skills.rest
nikhillinit
nikhillinitCOMMUNITY
Explore all skills by this author →
GitHub

phoenix-truth-case-orchestrator

Coordinate truth-case workflows, compute pass rates, and classify failures for Phoenix VC fund modeling.

Updated Jul 21, 2025
Search Tags:#testing#validation#orchestration#ci#phase-routing#truth-cases
One-click install
npx skills add https://github.com/nikhillinit/Updog_restore --skill phoenix-truth-case-orchestrator
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: phoenix-truth-case-orchestrator
Source: https://github.com/nikhillinit/Updog_restore/tree/main/.claude/skills/phoenix-truth-case-orchestrator
Command: npx skills add https://github.com/nikhillinit/Updog_restore --skill phoenix-truth-case-orchestrator

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill coordinates all truth-case work for the Phoenix VC fund modeling platform. It computes module-level pass rates, updates phase0-validation-report.md and docs/failure-triage.md, and helps decide routing between Phase 1A/1B/1C based on gate thresholds.

Core Features & Use Cases

  • Orchestrates truth-case suites across modules and scenarios, including tests/truth-cases/runner.test.ts
  • Updates module-level pass rates and Phase routing decisions in docs
  • Classifies failures as CODE BUG, TRUTH CASE ERROR, or MISSING FEATURE to guide remediation
  • Guides path decisions (Phase 1A vs 1B vs 1C) based on gate thresholds

Quick Start

Run the truth-case orchestrator against Phoenix truth-case corpus, then review the validation reports. Example:

  • npm test -- tests/truth-cases/runner.test.ts --run --reporter=verbose
  • Open docs/phase0-validation-report.md and docs/failure-triage.md to review results and recommended path

Frequently Asked Questions about phoenix-truth-case-orchestrator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I orchestrate truth-case validation workflows for Phoenix fund modeling?▼

Truth-case orchestration coordinates end-to-end validation across Phoenix modules by running test suites, computing pass rates, classifying failures as CODE BUG, TRUTH CASE ERROR, or MISSING FEATURE, and routing decisions between Phase 1A/1B/1C based on gate thresholds. Run npm test against tests/truth-cases/runner.test.ts with verbose reporting to execute and review results in generated validation reports.

What does phase routing based on gate thresholds mean in truth-case testing?▼

Phase routing automatically directs Phoenix modeling work between Phase 1A, 1B, or 1C based on module-level pass-rate metrics computed from truth-case suites. Gate thresholds define minimum pass rates required to advance; failures below thresholds trigger remediation classification and detailed triage documentation to guide next steps.

How do I classify truth-case failures to guide remediation priorities?▼

Failure classification tags each truth-case failure as CODE BUG, TRUTH CASE ERROR, or MISSING FEATURE. This categorization populates docs/failure-triage.md to help teams distinguish implementation gaps from test design issues, directing remediation efforts to the correct module or validation owner.

Can I use truth-case orchestration with continuous integration pipelines?▼

Yes. Truth-case orchestration integrates into CI workflows through npm test execution against the runner.test.ts suite, generating structured validation reports and phase routing decisions. Automated updates to phase0-validation-report.md and failure-triage.md enable CI gates and downstream deployment decisions.

What outputs does the truth-case orchestrator generate?▼

The orchestrator generates module-level pass-rate metrics, updates phase0-validation-report.md with routing decisions, populates docs/failure-triage.md with classified failures, and produces verbose test reporter output. These artifacts guide phase advancement, remediation prioritization, and validation sign-off.

Do I need existing test infrastructure to run truth-case orchestration?▼

Truth-case orchestration requires tests/truth-cases/runner.test.ts and a truth-case JSON corpus already in place. No external dependencies are listed; the Skill parses runner outputs and truth-case JSONs to compute metrics and populate validation docs, so basic Node.js/npm test execution is the minimum prerequisite.

Related Skills

Explore More Software Engineering Skills→
masharrattmasharratt
14

json-validation

Validate AGENT_SUCCESS_CRITERIA JSON with strict schema enforcement.

Community
Intermediate
yabafreyabafre
2

aped-triage

Classify and route incoming issues through a structured triage state machine.

Community
Advanced
redpanda-dataredpanda-data
34

triage

Automate issue categorization, labeling, and comments on GitHub and Jira.

Official
Intermediate
DarkMonkDevDarkMonkDev
1

test-catalog-updater

Update TEST_CATALOG.md with test metrics, status, and failure details.

Community
Intermediate