Run end-to-end regression tests on the opi runtime and analyze fidelity.
npx skills add https://github.com/OdradekAI/opi --skill opi-eval
Please help me install this Agent Skill. Skill: opi-eval Source: https://github.com/OdradekAI/opi/tree/main/.claude/skills/opi-eval Command: npx skills add https://github.com/OdradekAI/opi --skill opi-eval
This Skill assesses the fidelity and performance of the opi runtime by executing comprehensive regression tests against real LLM providers, collecting runtime traces, and dispatching an independent evaluator subagent for detailed analysis.
Run the opi-eval skill with the default configuration to evaluate the opi runtime and detect fidelity degradation.
High-intent search queries and answers about installing and using this skill.
Regression testing for runtime fidelity requires compiling the opi binary and executing structured test cases against real LLM providers to detect performance degradation. An independent evaluator subagent then analyzes runtime signals and test definitions across multiple dimensions.
End-to-end runtime assessment executes structured test cases against real LLM providers to measure fidelity. It collects runtime traces and dispatches an evaluator subagent to analyze performance metrics, generating structured reports with pass rates and trends.
Detect fidelity degradation by running structured regression tests against real LLM providers. The evaluation process collects runtime traces and generates detailed report files containing pass rates and metrics to identify performance drops.
Yes, comprehensive runtime assessment requires an evaluator subagent to analyze test case definitions, runtime signals, and evaluation dimensions. The opi binary and structured test cases are also necessary to execute the regression testing process.
A regression test report includes structured extraction files with pass rates, metrics, and performance trends. The evaluation results document fidelity assessment across multiple dimensions based on runtime signals collected during test case execution.
Yes, runtime fidelity evaluation executes structured test cases directly against real LLM providers. This approach captures authentic runtime traces and signals for the evaluator subagent to analyze, ensuring accurate regression and fidelity assessment.
arozumenkoConvert manual TMS test cases into executable end-to-end automation workflows.
comeritoIdentify changed files in a pull request and assess them against architecture, security, and quality rules.
samhvw8Orchestrate autonomous coding workflows within Claude Code.
mneves75Apply Test-Driven Development to create and test AI skills.
