opi-eval
OfficialEvaluate the fidelity of the opi runtime through end-to-end regression testing.
AuthorOdradekAI
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill assesses the fidelity and performance of the opi runtime by executing comprehensive regression tests against real LLM providers, collecting runtime traces, and dispatching an independent evaluator subagent for detailed analysis.
Core Features & Use Cases
- Regression Testing: Compiles the opi binary and runs structured test cases to detect fidelity degradation.
- Independent Evaluation: An evaluator subagent analyzes test case definitions, runtime signals, and evaluation dimensions.
- Reporting: Generates structured extraction and detailed report files with pass rates, metrics, and trends.
Quick Start
Run the opi-eval skill with the default configuration to evaluate the opi runtime and detect fidelity degradation.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: opi-eval Download link: https://github.com/OdradekAI/opi/archive/main.zip#opi-eval Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.