running-evals
CommunityAutomate comprehensive AI evals and deterministic tests with a single command.
Software Engineering#code quality#agent behavior#AI evaluation#deterministic testing#codebase assessment
Authorsouliane
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill simplifies the process of running both AI evaluations and deterministic tests on a codebase, reducing the complexity of evaluating agent behavior and ensuring code quality.
Core Features & Use Cases
- Automated Evaluation: Run both AI evaluations and deterministic tests in one command.
- AI/trajectory lane: Prepare, produce, and grade in-session transcripts.
- Deterministic lanes: Run tests like pinned-regressions without a model.
- Use Case: For a code review, use this Skill to automatically evaluate both the AI agent's behavior and the deterministic test results to get a comprehensive picture of code quality.
Quick Start
Run the full eval suite with a single command: /t3:running-evals
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: running-evals Download link: https://github.com/souliane/teatree/archive/main.zip#running-evals Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.