bootstrap-failures

Community

Seed evals with real production failure cases for effective testing.

Authorats-kinoshita-iso
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill helps teams incorporate real failure instances from bug reports, incidents, and manual tests into their eval suite, enhancing test relevance and coverage.

Core Features & Use Cases

  • Ingestion of Failure Data: Import failure cases from bug trackers, QA notes, and support tickets into a structured catalog.
  • Automated Catalog Construction: Convert raw failure reports into JSON entries with relevant metadata for evaluation purposes.
  • Use Case: Start your eval development by seeding 20-50 real failure scenarios to reflect actual user issues and system flaws.

Quick Start

Gather failure reports and add each as an entry in failure-catalog.json, then run /harness-kickoff to integrate them into your eval workflow.

Dependency Matrix

Required Modules

None required

Components

references

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: bootstrap-failures
Download link: https://github.com/ats-kinoshita-iso/trine-eval/archive/main.zip#bootstrap-failures

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.