counterfactual-failure-analysis
CommunityEvidence-bound counterfactual failure memos
Software Engineering#coding agents#counterfactual analysis#evidence memo#ee lab#replay validation#redaction compliance#causal hypotheses
AuthorDicklesworthstone
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill helps you write rigorous counterfactual failure-analysis memos for coding-agent outcomes by grounding the analysis in explicit ee lab evidence rather than speculation.
Core Features & Use Cases
- Counterfactual evidence for failed runs: Collects and analyzes
ee lab capture,ee lab replay, andee lab counterfactualJSON outputs to assess what changed between interventions. - Stop/Go guardrails against overclaiming: Refuses to conclude success and enforces evidence redaction, workspace scoping, provenance linkage, and replay-support requirements.
- Hypotheses with falsification paths: Produces an evidence-linked memo separating observed facts, replay-supported claims, hypotheses, and explicit assumptions.
Quick Start
Use the Skill to analyze why an agent failed by requesting a counterfactual failure memo grounded in the relevant ee lab JSON outputs for the same workspace and episode id.
Dependency Matrix
Required Modules
hashlibjsonsyspathlib
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: counterfactual-failure-analysis Download link: https://github.com/Dicklesworthstone/eidetic_engine_cli/archive/main.zip#counterfactual-failure-analysis Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.