Calculate debate pair quality metrics and trends from repository artifacts.
npx skills add https://github.com/netbrain/ratchet --skill ratchet-score
Please help me install this Agent Skill. Skill: ratchet:score Source: https://github.com/netbrain/ratchet/tree/main/skills/score Command: npx skills add https://github.com/netbrain/ratchet --skill ratchet-score
Consolidates debate and review artifacts to surface per-pair quality metrics, surface regressions, and provide an evidence-backed view of agent pair performance so teams can prioritize tuning and interventions.
Run /ratchet:score to display quality metrics and trends for the current workspace or provide a pair name to focus on a single pair.
High-intent search queries and answers about installing and using this skill.
Track code review quality metrics by calculating consensus rates, average rounds, and verdict distributions from debate artifacts, then persisting them with an exponential moving average to smooth historical trends.
Measure debate consensus rates and review effectiveness by ingesting per-pair metadata and review JSON artifacts to compute average effectiveness, gen vs adv splits, and top missed issues.
Calculate quality scores from archived artifacts by reading workspace metadata and review JSON files, computing epoch metrics, and using historical fallbacks to maintain trend accuracy.
Yes, exponential moving average smoothing works for cross-workspace comparisons by applying an alpha of 0.3 to update scores, allowing pair metrics to survive archival and support trend analysis.
Monitor fast-path usage in agent pair debates to evaluate review effectiveness and identify regressions, providing an evidence-backed view of agent performance to prioritize tuning and interventions.
Yes, you can analyze a single agent pair's performance by providing the specific pair name, which focuses the quality metrics and trend analysis on that pair alone.
netbrainInspect and continue Ratchet debates from stored .ratchet/debris round files and metadata.
netbrainRecord human verdicts for escalated Ratchet debates and update plan files.
netbrainRecords ad-hoc discoveries into the Ratchet plan's .ratchet/plan.yaml.
ebrahim-saniAnalyzes on-chain metrics to generate signal tables and plain-language conclusions.
