Benchmark Claude Code rules and skills with before/after comparisons.
npx skills add https://github.com/patrykk21/dotfiles --skill benchmark-patrykk21
Please help me install this Agent Skill. Skill: benchmark Source: https://github.com/patrykk21/dotfiles/tree/main/claude/skills/benchmark Command: npx skills add https://github.com/patrykk21/dotfiles --skill benchmark-patrykk21
This Skill allows users to measure the impact of Claude Code rules, skills, and workflows by running quantitative before/after comparisons and evaluating the outputs against assertions.
Run a benchmark to compare the performance of a rule pack with 'claude benchmark <rule-pack-name> --with rules <rule-pack-path> --without rules ~/.claude/rules/'.
High-intent search queries and answers about installing and using this skill.
You can measure their impact by running quantitative before/after comparisons and evaluating outputs against falsifiable assertions to ensure accurate assessment.
Assertion-based evaluation grades Claude Code outputs against falsifiable, discriminative assertions to generate detailed reports with pass rates and timing.
Run a benchmark command comparing performance with and without the target rules, such as 'claude benchmark <rule-pack-name> --with rules <rule-pack-path> --without rules ~/.claude/rules/'.
Yes, you need Python installed along with pypdf, pdfplumber, and pdf2image to handle the filesystem operations and text extraction required for benchmarking.
Benchmarking ensures accurate evaluation by enforcing filesystem sandboxing and auto-hiding global rules, isolating the target rules for precise measurement.
The benchmarking process generates detailed reports containing pass rates, timing metrics, and concrete evidence of the evaluation against assertions.
AnishWerkstattExtract text and tables from PDFs using Python scripts.
dparedesiCreate, evaluate, and improve Claude Skills using templates and scoring rubrics.
barkleesandersCreate, modify, and optimize custom Claude Code skills with structured workflows.
JediNightAutomate paper trading analysis with a 6-stage pipeline and Minervini risk rules.
