rig

Runs seeded Shatterfish bot benchmarks and summarizes SPRT comparison results.

Updated Sep 3, 2026
One-click install
npx skills add https://github.com/watchthelight/shatterfish --skill rig-watchthelight
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: rig
Source: https://github.com/watchthelight/shatterfish/tree/main/.claude/skills/rig
Command: npx skills add https://github.com/watchthelight/shatterfish --skill rig-watchthelight

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Validating a game-playing bot requires reproducible, statistically sound measurements rather than anecdotal runs. This Skill runs the Shatterfish rig over seeded games for one brain or an A/B pair and produces the depth, turns, cause-of-death, and SPRT verdict numbers the project requires before any brain change merges. ## Core Features & Use Cases - Seeded benchmark runs: Executes the rig via ./gradlew :rig:run with named seed sets or counted seeds, recording per-run results to runs.jsonl, summary.json, and sprt.json. - A/B brain comparison: Runs SPRT comparisons between a candidate brain and a baseline, reporting accept/reject/undecided verdicts with LLR and bounds. - Results publishing: Writes docs/results/<date>-<sha>.md in the project's expected format so numbers land in the same PR as the brain change. - Use Case: After modifying the bot's tactical search, ask to compare the new brain against the last published baseline on the standard seed set, and receive a summary table plus a publishable results file. ## Quick Start Ask the assistant to run the rig comparing the current brain against the last published baseline on the standard seed set and publish the results.

Frequently Asked Questions about rig

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run the Shatterfish rig on a set of seeds?

Invoke the rig through `./gradlew :rig:run` with `--brain`, `--seeds`, and `--out` arguments, or ask the assistant to run the rig. The Skill defaults to the smoke seed set for quick checks and the standard set for publishable numbers.

How do I compare two bot brains statistically?

Pass `--brain` and `--baseline` to the rig to run an SPRT comparison across the seed set. The output includes an accept, reject, or undecided verdict with the log-likelihood ratio and bounds in `sprt.json`.

What happens if the rig module is not implemented yet?

The Skill checks for `RigMain.java` in the rig module first. If it is missing, it reports that the rig is E3 milestone work and stops instead of attempting a run.

Can the rig run in oracle mode with hidden game information?

No. Oracle mode cannot be enabled through the rig command, and the Skill must refuse any configuration that would enable it, enforcing the project's information-parity rule.

Why did two runs of the same seed produce different results?

Identical tag, seed, and action list must reproduce identical runs. A mismatch is a determinism bug that outranks the measurement itself, and the Skill reports it before anything else.