ob

Automate SPRT test submission and result reading for Coda on OpenBench.

18|3|Updated Mar 27, 2026
One-click install
npx skills add https://github.com/adamtwiss/coda --skill ob-adamtwiss
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ob
Source: https://github.com/adamtwiss/coda/tree/main/.claude/skills/ob
Command: npx skills add https://github.com/adamtwiss/coda --skill ob-adamtwiss

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill provides a structured way to handle all operations related to the OpenBench platform for the Coda chess engine, including benchmarking, submission, tuning, and result reading, saving users time and preventing common errors.

Core Features & Use Cases

  • Benchmark Measurement: Automates the benchmarking process for Coda to ensure consistency with OpenBench.
  • SPRT Submission: Simplifies the process of submitting new chess positions to SPRT for testing against Stockfish.
  • SPSA Tune Submission: Allows users to submit SPSA tune requests to improve Coda's performance.
  • Test Stopping and Status Checks: Offers functionality to stop running tests and check their status, aiding in resource management.
  • Error Detection and Analysis: Detects and helps users diagnose common issues such as "Wrong Bench" errors.
  • Use Case: Suppose you've developed a new tuning algorithm for the Coda chess engine. Use this Skill to bench it against Stockfish and submit an SPRT test, ensuring your work aligns with OpenBench standards.

Quick Start

Invoke the OB Skill with 'ob Submit <dev_branch> <dev_bench> --base-bench <base_bench>' to submit an SPRT test.

Frequently Asked Questions about ob

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I submit an SPRT test for a chess engine on OpenBench?

To submit an SPRT test for a chess engine on OpenBench, you provide your dev branch and dev bench to the Skill, which then formats and automates the test submission against the base bench.

What is the best way to benchmark a chess engine before an OpenBench SPRT test?

Benchmarking a chess engine before an OpenBench SPRT test is best handled by automating the measurement process, ensuring your build produces the consistent baseline metrics required for valid submission.

Why does my OpenBench test fail with a Wrong Bench error?

Your OpenBench test fails with a Wrong Bench error when the submitted benchmark does not match the platform's expected value. This Skill detects the mismatch and helps diagnose the configuration issue.

Can I submit SPSA tuning requests for Coda through OpenBench?

Yes, you can submit SPSA tuning requests for Coda through OpenBench. The Skill simplifies submitting these tuning requests to systematically improve the engine's search performance.

Do I need OpenBench API access to manage chess engine SPRT tests?

Yes, you need OpenBench API access and Coda engine builds to manage chess engine SPRT tests. This Skill automates the interactions but requires valid API credentials to submit and read results.

How do I check the status of or stop running SPRT tests on OpenBench?

To check the status of or stop running SPRT tests on OpenBench, use the Skill's test management functions, which query the platform to retrieve current progress or halt resource-consuming tests.