best-of-n-with-judge

What problem does it solve?

This Skill streamlines the process of generating, vetting, and selecting the best implementation among multiple candidates by automating parallel code generation, testing, review, and consensus procedures.

Core Features & Use Cases

• Parallel candidate generation: Creates multiple implementation options simultaneously, reducing manual effort.
• Automated testing and validation: Runs tests and linting to gate candidates and ensure quality.
• Blind review and voting: Uses structured oracle assessments to evaluate candidate approaches objectively.
• Decision arbitration: Resolves ties via council arbitration or repeats with feedback.
• Use Case: Ideal for high-stakes code refactoring where multiple design options are explored, and the best solution must be objectively determined.

Quick Start

Command the AI to generate multiple solutions for a specified task, then automatically test, review, and select the best candidate, handling tie-breaks and cleanups seamlessly.