q2mm-benchmark

Audits and validates q2mm benchmark batches with pre-flight success specs and optimizer config checks.

27|29|Updated Aug 26, 2014
One-click install
npx skills add https://github.com/ericchansen/q2mm --skill q2mm-benchmark
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: q2mm-benchmark
Source: https://github.com/ericchansen/q2mm/tree/main/.copilot/skills/q2mm-benchmark
Command: npx skills add https://github.com/ericchansen/q2mm --skill q2mm-benchmark

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides a structured guardrails framework for planning, auditing, and validating large q2mm benchmark batches, ensuring fast failure on issues and reliable post-batch validation.

Core Features & Use Cases

  • Pre-flight success spec: Define acceptance criteria before any long-running batch.
  • Sanity-check optimizer config: Validate bounds, ftol, and ratio gate settings to avoid wasteful runs.
  • FIRST-system audit gate: Audit the initial system to catch fundamental issues before launching the rest.
  • Post-batch validation: Collect and inspect convergence results to confirm batch integrity.

Quick Start

Define the success spec and run the FIRST-system audit before launching any additional systems.

Frequently Asked Questions about q2mm-benchmark

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate optimizer configs before running a benchmark batch?

To validate optimizer configs before a benchmark batch, use a pre-flight audit to sanity-check bounds, ftol, and ratio gate settings, preventing wasteful long-running runs and ensuring configuration integrity.

What is a pre-flight audit for multi-system benchmarking?

A pre-flight audit for multi-system benchmarking is a validation process that defines acceptance criteria and applies sanity checks to configurations, ensuring success specs are established before executing large batches.

How do I set up a success spec for batch benchmark validation?

To set up a success spec for batch benchmark validation, define your acceptance criteria and pass an initial system audit gate, ensuring fundamental issues are caught before launching additional systems.

Can I audit the first system to catch issues before launching the rest of a batch?

Yes, you can audit the first system to catch fundamental issues before launching the rest of a batch, using an audit gate to ensure early failure on configuration or setup problems.

What is the best way to document post-batch validation results?

The best way to document post-batch validation results is to collect and inspect convergence data after the batch completes, confirming batch integrity and recording whether the success spec was met.

Why do I need pre-flight checks for long-running optimization batches?

Pre-flight checks are needed for long-running optimization batches to enforce fast failure on misconfigured bounds or ftol settings, avoiding wasted compute resources and ensuring batch reliability.