genesis-evals

Automate Genesis self-eval suite scoring with parallel sub-agents.

61|9|Updated Apr 25, 2026
One-click install
npx skills add https://github.com/danielmeppiel/genesis --skill genesis-evals
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: genesis-evals
Source: https://github.com/danielmeppiel/genesis/tree/main/dev/skills/genesis-evals
Command: npx skills add https://github.com/danielmeppiel/genesis --skill genesis-evals

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, jsonschema, and includes scripts (resource) components.

What problem does it solve?

Automates maintainer-side evaluation of Genesis changes by running and scoring the self-eval suite, ensuring PR and catalogue changes are validated before shipping.

Core Features & Use Cases

  • Orchestrates parallel cold-spawn sub-agents to execute the genesis self-eval scenarios.
  • Applies deterministic scoring and convergence checks to guarantee stable, repeatable results.
  • Produces a run summary with a verifiable run-id to support PR verification and audit trails.

Quick Start

Install and invoke the maintainer eval workflow to validate a PR or catalogue update.

Frequently Asked Questions about genesis-evals

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate maintainer-side evaluation and scoring for pull request changes?

Automating maintainer-side evaluation requires running the self-eval suite to validate PR changes, applying deterministic scoring and convergence checks across parallel sub-agents to guarantee stable, repeatable results before shipping.

What is a cold-spawn sub-agent orchestration workflow for automated evaluation?

Cold-spawn sub-agent orchestration runs parallel scenarios independently, generating pre-spawn records and applying explicit model prompts to ensure isolated, deterministic evaluation without user-facing context leakage.

How do I validate catalogue or PR updates with deterministic convergence checks?

Validating PR updates involves running parallel sub-agents that apply deterministic scoring, reporting convergence within a maximum of three iteration loops to ensure stable results and produce an auditable run summary.

Does the eval suite require loading external skills context into the user-facing bundle?

The loaded-skills context remains explicitly outside the user-facing bundle to prevent context leakage, ensuring that evaluation prompts and pre-spawn records stay isolated during the scoring process.

Do I need pyyaml and jsonschema to run automated evaluation orchestration scripts?

Yes, the orchestration scripts depend on pyyaml and jsonschema to parse configuration and validate schemas during the automated evaluation and deterministic scoring workflow.

Why does automated PR evaluation limit convergence to a maximum of three iteration loops?

Limiting convergence to three iteration loops ensures repeatable, stable scoring results while bounding the computational overhead of parallel sub-agent execution during the evaluation cycle.