mixseek-evaluator-config

What problem does it solve?

This Skill helps you create MixSeek evaluation and judgment configuration files without manually reasoning through metric selection, weight balance, or schema details.

Core Features & Use Cases

• Evaluator Config Generation: Drafts evaluator.toml files with the right model, metrics, and weighting for scoring submissions.
• Judgment Config Generation: Produces judgment.toml files that define deterministic final decision logic for comparisons and tournaments.
• Validation Guidance: Explains the required TOML structure, supported metric names, and common setup pitfalls so configurations are usable on the first pass.
• Use Case: A team preparing a benchmark run can use this Skill to choose relevance, coverage, and coherence metrics, assign balanced weights, and set stable evaluation parameters.

Quick Start

Ask for a MixSeek evaluation setup tailored to your task, and I will draft the evaluator and judgment configuration files you need.