Automate multi-turn Q&A evaluation workflows for AI model comparisons.
npx skills add https://github.com/MinhOmega/marlin-skill --skill checkpoint-qa
Please help me install this Agent Skill. Skill: checkpoint-qa Source: https://github.com/MinhOmega/marlin-skill/tree/main/.claude/skills/checkpoint-qa Command: npx skills add https://github.com/MinhOmega/marlin-skill --skill checkpoint-qa
Coordinates end-to-end Q&A evaluation for AI model comparisons by brainstorming questions, proposing answers, and validating responses against evaluation criteria.
Invoke the skill with a workspace path and a turn number to auto-generate questions and kick off the evaluation workflow.
High-intent search queries and answers about installing and using this skill.
Automate Q&A evaluation for AI model comparison by invoking the skill with a workspace path and turn number to auto-generate questions, evaluate responses, and export per-turn QA artifacts.
Generate an overall preference justification for multi-turn evaluations by evaluating CTV responses against structured criteria, producing a documented justification file in the output workspace.
Multi-turn Q&A evaluation handles preset and custom questions by reading input from turn evaluation files, brainstorming questions, suggesting answers with evidence, and exporting artifacts per turn.
Checkpoint-review is integrated into the AI model comparison workflow, automatically invoking output validation and rewriting mechanisms on each generated per-turn QA artifact.
Automated prompt engineering evaluations require turn evaluation markdown files located at workspace/turn_N/turn_N_evaluation.md as input to generate questions and QA artifacts.
moonlight-lupinDistribute prompts to multiple AI models and log blind comparison votes.
centminmodAnalyze Claude Code JSONL logs to compute per-turn token usage and cost estimates.
clearclownCoordinates 5-phase AIDA pipeline workflows with Leader and Player subagent delegation.
yanochka11Optimize declarative language model programs with automated improvement workflows.
