benchclaw-stage4-template-compilation

Name: benchclaw-stage4-template-compilation
Availability: InStock
Author: EurecaMoment

Generate benchmark templates and synthesis plans from input parameters.

Updated May 7, 2026

Search Tags:#benchmarking #template generation #benchmark evaluation #synthesis planning #benchmark item creation

Ready to run

npx skills add https://github.com/EurecaMoment/BenchClaw --skill benchclaw-stage4-template-compilation

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: benchclaw-stage4-template-compilation
Source: https://github.com/EurecaMoment/BenchClaw/tree/main/BenchClaw/skills/benchmark-stage4-build/skills/template-metric-code-generation/subskills/template-compilation
Command: npx skills add https://github.com/EurecaMoment/BenchClaw --skill benchclaw-stage4-template-compilation

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the generation of benchmark templates and synthesis plans for Stage 4 of the BenchClaw benchmark manufacturing process, streamlining the creation of benchmark items.

Core Features & Use Cases

Template Generation: Automatically generates template_manifest.jsonl and synthesis_plan.yaml based on input parameters.
Input Handling: Processes input files such as stage4_execution_plan.yaml, gt_kinship/*, and image_processing/image_manifest.jsonl.
Output Formatting: Outputs structured data required for item generation and evaluation.
Use Case: When constructing a benchmark, this Skill can be used to automatically generate the necessary templates and plans, ensuring consistency and efficiency in the benchmark creation process.

Quick Start

Run the benchclaw-stage4-template-compilation skill with the required inputs to generate the templates and synthesis plan for your benchmark.

Frequently Asked Questions about benchclaw-stage4-template-compilation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I generate benchmark templates and synthesis plans for item creation?▼

Benchmark template generation requires input files like stage4_execution_plan.yaml and image_processing/image_manifest.jsonl. Processing these inputs produces structured template_manifest.jsonl and synthesis_plan.yaml outputs required for downstream item generation.

What input files are needed to create a benchmark synthesis plan?▼

Creating a benchmark synthesis plan requires stage4_execution_plan.yaml, gt_kinship/* directory contents, and image_processing/image_manifest.jsonl as inputs to produce the structured synthesis_plan.yaml output.

How does template compilation work in the benchmark manufacturing process?▼

Template compilation works by processing execution plans and image manifests to automatically generate structured benchmark templates. It streamlines Stage 4 of benchmark manufacturing by ensuring consistency across item creation and evaluation outputs.

Can I use benchmark template generation without providing an image manifest?▼

Benchmark template generation requires image_processing/image_manifest.jsonl as a mandatory input. Without providing the image manifest, the compilation cannot produce the structured template_manifest.jsonl and synthesis_plan.yaml outputs needed for item generation.

What is the best way to automate benchmark item creation and evaluation?▼

Automating benchmark item creation is best achieved by compiling stage4_execution_plan.yaml and image manifests into template_manifest.jsonl and synthesis_plan.yaml, ensuring consistent structured output for the entire benchmark evaluation process.