skills.rest
EurecaMoment
EurecaMomentOFFICIAL
Explore all skills by this author →
GitHub

benchclaw-stage4-template-compilation

Generate benchmark templates and synthesis plans from input parameters.

Updated May 7, 2026
Search Tags:#benchmarking#template generation#benchmark evaluation#synthesis planning#benchmark item creation
One-click install
npx skills add https://github.com/EurecaMoment/BenchClaw --skill benchclaw-stage4-template-compilation
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: benchclaw-stage4-template-compilation
Source: https://github.com/EurecaMoment/BenchClaw/tree/main/BenchClaw/skills/benchmark-stage4-build/skills/template-metric-code-generation/subskills/template-compilation
Command: npx skills add https://github.com/EurecaMoment/BenchClaw --skill benchclaw-stage4-template-compilation

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the generation of benchmark templates and synthesis plans for Stage 4 of the BenchClaw benchmark manufacturing process, streamlining the creation of benchmark items.

Core Features & Use Cases

  • Template Generation: Automatically generates template_manifest.jsonl and synthesis_plan.yaml based on input parameters.
  • Input Handling: Processes input files such as stage4_execution_plan.yaml, gt_kinship/*, and image_processing/image_manifest.jsonl.
  • Output Formatting: Outputs structured data required for item generation and evaluation.
  • Use Case: When constructing a benchmark, this Skill can be used to automatically generate the necessary templates and plans, ensuring consistency and efficiency in the benchmark creation process.

Quick Start

Run the benchclaw-stage4-template-compilation skill with the required inputs to generate the templates and synthesis plan for your benchmark.

Frequently Asked Questions about benchclaw-stage4-template-compilation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate benchmark templates and synthesis plans for item creation?▼

Benchmark template generation requires input files like stage4_execution_plan.yaml and image_processing/image_manifest.jsonl. Processing these inputs produces structured template_manifest.jsonl and synthesis_plan.yaml outputs required for downstream item generation.

What input files are needed to create a benchmark synthesis plan?▼

Creating a benchmark synthesis plan requires stage4_execution_plan.yaml, gt_kinship/* directory contents, and image_processing/image_manifest.jsonl as inputs to produce the structured synthesis_plan.yaml output.

How does template compilation work in the benchmark manufacturing process?▼

Template compilation works by processing execution plans and image manifests to automatically generate structured benchmark templates. It streamlines Stage 4 of benchmark manufacturing by ensuring consistency across item creation and evaluation outputs.

Can I use benchmark template generation without providing an image manifest?▼

Benchmark template generation requires image_processing/image_manifest.jsonl as a mandatory input. Without providing the image manifest, the compilation cannot produce the structured template_manifest.jsonl and synthesis_plan.yaml outputs needed for item generation.

What is the best way to automate benchmark item creation and evaluation?▼

Automating benchmark item creation is best achieved by compiling stage4_execution_plan.yaml and image manifests into template_manifest.jsonl and synthesis_plan.yaml, ensuring consistent structured output for the entire benchmark evaluation process.

Related Skills

Explore More Software Engineering Skills→
perfectuser21perfectuser21

douyin-publisher

Automate publishing images, videos, and articles to Douyin via Playwright.

Community
Advanced
surus-latsurus-lat
8

synthesize-data

Generate synthetic benchmark datasets as JSONL input-output pairs from task specifications.

Official
Intermediate
EurecaMomentEurecaMoment

benchclaw-stage4-answer-image-processing

Generate BenchCLaw Stage4 answer images with annotations and composition from JSONL inputs using PIL and image processing techniques.

Official
Advanced
EurecaMomentEurecaMoment

benchclaw-stage4-plan-generation

Transform benchmark intent and evidence into a Stage 4 execution plan.

Official
Advanced