skills.rest
JayFarei
JayFareiCOMMUNITY
Explore all skills by this author →
Website𝕏@jayfareiGitHub

skill-rollouts-v1

Generate synthetic rollout rows for skill evaluation tasks as JSONL files.

92|6|Updated Mar 27, 2026
Search Tags:#skill development#automated testing#skill evaluation#synthetic testing#rollout generation
One-click install
npx skills add https://github.com/JayFarei/opentraces --skill skill-rollouts-v1
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-rollouts-v1
Source: https://github.com/JayFarei/opentraces/tree/main/src/opentraces/workflow_templates/skill-rollouts-v1
Command: npx skills add https://github.com/JayFarei/opentraces --skill skill-rollouts-v1

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill automates the creation of synthetic rollout rows for candidate skill versions, streamlining the process of evaluating and testing new skill versions.

Core Features & Use Cases

  • Synthetic Rollouts: Generates deterministic synthetic rollout rows for skill-eval-tasks-v1 tasks.
  • Builder: Uses the SkillOpt fake re-rollout runner and writes transcript references alongside the output JSONL.
  • Use Case: Ideal for quickly creating a set of synthetic rollouts to test a new skill version without manual setup.

Quick Start

Run the skill-rollouts-v1 script with the source JSONL file and output directory as arguments.

Frequently Asked Questions about skill-rollouts-v1

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate synthetic rollouts for skill evaluation tasks?▼

You generate synthetic rollouts by running the skill-rollouts-v1 script with a source JSONL file and an output directory, which writes the synthetic rows and transcript references to a new JSONL file.

What is a synthetic rollout in skill development?▼

Synthetic rollouts are deterministic test rows generated for skill-eval-tasks-v1 tasks. They allow developers to quickly test a new skill version by automating the data generation process instead of manual setup.

Do I need specific input formats to automate candidate skill version testing?▼

Yes, automated skill testing requires a source JSONL file containing task definitions and a specified output directory to write the generated synthetic rollouts and transcript references.

Can I use a fake re-rollout runner for deterministic skill testing?▼

Yes, you can use the SkillOpt fake re-rollout runner to generate deterministic synthetic rollouts. It writes transcript references alongside the output JSONL files to support your evaluation workflow.

What's the best way to test new skill versions without manual setup?▼

The best way to test new skill versions without manual setup is to automate synthetic rollout generation using a custom runner. This outputs structured JSONL files for deterministic skill evaluation tasks.

Related Skills

Explore More Software Engineering Skills→
JayFareiJayFarei
92

skill-eval-tasks-v1

Convert reviewed skill episodes into leakage-safe eval task rows for Dtrain, Dsel, and Dtest splits.

Community
Intermediate
519lab519lab
2

evaluating-llms-harness

Evaluate large language models on standardized benchmarks like MMLU and GSM8K.

Official
Advanced
XWIlluDeluXWIlluDelu

anthropic-skill-creator

Draft, evaluate, and optimize Claude Code skill instructions and triggers.

Community
Advanced
Venkateshvenki404224Venkateshvenki404224
25

frappe-data-migration-generator

Generate Python data migration scripts for importing CSV files into Frappe DocTypes.

Community
Intermediate