challenge-gen

Generate targeted training challenges from edge cases and commit history.

14|6|Updated Feb 3, 2026

Search Tags:#debugging #edge cases #agent training #active learning #challenge generation #commit replay

Ready to run

npx skills add https://github.com/tyevans/tackline --skill challenge-gen

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: challenge-gen
Source: https://github.com/tyevans/tackline/tree/main/skills/workflows/challenge-gen
Command: npx skills add https://github.com/tyevans/tackline --skill challenge-gen

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automatically generates specific training challenges for AI agents, targeting their identified weaknesses to improve performance.

Core Features & Use Cases

Targeted Challenge Generation: Creates edge-case and commit-replay challenges based on an agent's struggle profile.
Weakness Calibration: Tailors challenges to specific identified gaps and weaknesses in an agent's performance.
Use Case: After running /diagnose-agent and identifying that an agent struggles with handling malformed user inputs, you can use challenge-gen to create specific scenarios that force the agent to practice robust input validation.

Quick Start

Generate training challenges for the 'billing-agent'.

Frequently Asked Questions about challenge-gen

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I generate targeted training challenges for AI agents?▼

Targeted challenge generation creates edge-case and commit-replay scenarios by researching domain weaknesses and analyzing commit history to calibrate specific, grounded training data for AI agents.

How does analyzing commit history help with agent training?▼

Analyzing commit history enables commit-replay challenges, which recreate specific past scenarios and edge cases to force agents to practice resolving identified gaps and weaknesses in their performance.

What's the best way to use challenge generation after diagnosing agent weaknesses?▼

After diagnosing agent weaknesses, challenge generation calibrates targeted edge-case scenarios to the identified struggle profile, forcing the agent to practice specific gaps like robust input validation.

Can I run challenge generation in parallel for multiple agent weakness profiles?▼

Challenge generation supports both serial and parallel execution modes, allowing you to efficiently process multiple agent struggle profiles and generate targeted training scenarios at scale.

When do I need to generate edge-case challenges for debugging agent performance?▼

You need edge-case challenges when an agent struggles with specific scenarios like handling malformed user inputs, allowing you to create targeted training data that forces practice on robust input validation.