synthesis-feedback

Analyze synthesis build artifacts to identify quality bottlenecks and generate harness improvement recommendations.

1|Updated Jul 12, 2026
One-click install
npx skills add https://github.com/Tyler-R-Kendrick/slm-training --skill synthesis-feedback
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: synthesis-feedback
Source: https://github.com/Tyler-R-Kendrick/slm-training/tree/main/.agents/skills/synthesis-feedback
Command: npx skills add https://github.com/Tyler-R-Kendrick/slm-training --skill synthesis-feedback

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill addresses the challenge of maintaining high-quality training data by providing a structured feedback loop that links build artifacts directly to harness improvements, preventing the degradation of data quality over time.

Core Features & Use Cases

  • Automated Quality Auditing: Analyzes build artifacts like quality_report.json and rejected.jsonl to identify specific failure points in the synthesis pipeline.
  • Evidence-Based Improvement: Provides actionable recommendations for fixing producers and synthesizers rather than loosening quality gates.
  • Use Case: When a training data build shows high rejection rates, use this Skill to parse the synthesis_feedback.json and generate a targeted plan to refine the synthesis harness and improve yield.

Quick Start

Run the synthesis-feedback skill to analyze the latest build artifacts and generate improvement recommendations for the training harness.

Frequently Asked Questions about synthesis-feedback

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fix high rejection rates in my training data synthesis pipeline?

Analyze synthesis artifacts like rejected.jsonl and quality_report.json to trace failures back to specific synthesizer logic. This approach yields actionable harness adjustments rather than loosening strict data-gate invariants to improve yield.

What is a training data feedback loop and how does it prevent quality degradation?

A training data feedback loop prevents quality degradation by linking build artifacts directly to iterative harness improvements. It correlates rejection logs with synthesis logic adjustments to drive evidence-based refinement of producers and synthesizers.

How do I analyze rejected training data to improve my synthesis harness?

Analyze rejected training data by parsing synthesis_feedback.json to identify specific failure points in your synthesis pipeline. This generates a targeted plan to refine your training harness and improve build yield.

Does the synthesis feedback process require access to build output directories?

Yes, the synthesis feedback process requires access to build output directories to parse artifacts like rejected.jsonl and quality_report.json. It also mandates strict adherence to data-gate invariants to maintain quality assurance.

What is the best way to correlate rejection logs with synthesis logic adjustments?

The best way to correlate rejection logs with synthesis logic adjustments is using an automated quality auditing process. It evaluates quality reports against build artifacts to generate evidence-based recommendations for fixing producers.

Why should I refine the synthesis harness instead of loosening data quality gates?

You should refine the synthesis harness instead of loosening data quality gates because strict data-gate invariants prevent long-term quality degradation. Evidence-based improvements to producers and synthesizers increase yield without compromising training data integrity.