dataset-synthesizer-revisor

Community

Audit JSONL datasets before fine-tuning

Authorjoleques
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill prevents low-quality JSONL fine-tuning datasets from being used for training by detecting placeholders, AI apology traces, JSON syntax errors, and content imbalance that would degrade model behavior.

Core Features & Use Cases

  • Placeholder and marker detection: Identifies unresolved tokens such as [Preencher...], [INSIRA...], [Seu nome] and other generator artifacts.
  • AI-error and apology tracing: Flags machine-error remnants and "AI-splaining" phrases that should not appear in production training data.
  • JSONL structural validation: Verifies each line is a standalone valid JSON record with required root keys and correct escaping to avoid ingestion failures.
  • Line-by-line audit reporting: Produces a Markdown report with total lines analyzed, problematic line counts, per-line anomaly descriptions, and precise remediation recommendations saved next to the original dataset.
  • Use Case: Data QA and ML engineers validating synthesized datasets for customer support or documentation fine-tuning workflows.

Quick Start

Use the skill to analyze the file path/to/dataset.jsonl and produce a line-by-line Markdown audit report saved next to the original file.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: dataset-synthesizer-revisor
Download link: https://github.com/joleques/northstar-ai/archive/main.zip#dataset-synthesizer-revisor

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.