synthetic-data-generate-eval
OfficialGrade synthetic data runs for demo-quality fitness.
Data & Analytics#manifest validation#synthetic data evaluation#data quality grading#data plausibility#demo data validation#ACE workflow
Authordimagi-internal
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Manually validating synthetic data generation runs to ensure they produce demo-quality, believable data is time-consuming and prone to oversight, especially when schema-conformant data can still be obviously synthetic and unusable for stakeholder demos.
Core Features & Use Cases
- Multi-dimension grading: Evaluates 6 weighted dimensions including record count health, form schema coverage, out-of-chain data plausibility, warning honesty, manifest provenance, and operator next steps.
- Hard fitness gates: Automatically fails runs with obviously synthetic/garbage data even if they meet all schema conformance requirements, ensuring only believable data passes validation.
- Use Case: For ACE Phase 7 Plan B workflows, this skill validates that labs-side synthetic generation for Connect opportunities produces enough visits, correctly round-trips named FLWs with their promised archetypes, and generates data that would pass a domain expert's casual review of the labs dashboard.
Quick Start
Use the synthetic-data-generate-eval skill to evaluate the latest synthetic data generation run for your active Connect opportunity and produce a formal quality verdict file.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: synthetic-data-generate-eval Download link: https://github.com/dimagi-internal/ace/archive/main.zip#synthetic-data-generate-eval Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 537,000+ vetted skills library on demand.