dataset-qos-slo-designer

Define measurable dataset SLOs and executable quality checks for research training and evaluation data.

Updated Jul 16, 2026
One-click install
npx skills add https://github.com/Cloud-Byte-Consulting/plugins --skill dataset-qos-slo-designer-cloud-byte-consulting
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: dataset-qos-slo-designer
Source: https://github.com/Cloud-Byte-Consulting/plugins/tree/main/research-data-platform/skills/dataset-qos-slo-designer
Command: npx skills add https://github.com/Cloud-Byte-Consulting/plugins --skill dataset-qos-slo-designer-cloud-byte-consulting

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Vague goals like "we need better quality data" leave producers and consumers of research datasets without shared, enforceable expectations. This Skill replaces undefined expectations with named quality dimensions, numeric objectives, and executable checks, producing a negotiated SLO document per dataset that pipelines can enforce. ## Core Features & Use Cases - SLI/SLO/SLA framework: Walks the seven EDM Council data-quality dimensions (accuracy, completeness, conformity, consistency, coverage, timeliness, uniqueness) crossed with service-level indicators like availability, freshness, retention, and incident clocks (Td/Tn/Tr). - Enforcement mapping: Maps every SLO to executable checks using SodaCL or Great Expectations, wired into Airflow/Argo orchestration, with per-check violation policies (halt, quarantine, or segment). - Negotiated SLO document: Produces a structured template covering parties, objectives, intrinsic/extrinsic splits, enforcement tables, lifecycle policies, and review cadence. - Use Case: A research team needs to guarantee that an evaluation set stays frozen and free of train/eval contamination. Use this Skill to define a zero-overlap uniqueness SLO with a pre-publish contamination scan that halts publication on violation. ## Quick Start Use the dataset-qos-slo-designer skill to draft an SLO document with executable quality checks for our training corpus covering label accuracy, deduplication, and freshness.

Frequently Asked Questions about dataset-qos-slo-designer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I define SLOs for a machine learning dataset?

Dataset SLOs are defined by selecting a minimal set of quality dimensions (accuracy, completeness, conformity, consistency, coverage, timeliness, uniqueness) crossed with service-level indicators, then assigning each a metric, measurement window, and baseline. Aim for 5-12 SLOs per dataset, negotiated between producer and consumers.

How to enforce data quality checks in a pipeline?

Data quality checks are enforced by implementing each SLO as a SodaCL check or Great Expectations suite that runs as a post-ingest or pre-publish step in Airflow or Argo orchestration. Each check gets a violation policy: halt the pipeline, quarantine invalid records, or pass through with a segmentation label.

SodaCL vs Great Expectations for data quality checks?

Both SodaCL and Great Expectations implement conformity, completeness, and uniqueness rules and can be embedded in a data contract and executed via the Data Contract CLI test command. The choice depends on your existing contract tooling; both run as pipeline gates.

How do I prevent train and eval data contamination?

Train/eval contamination is prevented with a uniqueness SLO requiring zero n-gram overlap above a declared threshold, checked by an overlap scan at snapshot creation as a pre-publish gate. Contaminated eval snapshots are halted rather than published, with a repair clock for purging overlap.

When should a pipeline halt versus quarantine bad data?

Halt versus quarantine depends on consumer risk tolerance: the cadence of decisions on the data, the sunk cost of proceeding on bad data, and the opportunity cost of blocking. Eval sets warrant halting, while bulk pretraining ingests usually favor quarantine-and-flow so a few bad rows do not idle the cluster.