data-validation

Validate data analyses for methodological errors and calculation mistakes.

1|Updated Feb 26, 2026
One-click install
npx skills add https://github.com/tmorrowdev/data-plugin --skill data-validation-tmorrowdev
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-validation
Source: https://github.com/tmorrowdev/data-plugin/tree/main/skills/data-validation
Command: npx skills add https://github.com/tmorrowdev/data-plugin --skill data-validation-tmorrowdev

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Ensures analytical results are correct, well-documented, and free from common methodological errors so stakeholders can trust conclusions and act with confidence.

Core Features & Use Cases

  • Pre-delivery QA checklist: Step-by-step checks for source verification, freshness, completeness, null handling, deduplication, and filter correctness.
  • Calculation and reasonableness checks: Guidance for aggregation logic, denominator correctness, join validation, magnitude and trend sanity checks, and cross-validation techniques.
  • Documentation and reproducibility: Templates and code comment examples to record data sources, metric definitions, methodology, assumptions, and versioning for reproducible analyses.
  • Use Case: Review a quarterly revenue analysis to confirm joins didn't inflate counts, ensure time alignment across sources, verify denominators for rate calculations, and produce a reproducibility checklist for handoff.

Quick Start

Check this analysis for aggregation errors, join and denominator issues, timezone mismatches, and bias, then produce a reproducibility checklist and recommended corrections.

Frequently Asked Questions about data-validation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run sanity checks on data aggregations to prevent join explosions?

Run sanity checks on data aggregations by validating join keys and monitoring row counts before and after merging to detect join explosions. Apply checklist-driven cross-validation techniques to verify aggregation logic and ensure counts are not artificially inflated.

What is denominator shifting and how do I catch it during data validation?

Denominator shifting occurs when the base population of a rate calculation changes unexpectedly across data segments. Catch it during data validation by applying denominator correctness checks to verify that base populations remain consistent and match the intended metric definitions.

How do I check for timezone mismatches when aligning time-series data from multiple sources?

Check for timezone mismatches by applying time-alignment validation to standardize timestamps across multiple data sources before analysis. Verify that all time-series data uses a consistent timezone to prevent skewed trends and incorrect chronological grouping.

What's the best way to document data analyses for reproducibility before delivery?

Document data analyses for reproducibility by using structured templates to record data sources, metric definitions, methodology, assumptions, and versioning. This creates a clear audit trail that allows stakeholders to reproduce calculations and verify results independently.

Can I use this approach to detect selection bias in my dataset?

Yes, you can detect selection bias by applying cross-validation techniques and reasonableness checks to identify skewed sample distributions. The checklist-driven validation process evaluates whether your data filtering logic inadvertently excludes relevant populations.

Why does my cross-validation keep failing on null values and duplicate rows?

Cross-validation fails on null values and duplicate rows when pre-delivery QA skips completeness and deduplication checks. Resolve this by applying source verification, null handling, and deduplication steps before running aggregation logic and downstream calculations.