research-harness-audit

What problem does it solve?

Ensures raw data integrity by performing a comprehensive, read-only audit that inventories files, variables, IDs, time aspects, and missingness, and outputs a structured report without modifying any data.

Core Features & Use Cases

• Inventory each data file: size, format, encoding, rows, and columns without loading data into memory.
• Variable inventory and missingness analysis: identify non-missing counts, missing patterns, and flag variables with high missingness.
• ID and time checks: detect potential identifiers and time variables, their ranges, and format inconsistencies.
• Feasibility assessment: evaluate whether the study design and data support the planned cleaning and analysis steps.
• Output artifacts: generate reports (reports/data_audit_report.md) and audit logs (logs/audit_YYYYMMDD.log) for traceability.

Quick Start

Run the audit workflow to generate a data_audit_report.md and logs from the raw data as described in study_spec.md.