What problem does it solve?
Provides a systematic methodology to quickly understand dataset structure, assess data quality, and surface patterns and anomalies so analysts and engineers can trust downstream analysis and pipelines.
Core Features & Use Cases
- Structural profiling: row/column counts, grain, primary key checks, and column classification (identifier, dimension, metric, temporal, text, boolean, structural).
- Column-level statistics: null rates, distinct counts, top/bottom values, numeric percentiles and dispersion, string length and pattern checks, and timestamp range analysis.
- Relationship & quality discovery: foreign key candidate detection, correlation matrices, completeness scoring, consistency and accuracy checks, timeliness assessment, and documentation templates for schema and lineage.
- Use Case: Run this methodology to validate a staging dataset before promotion to a reporting mart, identify stale or anomalous records, and generate a schema document for the analytics team.
Quick Start
Run a profile on the target table to compute column null rates, top values, numeric percentiles, correlations, and generate a schema documentation template.