explore-data

Profile Parquet or CSV datasets with Polars to surface data quality issues.

Updated Jun 20, 2026
One-click install
npx skills add https://github.com/lowmason/agent-skills --skill explore-data-lowmason
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: explore-data
Source: https://github.com/lowmason/agent-skills/tree/main/explore-data
Command: npx skills add https://github.com/lowmason/agent-skills --skill explore-data-lowmason

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires polars, and includes scripts (resource) components.

What problem does it solve?

Profile a dataset with Polars before analysis to surface data-quality issues and guardrails that prevent modeling on flawed data.

Core Features & Use Cases

  • Profile shape, schema, nulls, and cardinality to understand data at first contact.
  • Check candidate keys for uniqueness and identify duplicates, silos, or sentinel values.
  • Assess panel balance and vintage as-of readiness for time-series data to guide cleansing and modeling decisions.

Quick Start

Run the profiling script on a dataset (Parquet/CSV) to generate a concise quality report with flags and suggested next steps.

Frequently Asked Questions about explore-data

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I profile a dataset to check for data quality issues before modeling?

You can profile a dataset with Polars to surface data quality issues by running a script that generates per-column statistics, quality flags, and checks for nulls, duplicates, and schema problems before modeling.

How do I check candidate keys for uniqueness and identify duplicates in a CSV file?

To check candidate keys for uniqueness and identify duplicates in a CSV, apply a profiling script to assess cardinality, uniques, and silos, which flags duplicate rows and sentinel values in your data.

Can I use Polars to assess panel balance and vintage as-of readiness for time-series data?

Yes, you can use Polars to assess panel balance and vintage as-of readiness for time-series data by profiling microdata to evaluate balance across periods and guide cleansing and modeling decisions.

Does the data profiling script work with both Parquet and CSV file formats?

Yes, the data profiling script works with both Parquet and CSV file formats, applying lazy Polars queries to new scrapes or microdata to assess shape, schema, nulls, and uniques.

What is the best way to generate a machine-readable summary of nulls and schema issues in a dataset?

The best way to generate a machine-readable summary of nulls and schema issues is to use a Polars profiling script that outputs an optional machine-readable summary with per-column statistics and quality flags.