data-analysis

Analyzes local tabular datasets with pandas, Polars, and DuckDB for reproducible conclusions.

22|Updated Sep 10, 2026
One-click install
npx skills add https://github.com/Lynricsy/HyperSkills --skill data-analysis-lynricsy
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-analysis
Source: https://github.com/Lynricsy/HyperSkills/tree/main/skills/data-analysis
Command: npx skills add https://github.com/Lynricsy/HyperSkills --skill data-analysis-lynricsy

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pandas, polars, duckdb, scipy, and includes references (resource) components.

What problem does it solve? Tabular analysis often produces wrong answers silently: duplicated refund events inflate revenue, null join keys fabricate matches, averages of averages distort weighting, and timezone shortcuts corrupt calendar windows. This Skill enforces data contracts, join-grain discipline, missingness accounting, and reproducible execution so reported numbers survive independent reconciliation. ## Core Features & Use Cases - Data contract and reconciliation workflows: Define population, identity, grain, and missingness before aggregating, then gate conclusions on executed checks like eligible = observed + missing. - Engine-specific guidance: Dedicated references for pandas ingestion and calendar endpoints, Polars lazy semantics and streaming, and DuckDB local SQL, joins, and spilling. - Statistical design discipline: Match inference to independent units, distinguish descriptive findings from causal claims, and report coverage alongside every incomplete measure. - Use Case: Finance needs net booked revenue by region from CSV exports containing retransmitted refund events and blank amounts. The Skill deduplicates by event identity, aggregates refunds at order grain before joining, keeps unknown amounts separate from zero, and delivers a rerunnable SQL script with reconciliation evidence. ## Quick Start Ask the agent to analyze your local CSV or Parquet files with this skill, for example to compute revenue by region from orders and refunds exports while preserving unknown amounts and delivering a rerunnable script.

Frequently Asked Questions about data-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze CSV files with pandas, Polars, or DuckDB?

Start by declaring a data contract covering identity columns, missing tokens, and grain, then read files with explicit dtypes rather than inferred schemas. Use pandas for bounded in-memory work, DuckDB for local SQL over files, or Polars when the project already uses its lazy expression model.

pandas vs Polars vs DuckDB for local data analysis?

Keep whichever engine the project already uses; do not migrate a working pipeline. Default to pandas for bounded in-memory tabular work, choose DuckDB when local SQL and disk-backed aggregation fit, and use Polars when the codebase relies on its lazy expression model.

Why do my join totals change after merging two fact tables?

Joining two child fact tables before aggregating multiplies rows, inflating sums. Aggregate each fact to the shared output grain first, then join the one-row-per-parent summaries, and validate expected cardinality on the required unique side.

Does Polars streaming guarantee bounded memory usage?

No. Streaming executes supported operations in batches, but joins, high-cardinality group state, sorts, and the final materialized DataFrame can still exceed memory. Inspect the physical plan and run the actual query to observe real resource use.

How do I handle a business day across DST transitions?

Construct both local midnight endpoints in the named IANA timezone, resolve ambiguous or nonexistent wall times, convert to UTC instants, and filter with a half-open [start, end) interval. A local day is not always 24 hours, so fixed-day arithmetic corrupts the window.

When should I not use this data analysis skill?

Do not use it for database operations like locks, WAL, or transactions, for creating Excel or PowerPoint deliverables, or for ML training infrastructure. Those belong to database, office, or ml-training skills respectively.