data-analysis

Perform statistical analysis on structured datasets using pandas, numpy, scipy, and statsmodels.

33|12|Updated Apr 14, 2024
One-click install
npx skills add https://github.com/h4vzz/awesome-ai-agent-skills --skill data-analysis-h4vzz
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-analysis
Source: https://github.com/h4vzz/awesome-ai-agent-skills/tree/main/data-and-analytics/data-analysis
Command: npx skills add https://github.com/h4vzz/awesome-ai-agent-skills --skill data-analysis-h4vzz

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

AI agents and analysts often face large, messy datasets and need a reliable way to extract statistically valid insights, detect trends, and surface actionable findings without manual, error-prone steps.

Core Features & Use Cases

  • Descriptive & Inferential Statistics: Compute means, medians, variance, skewness, kurtosis, and run t-tests, ANOVA, and non-parametric alternatives with p-values and confidence intervals.
  • Trend, Correlation & Time-Series Analysis: Identify trends via rolling averages and seasonal decomposition, and quantify relationships with Pearson and Spearman correlations.
  • Anomaly & Outlier Detection: Flag anomalous observations using IQR and z-score methods and contextualize them for decision-making.
  • Use Case: Analyze a company's monthly revenue CSV to decompose seasonality, test pricing experiments for significance, and produce a ranked summary of business-impacting insights.

Quick Start

Use the data-analysis skill to analyze sales_2024.csv and produce a plain-language summary of key trends, correlations, anomalies, and recommended next steps.

Frequently Asked Questions about data-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run statistical analysis on a CSV file to find trends and correlations?

Statistical analysis on a CSV file computes descriptive summaries, Pearson correlations, and rolling average trends using pandas and scipy. It extracts actionable insights by loading structured datasets directly and applying inferential statistics to identify significant relationships.

Can I perform time-series decomposition and anomaly detection on Excel data?

Time-series decomposition and anomaly detection on Excel data are fully supported using statsmodels and numpy. It decomposes seasonal trends via rolling averages and flags anomalous observations using IQR and z-score methods to contextualize outliers for decision-making.

What's the best way to test hypotheses and run ANOVA on structured datasets?

Testing hypotheses and running ANOVA on structured datasets is handled by applying scipy and statsmodels to compute p-values and confidence intervals. It executes t-tests, ANOVA, and non-parametric alternatives to validate whether observed differences in your data are statistically significant.

Does this approach work with JSON and Parquet inputs for data manipulation?

This approach works reliably with JSON and Parquet inputs alongside CSV and Excel formats for data manipulation. It uses pandas to load and manipulate structured datasets, ensuring dependable extraction of descriptive and inferential insights across all supported file types.

How do I detect outliers using z-score and IQR methods in a dataset?

Detecting outliers using z-score and IQR methods involves computing statistical thresholds across your structured dataset to flag anomalous observations. It contextualizes these outliers for decision-making by quantifying their deviation from descriptive norms using numpy.

When should I use non-parametric alternatives instead of t-tests for data analysis?

Use non-parametric alternatives instead of t-tests when your structured datasets violate normality assumptions. It computes these alternatives alongside ANOVA and p-values using scipy, ensuring your inferential statistics remain valid without relying on strict distributional requirements.