skills.rest
zhouziyue233
zhouziyue233COMMUNITY
Explore all skills by this author →
GitHub

data-pipeline

Fetch and clean economic data from multiple APIs into analysis-ready datasets.

6|1|Updated Apr 3, 2026
Search Tags:#reproducibility#econometrics#data-pipeline#data-cleaning#panel-data#api-fetching
One-click install
npx skills add https://github.com/zhouziyue233/great-econometrics --skill data-pipeline-zhouziyue233
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-pipeline
Source: https://github.com/zhouziyue233/great-econometrics/tree/main/skills/data-pipeline
Command: npx skills add https://github.com/zhouziyue233/great-econometrics --skill data-pipeline-zhouziyue233

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

End-to-end data pipeline that automates data fetching, cleaning, and preparation for econometric analysis.

Core Features & Use Cases

  • Data acquisition from multiple APIs (FRED, World Bank, IMF, BLS, OECD, Yahoo Finance)
  • Data cleaning, transformation, and panel-structure validation
  • Output generation to data/clean with an audit log for reproducibility

Quick Start

Tell the AI to run the data-pipeline with your target datasets and time range to fetch, clean, and prepare analysis-ready data.

Frequently Asked Questions about data-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate fetching economic data from multiple APIs for panel data analysis?▼

Automating economic data fetching involves retrieving multi-source datasets from APIs like FRED, World Bank, and IMF, then cleaning and transforming them into panel structures. This pipeline validates data quality across dimensions and outputs analysis-ready datasets.

What is the best way to prepare raw API data for econometric analysis?▼

Preparing raw API data for econometrics requires cleaning, transforming, and validating panel structures to ensure reliability. A configurable pipeline fetches from sources like BLS and OECD, applies merge plans, and outputs reproducible, analysis-ready datasets.

Do I need to provide my own API keys to fetch data from FRED, World Bank, or IMF?▼

Yes, fetching data from FRED, World Bank, IMF, or OECD requires environment-managed API keys. The pipeline uses these credentials to authenticate requests and retrieve economic data for subsequent cleaning and panel-structure validation.

How does panel data validation work when merging datasets from Yahoo Finance and OECD?▼

Panel data validation checks multi-source datasets for structural integrity across dimensions after applying a configurable merge plan. It ensures reliability and consistency before outputting the transformed data to a clean data directory.

Can I reproduce my data fetching and cleaning steps for empirical research?▼

Reproducibility is maintained through an audit log and optional versioning. The pipeline documents every fetching, cleaning, and transformation step applied to the economic data, ensuring you can trace and replicate the analysis-ready output.

What are the limitations of automated data pipelines for econometric analysis?▼

Limitations include dependency on external API availability and rate limits for sources like BLS and Yahoo Finance. Additionally, users must configure merge plans and manage environment API keys, as the pipeline does not generate these credentials.

Related Skills

Explore More Data & Analytics Skills→
sheehesheehe

data-fetcher

Fetch macroeconomic time-series data from FRED, World Bank, BLS, OECD, and Yahoo Finance.

Community
Intermediate
SunS1eep1ngSunS1eep1ng

statsmodels

Fit regression, GLM, and time series models in Python.

Community
Advanced
ovachieverovachiever
52

weights-and-biases

Automate ML experiment tracking and model registry management via the wandb API.

Community
Advanced
NigarumOvumNigarumOvum

tushare

Fetch stock prices, ETF details, bond data, and economic indicators via tushare APIs.

Community
Intermediate