alpha-search-data-engineering

What problem does it solve?

This Skill provides a unified framework to manage data collection, normalization, and caching for quantitative research, ensuring reliable and efficient data pipelines.

Core Features & Use Cases

• Data Provider Abstraction: Implements standardized interfaces for various sources like YFinance and Binance.
• Caching Layer: Uses DuckDB to store and retrieve data quickly, reducing API calls.
• Resilience and Efficiency: Incorporates rate limiting, exponential backoff retries, and data normalization to ensure robust data flows.
• Use Case: When building or updating your data pipelines, activate this Skill to fetch, normalize, and cache asset data seamlessly, avoiding stale or incomplete data.

Quick Start

Activate this Skill to implement data pipelines that fetch, normalize, and cache market data reliably using Python scripts and the provided modules.