Perform lazy, expression-based DataFrame operations with Polars for CSV and Parquet pipelines.
npx skills add https://github.com/ovachiever/droid-tings --skill polars-ovachiever
Please help me install this Agent Skill. Skill: polars Source: https://github.com/ovachiever/droid-tings/tree/main/skills/polars Command: npx skills add https://github.com/ovachiever/droid-tings --skill polars-ovachiever
Polars is a fast DataFrame library with a strong emphasis on lazy execution and parallelism. It enables efficient data manipulation, especially on large datasets, and provides a pandas-friendly API with modern performance features.
Use cases include large-scale data wrangling, ETL, feature engineering, and rapid analytics.
Create a dataframe, apply a lazy pipeline, and collect results. Example: read CSV lazily, filter, and compute aggregates.
High-intent search queries and answers about installing and using this skill.
Polars enables fast DataFrame operations through expression-based, lazy evaluation that optimizes execution plans before processing. It parallelizes select, filter, group-by, and join operations across large datasets, delivering significant performance gains over pandas while maintaining a familiar API.
Lazy evaluation builds an optimized execution plan before running, allowing Polars to parallelize and streamline operations. Eager evaluation executes immediately. Lazy mode in Polars reduces memory usage and accelerates pipelines by optimizing the full query before collection.
Polars provides a pandas-friendly API designed for migration, letting you adopt its expression-based syntax incrementally. It handles CSV, Parquet, and JSON I/O like pandas while delivering Apache Arrow-based memory efficiency and lazy optimization for accelerated analytics.
Build ETL pipelines by reading data lazily with Polars, chaining filter, select, and group-by expressions, then collecting results. Lazy evaluation optimizes the full pipeline before execution, enabling efficient data wrangling and feature engineering on large datasets.
Polars supports optional streaming alongside lazy evaluation to process datasets exceeding available memory. Combined with lazy plan optimization, streaming enables scalable analytics on large files without loading entire datasets into RAM.
Polars reads and writes CSV, Parquet, and JSON formats natively. Parquet is optimized for performance due to columnar storage and Apache Arrow compatibility, making it ideal for large-scale data pipelines alongside lazy evaluation.
xiechyParallelize pandas and NumPy workflows with Dask DataFrames and Arrays.
biomaps-infraProcess and analyze large tabular datasets exceeding RAM using Vaex.
yonesukeProcess large tabular datasets in Python using Polars lazy and eager APIs.
qinyan-aiScale pandas and NumPy workflows to datasets that exceed memory.
