Accelerates DataFrame transformations with lazy, expression-based queries on Apache Arrow-backed data.
npx skills add https://github.com/shushuzn/Rairos --skill polars-shushuzn
Please help me install this Agent Skill. Skill: polars Source: https://github.com/shushuzn/Rairos/tree/main/skills/polars Command: npx skills add https://github.com/shushuzn/Rairos --skill polars-shushuzn
Polars solves slow, cumbersome in-memory data wrangling by providing a fast DataFrame engine with expression-based transformations that scale well until your dataset no longer fits in RAM.
Use cases: migrate from pandas for performance, build ETL pipelines, accelerate groupby/aggregation and window features, and streamline reading/writing across CSV/Parquet/JSON for analytics.
Use the polars skill to transform an attached dataset by running an efficient lazy pipeline with column selection, filtering, and aggregation.
High-intent search queries and answers about installing and using this skill.
Polars accelerates in-memory data transformations by providing an expression-based DataFrame API backed by Apache Arrow, enabling parallel execution and lazy query optimization for faster filtering, joins, and aggregations on datasets that fit in RAM.
Lazy evaluation in Polars optimizes ETL pipelines by using scan_* patterns to build queries before execution, allowing the engine to optimize the entire transformation sequence and reduce unnecessary computations when collect is called.
Migrating to Polars involves replacing pandas operations with Polars' native expressions and LazyFrame API, leveraging Apache Arrow backend for efficient groupby, aggregation, and window functions while maintaining predictable typing.
Yes, Polars handles datasets in the 1–100GB range that fit in RAM by using Apache Arrow backend, lazy scan_* patterns, and parallel execution to efficiently manage large-scale filtering, reshaping, and joining operations.
Polars expressions enable parallel execution and safer, more predictable typing by composing transformations in an expression-first workflow, which allows the query optimizer to process operations efficiently across columns.
In-memory data transformations with Polars are limited by available RAM, meaning datasets must fit entirely in memory; once data exceeds RAM capacity, alternative out-of-core processing solutions are required.
ejolietPerform fast, memory-efficient DataFrame operations on large datasets with Polars.
weirdgmeDesign and implement scalable platform engineering patterns for internal developer platforms.
spqwLoad Apache Arrow IPC and Parquet files in Observable Framework projects.
Zeyuyang-0420Process large tabular datasets with lazy evaluation and out-of-core operations.
