Migrates pandas-style data analysis to Polars expressions with eager or lazy execution.
npx skills add https://github.com/CRAG666/dotfiles --skill polars-crag666
Please help me install this Agent Skill. Skill: polars Source: https://github.com/CRAG666/dotfiles/tree/main/skills/polars Command: npx skills add https://github.com/CRAG666/dotfiles --skill polars-crag666
This Skill helps you write faster, more reliable data processing pipelines by replacing slow pandas workflows with Polars’ parallel and lazy execution.
Use the polars skill to migrate your pandas pipeline to a faster lazy Polars flow by running: scan a CSV, filter rows, select only needed columns, and collect results into a DataFrame.
High-intent search queries and answers about installing and using this skill.
Polars lazy evaluation optimizes ETL pipelines by building a query plan using LazyFrame scan operations. This enables filtering, projection pushdown, and parallel execution on in-memory datasets before collecting results into a DataFrame.
Perform window functions, joins, and group-bys efficiently on large datasets using Polars expression-based transformations. The framework applies parallel execution and pushdown optimizations to scale data reshaping operations reliably.
Use eager execution for interactive analysis requiring immediate results, and lazy evaluation for production ETL pipelines needing query optimization. Polars supports both modes, allowing you to build expressions and run them according to your performance needs.
Python UDFs slow down Polars transformations by bypassing the native parallel execution and lazy optimization engine. Best-practice patterns use Polars APIs like pl.col expressions to maintain type safety and optimize performance.
CRAG666Perform genomic interval operations on Polars DataFrames with scalable execution.
manutejTeach Apache Spark data processing across RDDs, DataFrames, Spark SQL, streaming, and MLlib.
JeffallanClean, transform, and analyze tabular data in pandas DataFrames.
felixboehmManipulate large datasets with lazy evaluation and parallel execution.
