Process DataFrames in Python and Rust using Apache Arrow.
npx skills add https://github.com/jimmc414/Kosmos --skill polars-jimmc414
Please help me install this Agent Skill. Skill: polars Source: https://github.com/jimmc414/Kosmos/tree/main/kosmos-claude-scientific-skills/scientific-skills/polars Command: npx skills add https://github.com/jimmc414/Kosmos --skill polars-jimmc414
This Skill provides a high-performance, memory-efficient alternative to traditional data manipulation libraries like pandas, enabling faster and more scalable data analysis workflows.
Use the polars skill to read the CSV file 'data.csv' into a DataFrame and display the first 5 rows.
High-intent search queries and answers about installing and using this skill.
You can process large CSV files using lazy evaluation, which optimizes complex queries before execution to handle datasets that exceed available memory efficiently.
Migrating pandas workflows is simplified through a familiar expression-based API that provides significant performance gains while maintaining compatibility for existing data manipulation scripts.
Lazy evaluation works by building a query graph that optimizes the entire data manipulation pipeline before execution, reducing unnecessary computations and memory overhead during processing.
Yes, the library supports multiple I/O operations including reading and writing CSV, Parquet, and JSON files directly into DataFrames for high-performance data manipulation.
Yes, it is built directly on Apache Arrow, utilizing its columnar memory format alongside a Rust backend to deliver lightning-fast data processing, filtering, grouping, and joins.
While highly efficient for ETL pipelines, users transitioning from pandas must adapt to its strict expression-based API design, which differs from traditional imperative DataFrame manipulation methods.
beauschwabPerform lazy, expression-based DataFrame operations on large datasets with CSV and Parquet IO.
starlake-aiConvert Parquet files into CSV format for batch ETL pipelines.
sagunkayasthaProvide a high-performance DataFrame library for Python and Rust using Apache Arrow.
viniruggeriDistribute large pandas and NumPy workloads across clusters for parallel processing.
