Process and analyze out-of-core datasets exceeding RAM with Vaex DataFrames.
npx skills add https://github.com/ovachiever/droid-tings --skill vaex
Please help me install this Agent Skill. Skill: vaex Source: https://github.com/ovachiever/droid-tings/tree/main/skills/vaex Command: npx skills add https://github.com/ovachiever/droid-tings --skill vaex
This Skill introduces Vaex for out-of-core, lazy-evaluated dataframes that handle datasets far larger than RAM, enabling fast statistics, visualizations, and ML pipelines on big data.
Open a large dataset, create a virtual column, and compute a fast mean without loading all data.
High-intent search queries and answers about installing and using this skill.
Out-of-core dataframes let you process multi-terabyte datasets without loading them entirely into memory. Vaex maps large CSV, HDF5, Parquet, and Arrow files directly, enabling fast aggregations and statistics on data that exceeds available RAM.
Virtual columns in Vaex compute derived features on-the-fly without storing intermediate results. This lets you build complex feature pipelines on big data while keeping memory usage minimal.
Vaex ML integrates with scikit-learn and supports streaming I/O, allowing you to train models on out-of-core dataframes and process big data through complete ML workflows without loading everything into memory.
Vaex handles CSV, HDF5, Parquet, and Arrow formats for out-of-core analysis. Format interoperability lets you read and process large files in their native format without conversion overhead.
Lazy evaluation defers computation until results are explicitly requested, allowing Vaex to optimize queries and avoid unnecessary calculations. This enables fast aggregations and visualizations on datasets that would be prohibitively slow with eager evaluation.
Vaex supports fast visualizations of out-of-core data by computing statistics and binning data efficiently without materializing the full dataset. This lets you explore and understand massive datasets interactively.
biomaps-infraProcess and analyze large tabular datasets exceeding RAM using Vaex.
DieStokOrchestrate multi-agent code review workflows and aggregate findings into merge-ready reports.
PetriLahdelmaGuide analytics, data processing, and ML modeling with pandas and scikit-learn.
LogauaEngstromScale pandas and NumPy beyond memory with parallel computing.
