Process out-of-core tabular data with lazy filtering, aggregations, and visualization.
npx skills add https://github.com/jasrajtulsi/GRAD-SCOPE --skill vaex-jasrajtulsi
Please help me install this Agent Skill. Skill: vaex Source: https://github.com/jasrajtulsi/GRAD-SCOPE/tree/main/.claude/skills/vaex Command: npx skills add https://github.com/jasrajtulsi/GRAD-SCOPE --skill vaex-jasrajtulsi
Vaex helps you work with tabular datasets that are too large to fit in memory by keeping calculations lazy, efficient, and fast. It is designed for exploratory analysis, statistics, visualization, and machine learning on billion-row-scale data.
Use the vaex skill to open a large dataset, compute the key statistics you need, and generate a visualization for the columns I specify.
High-intent search queries and answers about installing and using this skill.
You can analyze massive CSV datasets without RAM limits by using out-of-core DataFrames to load files directly via memory mapping, enabling lazy filtering and aggregations without loading everything into memory.
Out-of-core visualization on billion-row datasets is achieved by generating heatmaps and histograms directly from memory-mapped HDF5 or Arrow files, computing visual summaries efficiently without full data ingestion.
Yes, you can run lazy aggregations and create virtual columns on Parquet files by opening them as out-of-core DataFrames, delaying execution until the specific computation is explicitly triggered.
You do not need to convert datasets to HDF5 first; you can directly open and process CSV, Arrow, and Parquet files for out-of-core data analysis, though HDF5 supports optimal memory-mapped access.
Lazy evaluation in large tabular datasets works by building virtual columns and delayed execution plans during filtering, skipping computation until a specific aggregation or visualization explicitly requires the results.
Out-of-core DataFrames for machine learning workflows require Python 3.10+ and Vaex-style memory-mapped files, meaning standard pandas workflows must be adapted to delayed execution and lazy aggregation patterns.
LeonChaoXProcess large tabular datasets with lazy out-of-core Vaex DataFrame operations.
teradata-labsGenerate SQL workflows for Teradata column transformations and feature engineering.
ovachieverProcess and analyze out-of-core datasets exceeding RAM with Vaex DataFrames.
Zeyuyang-0420Process large tabular datasets with lazy evaluation and out-of-core operations.
