alterlab-vaex
CommunityAnalyze huge datasets with Vaex out-of-core.
Data & Analytics#visualization#machine-learning#out-of-core#lazy-evaluation#vaex#big-data#dataframes
AuthorAlterLab-IEU
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Vaex enables interactive analysis of datasets too large to fit in memory by using out-of-core DataFrames and memory-mapped IO, allowing scalable exploration without upgrading hardware.
Core Features & Use Cases
- Out-of-core DataFrames: process billions of rows without loading all data into RAM.
- Lazy evaluation & virtual columns: build complex pipelines without immediate computation.
- Fast aggregations & I/O: efficient statistics, binning, and seamless loading from CSV, Parquet, HDF5, or Arrow formats.
- Visualization & ML integration: scalable plotting and machine learning workflows on big data.
- Real-world use cases: explore massive scientific datasets, financial time series, or large logs with responsive feedback.
Quick Start
Open a large dataset with vaex.open('path/to/data') and start interactive analysis without loading everything into memory.
Dependency Matrix
Required Modules
None requiredComponents
references
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: alterlab-vaex Download link: https://github.com/AlterLab-IEU/AlterLab-Academic-Skills/archive/main.zip#alterlab-vaex Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.