Store and access chunked N-D arrays with parallel I/O and cloud backends.
npx skills add https://github.com/jackspace/ClaudeSkillz --skill zarr-python
Please help me install this Agent Skill. Skill: zarr-python Source: https://github.com/jackspace/ClaudeSkillz/tree/main/skills/scientific-pkg-zarr-python Command: npx skills add https://github.com/jackspace/ClaudeSkillz --skill zarr-python
Zarr enables chunked, compressed N-dimensional arrays with parallel I/O and cloud storage integration, designed for large-scale scientific computing.
Create a 2D zarr array on disk, write data, and read back a slice with NumPy indexing.
High-intent search queries and answers about installing and using this skill.
Zarr enables chunked, compressed N-dimensional arrays with parallel I/O across cloud storage backends like S3 and GCS. It integrates seamlessly with NumPy, Dask, and Xarray for scalable scientific workflows, supporting configurable chunking, multiple compression codecs, and local or cloud-backed storage.
Yes, Zarr is designed for seamless integration with NumPy, Dask, and Xarray. It provides chunked array storage with parallel I/O capabilities, making it ideal for large-scale scientific pipelines that require efficient data streaming and distributed computation.
Zarr supports LocalStore for disk, MemoryStore for RAM, ZipStore for ZIP archives, and cloud backends via s3fs and gcsfs integration. This enables flexible deployment across on-premises infrastructure, cloud object storage like S3 and GCS, and hybrid workflows.
Chunking divides large N-dimensional arrays into smaller blocks, enabling selective loading, parallel access, and per-chunk compression. This reduces memory overhead, accelerates I/O operations, and allows efficient streaming of data larger than available RAM.
Zarr requires the zarr package. For S3 integration, install s3fs; for GCS, install gcsfs. Local and in-memory storage work without additional dependencies. Python 3.11+ is required for full compatibility.
Zarr supports multiple compression codecs including Blosc, Gzip, and Zstd with configurable settings per chunk. Compression reduces storage footprint and bandwidth costs, particularly valuable for cloud-based workflows handling large-scale scientific data.
rubenslivManage large chunked N-dimensional arrays with cloud and parallel I/O.
xjtulycAnalyze NetCDF/HDF5 datasets with xarray and lazy Dask computation.
galeepCreates chunked, compressed N-dimensional arrays in Python with cloud storage integration via zarr, numpy, dask, and xarray.
tondevrelManage N-dimensional labeled arrays and datasets in Python with NumPy and Dask.
