What problem does it solve?
Zarr Python solves the problem of efficiently storing and accessing very large N-dimensional arrays by using chunked, compressed storage that works well with parallel and cloud workflows.
Core Features & Use Cases
- Chunked N-D array storage: Create arrays with tunable chunk shapes so reads/writes match your access patterns, improving performance for large scientific datasets.
- Compression and scalable backends: Apply per-chunk compression and store data on local files, in-memory, ZIP archives, or cloud object stores such as S3 and GCS.
- Ecosystem integration: Seamlessly interoperate with NumPy-like indexing, and support lazy/out-of-core processing via Dask and labeled workflows via Xarray.
Quick Start
Open or create a chunked Zarr array in a local folder, write numeric data into it using NumPy-style slicing, then read back a subset to verify correct chunked behavior.