An implementation of chunked, compressed, N-dimensional arrays for Python

Zarr Zarr is a Python package providing an implementation of compressed, chunked, N-dimensional arrays, designed for use in parallel computing. Main Features Create N-dimensional arrays with any NumPy dtype. Chunk arrays along any dimension. Compress and/or filter chunks using any NumCodecs codec. Store arrays in memory, on disk, inside a zip file, on S3, etc… Read an array concurrently from multiple threads or processes. Write to an array concurrently from multiple threads or processes. Organize arrays into hierarchies via groups. […]

Read more