Zarr-Python 3 release

News & Announcements Jobs
1

We released Zarr-Python 3 today, complete with support for the v3 spec, new extensions (chunk-sharding) and significant performance gains.

Xarray v2025.01.1 was also released today with full support for Zarr-Python 3.

Looking forward to hearing how it works for everyone.

21 Likes
2

Huge, congratulations!

1 Like
3

Nice work! I’m excited to see what happens as this spreads around.

1 Like
4

Amazing. Congrats to the whole team!

1 Like
5

Amazing work and congratulations!

1 Like
6

Congrats, and nice work everyone!

1 Like
7

In my view, the end-to-end async capabilities are one of the most exciting pieces of this release. Zarr is primarily an I/O library, so it makes total sense for it to be async. I’m eager to see how folks building APIs / web services / etc. are able to take advantage of this to deliver big performance gains.

However, to fully realize this potential, we will also have to bring async to Xarray, since most Pangeo users interact with Zarr via Xarray.

Imagine being able to write code like


async def extract_point(x, y):
    ds = await xr.async.open_dataset("s3://data.zarr")
    return await ds.async.sel(x=x, y=y)

This is now feasible with Zarr Python 3 under the hood.

6 Likes