Copy > 5GB zarr file to S3

Do not use gzip with Zarr. Instead, use a Zip file. It is supported natively by the format (e.g. ZipStore).

Similar discussion happening at Any tips on avoiding high AWS S3 cost when storing Zarr's with lots of objects - #13 by rabernat

1 Like