We just published a blog post outlining a cloud native architecture for training ML models using Xarray and Zarr.
Title: cloud native data loaders for machine learning using zarr and xarray
Link: Cloud native data loaders for machine learning using Zarr and Xarray | Earthmover
Code: GitHub - earth-mover/dataloader-demo
What do you think? Have you tried something similar? What has worked well for you?