# Pangeo Showcase: "Cloud Native Data Loaders for Machine Learning Using Zarr and Xarray"

**URL:** <https://discourse.pangeo.io/t/pangeo-showcase-cloud-native-data-loaders-for-machine-learning-using-zarr-and-xarray/4110>\
**Category:** Pangeo Showcase\
**Tags:** machine-learning\
**Created:** [March 19, 2024, 7:02pm UTC](https://discourse.pangeo.io/t/pangeo-showcase-cloud-native-data-loaders-for-machine-learning-using-zarr-and-xarray/4110 "2024-03-19T19:02:41Z")\
**Posts on this page:** 1\
**Showing post:** 8

<div class="post-metadata">

**Author:** ![emfdavid](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/emfdavid/32/2598_2.png) [@emfdavid](https://discourse.pangeo.io/u/emfdavid)\
**Post date:** [June 26, 2026, 6:08pm UTC](https://discourse.pangeo.io/t/pangeo-showcase-cloud-native-data-loaders-for-machine-learning-using-zarr-and-xarray/4110/8 "2026-06-26T18:08:13Z")

</div>

Cross posting from this other thread:

> [@Favorite way to go from netCDF (&xarray) to torch/TF/Jax et al](https://discourse.pangeo.io/t/favorite-way-to-go-from-netcdf-xarray-to-torch-tf-jax-et-al/2663/9):
>
> The IO is fast now but there is still no standard tooling for chunked zarr compatible split/shuffle aware batching. I put some time (and tokens) into building [GitHub - emfdavid/insitubatch: Train in place on n-dimensional cloud tensors. · GitHub](https://github.com/emfdavid/insitubatch) this week. It is one Data Set abstraction compatible with Torch, Jax and TF. It is batteries included with tunable caching, pre-fechting and max-inflight. No heavy worker processes makes it much more efficient - lean memory and cpu (fetch once!) It …

---

_[View the full topic](https://discourse.pangeo.io/t/pangeo-showcase-cloud-native-data-loaders-for-machine-learning-using-zarr-and-xarray/4110)._