Icepyx - Python tools for ICESat-2 data

[weiji14]

@weiji14

@dcherian

A nice way forward would be to break out the ArViz code into a separate package that adds group handling on top of xarray (there’s a lot of demand for such a package). icepyx could then use that new package as a dependency.

Thanks for chipping in @dcherian! So I suppose the hierarchy would be something like datagroup (?) → dataset → dataarray. But this should really, really be a last resort (as you emphasized) if there’s a clear reason for the nested structure to exist in the first place.

Just cross-referencing the “Dataset groups” issue at Dataset groups · Issue #1092 · pydata/xarray · GitHub and the more recent “Feature Request: Hierarchical storage and processing in xarray” issue at Feature Request: Hierarchical storage and processing in xarray · Issue #4118 · pydata/xarray · GitHub. See also the Arviz InferenceData documentation at https://arviz-devs.github.io/arviz/generated/arviz.InferenceData.html#arviz.InferenceData and code at https://github.com/arviz-devs/arviz/blob/v0.9.0/arviz/data/inference_data.py#L45. I’ll try to look into this more (if I have time) as it looks really promising:

Surprisingly, this somewhat works, though there’s lots of warnings, and the very nested ‘gt**’ groups aren’t being read properly:

import arviz as az

datagroup = az.from_netcdf(filename="ATL06.003/2020.05.13/ATL06_20200513024639_07260711_003_01.h5")
datagroup