Data pipelining and cataloging best practices (? using intake-xarray to transform and combine data metadata?)

With STAC you can search within the metadata recorded by the catalog, without opening the actual files. As soon as you have opened the dataset there’s indeed no need for the catalog anymore, and also no need to repeatedly reopen files.

This means that STAC is best suited if you have many files with different spatio-temporal extents, while for model data there’s not too much of a difference between the two

2 Likes