Opening cloud data without using intake

Cloud Pangeo Cloud Support
1

This syntax doesn’t appear to work any more:

import xarray as xr
import fsspec
ds = xr.open_zarr(fsspec.get_mapper('gs://pangeo-ldeo-mitgcm/channel_floats/channel_float_vars'))

I know the data exists, because I can open it with intake, but how do I open a dataset that’s not in the intake catalog (e.g. gs://argodata/sdl/GLOBAL_ARGO_SDL2000)? Or is this no longer possible?

1 Like
2

The data are now all requester pays. So I think you need to do something like

import gscfs
gcs = gcsfs.GCSFileSystem(requester_pays=True)
gcs.get_mapper(url)

Let us know if this works.

3

Thanks! This works - I will do a PR to update the docs.

1 Like