# Google storage gs:// URLs for Pangeo datasets on GCS

**URL:** https://discourse.pangeo.io/t/google-storage-gs-urls-for-pangeo-datasets-on-gcs/975
**Category:** Cloud
**Created:** [October 25, 2020, 7:27pm UTC](https://discourse.pangeo.io/t/google-storage-gs-urls-for-pangeo-datasets-on-gcs/975 "2020-10-25T19:27:37Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![andrewbrettin](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/andrewbrettin/32/607_2.png) [@andrewbrettin](https://discourse.pangeo.io/u/andrewbrettin)
#### Post date: [October 25, 2020, 7:27pm UTC](https://discourse.pangeo.io/t/google-storage-gs-urls-for-pangeo-datasets-on-gcs/975/1 "2020-10-25T19:27:37Z")

</div>

Hi Pangeo team,

I have been following the [tutorial](https://rechunker.readthedocs.io/en/latest/#quickstart) for rechunker and am trying to rechunk data onto my personal google cloud bucket. However, I would like to use the GFDL CM2.6 data [here](https://catalog.pangeo.io/browse/master/ocean/GFDL_CM2_6/GFDL_CM2_6_one_percent_ocean_surface/) instead of the Copernicus Marine Environment which is used in the example. The tutorial gives a URL for this dataset (‘gs://pangeo-cmems-duacs’), but I don’t know where this link comes from, and I don’t know how to get the corresponding GCS URL for any of the other datasets I might be interested in.

Where can I find the Google Storage URL for other Pangeo datasets that I may be interested in (in particular the GFDL CM2.6 ocean surface datasets)?

Thanks,

Andrew

---

<div class="post-metadata">

### Author: ![rabernat](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/rabernat/32/22_2.png) [@rabernat](https://discourse.pangeo.io/u/rabernat)
#### Post date: [October 26, 2020, 2:42pm UTC](https://discourse.pangeo.io/t/google-storage-gs-urls-for-pangeo-datasets-on-gcs/975/2 "2020-10-26T14:42:00Z")

</div>

Hi @andrewbrettin – thanks for this interesting question.

The current “official” Pangeo catalog is an Intake catalog and is managed here:

> **[pangeo-data/pangeo-datastore](https://github.com/pangeo-data/pangeo-datastore)**
>
> Pangeo Cloud Datastore. Contribute to pangeo-data/pangeo-datastore development by creating an account on GitHub.

  
And the catalog for CM2.6 is here:  

> <https://github.com/pangeo-data/pangeo-datastore/blob/master/intake-catalogs/ocean/GFDL_CM2.6.yaml>

This is turned into a website here:

> **[Pangeo Catalog](https://catalog.pangeo.io/)**

We intend the data to be used via intake, e.g.

```python

from intake import open_catalog
cat = open_catalog("https://raw.githubusercontent.com/pangeo-data/pangeo-datastore/master/intake-catalogs/ocean/GFDL_CM2.6.yaml")
ds = cat["GFDL_CM2_6_control_ocean"].to_dask()

```

However, your question reveals two problems with this approach:

- If you don’t want to open the data with xarray / dask but would rather open it directly with zarr, or just even know the actual URL on cloud storage, intake doesn’t make that easy for you
- The catalog website also does not make that information obvious

These are two concrete things we could try to improve going forward.

I hope this helps.
