# The CMIP6 Data for our Hackathon

**URL:** <https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73>\
**Category:** CMIP6 Hackathon\
**Created:** [September 13, 2019, 12:09am UTC](https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73 "2019-09-13T00:09:18Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![naomi-henderson](https://avatars.discourse-cdn.com/v4/letter/n/ecb155/32.png) [@naomi-henderson](https://discourse.pangeo.io/u/naomi-henderson)\
**Post date:** [September 13, 2019, 12:09am UTC](https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73/1 "2019-09-13T00:09:18Z")

</div>

This topic is for discussing the CMIP6 collection and the various resources for identifying and requesting data for your projects.

---

<div class="post-metadata">

**Author:** ![naomi-henderson](https://avatars.discourse-cdn.com/v4/letter/n/ecb155/32.png) [@naomi-henderson](https://discourse.pangeo.io/u/naomi-henderson)\
**Post date:** [September 13, 2019, 2:49am UTC](https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73/2 "2019-09-13T02:49:54Z")

</div>

Hi all, I am Naomi Henderson (research scientist, LDEO) and I have been putting together our zarr CMIP6 bucket in Google Cloud Storage (GCS). I will get this started by giving a few general tips which should apply to both the NCAR/GLADE and the LDEO/GCS collections.

## 1. Finding the data you need:

- Identify your project and decide which variables and experiments you will need

- Check availability at: [ESGF](https://esgf-node.llnl.gov/search/cmip6/)

- CMIP6 Data for beginners: [Google Doc](https://tinyurl.com/y2m8wdk4)

- CMIP6 `table_id` is a code for specifying realm and frequency, see: [HERE](https://docs.google.com/spreadsheets/d/1Hmu9fE9GdXUZoTl90vDv-qiI803L2feMxe6dAR0oErI/edit?usp=sharing)

- CMIP6 experiments (`experiment_id`):

- CMIP6 models (`source_id`):

- CMIP6 variables (`variable_id`):

- Check the [CMIP ERRATA page](https://errata.es-doc.org/static/index.html?project=cmip6)

## 2. Make a request: [HERE](https://tinyurl.com/cmip-data-request)

- A data request can be made with a minimum of 3 keywords: `experiment_id`, `table_id`, and `variable_id`.

- The Google Form which we have put together allows you to specify first a `table_id` and then select multiple `experiment_id`s and provide a list of `variable_id`s.

- Normally, we would assume you would like all available models, but if you would like specific models, you can select `source_id`s from a list.

- Please add comments and questions if the simple form does not quite fit your requirements.

---

<div class="post-metadata">

**Author:** ![rabernat](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/rabernat/32/22_2.png) [@rabernat](https://discourse.pangeo.io/u/rabernat)\
**Post date:** [September 13, 2019, 1:08pm UTC](https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73/3 "2019-09-13T13:08:30Z")

</div>

Thanks @naomi for this very useful post!

---

<div class="post-metadata">

**Author:** ![afahadabdullah](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/afahadabdullah/32/76_2.png) [@afahadabdullah](https://discourse.pangeo.io/u/afahadabdullah)\
**Post date:** [September 18, 2019, 4:29pm UTC](https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73/4 "2019-09-18T16:29:43Z")

</div>

Thanks, Naomi for the post and collecting CMIP6 data. I am wondering if it is possible to get Observed/reanalysis data for the Hackathon. Era5 will be great as reanalysis data. I am also looking for CMIP5 data to use in the hackathon. However, I wasn’t able to request the CMIP5 data.

---

<div class="post-metadata">

**Author:** ![cspencerjones](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/cspencerjones/32/59_2.png) [@cspencerjones](https://discourse.pangeo.io/u/cspencerjones)\
**Post date:** [September 25, 2019, 1:21pm UTC](https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73/5 "2019-09-25T13:21:44Z")

</div>

When I make a data request, should I include all the variables I want, or just the ones not listed in the “Preliminary contents of our GCS (gs://pangeo-cmip6) bucket” section of the google doc?

---

<div class="post-metadata">

**Author:** ![naomi](https://avatars.discourse-cdn.com/v4/letter/n/ee59a6/32.png) [@naomi](https://discourse.pangeo.io/u/naomi)\
**Post date:** [September 25, 2019, 1:35pm UTC](https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73/6 "2019-09-25T13:35:40Z")

</div>

Hi @cspencerjones , it is probably better to list all the variables you want - so that the scripts know to automatically update as more datasets become available at ESGF. I am not sure if this is true for the NCAR/GLADE folks, but it is for the LDEO GCS collection. Thanks for the question!

---

<div class="post-metadata">

**Author:** ![AndMei](https://avatars.discourse-cdn.com/v4/letter/a/977dab/32.png) [@AndMei](https://discourse.pangeo.io/u/AndMei)\
**Post date:** [March 24, 2020, 10:19am UTC](https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73/7 "2020-03-24T10:19:40Z")

</div>

Thanks all for the valuable resource. Once we’ve made a request, is there any way of knowing if it is being actioned, or being notified when it is?

---

<div class="post-metadata">

**Author:** ![naomi](https://avatars.discourse-cdn.com/v4/letter/n/ee59a6/32.png) [@naomi](https://discourse.pangeo.io/u/naomi)\
**Post date:** [March 24, 2020, 12:30pm UTC](https://discourse.pangeo.io/t/the-cmip6-data-for-our-hackathon/73/8 "2020-03-24T12:30:19Z")

</div>

Hi @AndMei , normally it has been taking just a day or two for requests to be filled, so that feature was not so important, perhaps! The LLNL downloads were not happening for a few days, and now the internet seems very slow (gamers? netflix?). But I should have gotten back to you sooner, sorry. I will email you separately with an update.

It is a great idea to build in automatic updates, though. Would you be willing to open an issue here [https://github.com/naomi-henderson/cmip6collect](https://github.com/naomi-henderson/cmip6collect)?