# Processing Terabyte-Scale NASA Cloud Datasets with Coiled

**URL:** https://discourse.pangeo.io/t/processing-terabyte-scale-nasa-cloud-datasets-with-coiled/3825
**Category:** Cloud
**Created:** [November 7, 2023, 6:12pm UTC](https://discourse.pangeo.io/t/processing-terabyte-scale-nasa-cloud-datasets-with-coiled/3825 "2023-11-07T18:12:38Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![jrbourbeau](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/jrbourbeau/32/1873_2.png) [@jrbourbeau](https://discourse.pangeo.io/u/jrbourbeau)
#### Post date: [November 7, 2023, 6:12pm UTC](https://discourse.pangeo.io/t/processing-terabyte-scale-nasa-cloud-datasets-with-coiled/3825/1 "2023-11-07T18:12:38Z")

</div>

Hi All,

I’ve been working with groups that process NASA data (folks like @asteiker @betolink @andypbarrett @jinbow) to help move their workloads to the cloud. It turns out a common pattern for lots of workloads is a big parallel for-loop.

Here’s a blogpost where we wrote about this analysis pattern and discussed cloud performance and cost [Processing Terabyte-Scale NASA Cloud Data | Coiled](https://medium.com/coiled-hq/processing-terabyte-scale-nasa-cloud-datasets-with-coiled-70ab552f35ec) (Spoiler: it’s surprisingly cheap to churn through a bunch of cloud data when using spot instances, the right region, etc.)

Hopefully this can serve as a useful template for others with similar use cases

---

<div class="post-metadata">

### Author: ![betolink](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/betolink/32/247_2.png) [@betolink](https://discourse.pangeo.io/u/betolink)
#### Post date: [November 27, 2023, 9:37pm UTC](https://discourse.pangeo.io/t/processing-terabyte-scale-nasa-cloud-datasets-with-coiled/3825/2 "2023-11-27T21:37:04Z")

</div>

Just to mention that we are having a community call tomorrow to talk about Coiled-powered workflows for cloud data [Openscapes Community Call: NASA Earthdata Cloud with Coiled](https://openscapes.org/events/2023-11-28-coiled-openscapes/)  
This call is open and it would be great if Pangeo folks can attend and give their 2c on this approach.
