# Pangeo Showcase: "Firecube: A plugin-based batch ingestion engine for creating operational analysis-ready data cubes" (October 14, 12 PM EDT / 16:00 UTC)

**URL:** <https://discourse.pangeo.io/t/pangeo-showcase-firecube-a-plugin-based-batch-ingestion-engine-for-creating-operational-analysis-ready-data-cubes-october-14-12-pm-edt-16-00-utc/5834>\
**Category:** Pangeo Showcase\
**Created:** [October 8, 2026, 3:42pm UTC](https://discourse.pangeo.io/t/pangeo-showcase-firecube-a-plugin-based-batch-ingestion-engine-for-creating-operational-analysis-ready-data-cubes-october-14-12-pm-edt-16-00-utc/5834 "2026-10-08T15:42:53Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![maxrjones](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/maxrjones/32/3190_2.png) [@maxrjones](https://discourse.pangeo.io/u/maxrjones)\
**Post date:** [October 8, 2026, 3:42pm UTC](https://discourse.pangeo.io/t/pangeo-showcase-firecube-a-plugin-based-batch-ingestion-engine-for-creating-operational-analysis-ready-data-cubes-october-14-12-pm-edt-16-00-utc/5834/1 "2026-10-08T15:42:53Z")

</div>

[![](https://canada1.discourse-cdn.com/flex030/uploads/pangeo/original/2X/3/39b13a5c76c3f94705296cabb974b9096a83364a.jpeg "Firecube: A plugin-based batch ingestion engine for creating operational analysis-ready data cubes") ](https://www.youtube.com/watch?v=qLHfD5006Q4)

**Title** : “Firecube: A plugin-based batch ingestion engine for creating operational analysis-ready data cubes”  
**Speaker** s: Armagan Karatosun and Anna-Lena Erdmann  
**When:** Wednesday, October 14, 2026 at 12 PM EDT (2026-10-14T16:00:00Z)  
**Where:** [Launch Meeting - Zoom](https://numfocus-org.zoom.us/j/83234473026?pwd=mgM3uAuru1AE1aFPlRjW2dAAAyo8IY.1)  
**Details:**

Join us next Wednesday, October 14 at 12 PM EDT for the next Pangeo showcase presentation!

**Abstract** :

At EUMETSAT we are working with petabytes of satellite data and climate data records, and our task was simple (!): to turn them into analysis-ready, cloud-optimized Zarr cubes, and to keep doing it as new data arrives. The usual answer, a to\_zarr script per dataset, broke down in production: a six-hour ingestion interrupted in its third hour by a virtual machine that died under disk pressure. Appends were serialized on one writer; a crashed job meant starting over, and nobody could tell which slots had been written or by which run.

This is why we built Firecube: a plugin-based ingestion engine that makes those cubes operational, meaning safe to interrupt, resumable, reproducible, and parallel to write, all in native Zarr. A plugin describes the product; Firecube plans the store, coordinates the writers, and keeps a record of what was written. We’ll walk through how it parallelizes writes within one Zarr store, the small control plane that makes runs resumable, and the numbers from a production ingest.

By open-sourcing Firecube, we are looking for users, contributors, collaborators, and feedback so that it serves Zarr cube producers across the scientific community, well beyond EUMETSAT.

Agenda:

- ~15 minutes - Showcase presentation
- 10 - 30 minutes - Discussion
- 15 - 30 minutes - Community check-in

---

<div class="post-metadata">

**Author:** ![maxrjones](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.pangeo.io/maxrjones/32/3190_2.png) [@maxrjones](https://discourse.pangeo.io/u/maxrjones)\
**Post date:** [October 14, 2026, 3:31pm UTC](https://discourse.pangeo.io/t/pangeo-showcase-firecube-a-plugin-based-batch-ingestion-engine-for-creating-operational-analysis-ready-data-cubes-october-14-12-pm-edt-16-00-utc/5834/2 "2026-10-14T15:31:16Z")

</div>

Happening in 30 minutes!