Announcement:
We are excited to announce the return of the Pangeo Showcase event! This showcase is a time and platform to speak to the community about how you are tackling issues with or related to Pangeo. These are freeform talks made available to the community with a DOI via zenodo and on the Pangeo YouTube Channel, and presented for the first ~15 minute of the weekly Pangeo Community Meeting, held every Wednesday alternating between 12pm and 4pm US Eastern Local Time (EST or EDT). If you’re interested in giving a talk, fill out this short form. Our first speaker to kick off the showcase is Peter Marsh to talk about how to access large files thought cloud friendly pathways. Please see the prompt below, start pondering on your experience in the area, and come ready to talk!
Meeting Logistics!
Title: Accessing NetCDF and GRIB file collections as cloud-native virtual datasets using Kerchunk
Invited Speaker: Peter Marsh
When: Wednesday, September 21st 12PM EDT
Where: Launch Meeting - Zoom
Abstract:
A showcase explaining the functionality and use cases of the open source python package Kerchunk. The Kerchunk library provides a way to map the internal layout and chunking of various gridded scientific data files to virtual Zarr datasets. By creating standardized reference files users can now directly access the compressed chunks of data contained in the original files as a single virtual datasets. This provides a convenient and low cost means for creating Cloud-Optimized, Analysis-Ready datasets.
Relevant material: kerchunk — kerchunk documentation
Agenda:
- 5-15 minutes - Community showcase
- 5-15 minutes - Q&A / Community check-in
- 20-35 minutes - Agenda and Open discussion
Kind regards,
The Pangeo Showcase Organizers