Pangeo Showcase: "Compression of Geospatial Data with Varying Information Density"

DOI

Title: “Compression of Geospatial Data with Varying Information Density”
Invited Speaker: Ayoub Fatihi (ORCID: 0000-0001-8572-6553), Milan Klöwer (ORCID: 0000-0002-3920-4356),Hauke Schulz (ORCID: 0000-0001-5468-1137), Miha Razinger (ORCID: 0000-0001-6280-4264),Juan José Dominguez
When: Wednesday, Nov 1, 12PM EDT
Where: Launch Meeting - Zoom
Abstract:
Geospatial data can vary in its information density from one part of the world to another. A dataset containing streets will be very dense in cities but contains little information in remote places like the Alps or even the ocean. The same is also true for datasets about the ocean or the atmosphere. The variability of sea surface temperatures and currents is much larger in the vicinity of the golf stream than in the middle of the Atlantic basin. This variability might also change in time. A hurricane, for example, has a lot of variability in winds, temperature and rain rates, and travels in addition across entire ocean basins.

The challenge of this project is to improve xbitinfo to preserve the natural variability of these features but not to save random noise where the real information density is rather low. This means in particular that the number of bits needed to preserve in compression changes with location. A hurricane has a different information density than a same-sized area in the steadily blowing trade-wind regimes. Compressibility of climate data therefore can change drastically in time and space, which we want to exploit.

Currently in the bitinformation framework, to preserve all real information, the maximum information content calculated by xbitinfo needs to be used for the entire dataset. However, bitinformation can also be calculated on subsets, such that the ‘boring’ parts can therefore be more efficiently compressed.

  • 20 minutes - Community Showcase
  • 40 minutes - Showcase discussion/Community check-ins
5 Likes

Hi Rich. A couple of folks here are interested in the recording. Should I look for it on Youtube ?

Cheers!

@Yves_Moisan , thanks for the reminder! :slight_smile:
I have updated the post above with the link to Zenodo and also the recording!

1 Like