Announcing IceChunkCoin: The World's First Multi-Dimensional, Chunk-Native Blockchain Asset
Today we’re thrilled to announce IceChunkCoin, the world’s first hyper-dimensional, chunk-native blockchain asset.
Ryan Abernathey
CEO & Co-founder
Tag
#icechunk
17 posts
Cursed venvs, Confident Releases: Testing Icechunk Across Major Versions
tl;dr: Technical details of how we do surgery on python wheels in order to do cross version compatibility testing. We're getting ready to release Icechunk V2 — the next evolution of our tensor storage engine. People run real workloads on Icechunk V1. They're not all going to upgrade on the same day.
Ian Hunt-Isaak
Xarray Community Developer
Evolving our Tensor Storage Engine: A Preview of Icechunk 2
Earthmover is building the cloud platform for scientific data, focusing on weather, climate and geospatial use cases. In these domains, tensors, not tables, are the ideal data model. We have devoted major engineering effort for the past year to Icechunk, our open-source transactional tensor storage
Sebastian Galkin
Staff Engineer
I/O-Maxing Tensors in the Cloud
The critical role of I/O in data science and AI/ML For both analytics and AI workloads, fast I/O is the foundation of good performance. Most of these workloads involve fluxing a large amount of data from storage into RAM, and then to the CPU or GPU. In the cloud, where data reside on object storage,
Ryan Abernathey
CEO & Co-founder
From 10 Minutes to 10 Seconds: How Woods Hole Scientists used Icechunk to Optimize Ocean Data Access
Note: this is a guest post by Woods Whole Oceanographic Institute scientist Dr. Iury Simoes-Sousa Among the many ways the ocean affects our lives, one of the most fundamental is through its ability to transport key climate variables such as heat, nutrients, and marine organisms. This transport happe
Iury Simoes-Sousa
Postdoctoral Investigator, WHOI
Multi-Player Mode: Why Teams That Use Zarr Need Icechunk
Bring reliability, scalability, and version control to your Zarr datasets, without giving up performance. Zarr is a powerful protocol for storing large-scale, multi-dimensional arrays. It's fast, scalable, and cloud-native, which is why it's used across a variety of domains like climate science and
Lindsey Nield
Software Engineer
Radar DataTree: Transforming thousands of scans into a single cohesive model
From structure to scale, radar needs a model that organizes complete collections as time-aware, cloud-native datasets. In our second post, we looked at how new standards and open-source tools are transforming weather radar from raw binary blobs into structured, metadata-rich datasets. FM-301—an offi
Alfonso Ladino-Rincon
Data Scientist
Icechunk 1.0: Production-Grade Cloud-Native Array Storage Is Here
A year ago, we made an important internal decision which set Earthmover on a new course—we decided to refactor and open source our core technology for storing array-based data in the cloud. This took the form of the Icechunk project, an open source package and specification enabling database-style t
Ryan Abernathey
CEO & Co-founder
Everything you need to know about Icechunk garbage collection
We will talk about two powerful Icechunk operations: expiration and garbage collection. They are related, so we usually refer to both under the name of garbage collection or simply GC. We will explain what each of them does, why you may want to use them, and how to do it safely and effectively. The
Sebastian Galkin
Staff Engineer
Fundamentals: What Is Zarr? A Cloud-Native Format for Tensor Data
Why scientists, data engineers, and developers are turning to Zarr Often the biggest bottleneck in your workflow isn’t your code or your hardware, but the way your data is stored. Data formats can limit–or unlock–what you’re able to do with your data. In modern science and data-intensive computing,
Lindsey Nield
Software Engineer
Icechunk: Efficient storage of versioned array data
We recently got an interesting question in Icechunk's community Slack channel (thank you Iury Simoes-Sousa for motivating this post): I'm new to Icechunk. How is the storage managed for redundant information between different versions of a data repository? Icechunk keeps your data versioned, allowin
Sebastian Galkin
Staff Engineer
Zarr takes Cloud-Native Geospatial by storm
Our takeaways from the Cloud-Native Geospatial conference on Zarr's surging adoption and its impact on the future of Earth Observation data. Our team just returned from an action-packed week at the Cloud-Native Geospatial conference in beautiful Snowbird, Utah, and the key takeaway was unmistakable:
Joe Hamman
CTO & Co-founder
Learning about Icechunk consistency with a clichéd but instructive example
In this post we'll show what can happen when more than one process write to the same Icechunk repository concurrently, and how Icechunk uses transactions and conflict resolution to guarantee consistency. For this, we'll use a commonplace example: bank account transfers. This is not a problem you wou
Sebastian Galkin
Staff Engineer
Fundamentals: What is Cloud-Optimized Scientific Data?
Why naively lifting scientific data to the cloud falls flat. Scientific formats predate the cloud There are exabytes of scientific data out in the wild, with more being generated every year. At Earthmover we believe the best place for it to reside is in the cloud, in object storage. Cloud platforms
Tom Nicholas
Software Engineer
Exploring Icechunk scalability: untangling S3's prefix story
We at Earthmover recently released the Icechunk tensor storage engine, a novel cloud-optimized storage format and library for large-scale array data. Built on Rust’s tokio async runtime, Icechunk delivers impressive gains in performance over today’s array storage engines (e.g. Zarr V2, netCDF). The
Sebastian Galkin
Staff Engineer
Solving NASA's Cloud Data Dilemma: How Icechunk Revolutionizes Earth Data Access
Summary NASA has been migrating over 100 petabytes of data from on prem systems to the cloud for the last several years and is now able to focus on measures of efficiency that were not possible before. Earthmover and Development Seed worked with NASA to pilot Earthmover’s open-source Icechunk tensor
Ryan Abernathey
CEO & Co-founder
Announcing Icechunk!
TLDR We are excited to announce the release of the Icechunk storage engine, a new open-source library and specification for the storage of multidimensional array (a.k.a. tensor) data in cloud object storage. Icechunk works together with Zarr, augmenting the Zarr core data model with features that en
Ryan Abernathey
CEO & Co-founder
Related Posts
- Announcing IceChunkCoin: The World's First Multi-Dimensional, Chunk-Native Blockchain Asset Apr 1, 2026
- Cursed venvs, Confident Releases: Testing Icechunk Across Major Versions Mar 20, 2026
-
Ditch the Data Pipeline: A Snow Alert Bot in an Afternoon Feb 18, 2026 -
Earthmover Selected to Power ARIA’s “Forecasting Tipping Points” Simulation Catalogue Feb 9, 2026
Blog Tags
access controls announcement arraylake Big Data blog post blog-post case study case-study cloud cloud native conference data cube data workflows dev note earth-observation event FAIR feature release flux fundamentals garbage collection geospatial GOES-R icechunk marketplace NASA netCDF NOAA oceanography open data open science open source performance Python Radar Rust serverless tabular data tensorops tensors testing third-wheel vector data weather Xarray zarr