Ship fast, break nothing: Engineering rigor in Icechunk with concurrency & fault injection testing
We describe our approach to rigor in Icechunk 2 including concurrency permutation testing and more!
Deepak Cherian
Forward Deployed Engineer
Tag
#Rust
2 posts
Announcing Icechunk!
Earthmover announces Icechunk, an open-source transactional storage engine for Zarr that brings ACID transactions, time travel, data versioning, and high-performance Rust-based I/O to multidimensional array data in cloud object storage.
Ryan Abernathey
CEO & Co-founder
Related Posts
-
Announcing the Arraylake MCP Server May 12, 2026 -
Beyond Weather: On-demand visualizations of fine tuned AIFS models over NetCDF workarounds in one week May 7, 2026 -
Variable length chunks in Zarr May 5, 2026 - Ship fast, break nothing: Engineering rigor in Icechunk with concurrency & fault injection testing Apr 28, 2026
Blog Tags
access controls ai AI weather AIFS announcement arraylake Big Data blog post blog-post case study case-study climate risk cloud cloud native conference data cube data workflows dev note earth observation earth-observation energy engineering event FAIR feature release flux fundamentals garbage collection geospatial GOES-R hypothesis icechunk IFS marketplace mcp NASA netCDF NetCDF NOAA oceanography open data open science open source performance property-testing Python Radar rust Rust serverless shuttle tabular data technical tensorops tensors testing third-wheel toxiproxy vector data weather wildfire xarray Xarray zarr Zarr