Ship fast, break nothing: Engineering rigor in Icechunk with concurrency & fault injection testing
We describe our approach to rigor in Icechunk 2 including concurrency permutation testing and more!
Deepak Cherian
Forward Deployed Engineer
Tag
#testing
3 posts
Ship fast, break nothing: Engineering rigor in Icechunk with property and stateful testing
How we engineer rigor into Icechunk and its upstream brethren using property and stateful testing techniques. Also, a cautionary tale.
Deepak Cherian
Forward Deployed Engineer
Sebastian Galkin
Staff Engineer
Cursed venvs, Confident Releases: Testing Icechunk Across Major Versions
Earthmover built third-wheel, an open-source tool that rewrites Python wheels to install multiple versions of a library in one environment, enabling cross-version compatibility testing for the Icechunk V2 release.
Ian Hunt-Isaak
Xarray Community Developer
Related Posts
-
Announcing the Arraylake MCP Server May 12, 2026 -
Beyond Weather: On-demand visualizations of fine tuned AIFS models over NetCDF workarounds in one week May 7, 2026 -
Variable length chunks in Zarr May 5, 2026 - Ship fast, break nothing: Engineering rigor in Icechunk with concurrency & fault injection testing Apr 28, 2026
Blog Tags
access controls ai AI weather AIFS announcement arraylake Big Data blog post blog-post case study case-study climate risk cloud cloud native conference data cube data workflows dev note earth observation earth-observation energy engineering event FAIR feature release flux fundamentals garbage collection geospatial GOES-R hypothesis icechunk IFS marketplace mcp NASA netCDF NetCDF NOAA oceanography open data open science open source performance property-testing Python Radar rust Rust serverless shuttle tabular data technical tensorops tensors testing third-wheel toxiproxy vector data weather wildfire xarray Xarray zarr Zarr