Announcing the Earthmover Data Marketplace: Subscribe to ARCO datasets from ECMWF, NOAA, and more. Explore the marketplace .
Ryan Abernathey

Ryan Abernathey

CEO & Co-founder

20 posts

Announcing the Earthmover Data Marketplace

Announcing the Earthmover Data Marketplace

Earthmover launches the world's first marketplace for AI-ready weather and climate data, offering instant access to analysis-ready cloud-optimized data cubes from leading providers in the open-source Icechunk format.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

I/O-Maxing Tensors in the Cloud

I/O-Maxing Tensors in the Cloud

Zarr Python with Icechunk or Obstore now fully saturates the network between EC2 and S3, achieving the physically maximum possible throughput for reading and writing tensor data in the cloud. Benchmarks compare Zarr, Tensorstore, TileDB, and Parquet stacks across a range of chunk sizes and instance types.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Building the Future of Scientific Data at the Zarr Summit

Building the Future of Scientific Data at the Zarr Summit

Earthmover co-organizes the Zarr Summit in Rome, bringing together developers and adopters to advance the open-source cloud-native array format as adoption accelerates across major organizations like ESA, NASA, and NVIDIA.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Icechunk 1.0: Production-Grade Cloud-Native Array Storage Is Here

Icechunk 1.0: Production-Grade Cloud-Native Array Storage Is Here

Icechunk 1.0 is now stable and production-ready, bringing transactional safety, efficient versioning, high-performance Rust-based I/O, and virtual references for HDF5 and NetCDF to cloud-native array storage. The release includes manifest splitting, distributed writes, conflict resolution, and a 30 TB ERA5 sample dataset.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Fundamentals: Tensors vs. Tables

Fundamentals: Tensors vs. Tables

Multidimensional array data about the physical world is fundamentally incompatible with the tabular data model. Benchmarks show that array-native tools like Xarray and Zarr outperform DuckDB and Parquet by up to 10x for common weather data queries.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

How Our Customers Use NOAA Data

How Our Customers Use NOAA Data

Earthmover customers share how NOAA climate and weather data powers their businesses, from wildfire risk modeling and energy trading to carbon market ratings and precipitation enhancement.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Announcing Icechunk!

Announcing Icechunk!

Earthmover announces Icechunk, an open-source transactional storage engine for Zarr that brings ACID transactions, time travel, data versioning, and high-performance Rust-based I/O to multidimensional array data in cloud object storage.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Case Study: ALIVE at The University of Wisconsin-Madison

Case Study: ALIVE at The University of Wisconsin-Madison

The ALIVE research team at UW-Madison uses Arraylake to manage GOES-R satellite data for near real-time carbon and water flux estimation, benefiting from version control, ACID transactions, and seamless remote collaboration.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Case Study: Sylvera

Case Study: Sylvera

Carbon market ratings company Sylvera adopted Arraylake to centralize millions of scattered geotiff files into cloud-optimized arrays, enabling incremental data ingestion and version-tracked auditing across their geospatial pipelines.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Earthmover and Pangeo at AGU 2023

Earthmover and Pangeo at AGU 2023

Earthmover will be at AGU 2023 in booth 1007 alongside Coiled and Pangeo, demoing Arraylake and presenting three talks on cloud-native scientific data workflows.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Arraylake Now Available in Private Beta

Arraylake Now Available in Private Beta

Earthmover launches Arraylake in private beta, a cloud-native data lake platform purpose-built for multidimensional arrays with a built-in data catalog, ACID transactions, version control, and virtual file support.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Why we started Earthmover

Why we started Earthmover

Earthmover was founded to build a modern cloud data stack for scientific data, inspired by the success of the Pangeo open-source community and the urgent need for better tooling around multidimensional array datasets in climate tech and beyond.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder