Ryan Abernathey

Ryan Abernathey

CEO & Co-founder

24 posts

Our compute roadmap: introducing Zax SQL

Our compute roadmap: introducing Zax SQL

We're introducing Zax, a new query and compute engine for multidimensional scientific data, and Zax-SQL, the first interface to it. Zax plans your computation for you, so you are no longer responsible for tuning chunk sizes, worker counts, and memory limits.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Brian Davis
Brian Davis

Head of Product

Joe Hamman
Joe Hamman

CTO & Co-founder

Deepak Cherian
Deepak Cherian

Principal Research Engineer

Sebastian Galkin
Sebastian Galkin

Head of Engineering

Making open-source AI weather forecasting models easy to run

Making open-source AI weather forecasting models easy to run

A joint post from Earthmover and Hugging Face on running open-source AI weather forecasting models like Aurora using free ERA5 data from the Earthmover Marketplace — with a live demo space and a full local tutorial.

Emma Scharfmann
Emma Scharfmann

ML for Science, Hugging Face

Aaron Spring
Aaron Spring

ML, AI and geospatial data engineering

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Kashif Rasul
Kashif Rasul

AI Research Science, Hugging Face

Filtered Subscriptions: Fine-Grained Cloud-Native Data Sharing

Filtered Subscriptions: Fine-Grained Cloud-Native Data Sharing

Earthmover's filtered subscriptions allow data providers to create secure, read-only views into multidimensional data cubes, enabling more granular cloud-native data exchange between provider and consumer.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Sebastian Galkin
Sebastian Galkin

Head of Engineering

Lindsey Nield
Lindsey Nield

Senior Engineer

Announcing the Earthmover Data Marketplace

Announcing the Earthmover Data Marketplace

Earthmover launches the world's first marketplace for AI-ready weather and climate data, offering instant access to analysis-ready cloud-optimized data cubes from leading providers in the open-source Icechunk format.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

I/O-Maxing Tensors in the Cloud

I/O-Maxing Tensors in the Cloud

Zarr Python with Icechunk or Obstore now fully saturates the network between EC2 and S3, achieving the physically maximum possible throughput for reading and writing tensor data in the cloud. Benchmarks compare Zarr, Tensorstore, TileDB, and Parquet stacks across a range of chunk sizes and instance types.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Icechunk 1.0: Production-Grade Cloud-Native Array Storage Is Here

Icechunk 1.0: Production-Grade Cloud-Native Array Storage Is Here

Icechunk 1.0 is now stable and production-ready, bringing transactional safety, efficient versioning, high-performance Rust-based I/O, and virtual references for HDF5 and NetCDF to cloud-native array storage. The release includes manifest splitting, distributed writes, conflict resolution, and a 30 TB ERA5 sample dataset.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Fundamentals: Tensors vs. Tables

Fundamentals: Tensors vs. Tables

Multidimensional array data about the physical world is fundamentally incompatible with the tabular data model. Benchmarks show that array-native tools like Xarray and Zarr outperform DuckDB and Parquet by up to 10x for common weather data queries.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

How Our Customers Use NOAA Data

How Our Customers Use NOAA Data

Earthmover customers share how NOAA climate and weather data powers their businesses, from wildfire risk modeling and energy trading to carbon market ratings and precipitation enhancement.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Announcing Icechunk!

Announcing Icechunk!

Earthmover announces Icechunk, an open-source transactional storage engine for Zarr that brings ACID transactions, time travel, data versioning, and high-performance Rust-based I/O to multidimensional array data in cloud object storage.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Case Study: Sylvera

Case Study: Sylvera

Carbon market ratings company Sylvera adopted Arraylake to centralize millions of scattered geotiff files into cloud-optimized arrays, enabling incremental data ingestion and version-tracked auditing across their geospatial pipelines.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Earthmover and Pangeo at AGU 2023

Earthmover and Pangeo at AGU 2023

Earthmover will be at AGU 2023 in booth 1007 alongside Coiled and Pangeo, demoing Arraylake and presenting three talks on cloud-native scientific data workflows.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Arraylake Now Available in Private Beta

Arraylake Now Available in Private Beta

Earthmover launches Arraylake in private beta, a cloud-native data lake platform purpose-built for multidimensional arrays with a built-in data catalog, ACID transactions, version control, and virtual file support.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder

Why we started Earthmover

Why we started Earthmover

Earthmover was founded to build a modern cloud data stack for scientific data, inspired by the success of the Pangeo open-source community and the urgent need for better tooling around multidimensional array datasets in climate tech and beyond.

Ryan Abernathey
Ryan Abernathey

CEO & Co-founder