Articles, announcements, and case studies from the Earthmover team.https://earthmover.io/en-ushttps://earthmover.io/blog/icechunk-at-nws-cirrus/https://earthmover.io/blog/icechunk-at-nws-cirrus/Earthmover has teamed up with Booz Allen Hamilton on NWS CIRRUS — NOAA's new cloud-based operational data platform for the National Weather Service. Icechunk will serve as a core data format for the operational data lake.Thu, 04 Jun 2026 00:00:00 GMTAnnouncementJoe Hammanhttps://earthmover.io/blog/virtual-zarr/https://earthmover.io/blog/virtual-zarr/Access billions of chunks of satellite imagery as a single Zarr store, without copying any data!Tue, 02 Jun 2026 00:00:00 GMTBlog PostTom Nicholashttps://earthmover.io/blog/low-latency-era5-icechunk-marketplace/https://earthmover.io/blog/low-latency-era5-icechunk-marketplace/We released Icechunk-ERA5, a performance-optimized, daily updating ERA5 data cube available now in the Earthmover data marketplace.Mon, 01 Jun 2026 00:00:00 GMTAnnouncementRyan Abernatheyhttps://earthmover.io/blog/engineering-rigor-in-icechunk-part-3/https://earthmover.io/blog/engineering-rigor-in-icechunk-part-3/How we used third-wheel and Hypothesis to interleave Icechunk 1.x and 2.x in a single stateful test — and the bugs that fell out.Thu, 21 May 2026 12:00:00 GMTBlog PostIan Hunt-Isaakhttps://earthmover.io/blog/announcing-arraylake-mcp/https://earthmover.io/blog/announcing-arraylake-mcp/The Arraylake MCP server is now publicly available. Connect Claude, ChatGPT, Cursor, or any MCP-compatible client to your Arraylake data and let an AI assistant discover repositories, inspect schemas, query Flux, and render interactive maps.Tue, 12 May 2026 00:00:00 GMTAnnouncementMatt Iannuccihttps://earthmover.io/blog/beyond-weather-netcdf-workarounds-to-beautiful-visualizations/https://earthmover.io/blog/beyond-weather-netcdf-workarounds-to-beautiful-visualizations/The Company: Long Range AI Weather Prediction Beyond Weather is an Amsterdam-based AI weather forecasting startup with its roots in academic research. Founded in 2023 by a master's student, a PhD researcher, and a professor from the Vrije Universiteit Amsterdam's climate extremes and societal risk r…Thu, 07 May 2026 12:00:00 GMTCase StudyMargaret Francishttps://earthmover.io/blog/zarr-variable-length-chunks/https://earthmover.io/blog/zarr-variable-length-chunks/A new extension to Zarr just landed: the rectilinear chunk grid lets you specify arbitrarily sized chunks along each axis, aligning chunk boundaries with the natural structure of your data instead of forcing a regular grid.Tue, 05 May 2026 00:00:00 GMTBlog PostJoe Hamman, Max Jones, Davis Bennethttps://earthmover.io/blog/engineering-rigor-in-icechunk-concurrency-fault-injection/https://earthmover.io/blog/engineering-rigor-in-icechunk-concurrency-fault-injection/We describe our approach to rigor in Icechunk 2 including concurrency permutation testing and more!Tue, 28 Apr 2026 12:00:00 GMTBlog PostDeepak Cherianhttps://earthmover.io/blog/engineering-rigor-in-icechunk-part-1/https://earthmover.io/blog/engineering-rigor-in-icechunk-part-1/How we engineer rigor into Icechunk and its upstream brethren using property and stateful testing techniques. Also, a cautionary tale.Wed, 22 Apr 2026 12:00:00 GMTBlog PostDeepak Cherian, Sebastian Galkinhttps://earthmover.io/blog/how-kettle-uses-earthmover-to-power-wildfire-risk-modeling-at-scale/https://earthmover.io/blog/how-kettle-uses-earthmover-to-power-wildfire-risk-modeling-at-scale/The Company Kettle is not a typical insurance company. Using AI to build smarter insurance products, Kettle provides insurance for property owners in areas affected by catastrophic climate events, with a particular focus on wildfire. Their AI models consume over 130 terabytes of satellite, weather,…Fri, 17 Apr 2026 00:00:00 GMTCase StudyMargaret Francishttps://earthmover.io/blog/filtered-subscriptions/https://earthmover.io/blog/filtered-subscriptions/Earthmover's filtered subscriptions allow data providers to create secure, read-only views into multidimensional data cubes, enabling more granular cloud-native data exchange between provider and consumer.Wed, 15 Apr 2026 00:00:00 GMTannouncementRyan Abernathey, Sebastian Galkin, Lindsey Nieldhttps://earthmover.io/blog/from-geotiff-chaos-to-cloud-native-climate-risk-how-eoliann-built-airis-on-earthmover/https://earthmover.io/blog/from-geotiff-chaos-to-cloud-native-climate-risk-how-eoliann-built-airis-on-earthmover/Eoliann builds proprietary climate risk models that estimate the physical impact of extreme weather events — floods, wildfires, and storms — on critical physical infrastructure: electricity transmission lines, substations, and gas pipelines…Mon, 13 Apr 2026 00:00:00 GMTCase StudyMargaret Francishttps://earthmover.io/blog/announcing-icechunk-2-better-consistency-performance-and-reliability-for-tensor-storage/https://earthmover.io/blog/announcing-icechunk-2-better-consistency-performance-and-reliability-for-tensor-storage/When we released Icechunk 1.0 last July, we declared it production-ready and committed to format stability. Since then, adoption has exceeded our expectations. Teams across weather forecasting, climate science, neuroscience, and AI/ML have pushed Icechunk into scenarios we didn't fully anticipate--r…Thu, 09 Apr 2026 00:00:00 GMTAnnouncementRyan Abernathey, Sebastian Galkinhttps://earthmover.io/blog/expanding-the-earthmover-data-marketplace/https://earthmover.io/blog/expanding-the-earthmover-data-marketplace/When we launched the Earthmover Data Marketplace in January, we described it as just the beginning. Today, we're showing that growth. We're excited to announce four new data partners joining the marketplace: Sylvera, Spire, Eagle Rock Analytics, and CarbonPlan. This second cohort adds proprietary da…Tue, 07 Apr 2026 00:00:00 GMTAnnouncementMargaret Francishttps://earthmover.io/blog/announcing-icechunkcoin/https://earthmover.io/blog/announcing-icechunkcoin/Today we’re thrilled to announce IceChunkCoin, the world’s first hyper-dimensional, chunk-native blockchain asset.Wed, 01 Apr 2026 00:00:00 GMTAnnouncementRyan Abernatheyhttps://earthmover.io/blog/cursed-venvs-confident-releases-testing-icechunk-across-major-versions/https://earthmover.io/blog/cursed-venvs-confident-releases-testing-icechunk-across-major-versions/Earthmover built third-wheel, an open-source tool that rewrites Python wheels to install multiple versions of a library in one environment, enabling cross-version compatibility testing for the Icechunk V2 release.Fri, 20 Mar 2026 00:00:00 GMTAnnouncementIan Hunt-Isaakhttps://earthmover.io/blog/ditch-the-data-pipeline-a-snow-alert-bot-in-an-afternoon/https://earthmover.io/blog/ditch-the-data-pipeline-a-snow-alert-bot-in-an-afternoon/How we built a Slack bot that alerts our team when it's snowing at their location, using Earthmover's Marketplace and Flux APIs to skip the data pipeline entirely.Wed, 18 Feb 2026 00:00:00 GMTBlog PostIan Hunt-Isaak, Matt Iannuccihttps://earthmover.io/blog/earthmover-selected-to-power-arias-forecasting-tipping-points-simulation-catalogue/https://earthmover.io/blog/earthmover-selected-to-power-arias-forecasting-tipping-points-simulation-catalogue/Earthmover has been selected by ARIA to provide the Simulation Catalogue for the Forecasting Tipping Points programme, enabling 26 research teams to share and analyze petabyte-scale climate data.Mon, 09 Feb 2026 00:00:00 GMTAnnouncementJoe Hammanhttps://earthmover.io/blog/announcing-data-marketplace/https://earthmover.io/blog/announcing-data-marketplace/Earthmover launches the world's first marketplace for AI-ready weather and climate data, offering instant access to analysis-ready cloud-optimized data cubes from leading providers in the open-source Icechunk format.Thu, 22 Jan 2026 00:00:00 GMTAnnouncementRyan Abernatheyhttps://earthmover.io/blog/evolving-our-tensor-storage-engine-a-preview-of-icechunk-2/https://earthmover.io/blog/evolving-our-tensor-storage-engine-a-preview-of-icechunk-2/A preview of Icechunk 2, featuring node rename, chunk reindexing, rectilinear grids, repository-level metadata, and significant performance improvements with a smooth migration path from Icechunk 1.Tue, 02 Dec 2025 00:00:00 GMTAnnouncementSebastian Galkinhttps://earthmover.io/blog/i-o-maxing-tensors-in-the-cloud/https://earthmover.io/blog/i-o-maxing-tensors-in-the-cloud/Zarr Python with Icechunk or Obstore now fully saturates the network between EC2 and S3, achieving the physically maximum possible throughput for reading and writing tensor data in the cloud. Benchmarks compare Zarr, Tensorstore, TileDB, and Parquet stacks across a range of chunk sizes and instance types.Tue, 25 Nov 2025 00:00:00 GMTBlog PostRyan Abernatheyhttps://earthmover.io/blog/scientific-data-visualization-with-xarray-and-napari/https://earthmover.io/blog/scientific-data-visualization-with-xarray-and-napari/A roadmap for integrating Xarray and napari to deliver named-dimension-aware, metadata-rich scientific data visualization across biology and geosciences.Wed, 29 Oct 2025 00:00:00 GMTBlog PostIan Hunt-Isaakhttps://earthmover.io/blog/building-the-future-of-scientific-data-at-the-zarr-summit/https://earthmover.io/blog/building-the-future-of-scientific-data-at-the-zarr-summit/Earthmover co-organizes the Zarr Summit in Rome, bringing together developers and adopters to advance the open-source cloud-native array format as adoption accelerates across major organizations like ESA, NASA, and NVIDIA.Fri, 10 Oct 2025 00:00:00 GMTBlog PostEventRyan Abernatheyhttps://earthmover.io/blog/from-10-minutes-to-10-seconds-how-woods-hole-scientists-used-icechunk-to-optimize-ocean-data-access/https://earthmover.io/blog/from-10-minutes-to-10-seconds-how-woods-hole-scientists-used-icechunk-to-optimize-ocean-data-access/Woods Hole scientists reduced ocean profile data access from 10 minutes to 10 seconds by converting their OPeNDAP-served NetCDF files to Icechunk repositories on AWS S3.Wed, 08 Oct 2025 00:00:00 GMTBlog PostIury Simoes-Sousahttps://earthmover.io/blog/dynamic-map-tile-rendering-icechunk-zarr-data-xpublish-tiles/https://earthmover.io/blog/dynamic-map-tile-rendering-icechunk-zarr-data-xpublish-tiles/Earthmover is launching a new open-source library xpublish-tiles that powers our new Flux Tiles service, which allows Earthmover Platform users to view their data on a slippy map with dynamically rendered tiles at lower zoom levels than was possible previously.Mon, 29 Sep 2025 00:00:00 GMTBlog PostDeepak Cherian, Matt Iannuccihttps://earthmover.io/blog/plotting-heatwaves-during-nyc-climate-week/https://earthmover.io/blog/plotting-heatwaves-during-nyc-climate-week/A hands-on walkthrough of calculating historical heatwave frequency over NYC using ERA5 reanalysis data on the Earthmover platform with Arraylake, Icechunk, Xarray, and open-source climate tools.Fri, 26 Sep 2025 00:00:00 GMTBlog PostTom Nicholashttps://earthmover.io/blog/earthmovers-7-2m-seed-round-led-by-lowercarbon-capital/https://earthmover.io/blog/earthmovers-7-2m-seed-round-led-by-lowercarbon-capital/Earthmover announces its $7.2M seed round led by Lowercarbon Capital, with participation from Costanoa Ventures and Preston-Werner Ventures, to build the cloud-native data platform for weather, climate, and scientific data.Mon, 22 Sep 2025 00:00:00 GMTAnnouncementRyan Abernatheyhttps://earthmover.io/blog/the-3-key-optimizations-that-cut-the-cost-of-ai-weather-forecasts-by-90/https://earthmover.io/blog/the-3-key-optimizations-that-cut-the-cost-of-ai-weather-forecasts-by-90/GPUs running AI weather forecasts spend over 95% of their time idle, waiting for data. Three optimizations — pre-processing inputs into Icechunk, moving regridding onto the GPU, and writing outputs in parallel — cut inference costs by nearly 90%.Wed, 27 Aug 2025 00:00:00 GMTBlog PostRyan Abernatheyhttps://earthmover.io/blog/multi-player-mode-why-teams-that-use-zarr-need-icechunk/https://earthmover.io/blog/multi-player-mode-why-teams-that-use-zarr-need-icechunk/Zarr lacks built-in support for concurrent readers and writers, leading to inconsistent reads and conflicting writes in team settings. Icechunk solves this by adding atomic updates, consistent snapshots, and Git-like version control on top of Zarr.Mon, 25 Aug 2025 00:00:00 GMTBlog PostLindsey Nieldhttps://earthmover.io/blog/radar-scan-datasets-time-aware-cloud-native/https://earthmover.io/blog/radar-scan-datasets-time-aware-cloud-native/Introducing the Radar DataTree, a new data model that organizes thousands of fragmented weather radar scans into a single time-aware, cloud-native, version-controlled dataset using xarray-datatree, Zarr, and Icechunk.Tue, 19 Aug 2025 00:00:00 GMTBlog PostAlfonso Ladino-Rinconhttps://earthmover.io/blog/earthmover-sponsors-ocean-hack-week-empowering-the-open-science-community/https://earthmover.io/blog/earthmover-sponsors-ocean-hack-week-empowering-the-open-science-community/Earthmover is sponsoring Ocean Hack Week 2025, providing financial support for participant travel and an Arraylake organization to empower the open ocean science community.Mon, 18 Aug 2025 00:00:00 GMTBlog PostRyan Abernatheyhttps://earthmover.io/blog/from-files-to-datasets-fm-301-and-the-future-of-radar-interoperability/https://earthmover.io/blog/from-files-to-datasets-fm-301-and-the-future-of-radar-interoperability/An introduction to the WMO FM-301 standard for weather radar data and how open-source tools like Xradar are turning fragmented binary radar files into structured, analysis-ready datasets.Wed, 30 Jul 2025 00:00:00 GMTBlog PostAlfonso Ladino-Rinconhttps://earthmover.io/blog/icechunk-1-0-production-grade-cloud-native-array-storage-is-here/https://earthmover.io/blog/icechunk-1-0-production-grade-cloud-native-array-storage-is-here/Icechunk 1.0 is now stable and production-ready, bringing transactional safety, efficient versioning, high-performance Rust-based I/O, and virtual references for HDF5 and NetCDF to cloud-native array storage. The release includes manifest splitting, distributed writes, conflict resolution, and a 30 TB ERA5 sample dataset.Thu, 10 Jul 2025 00:00:00 GMTAnnouncementRyan Abernatheyhttps://earthmover.io/blog/meet-the-earthmover-team-at-scipy-2025-in-tacoma/https://earthmover.io/blog/meet-the-earthmover-team-at-scipy-2025-in-tacoma/The Earthmover team is attending SciPy 2025 in Tacoma, Washington, with a tutorial on Xarray DataTree and Zarr, multiple talks and posters on Icechunk and Xarray, and a booth showcasing the Earthmover Platform.Wed, 02 Jul 2025 00:00:00 GMTEventJoe Hammanhttps://earthmover.io/blog/the-untapped-promise-of-weather-radar-data/https://earthmover.io/blog/the-untapped-promise-of-weather-radar-data/Weather radar captures rich four-dimensional atmospheric data, but legacy binary formats and fragmented archives make large-scale analysis painfully difficult. A modern, cloud-native data model could unlock radar's vast scientific potential.Mon, 30 Jun 2025 00:00:00 GMTBlog PostAlfonso Ladino-Rinconhttps://earthmover.io/blog/ergonomic-seasonal-grouping-and-resampling-in-xarray/https://earthmover.io/blog/ergonomic-seasonal-grouping-and-resampling-in-xarray/Xarray introduces SeasonGrouper and SeasonResampler, two new Grouper objects that enable custom, overlapping, and variable-length seasonal aggregations without workarounds.Wed, 18 Jun 2025 00:00:00 GMTBlog PostDeepak Cherianhttps://earthmover.io/blog/announcing-fine-grained-access-controls/https://earthmover.io/blog/announcing-fine-grained-access-controls/Arraylake now supports fine-grained, repository-level permissions with admin, write, and read privilege levels, giving teams precise control over data access and secure sharing with external collaborators.Tue, 10 Jun 2025 00:00:00 GMTAnnouncementBrian Davishttps://earthmover.io/blog/cloud-native-platforms-are-the-natural-evolution-of-atmosphere-ocean-open-data-practice/https://earthmover.io/blog/cloud-native-platforms-are-the-natural-evolution-of-atmosphere-ocean-open-data-practice/Open-data practice in ocean/atmosphere sciences is approximately 170 years old! While it is easy to exclaim, "weather/climate are global, of course we must share data", the actual story is anything but. That story holds valuable inspiration that we can draw from as we face a significant reduction in US climate science research.Mon, 09 Jun 2025 00:00:00 GMTBlog PostDeepak Cherianhttps://earthmover.io/blog/xarray-for-biology/https://earthmover.io/blog/xarray-for-biology/Xarray's labeled, multidimensional data structures can solve common pain points in biological data analysis, from tracking microscopy metadata to managing complex genomic datasets. Adoption has been limited by awareness, technical rough edges, and lack of tool integration, but the community is actively working to change that.Fri, 06 Jun 2025 00:00:00 GMTBlog PostIan Hunt-Isaakhttps://earthmover.io/blog/everything-you-need-to-know-about-icechunk-garbage-collection/https://earthmover.io/blog/everything-you-need-to-know-about-icechunk-garbage-collection/A practical guide to Icechunk's garbage collection and expiration operations, explaining when and how to safely reclaim storage from unused snapshots and dangling objects.Fri, 30 May 2025 00:00:00 GMTBlog PostSebastian Galkinhttps://earthmover.io/blog/what-is-zarr/https://earthmover.io/blog/what-is-zarr/Zarr is an open-source, cloud-native protocol for storing chunked, compressed N-dimensional arrays. This guide covers how Zarr works, its ecosystem of tools like Xarray and Icechunk, and when to use it for large-scale scientific and ML data.Tue, 20 May 2025 00:00:00 GMTBlog PostLindsey Nieldhttps://earthmover.io/blog/icechunk-efficient-storage-of-versioned-array-data/https://earthmover.io/blog/icechunk-efficient-storage-of-versioned-array-data/Icechunk stores versioned array data efficiently by never copying or rewriting existing chunks, so each new version only consumes storage for the data that actually changed. Older versions can be expired and garbage-collected when they are no longer needed.Wed, 14 May 2025 00:00:00 GMTBlog PostSebastian Galkinhttps://earthmover.io/blog/tensorops-scientific-data-doesnt-have-to-hurt/https://earthmover.io/blog/tensorops-scientific-data-doesnt-have-to-hurt/Scientific data pipelines are plagued by data swamps, duplicated code, fragile workflows, and siloed teams. TensorOps is a vision for modern practices that bring collaboration, velocity, and reliability to scientific data engineering.Thu, 08 May 2025 00:00:00 GMTBlog PostBrian Davishttps://earthmover.io/blog/zarr-takes-cloud-native-geospatial-by-storm/https://earthmover.io/blog/zarr-takes-cloud-native-geospatial-by-storm/At the 2025 Cloud-Native Geospatial conference, Zarr adoption was surging across the geospatial domain, with Copernicus Sentinel, USGS Landsat, Google Earth Engine, and ESRI ArcGIS all embracing the format for cloud-optimized array data.Tue, 06 May 2025 00:00:00 GMTBlog PostJoe Hammanhttps://earthmover.io/blog/meet-the-earthmover-team-at-the-cloud-native-geospatial-conference-2025/https://earthmover.io/blog/meet-the-earthmover-team-at-the-cloud-native-geospatial-conference-2025/The Earthmover team is attending the Cloud Native Geospatial Conference 2025 in Snowbird, Utah, leading a hands-on Zarr, Icechunk, and Xarray workshop and presenting talks on cloud-native datacube workflows.Mon, 28 Apr 2025 00:00:00 GMTEventJoe Hammanhttps://earthmover.io/blog/learning-about-icechunk-consistency/https://earthmover.io/blog/learning-about-icechunk-consistency/A practical walkthrough of how Icechunk uses transactions and conflict detection to guarantee data consistency when multiple processes write concurrently. The post demonstrates optimistic concurrency control and the rebase workflow using a bank-account transfer example.Wed, 23 Apr 2025 00:00:00 GMTBlog PostSebastian Galkinhttps://earthmover.io/blog/fundamentals-what-is-cloud-optimized-scientific-data/https://earthmover.io/blog/fundamentals-what-is-cloud-optimized-scientific-data/Why traditional scientific file formats like NetCDF perform poorly on cloud object storage, and how cloud-optimized formats like Zarr and Icechunk solve the problem by separating metadata and chunking data.Thu, 17 Apr 2025 00:00:00 GMTBlog PostTom Nicholashttps://earthmover.io/blog/announcing-flux/https://earthmover.io/blog/announcing-flux/Earthmover introduces Flux, a managed API layer that serves geospatial data from Arraylake via standard protocols like WMS, EDR, and OPeNDAP, eliminating the need for teams to build and maintain custom data delivery infrastructure.Tue, 15 Apr 2025 00:00:00 GMTAnnouncementRyan Abernatheyhttps://earthmover.io/blog/exploring-icechunk-scalability/https://earthmover.io/blog/exploring-icechunk-scalability/Demystifying how S3 prefix sharding actually works and demonstrating that Icechunk can scale to hundreds of thousands of requests per second, far beyond the single-prefix limit.Thu, 10 Apr 2025 00:00:00 GMTBlog PostSebastian Galkinhttps://earthmover.io/blog/tensors-vs-tables/https://earthmover.io/blog/tensors-vs-tables/Multidimensional array data about the physical world is fundamentally incompatible with the tabular data model. Benchmarks show that array-native tools like Xarray and Zarr outperform DuckDB and Parquet by up to 10x for common weather data queries.Thu, 03 Apr 2025 00:00:00 GMTBlog PostRyan Abernatheyhttps://earthmover.io/blog/nasa-icechunk/https://earthmover.io/blog/nasa-icechunk/Earthmover and Development Seed partnered with NASA to pilot Icechunk, an open-source tensor storage engine that enables 100x faster cloud-native data access for archival Earth science datasets without costly data migration.Thu, 27 Mar 2025 00:00:00 GMTBlog PostCase StudyRyan Abernatheyhttps://earthmover.io/blog/noaa-data/https://earthmover.io/blog/noaa-data/Earthmover customers share how NOAA climate and weather data powers their businesses, from wildfire risk modeling and energy trading to carbon market ratings and precipitation enhancement.Mon, 17 Mar 2025 00:00:00 GMTBlog PostRyan Abernatheyhttps://earthmover.io/blog/xarray-open-zarr-improvements/https://earthmover.io/blog/xarray-open-zarr-improvements/zarr-python’s performance paradox Last month, we released Zarr-Python 3.0 - a ground-up rewrite of the library (read more about it in this post). Beyond the exciting new features in Zarr V3, we put a lot of work into addressing some long standing performance issues with Zarr-Python 2. With the improvements described in this blog post, we’ve achieved a 14x speedup in loading the ARCO ERA5 dataset! Zarr-Python 2 had a paradoxical performance quirk; although the library could generate massive petabyte-scale datasets, it struggled to perform well when managing large or highly nested hierarchies. For example, listing the contents of a large Zarr group could be painfully slow, particularly if that Zarr group was stored on a high latency storage backend. Zarr users would experience this as longThu, 20 Feb 2025 00:00:00 GMTBlog PostDavis Bennethttps://earthmover.io/blog/zarr3-release/https://earthmover.io/blog/zarr3-release/Zarr-Python 3.0 is released with full support for the Zarr V3 specification, chunk-sharding for more flexible storage, major performance improvements from a fully asynchronous core, and a modernized extensible codebase.Thu, 09 Jan 2025 00:00:00 GMTAnnouncementJoe Hammanhttps://earthmover.io/blog/icechunk/https://earthmover.io/blog/icechunk/Earthmover announces Icechunk, an open-source transactional storage engine for Zarr that brings ACID transactions, time travel, data versioning, and high-performance Rust-based I/O to multidimensional array data in cloud object storage.Tue, 15 Oct 2024 00:00:00 GMTAnnouncementRyan Abernatheyhttps://earthmover.io/blog/vector-datacube-pt1/https://earthmover.io/blog/vector-datacube-pt1/Vector data cubes extend the familiar raster data cube concept to geospatial vector data, using arrays indexed by geometries instead of gridded coordinates. The Xvec package brings this capability to Xarray, enabling powerful multidimensional analysis of point, line, and polygon data.Mon, 29 Jul 2024 00:00:00 GMTBlog PostEmma Marshallhttps://earthmover.io/blog/case-study-alive/https://earthmover.io/blog/case-study-alive/The ALIVE research team at UW-Madison uses Arraylake to manage GOES-R satellite data for near real-time carbon and water flux estimation, benefiting from version control, ACID transactions, and seamless remote collaboration.Mon, 01 Jul 2024 00:00:00 GMTCase StudyRyan Abernatheyhttps://earthmover.io/blog/serverless-datacube-pipeline/https://earthmover.io/blog/serverless-datacube-pipeline/A practical guide to building planetary-scale Earth observation datacubes in Zarr using serverless computing, comparing frameworks like Coiled, Modal, and Lithops for massively parallel satellite image processing.Wed, 05 Jun 2024 00:00:00 GMTBlog PostRyan Abernatheyhttps://earthmover.io/blog/zarr-python-v3-update/https://earthmover.io/blog/zarr-python-v3-update/The Zarr-Python project is undergoing a major refactor toward version 3.0, bringing full support for the Zarr V3 specification, new asynchronous APIs for better performance, and a modernized plugin system for codecs and storage backends.Thu, 09 May 2024 00:00:00 GMTBlog PostJoe Hammanhttps://earthmover.io/blog/case-study-sylvera/https://earthmover.io/blog/case-study-sylvera/Carbon market ratings company Sylvera adopted Arraylake to centralize millions of scattered geotiff files into cloud-optimized arrays, enabling incremental data ingestion and version-tracked auditing across their geospatial pipelines.Fri, 12 Apr 2024 00:00:00 GMTCase StudyRyan Abernatheyhttps://earthmover.io/blog/cloud-native-dataloader/https://earthmover.io/blog/cloud-native-dataloader/A practical guide to building a high-performance PyTorch dataloader that streams Zarr data directly from cloud storage using Xarray, Xbatcher, and Dask, achieving a 15x speedup over naive approaches.Thu, 14 Mar 2024 00:00:00 GMTBlog PostJoe Hammanhttps://earthmover.io/blog/agu-2023/https://earthmover.io/blog/agu-2023/Earthmover will be at AGU 2023 in booth 1007 alongside Coiled and Pangeo, demoing Arraylake and presenting three talks on cloud-native scientific data workflows.Tue, 05 Dec 2023 00:00:00 GMTEventRyan Abernatheyhttps://earthmover.io/blog/arraylake-beta-launch/https://earthmover.io/blog/arraylake-beta-launch/Earthmover launches Arraylake in private beta, a cloud-native data lake platform purpose-built for multidimensional arrays with a built-in data catalog, ACID transactions, version control, and virtual file support.Wed, 04 Oct 2023 00:00:00 GMTAnnouncementRyan Abernatheyhttps://earthmover.io/blog/earthmover-is-hiring/https://earthmover.io/blog/earthmover-is-hiring/Earthmover is hiring two founding engineers to help build a modern data stack for science, tackling climate and planetary challenges with cloud-native software.Mon, 10 Oct 2022 00:00:00 GMTAnnouncementJoe Hammanhttps://earthmover.io/blog/why-we-started-earthmover/https://earthmover.io/blog/why-we-started-earthmover/Earthmover was founded to build a modern cloud data stack for scientific data, inspired by the success of the Pangeo open-source community and the urgent need for better tooling around multidimensional array datasets in climate tech and beyond.Mon, 10 Oct 2022 00:00:00 GMTBlog PostRyan Abernathey