Your data layer matters more than ever
Agents can build the app. Turning raw files into a dataset still takes a human, so share the dataset, and do it without copying the data.
Ian Hunt-Isaak
Xarray Community Developer
blog · tag
#zero-copy-ingest
2 posts
Fundamentals: What is zero-copy ingest?
You want to use Zarr, but your data is in HDF5, TIFF, or ND2. Zero-copy ingest lets you read it as Zarr without converting it.
Ian Hunt-Isaak
Xarray Community Developer
Related Posts
Blog Tags
access controls access-control agents ai AI weather AIFS announcement architecture arraylake Arraylake aurora Big Data biology blog post blog-post case study case-study chat cirrus climate risk cloud cloud native compliance compute conference data archives data cube data infrastructure data workflows dev note dynamical earth observation earth-2 earth-observation energy engineering enterprise era5 event FAIR feature release financial-services flux forecast fundamentals garbage collection geospatial GOES-R governance grib guest-post hrrr hugging-face hypothesis iceberg icechunk Icechunk IFS LangChain LangGraph marketplace mcp NASA natural language processing NCEI netCDF NetCDF noaa NOAA nowcasting nvidia nws oceanography open data open science open source performance product property-testing public-sector python Python Radar rust Rust scverse security serverless shuttle single-cell soc2 sql tables tabular data teams technical tensorops tensors testing third-wheel toxiproxy trust vector data virtual-zarr virtualizarr virtualization weather wildfire WOD xarray Xarray zarr Zarr zax zero-copy-ingest