Toward Value-Aware Metadata for Extreme-Event Retrieval in Cloud-Native Climate Data Services | AMiner
Toward Value-Aware Metadata for Extreme-Event Retrieval in Cloud-Native Climate Data Services
Jiaming Tan,Chengcheng Shao,Xiaoyong Li,Xiang Zhu,Kaijun Ren,Shukai Chen,Yazhen Wang
2026 IEEE International Conference on Web Services (ICWS)(2026)
College of Computer Science and Technology
被引用0|浏览0
摘要
Cloud-native climate services increasingly expose analysis-ready Zarr archives through web APIs and Python/Xarray workflows. These layouts accelerate coordinateto-value subsetting, yet they are less efficient for value-tocoordinate workloads, including threshold-based extreme-event discovery and regional top-$k$ retrieval. In such queries, geometryoverlapping chunks are often read and decompressed before value predicates can be evaluated, causing unnecessary data access. This paper presents an external value-aware metadata layer that preserves the original archive while enabling pruning before data access. The proposed sidecar maintains lightweight chunk synopses, coarse upper bounds, and hot metadata caches to transform geometry-only candidates into value-aware candidates. ERA5 experiments show up to $5 \times$ fewer chunk reads and up to $6.3 \times$ lower median latency than a geometry-only Zarr+Xarray pipeline, demonstrating a practical direction for low-latency extreme-event services without migrating data into a dedicated array database.
更多
查看译文
关键词
Climate data service,Zarr,value-aware metadata,extreme-event retrieval,sidecar index,top-$k$