Understanding Effectiveness of Multi-Error-Bounded Lossy Compression for Preserving Ranges of Interest in Scientific Analysis

Yuanjian Lin, Sheng Di, Kai Zhao, Sian Jin, Cheng Wang, Kyle Chard, Dingwen Tao, Ian T. Foster, Franck Cappello

Abstract

Lossy compression frameworks have been proposed as a method to reduce the size of data produced by scientific simulations. However, they do so at the expense of precision and existing compressors apply a single error bound across the entire dataset. Varying the precision across user-specified ranges of scalar values appears to be a promising approach to further improve compression ratios while retaining precision in specific areas of interest. In this work, we investigate a specific compression method, based on the SZ framework, that can set multiple error bounds. We evaluate its effectiveness by applying it to real-world datasets which have concrete precision requirements. Our results show that the multi-error-bounded lossy compression can improve compression ration by 15 % with negligible overhead in compression time.
BibTeX
@inproceedings{lin2021understanding,
  author = {Yuanjian Lin and Sheng Di and Kai Zhao and Sian Jin and Cheng Wang and Kyle Chard and Dingwen Tao and Ian T. Foster and Franck Cappello},
  title = {{Understanding Effectiveness of Multi-Error-Bounded Lossy Compression for Preserving Ranges of Interest in Scientific Analysis}},
  booktitle = {DRBSD@SC},
  year = {2021},
  doi = {10.1109/drbsd754563.2021.00010},
}

Loading related content...

Figure