Genomics Data Lossless Compression with (S, K)-Mer Encoding and Deep Neural Networks

Hui Sun, Liping Yi, Huidong Ma, Yongxia Sun, Yingfeng Zheng, Wenwen Cui, Meng Yan, Gang Wang, Xiaoguang Liu

TL;DR

This paper introduces DeepGeCo, a novel deep learning-based framework for lossless compression of genomics data. It addresses the challenges of model cold-start, low throughput, and the trade-off between compression ratio and speed by introducing an (s, k)-mer encoding pre-processing step, a warm-start model, and a threshold controller. DeepGeCo achieves significant improvements in both compression ratio and throughput compared to existing methods.

What Problem Does This Paper Address?

The rapid growth of genomics data, driven by advancements in sequencing technologies, presents a significant challenge for storage, transmission, and sharing. While lossless compression is crucial for maintaining data integrity in genomics, existing methods, particularly those based on deep learning, face several limitations:

  • Model Cold-Start Problem: Adaptive compression models, which update their parameters during compression, often suffer from poor performance in the initial stages due to randomly initialized parameters. This leads to suboptimal compression ratios for early data segments.
  • Low Compression Throughput: Many deep learning-based compressors, while achieving good compression ratios, are significantly slower than traditional methods, making them impractical for real-time applications or large-scale datasets.
  • Trade-off Between Compression Ratio and Throughput: Achieving both a high compression ratio and high throughput simultaneously is difficult. Applications like long-term data backup require low compression ratios and high throughput, while also needing to be memory-efficient.

Methods

DeepGeCo tackles these challenges with a multi-faceted approach, introducing a framework with three distinct modes (MINI, PLUS, ULTRA) to cater to different needs. The core innovations include:

  • (s, k)-mer Encoding: This pre-processing step encodes genomics strings by sliding a window of size k with a stride s. This reduces the input data size for the deep learning models, significantly improving compression throughput and reducing model training/inference time. The authors also propose a novel metric, RTCR (Ranking of Throughput and Compression Ratio), to select optimal (s, k) parameters.
  • Warm-Start and Supporter Models: To address the cold-start problem, DeepGeCo employs a two-model strategy. A Warm-Start Model (using BiGRU) is pre-trained on similar genomics data and frozen during compression. This model provides strong initial predictions. A Supporter Model (using Transformer) is trained adaptively and takes over after the initial batches. This combination ensures good performance from the start and efficient adaptation.
  • Threshold Controller and Probability Mixer: These components dynamically balance the contributions of the Warm-Start and Supporter models. The threshold controller determines how much data is fed to the Warm-Start model, while the probability mixer integrates their outputs to produce a final probabilistic prediction. This mechanism allows for fine-tuning the trade-off between compression ratio and throughput.
  • Three Compression Modes:
    • MINI: Uses only the static Warm-Start model for high throughput and low memory usage, suitable for resource-constrained environments, but with a lower compression ratio.
  • PLUS: The default mode, dynamically training the Supporter model with a frozen Warm-Start model. It offers a good balance of compression ratio, throughput, and memory usage.
  • ULTRA: Fine-tunes the Warm-Start model on the input data before freezing it. This mode achieves the highest compression ratio but at the cost of lower throughput and higher memory usage, suitable for archival purposes.

Datasets

The paper evaluates DeepGeCo on 10 real-world genomics datasets. The specific datasets are not explicitly listed in a single consolidated benchmark, but examples mentioned include PlFa, WaMe, DrMe, OrSa, GaGa, SnSt, MoGu, AtAl, ArTh, and HuMa. The authors also refer to the "DNA corpus" for experiments related to (s, k)-mer encoder selection.

Key Insights and Ideas

  • Pre-processing is Key: The (s, k)-mer encoding is a crucial innovation, demonstrating that intelligent pre-processing can significantly boost the efficiency of deep learning compressors without substantial computational overhead.
  • Warm-Start Solves Cold-Start: The combination of a pre-trained static model with an adaptive model effectively mitigates the cold-start problem, ensuring consistent performance from the very beginning of compression.
  • Dynamic Balancing is Essential: The threshold controller and probability mixer are vital for achieving the desired trade-off between compression ratio and throughput, allowing DeepGeCo to be adaptable to various scenarios.
  • Mode Specialization: Offering distinct modes (MINI, PLUS, ULTRA) acknowledges that different applications have different priorities, allowing users to select the best configuration for their specific needs.

Key Results

DeepGeCo demonstrates significant improvements over baseline methods:

  • Compression Ratio: Achieves up to a 31.095% average improvement in compression ratio compared to baselines. The ULTRA mode, in particular, shows the highest compression ratios.
  • Throughput: Achieves up to a 22.949x average improvement in throughput compared to baselines. The PLUS mode offers a substantial speedup.
  • Memory Usage: DeepGeCo modes exhibit low CPU and GPU memory usage, making them efficient for practical deployment.
  • Optimal (s, k) Selection: The (3, 3)-mer encoding was found to provide the best balance between compression ratio and throughput, as indicated by the RTCR metric.

Limitations and Future Work

  • Threshold Parameter ts: The performance of DeepGeCo (PLUS) is dependent on the ts parameter, which regulates the warm-up data size. While ts=10 is set as default, increasing ts improves compression ratio but decreases throughput, indicating a trade-off that needs careful consideration.
  • Batch Size Impact: The paper notes that increasing batch size generally improves metrics for PLUS and ULTRA modes, but the effect on MINI is more complex, with reduced throughput despite potential gains in compression ratio.
  • Future Work: The authors suggest that the model structures can be re-customized for specific requirements to achieve better performance balance. The paper also implies that further exploration of semi-adaptive methods could lead to even better results.

Summary updated

Abstract

Learning-based compression shows competitive compression ratios for genomics data. It often includes three types of compressors: static, adaptive and semi-adaptive. However, these existing compressors suffer from inferior compression ratios or throughput, and adaptive compressors also faces model cold-start problems. To address these issues, we propose DeepGeCo, a novel genomics data lossless adaptive compression framework with (s,k)-mer encoding and deep neural networks, involving three compression modes (MINI for static, PLUS for adaptive, ULTRA for semi-adaptive) for flexible requirements of compression ratios or throughput. In DeepGeCo, (1) we develop BiGRU and Transformer as the backbone to build Warm-Start and Supporter models in terms of cold-start problems. (2) We introduce (s,k)-mer encoding to pre-process genomics data before feeding it into the DNN model for improve model throughput, and we propose a new metric - Ranking of Throughput and Compression Ratio (RTCR) for effective encoding parameters selection. (3) We design a threshold controller and a probabilistic mixer within the backbone to balance compression ratios and model throughput. Experiments on 10 real-world datasets show that DeepGeCo's three compression modes improve up to a 22.949X average throughput and up to a 31.095% average compression ratio improvement while occupying low CPU or GPU memory.
BibTeX
@inproceedings{sun2025genomics,
  author = {Hui Sun and Liping Yi and Huidong Ma and Yongxia Sun and Yingfeng Zheng and Wenwen Cui and Meng Yan and Gang Wang and Xiaoguang Liu},
  title = {{Genomics Data Lossless Compression with (S, K)-Mer Encoding and Deep Neural Networks}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2025},
  doi = {10.1609/aaai.v39i12.33371},
}
Figure