crossNN: an explainable framework for cross-platform DNA methylation-based classification of cancer

Dongsheng Yuan, Robin Jugas, Petra Pokorná, Jaroslav Štěrba, Ondřej Slabý, Simone Schmid, Christin Siewert, Brendan Osberg, David Capper, Pia S. Zeiner, Katharina J. Weber, Patrick N. Harter, Nabil Jabareen, Sebastian D. Mackowiak, Naveed Ishaque, Roland Eils, Soeren Lukassen, Philipp EuskirchenmedRxiv 2024 · DOI

TL;DR

Researchers have developed crossNN, a shallow neural network that classifies brain tumors using DNA methylation data regardless of the technology used to sequence them. By training the model to handle massive amounts of missing data, it achieves high precision across microarrays and various sequencing platforms, offering a fast, explainable, and "platform-agnostic" diagnostic tool.

What Problem Does This Paper Address?

DNA methylation—the addition of methyl groups to DNA—acts as a molecular "signature" that is incredibly effective at identifying specific types of brain tumors. Currently, the gold standard for this is the "Heidelberg classifier," which uses Random Forest models.

However, there is a catch: these models are usually tied to a fixed set of features (specific genomic locations) provided by chemical microarrays (like the Illumina 450K or EPIC chips). As the field moves toward DNA sequencing (like nanopore or whole-genome bisulfite sequencing), the data becomes "sparse." Sequencing might only capture a random subset of the genome, leaving huge gaps that traditional classifiers can't handle. Previous workarounds required training a custom "ad-hoc" model for every single new patient sample—a process that is computationally expensive, slow, and makes it hard to compare results between patients.

Methods

The authors propose crossNN, a framework built on a surprisingly simple architecture: a perceptron (a single-layer neural network).

Key technical highlights include:

  • Feature Encoding: Instead of using continuous "beta values" (0 to 1), they binarize the data. Methylated sites are encoded as 1, unmethylated as -1, and—crucially—missing or uncovered sites are encoded as 0.
  • Training for Sparsity: To make the model robust to sequencing data where most sites are missing, they used a "random masking" strategy during training. They intentionally hid 97.5% of the data during training iterations, forcing the network to learn how to classify tumors based on very limited information.
  • Explainability: Because the model is a simple linear network without hidden layers or complex biases, the "weights" assigned to each genomic site are directly interpretable. A high positive weight means methylation at that site strongly suggests a specific tumor type.

Datasets

The model was trained and validated using an extensive collection of samples:

  • Training Set: The Heidelberg brain tumor reference set (v11b4), containing 2,801 samples across 82 tumor types and 9 control classes.
  • Validation Cohort: A massive independent set of 1,923 patient samples collected from diverse platforms, including:
  • Standard microarrays (450K, EPIC, and the new EPICv2).
  • Low-pass Nanopore sequencing (WGS).
  • Targeted bisulfite sequencing.
  • Whole-genome bisulfite sequencing (WGBS).

Key Insights and Ideas

  • Simplicity is a Feature, Not a Bug: While deep learning often favors "deeper" networks, the authors found that a shallow, linear model was non-inferior to complex deep-neural networks (like Sturgeon) and superior in precision. The simplicity prevents overfitting and keeps the model "explainable."
  • The Power of Zero: By encoding missing data as a neutral '0', the model treats "I don't know" differently than "this site is unmethylated." This allows the same model to work on a microarray (where we know almost everything) and nanopore sequencing (where we know very little).
  • Biological Discovery: Because the model is explainable, the authors could "look under the hood." They identified that the PWWP3A gene is a key marker for HGNET-MN1 tumors, specifically noting that hypomethylation in the gene body—rather than the promoter—was the deciding factor.

Key Results

  • High Accuracy: The model achieved an overall accuracy of 96.11% in cross-validation.
  • Platform Robustness: Even when microarray data was sub-sampled to simulate extreme sparsity (down to 0.5% coverage), the model remained stable.
  • Superior Precision: In head-to-head comparisons with other state-of-the-art tools (ad-hoc RF and Sturgeon DNN), crossNN showed higher precision (>0.97 across all platforms) when using diagnostic cut-offs.
  • Speed: Unlike ad-hoc methods that take minutes or hours to train per sample, crossNN provides instantaneous predictions (within seconds), making it viable for time-sensitive environments like intraoperative diagnostics.

Limitations and Future Work

The authors acknowledge a few hurdles:

  • Binarization Bias: Using a single global threshold (0.6) to decide if a site is "methylated" might be too simplistic for certain tumor types that exhibit global hyper- or hypo-methylation.
  • Rare Tumors: While the validation set was large, some extremely rare brain tumor types were under-represented, meaning the model's performance on those specific entities still needs more data.
  • Purity Issues: The model's performance in samples with low tumor purity (high amounts of healthy "background" cells) remains an area for systematic investigation.

The team has made the framework open-source and provided a web-based interface at crossnn.dkfz.de to encourage clinical adoption.

Summary updated

Abstract

Abstract DNA methylation-based classification of brain tumors has emerged as a powerful and indispensable diagnostic technique. Initial implementations have used methylation microarrays for data generation, but different sequencing approaches are increasingly used. Most current classifiers, however, rely on a fixed methylation feature space, rendering them incompatible with other platforms, especially different flavors of DNA sequencing. Here, we describe crossNN, a neural network-based machine learning framework which can accurately classify tumor entities using DNA methylation profiles obtained from different platforms and with different epigenome coverage and sequencing depth. It outperforms other deep- and shallow machine learning models with respect to precision as well as simplicity and computational requirements while still being fully explainable. Validation in a large cohort of >1,900 tumors profiled using different microarray and sequencing platforms, including low-pass nanopore and targeted bisulfite sequencing, demonstrates the robustness and scalability of the model.
BibTeX
@misc{yuan2024crossnn,
  author = {Dongsheng Yuan and Robin Jugas and Petra Pokorná and Jaroslav Štěrba and Ondřej Slabý and Simone Schmid and Christin Siewert and Brendan Osberg and David Capper and Pia S. Zeiner and Katharina J. Weber and Patrick N. Harter and Nabil Jabareen and Sebastian D. Mackowiak and Naveed Ishaque and Roland Eils and Soeren Lukassen and Philipp Euskirchen},
  title = {{crossNN: an explainable framework for cross-platform DNA methylation-based classification of cancer}},
  year = {2024},
  doi = {10.1101/2024.01.22.24301523},
  howpublished = {medRxiv},
}
Figure