Multicenter validation of cancer gene panel-based next-generation sequencing for translational research and molecular diagnostics

Burkhard Hirsch, Volker Endris, Silke Laßmann, Wilko Weichert, Nicole Pfarr, Peter Schirmacher, Valentina Kovaleva, Martin Werner, Irina Bonzheim, Falko Fend, Jan Sperveslage, Kerstin Kaulich, A. Zacher, Guido Reifenberger, Karl Köhrer, Stefanie Stepanow, S. Lerke, Thomas Mayr, Daniela E. Aust, Gustavo Baretton, Sven Weidner, Andreas Jung, Thomas Kirchner, Martin L. Hansmann, Lina Burbat, Edda von der Wall, Manfred Dietel, Michael HummelArchiv 2018 · DOI

TL;DR

This study validates the reliability of next-generation sequencing (NGS) for detecting cancer mutations across multiple centers and platforms. It demonstrates that targeted NGS is a robust method for molecular diagnostics, but highlights the critical importance of standardized DNA extraction protocols for consistent results.

What Problem Does This Paper Address?

The increasing use of targeted amplicon-based Next-Generation Sequencing (NGS) for cancer diagnostics and research necessitates understanding its reliability, especially in multicenter settings. While NGS offers comprehensive mutation detection, concerns exist regarding inter-laboratory variability, the impact of different NGS platforms, and the choice of gene panels. This paper addresses the critical need to assess the comparability and reproducibility of targeted NGS across multiple institutions, using various platforms and gene panels, to ensure accurate and consistent molecular diagnostics for cancer patients.

Methods

The study employed a multicenter interlaboratory trial involving seven partner sites from the German Cancer Consortium (DKTK). They used formalin-fixed, paraffin-embedded (FFPE) tumor specimens from 15 pre-characterized cancer cases (5 each of breast, lung, and colon carcinoma) and a colorectal cancer cell line DNA dilution series. Two main NGS platforms were used: Ion Torrent PGM™ and Illumina MiSeq™. Both commercially available and custom-designed cancer gene panels were utilized for library preparation and sequencing. The trial involved two main approaches:

  1. Site-specific analysis: Centrally extracted DNA and FFPE tissue sections were sent to each partner site for local library preparation, sequencing, and bioinformatics analysis using commercial gene panels.
  2. Cancer-specific panel-based sequencing: Centrally extracted DNA was analyzed at seven sequencing sites using custom-designed gene panels, with bioinformatics performed centrally. A sensitivity test was also conducted using serial dilutions of a colon cancer cell line DNA to assess variant detection at low frequencies.

Datasets

The study utilized:

  • 15 molecularly pre-characterized FFPE tumor samples: 5 each of Breast, Lung, and Colon carcinoma.
  • A colorectal cancer cell line (LoVo) DNA dilution series: Used for sensitivity and reproducibility testing.

No new benchmark datasets were introduced; the focus was on validating existing methods with real-world clinical samples.

Key Insights and Ideas

  • NGS is robust across platforms and panels: The study strongly confirms that targeted NGS is a reliable method for detecting pre-characterized mutations, regardless of the specific NGS platform (PGM™ or MiSeq™) or the gene panel used, provided certain conditions are met. This is crucial for widespread adoption in clinical settings.
  • DNA extraction is a critical bottleneck: The most significant source of variability in results stemmed from local processing, particularly the DNA extraction method. This highlights that while the sequencing technology itself is robust, the pre-analytical steps can profoundly impact data quality and mutation detection.
  • Magnetic bead-based extraction shows a trend: While not definitively conclusive, there was a tendency favoring magnetic bead-based DNA extraction methods for better mutation detection, suggesting this could be a preferred approach.
  • Centralized bioinformatics is beneficial: For cancer-specific panel-based sequencing, centralizing the bioinformatics analysis led to highly uniform results, underscoring the importance of standardized data processing pipelines.

Key Results

  • High concordance for pre-characterized mutations: All pre-characterized mutations were correctly re-identified across all sequencing sites, platforms, and gene panels when using centrally extracted DNA.
  • Impact of local processing: Locally processed FFPE tissue sections showed variability, with some mutations remaining undetectable in a few cases. This was attributed to differences in DNA extraction methods.
  • Sensitivity demonstrated: The sensitivity testing with the LoVo cell line dilutions showed that expected mutations were detected at various allelic frequencies, demonstrating the capability of the panels and platforms to identify low-frequency variants.
  • Additional variants detected: Beyond the pre-characterized mutations, commercial amplicon panel-based NGS consistently detected additional variants in genes like TP53, APC, ATM, PIK3CA, and JAK3, indicating the broad utility of these panels.

Limitations and Future Work

  • DNA extraction variability: The authors acknowledge that variations in DNA extraction methods are a major source of variability. They strongly recommend careful validation of DNA extraction procedures for both multicenter activities and local diagnostics.
  • Tendency, not definitive proof: The preference for magnetic bead-based DNA extraction is noted as a "trend," implying further studies might be needed to solidify this finding.
  • Pre-analytical conditions: The paper emphasizes that while NGS is robust, careful consideration of pre-analytical conditions, particularly DNA extraction, is essential for reliable diagnostic information.
  • Future work: The authors suggest that such interlaboratory trials should be established as a regular measure of external quality assessment to ensure ongoing comparability and reproducibility of diagnostic findings. They also imply that further standardization of DNA extraction protocols would be beneficial.

Summary updated

Abstract

The simultaneous detection of multiple somatic mutations in the context of molecular diagnostics of cancer is frequently performed by means of amplicon-based targeted next-generation sequencing (NGS). However, only few studies are available comparing multicenter testing of different NGS platforms and gene panels. Therefore, seven partner sites of the German Cancer Consortium (DKTK) performed a multicenter interlaboratory trial for targeted NGS using the same formalin-fixed, paraffin-embedded (FFPE) specimen of molecularly pre-characterized tumors (n = 15; each n = 5 cases of Breast, Lung, and Colon carcinoma) and a colorectal cancer cell line DNA dilution series. Detailed information regarding pre-characterized mutations was not disclosed to the partners. Commercially available and custom-designed cancer gene panels were used for library preparation and subsequent sequencing on several devices of two NGS different platforms. For every case, centrally extracted DNA and FFPE tissue sections for local processing were delivered to each partner site to be sequenced with the commercial gene panel and local bioinformatics. For cancer-specific panel-based sequencing, only centrally extracted DNA was analyzed at seven sequencing sites. Subsequently, local data were compiled and bioinformatics was performed centrally. We were able to demonstrate that all pre-characterized mutations were re-identified correctly, irrespective of NGS platform or gene panel used. However, locally processed FFPE tissue sections disclosed that the DNA extraction method can affect the detection of mutations with a trend in favor of magnetic bead-based DNA extraction methods. In conclusion, targeted NGS is a very robust method for simultaneous detection of various mutations in FFPE tissue specimens if certain pre-analytical conditions are carefully considered.
BibTeX
@inproceedings{hirsch2018multicenter,
  author = {Burkhard Hirsch and Volker Endris and Silke Laßmann and Wilko Weichert and Nicole Pfarr and Peter Schirmacher and Valentina Kovaleva and Martin Werner and Irina Bonzheim and Falko Fend and Jan Sperveslage and Kerstin Kaulich and A. Zacher and Guido Reifenberger and Karl Köhrer and Stefanie Stepanow and S. Lerke and Thomas Mayr and Daniela E. Aust and Gustavo Baretton and Sven Weidner and Andreas Jung and Thomas Kirchner and Martin L. Hansmann and Lina Burbat and Edda von der Wall and Manfred Dietel and Michael Hummel},
  title = {{Multicenter validation of cancer gene panel-based next-generation sequencing for translational research and molecular diagnostics}},
  booktitle = {Archiv},
  year = {2018},
  doi = {10.1007/s00428-017-2288-7},
}
Figure