Multiple Myeloma DREAM Challenge Reveals Epigenetic Regulator PHF19 As Marker of Aggressive Disease

Mike J. Mason, Carolina Schinke, Christine Eng, Fadi Towfic, Fred K. Gruber, Andrew Dervan, Brian S. White, Aditya Pratapa, Yuanfang Guan, Hongjie Chen, Yi Cui, Bailiang Li, Thomas Yu, Elias Chaibub Neto, Konstantinos Mavrommatis, María Ortiz, Valeriy V. Lyzogubov, Kamlesh Bisht, Hongyue Dai, Frank Schmitz, Erin Flynt, Dan Rozelle, Samuel A. Danziger, Alexander V. Ratushny, William S. Dalton, Hartmut Goldschmidt, Hervé Avet‐Loiseau, Mehmet Samur, Boris Hayete, Pieter Sonneveld, Kenneth H. Shain, Nikhil Munshi, Daniel Auclair, Dirk Hose, Gareth J. Morgan, Matthew Trotter, Douglas E. Bassett, Jonathan Göke, Brian A. Walker, Anjan Thakurta, Justin GuinneybioRxiv 2019 · DOI

TL;DR

This paper describes the Multiple Myeloma DREAM Challenge, a crowdsourced effort to identify robust predictors of aggressive multiple myeloma. The challenge revealed PHF19, an epigenetic regulator, as a novel and powerful biomarker for predicting rapid disease progression, outperforming existing models and leading to a simple, yet effective, four-feature predictive model.

What Problem Does This Paper Address?

Multiple myeloma (MM) is a blood cancer where a significant subset of patients (15-20%) experience aggressive disease progression and poor outcomes despite advances in treatment. Accurately identifying these high-risk patients early is crucial for tailoring treatment and developing new therapies. While gene expression-based models have shown promise, they often use diverse gene sets, making them complex and difficult to implement clinically. This paper addresses the need for more robust, parsimonious, and clinically translatable prognostic models for newly diagnosed MM patients.

Methods

The core of this research was the Multiple Myeloma DREAM Challenge, a crowdsourced initiative. This involved:

  • Benchmarking: Participants developed predictive models using a combination of clinical features (age, sex, ISS) and gene expression data.
  • Data Integration: Eight diverse datasets were assembled, including both publicly available and sequestered "hidden" validation sets, totaling 2447 unique patient samples.
  • Model Evaluation: Submitted models were evaluated using weighted-integrated area under the curve (wiAUC) and weighted balanced accuracy (wBAC) to account for different time thresholds and cohort sizes.
  • Post-Challenge Analysis: The organizers performed further analysis on top-performing models, including feature importance assessment and experimental validation of key findings.
  • In vitro studies: To assess the functional role of the identified biomarker, PHF19, researchers used lentiviral-expressed shRNA to knockdown its expression in MM cell lines and observed the effects on proliferation, cell cycle, and apoptosis.

Datasets

The challenge utilized a combination of publicly available and private datasets for training and validation:

Training Datasets: * Masaryk University (N=147) * MAQC-II (N=559) * MMRF IA9 (N=636) * HOVON65/GMMG-HD4 (N=282)

Validation Datasets: * MRC-IX (N=241) * Heidelberg (N=215) * Moffitt (N=74) * DFCI (N=293)

These datasets included microarray and RNA-seq expression data, along with clinical annotations such as age, ISS, and cytogenetics. The challenge aimed to benchmark models against existing published predictors.

Key Insights and Ideas

  • Crowdsourcing for Robustness: The DREAM Challenge format, leveraging a large community of participants, proved effective in generating more robust and accurate predictive models than individual efforts might achieve.
  • Clinical Features Matter: Integrating basic clinical data like age and ISS significantly improved the performance of gene expression-based models, highlighting their continued importance.
  • PHF19 as a Novel Biomarker: The unexpected identification of PHF19, an epigenetic regulator, as the most strongly associated gene with rapid MM progression was a major breakthrough. Its predictive power surpassed that of previously known high-risk genes like MMSET.
  • Parsimony is Powerful: A simple four-feature model (age, ISS, PHF19, and MMSET expression) achieved performance comparable to much more complex models, suggesting a path towards easier clinical adoption.
  • Functional Role of PHF19: Experimental validation confirmed that PHF19 plays a functional role in MM cell proliferation, with its knockdown leading to cell cycle arrest, supporting its biological relevance.

Key Results

  • Top Model Performance: The top-performing model from the challenge (developed by the Genome Institute of Singapore) achieved a weighted-integrated AUC (wiAUC) of 0.6721, outperforming published comparator models.
  • Clinical Feature Impact: Adding age and ISS to existing models improved AUC metrics by approximately 6%.
  • PHF19's Predictive Power: PHF19 was identified as the top-ranked gene predictor, showing a stronger association with MM progression than MMSET.
  • Four-Feature Model Efficacy: A four-feature model (age, ISS, PHF19, MMSET) achieved a wiAUC of 0.693, outperforming the extended UAMS-70 model (wiAUC=0.667) and rivaling the winning algorithm.
  • In vitro validation: Knockdown of PHF19 in MM cell lines led to a significant inhibition of proliferation and cell cycle arrest.

Limitations and Future Work

  • Dataset Heterogeneity: While efforts were made to harmonize data, the use of multiple datasets with varying platforms and patient cohorts can introduce variability.
  • Clinical Utility of PHF19: While PHF19 shows strong prognostic value, its direct association with specific cytogenetic features is not apparent, which might have contributed to it being missed in earlier studies. Further work is needed to elucidate the mechanisms of PHF19 in MM biology and its interplay with MMSET.
  • Translational Gap: The paper highlights the potential for a simple, four-feature model to be adopted clinically, but further validation and prospective studies would be necessary to confirm its real-world utility.
  • Mechanistic Understanding: While PHF19's functional role in proliferation is shown, a deeper understanding of its precise epigenetic mechanisms in MM pathogenesis and aggressiveness is a key area for future research.

Summary updated

Abstract

Abstract While the past decade has seen meaningful improvements in clinical outcomes for multiple myeloma patients, a subset of patients do not benefit from current therapeutics for unclear reasons. Many gene expression-based models of risk have been developed, but each model uses a different combination of genes and often involve assaying many genes making them difficult to implement. We organized the Multiple Myeloma DREAM Challenge, a crowdsourced effort to develop models of rapid progression in newly diagnosed myeloma patients and to benchmark these against previously published models. This effort lead to more robust predictors and found that incorporating specific demographic and clinical features improved gene expression-based models of high risk. Furthermore, post challenge analysis identified a novel expression-based risk marker and histone modifier, PHF19 , which featured prominently in several independent models. Lastly, we show that a simple four feature predictor composed of age, International Staging System stage (ISS), and expression of PHF19 and MMSET performs similarly to more complex models with many more gene expression features included. Key points Most comprehensive and unbiased assessment of prognostic biomarkers in MM resulting in a robust and parsimonious model. Identification of PHF19 as the expression based biomarker most strongly associated with rapid progression in MM patients.
BibTeX
@misc{mason2019multiple,
  author = {Mike J. Mason and Carolina Schinke and Christine Eng and Fadi Towfic and Fred K. Gruber and Andrew Dervan and Brian S. White and Aditya Pratapa and Yuanfang Guan and Hongjie Chen and Yi Cui and Bailiang Li and Thomas Yu and Elias Chaibub Neto and Konstantinos Mavrommatis and María Ortiz and Valeriy V. Lyzogubov and Kamlesh Bisht and Hongyue Dai and Frank Schmitz and Erin Flynt and Dan Rozelle and Samuel A. Danziger and Alexander V. Ratushny and William S. Dalton and Hartmut Goldschmidt and Hervé Avet‐Loiseau and Mehmet Samur and Boris Hayete and Pieter Sonneveld and Kenneth H. Shain and Nikhil Munshi and Daniel Auclair and Dirk Hose and Gareth J. Morgan and Matthew Trotter and Douglas E. Bassett and Jonathan Göke and Brian A. Walker and Anjan Thakurta and Justin Guinney},
  title = {{Multiple Myeloma DREAM Challenge Reveals Epigenetic Regulator <i>PHF19</i> As Marker of Aggressive Disease}},
  year = {2019},
  doi = {10.1101/737122},
  howpublished = {bioRxiv},
}
Figure