Quality of patient‐reported outcomes in oncology clinical trials using immune checkpoint inhibitors: A systematic review

Eoghan Ruadh Malone, Reeta Barua, Nicholas Meti, Xuan Li, Rouhi Fazelzad, Aaron R. HansenCancer 2021 · DOI

TL;DR

This systematic review assessed the quality of reporting for patient-reported outcomes (PROs) in clinical trials of immune checkpoint inhibitors (ICIs). While overall reporting quality is good, there's significant heterogeneity, particularly concerning the integration of PROs into trial design and the clarity of hypotheses. This highlights a need for standardized approaches to ensure PRO data effectively informs patient care and clinical decision-making.

What Problem Does This Paper Address?

Immune checkpoint inhibitors (ICIs) have revolutionized cancer treatment, but their effectiveness and side effects can be complex. Patient-reported outcomes (PROs), which capture a patient's direct experience of their health, quality of life, and functional status, are crucial for understanding the full impact of these therapies. However, the way PRO data is collected, analyzed, and reported in clinical trials can be inconsistent, making it difficult to compare results across studies or to fully leverage this valuable information. This paper addresses the gap in understanding the quality of PRO reporting specifically within ICI clinical trials, aiming to identify factors that influence this quality and to highlight areas for improvement.

Methods

The researchers conducted a systematic literature search across multiple databases to identify prospective clinical trials involving ICIs in advanced tumors between 2003 and 2020. They adapted a 30-point scoring system, based on the CONSORT PRO extension statement, to evaluate the adherence of these trials to established reporting guidelines for PROs. This scoring system assessed various domains of reporting, including the identification of PROs in trial titles and abstracts, the clarity of PRO hypotheses, the methods used for data collection and analysis, and the reporting of results and limitations. Linear regression was used to identify factors associated with higher reporting quality scores.

Datasets

The study did not use a specific dataset for training or evaluation in the traditional machine learning sense. Instead, the "dataset" comprised 33 published clinical trials that met the inclusion criteria. These trials were identified through a systematic literature search.

Key Insights and Ideas

  • PROs are often an afterthought: While PROs are collected, they are frequently reported in separate publications from the primary trial results, suggesting they might not be considered a core outcome from the outset.
  • Quality is good, but not perfect: The overall quality of PRO reporting in ICI trials is generally good, but there's room for improvement, especially in clearly stating PRO-specific hypotheses and integrating PROs as primary or secondary endpoints.
  • Larger trials, better reporting: Trials with a larger number of participants tend to have higher quality PRO reporting. This could be due to increased resources or a greater focus on comprehensive data collection in larger studies.
  • Cancer type matters: The quality of PRO reporting varies by cancer type, with some sites showing better adherence to guidelines than others.
  • Trial series differences: There were observed differences in reporting quality between different ICI trial series (e.g., KEYNOTE vs. CHECKMATE), suggesting potential variations in internal publication standards.

Key Results

  • Out of 8058 reviewed articles, 33 trials met the inclusion criteria.
  • The median PRO reporting score was 23.5 out of 30 points.
  • 82% of trials reported PROs in a separate publication from the original study.
  • Trials with more than 250 patients had significantly higher PRO reporting scores.
  • Reporting quality was generally lower in disease sites other than melanoma, lung, and renal cell carcinoma (RCC).
  • KEYNOTE trial series showed higher scores compared to CHECKMATE.
  • There was no significant correlation between PRO reporting quality and whether a trial met its primary endpoint or reported changes in quality of life.

Limitations and Future Work

The authors acknowledge that the relatively small number of included trials might affect the reliability of the estimated coefficients and p-values in their analyses. They also note that their scoring system measures the adequacy of reporting rather than the actual quality of the PRO data itself. Future work should focus on designing ICI clinical trials with PROs or HRQOL as primary or secondary endpoints, ensuring adequate power to detect meaningful changes. There's also a need for continued development of standardized methods for PRO assessment, analysis, and reporting to ensure this crucial data is effectively utilized in patient care and clinical decision-making.

Summary updated

Abstract

The quality of reporting of PROs in ICI phase II and III clinical trials is heterogeneous across various cancer sites. As PRO data are increasingly used to counsel patients and complement clinical decision making, innovative and collaborative efforts are required to improve the reporting of these essential data.
BibTeX
@inproceedings{malone2021quality,
  author = {Eoghan Ruadh Malone and Reeta Barua and Nicholas Meti and Xuan Li and Rouhi Fazelzad and Aaron R. Hansen},
  title = {{Quality of patient‐reported outcomes in oncology clinical trials using immune checkpoint inhibitors: A systematic review}},
  booktitle = {Cancer},
  year = {2021},
  doi = {10.1002/cam4.4086},
}
Figure