TL;DR
This paper validates the Urgency Numeric Rating Scale (NRS) as a reliable and psychometrically sound tool for measuring bowel urgency in patients with ulcerative colitis (UC). The Urgency NRS is shown to be a sensitive indicator of treatment effectiveness, with a 3-point improvement signifying a meaningful change and a score of 1 or less indicating remission.
What Problem Does This Paper Address?
Ulcerative colitis (UC) is a chronic inflammatory bowel disease affecting the colon and rectum, characterized by symptoms like diarrhea, rectal bleeding, and a significant impact on quality of life. One particularly bothersome symptom is bowel urgency, which can severely disrupt daily activities and influence treatment decisions. While clinical guidelines recognize the importance of managing urgency, there has been a lack of validated patient-reported outcome (PRO) measures specifically designed to quantify its severity and track changes over time in clinical trials. This gap makes it difficult to objectively assess the effectiveness of new treatments in alleviating this distressing symptom.
Methods
The study employed a rigorous psychometric evaluation of the Urgency NRS, a single-item scale ranging from 0 (no urgency) to 10 (worst possible urgency). Data were drawn from a large, multicenter, randomized, placebo-controlled phase 3 trial (LUCENT-1) involving patients with moderately to severely active UC. The evaluation encompassed several key psychometric properties:
- Test-retest reliability: Assessed using intraclass correlation coefficients (ICCs) in participants whose condition was stable, indicating the scale's consistency over time.
- Known-groups validity: Examined by comparing Urgency NRS scores between groups of patients with different levels of disease severity (based on the Patient Global Rating of Severity - PGRS) and clinical outcomes (remission, response).
- Convergent and discriminant validity: Evaluated by correlating Urgency NRS scores with other established PROs (like the Inflammatory Bowel Disease Questionnaire - IBDQ) and objective clinical/histological measures (like the modified Mayo score and Geboes score).
- Responsiveness: Assessed by measuring how well the Urgency NRS captured changes in bowel urgency in response to treatment, comparing score changes in patients who achieved clinical remission or response versus those who did not.
- Score interpretation: Anchor-based analyses were conducted to identify thresholds for meaningful within-patient improvement and bowel urgency remission, using established clinical anchors like PGRS, clinical remission, and histologic remission.
Datasets
The study utilized data from the LUCENT-1 trial, a phase 3 randomized, double-blind, placebo-controlled study of mirikizumab for UC induction treatment. The dataset comprised 1,162 participants with moderately to severely active UC. This trial provided a rich source of daily electronic diary data, allowing for the calculation of weekly average Urgency NRS scores and their correlation with other clinical and patient-reported outcomes. No new benchmarks were introduced; rather, existing validated measures were used as anchors for the Urgency NRS validation.
Key Insights and Ideas
- The Urgency NRS is a robust measure: The study provides strong evidence that the Urgency NRS is a reliable and valid tool for assessing bowel urgency in UC patients. Its psychometric properties hold up well across various validation methods.
- Meaningful improvement is quantifiable: A key finding is the establishment of a 3-point improvement on the Urgency NRS as a clinically meaningful change for patients with moderate-to-severe UC. This provides a concrete target for treatment success.
- Bowel urgency remission is achievable: The study identified a threshold of an Urgency NRS score of 1 or less as indicative of bowel urgency remission, closely associated with clinical, endoscopic, and histologic remission. This suggests that achieving "no urgency" (a score of 0) might not be a realistic or necessary target for all patients.
- Daily monitoring is effective: The analysis of daily Urgency NRS scores and their aggregation into weekly averages demonstrated that this approach is appropriate for capturing symptom fluctuations without significant loss of information.
- The scale is sensitive to change: The Urgency NRS effectively captured improvements in bowel urgency among patients who achieved clinical remission, response, or significant symptom improvement, highlighting its responsiveness to treatment.
Key Results
- High Test-Retest Reliability: ICC values of 0.89 and 0.76 were observed for stable participants, indicating strong consistency.
- Good Known-Groups Validity: Patients with higher PGRS scores (indicating worse symptoms) consistently reported higher Urgency NRS scores at both baseline and week 12.
- Convergent and Discriminant Validity: The Urgency NRS showed moderate to strong correlations with other PROs related to bowel symptoms and quality of life (convergent validity) and weak correlations with objective measures like Geboes score and endoscopic subscore (discriminant validity).
- Responsiveness to Change: Patients achieving clinical remission, clinical response, or IBDQ remission showed significantly greater improvements in Urgency NRS scores compared to non-responders.
- Meaningful Improvement Threshold: A ≥ 3-point improvement on the Urgency NRS was identified as a meaningful within-patient improvement.
- Bowel Urgency Remission Threshold: An Urgency NRS score of ≤ 1 point was identified as a threshold for bowel urgency remission, showing strong associations with clinical remission.
Limitations and Future Work
The authors acknowledge several limitations:
- Daily Recall Period: The psychometric evaluation primarily used weekly average Urgency NRS scores derived from daily 24-hour recall periods. While this reflects intended clinical use, the psychometric properties for a one-time assessment with a longer recall period (more applicable to real-world studies) were not directly examined. However, they hypothesize similar performance.
- Generalizability: While the study included a large and diverse patient sample, the underrepresentation of Black participants means generalizability to this population needs further testing.
- Diagnostic Test Statistics: The generalizability of the identified thresholds for meaningful improvement and remission, derived using diagnostic test statistics, to other patient samples or populations is unconfirmed and warrants future validation.
Future work could involve testing the Urgency NRS with longer recall periods and confirming the established thresholds in different UC patient cohorts to enhance generalizability.
Summary updated