Using Item Response Theory (IRT) to Improve the Efficiency of the Simple Clinical Colitis Activity Index (SCCAI) for patients with ulcerative colitis

Alissa Walsh, Rena Cao, Darren Wong, Ramona Kantschuster, Lawrence Matini, Jean M. Wilson, Oxford Ibd Cohort, Andrey Kormilitzin, Matthew South, Simon Travis, Sarah BauermeisterResearch 2020 · DOI

Introduction

The Simple Clinical Colitis Activity Index (SCCAI) has been a cornerstone for monitoring disease activity in ulcerative colitis (UC) since its introduction in 1998. Its primary advantage is its non-invasive nature, relying on patient-reported symptoms rather than endoscopy or laboratory tests. However, in the modern era of digital health and electronic Patient-Reported Outcomes (ePROs), the original 9-item survey presents a significant "response burden." Frequent, daily monitoring can lead to fatigue and inconsistent data entry. Furthermore, the inclusion of extraintestinal manifestations (EIMs)—such as skin conditions or joint pain—may not accurately reflect localized bowel inflammation. This study aimed to use Item Response Theory (IRT) to streamline the SCCAI, identifying the most informative items to create a more efficient monitoring tool.

Methods

The research team utilized data from 516 consecutive UC patients within the Oxford IBD Cohort. Symptom data were collected via TrueColours, a real-time digital platform that prompts patients to record symptoms and quality of life metrics.

To evaluate the metric properties of the SCCAI, the researchers applied a 2-parameter (2-PL) logistic IRT model. Unlike classical test theory, IRT assesses items based on two parameters:

  1. Discrimination (Slope): The ability of an item to distinguish between different levels of disease severity.
  2. Difficulty (Threshold): The level of disease activity at which a patient is likely to report a specific symptom.

Items with low discrimination values (typically < 1.70) were systematically removed to determine if a leaner scale could maintain or improve the "information" provided about the patient's underlying disease state.

Results

The initial analysis of the 9-item SCCAI revealed that certain items, specifically rare skin conditions like Erythema nodosum and Pyoderma gangrenosum, were statistically insignificant, reported by only 0 to 2 patients out of the 516. These items were removed, resulting in a 7-item scale.

Further IRT analysis identified that four core symptoms provided the vast majority of discriminatory power:

  • Daytime bowel frequency
  • Nocturnal bowel frequency
  • Urgency of defecation
  • Rectal bleeding

This 4-item scale demonstrated superior performance compared to the longer versions. Discrimination values for these items ranged from 1.50 to 2.78, with "Daytime frequency" being particularly informative (2.78). Additionally, the 4-item scale showed higher unidimensionality, meaning it more accurately measures a single underlying trait (bowel inflammation) without the "noise" introduced by unrelated symptoms like joint pain. Interestingly, while the overall reliability (Cronbach’s alpha) was modest, it was higher for the 4-item version (0.65) than for the 7-item version (0.63).

Discussion and Conclusion

Reducing the SCCAI from nine items to four significantly minimizes the response burden for patients while maintaining, and even improving, the tool's ability to distinguish between remission and flare states. This efficiency is crucial for long-term adherence in digital monitoring programs.

However, the authors note that this 4-item scale requires further validation. Future research must compare the refined index against objective "gold standard" markers of inflammation, such as fecal calprotectin, endoscopy, and histopathology. Additionally, the consistency of the tool over time (test-retest reliability) needs to be established before it can be formally adopted as a clinical standard. By focusing on the "Core Four" symptoms, clinicians can potentially achieve more precise monitoring with less effort from the patient.

Summary updated

Abstract

Abstract BackgroundThe SCCAI was designed to facilitate assessment of disease activity in ulcerative colitis (UC). We aimed to interrogate the metric properties of individual items of the SCCAI using item response theory (IRT) analysis, to simplify and improve its performance. MethodsThe original 9-item SCCAI was collected through TrueColours, a real-time software platform which allows remote entry and monitoring of patients with UC. Data were securely uploaded onto Dementias Platform UK Data Portal, where they were analysed in Stata 16.1 SE. A 2-parameter (2-PL) logistic IRT model was estimated to evaluate each item of the SCCAI for its informativeness (discrimination). A revised scale was generated and re-assessed following systematic removal of items. ResultsSCCAI data for 516 UC patients (41 years, SD=15) treated in Oxford were examined. After initial item deletion (Erythema nodosum, Pyoderma gangrenosum), a 7-item scale was estimated. Discrimination values (information) ranged from 0.41 to 2.52 indicating selected item inefficiency with three items &lt;1.70 which is a suggested discriminatory value for optimal efficiency. Systematic item deletions found that a 4-item scale (bowel frequency day; bowel frequency nocturnal; urgency to defaecation; rectal bleeding) was more informative and discriminatory of trait severity (discrimination values of 1.50 to 2.78). The 4-item scale possesses higher scalability and unidimensionality, suggesting that the responses to items are either direct endorsement (patient selection by symptom ) or non-endorsement of the trait (disease activity). Conclusion Reduction of the SCCAI from the original 9-item scale to a 4-item scale provides optimum trait information that will minimise response burden. This new 4-item scale needs validation against other measures of disease activity such as faecal calprotectin, endoscopy and histopathology.
BibTeX
@inproceedings{walsh2020using,
  author = {Alissa Walsh and Rena Cao and Darren Wong and Ramona Kantschuster and Lawrence Matini and Jean M. Wilson and Oxford IBD Cohort and Andrey Kormilitzin and Matthew South and Simon Travis and Sarah Bauermeister},
  title = {{Using Item Response Theory (IRT) to Improve the Efficiency of the Simple Clinical Colitis Activity Index (SCCAI) for patients with ulcerative colitis}},
  booktitle = {Research},
  year = {2020},
  doi = {10.21203/rs.3.rs-60494/v2},
}
Figure