Automating Three-dimensional Osteoarthritis Histopathological Grading of Human Osteochondral Tissue using Machine Learning on Contrast-Enhanced Micro-Computed Tomography

S.j.o. Rytky, Aleksei Tiulpin, Tuomas Frondelius, Mikko Finnilä, Sakari S. Karhula, J. Leino, Kenneth P. H. Pritzker, Maarit Valkealahti, Petri Lehenkari, Antti Joukainen, Heikki Kröger, Heikki J. Nieminen, Simo SaarakkalabioRxiv 2019 · DOI

TL;DR

This paper introduces a machine learning approach to automatically grade the histopathological severity of osteoarthritis (OA) in human osteochondral tissue using 3D micro-computed tomography (CEµCT). The developed method shows promise for objective and efficient OA assessment, with publicly available code and software to aid researchers.

What Problem Does This Paper Address?

Accurately grading the severity of osteoarthritis (OA) in human osteochondral tissue is crucial for understanding disease progression and developing new treatments. The current gold standard, manual histopathological grading, is time-consuming, destructive, and prone to user bias. While 3D imaging techniques like contrast-enhanced micro-computed tomography (CEµCT) offer a less destructive way to assess tissue, grading still relies on manual interpretation. Existing automated methods often focus on single tissue zones or lack robust validation. This paper aims to bridge this gap by developing an automated, machine learning-based grading system for multiple zones of osteochondral tissue using CEµCT, addressing the need for objective and efficient OA assessment.

Methods

The researchers employed a multi-stage machine learning pipeline. First, they extracted 3D volumes of interest (VOIs) from different zones of the osteochondral tissue: surface (SZ), deep (DZ), and calcified (CZ). These VOIs were then processed using a dimensionally reduced Local Binary Pattern (LBP) textural feature analysis. Two regression models, Regularized Ridge and Logistic Regression (LR), were trained zone-wise on these features against manually assigned histopathological grades. Validation was performed using a rigorous nested leave-one-out cross-validation strategy to prevent overfitting, followed by evaluation on an independent test set. Performance was measured using Spearman's correlation, Average Precision (AP), and Area Under the Receiver Operating Characteristic Curve (AUC).

Datasets

The study utilized two datasets of human osteochondral cores:

  • Cross-validation set: 34 samples (Ø = 2 mm) from 19 total knee arthroplasty (TKA) patients. This set was used for training and cross-validation.
  • Test set: 45 samples (Ø = 4 mm) from 7 TKA patients and 2 asymptomatic cadavers. This independent set was used to evaluate the model's generalization capabilities, including its robustness to changes in sample acquisition protocol.

Key Insights and Ideas

  • Zone-specific performance: The machine learning models performed best for the surface zone (SZ), suggesting that surface features are more readily captured and indicative of OA severity by the chosen methods.
  • Generalizability is key: The study highlights the importance of robust validation, particularly using independent test sets and considering variations in imaging parameters, to ensure a model's real-world applicability.
  • Texture is informative: Local Binary Patterns (LBP) proved to be effective textural features for capturing subtle changes in the osteochondral tissue indicative of OA.
  • Automation is feasible: The research demonstrates that automating the histopathological grading of osteochondral tissue using CEµCT and machine learning is achievable, paving the way for more objective and efficient assessments.

Key Results

The machine learning models achieved promising results, particularly on the cross-validation set:

  • Surface Zone (SZ): Achieved high performance with AUC of 0.92 and AP of 0.89 for Logistic Regression. Spearman's correlation was also strong at 0.68.
  • Deep Zone (DZ): Showed moderate performance, with AUC of 0.72 and AP of 0.50 on cross-validation. Notably, the AP for DZ increased significantly to 0.83 on the independent test set.
  • Calcified Zone (CZ): Exhibited moderate performance, with AUC of 0.77 and AP of 0.71 on cross-validation. Performance decreased slightly on the test set (AUC 0.63, AP 0.62).

While performance generally decreased on the independent test set compared to cross-validation, the models still demonstrated reasonable accuracy, especially for the surface zone. The study also found that the models are better at detecting overall degeneration rather than fine-grained grading, likely due to the limited training sample size.

Limitations and Future Work

The authors acknowledge several limitations:

  • Sample Size: The model was trained on a relatively small number of samples (34 for cross-validation), which may limit its ability to capture the full spectrum of OA severity and perform fine-grained grading.
  • Freeze-Thaw Cycle: Samples underwent one freeze-thaw cycle, which could potentially affect tissue integrity.
  • Image Quality Variations: Differences in core diameters and imaging parameters between the cross-validation and test sets led to variations in image quality, impacting model performance.
  • Zone-Specific Challenges: The calcified zone (CZ) model showed some limitations, potentially due to the segmentation method or the nature of the tissue.

Future work suggested includes:

  • Larger Training Datasets: Acquiring a larger and more diverse dataset would likely improve model reliability and generalization.
  • Data Augmentation and Semi-Supervised Learning: Techniques like domain adaptation could enhance model performance, especially for zones with lower accuracy.
  • Improved Segmentation: Further development of segmentation methods for the calcified zone could improve grading accuracy.
  • Exploring Other Features: Investigating additional feature extraction methods beyond LBP might yield better results.
  • Software Development: The authors have released an open-source software prototype, encouraging further development and application by the OA research community.

Summary updated

Abstract

Abstract Objective To develop and validate a machine learning (ML) approach for automatic three-dimensional (3D) histopathological grading of osteochondral samples imaged with contrast-enhanced micro-computed tomography (CEμCT). Design Osteochondral cores from 24 total knee arthroplasty patients and 2 asymptomatic cadavers (n = 34, Ø = 2 mm; n = 45, Ø = 4 mm) were imaged using CEμCT with phosphotungstic acid-staining. Volumes-of-interest (VOI) in surface (SZ), deep (DZ) and calcified (CZ) zones were extracted depthwise and subjected to dimensionally reduced Local Binary Pattern-textural feature analysis. Regularized Ridge and Logistic regression (LR) models were trained zone-wise against the manually assessed semi-quantitative histopathological CEμCT grades (Ø = 2 mm samples). Models were validated using nested leave-one-out cross-validation and an independent test set (Ø = 4 mm samples). The performance was assessed using Spearman’s correlation, Average Precision (AP) and Area under the Receiver Operating Characteristic Curve (AUC). Results Highest performance on cross-validation was observed for SZ, both on Ridge regression (ρ = 0.68, p < 0.0001) and LR (AP = 0.89, AUC = 0.92). The test set evaluations yielded decreased Spearman’s correlations on all zones. For LR, performance was almost similar in SZ (AP = 0.89, AUC = 0.86), decreased in CZ (AP = 0.71→0.62, AUC = 0.77→0.63) and increased in DZ (AP = 0.50→0.83, AUC = 0.72→0.72). Conclusion We showed that the ML-based automatic 3D histopathological grading of osteochondral samples is feasible from CEμCT. The developed method can be directly applied by OA researchers since the grading software and all source codes are publicly available.
BibTeX
@misc{rytky2019automating,
  author = {S.J.O. Rytky and Aleksei Tiulpin and Tuomas Frondelius and Mikko Finnilä and Sakari S. Karhula and J. Leino and Kenneth P. H. Pritzker and Maarit Valkealahti and Petri Lehenkari and Antti Joukainen and Heikki Kröger and Heikki J. Nieminen and Simo Saarakkala},
  title = {{Automating Three-dimensional Osteoarthritis Histopathological Grading of Human Osteochondral Tissue using Machine Learning on Contrast-Enhanced Micro-Computed Tomography}},
  year = {2019},
  doi = {10.1101/713800},
  howpublished = {bioRxiv},
}
Figure