KneeFS-Net: A Lightweight Deep Learning Model for Knee Osteoarthritis Severity Assessment with Cross-Domain External Validation

Shafqat Alam, Galib Anjum Talukder Mahi, Yeasir Rabbani Tanvir, Md. Ibrahim, Md. Shahed Hossain, Shashank Ghimire, Mahmud Hasan Mostofa Kamal, Asm Shahidul Hossain, Taufiq HasanarXiv 2026 · arXiv

TL;DR

Researchers have developed KneeFS-Net, a lightweight deep learning model (just 0.8 million parameters) that matches the performance of models 35 times its size in grading knee osteoarthritis. By combining spatial, Fourier, and state-space features, the model demonstrates remarkable efficiency and provides a practical roadmap for adapting medical AI to underrepresented populations with minimal labeled data.

What Problem Does This Paper Address?

Knee osteoarthritis (KOA) is a leading cause of disability globally, particularly in aging populations. Clinicians typically grade its severity using the Kellgren–Lawrence (KL) scale, a five-grade system ranging from 0 (healthy) to 4 (severe). However, accurate KL grading requires specialized radiologic expertise that is often scarce in low-resource settings.

While deep learning has shown promise in automating this task, two major hurdles remain:

  1. Computational Cost: Most high-performing models are "heavy," requiring significant GPU resources that aren't always available in clinical environments.
  2. Domain Shift: Models trained on pristine, curated research datasets (like the US-based OAI) often fail when deployed on "real-world" clinical images from different populations (e.g., in South Asia) due to variations in anatomy, X-ray equipment, and imaging protocols.

Methods

The authors introduce KneeFS-Net, an architecture designed for efficiency and "ordinal" awareness (recognizing that the difference between Grade 1 and 2 is smaller than between Grade 1 and 4).

Key technical innovations include:

  • FSSE (Frequency-Spatial Selective Encoding) Layers: Instead of standard convolutions, each layer uses three parallel branches:
  • Local: Depthwise convolutions for fine details like bone spurs (osteophytes).
  • Frequency: A Fourier-based branch that captures global context across the entire joint at a low computational cost.
  • State-Space (SSM): Utilizing selective state-space modeling (similar to the "Mamba" architecture) to capture long-range dependencies in the image data efficiently.
  • Landmark-Guided Attention: The model uses anatomical landmarks to focus specifically on the medial and lateral joint spaces—the areas most critical for diagnosis.
  • Ordinal Prediction Head: Rather than treating the five KL grades as independent categories, the model predicts cumulative probabilities, explicitly modeling the progression of the disease.

Datasets

The study utilizes three distinct cohorts to test generalization:

  1. OAI (Osteoarthritis Initiative): A large, public US-based research dataset used for initial training and benchmarking.
  2. BMU Cohort (Bangladesh Medical University): A newly curated single-center hospital dataset from Bangladesh (271 knees) used for external validation.
  3. Multi-District Cohort: A large, "noisy" teleradiology dataset from 219 centers across Bangladesh (1,000 labeled knees, 6,092 unlabeled) representing real-world clinical variability.

Key Insights and Ideas

  • Efficiency is the New State-of-the-Art: KneeFS-Net achieves a Quadratic Weighted Kappa (QWK) of 0.863 on the OAI dataset. This is comparable to heavyweights like DenseNet121 or Swin-Transformer, but with 9 to 35 times fewer parameters and significantly lower GFLOPs.
  • The Teleradiology "Tax": The model performed excellently when transferred directly to the Bangladeshi hospital cohort (QWK 0.803). However, performance dropped sharply on the multi-center teleradiology data (QWK 0.656). This highlights that "real-world" noise (artifacts, varied scales, graininess) is a much bigger hurdle than population-level anatomical differences.
  • SSL as a Bridge: Self-supervised learning (using the DINO framework) on unlabeled local images, followed by joint fine-tuning, recovered most of the lost performance. This suggests that hospitals can "tune" a lightweight model to their specific equipment using their own unlabelled archives.

Key Results

  • Model Size: 0.8 million parameters and 0.33 GFLOPs (extremely lightweight).
  • In-Domain (OAI): 0.863 QWK, 97.2% within-one-grade accuracy.
  • Cross-Domain (Bangladesh Hospital): 0.803 QWK without any retraining.
  • Adapted Performance (Teleradiology): After self-supervised pretraining and fine-tuning, the model reached 0.823 QWK on the difficult multi-center dataset, nearly matching the agreement levels found between human radiologists (0.869).
  • Hardware Friendly: The model requires only 222 MB of peak GPU memory, making it suitable for deployment on modest hardware or even CPUs in a reporting workflow.

Limitations and Future Work

The authors acknowledge several limitations:

  • Localization Dependency: While the grading model is lightweight, the full pipeline still requires a knee detector and region localizer. The study used expert-checked boxes for the Bangladeshi cohorts, so a fully "end-to-end" automated deployment might see slightly lower performance.
  • Class Imbalance: Severe cases (KL4) are rare in the Bangladeshi cohorts, making it difficult to statistically verify the model's performance on the most advanced stages of the disease.
  • Retrospective Nature: The study was conducted on historical data. The next step is prospective validation—testing the model in a live clinical workflow to see if it actually improves diagnostic speed or accuracy for radiologists.

Summary updated

Abstract

Knee osteoarthritis (OA) grading from radiographs using the Kellgren-Lawrence (KL) scale requires expertise that may be scarce. We present KneeFS-Net, a lightweight ordinal grader (0.8 million parameters; 0.33 GFLOPs) combining spatial, Fourier and state-space features with landmark-guided attention. On the Osteoarthritis Initiative (OAI) test set, KneeFS-Net achieved a quadratic weighted kappa (QWK) of 0.863, mean absolute error (MAE) of 0.325 and 97.2% within-one-grade accuracy, comparable to models with 9-35-fold more parameters. We evaluated cross-population generalization on two Bangladeshi cohorts, a single-center hospital cohort and a multi-center teleradiology cohort. Without further training or adaptation, the OAI-trained model achieved QWK 0.803, MAE 0.339 and 98.2% within-one-grade accuracy on its hospital cohort, declining to QWK 0.656 and MAE 0.522 on multi-center teleradiology images. Self-supervised pretraining on 6,092 unlabeled radiographs followed by joint fine-tuning achieved QWK 0.823, MAE 0.329 and 99.7% within-one-grade accuracy in cross-validation. These findings demonstrate accurate, efficient KL grading and potential adaptation to new populations with limited annotation.
BibTeX
@misc{alam2026kneefs,
  author = {Shafqat Alam and Galib Anjum Talukder Mahi and Yeasir Rabbani Tanvir and Md. Ibrahim and Md. Shahed Hossain and Shashank Ghimire and Mahmud Hasan Mostofa Kamal and ASM Shahidul Hossain and Taufiq Hasan},
  title = {{KneeFS-Net: A Lightweight Deep Learning Model for Knee Osteoarthritis Severity Assessment with Cross-Domain External Validation}},
  year = {2026},
  eprint = {2611.19988},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.19988},
}
Figure