Bridging Classification and Segmentation in Osteosarcoma Assessment via Foundation and Discrete Diffusion Models

Manh Duong Nguyen, Dac Thai Nguyen, Trung Viet Nguyen, Homi Yamada, Huy Hieu Pham, Phi Le Nguyen

Introduction

Osteosarcoma, the most prevalent primary malignant bone tumor, presents a significant diagnostic challenge. A critical determinant of patient prognosis is the necrosis ratio—the proportion of dead tumor tissue following induction chemotherapy. Clinical data suggests that a necrosis rate exceeding 90% correlates with a five-year survival rate of over 80%. However, calculating this metric manually is a labor-intensive and subjective process for pathologists, who must navigate massive Whole Slide Images (WSIs) that often exceed several gigabytes in size.

Existing computational approaches to automate this assessment typically fall into two categories: patch-based classification and region-based segmentation. Patch-based methods often lose global spatial context, while region-based methods require exhaustive pixel-level annotations that are difficult to obtain for rare cancers. To address these limitations, this research introduces FDDM (Foundation and Discrete Diffusion Model), a two-stage framework designed to bridge the gap between local classification and global segmentation.

Methodology

The FDDM framework operates in two distinct phases to achieve high-precision tissue characterization.

Phase 1: Foundation Model-Based Classification

The first stage leverages UNI, a state-of-the-art pathology foundation model pre-trained on over 100 million image patches. To adapt this massive model to the specific nuances of osteosarcoma without prohibitive computational costs, the researchers employed Low-Rank Adaptation (LoRA). This technique allows for efficient fine-tuning by updating only a small subset of the model's parameters. The output of this phase is a coarse classification mask that identifies tissue types but often lacks the refined boundaries required for clinical accuracy.

Phase 2: Refinement via Discrete Diffusion

To transform the coarse, often "noisy" classification maps into precise segmentation masks, the framework utilizes a Brownian Bridge Diffusion Model (BBDM). Unlike generative diffusion models that create images from random noise, the BBDM is used here as a refiner. It learns the transition from the discrete classification space to a continuous, anatomically accurate segmentation space. By conditioning this process on the original histological image, the model ensures that the final boundaries align with the actual biological structures of the tissue.

Data and Experimental Setup

The study utilized a newly curated dataset derived from 160 osteosarcoma WSIs, categorized into seven distinct tissue classes (including Viable Tumor, Necrosis, Fibrosis, and Inflammatory tissue). The data was split into two specialized sets:

  • Patch-based Dataset: Approximately 900,000 annotated patches (256x256 pixels) for training the foundation classifier.
  • Region-based Dataset: Roughly 51,000 larger samples used to train the diffusion-based refiner.

Results and Clinical Impact

The FDDM framework demonstrated superior performance across both technical and clinical metrics:

  • Segmentation Accuracy: The model achieved a 44.91% mean Intersection over Union (mIOU). This represents a nearly 5% improvement over the standalone UNI foundation model and a 10% boost over traditional convolutional neural network (CNN) architectures.
  • Clinical Precision: Most importantly, FDDM significantly improved the estimation of the Total Necrosis Rate (TNR). The model reduced the TNR error rate to just 4.17%, a stark contrast to traditional models like U-Net, which exhibited error rates as high as 35.96%.
  • Qualitative Superiority: Visual analysis confirms that the diffusion refinement stage effectively eliminates the "speckled" artifacts common in patch-based classification, producing smooth, biologically plausible segmentations that better reflect the underlying pathology.

Discussion and Future Work

By combining the broad knowledge of pathology foundation models with the iterative refinement capabilities of diffusion models, FDDM provides a robust solution for complex cancer assessment. The study proves that foundation models are the new baseline for specialized pathology tasks, and that diffusion processes can serve as a "smart eraser" to correct classification errors.

Despite these successes, the authors acknowledge certain limitations. The iterative nature of diffusion models increases computational demand during inference compared to single-pass networks. Future research will focus on optimizing these models for real-time clinical deployment and testing the framework's generalizability across other rare and complex cancer types. Ultimately, this work represents a significant step toward standardized, AI-assisted prognostic assessment in oncology.

Summary updated

Abstract

Osteosarcoma, the most common primary bone cancer, often requires accurate necrosis assessment from whole slide images (WSIs) for effective treatment planning and prognosis. However, manual assessments are subjective and prone to variability. In response, we introduce FDDM, a novel framework bridging the gap between patch classification and region-based segmentation. FDDM operates in two stages: patch-based classification, followed by region-based refinement, enabling cross-patch information intergation. Leveraging a newly curated dataset of osteosarcoma images, FDDM demonstrates superior segmentation performance, achieving up to a 10% improvement mIOU and a 32.12% enhancement in necrosis rate estimation over state-of-the-art methods. This framework sets a new benchmark in osteosarcoma assessment, highlighting the potential of foundation models and diffusion-based refinements in complex medical imaging tasks.
BibTeX
@inproceedings{nguyen2025bridging,
  author = {Manh Duong Nguyen and Dac Thai Nguyen and Trung Viet Nguyen and Homi Yamada and Huy Hieu Pham and Phi Le Nguyen},
  title = {{Bridging Classification and Segmentation in Osteosarcoma Assessment via Foundation and Discrete Diffusion Models}},
  booktitle = {ISBI},
  year = {2025},
  url = {https://openreview.net/forum?id=ID37Aa3TJU},
}
Figure