MonoBox: Tightness-Free Box-Supervised Polyp Segmentation Using Monotonicity Constraint

Qiang Hu, Zhenyu Yi, Ying Zhou, Fan Huang, Mei Liu, Qiang Li, Zhiwei Wang

Introduction

Training deep learning models for medical image segmentation typically requires expensive, pixel-level masks. Box-Supervised Segmentation (BSS) has emerged as a popular alternative, utilizing simple bounding boxes that are significantly faster to produce. However, most BSS methods rely on a "tightness assumption," requiring box edges to perfectly touch object boundaries. MonoBox is a novel framework that eliminates this requirement by enforcing a monotonicity constraint, ensuring robust training even when clinicians provide loose or imprecise annotations.

The Problem: Limitations of the Tightness Assumption

In clinical practice, the tightness assumption often fails. Polyps frequently exhibit blurry boundaries and low contrast with surrounding tissue, leading endoscopists to draw boxes that are either too wide or too narrow.

Examples of bounding box annotations for polyps in colonoscopy images, illustrating the variety of polyp appearances and the difficulty of precise box placement.

Traditional BSS methods, often based on Multiple Instance Learning (MIL), struggle with these "noisy" edges. When a box is oversized, the model attempts to force the segmentation to touch the incorrect boundaries, frequently producing "thorn-like" artifacts and splinters that degrade the clinical utility of the output.

Methods: Monotonicity Constraint and Label Correction

MonoBox introduces two primary mechanisms to handle non-tight boxes and improve segmentation accuracy:

  1. Monotonicity Constraint (MC): Instead of forcing the model to match potentially incorrect binary labels in "unconfident regions" near box edges, MonoBox enforces a spatial trend. Using four directional kernels, the MC ensures that the predicted probability of a pixel being a polyp decreases monotonically as one moves from the center of the box toward the background. This provides a reliable gradient for optimization without over-fitting to noisy labels.
Comparison of Multiple Instance Learning (MIL) and the Monotonicity Constraint (MC). While MIL fails to provide correct supervision for non-tight boxes (Cases I and II), MC maintains a consistent spatial trend across all scenarios.
  1. Adaptive Label Correction (LC): As the model's confidence grows during training, it utilizes its own predicted masks to refine the original bounding boxes. Periodically, the framework "tightens" the boxes based on high-probability predictions and dynamically shrinks the unconfident regions, creating a virtuous cycle that gradually cleans the noisy dataset.

Additionally, the framework optimizes a Proxy Map, which decouples shape information from the segmentation map, allowing for more direct optimization of the box-level constraints.

Datasets and Evaluation

The researchers evaluated MonoBox across three distinct scenarios:

  • Public Synthetic Noisy Dataset: A combination of five public polyp datasets (including ClinicDB and Kvasir-SEG) where ground-truth boxes were perturbed with Gaussian noise to simulate inaccuracy.
  • In-House Real Noisy Dataset: A large-scale dataset of 18,656 colonoscopy images featuring real-world annotations from endoscopists, which naturally contained non-tight boxes.
  • COCO Dataset: To demonstrate the framework's generality, tests were also conducted on natural images using the COCO test-dev split.

Key Results and Insights

MonoBox significantly outperformed existing state-of-the-art anti-noise methods:

  • Performance Gains: On the real-world noisy dataset, MonoBox improved the Dice score by 3.3% over the previous best method (FSRM). On synthetic noisy data, the improvement reached 5.5%.
  • Visual Quality: Qualitative analysis confirmed that MonoBox successfully eliminates the "thorn-like" artifacts common in other box-supervised methods when boxes are over-sized.
  • Robustness: The core innovation is the shift from "targets to trends." By exploiting the spatial correlation of noise—recognizing that neighbors closer to the center are more likely to be foreground—the method remains stable even as box tightness decreases.

Limitations and Future Work

Currently, MonoBox utilizes a uniform scale for the "unconfident region" across all samples in a dataset. However, in practice, some boxes are noisier than others. Future research will explore methods to adaptively perceive the appropriate unconfident scale for each individual training sample, potentially using the model's own uncertainty metrics to determine how much of a box edge should be distrusted at any given time.

Summary updated

Abstract

We propose MonoBox, an innovative box-supervised segmentation method constrained by monotonicity to liberate its training from the user-unfriendly box-tightness assumption. In contrast to conventional box-supervised segmentation, where the box edges must precisely touch the target boundaries, MonoBox leverages imprecisely-annotated boxes to achieve robust pixel-wise segmentation. The 'linchpin' is that, within the noisy zones around box edges, MonoBox discards the traditional misguiding multiple-instance learning loss, and instead optimizes a carefully-designed objective, termed monotonicity constraint. Along directions transitioning from the foreground to background, this new constraint steers responses to adhere to a trend of monotonically decreasing values. Consequently, the originally unreliable learning within the noisy zones is transformed into a correct and effective monotonicity optimization. Moreover, an adaptive label correction is introduced, enabling MonoBox to enhance the tightness of box annotations using predicted masks from the previous epoch and dynamically shrink the noisy zones as training progresses. We verify MonoBox in the box-supervised segmentation task of polyps, where satisfying box-tightness is challenging due to the vague boundaries between the polyp and normal tissues. Experiments on both public synthetic and in-house real noisy datasets demonstrate that MonoBox exceeds other anti-noise state-of-the-arts by improving Dice by at least 5.5% and 3.3%, respectively. Codes are at https://github.com/Huster-Hq/MonoBox.
BibTeX
@inproceedings{hu2025monobox,
  author = {Qiang Hu and Zhenyu Yi and Ying Zhou and Fan Huang and Mei Liu and Qiang Li and Zhiwei Wang},
  title = {{MonoBox: Tightness-Free Box-Supervised Polyp Segmentation Using Monotonicity Constraint}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2025},
  doi = {10.1609/aaai.v39i4.32371},
}
Figure