Initialization and Stopping Tolerance in CPU Dermoscopic Segmentation

Wenhao Xu, Yixian Kong, Ting Pan, Changwei Wang, Feilong Wang, Rongtao XuarXiv 2026 · arXiv

TL;DR

In the world of skin lesion segmentation, more computation doesn't always mean better results. This paper demonstrates that refining a simple Otsu threshold with a Chan-Vese active contour model can actually decrease accuracy, and reveals how often-ignored numerical settings like stopping tolerance can completely flip the perceived performance of different algorithms.

What Problem Does This Paper Address?

Active contour models, like the classic Chan-Vese algorithm, are staples in medical imaging for their ability to "shrink-wrap" around objects based on intensity differences. However, these models are sensitive to two things: where they start (initialization) and when they decide to quit (stopping tolerance).

In many research papers, these numerical details are treated as "implementation noise" and are poorly reported. The authors tackle a fundamental question: Does the extra CPU time spent evolving a contour actually improve the segmentation, or are we just adding complexity for no gain? By systematically varying initializers and tolerances, they highlight a reproducibility crisis where "better" results might just be an artifact of arbitrary stopping rules.

Methods

The researchers used the open-source scikit-image implementation of the Chan-Vese model, focusing on a CPU-only pipeline. They compared three different ways to start the contour:

  1. Checkerboard: A generic grid pattern.
  2. Disk: A large circle centered in the image.
  3. Otsu Seed: A mask generated by Otsu thresholding, converted into a signed-distance field.

Crucially, they tested these against a Raw Otsu Baseline (no contour evolution at all) and varied the stopping tolerance ($\epsilon$)— the threshold of change below which the algorithm decides it has converged.

Datasets

The study utilized a resized "mirror" of the ISIC 2017 skin lesion challenge dataset.

  • Development set: 100 images used to select the best input color channel (Blue was chosen over Luminance).
  • Evaluation set: 600 held-out images used for the final benchmarks.

Key Insights and Ideas

  • The Refinement Paradox: The most surprising finding was that the raw Otsu thresholding outperformed every single Chan-Vese configuration. Evolving the contour from an Otsu seed actually reduced the mean Dice score.
  • The "One-Step" Trap: At default tolerances, the "Disk" initializer often stopped after a single iteration. This means the algorithm wasn't actually "working"; it just decided it was close enough to a solution immediately, leading to poor scores that don't reflect the model's true potential.
  • Performance Reversals: The "best" initializer changes depending on lesion size. For small lesions, Otsu-seeding is vastly superior to a checkerboard; for large lesions, the checkerboard actually takes the lead. Aggregate scores can hide these critical sub-group failures.
Figure 1: Overlap and computation under the two stopping tolerances. Dashed lines in (a,b) mark the Otsu-only baseline; error bars in (a) show 95% image-bootstrap intervals. The dotted line in (c) marks the 500-iteration limit.

Key Results

  • Otsu is King: The simple Otsu threshold achieved the highest mean Dice score of 0.6897 while being roughly 100x faster than the refined versions.
  • Refinement Loss: Evolving the Otsu seed at default tolerance dropped the Dice score to 0.6660.
  • Tolerance Sensitivity: Tightening the stopping tolerance ($\epsilon = 10^{-5}$) forced almost all runs to hit the 500-iteration limit, significantly increasing CPU time (from ~360ms to ~935ms for Otsu seeds) but narrowing the performance gap between initializers.
  • Qualitative Failure: As seen in the examples, even when one method shows a "large improvement" over another, it may still fail to capture the true boundary of the lesion accurately.
Figure 3: Examples nearest the 10th, 50th, and 90th percentiles of the default Otsu-seed minus checkerboard Dice difference, shown from top to bottom. Green contours: reference; magenta contours: prediction. Values below panels are per-image Dice.

Limitations and Future Work

The study is limited to a global two-phase model, meaning it assumes the image only has two main intensity regions (lesion and skin). It does not account for:

  • Spatial Inhomogeneity: Local intensity variations that might require more complex models (e.g., Lankton or Li models).
  • Preprocessing: The impact of hair removal or border cropping was not explored.
  • Deep Learning: While the paper mentions U-Nets and Transformers, it focuses strictly on training-free, CPU-based methods.

The authors conclude that future evaluations must report the initial-field definition, stopping tolerance, and actual iteration counts together to ensure results are truly reproducible and not just a byproduct of numerical settings.

Summary updated

Abstract

Contour initialization and numerical stopping can jointly affect the evaluation of active-contour segmentation. We examine their interaction using the open-source scikit-image Chan-Vese implementation on a resized ISIC 2017 mirror. A fixed development set of 100 images selects a common input channel; all 600 images in the repository's held-out partition are then evaluated. Otsu thresholding is compared with checkerboard-, disk-, and Otsu-initialized contours under default and tighter level-set tolerances. At the default tolerance, Otsu initialization increases mean image Dice from 0.6011 to 0.6660 relative to checkerboard initialization, a paired difference of 0.0649 (95% image-bootstrap interval [0.0452, 0.0860]). Otsu thresholding alone achieves 0.6897. The default disk initializer stops after one iteration on 471 images. Tightening the tolerance reduces the Otsu-seed advantage over checkerboard initialization to 0.0197, with most runs reaching the 500-iteration limit. The default-tolerance advantage also reverses between small- and large-lesion strata. These findings show that an improvement over a generic initializer can coexist with deterioration relative to the threshold baseline. Evaluations should retain the unrefined mask as a comparator and report the initial-field definition, stopping tolerance, and observed iteration counts together.
BibTeX
@misc{xu2026initialization,
  author = {Wenhao Xu and Yixian Kong and Ting Pan and Changwei Wang and Feilong Wang and Rongtao Xu},
  title = {{Initialization and Stopping Tolerance in CPU Dermoscopic Segmentation}},
  year = {2026},
  eprint = {2609.25685},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2609.25685},
}
Figure