Supervised Feature Learning for Curvilinear Structure Segmentation

Carlos J. Becker, Roberto Rigamonti, Vincent Lepetit, Pascal Fua

Abstract

This paper introduces a novel Gradient Boosting framework designed to segment curvilinear structures, such as blood vessels and neurons, in 2D and 3D medical imagery. By simultaneously learning optimal convolutional filters and classification weights in a closed-form manner, the proposed method achieves state-of-the-art accuracy with significantly lower computational overhead than contemporary deep learning alternatives.

Introduction

Segmenting curvilinear structures—the branching networks of blood vessels in the retina or dendrites in the brain—is a fundamental task in medical imaging. Historically, researchers relied on two primary approaches: hand-crafted features (like the Frangi filter) which require tedious manual tuning, or unsupervised feature learning (like Deep Belief Networks) which require secondary fine-tuning for specific tasks.

At the time of this research (2013), fully supervised deep learning models like Convolutional Neural Networks (CNNs) were often computationally prohibitive for large 3D image stacks. This paper proposes a "middle way": a fully discriminative method that learns features specifically for the segmentation task while remaining computationally efficient through mathematical optimization.

Methodology

The core of the approach is a Gradient Boosting framework where the "weak learners" are specialized convolutional kernels.

Learned Convolutional Kernels

Unlike standard boosting that uses fixed features (e.g., Haar wavelets), this method learns the weights of convolutional filters on the fly. To manage the enormous search space of potential filters, the authors formulated kernel learning as a regularized least-squares problem. This allows for the calculation of the optimal filter in closed form at each boosting step, avoiding the slow iterative process of backpropagation.

Regularization and 3D Efficiency

To prevent overfitting to noise, a smoothness constraint was added to the kernels, ensuring filters represent coherent spatial structures. For 3D volumes, the authors restricted the search to symmetric separable filters and utilized the output of existing filters (like Optimally Oriented Flux) as additional data channels to provide rotation invariance.

Figure 5: Comparison of input micrographs and the resulting segmentation for complex neuron structures.

Datasets and Evaluation

The method was evaluated on two distinct biological benchmarks:

  1. DRIVE Dataset: 40 RGB retinal scans used for blood vessel segmentation.
  2. Brightfield Micrographs: Challenging datasets of dyed neurons, including 2D minimum-intensity projections and full 3D image stacks.

Key Results

The proposed method consistently outperformed state-of-the-art hand-crafted filters and hybrid methods across all datasets. On the DRIVE retinal dataset, the algorithm's precision-recall curve surpassed the performance of human experts in terms of pixel-wise error.

Figure 1: High-fidelity segmentation of the retinal vessel network from the DRIVE dataset.

Furthermore, the system demonstrated high efficiency, training in approximately 4 hours for 2D datasets and 6 hours for 3D stacks on a 32-core machine. This performance on 3D neuron stacks was particularly notable, as competing supervised algorithms often faced prohibitive computational costs.

Conclusion and Future Work

The authors successfully demonstrated that supervised filter learning—specifically minimizing segmentation error during the boosting process—outperforms unsupervised alternatives. While the current model relies on pre-processing for 3D rotation invariance, future work aims to extend this "kernel boosting" approach to more complex textures and organelles within Electron Microscopy (EM) imagery.

Summary updated

Abstract

We present a novel, fully-discriminative method for curvilinear structure segmentation that simultaneously learns a classifier and the features it relies on. Our approach requires almost no parameter tuning and, in the case of 2D images, removes the requirement for hand-designed features, thus freeing the practitioner from the time-consuming tasks of parameter and feature selection. Our approach relies on the Gradient Boosting framework to learn discriminative convolutional filters in closed form at each stage, and can operate on raw image pixels as well as additional data sources, such as the output of other methods like the Optimally Oriented Flux. We will show that it outperforms state-of-the-art curvilinear segmentation methods on both 2D images and 3D image stacks.
BibTeX
@inproceedings{becker2013supervised,
  author = {Carlos J. Becker and Roberto Rigamonti and Vincent Lepetit and Pascal Fua},
  title = {{Supervised Feature Learning for Curvilinear Structure Segmentation}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2013},
  doi = {10.1007/978-3-642-40811-3\_66},
}
Figure