Retinal Vessel Segmentation via Neuron Programming

Tingting Wu, Ruyi Min, Peixuan Song, Hengtao Guo, Tieyong Zeng, Feng-Lei FanarXiv 2024 · DOI · arXiv

Abstract

Accurate segmentation of retinal blood vessels is essential for diagnosing various systemic and ocular diseases. While Neural Architecture Search (NAS) has advanced the automation of network design, it typically overlooks neuronal diversity by assuming uniform neuron types throughout a model. This paper introduces Neuron Programming (NP), a novel framework that searches for optimal neuron types at specific positions within a network. By integrating quadratic neurons into a U-Net architecture and utilizing a genetic algorithm for joint optimization, the authors achieve state-of-the-art results on multiple benchmarks. Notably, the resulting models are highly efficient, requiring up to 7x fewer parameters than existing high-performance alternatives.

Introduction

Segmenting blood vessels in retinal fundus images is a critical task for diagnosing conditions like diabetic retinopathy and glaucoma. However, it is notoriously difficult because vessels are microscopic, intertwined, and often obscured by low contrast or lesions.

While standard deep learning approaches and NAS have improved performance, they generally rely on standard "point neurons" that perform simple linear operations. The human brain, by contrast, utilizes a diverse array of neuronal types to process information of varying complexity. The authors argue that artificial neural networks should similarly leverage neuronal diversity. The core challenge addressed is the automated determination of which specific neuron type belongs at each location in a deep network without incurring prohibitive computational costs.

Methodology: Neuron Programming

The proposed Neuron Programming (NP) framework introduces two primary innovations: the use of quadratic neurons and a specialized search strategy that treats neuron types as programmable components.

Quadratic Neurons and Search Strategy

Unlike conventional neurons that use a simple inner product, quadratic neurons incorporate higher-order terms, allowing them to model complex non-linear interactions more effectively. This is particularly beneficial for capturing the intricate morphology of retinal vessels.

Overview of the Neuron Programming (NP) framework, illustrating the evolutionary search process, gene encoding, and the ReLinear training strategy.

The search process utilizes a Genetic Algorithm to optimize the network across two dimensions:

  1. Architecture (Connections): Determining the "skeleton" or connectivity of the network.
  2. Neuronal Type (Operations): Selecting between conventional and quadratic neurons for each node.

The framework supports both a joint search (optimizing both dimensions simultaneously) and a "plug-and-play" approach. To mitigate the high cost of searching, a hypernetwork is employed to predict optimal neuronal configurations for given architectures, drastically reducing deployment time on new datasets.

The Node Library and Gene Encoding

The search space is defined by a library of pre-activation and post-activation nodes. Each node is encoded by a gene sequence that specifies its normalization type (e.g., Instance Normalization), convolution kernel size (3x3 or 5x5), and neuron type (conventional vs. quadratic).

The library of pre- and post-activation nodes used for neuron programming, detailing the gene sequences for various normalization and convolution types.

Experimental Validation

The researchers evaluated the NP framework on four public datasets: DRIVE, STARE, CHASE_DB1, and HRF. These datasets provide a range of challenges, from pediatric subjects to various pathological changes and high-resolution imagery.

Key Results

  • Superior Performance: On the DRIVE dataset, the model achieved a Sensitivity (SE) of 0.8489, outperforming standard U-Net and other complex NAS-based competitors.
  • Parameter Efficiency: The model is remarkably lean, utilizing only 0.84 million parameters. In comparison, the high-performing FR-UNet uses 5.72 million parameters, representing a nearly 7x reduction in size while maintaining superior performance.
  • Robustness: Qualitative analysis indicates that the model is superior at resolving topological issues, such as identifying thin vessels in low-contrast regions where other models often fail.

Discussion and Insights

A key finding is that diversity drives efficiency. By allowing the network to select complex quadratic neurons only where needed—specifically in the initial encoder layers and final decoder layers—the model gains expressiveness without becoming excessively deep or wide. Furthermore, the study identified a synergy between Instance Normalization and quadratic neurons, which helps stabilize training by preventing feature magnitude explosions.

Conclusion and Future Work

Neuron Programming represents a significant shift from searching for network skeletons to optimizing the fundamental units of computation. While the initial generation of training data for the search process is computationally intensive, the resulting "meta-architect" can deploy optimized models almost instantly. Future work will explore expanding the neuron library to include biologically inspired types like spiking neurons and applying NP to 3D medical imaging tasks such as MRI segmentation.

Summary updated

Abstract

The accurate segmentation of retinal blood vessels plays a crucial role in the early diagnosis and treatment of various ophthalmic diseases. Designing a network model for this task requires meticulous tuning and extensive experimentation to handle the tiny and intertwined morphology of retinal blood vessels. To tackle this challenge, Neural Architecture Search (NAS) methods are developed to fully explore the space of potential network architectures and go after the most powerful one. Inspired by neuronal diversity which is the biological foundation of all kinds of intelligent behaviors in our brain, this paper introduces a novel and foundational approach to neural network design, termed ``neuron programming'', to automatically search neuronal types into a network to enhance a network's representation ability at the neuronal level, which is complementary to architecture-level enhancement done by NAS. Additionally, to mitigate the time and computational intensity of neuron programming, we develop a hypernetwork that leverages the search-derived architectural information to predict optimal neuronal configurations. Comprehensive experiments validate that neuron programming can achieve competitive performance in retinal blood segmentation, demonstrating the strong potential of neuronal diversity in medical image analysis.
BibTeX
@misc{wu2024retinal,
  author = {Tingting Wu and Ruyi Min and Peixuan Song and Hengtao Guo and Tieyong Zeng and Feng-Lei Fan},
  title = {{Retinal Vessel Segmentation via Neuron Programming}},
  year = {2024},
  eprint = {2411.11110},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2411.11110},
}
Figure