Brain lesion segmentation through image synthesis and outlier detection

Christopher Bowles, Chen Qin, Ricardo Guerrero, Roger N. Gunn, Alexander Hammers, David Alexander Dickie, María Valdés Hernández, Joanna M. Wardlaw, Daniel RueckertNeuroImage 2017 · DOI

TL;DR

This paper introduces a novel, unsupervised method for segmenting brain lesions, particularly those associated with small vessel disease (SVD), by synthesizing "healthy" brain images and identifying deviations. This approach significantly outperforms existing methods, especially in detecting smaller lesions and cortical infarcts, by being adaptable to various pathologies without requiring specific training data for each.

What Problem Does This Paper Address?

Cerebral small vessel disease (SVD) is a common condition in the elderly, leading to various brain abnormalities, most notably hyperintense regions on T2-weighted MRI scans, particularly FLAIR sequences. Automatically segmenting these lesions is crucial for diagnosis and monitoring, but existing methods often struggle. Many are limited to white matter lesions, fail to generalize across different types of SVD pathology, or require extensive manual training data for each specific abnormality. This paper aims to develop a more robust and versatile unsupervised method that can detect hyperintense lesions on FLAIR images, irrespective of their underlying cause or location, by leveraging image synthesis and outlier detection.

Methods

The core of the proposed method lies in a two-pronged approach to identify potential lesions:

  1. Image Synthesis (LSYN): The system synthesizes a "pseudo-healthy" FLAIR image from a subject's T1-weighted (T1-w) image. This is achieved using voxel-wise kernel regression to learn the expected relationship between T1-w and FLAIR intensities in healthy tissue. By subtracting this synthesized image from the actual FLAIR image, a difference map is generated, highlighting areas where the real FLAIR intensity deviates from the expected healthy intensity.
  2. Gaussian Mixture Model (LFLAIR): A Gaussian mixture model (GMM) is trained on healthy FLAIR images to capture the expected intensity distributions within different brain regions. This model then provides a likelihood of a voxel's intensity being abnormal based on its expected distribution in healthy tissue.

These two likelihood maps (LSYN and LFLAIR) are then combined with a white matter hyperintensity (WMH) atlas using a one-class support vector machine (SVM). This unsupervised classifier is trained only on healthy tissue and identifies deviations from the norm. Finally, a conditional random field (CRF) is applied for post-processing to refine the segmentation and produce a binary output.

Datasets

The study utilized a heterogeneous dataset of 127 subjects with SVD. For training the synthesis and GMM models, a subset of healthy subjects was used. The paper does not introduce a new benchmark dataset but evaluates its method against established techniques using this existing dataset, which includes data acquired under three different protocols.

Key Insights and Ideas

  • Synthesizing "healthy" is key: The ability to create a "pseudo-healthy" FLAIR image from T1-w data is a powerful way to isolate abnormalities by subtraction. This bypasses the need for direct lesion segmentation in the initial stages.
  • Unsupervised learning for flexibility: Training only on healthy tissue allows the method to detect a wide range of pathologies without needing specific examples of each, making it more adaptable than supervised methods.
  • Combining complementary information: Merging the synthesis-based difference map (LSYN) with the GMM-based intensity likelihood (LFLAIR) provides a more robust detection mechanism, compensating for potential artifacts or limitations of each individual approach.
  • Outlier detection for abnormality: Framing lesion segmentation as an outlier detection problem is a natural fit for identifying deviations from expected healthy tissue patterns.

Key Results

The proposed method demonstrated significantly superior performance compared to three established methods (LGA, LPA, and LesionTOADS) across various metrics, including Dice Similarity Coefficient (DSC), Average Symmetric Surface Distance (ASSD), and Intra-Class Correlation (ICC).

  • Overall Performance: The proposed method achieved a DSC of 0.703, outperforming LPA (0.683), LesionTOADS (0.497), and LGA (0.473) on the whole dataset. It also showed better ASSD and ICC.
  • Detection of Small Lesions: The method excelled in detecting smaller lesions, achieving higher DSC values for lesions < 0.01 ml and 0.01-0.1 ml compared to other methods.
  • Cortical Infarcts: The paper highlights the method's ability to detect cortical infarcts, which are often missed by methods restricted to white matter segmentation.
  • Clinical Validation: The segmentation results showed strong associations with clinical variables like deep atrophy and perivascular spaces, similar to reference segmentations, indicating clinical relevance.

Limitations and Future Work

  • Requirement for T1-w and FLAIR: A limitation is the need for both T1-w and FLAIR images. Changes in T1-w acquisition protocols could potentially impact performance.
  • Future Work: The authors suggest extending the framework to detect other SVD hallmarks like lacunar cavities, microbleeds, and enlarged perivascular spaces. They also aim to improve robustness to different acquisition protocols, potentially through sequence normalization or modifications to the regression model.

Summary updated

Abstract

Cerebral small vessel disease (SVD) can manifest in a number of ways. Many of these result in hyperintense regions visible on <i>T</i><sub>2</sub>-weighted magnetic resonance (MR) images. The automatic segmentation of these lesions has been the focus of many studies. However, previous methods tended to be limited to certain types of pathology, as a consequence of either restricting the search to the white matter, or by training on an individual pathology. Here we present an unsupervised abnormality detection method which is able to detect abnormally hyperintense regions on FLAIR regardless of the underlying pathology or location. The method uses a combination of image synthesis, Gaussian mixture models and one class support vector machines, and needs only be trained on healthy tissue. We evaluate our method by comparing segmentation results from 127 subjects with SVD with three established methods and report significantly superior performance across a number of metrics.
BibTeX
@inproceedings{bowles2017brain,
  author = {Christopher Bowles and Chen Qin and Ricardo Guerrero and Roger N. Gunn and Alexander Hammers and David Alexander Dickie and María Valdés Hernández and Joanna M. Wardlaw and Daniel Rueckert},
  title = {{Brain lesion segmentation through image synthesis and outlier detection}},
  booktitle = {NeuroImage},
  year = {2017},
  doi = {10.1016/j.nicl.2017.09.003},
}
Figure