Patch2Self denoising of Diffusion MRI with Self-Supervision and Matrix Sketching

Shreyas Fadnavis, Agniva Chowdhury, Joshua Batson, Petros Drineas, Eleftherios GaryfallidisbioRxiv 2022 · DOI

TL;DR

This paper introduces Patch2Self (P2S), a novel self-supervised learning method for denoising Diffusion MRI (dMRI) data, which learns to predict a clean volume from its noisy counterparts without requiring explicit noise models. To address P2S's computational demands, they propose P2S-sketch, which leverages matrix sketching to significantly speed up training and reduce memory usage while maintaining denoising quality.

What Problem Does This Paper Address?

Diffusion-weighted magnetic resonance imaging (dMRI) is crucial for understanding the brain's white matter structure. However, dMRI data is notoriously noisy, which can corrupt microstructure analysis and hinder the reconstruction of neural pathways. Existing denoising methods often rely on specific noise models or can be computationally intensive. The authors aim to develop a more robust and efficient denoising technique that can improve downstream analyses like microstructure modeling and tractography.

Methods

The core of the paper is Patch2Self (P2S), a self-supervised learning approach. P2S treats dMRI denoising as an "in-painting" problem. It learns a linear mapping by using the p-neighborhoods of voxels from all but one 3D volume (held-out for prediction) to predict the central voxel of the held-out volume. This leverages the statistical independence of noise across different gradient directions.

To overcome the computational burden of P2S (which uses all voxels and volumes), the authors introduce P2S-sketch. This method employs matrix sketching, a technique from randomized linear algebra, to create a smaller "coreset" of the data. By performing the self-supervised denoising on this sketched matrix, P2S-sketch achieves significant speedups and reduced memory requirements. They explore various sketching strategies, including leverage score sampling, and demonstrate that leverage scores can also provide interpretability by highlighting influential data regions.

Datasets

The authors evaluated their methods on several real-world dMRI datasets:

  • PPMI (Parkinson's Progression Markers Initiative): A single-shell dataset with 65 gradient directions.
  • Stanford HARDI: A dataset with high angular resolution diffusion imaging (160 gradient directions).
  • Sherbrooke 3-Shell: A multi-shell dataset with 193 gradient directions.
  • HCP 7T: A high-field dMRI dataset.
  • Porcine Cardiac Data: Used to demonstrate robustness to physiological noise.

They also used simulated data with varying Signal-to-Noise Ratios (SNRs) to quantitatively assess performance.

Key Insights and Ideas

  • Self-supervision for dMRI denoising: The paper demonstrates that a self-supervised approach, without explicit noise models, can effectively denoise dMRI data. This is a significant departure from traditional methods.
  • Matrix sketching for efficiency: P2S-sketch shows that by intelligently subsampling the data using matrix sketching, the computational cost of self-supervised denoising can be drastically reduced without sacrificing accuracy. This makes advanced denoising techniques more practical.
  • Leverage scores for interpretability: The use of statistical leverage scores to understand which voxels or regions are most influential in the denoising process is a novel contribution. This moves beyond treating denoising as a black box and offers insights into the data's structure and noise characteristics.
  • Handling signal voids: P2S-sketch can effectively "in-paint" signal voids in dMRI data, a common artifact, by learning from the surrounding context.

Key Results

  • Denoising Quality: P2S and P2S-sketch achieve state-of-the-art denoising performance, outperforming the Marchenko-Pastur method in terms of visual conspicuity and downstream modeling tasks.
  • Speedup and Memory Reduction: P2S-sketch offers significant speedups (e.g., training on a small fraction of data) and reduced memory usage compared to P2S, making it more scalable.
  • Downstream Task Improvement: Denoising with P2S and P2S-sketch leads to improved microstructure modeling (e.g., higher R² values in DTI and CSD fitting) and more coherent tractography results (fewer spurious streamlines).
  • Robustness: The methods demonstrate robustness to various noise types and artifacts, including physiological noise and ghosting.

Limitations and Future Work

  • Sketch Size Hyperparameter: P2S-sketch introduces a new hyperparameter: the sketch size. The paper proposes a method for calibrating this size using QR decomposition and self-supervised loss, but it remains an area for further optimization.
  • Computational Cost of Sketching: While P2S-sketch is faster than P2S, the sketching process itself still adds computational overhead, though it's significantly less than the full P2S computation.
  • Future Work: The authors plan to release their implementation as part of the DIPY library and a separate matrix sketching package. They also suggest further exploration of different sketching strategies and their impact on interpretability.

Summary updated

Abstract

Abstract Diffusion-weighted magnetic resonance imaging (DWI) is the only noninvasive method for quantifying microstructure and reconstructing white-matter pathways in the living human brain. Fluctuations from multiple sources create significant additive noise in DWI data which must be suppressed before subsequent microstructure analysis. We introduce a self-supervised learning method for denoising DWI data, Patch2Self (P2S), which uses the entire volume to learn a full-rank locally linear denoiser for that volume. By taking advantage of the oversampled q -space of DWI data, P2S can separate structure from noise without requiring an explicit model for either. The setup of P2S however can be resource intensive, both in terms of running time and memory usage, as it uses all voxels ( n ) from all-but-one held-in volumes ( d − 1) to learn a linear mapping Φ : ℝ n ×( d −1) ↦ ℝ n for denoising the held-out volume. We exploit the redundancy imposed by P2S to alleviate its performance issues and inspect regions that influence the noise disproportionately. Specifically we introduce P2S-sketch, which makes a two-fold contribution: (1) P2S-sketch uses matrix sketching to perform self-supervised denoising. By solving a sub-problem on a smaller sub-space, so called, coreset , we show how P2S can yield a significant speedup in training time while using less memory. (2) We show how the so-called statistical leverage scores can be used to interpret the denoising of dMRI data, a process that was traditionally treated as a black-box. Our experiments conducted on simulated and real data clearly demonstrate that P2S via matrix sketching (P2S-sketch) does not lead to any loss in denoising quality, while yielding significant speedup and improved memory usage by training on a smaller fraction of the data. With thorough comparisons on real and simulated data, we show that Patch2Self outperforms the current state-of-the-art methods for DWI denoising both in terms of visual conspicuity and downstream modeling tasks. We demonstrate the effectiveness of our approach via multiple quantitative metrics such as fiber bundle coherence, R 2 via cross-validation on model fitting, mean absolute error of DTI residuals across a cohort of sixty subjects.
BibTeX
@misc{fadnavis2022patch,
  author = {Shreyas Fadnavis and Agniva Chowdhury and Joshua Batson and Petros Drineas and Eleftherios Garyfallidis},
  title = {{Patch2Self denoising of Diffusion MRI with Self-Supervision and Matrix Sketching}},
  year = {2022},
  doi = {10.1101/2022.03.15.484539},
  howpublished = {bioRxiv},
}
Figure