Quantifying Statistical Significance of Neural Network-based Image Segmentation by Selective Inference

Vo Nguyen Le Duy, Shogo Iwazaki, Ichiro TakeuchiNeurIPS 2022 · OpenReview

Deep neural networks (DNNs) have revolutionized image segmentation, enabling highly accurate object detection in fields ranging from autonomous driving to medical imaging. However, while a DNN can effectively highlight where an object is, it rarely tells us if that detection is statistically reliable.

This paper introduces a novel framework to calculate exact, valid p-values for image segmentation results produced by DNNs. By leveraging a "homotopy-based" selective inference method, the authors provide a robust mathematical way to distinguish between true biological or physical features and random noise.

The Challenge: Selection Bias and "Double Dipping"

In high-stakes fields like clinical diagnostics, knowing a model's statistical confidence is just as important as the prediction itself. The core challenge in validating DNN outputs is selection bias, often referred to as "double dipping."

In traditional statistics, a hypothesis is defined before observing the data. In deep learning, however, the network looks at the data first and then generates a hypothesis (e.g., "I found a tumor here"). If you then use that exact same data to test whether the detected tumor is statistically significant, your p-values will be heavily biased toward zero.

Even on an image consisting entirely of random noise, a DNN might "find" a shape. A naive statistical test would confidently, and incorrectly, declare it a significant discovery.

Comparison of naive and selective p-values on a noisy image

This paper aims to provide a "valid" p-value that explicitly accounts for the fact that the network chose that specific region based on the data itself.

Methods: Conditional Selective Inference

To solve the double-dipping problem, the authors utilize Conditional Selective Inference (SI). The "conditional" aspect is crucial: the method calculates the probability of the observed result given that the network's internal logic would have led to the exact same segmentation.

The Innovation: The Homotopy Method

Previous SI methods worked well for simple algorithms, like basic thresholding, where the "selection event" could be described as a simple geometric shape. DNNs, however, are far too complex for these traditional approaches. The authors overcome this with a novel homotopy-based algorithm:

  1. Piecewise-Linearity: The authors focus on DNNs built with piecewise-linear components (such as ReLU activations, max-pooling, and standard convolutions). These networks can be mathematically decomposed into a massive set of linear inequalities.
  2. Parametrized Line Search: Instead of attempting to map the entire high-dimensional space of the DNN, the researchers look at a 1D line in the data space that passes through the observed image.
  3. Homotopy Path: They use a "homotopy method" to efficiently trace this line and find every "breakpoint"—the exact points where a single neuron in the network would flip from active to inactive. This allows them to identify the precise intervals on that line where the network would produce the same segmentation result, making the math for calculating the exact p-value tractable.

Key Insights and Results

The paper reframes a segmentation mask not just as a final output, but as a data-driven hypothesis that requires formal testing. By restricting the search to a 1D "solution path," the complexity of validating this hypothesis becomes manageable. While DNNs are often considered "black boxes," those built with ReLUs are essentially collections of many linear pieces. The authors found that the number of breakpoints along their search line grows almost linearly in practice, making the algorithm surprisingly efficient.

The researchers validated their method across both synthetic and real-world datasets:

  • False Positive Control: In tests using images corrupted by Gaussian noise, the "naive" statistical method had a False Positive Rate (FPR) near 100%, consistently declaring noise as significant. The proposed selective inference method successfully maintained the FPR at the target level (e.g., 5%).
  • Higher Statistical Power: Compared to "over-conditioning" (a simpler version of SI that rigidly fixes every neuron's state), the homotopy method provided much higher statistical power, meaning it was far better at correctly identifying real features as significant.
  • Real-World Clinical Impact: The method was tested on a dataset of 1,880 brain MRI scans. On scans without tumors, the naive p-value often returned 0.00 (a false alarm). In contrast, the selective p-value returned 0.67, correctly indicating that the "detected" region was merely noise and not statistically significant.

Limitations and Future Work

While a significant step forward for interpretable deep learning, the method has current limitations. Architecturally, it specifically requires piecewise-linear functions. It does not yet natively support operations like Softmax or Batch Normalization, which are common in modern architectures, requiring piecewise-linear approximations to function.

Furthermore, applying this framework to a new, complex state-of-the-art architecture requires significant manual effort to "unwrap" the selection events for every layer. The authors note that future work should focus on creating generic software tools to automate this process. Finally, while vastly more efficient than an exhaustive search, the homotopy method still requires multiple forward passes of the network to find all breakpoints, introducing computational overhead.

Summary updated

Abstract

Although a vast body of literature relates to image segmentation methods that use deep neural networks (DNNs), less attention has been paid to assessing the statistical reliability of segmentation results. In this study, we interpret the segmentation results as hypotheses driven by DNN (called DNN-driven hypotheses) and propose a method to quantify the reliability of these hypotheses within a statistical hypothesis testing framework. To this end, we introduce a conditional selective inference (SI) framework---a new statistical inference framework for data-driven hypotheses that has recently received considerable attention---to compute exact (non-asymptotic) valid p-values for the segmentation results. To use the conditional SI framework for DNN-based segmentation, we develop a new SI algorithm based on the homotopy method, which enables us to derive the exact (non-asymptotic) sampling distribution of DNN-driven hypothesis. We conduct several experiments to demonstrate the performance of the proposed method.
BibTeX
@inproceedings{duy2022quantifying,
  author = {Vo Nguyen Le Duy and Shogo Iwazaki and Ichiro Takeuchi},
  title = {{Quantifying Statistical Significance of Neural Network-based Image Segmentation by Selective Inference}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2022},
  url = {https://openreview.net/forum?id=4NOsC2wjP},
}
Figure