α-deep Probabilistic Inference (α-DPI): Efficient Uncertainty Quantification from Exoplanet Astrometry to Black Hole Feature Extraction

He Sun, Katherine L. Bouman, Paul Tiede, Jason Wang, Sarah Blunt, Dimitri Mawet

TL;DR

$\alpha$-deep Probabilistic Inference ($\alpha$-DPI) is a new deep learning framework that combines the speed of variational inference with the accuracy of importance sampling to map complex uncertainties in astronomical data. By using $\alpha$-divergence and normalizing flows, it can characterize multi-modal posterior distributions—such as the possible orbits of an exoplanet—up to 15x faster than traditional MCMC methods without sacrificing precision.

What Problem Does This Paper Address?

In astronomy, we rarely observe physical properties directly. Instead, we get "inverse problems": we have noisy, sparse data (like dots on an image or radio interference patterns) and must infer the underlying cause (like a planet's orbit or a black hole’s shape).

The gold standard for solving this is Bayesian Inference, which provides a "posterior"—a map of all possible solutions and their likelihoods. Traditionally, researchers use Markov Chain Monte Carlo (MCMC) sampling. While accurate, MCMC is notoriously slow and struggles with high-dimensional data. Alternatively, Variational Inference (VI) is fast because it treats inference as an optimization problem, but it often suffers from "mode collapse," where the algorithm ignores valid alternative solutions and focuses only on the most obvious one.

The authors aim to bridge this gap: creating a method that is as fast as VI but as robust and accurate as MCMC, specifically for high-stakes astronomical discoveries.

Methods

The authors propose a two-step framework called $\alpha$-DPI:

  1. Variational Inference with Normalizing Flows: Instead of using simple Gaussian distributions, the team uses Normalizing Flows (specifically Real-NVP). These are invertible neural networks that can transform a simple distribution into a highly complex, multi-modal one.
  2. $\alpha$-Divergence Loss: Standard VI uses KL-divergence, which is "zero-forcing"—it heavily penalizes the model if it places any probability where the true likelihood is low, leading to mode collapse. By using $\alpha$-divergence, the researchers can tune the "exploration vs. exploitation" trade-off. This allows the network to "bridge" disconnected modes during training, ensuring no valid physical solutions are missed.
  3. Importance Reweighting: After the network learns the approximate posterior, a final "cleaning" step uses importance sampling to reweight the samples. This corrects for any small inaccuracies in the neural network's approximation.

Datasets

The method was validated on two high-impact real-world problems:

  • Exoplanet Astrometry: Using data from the Gemini Planet Imager (GPI) to fit the 8-parameter Keplerian orbit of the planet $\beta$ Pictoris b.
  • Black Hole Feature Extraction: Using both simulated and real data from the Event Horizon Telescope (EHT) 2017 observations of the black hole M87*. This involved fitting geometric models (crescents and ellipses) to radio interferometry data.

Key Insights and Ideas

  • Taming Mode Collapse: The "aha moment" is the use of $\alpha$-divergence. While standard deep imaging (KL-DPI) completely missed minor orbital configurations for $\beta$ Pic b, $\alpha$-DPI captured all of them by being more "tolerant" during the optimization phase.
  • The Power of Invertibility: Because Normalizing Flows are bijective (invertible), they can calculate exact probability densities. This makes them far more efficient for importance sampling than standard Variational Autoencoders (VAEs).
  • Model Selection via ELBO: The framework naturally produces an Evidence Lower Bound (ELBO). The authors showed that ELBO can be used as a reliable metric for model selection—for instance, determining exactly how many Gaussian components are needed to describe the environment around a black hole without over-fitting.

Key Results

  • Speedup: For exoplanet orbit fitting, $\alpha$-DPI achieved results nearly identical to MCMC in just 1.5 hours on a single GPU, compared to over 24 hours for the MCMC baseline.
  • Scalability: The authors tested the method on models ranging from 6 to 1024 dimensions. While traditional nested sampling times grew exponentially with complexity, $\alpha$-DPI’s computational time remained relatively flat, demonstrating its readiness for high-resolution imaging.
  • M87* Accuracy: When applied to the famous M87* black hole data, $\alpha$-DPI correctly identified the "crescent + 2 ellipses" model as the best fit, matching results from the original EHT collaboration papers but with a more automated, efficient pipeline.

Limitations and Future Work

  • Disconnected Modes: Normalizing flows are continuous functions. If the true posterior has completely isolated "islands" of probability with zero-probability seas between them, the flow must still create a thin "bridge" to connect them, which can introduce some low-likelihood samples that must be filtered out.
  • Hyperparameter Sensitivity: The choice of the $\alpha$ value (e.g., 0.5 vs 0.9) affects performance. While the paper provides heuristics, finding the "perfect" $\alpha$ for a brand-new problem may require some trial and error.
  • Future Directions: The authors suggest applying $\alpha$-DPI to "movies" of black holes (time-resolved imaging) and next-generation EHT data, where the dimensionality will be too high for any current sampling-based methods to handle.

Summary updated

Abstract

Abstract Inference is crucial in modern astronomical research, where hidden astrophysical features and patterns are often estimated from indirect and noisy measurements. Inferring the posterior of hidden features, conditioned on the observed measurements, is essential for understanding the uncertainty of results and downstream scientific interpretations. Traditional approaches for posterior estimation include sampling-based methods and variational inference (VI). However, sampling-based methods are typically slow for high-dimensional inverse problems, while VI often lacks estimation accuracy. In this paper, we propose α -deep probabilistic inference, a deep learning framework that first learns an approximate posterior using α -divergence VI paired with a generative neural network, and then produces more accurate posterior samples through importance reweighting of the network samples. It inherits strengths from both sampling and VI methods: it is fast, accurate, and more scalable to high-dimensional problems than conventional sampling-based approaches. We apply our approach to two high-impact astronomical inference problems using real data: exoplanet astrometry and black hole feature extraction.
BibTeX
@article{sun2022deep,
  author = {He Sun and Katherine L. Bouman and Paul Tiede and Jason Wang and Sarah Blunt and Dimitri Mawet},
  title = {{α-deep Probabilistic Inference (α-DPI): Efficient Uncertainty Quantification from Exoplanet Astrometry to Black Hole Feature Extraction}},
  journal = {The Astrophysical Journal},
  year = {2022},
  doi = {10.3847/1538-4357/ac6be9},
}
Figure