A forward modeling approach to analyzing galaxy clustering with S <scp>im</scp> BIG

ChangHoon Hahn, Michael Eickenberg, Shirley Ho, Jiamin Hou, Pablo Lemos, Elena Massara, Chirag Modi, Azadeh Moradinezhad Dizgah, Bruno Régaldo-Saint Blancard, Muntazir AbidiProceedings of the National Academy of Sciences 2023 · DOI

TL;DR

This paper introduces SIMBIG, a novel framework that uses high-fidelity simulations and machine learning (specifically, simulation-based inference with normalizing flows) to analyze galaxy clustering. By leveraging information from nonlinear scales, SIMBIG achieves significantly more precise cosmological constraints, particularly on $\sigma_8$, compared to traditional methods, offering a statistical gain equivalent to a 60% larger galaxy survey.

What Problem Does This Paper Address?

Cosmological analyses heavily rely on understanding the distribution of galaxies in the Universe to constrain fundamental parameters like the amount of dark matter and dark energy. The standard approach uses the galaxy power spectrum, but this is typically limited to large, "linear" scales where the physics is well-understood by analytic models (like perturbation theory). These models struggle to accurately describe smaller, "nonlinear" scales where structure formation is more complex. Furthermore, accurately accounting for observational systematics (e.g., how galaxies are selected, instrumental effects) is a major challenge. This limits the amount of information we can extract from galaxy surveys, especially as future surveys aim to probe deeper into cosmic history and cover larger volumes.

Methods

The core of SIMBIG is a forward modeling approach combined with simulation-based inference (SBI).

  • Forward Model: Instead of relying on analytic models, SIMBIG builds a comprehensive simulation that aims to replicate the observed galaxy distribution and its associated systematics. This involves:
  • Using high-resolution N-body simulations (from the QUIJOTE suite) to model the underlying dark matter distribution, which accurately captures nonlinear structure formation.
  • Employing a Halo Occupation Distribution (HOD) model to populate dark matter halos with galaxies, connecting the dark matter to the observable galaxy population. This HOD model is sophisticated, including assembly, concentration, and velocity biases.
  • Crucially, incorporating detailed survey realism. This means simulating observational effects like survey geometry, fiber collisions (where two galaxies are too close to be observed by separate fibers), and other selection effects.
  • Simulation-Based Inference (SBI): To infer cosmological parameters from the simulated data, SIMBIG uses SBI, a "likelihood-free" inference technique.
  • It trains normalizing flows, a type of neural network capable of learning complex probability distributions, to approximate the posterior distribution of cosmological parameters.
  • The training data consists of pairs of simulated cosmological parameters and the corresponding summary statistics (in this paper, the galaxy power spectrum, $P(k)$) generated by the forward model.
  • This approach bypasses the need for an analytic likelihood function, which is often difficult to define accurately for nonlinear scales.

Datasets

  • Training Data: 20,000 simulated galaxy catalogs generated by the SIMBIG forward model. These simulations are based on 2,000 high-resolution QUIJOTE N-body simulations, each run with 10 different sets of HOD parameters.
  • Observational Data: The Baryon Oscillation Spectroscopic Survey (BOSS) CMASS galaxy sample (specifically, the Southern Galactic Cap region) is used for comparison and to infer cosmological constraints.

Key Insights and Ideas

  • Nonlinear Scales are Rich in Information: The paper strongly demonstrates that by extending analyses to nonlinear scales (up to $k_{max} = 0.5 \, h/\text{Mpc}$), significantly more cosmological information can be extracted than from linear scales alone.
  • Forward Modeling is Key to Exploiting Nonlinearity: Traditional analytic methods fail on nonlinear scales. SIMBIG's strength lies in its ability to accurately model these complex regimes through high-fidelity simulations that include observational systematics.
  • SBI as a Powerful Inference Tool: SBI, particularly with normalizing flows, provides a robust and flexible framework for performing Bayesian inference when analytic likelihoods are intractable, making it ideal for complex simulation-based analyses.
  • Systematics Modeling is Crucial: The inclusion of detailed survey realism in the forward model is highlighted as essential for accurate and reliable cosmological constraints, preventing biases that could arise from observational imperfections.

Key Results

  • Improved $\sigma_8$ Constraints: SIMBIG achieves a $\sigma_8$ constraint that is 27% more precise than standard power spectrum analyses limited to linear scales ($k_{max} = 0.25 \, h/\text{Mpc}$).
  • Equivalent to Larger Survey: This improvement in precision is equivalent to the statistical gain expected from analyzing a galaxy survey approximately 60% larger than the BOSS CMASS sample using traditional methods.
  • Consistent Cosmological Parameters: The inferred cosmological parameters ($\Omega_m$, $\sigma_8$) are consistent with previous studies, validating the SIMBIG framework. Specifically, they derive $\Omega_m = 0.292 \pm 0.055$ and $\sigma_8 = 0.812^{+0.067}_{-0.068}$.
  • Validation Against Other Methods: When SIMBIG is applied to $k_{max} = 0.25 \, h/\text{Mpc}$ (matching the scale limits of other methods), its results are in excellent agreement with previous studies using halo occupation models, further validating the approach.

Limitations and Future Work

  • Conservatism of Posteriors: The paper notes that the posteriors are "conservative" (broader than ideal) due to a limited number of N-body simulations used to construct the training dataset. This limits the precision of the $\Omega_m$ constraint.
  • Future Work:
    • More Simulations: The authors suggest that increasing the number of N-body simulations used for training would significantly improve the precision of the cosmological constraints, particularly for $\Omega_m$.
  • Higher-Order Statistics: SIMBIG is designed to handle any summary statistic. The authors plan to extend their analysis to higher-order statistics (like the bispectrum) and non-standard observables to extract even more cosmological information.
  • Field-Level Analysis: Future work will explore field-level summary statistics using convolutional and graph neural networks.
  • Next-Generation Surveys: SIMBIG is well-suited for upcoming large spectroscopic surveys like DESI, PFS, Euclid, and Roman, promising even tighter constraints and more stringent tests of the standard cosmological model.

Summary updated

Abstract

We present cosmological constraints from a simulation-based inference (SBI) analysis of galaxy clustering from the SimBIG forward modeling framework. SimBIG leverages the predictive power of high-fidelity simulations and provides an inference framework that can extract cosmological information on small nonlinear scales. In this work, we apply SimBIG to the Baryon Oscillation Spectroscopic Survey (BOSS) CMASS galaxy sample and analyze the power spectrum, [Formula: see text], to [Formula: see text]. We construct 20,000 simulated galaxy samples using our forward model, which is based on 2,000 high-resolution Quijote[Formula: see text]-body simulations and includes detailed survey realism for a more complete treatment of observational systematics. We then conduct SBI by training normalizing flows using the simulated samples and infer the posterior distribution of [Formula: see text]CDM cosmological parameters: [Formula: see text]. We derive significant constraints on [Formula: see text] and [Formula: see text], which are consistent with previous works. Our constraint on [Formula: see text] is 27% more precise than standard [Formula: see text] analyses because we exploit additional cosmological information on nonlinear scales beyond the limit of current analytic models, [Formula: see text]. This improvement is equivalent to the statistical gain expected from a standard [Formula: see text] analysis of galaxy sample [Formula: see text]60% larger than CMASS. While we focus on [Formula: see text] in this work for validation and comparison to the literature, SimBIG provides a framework for analyzing galaxy clustering using any summary statistic. We expect further improvements on cosmological constraints from subsequent SimBIG analyses of summary statistics beyond [Formula: see text].
BibTeX
@inproceedings{hahn2023forward,
  author = {ChangHoon Hahn and Michael Eickenberg and Shirley Ho and Jiamin Hou and Pablo Lemos and Elena Massara and Chirag Modi and Azadeh Moradinezhad Dizgah and Bruno Régaldo-Saint Blancard and Muntazir Abidi},
  title = {{A forward modeling approach to analyzing galaxy clustering with S <scp>im</scp> BIG}},
  booktitle = {Proceedings of the National Academy of Sciences},
  year = {2023},
  doi = {10.1073/pnas.2218810120},
}
Figure