STAR NRE: Solving supernova selection effects with set-based truncated auto-regressive neural ratio estimation

Konstantin Karchev, Roberto Trotta

This paper presents STAR NRE, a new machine-learning framework designed to handle one of the biggest headaches in modern astronomy: selection bias. As we move into the era of "Big Data" cosmology with surveys like the Vera C. Rubin Observatory’s LSST, we need tools that can process hundreds of thousands of supernovae without "baking in" the answers we expect to find.

TL;DR

STAR NRE uses simulation-based inference and "Deep Set" neural networks to perform unbiased cosmological parameter estimation from massive supernova datasets. It successfully accounts for complex selection effects (like only seeing the brightest objects) without the systematic biases or scaling issues that plague traditional methods.

What Problem Does This Paper Address?

In supernova cosmology, we use Type Ia supernovae (SN Ia) as "standard candles" to measure the expansion of the universe. However, our telescopes aren't perfect. We suffer from Malmquist bias (we tend to detect only the brightest objects, especially at great distances) and Eddington bias (uncertainties in distance or redshift can make common objects look like rare ones).

Currently, astronomers use two main approaches:

  1. Bias Correction: This involves shifting the data to match a "fiducial" (guessed) model. The problem? It often "imprints" that guess onto the final result, leading to circular reasoning.
  2. Bayesian Hierarchical Models (BHM): These are mathematically rigorous but scale terribly. Trying to run a BHM on 100,000 supernovae is computationally exhausting and requires an explicit, often oversimplified, formula for the "selection function."

Methods

The authors propose STAR NRE (Set-based Truncated Auto-regressive Neural Ratio Estimation). It belongs to a family of techniques called Simulation-Based Inference (SBI). Instead of writing down a complex likelihood equation, you build a high-fidelity simulator of the universe and the telescope, then train a neural network to "invert" the simulator.

Key technical innovations include:

  • Conditioned Deep Sets: Standard neural networks expect fixed-size inputs. Supernova catalogs are "sets"—unordered collections of variable size. STAR NRE uses a Deep Set architecture where the "featurizer" (the part that looks at individual supernovae) is conditioned on the cosmological parameters, making the learning process much more efficient.
  • Auto-regressive Inference: To handle high-dimensional problems (7+ parameters), the network breaks the task into a chain of simpler, low-dimensional estimations.
  • Subsampling-based Truncation: To scale to 100,000+ objects, the authors train the model on small random subsets first. They use a "fuzzy" posterior (a mixture of results from different subsets) to safely narrow down the parameter space before fine-tuning on the full dataset.

Datasets

The study uses mock datasets designed to mimic the expected sensitivity of the LSST (Legacy Survey of Space and Time).

  • Size: Approximately 100,000 mock Type Ia supernovae.
  • Features: Standardized brightness, redshifts with realistic Gaussian uncertainties, and a volumetric rate model (how many SNe occur at different points in cosmic history).
  • Comparison: The authors compare STAR NRE against traditional $\chi^2$ fits and "perfect" (but computationally unfeasible) Bayesian models.

Key Insights and Ideas

  • The "Likelihood Cancellation" Trap: The authors demonstrate that if you try to estimate the "data likelihood" and the "selection correction" separately, they nearly cancel each other out. This makes "piecewise" machine learning very dangerous; you need an end-to-end approach like STAR NRE to stay accurate.
  • Cardinality is Information: The number of supernovae detected isn't just a nuisance; it contains valuable information about the expansion of the universe and the rate of star formation. STAR NRE naturally incorporates this "count" information.
  • Breaking the Fiducial Tie: Unlike traditional bias corrections, STAR NRE doesn't get "stuck" near the initial guess. It can recover the true cosmology even if the starting assumptions are significantly off.

Key Results

  • Unbiased Recovery: STAR NRE successfully recovered 7 parameters (including dark matter density $\Omega_{m0}$, the dark energy equation of state $w_0$, and supernova rate parameters) from a set of 100,000 SNe without bias.
  • Precision: The constraints produced were comparable to a full Bayesian Hierarchical Model but achieved in a fraction of the time and with far more flexibility regarding the selection criteria.
  • Robustness: The model proved that traditional linear bias corrections fail when the "true" universe deviates from the "fiducial" model, whereas STAR NRE remained accurate.

Limitations and Future Work

  • Simplified Physics: This paper uses a "toy" model where supernovae are represented by peak brightness and redshift. Real data consists of "light curves" (brightness over time in multiple colors).
  • Integration: The next step is to plug STAR NRE into more complex simulators (like the authors' own slicsim) that generate raw pixel-level or light-curve data.
  • Contamination: Future versions will need to handle "non-Ia" supernovae (other types of stellar explosions that look similar but behave differently) by incorporating classification steps directly into the neural pipeline.

Summary updated

Abstract

Accounting for selection effects in supernova type Ia (SN Ia) cosmology is crucial for unbiased cosmological parameter inference -- even more so for the next generation of large, mostly photometric-only surveys. The conventional "bias correction" procedure has a built-in systematic bias towards the fiducial model used to derive it and fails to account for the additional Eddington bias that arises in the presence of significant redshift uncertainty. On the other hand, likelihood-based analyses within a Bayesian hierarchical model, e.g. using MCMC, scale poorly with the data set size and require explicit assumptions for the selection function that may be inaccurate or contrived. To address these limitations, we introduce STAR NRE, a simulation-based approach that makes use of a conditioned deep set neural network and combines efficient high-dimensional global inference with subsampling-based truncation in order to scale to very large survey sizes while training on sets with varying cardinality. Applying it to a simplified SN Ia model consisting of standardised brightnesses and redshifts with Gaussian uncertainties and a selection procedure based on the expected LSST sensitivity, we demonstrate precise and unbiased inference of cosmological parameters and the redshift evolution of the volumetric SN Ia rate from ~100 000 mock SNae Ia. Our inference procedure can incorporate arbitrarily complex selection criteria, including transient classification, in the forward simulator and be applied to complex data like light curves. We outline these and other steps aimed at integrating STAR NRE into an end-to-end simulation-based pipeline for the analysis of future photometric-only SN Ia data.
BibTeX
@article{karchev2025star,
  author = {Konstantin Karchev and Roberto Trotta},
  title = {{STAR NRE: Solving supernova selection effects with set-based truncated auto-regressive neural ratio estimation}},
  journal = {Journal of Cosmology and Astroparticle Physics},
  year = {2025},
  doi = {10.1088/1475-7516/2025/07/031},
}
Figure