Automatic Estimation of Flux Distributions of Astrophysical Source Populations

Raymond K. W. Wong2013

TL;DR

This paper introduces a novel statistical framework for automatically estimating the flux distribution of astrophysical source populations, specifically by identifying "breakpoints" in their log N-log S relationship. Their method uses an "Interwoven EM Algorithm" to accurately estimate both the number and location of these breakpoints, overcoming limitations of previous approaches.

What Problem Does This Paper Address?

Astrophysicists often study the distribution of celestial sources (like X-ray pulsars or supernovae) by looking at how the number of detectable sources (N) changes with their flux (S). This relationship, known as the log N-log S curve, is typically expected to be a straight line (a power law) under simple theoretical models. However, real-world data often shows deviations from this linearity, suggesting more complex underlying source populations. To account for this, astrophysicists have resorted to using piecewise linear models (broken power laws) with pre-defined breakpoints. The challenge has been that there's no statistically rigorous and automated way to determine how many breakpoints there are and where they occur, making it difficult to reliably compare theoretical models with observational data.

Methods

The core of the paper's contribution is a new statistical methodology that tackles the problem of estimating the number and location of breakpoints in the log N-log S relationship.

  • Interwoven EM Algorithm (IEM): This is the central novel algorithm. It's an extension of the Expectation-Maximization (EM) algorithm, designed to handle the complex parameter space involved in estimating multiple breakpoints. IEM combines the strengths of two other EM variants (SAEM and AAEM) to achieve more efficient and stable parameter estimation for a fixed number of breakpoints.
  • Model Selection for Number of Breakpoints: To determine the optimal number of breakpoints (B), the paper employs a model selection procedure. This involves using the "power posterior" technique to accurately approximate the log-likelihood of candidate models, allowing for a principled comparison between models with different numbers of breakpoints.
  • Hierarchical Modeling: The authors frame the problem using a hierarchical model. Observed photon counts (Y) are modeled as a Poisson distribution dependent on the true flux (S), which itself follows a broken Pareto distribution (representing the piecewise linear log N-log S relationship). This allows them to account for the fact that fluxes are not directly observed but inferred from counts.

Datasets

The primary dataset used for evaluation is the Chandra Deep Field North (CDFN) X-ray survey. The authors specifically consider a subset of sources with off-axis angles less than 8 arcminutes to mitigate issues of incompleteness and confusion, aiming for a higher signal-to-noise ratio subset.

Key Insights and Ideas

  • Automated Breakpoint Detection: The most significant insight is the development of a statistically rigorous and automated method for identifying breakpoints. This moves beyond ad-hoc methods or manual selection, providing a more objective way to analyze source populations.
  • IEM's Efficiency: The Interwoven EM algorithm demonstrates superior convergence properties compared to its component algorithms (SAEM, AAEM) and the standard AEM, making it a more robust tool for this complex estimation problem.
  • Model Selection is Crucial: The paper highlights that simply fitting a model with a fixed number of breakpoints is insufficient. A principled model selection criterion (like BIC, which they find performs better than AIC) is essential for choosing the correct model order (number of breakpoints).
  • Sample Size Matters: The analysis of the CDFN data reveals that detecting subtle breakpoints is highly dependent on sample size. A sufficient number of sources are needed to reliably identify deviations from a simple power law.

Key Results

  • The proposed methodology, particularly using the IEM algorithm, is shown through simulations to be capable of accurately detecting structural breaks in various parameter configurations.
  • For the CDFN data, the analysis suggests a two-piece broken power-law model (B=2) is preferred for sources with off-axis angles less than 8 arcminutes.
  • The estimated breakpoint in the CDFN data occurs at a flux around log10(S) ≈ -15.657, with a change in slope from approximately 0.48 to 0.85.
  • Simulation studies indicate that BIC is a more reliable model selection criterion than AIC for choosing the number of breakpoints, with AIC tending to overestimate B.
  • The paper provides parameter estimates and standard errors for the CDFN data, showing relative mean squared errors generally on the order of 10⁻² to 10⁻¹.

Limitations and Future Work

  • Unknown Number of Breakpoints (B): While the paper provides a method for selecting B, the theoretical properties of the estimator for B are not fully established due to the complexity of the problem. The authors note that deriving theoretical properties for unknown B is "substantially more difficult" and "infeasible to derive theoretical properties under a set of practically relevant assumptions."
  • Computational Intensity: While IEM is efficient, the overall process, especially for accurate log-likelihood approximation using power posteriors, can still be computationally intensive.
  • Future Work: The authors mention that R code implementing their procedure is available, suggesting a path for wider adoption. Further theoretical work on the properties of the estimator for an unknown number of breakpoints would be valuable. The paper also hints at the need to consider more complex issues like incompleteness and confusion for datasets with larger off-axis angles, which were deliberately excluded in their primary analysis.

Summary updated

Abstract

In astrophysics a common goal is to infer the flux distribution of populations of scientifically interesting objects such as pulsars or supernovae. In practice, inference for the flux distribution is often conducted using the cumulative distribution of the number of sources detected at a given sensitivity. The resulting “log(N> S) − log(S) ” relationship can be used to compare and evaluate theoretical models for source populations and their evolution. Under restrictive assumptions the relationship should be linear. In practice, however, when simple theoretical models fail, it is common for astrophysicists to use pre-specified piecewise linear models. This paper proposes a methodology for estimating both the number and locations of “breakpoints” in astrophysical source populations that extends beyond existing work in this field. An important component of the proposed methodology is a new Interwoven EM Algorithm that computes parameter estimates. It is shown that in simple settings such estimates are asymptotically consistent despite the complex nature of the parameter space. Through simula-tion studies it is demonstrated that the proposed methodology is capable of accurately detecting structural breaks in a variety of parameter configurations. This paper concludes with an appli-cation of our methodology to the Chandra Deep Field North (CDFN) dataset.
BibTeX
@misc{wong2013automatic,
  author = {Raymond K. W. Wong},
  title = {{Automatic Estimation of Flux Distributions of Astrophysical Source Populations}},
  year = {2013},
}
Figure