Dynamical dark energy in light of the latest observations

Gong‐Bo Zhao, Marco Raveri, Levon Pogosian, Yuting Wang, Robert Crittenden, Will Handley, Will J. Percival, Florian Beutler, J. Brinkmann, Chia-Hsun Chuang, Antonio J. Cuesta, Daniel J. Eisenstein, Francisco-Shu Kitaura, K. Koyama, Benjamin L’Huillier, Robert C. Nichol, Matthew M. Pieri, Sergio Rodríguez-Torres, Ashley J. Ross, Graziano Rossi, Ariel G. Sánchez, Arman Shafieloo, Jeremy L. Tinker, Rita Tojeiro, J. Alberto Vázquez, Hanyu Zhang

Introduction

For decades, the $\Lambda$CDM model—comprising a cosmological constant ($\Lambda$) and Cold Dark Matter—has served as the bedrock of modern cosmology. By assuming that dark energy is a constant energy density ($w = -1$), $\Lambda$CDM has successfully explained a vast array of observations. However, as the precision of cosmological measurements has increased, significant "tensions" have emerged between different datasets, most notably the discrepancy between local measurements of the Hubble constant ($H_0$) and those inferred from the Cosmic Microwave Background (CMB).

This paper investigates whether these tensions are mere statistical fluctuations or indicators that the standard model is incomplete. By moving beyond the assumption of a constant $\Lambda$ and reconstructing the dark energy equation of state ($w$) as a dynamical variable that evolves over time, the authors find compelling evidence for new physics.

The Tensions in Standard Cosmology

The primary motivation for this study is the growing discordance in the "Standard Model." Two specific discrepancies stand out:

  1. The Hubble Tension: Local measurements of the universe's expansion rate ($H_0$) yield values significantly higher than those predicted by $\Lambda$CDM when calibrated against the CMB.
  2. Lyman-$\alpha$ BAO: Measurements of Baryon Acoustic Oscillations (BAO) from the Lyman-$\alpha$ forest show a mismatch in matter density compared to other probes.

If these discrepancies are physical, they suggest that the energy density of the vacuum is not constant.

Methodology: Non-Parametric Reconstruction

To test for dynamical dark energy without being biased by a specific functional form, the authors employ a non-parametric reconstruction of $w(z)$. They divide the history of the universe into 30 redshift bins and allow $w$ to vary in each. To prevent the model from simply "overfitting" noise, they use a correlated prior method that penalizes excessive oscillations, ensuring a physically plausible, smooth evolution.

The statistical significance of the results is evaluated using:

  • Kullback-Leibler (KL) Divergence: A metric used to quantify the "surprise" or tension between datasets within a given model.
  • Principal Component Analysis (PCA): This revealed that despite having 30 bins, the current data effectively constrains approximately four independent degrees of freedom for $w(z)$.
  • PolyChord: A nested sampling algorithm used to explore the high-dimensional parameter space efficiently.

Data and Observations

The study utilizes a comprehensive compilation of data known as ALL16. This includes:

  • CMB: Temperature and polarization spectra from the Planck 2015 mission.
  • Supernovae: The Joint Light-curve Analysis (JLA) sample.
  • BAO: Data from 6dFGS, SDSS MGS, and BOSS DR12.
  • Lyman-$\alpha$ Forest: High-redshift BAO data from BOSS DR11.
  • Local $H_0$: The 2016 Riess et al. measurement.
  • Supporting Data: Cosmic chronometers (OHD), galaxy power spectra (WiggleZ), and weak lensing (CFHTLenS).

Key Findings: The $3.5\sigma$ Hint

The reconstruction yields a dark energy equation of state that evolves significantly over cosmic time. A particularly striking result is the "crossing" phenomenon: the reconstructed $w(z)$ crosses the $w = -1$ boundary, often referred to as the "phantom divide." This behavior is impossible for simple single-scalar-field models (quintessence) and points toward more complex physics, such as multiple fields or modifications to General Relativity.

Quantitatively, the dynamical model provides a much better fit to the data than $\Lambda$CDM, with an improvement of $\Delta \chi^2 = -12.3$. This corresponds to a statistical preference for dynamical dark energy at the $3.5\sigma$ level.

Resolving the Hubble Tension

One of the most significant achievements of the dynamical model is its ability to reconcile disparate datasets. Under the $\Lambda$CDM framework, the tension between the CMB and local $H_0$ measurements is a stark $4.4\sigma$. When the dark energy equation of state is allowed to evolve, this tension effectively vanishes, dropping to a negligible $0.7\sigma$. This suggests that the "Hubble tension" may be a direct consequence of forcing a dynamical universe into the rigid box of a cosmological constant.

Conclusion and Future Prospects

While the fit improvement is substantial, the authors note a caveat: the Bayesian evidence does not yet decisively favor the dynamical model. Because Bayesian statistics penalize models for added complexity (the extra degrees of freedom in $w(z)$), $\Lambda$CDM remains a competitive, albeit strained, description of the data.

However, the trajectory is clear. The preference for dynamical dark energy grew from $2.5\sigma$ in 2012 to $3.5\sigma$ in 2016. The authors forecast that if this dynamical model represents reality, the upcoming Dark Energy Spectroscopic Instrument (DESI) survey will be able to confirm it with "decisive" Bayesian evidence. For now, we stand at a threshold: we are either seeing the first hints of a revolution in our understanding of the vacuum or a statistical fluctuation that will be clarified by the next generation of surveys.

Summary updated

Abstract

A flat Friedman-Roberson-Walker universe dominated by a cosmological constant ($\Lambda$) and cold dark matter (CDM) has been the working model preferred by cosmologists since the discovery of cosmic acceleration. However, tensions of various degrees of significance are known to be present among existing datasets within the $\Lambda$CDM framework. In particular, the Lyman-$\alpha$ forest measurement of the Baryon Acoustic Oscillations (BAO) by the Baryon Oscillation Spectroscopic Survey (BOSS) prefers a smaller value of the matter density fraction $\Omega_{\rm M}$ compared to the value preferred by cosmic microwave background (CMB). Also, the recently measured value of the Hubble constant, $H_0=73.24\pm1.74 {\rm km} {\rm s}^{-1} {\rm Mpc}^{-1}$, is $3.4\sigma$ higher than $66.93\pm0.62 {\rm km} {\rm s}^{-1} {\rm Mpc}^{-1}$ inferred from the Planck CMB data. In this work, we investigate if these tensions can be interpreted as evidence for a non-constant dynamical dark energy (DE). Using the Kullback-Leibler (KL) divergence to quantify the tension between datasets, we find that the tensions are relieved by an evolving DE, with the dynamical DE model preferred at a $3.5\sigma$ significance level based on the improvement in the fit alone. While, at present, the Bayesian evidence for the dynamical DE is insufficient to favour it over $\Lambda$CDM, we show that, if the current best fit DE happened to be the true model, it would be decisively detected by the upcoming DESI survey.
BibTeX
@inproceedings{zhao2017dynamical,
  author = {Gong‐Bo Zhao and Marco Raveri and Levon Pogosian and Yuting Wang and Robert Crittenden and Will Handley and Will J. Percival and Florian Beutler and J. Brinkmann and Chia-Hsun Chuang and Antonio J. Cuesta and Daniel J. Eisenstein and Francisco-Shu Kitaura and K. Koyama and Benjamin L’Huillier and Robert C. Nichol and Matthew M. Pieri and Sergio Rodríguez-Torres and Ashley J. Ross and Graziano Rossi and Ariel G. Sánchez and Arman Shafieloo and Jeremy L. Tinker and Rita Tojeiro and J. Alberto Vázquez and Hanyu Zhang},
  title = {{Dynamical dark energy in light of the latest observations}},
  booktitle = {Nature Astronomy},
  year = {2017},
  doi = {10.1038/s41550-017-0216-z},
}
Figure