Verification of Radiative Transfer Schemes for the EHT

Roman Gold, Avery E. Broderick, Ziri Younsi, Christian M. Fromm, Charles F. Gammie, Monika Mościbrodzka, Hung-Yi Pu, Thomas Bronzwaer, Jordy Davelaar, Jason Dexter, David Ball, Chi‐kwan Chan, Tomohisa Kawashima, Yosuke Mizuno, Bart Ripperda, Kazunori Akiyama, A. Alberdi, W. Alef, Keiichi Asada, Rebecca Azulay, Anne-Kathrin Baczko, Mislav Baloković, John Barrett, Dan Bintley, Lindy Blackburn, W. Boland, Katherine L. Bouman, Geoffrey C. Bower, Michael Bremer, Christiaan D. Brinkerink, Roger Brissenden, S. Britzen, Dominique Broguière, Do‐Young Byun, J. E. Carlstrom, Andrew Chael, Koushik Chatterjee, Shami Chatterjee, Ming‐Tang Chen, Xiaopeng Cheng, Ilje Cho, Pierre Christian, J. E. Conway, J. M. Cordes, G. Crew, Yuzhu Cui, Mariafelicia De Laurentis, Roger Deane, Jessica Dempsey, G. Desvignes, Sheperd S. Doeleman, Ralph P. Eatough, H. Falcke, Vincent L. Fish, Ed Fomalont, Raquel Fraga-Encinas, Bill Freeman, Per Friberg, José L. Gómez, Peter Galison, Roberto García, Olivier Gentaz, Boris Georgiev, C. Goddi, Minfeng Gu, Mark Gurwell, Kazuhiro Hada, M. H. Hecht, Ronald Hesper, Luis C. Ho, Paul T. P. Ho, Mareki Honma, Wu Jiang, Lei Huang, D. H. Hughes, Makoto Inoue, Sara Issaoun, D. J. James, Buell T. Jannuzi, Michaël Janssen, Britton Jeter, Abhishek V. Joshi, Alejandra Jiménez-Rosales, Michael D. Johnson, Svetlana G. Jorstad, Taehyun Jung, Mansour Karami, R. Karuppusamy, Garrett K. Keating, Mark Kettenis, Jae-Young Kim, Junhan Kim, Jongsoo Kim, Motoki Kino, Jun Yi Koay, Patrick M. Koch, Shoko Koyama, M. Krämer, C. Krämer, T. P. KrichbaumThe Astrophysical Journal 2020 · DOI

Abstract

The Event Horizon Telescope (EHT) Collaboration has recently produced the first resolved images of the central supermassive black hole in the giant elliptical galaxy M87. Here we report on tests of the consistency and accuracy of the general relativistic radiative transfer codes used within the collaboration to model M87 and Sgr A. We compare and evaluate (1) deflection angles for equatorial null geodesics in a Kerr spacetime; (2) images calculated from a series of simple, parameterized matter distributions in the Kerr metric using simplified emissivities and absorptivities; (3) for a subset of codes, images calculated from general relativistic magnetohydrodynamics simulations using different realistic synchrotron emissivities and absorptivities; (4) observables for the 2017 configuration of EHT, including visibility amplitudes and closure phases. The error in total flux is of order 1% when the codes are run with production numerical parameters. The dominant source of discrepancies for small camera distances is the location and detailed setup of the software “camera” that each code uses to produce synthetic images. We find that when numerical parameters are suitably chosen and the camera is sufficiently far away the images converge and that for given transfer coefficients, numerical uncertainties are unlikely to limit parameter estimation for the current generation of EHT observations.

Introduction: The Need for Verification

Capturing an image of a black hole is a complex task that extends beyond simple observation. The EHT collects sparse interferometric data that must be interpreted using sophisticated theoretical models. These models rely on General Relativistic Radiative Transfer (GRRT) codes—software that simulates how light travels through hot, magnetized plasma (the accretion disk) while being warped by the extreme gravity of a black hole.

To ensure the scientific integrity of the iconic images of M87 and Sgr A, the EHT Collaboration performed a comprehensive "sanity check" on the software used to simulate them. This verification process ensures that the codes are correctly solving the mathematical equations of general relativity and radiative transfer, confirming that numerical errors do not compromise our physical understanding.

Methodology: A Multi-Tiered Testing Framework

The researchers evaluated 10 international GRRT codes, including GPU-accelerated ones like GRay and ODYSSEY and CPU-based ones like BHOSS and RAPTOR. The testing suite included:

  1. Geodesic Integration: Testing how accurately codes trace the paths of light rays (null geodesics) around a spinning black hole against a high-precision Mathematica reference.
  2. Standardized Analytic Tests: Five scenarios with well-defined matter distributions varying parameters like black hole spin and plasma absorption.
  3. GRMHD Snapshots: Using complex data from General Relativistic Magnetohydrodynamics simulations to test performance in turbulent environments.
  4. Interferometric Observables: Converting synthetic images into visibility amplitudes and closure phases to match real EHT data formats.
Comparison of deflection angles and errors across various GRRT codes against an exact reference solution.

Key Results: Precision and Consistency

The study confirmed that the "digital cameras" used by the EHT are highly consistent. Key findings include:

  • Total Flux Agreement: The error in total light flux was found to be approximately 1% using standard production settings.
  • Image Consistency: Relative discrepancies in image structure were typically 0.6% or less.
  • Geodesic Precision: As shown in the deflection angle tests, the codes match exact mathematical solutions with high precision, except in extreme cases very close to the event horizon.
  • Parameter Estimation: Numerical uncertainties are unlikely to limit the ability to estimate physical parameters, such as black hole mass or spin, for current EHT observations.
Synthetic images generated by seven different GRRT codes for five standardized analytic tests, demonstrating high visual consistency.

Discussion: Identifying Sources of Error

A significant insight from the study was that most discrepancies between codes originated from the "software camera" setup—specifically, the distance of the virtual camera and the definition of its field of view. When the camera is placed sufficiently far away, the images converge.

Furthermore, the study highlighted that using "angle-averaged" formulas for synchrotron radiation can introduce biases. The collaboration recommends using full, angle-dependent emissivities for future EHT science.

Limitations and Future Work

While the current verification is robust for total intensity (unpolarized light), future work is needed to address:

  • Polarized Radiative Transfer: Cross-validating codes for the polarized images now being released by the EHT.
  • Time-Dependent Effects: Moving beyond the "fast-light" approximation to address dynamic plasma environments.
  • Alternative Gravity Theories: Testing codes against non-Kerr metrics to explore physics beyond standard General Relativity.

This work establishes a benchmark for future black hole imaging software, ensuring that our "digital eyes" on the universe remain sharp and reliable.

Summary updated

Abstract

Abstract The Event Horizon Telescope (EHT) Collaboration has recently produced the first resolved images of the central supermassive black hole in the giant elliptical galaxy M87. Here we report on tests of the consistency and accuracy of the general relativistic radiative transfer codes used within the collaboration to model M87* and Sgr A*. We compare and evaluate (1) deflection angles for equatorial null geodesics in a Kerr spacetime; (2) images calculated from a series of simple, parameterized matter distributions in the Kerr metric using simplified emissivities and absorptivities; (3) for a subset of codes, images calculated from general relativistic magnetohydrodynamics simulations using different realistic synchrotron emissivities and absorptivities; (4) observables for the 2017 configuration of EHT, including visibility amplitudes and closure phases. The error in total flux is of order 1% when the codes are run with production numerical parameters. The dominant source of discrepancies for small camera distances is the location and detailed setup of the software “camera” that each code uses to produce synthetic images. We find that when numerical parameters are suitably chosen and the camera is sufficiently far away the images converge and that for given transfer coefficients, numerical uncertainties are unlikely to limit parameter estimation for the current generation of EHT observations. The purpose of this paper is to describe a verification and comparison of EHT radiative transfer codes. It is not to verify EHT models more generally.
BibTeX
@article{gold2020verification,
  author = {Roman Gold and Avery E. Broderick and Ziri Younsi and Christian M. Fromm and Charles F. Gammie and Monika Mościbrodzka and Hung-Yi Pu and Thomas Bronzwaer and Jordy Davelaar and Jason Dexter and David Ball and Chi‐kwan Chan and Tomohisa Kawashima and Yosuke Mizuno and Bart Ripperda and Kazunori Akiyama and A. Alberdi and W. Alef and Keiichi Asada and Rebecca Azulay and Anne-Kathrin Baczko and Mislav Baloković and John Barrett and Dan Bintley and Lindy Blackburn and W. Boland and Katherine L. Bouman and Geoffrey C. Bower and Michael Bremer and Christiaan D. Brinkerink and Roger Brissenden and S. Britzen and Dominique Broguière and Do‐Young Byun and J. E. Carlstrom and Andrew Chael and Koushik Chatterjee and Shami Chatterjee and Ming‐Tang Chen and Xiaopeng Cheng and Ilje Cho and Pierre Christian and J. E. Conway and J. M. Cordes and G. Crew and Yuzhu Cui and Mariafelicia De Laurentis and Roger Deane and Jessica Dempsey and G. Desvignes and Sheperd S. Doeleman and Ralph P. Eatough and H. Falcke and Vincent L. Fish and Ed Fomalont and Raquel Fraga-Encinas and Bill Freeman and Per Friberg and José L. Gómez and Peter Galison and Roberto García and Olivier Gentaz and Boris Georgiev and C. Goddi and Minfeng Gu and Mark Gurwell and Kazuhiro Hada and M. H. Hecht and Ronald Hesper and Luis C. Ho and Paul T. P. Ho and Mareki Honma and Wu Jiang and Lei Huang and D. H. Hughes and Makoto Inoue and Sara Issaoun and D. J. James and Buell T. Jannuzi and Michaël Janssen and Britton Jeter and Abhishek V. Joshi and Alejandra Jiménez-Rosales and Michael D. Johnson and Svetlana G. Jorstad and Taehyun Jung and Mansour Karami and R. Karuppusamy and Garrett K. Keating and Mark Kettenis and Jae-Young Kim and Junhan Kim and Jongsoo Kim and Motoki Kino and Jun Yi Koay and Patrick M. Koch and Shoko Koyama and M. Krämer and C. Krämer and T. P. Krichbaum},
  title = {{Verification of Radiative Transfer Schemes for the EHT}},
  journal = {The Astrophysical Journal},
  year = {2020},
  doi = {10.3847/1538-4357/ab96c6},
}
Figure