Comparison of Polarized Radiative Transfer Codes Used by the EHT Collaboration

Ben Prather, Jason Dexter, Monika Mościbrodzka, Hung-Yi Pu, Thomas Bronzwaer, Jordy Davelaar, Ziri Younsi, Charles F. Gammie, Roman Gold, George N. Wong, Kazunori Akiyama, A. Alberdi, W. Alef, Juan Carlos Algaba, Richard Anantua, Keiichi Asada, Rebecca Azulay, U. Bach, Anne-Kathrin Baczko, David Ball, Mislav Baloković, John Barrett, Michi Bauböck, B. A. Benson, Dan Bintley, Lindy Blackburn, R. Blundell, Katherine L. Bouman, Geoffrey C. Bower, Hope Boyce, Michael Bremer, Christiaan D. Brinkerink, Roger Brissenden, S. Britzen, Avery E. Broderick, Dominique Broguière, Sandra Bustamante, Do‐Young Byun, J. E. Carlstrom, Chiara Ceccobello, Andrew Chael, Chi‐kwan Chan, Dominic O. Chang, Koushik Chatterjee, Shami Chatterjee, Ming‐Tang Chen, Xiaopeng Cheng, Ilje Cho, Pierre Christian, Nicholas S. Conroy, J. E. Conway, J. M. Cordes, T. M. Crawford, G. Crew, Alejandro Cruz-Osorio, Yuzhu Cui, Mariafelicia De Laurentis, Roger Deane, Jessica Dempsey, G. Desvignes, Vedant Dhruv, Sheperd S. Doeleman, Sean Dougal, Sergio A. Dzib, Ralph P. Eatough, Razieh Emami, H. Falcke, Joseph Farah, Vincent L. Fish, Ed Fomalont, H. Alyson Ford, Raquel Fraga-Encinas, William T. Freeman, Per Friberg, Christian M. Fromm, Antonio Fuentes, Peter Galison, Roberto García, Olivier Gentaz, Boris Georgiev, C. Goddi, Arturo I. Gómez-Ruiz, José L. Gómez, Minfeng Gu, Mark Gurwell, Kazuhiro Hada, Daryl Haggard, Kari Haworth, M. H. Hecht, Ronald Hesper, Dirk Heumann, Luis C. Ho, Paul T. P. Ho, Mareki Honma, Wu Jiang, Lei Huang, D. H. Hughes, Shiro Ikeda, C. M. Violette Impellizzeri

Abstract

Interpretation of resolved polarized images of black holes by the Event Horizon Telescope (EHT) requires predictions of the polarized emission observable by an Earth-based instrument for a particular model of the black hole accretion system. Such predictions are generated by general relativistic radiative transfer (GRRT) codes, which integrate the equations of polarized radiative transfer in curved spacetime. A selection of ray-tracing GRRT codes used within the EHT Collaboration is evaluated for accuracy and consistency in producing a selection of test images, demonstrating that the various methods and implementations of radiative transfer calculations are highly consistent. When imaging an analytic accretion model, we find that all codes produce images similar within a pixel-wise normalized mean squared error (NMSE) of 0.012 in the worst case. When imaging a snapshot from a cell-based magnetohydrodynamic simulation, we find all test images to be similar within NMSEs of 0.02, 0.04, 0.04, and 0.12 in Stokes I, Q, U, and V, respectively. We additionally find the values of several image metrics relevant to published EHT results to be in agreement to much better precision than measurement uncertainties.

Introduction

Capturing an image of a black hole like M87 or Sgr A is a complex process involving the reconstruction of data from a global network of radio telescopes. To interpret these observations, scientists rely on General Relativistic Radiative Transfer (GRRT) codes. These tools simulate how light (photons) travels through the warped spacetime around a black hole and interacts with the surrounding hot, magnetized plasma of the accretion disk.

Because different research groups developed their own GRRT codes—using various numerical schemes, coordinate systems, and integration methods—ensuring consistency across the collaboration is critical. If different codes produced significantly divergent images from the same physical model, the EHT’s scientific conclusions could be compromised. This study presents a comprehensive cross-validation to verify the robustness of the collaboration's software library.

Methodology and Evaluated Codes

The study evaluates six primary codes: BHOSS, ipole, ipole-IL, grtrans, Odyssey, and RAPTOR. These codes solve the radiative transfer equations along geodesics (the curved paths of light in a gravitational field). Unlike standard radiative transfer which only handles light intensity ($I$), these codes must track polarized light using the four Stokes parameters ($I, Q, U, V$).

Visualization of the Stokes Q parameter, representing one component of linear polarization in a simulated black hole environment.

The calculations must account for several physical phenomena:

  • Synchrotron emission and absorption: Light produced by electrons spiraling in magnetic fields.
  • Faraday rotation and conversion: The twisting and changing of light's polarization as it passes through magnetized plasma.
  • Parallel transport: Maintaining the orientation of the polarization vector through curved spacetime.

The codes vary in implementation; for instance, Odyssey utilizes GPU acceleration for performance, while ipole employs a semi-analytic method for stability in "thick" plasmas where absorption or rotation is high.

Benchmarking Datasets

The codes were evaluated against three benchmark problems of increasing complexity:

  1. Analytic Integration: A simplified test with constant coefficients where the exact mathematical solution is known.
  2. Thin-disk Model: A Novikov-Thorne model of an opaque disk around a spinning black hole, testing complex geodesics and parallel transport.
  3. GRMHD Snapshot: A single frame from a 3D General Relativistic Magnetohydrodynamic simulation of a SANE (Standard and Normal Evolution) accretion flow, reflecting the realistic conditions used to model M87*.

Key Results and Consistency

The comparison demonstrated high precision across all codes. In analytic tests, the codes agreed within a pixel-wise Normalized Mean Squared Error (NMSE) of 0.012. For realistic plasma snapshots, the NMSE remained low: 0.02 for total intensity ($I$) and up to 0.12 for circular polarization ($V$).

Total intensity (Stokes I) image with overlaid polarization vectors, demonstrating the consistent output across different GRRT implementations.

Crucially, the variation between codes was typically less than 30% of the $1\sigma$ observational uncertainty reported by the EHT. This indicates that "code uncertainty" is significantly smaller than "detector uncertainty," meaning our current understanding is limited by hardware and plasma physics modeling rather than simulation software.

Discussion and Future Directions

The study found that the codes are consistent enough to potentially help constrain the mass of a black hole like M87* to within 0.4% in an ideal scenario. However, it also highlighted that choices in physical modeling—such as electron emissivity functions—cause more variation than the choice of GRRT code itself.

Future work will focus on refining electron temperature models and moving beyond the "fast-light" approximation for higher temporal accuracy. Additionally, better modeling of "Faraday screens" in the outer regions of simulations is needed, as the final appearance of polarization is highly sensitive to these areas.

In conclusion, the EHT collaboration's suite of GRRT codes is robust and reliable, providing a solid foundation for the scientific interpretation of black hole images.

Summary updated

Abstract

Abstract Interpretation of resolved polarized images of black holes by the Event Horizon Telescope (EHT) requires predictions of the polarized emission observable by an Earth-based instrument for a particular model of the black hole accretion system. Such predictions are generated by general relativistic radiative transfer (GRRT) codes, which integrate the equations of polarized radiative transfer in curved spacetime. A selection of ray-tracing GRRT codes used within the EHT Collaboration is evaluated for accuracy and consistency in producing a selection of test images, demonstrating that the various methods and implementations of radiative transfer calculations are highly consistent. When imaging an analytic accretion model, we find that all codes produce images similar within a pixel-wise normalized mean squared error (NMSE) of 0.012 in the worst case. When imaging a snapshot from a cell-based magnetohydrodynamic simulation, we find all test images to be similar within NMSEs of 0.02, 0.04, 0.04, and 0.12 in Stokes I , Q , U , and V , respectively. We additionally find the values of several image metrics relevant to published EHT results to be in agreement to much better precision than measurement uncertainties.
BibTeX
@article{prather2023comparison,
  author = {Ben Prather and Jason Dexter and Monika Mościbrodzka and Hung-Yi Pu and Thomas Bronzwaer and Jordy Davelaar and Ziri Younsi and Charles F. Gammie and Roman Gold and George N. Wong and Kazunori Akiyama and A. Alberdi and W. Alef and Juan Carlos Algaba and Richard Anantua and Keiichi Asada and Rebecca Azulay and U. Bach and Anne-Kathrin Baczko and David Ball and Mislav Baloković and John Barrett and Michi Bauböck and B. A. Benson and Dan Bintley and Lindy Blackburn and R. Blundell and Katherine L. Bouman and Geoffrey C. Bower and Hope Boyce and Michael Bremer and Christiaan D. Brinkerink and Roger Brissenden and S. Britzen and Avery E. Broderick and Dominique Broguière and Sandra Bustamante and Do‐Young Byun and J. E. Carlstrom and Chiara Ceccobello and Andrew Chael and Chi‐kwan Chan and Dominic O. Chang and Koushik Chatterjee and Shami Chatterjee and Ming‐Tang Chen and Xiaopeng Cheng and Xiaopeng Cheng and Ilje Cho and Pierre Christian and Nicholas S. Conroy and J. E. Conway and J. M. Cordes and T. M. Crawford and G. Crew and Alejandro Cruz-Osorio and Yuzhu Cui and Mariafelicia De Laurentis and Roger Deane and Jessica Dempsey and G. Desvignes and Vedant Dhruv and Sheperd S. Doeleman and Sean Dougal and Sergio A. Dzib and Ralph P. Eatough and Razieh Emami and H. Falcke and Joseph Farah and Vincent L. Fish and Ed Fomalont and H. Alyson Ford and Raquel Fraga-Encinas and William T. Freeman and Per Friberg and Christian M. Fromm and Antonio Fuentes and Peter Galison and Roberto García and Olivier Gentaz and Boris Georgiev and C. Goddi and Arturo I. Gómez-Ruiz and José L. Gómez and Minfeng Gu and Mark Gurwell and Kazuhiro Hada and Daryl Haggard and Kari Haworth and M. H. Hecht and Ronald Hesper and Dirk Heumann and Luis C. Ho and Paul T. P. Ho and Mareki Honma and Wu Jiang and Lei Huang and D. H. Hughes and Shiro Ikeda and C. M. Violette Impellizzeri},
  title = {{Comparison of Polarized Radiative Transfer Codes Used by the EHT Collaboration}},
  journal = {The Astrophysical Journal},
  year = {2023},
  doi = {10.3847/1538-4357/acc586},
}

Loading related content...

Figure