Toward a Public MAGIC Gamma-Ray Telescope Legacy Data Portal

M. Doro, Cosimo Nigro, E. Prandini, A. Tramacere, M. Delfino, J. Delgado, Elia do Souto, L. Jouvin, J. Rico

Abstract

The MAGIC telescopes are one of the three major IACTs (Imaging Atmospheric Cherenkov Telescopes) for observation of gamma rays in the TeV regime currently operative. MAGIC functions since 2003, and has published data from more than 60 sources, mostly blazars. MAGIC already provides astronomical .fits files with basic final scientific products such as spectral energy distributions, light curves and skymaps from published results. In future, the format of the files can be complemented with further relevant information to the community: a) by including the full multi-wavelength dataset enclosed in a publication, b) providing data in alternative easy-to-use formats such as ASCII or ECSV, which are accessible with other commonly used packages such as astropy or gammapy. Finally, besides high level products, activities have started to provide photon event lists and instrument response functions in a format such that scientists within and outside the community are allowed to perform higher level analysis. A second aim is to provide a full legacy of MAGIC data. This contribution will illustrate the achievements and plans of this activity.

Introduction

Since 2003, the Major Atmospheric Gamma-ray Imaging Cherenkov (MAGIC) telescopes have been observing the universe’s most violent phenomena in the tera-electronvolt (TeV) regime. While the collaboration has published data on over 60 sources, accessing that data for independent analysis has historically been challenging. Currently, data is often shared as basic FITS files tied to specific publications, lacking the standardization required for modern open-source tools. To bridge this gap, the MAGIC Collaboration is developing a "Legacy Data Portal" following FAIR (Findable, Accessible, Interoperable, and Reusable) data principles.

Standardizing the Data Pipeline

A key component of this transition is the standardization of data levels. The collaboration distinguishes between Data Level 3 (DL3), which includes event lists and Instrument Response Functions (IRFs), and Data Level 4 (DL4), which consists of high-level science products like Spectral Energy Distributions (SEDs) and light curves.

The MAGIC data analysis chain, from raw image cleaning to event classification.

By aligning with the gamma-cat project, the collaboration is moving toward machine-readable formats like YAML for metadata and ECSV (Enhanced Character-Separated Values) for tabular data. These formats ensure that data is "self-describing," retaining critical header metadata while remaining compatible with standard Python libraries like astropy.

Case Study: NGC 1275

To demonstrate the new portal's capabilities, the authors presented a prototype using data from a 2018 study (AA617(2018)A91) on the active galaxy NGC 1275. This case study illustrates how the portal can provide comprehensive multi-wavelength datasets, integrating MAGIC's TeV observations with data from other instruments like Fermi-LAT and KVA.

Multi-wavelength data for the active galaxy NGC 1275, demonstrating the types of high-level science products (DL4) to be included in the portal.

Key Insights and Future Roadmap

The transition to a public legacy portal requires addressing the complexity of Instrument Response Functions (IRFs), which act as the "instruction manual" for interpreting event lists. While DL4 products are relatively straightforward to share, providing DL3 data for individual observations is a significant technical undertaking that requires community-wide consensus on metadata standards.

The collaboration has already established initial repositories (e.g., vobs.magic.pic.es) and is working toward enabling programmatic access via APIs and tools like astroquery. The long-term goal is to convert nearly 20 years of published research into this standardized format, ensuring the MAGIC telescope's scientific legacy remains accessible to the global astrophysics community.

Summary updated

Abstract

The MAGIC telescopes are one of the three major IACTs (Imaging Atmospheric Cherenkov Telescopes) for observation of gamma rays in the TeV regime currently operative. MAGIC functions since 2003, and has published data from more than 60 sources, mostly blazars. MAGIC already provides astronomical \texttt{.fits} files with basic final scientific products such as spectral energy distributions, light curves and skymaps from published results. In future, the format of the files can be complemented with further relevant information to the community: a) by including the full multi-wavelength dataset enclosed in a publication, b) providing data in alternative easy-to-use formats such as ASCII or ECSV, which are accessible with other commonly used packages such as \texttt{astropy} or \texttt{gammapy}. Finally, besides high level products, activities have started to provide photon event lists and instrument response functions in a format such that scientists within and outside the community are allowed to perform higher level analysis. A second aim is to provide a full legacy of MAGIC data. This contribution will illustrate the achievements and plans of this activity.
BibTeX
@inproceedings{doro2019toward,
  author = {M. Doro and Cosimo Nigro and E. Prandini and A. Tramacere and M. Delfino and J. Delgado and Elia do Souto and L. Jouvin and J. Rico},
  title = {{Toward a Public MAGIC Gamma-Ray Telescope Legacy Data Portal}},
  booktitle = {Proceedings of 36th International Cosmic Ray Conference — PoS(ICRC2019)},
  year = {2019},
  doi = {10.22323/1.358.0666},
}
Figure