Generative adversarial networks for scintillation signal simulation in EXO-200

S. Li, I. Ostrovskiy, Z. Li, L. Yang, S. Al Kharusi, G. Anton, P. S. Barbeau, I. Badhrees, Diane M. Beck, V. Belov, Trilochan Bhatta, M. Breidenbach, T. Brunner, G. F. Cao, W. R. Cen, C. Chambers, B. T. Cleveland, Minor J. Coon, A. Craycraft, T. Daniels, L. Darroch, S. J. Daugherty, J. Davis, S. Delaquis, A. Der Mesrobian-Kabakian, R. DeVoe, J. Dilling, A. Dolgolenko, M. J. Dolinski, J. Echevers, W. M. Fairbank, D. Fairbank, J. Farine, Soheyla Feyzbakhsh, P. Fierlinger, Yanyan Fu, D. Fudenberg, P. Gautam, R. Gornea, G. Gratta, C. Hall, E. V. Hansen, J. Hoessl, P. Hufschmidt, M. Hughes, A. Iverson, A. Jamil, C. E. Jessiman, M. J. Jewell, A. S. Johnson, A. Karelin, L. J. Kaufman, T. Koffas, R. Krücken, A. Kuchenkov, K.s. Kumar, Y. Lan, A. C. Larson, B. G. Lenardo, D. S. Leonard, G.s. Li, C. Licciardi, Y. H. Lin, R. MacLellan, Thomas McElroy, Thilo Michel, B. Mong, David C. Moore, K. Murray, O. Njoya, O. Nusair, A. Odian, Andréa Perna, A. Piepke, A. Pocar, F. Retière, A. L. Robinson, P.c. Rowson, J. Runge, Susann Schmidt, D. Sinclair, K. Skarpaas, A. K. Soma, V. Stekhanov, M. Tarka, S. Thibado, J. Todd, T. Tolba, T.i. Totev, R. Tsang, B. Veenstra, V. Veeraraghavan, P. Vogel, J.-l. Vuilleumier, M. Wagenpfeil, J. Watkins, M. Weber, Liangjian Wen, U. Wichoski, Gerrit WredeJournal of Instrumentation 2023 · DOI

TL;DR

This paper introduces a novel application of Generative Adversarial Networks (GANs), specifically Wasserstein GANs, to simulate scintillation signals in the EXO-200 experiment. By training on real calibration data, the GAN can generate realistic detector signals an order of magnitude faster than traditional Monte Carlo methods, while accurately capturing complex detector physics like position dependency and even identifying faulty channels.

What Problem Does This Paper Address?

Simulating particle detector responses is crucial for data analysis, detector design, and new physics searches. However, traditional Monte Carlo (MC) simulations, especially for complex detectors like the EXO-200 time projection chamber (TPC), are computationally expensive and time-consuming. This is particularly true for simulating scintillation light, which involves generating and tracking millions of photons. Furthermore, MC simulations rely on precise knowledge of detector geometry and material optical properties, which are often not perfectly known, leading to discrepancies between simulated and real data. The EXO-200 experiment, for instance, uses a simplified parametric simulation for light yield due to these challenges. This paper aims to address these limitations by developing a faster, more accurate, and data-driven simulation method using deep learning.

Methods

The core of this work is the application of a Wasserstein Generative Adversarial Network (WGAN). Unlike traditional GANs, WGANs use the Wasserstein distance as a loss function, which provides more stable training and better gradients, preventing issues like training collapse. The WGAN is trained on raw scintillation waveforms from the EXO-200 detector's avalanche photodiode (APD) channels.

Key methodological aspects include:

  • Data Representation: APD waveforms are converted into image-like representations (74 channels x 350 time samples) to leverage GANs' strength in image generation.
  • Label Conditioning: The generator is conditioned on physics labels (scintillation energy and spatial coordinates X, Y, Z) to produce waveforms with specific characteristics. These labels are derived from the EXO-200 reconstruction algorithm.
  • Training Strategy: The WGAN is trained using the Adam optimizer with a specific learning rate schedule and a gradient penalty to enforce the Lipschitz constraint on the discriminator. The training involves alternating updates between the discriminator and the generator.
  • Validation: The generated waveforms are evaluated at multiple levels: raw waveform comparison, signal feature comparison, and finally, by integrating them into the EXO-200 reconstruction framework to compare reconstructed energy spectra.

Datasets

The primary dataset used in this study is real calibration data from the EXO-200 experiment, specifically from 228Th calibration runs. This data is split into training and testing sets with a ratio of approximately 7:3. The training data consists of 215,789 events from phase II of the experiment. The labels (energy and position) for training are derived from the existing EXO-200 reconstruction algorithm applied to this calibration data.

Key Insights and Ideas

  • Data-Driven Simulation: The GAN approach bypasses the need for detailed, often uncertain, physical models of light propagation and detector response, relying instead on learning directly from real data.
  • Speed and Efficiency: The GAN can generate simulated waveforms an order of magnitude faster than traditional MC methods, significantly reducing computational costs.
  • Capturing Complex Physics: The GAN successfully learns and reproduces subtle physics phenomena, such as the position-dependent light response across different APD planes and the anti-correlation between scintillation and charge signals.
  • Identifying Detector Issues: The network implicitly learns to recognize and reproduce the behavior of "dead" APD channels caused by excessive leakage current, a testament to its ability to capture real-world detector characteristics.
  • Reconstruction Compatibility: The generated waveforms, when fed into the standard EXO-200 reconstruction pipeline, produce energy spectra comparable to those from real data, demonstrating the practical utility of the simulated signals.

Key Results

  • Speedup: The GAN achieves an average simulation rate of ~69 events/s on an Nvidia GeForce 1080Ti GPU, compared to ~4.2 events/s for the traditional EXO-200 simulation framework (which includes Geant4 and parametric optical simulation). This represents an approximate order of magnitude speedup.
  • Energy Resolution: While the GAN-generated energy spectra are comparable to real data, they exhibit slightly worse energy resolution. For the 2.614 MeV 228Th peak, the resolution is 9.1% for GAN-generated data versus 7.6% for real data without position correction. After applying a light map correction, the resolutions improve to 2.0% for GAN and 1.3% for real data, respectively.
  • Spatial Dependence: The GAN accurately reproduces the spatial dependence of APD amplitudes in both planes, showing good agreement with real data in terms of average amplitudes and standard deviations.
  • Disconnected Channels: The GAN successfully identifies and reproduces the pattern of disconnected APD channels, matching the calibration data.

Limitations and Future Work

  • Energy Label Uncertainty: The primary limitation acknowledged is the uncertainty in the energy labels derived from the EXO-200 reconstruction (~5% for the 228Th peak). This imperfect labeling is believed to contribute to the slightly worse energy resolution of the GAN-generated data.
  • Training Data Source: The approach requires training on real data, which means it cannot be used to optimize the design of entirely new detectors as effectively as traditional MC methods that can explore hypothetical detector configurations.
  • Single-Site Events: The current study focused on single-site events for simplicity. The authors suggest that extending the approach to multi-site events, which are common in TPCs, is a promising future direction.
  • Improved Training Data: Future work could involve using a light source with known intensity and controlled deployment to generate training events with more accurate "truth" labels, potentially leading to better energy resolution.
  • Joint Charge and Light Waveform Training: An interesting avenue for future research is to train the network on both charge and light waveforms simultaneously. If the network can learn the anti-correlation between these signals, it could potentially leverage the improved accuracy of rotated energy labels.

Summary updated

Abstract

Abstract Generative Adversarial Networks trained on samples of simulated or actual events have been proposed as a way of generating large simulated datasets at a reduced computational cost. In this work, a novel approach to perform the simulation of photodetector signals from the time projection chamber of the EXO-200 experiment is demonstrated. The method is based on a Wasserstein Generative Adversarial Network — a deep learning technique allowing for implicit non-parametric estimation of the population distribution for a given set of objects. Our network is trained on real calibration data using raw scintillation waveforms as input. We find that it is able to produce high-quality simulated waveforms an order of magnitude faster than the traditional simulation approach and, importantly, generalize from the training sample and discern salient high-level features of the data. In particular, the network correctly deduces position dependency of scintillation light response in the detector and correctly recognizes dead photodetector channels. The network output is then integrated into the EXO-200 analysis framework to show that the standard EXO-200 reconstruction routine processes the simulated waveforms to produce energy distributions comparable to that of real waveforms. Finally, the remaining discrepancies and potential ways to improve the approach further are highlighted.
BibTeX
@article{li2023generative,
  author = {S. Li and I. Ostrovskiy and Z. Li and L. Yang and S. Al Kharusi and G. Anton and P. S. Barbeau and I. Badhrees and Diane M. Beck and V. Belov and Trilochan Bhatta and M. Breidenbach and T. Brunner and G. F. Cao and W. R. Cen and C. Chambers and B. T. Cleveland and Minor J. Coon and A. Craycraft and T. Daniels and L. Darroch and S. J. Daugherty and J. Davis and S. Delaquis and A. Der Mesrobian-Kabakian and R. DeVoe and J. Dilling and A. Dolgolenko and M. J. Dolinski and J. Echevers and W. M. Fairbank and D. Fairbank and J. Farine and Soheyla Feyzbakhsh and P. Fierlinger and Yanyan Fu and D. Fudenberg and P. Gautam and R. Gornea and G. Gratta and C. Hall and E. V. Hansen and J. Hoessl and P. Hufschmidt and M. Hughes and A. Iverson and A. Jamil and C. E. Jessiman and M. J. Jewell and A. S. Johnson and A. Karelin and L. J. Kaufman and T. Koffas and R. Krücken and A. Kuchenkov and K.S. Kumar and Y. Lan and A. C. Larson and B. G. Lenardo and D. S. Leonard and G.S. Li and C. Licciardi and Y. H. Lin and R. MacLellan and Thomas McElroy and Thilo Michel and B. Mong and David C. Moore and K. Murray and O. Njoya and O. Nusair and A. Odian and Andréa Perna and A. Piepke and A. Pocar and F. Retière and A. L. Robinson and P.C. Rowson and J. Runge and Susann Schmidt and D. Sinclair and K. Skarpaas and A. K. Soma and V. Stekhanov and M. Tarka and S. Thibado and J. Todd and T. Tolba and T.I. Totev and R. Tsang and B. Veenstra and V. Veeraraghavan and P. Vogel and J.-L. Vuilleumier and M. Wagenpfeil and J. Watkins and M. Weber and Liangjian Wen and U. Wichoski and Gerrit Wrede},
  title = {{Generative adversarial networks for scintillation signal simulation in EXO-200}},
  journal = {Journal of Instrumentation},
  year = {2023},
  doi = {10.1088/1748-0221/18/06/p06005},
}
Figure