Novel approach for evaluating detector-related uncertainties in a LArTPC using MicroBooNE data

P. Abratenko, R. An, J. Anthony, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, C. Barnes, G. Barr, V. Basque, L. Bathe-Peters, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bishai, A. Blake, T. Bolton, Julia Book, L. Camilleri, D. Caratelli, I. Caro Terrazas, F. Cavanna, G. B. Cerati, Y. Chen, D. Cianci, J. M. Conrad, M. R. Convery, L. Cooper-Troendle, J. I. Crespo-Anadón, M. Del Tutto, S. R. Dennis, P. Detje, Ann Devitt, R. Diurba, R. Dorrill, K. Duffy, S. Dytman, B. Eberly, A. Ereditato, J. J. Evans, R. Fine, G. A. Fiorentini Aguirre, R. S. Fitzpatrick, B. T. Fleming, N. Foppiani, D. Franco, A. P. Furmanski, D. García-Gámez, S. Gardiner, G. Ge, S. Gollapinni, O. Goodwin, E. Gramellini, P. Green, H. Greenlee, W. Gu, R. Guénette, P. Guzowski, L. Hagaman, O. Hen, C. Hilgenberg, G. A. Horton-Smith, A. Hourlier, R. Itay, C. James, X. Ji, L. Jiang, J. H. Jo, R. A. Johnson, Y.-j. Jwa, D. Kalra, N. Kamp, N. Kaneshige, G. Karagiorgi, W. Ketchum, M. Kirby, T. Kobilarcik, I. Kreslo, I. Lepetic, K. Li, Ye Li, K. Lin, B. R. Littlejohn, W. C. Louis, X. Luo, K. Manivannan, C. Mariani, D. Marsden, J. Marshall, D. A. Martínez Caicedo, K. Mason, A. Mastbaum, N. McConkey, V. Meddage, T. Mettler, K. Miller, J. Mills, K. MistryThe European Physical Journal C 2022 · DOI

TL;DR

This paper introduces a novel, data-driven method to quantify systematic uncertainties in liquid argon time projection chambers (LArTPCs) by modifying simulated detector signals based on observed differences in data. This approach is more computationally efficient and less dependent on detailed simulation models than traditional methods, making it crucial for future experiments like SBN and DUNE.

What Problem Does This Paper Address?

Precision neutrino experiments, especially those using LArTPCs like MicroBooNE, rely heavily on simulations to interpret their data. However, discrepancies between simulated and actual detector responses introduce systematic uncertainties that can limit the precision of physics measurements. These uncertainties arise from complex detector effects like electron-ion recombination, diffusion, and the electronics' response to signals. Quantifying and reducing these uncertainties is paramount for achieving the sensitivity required by next-generation experiments. Traditional methods often involve detailed, computationally expensive re-simulations with varied detector parameters. This paper tackles the challenge of efficiently and robustly assessing these detector-related systematic uncertainties.

Methods

The core of this paper is a novel technique that modifies simulated wire waveforms directly, rather than re-simulating the entire detector response. The process involves:

  1. Data-Driven Parameterization: Cosmic ray muon tracks are used to measure key properties of ionization signals (hits), specifically their integrated charge and width, as a function of various detector variables (position in x, y, z, and angles $\theta_{xz}$, $\theta_{yz}$). These measurements are performed in both real data and simulation.
  2. Ratio Extraction: Data-to-simulation ratios of these hit properties are calculated for each variable. These ratios represent the observed discrepancies in the detector's response.
  3. Waveform Modification: These ratios are then used to scale the simulated waveforms. The modification is applied to the "simulation-dominated" portions of waveforms, leaving "cosmic-dominated" portions (used for background) untouched. This is achieved by fitting Gaussian functions to the waveforms and modifying their charge and width parameters based on the extracted ratios.
  4. Systematic Uncertainty Estimation: The modified simulation samples are then compared to the nominal simulation. The differences observed in reconstructed quantities (like shower energy or invariant mass) are taken as the estimate of the systematic uncertainty associated with that specific detector variable.

This method is designed to be agnostic to the underlying simulation model, capturing residual effects not perfectly modeled. It's also significantly faster than full re-simulations, offering an order-of-magnitude speedup.

Datasets

The primary datasets used are:

  • MicroBooNE Beam-Off Data: Used to select cosmic ray muon tracks for characterizing detector response.
  • MicroBooNE Beam-On Data: Used for physics analyses where the detector uncertainties are evaluated.
  • Simulated Cosmic Ray Muons (CORSIKA): Overlaid on beam-off data to create a realistic simulation of cosmic ray backgrounds.
  • Simulated Neutrino Interaction Events: Used for evaluating the impact of the modified waveforms on physics observables.

The paper does not introduce new benchmark datasets but rather leverages existing MicroBooNE data and simulation infrastructure.

Key Insights and Ideas

  • Data-Driven is Key: The most significant insight is the power of using real data to directly inform and correct simulation, bypassing the need for perfect theoretical models of every detector effect.
  • Waveform Modification Efficiency: Directly modifying waveforms is a computationally efficient way to explore systematic uncertainties, making it practical for large datasets and complex analyses.
  • Universality of the Approach: The method is designed to be general and applicable to various detector variables and even different physics objects (e.g., showers, not just tracks), suggesting broad applicability.
  • Capturing Unmodeled Effects: By focusing on observed data-simulation differences, this method can capture detector effects that are not fully understood or implemented in the simulation.

Key Results

The paper demonstrates that the waveform modification technique:

  • Accurately Reflects Detector Variations: The modified simulations show variations in reconstructed quantities (e.g., shower dE/dx, diphoton invariant mass) that are consistent with the observed differences between data and nominal simulation.
  • Quantifies Systematic Uncertainties: The method successfully quantifies the impact of detector response uncertainties on physics observables, showing shifts typically in the range of 1-2%, and up to 6% for the diphoton invariant mass width.
  • Is Computationally Efficient: The waveform modification process is about an order of magnitude faster than running the full simulation.
  • Is Robust: The method is shown to be relatively insensitive to the details of the detector model and can capture effects not explicitly included in the simulation.

Limitations and Future Work

The authors acknowledge several limitations and suggest future directions:

  • Limited to Waveform Properties: The current method primarily addresses uncertainties related to ionization charge and signal width. It may not fully capture uncertainties related to other detector effects like electron-ion recombination or scintillation light.
  • Extrapolation in Angular Variables: For high angles ($\theta_{xz}$ approaching $\pi/2$), the method relies on extrapolation, which introduces some uncertainty.
  • Correlations Between Variables: While the method treats variables largely independently, there are known correlations (e.g., between y and z position dependence) that could be more thoroughly investigated and incorporated.
  • Future Work:
    • Expanding the method to include dependencies on local ionization density.
  • Investigating the impact of correlations between different detector variables.
  • Potentially using this method to correct the nominal simulation rather than just estimate uncertainties, if detector uncertainties become dominant.
  • Applying similar methods to LArTPCs with different readout designs.

Summary updated

Abstract

Abstract Primary challenges for current and future precision neutrino experiments using liquid argon time projection chambers (LArTPCs) include understanding detector effects and quantifying the associated systematic uncertainties. This paper presents a novel technique for assessing and propagating LArTPC detector-related systematic uncertainties. The technique makes modifications to simulation waveforms based on a parameterization of observed differences in ionization signals from the TPC between data and simulation, while remaining insensitive to the details of the detector model. The modifications are then used to quantify the systematic differences in low- and high-level reconstructed quantities. This approach could be applied to future LArTPC detectors, such as those used in SBN and DUNE.
BibTeX
@article{abratenko2022novel,
  author = {P. Abratenko and R. An and J. Anthony and L. Arellano and J. Asaadi and A. Ashkenazi and S. Balasubramanian and B. Baller and C. Barnes and G. Barr and V. Basque and L. Bathe-Peters and O. Benevides Rodrigues and S. Berkman and A. Bhanderi and A. Bhat and M. Bishai and A. Blake and T. Bolton and Julia Book and L. Camilleri and D. Caratelli and I. Caro Terrazas and F. Cavanna and G. B. Cerati and Y. Chen and D. Cianci and J. M. Conrad and M. R. Convery and L. Cooper-Troendle and J. I. Crespo-Anadón and M. Del Tutto and S. R. Dennis and P. Detje and Ann Devitt and R. Diurba and R. Dorrill and K. Duffy and S. Dytman and B. Eberly and A. Ereditato and J. J. Evans and R. Fine and G. A. Fiorentini Aguirre and R. S. Fitzpatrick and B. T. Fleming and N. Foppiani and D. Franco and A. P. Furmanski and D. García-Gámez and S. Gardiner and G. Ge and S. Gollapinni and O. Goodwin and E. Gramellini and P. Green and H. Greenlee and W. Gu and R. Guénette and P. Guzowski and L. Hagaman and O. Hen and C. Hilgenberg and G. A. Horton-Smith and A. Hourlier and R. Itay and C. James and X. Ji and L. Jiang and J. H. Jo and R. A. Johnson and Y.-J. Jwa and D. Kalra and N. Kamp and N. Kaneshige and G. Karagiorgi and W. Ketchum and M. Kirby and T. Kobilarcik and I. Kreslo and I. Lepetic and K. Li and Ye Li and K. Lin and B. R. Littlejohn and W. C. Louis and X. Luo and K. Manivannan and C. Mariani and D. Marsden and J. Marshall and D. A. Martínez Caicedo and K. Mason and A. Mastbaum and N. McConkey and V. Meddage and T. Mettler and K. Miller and J. Mills and K. Mistry},
  title = {{Novel approach for evaluating detector-related uncertainties in a LArTPC using MicroBooNE data}},
  journal = {The European Physical Journal C},
  year = {2022},
  doi = {10.1140/epjc/s10052-022-10270-8},
}
Figure