Convolutional neural networks applied to neutrino events in a liquid argon time projection chamber

R. Acciarri, C. Adams, R. An, J. Asaadi, M. Auger, L. Bagby, B. Baller, G. Barr, M. Bass, F. Bay, M. Bishai, A. Blake, T. Bolton, L. Bugel, L. Camilleri, D. Caratelli, B. Carls, R. Castillo Fernández, F. Cavanna, H. Chen, E. Church, D. Cianci, G. H. Collin, J. M. Conrad, M. R. Convery, J. I. Crespo-Anadón, M. Del Tutto, D. Devitt, S. Dytman, B. Eberly, A. Ereditato, L. Escudero, J. Esquivel, B. T. Fleming, W. Foreman, A. P. Furmanski, G. T. Garvey, V. Genty, D. Goeldi, S. Gollapinni, N. Graf, E. Gramellini, H. Greenlee, R. Grosso, R. Guénette, A. Hackenburg, P. Hamilton, O. Hen, J. Hewes, Colton Hill, J. Ho, G. A. Horton-Smith, C. James, J. Jan de Vries, C.-m. Jen, L. Jiang, R. A. Johnson, B. J. P. Jones, J. Joshi, H. Jöstlein, D. Kaleko, G. Karagiorgi, W. Ketchum, B. Kirby, M. Kirby, T. Kobilarcik, I. Kreslo, A. Laube, Ye Li, A. Lister, B. R. Littlejohn, S. Lockwitz, D. Lorca, W. C. Louis, M. Luethi, B. Lundberg, X. Luo, A. Marchionni, C. Mariani, J. Marshall, D. A. Martínez Caicedo, V. Meddage, T. Miceli, G.b. Mills, J. Moon, M. Mooney, C. D. Moore, J. Mousseau, R. Murrells, D. Naples, P. Nienaber, J. Nowak, O. Palamara, V. Paolone, V. Papavassiliou, S. F. Pate, Ž. Pavlović, D. Porzio, G. Pulliam, X. QianJournal of Instrumentation 2017 · DOI

TL;DR

This paper explores the application of Convolutional Neural Networks (CNNs) to analyze data from the MicroBooNE liquid argon time projection chamber (LArTPC). The researchers demonstrate CNNs' potential for identifying single particles, localizing neutrino interactions, and classifying events, while also addressing practical challenges like image size and data processing for LArTPCs.

What Problem Does This Paper Address?

Neutrino experiments like MicroBooNE generate massive amounts of data from liquid argon time projection chambers (LArTPCs). Reconstructing and analyzing neutrino interactions from this data is a complex and time-consuming process. Traditional methods often involve intricate, hand-crafted algorithms for feature extraction and event classification. This paper investigates whether deep learning, specifically CNNs, can automate and improve these tasks by learning features directly from the detector's image-like data. A key challenge is the sheer size of LArTPC images, which are significantly larger than typical photographic images used in computer vision, posing hardware limitations for training deep networks. Additionally, the sparse nature of LArTPC images, with long, thin particle tracks against a largely empty background, differs from the dense information in natural photographs, raising questions about CNN applicability.

Methods

The study employs several CNN architectures and techniques:

  • Image Classification: AlexNet and GoogLeNet were used to classify single particles (electrons, photons, muons, pions, protons) within LArTPC images.
  • Object Detection: The Faster R-CNN architecture was adapted for localizing particles by drawing bounding boxes around their energy depositions.
  • Neutrino Event Classification and Localization: A simplified Inception-ResNet-v2 was used for classifying neutrino events from cosmic ray backgrounds using single-plane images. For a more comprehensive approach, a novel network based on ResNet was designed to combine information from all three TPC planes and optical detector data for neutrino event identification.
  • Data Augmentation and Preprocessing: Techniques like image cropping and downsizing were employed to manage large image sizes and hardware constraints. Data augmentation, such as random cropping and varying pixel intensity scales, was used to improve network robustness and prevent over-training.
  • Feature Engineering: For the three-plane analysis, additional input images were created to provide information about minimum ionizing particles (MIPs), heavily ionizing particles (HIPs), and PMT signals, acting as a form of "soft attention" to guide the network.

Datasets

The study primarily uses simulated data generated using the LArSoft framework, which incorporates GEANT4 for particle tracking and a model for electron drift. This simulated data is overlaid with real cosmic ray background data collected by the MicroBooNE detector.

  • Single Particle Classification/Detection: Simulated single particle events (e-, γ, µ-, π-, proton) were generated.
  • Neutrino Event Classification/Localization (Demonstration 2): Simulated neutrino events were overlaid onto off-beam cosmic ray data events.
  • Neutrino Event Identification (Demonstration 3): Simulated neutrino events were overlaid onto off-beam cosmic ray data events, incorporating TPC plane data and optical detector information.

Key Insights and Ideas

  • CNNs are applicable to sparse LArTPC images: Despite the difference from natural photographs, CNNs can effectively learn patterns in LArTPC images for particle identification and event detection.
  • Image size is a critical constraint: The large dimensions of LArTPC images necessitate strategies like cropping and downsizing, which can impact performance, particularly for features like dE/dx.
  • Broader training improves performance: Networks trained on a wider variety of particle types (e.g., five-particle classification) showed better performance in separating specific particle pairs (e.g., µ-/π-) compared to networks trained only on those specific pairs.
  • Multi-view and multi-modal data fusion is beneficial: Combining information from all three TPC planes and optical detector data significantly enhances neutrino event identification capabilities.
  • Simulated data needs careful calibration: Differences between simulated and real detector responses (e.g., wire response, pixel intensity scaling) can affect network performance, highlighting the need for accurate simulation modeling.

Key Results

  • Single Particle Classification: Achieved 83% efficiency and 82% purity for e-/γ separation, and 95% efficiency and 75% purity for µ-/π- separation.
  • Neutrino Event Classification (Single Plane): Demonstrated an efficiency of 87.1%±0.5% with 72.9% purity for neutrino events using a simplified Inception-ResNet-v2.
  • Neutrino Event Identification (3 Planes + Optical): Achieved a neutrino event selection efficiency of 85% with 85% cosmic-only rejection.
  • Object Detection: The Faster-RCNN architecture showed reasonable localization accuracy for both track-like and shower-like particles.
  • Impact of Downsizing: Downsizing images by a factor of two negatively affected particle classification performance for most particle types.

Limitations and Future Work

  • Simulation-Data Discrepancies: The study acknowledges that differences in simulated vs. real detector response (e.g., wire response, noise characteristics) limit the generalization of networks trained on simulation to real data. Future work will focus on improving simulation accuracy and developing techniques to mitigate these discrepancies.
  • Image Downsizing Effects: While necessary due to hardware constraints, downsizing can degrade performance. Further studies are needed to explore optimal downsizing strategies or alternative methods for handling large images.
  • Model-Dependent Bias: Using simulated neutrino events for training might introduce model-dependent biases. Future work will explore model-independent approaches and methods to quantify and minimize such biases.
  • Exploration of Network Architectures: The paper suggests that fully exploring the vast space of network configurations and architectures for LArTPC data is a promising avenue for future research.
  • Systematic Uncertainty Studies: More rigorous studies are needed to quantify systematic uncertainties, particularly those arising from the simulation of signal waveforms and detector response.

Summary updated

Abstract

We present several studies of convolutional neural networks applied to data coming from the MicroBooNE detector, a liquid argon time projection chamber (LArTPC). The algorithms studied include the classification of single particle images, the localization of single particle and neutrino interactions in an image, and the detection of a simulated neutrino event overlaid with cosmic ray backgrounds taken from real detector data. These studies demonstrate the potential of convolutional neural networks for particle identification or event detection on simulated neutrino interactions. We also address technical issues that arise when applying this technique to data from a large LArTPC at or near ground level.
BibTeX
@article{acciarri2017convolutional,
  author = {R. Acciarri and C. Adams and R. An and J. Asaadi and M. Auger and L. Bagby and B. Baller and G. Barr and M. Bass and F. Bay and M. Bishai and A. Blake and T. Bolton and L. Bugel and L. Camilleri and D. Caratelli and B. Carls and R. Castillo Fernández and F. Cavanna and H. Chen and E. Church and D. Cianci and G. H. Collin and J. M. Conrad and M. R. Convery and J. I. Crespo-Anadón and M. Del Tutto and D. Devitt and S. Dytman and B. Eberly and A. Ereditato and L. Escudero and J. Esquivel and B. T. Fleming and W. Foreman and A. P. Furmanski and G. T. Garvey and V. Genty and D. Goeldi and S. Gollapinni and N. Graf and E. Gramellini and H. Greenlee and R. Grosso and R. Guénette and A. Hackenburg and P. Hamilton and O. Hen and J. Hewes and Colton Hill and J. Ho and G. A. Horton-Smith and C. James and J. Jan de Vries and C.-M. Jen and L. Jiang and R. A. Johnson and B. J. P. Jones and J. Joshi and H. Jöstlein and D. Kaleko and G. Karagiorgi and W. Ketchum and B. Kirby and M. Kirby and T. Kobilarcik and I. Kreslo and A. Laube and Ye Li and A. Lister and B. R. Littlejohn and S. Lockwitz and D. Lorca and W. C. Louis and M. Luethi and B. Lundberg and X. Luo and A. Marchionni and C. Mariani and J. Marshall and D. A. Martínez Caicedo and V. Meddage and T. Miceli and G.B. Mills and J. Moon and M. Mooney and C. D. Moore and J. Mousseau and R. Murrells and D. Naples and P. Nienaber and J. Nowak and O. Palamara and V. Paolone and V. Papavassiliou and S. F. Pate and Ž. Pavlović and D. Porzio and G. Pulliam and X. Qian},
  title = {{Convolutional neural networks applied to neutrino events in a liquid argon time projection chamber}},
  journal = {Journal of Instrumentation},
  year = {2017},
  doi = {10.1088/1748-0221/12/03/p03011},
}
Figure