Introduction
In high-energy physics (HEP), experiments such as the Deep Underground Neutrino Experiment (DUNE) generate vast amounts of high-dimensional data. A fundamental task in analyzing this data is event classification: identifying neutrino flavors (electron, muon, or tau) based on the visual patterns of particle interactions within a detector. While Convolutional Neural Networks (CNNs) have become a standard tool for this task, they often function as "black boxes," lacking interpretability and showing sensitivity to changes in data resolution or detector conditions. This paper explores the adaptation of Vision-Language Models (VLMs) to provide a more robust and explainable alternative.
Methodology
The researchers adapted LLaMA 3.2 Vision 11B, a multimodal large language model, for neutrino event classification using a specialized fine-tuning and prompting pipeline.
Fine-tuning and Prompt Engineering
To manage the computational demands of an 11-billion-parameter model, the team employed Quantized Low-Rank Adaptation (QLoRA). This allowed for efficient training on consumer-grade hardware by updating only a small subset of the model's weights. The model was guided by a "System Prompt" that established its persona as a neutrino physicist, providing specific criteria for classification (e.g., identifying "fuzzy electron showers" for $\nu_e$ CC events). To ensure structured output, constrained decoding was used to force the model to lead its responses with a standardized classification prefix.
Experimental Setup
The study utilized a simulated dataset from a Liquid Argon Time Projection Chamber (LArTPC), consisting of 190,000 events across three categories: Electron neutrino ($\nu_e$) Charged Current, Muon neutrino ($\nu_\mu$) Charged Current, and Neutral Current (NC) interactions. The input data consisted of dual 512x512 grayscale pixel maps representing orthogonal XZ and YZ views of the particle tracks. A Siamese CNN architecture served as the baseline for comparison.
Results and Discussion
The fine-tuned VLM demonstrated significant improvements over traditional methods in both performance and interpretability.
Performance and Robustness
LLaMA 3.2 Vision achieved an accuracy of 87%, significantly higher than the Siamese CNN's 68%. More importantly, the VLM exhibited remarkable robustness. When tested on downsampled 256x256 images, the CNN's accuracy dropped precipitously to 49%, whereas the VLM maintained an accuracy of 85%. This suggests that the VLM leverages high-level semantic understanding of particle topologies rather than relying solely on local pixel patterns.
Explainability
A key advantage of the VLM approach is its ability to generate natural language justifications for its classifications. By articulating the features it identifies—such as the length and narrowness of a muon track—the model allows physicists to verify the reasoning behind a prediction, bridging the gap between raw data and scientific insight.
Conclusion
While the VLM offers superior accuracy and robustness, it introduces a significant computational trade-off, requiring substantially more VRAM and longer inference times than CNNs. Future work will focus on model distillation and the development of domain-specific foundation models to bring these advanced reasoning capabilities into real-time experimental triggers.
Summary updated