A Unified Interpretable Semantic Framework for Multi-Modal Fiber Sensing Under Data Scarcity

Khouloud AbdelliarXiv 2026 · arXiv

TL;DR

Researchers at Nokia Bell Labs have developed a unified framework that translates raw data from different fiber-optic sensing technologies into a shared "language" of physical descriptors. By using semantic reasoning and large language models (LLMs), the system achieves over 91% accuracy in event classification across multiple modalities without requiring massive labeled datasets or frequent model retraining.

What Problem Does This Paper Address?

Optical fiber sensing is a critical tool for monitoring everything from telecommunications infrastructure to industrial pipelines. However, the field is currently fragmented. Different sensing modalities—such as State-of-Polarization (SOP) monitoring, Distributed Acoustic Sensing (DAS), and Optical Time-Domain Reflectometry (OTDR)—measure fundamentally different physical quantities.

Traditionally, this has meant building separate, "black-box" machine learning models for each sensor. These models are data-hungry, difficult to interpret, and brittle; they often fail when deployed in new environments where labeled data is scarce. The authors address this by asking: Can we create a single, interpretable framework that works across all these sensors by focusing on the underlying physics of the events they detect?

Methods

The authors propose a four-stage Unified Semantic Inference Framework:

  1. Modality-Specific Feature Extraction: Raw signals (like Stokes parameters for SOP or backscatter traces for OTDR) are processed into numerical features.
  2. Feature-to-Semantic Abstraction: These features are mapped onto a shared set of five physics-grounded "semantic descriptors": Impulsiveness, Persistence, Spectral/Structural Profile, Complexity, and Energy Concentration. These are discretized into qualitative levels (Low, Medium, High).
  3. Semantic Inference: An LLM-based reasoning engine (using GPT-4o-mini) compares the observed semantic pattern against "class profiles" stored in a knowledge base. For example, a "Fiber Cut" in OTDR is semantically defined by high impulsiveness and high structural profile.
  4. Retrieval-Assisted Refinement: If the system’s confidence is low, it retrieves semantically similar labeled examples from a reference database to resolve ambiguity.
Fig. 1. Unified semantic framework for multi-modal fiber sensing. Modality-specific measurements are transformed into a shared semantic representation through feature extraction and semantic mapping, followed by retrieval-assisted semantic reasoning and knowledge-base adaptation.

Datasets

The framework was validated on three distinct real-world datasets:

  • SOP Disturbance Dataset: Data from a 2600-km transmission system involving mechanical perturbations like bending, shaking, and impacts.
  • DAS Field-Trial Dataset: Measurements from a 57-km deployed fiber link capturing background noise, jackhammers, and excavators.
  • OTDR Fault Dataset: Experimental data covering eight fault types, including fiber tapping, bad splices, and fiber cuts.

Key Insights and Ideas

  • Physics as a Universal Translator: While an OTDR trace looks nothing like a DAS vibration signature, a "sudden impact" exhibits high Impulsiveness in both. By moving from raw data to semantic attributes, the researchers created a "cross-modal" bridge.
  • Decoupling Reasoning from Sensing: By separating signal processing (modality-specific) from inference (modality-independent), the system can reason about new types of sensors or events without redesigning the core logic.
  • Knowledge Accumulation vs. Retraining: Unlike standard neural networks that require a full "retrain" to learn from new data, this system improves simply by adding new examples to its retrieval database. This makes it "operationally self-improving."
  • The "Why" Matters: Because the system uses semantic descriptors, it doesn't just output a label; it provides a human-readable rationale (e.g., "Classified as Fiber Cut due to abrupt signal loss and high structural profile").

Key Results

The framework demonstrated robust performance across the board, often outperforming traditional supervised models like Support Vector Machines (SVM) and Multi-Layer Perceptrons (MLP) despite the data-scarce conditions:

  • SOP Accuracy: 95.0%, outperforming an MLP (91.0%) and SVM (90.0%).
  • DAS Accuracy: 91.1% (achieved through retrieval-assisted adaptation), a significant jump from the 77.8% achieved with zero-shot reasoning alone.
  • OTDR Accuracy: 94.6%, exceeding the supervised SVM baseline (90.0%).
An example of interpretable inference for an OTDR fault, showing the transformation from raw trace to semantic descriptors and the final human-readable rationale.

Limitations and Future Work

While the framework is highly effective, the authors note a few areas for further development:

  • Calibration Dependency: The mapping from numerical features to "Low/Medium/High" semantic levels still requires modality-specific calibration thresholds based on domain knowledge.
  • Ambiguity in Field Conditions: In the DAS dataset, the system initially struggled to distinguish between background noise and jackhammers due to overlapping temporal characteristics, highlighting the need for the retrieval-assisted mechanism.
  • Future Directions: The authors suggest extending this to even more sensing modalities and exploring how this semantic approach can handle "novel" events that weren't part of the original training or profile definitions.

Summary updated

Abstract

We propose a unified interpretable semantic framework for multi-modal fiber sensing under data scarcity. The framework maps heterogeneous measurements from state of-polarization (SOP) monitoring, distributed acoustic sensing (DAS), and optical time-domain reflectometry (OTDR) into a shared set of physics-grounded semantic descriptors capturing impulsiveness, persistence, structural characteristics, and energy concentration. Inference is performed through reasoning over semantic class profiles, optionally assisted by retrieval of semantically similar examples to resolve ambiguity and support adaptation without model retraining. Experimental validation on real SOP, DAS, and OTDR datasets demonstrates robust performance across sensing modalities, achieving accuracies of 95.0%, 91.1%, and 94.6%, respectively, while providing transparent and physically interpretable decisions. The proposed framework establishes a unified and data efficient approach for optical fiber sensing in evolving and data scarce deployment environments.
BibTeX
@misc{abdelli2026unified,
  author = {Khouloud Abdelli},
  title = {{A Unified Interpretable Semantic Framework for Multi-Modal Fiber Sensing Under Data Scarcity}},
  year = {2026},
  eprint = {2611.16027},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.16027},
}
Figure