Conformal Risk Control for QoT-Aware Lightpath Feasibility Under Technology-Driven Domain Shift

Kiarash Rezaei, Omran Ayoub, Paolo Monti, Carlos Natalino

TL;DR

This paper introduces a framework to make AI-based optical network models "trustworthy" after technology upgrades without needing to retrain them. By wrapping a fixed regressor in a Conformal Risk Control (CRC) layer, the authors provide statistical guarantees on prediction reliability, boosting decision accuracy from 85% to over 99% under severe network shifts.

What Problem Does This Paper Address?

In modern optical networks, operators use AI/ML models to predict the Quality of Transmission (QoT)—essentially, will a lightpath (LP) work before we turn it on? Usually, these models provide a "point prediction" (e.g., "The OSNR will be 20 dB").

The problem is twofold:

  1. Silent Failure: Point predictions don't tell you how confident the model is.
  2. Domain Shift: Networks evolve. If you upgrade your amplifiers or fiber types, a model trained on the "old" network becomes inaccurate. This is a "domain shift," and the model won't tell you it's suddenly guessing wrong.

While retraining (Transfer Learning) is an option, it requires model access and significant computational effort. This paper asks: Can we keep our old model but add a "safety wrapper" that guarantees its reliability in the new environment?

Methods

The authors propose a three-layer post-hoc framework that leaves the original AI model untouched:

  1. The Base Regressor: A fixed, pre-trained XGBoost model that predicts a QoT metric (like OSNR).
  2. The CRC Layer: This is the core innovation. It uses a small "calibration set" of data from the new network. Using a statistical procedure called Learn Then Test (LTT), it calculates an uncertainty band ($B_{\lambda^*}$) around the point prediction. This band comes with a finite-sample guarantee: the true QoT value will fall within this band at least $(1-\alpha)$ of the time with high confidence.
  3. The Policy Layer: This translates the uncertainty band into a binary "Feasible" or "Infeasible" decision. They propose two policies:
  4. Risk-Averse (RA): Only accepts a lightpath if even the bottom of the uncertainty band is above the threshold.
  5. Efficiency-Oriented (EO): Accepts if the top of the band is above the threshold, prioritizing network utilization.
Fig. 1: Overview of the proposed CRC decision-support framework. An AI/ML regressor predicts the QoT of an LP from its feature vector. The CRC layer uses calibration set and LTT to construct the uncertainty band Bλ⋆, which is then mapped to a feasibility decision by the RA and EO policies with respect to the threshold τ.

Datasets

The study utilizes the open SDM QoT dataset based on the CONUS topology. It covers 17 different "source-to-target" scenarios involving upgrades in:

  • Fiber: Bundled single-mode vs. multicore fiber.
  • Amplifiers: Standard EDFA vs. SDM-amplified systems.
  • Switching: Independent vs. joint switching architectures.

Key Insights and Ideas

  • Amplifiers are the Culprits: By using "feature shift contribution scores," the authors found that amplifier upgrades cause the most significant disruptions to model accuracy, primarily affecting link occupation and spectrum-related features.
Fig. 2: Average feature shift heatmap of Cj across source–target shift families. Features are grouped by the characteristic they represent: length, link occupation, topology, and spectrum. Feature abbreviations: PL = path length, LL = link length, LO = link occupation, NL = number of links, NS = number of spans, SD = source node degree, DD = destination node degree, CF = carrier frequency, and AC = active channels.
  • Guarantees over Heuristics: Unlike standard Quantile Regression (QR), which often fails to maintain its promised coverage after a domain shift, the CRC/LTT approach provides a rigorous statistical guarantee that holds even with small calibration datasets.
  • Zero-Shot to Hero: The framework allows a "zero-shot" model (one that has never seen the new technology) to perform nearly as well as a fully retrained model, simply by adjusting its "caution" based on the calibration data.

Key Results

  • Reliability: In 170 trials across 17 different domain shifts, the CRC uncertainty bands met the 90% target coverage 100% of the time. In contrast, the baseline Quantile Regression (QR) met the target in zero trials.
  • Accuracy Boost: Under severe domain shifts, the Efficiency-Oriented (EO) policy improved feasibility-decision accuracy from ~85% (Zero-Shot) to over 99%, effectively matching the performance of Transfer Learning without the overhead of retraining.
  • Data Efficiency: The system became stable with as few as 1,000 calibration samples, making it practical for real-world deployment immediately after a network upgrade.

Limitations and Future Work

  • Exchangeability Assumption: The math relies on the calibration data being representative of future test data. If the network continues to "drift" (e.g., due to aging) after calibration, the guarantees may degrade.
  • Symmetric Bands: Currently, the uncertainty bands are symmetric (e.g., $\pm 2$ dB). The authors suggest that asymmetric bands (e.g., $+1$ dB / $-3$ dB) might be more efficient, as domain shifts often push errors in a specific direction.
  • Dynamic Environments: Future work could explore "rolling calibration" to handle evolving noise conditions or gradual component degradation.

Summary updated

Abstract

Artificial intelligence and machine learning (AI/ML)-based regression models support operational decision-making in optical networks but typically expose only point predictions, which carry no statistically controlled information about their reliability. This paper proposes a post-hoc conformal risk control (CRC) framework that keeps a pretrained AI/ML regressor fixed, provides a finite-sample guarantee on uncertainty band miscoverage, and maps the band to operational decisions through policy rules. The guarantee applies to interval miscoverage, while decision-error rates are evaluated empirically. We instantiate the framework for quality of transmission (QoT)-aware lightpath (LP) feasibility assessment, in which a regressor predicts optical signal-to-noise ratio (OSNR) under domain shifts caused by fiber, amplifier, and switching upgrades. Feature shift contribution scores identify the LP features whose relation to QoT changes the most across a technology transition, and two policies translate the bands into feasibility decisions, allowing operators to tune the trade-off between conservatively rejecting or aggressively accepting LP realizations. Experiments on open space-division multiplexing (SDM) QoT datasets over the CONUS topology show that, for a target coverage of 90%, the uncertainty bands meet the target in all 170 trials spanning 17 domain shifts and ten calibration-test partitions, whereas a source-only quantile regression (QR) baseline meets it in none. Under severe shifts, the efficiency-oriented (EO) policy empirically improves zero-shot (ZS) feasibility-decision accuracy from about 85% to above 99%, approaching a transfer learning (TL) policy while avoiding retraining. The framework provides finite-sample control of uncertainty band miscoverage for regression-based optical network decision support, with potential applications beyond QoT-aware LP feasibility assessment.
BibTeX
@misc{rezaei2026conformal,
  author = {Kiarash Rezaei and Omran Ayoub and Paolo Monti and Carlos Natalino},
  title = {{Conformal Risk Control for QoT-Aware Lightpath Feasibility Under Technology-Driven Domain Shift}},
  year = {2026},
  eprint = {2611.13893},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.13893},
}
Figure