Conformal Risk Certificates for Portfolio Optimization Under Uncertainty: A Gated Reinforcement-Learning Approach

Mohammad Zarei, Amirhossein MohammadpourAzari, Moslem HabibiarXiv 2026 · arXiv

TL;DR

This paper introduces Gated Conformal Semantic Risk Control (Gated-CSRC), a neuro-symbolic framework that uses Large Language Models (LLMs) and conformal prediction to "certify" reinforcement learning (RL) portfolio trades. By extracting risk states from financial news and enforcing them through a geometric safety gate, the system eliminates nearly all semantic risk breaches (like over-exposure during a macro crisis) while retaining the high performance of RL agents.

What Problem Does This Paper Address?

Reinforcement learning has become a powerhouse for portfolio optimization, but it suffers from a "black box" problem that makes regulators nervous. Most RL agents are price-bound: they react to market movements that may have already been telegraphed in news reports or regulatory filings.

Furthermore, even when LLMs are used in trading, they are typically used to predict "alpha" (returns). The authors argue this is an epistemological mistake. A "fluent" LLM rationale isn't necessarily a calibrated one; it doesn't provide a frequentist guarantee that a portfolio will survive a sudden factor shock. There is a critical need for a pre-trade audit trail—a way to prove that a proposed trade respects a bounded risk envelope before capital is deployed, especially under the scrutiny of new regulations like the EU AI Act.

Methods

The authors propose a four-stage pipeline that separates the "return-seeking" proposal from the "risk-verifying" execution.

  1. Semantic Parsing: An instruction-tuned LLM (Llama-3-8B) reads daily financial news and extracts a structured "semantic risk state" (JSON) covering macro distress, liquidity strain, earnings pressure, and sector-specific risks.
  2. Certificate Construction: These states define the center and shape of an ellipsoidal "uncertainty set" of potential market shocks. Crucially, they use Conformal Prediction to calibrate the size (radius) of this set. By looking at past errors in similar "semantic buckets" (e.g., previous liquidity crises), the system determines a radius that offers a 90% empirical coverage guarantee.
  3. Gated Mechanism: A standard RL agent (PPO) proposes a raw trade. An Asymmetric Projection Gate checks if this trade would violate a worst-case semantic loss budget based on the certificate.
  4. Execution: If the trade is safe, it passes through. If it breaches the budget, a Second-Order Cone Programming (SOCP) solver "projects" the trade to the nearest feasible safe portfolio.
The Gated-CSRC pre-trade execution framework pipeline.

Datasets

The study evaluates the framework using:

  • Assets: Nine liquid U.S. Select Sector SPDR ETFs (covering Materials, Energy, Tech, etc.) from 2015 to 2023.
  • Text: The Financial News and Stock Price Integration Dataset (FNSPID), providing time-aligned news records.
  • Evaluation: A rolling walk-forward protocol where the model is trained on 48 months and tested on the subsequent 12 months, covering major events like the 2020 COVID-19 market crash.

Key Insights and Ideas

  • Language as Geometry: Instead of using text to predict prices, the authors use it to define the feasible region of a portfolio. Textual stress changes the "shape" of what a safe portfolio looks like.
  • Asymmetric Intervention: Unlike "Hard CSRC" which forces every trade through a solver, the Gated approach only intervenes when a breach is detected. This prevents "unnecessary correction" during calm periods, preserving the RL agent's native performance.
  • Auditability over Explanation: Post-hoc explanations (like attention maps) don't prove a trade was safe at the time it was made. Gated-CSRC creates a replayable decision trace: Document $\rightarrow$ Semantic State $\rightarrow$ Conformal Radius $\rightarrow$ Action.
  • Semantic Bucketing: The authors found that global "exchangeability" (the idea that the past always predicts the future) fails in finance. By calibrating the conformal radius within specific "semantic buckets" (e.g., only looking at past "high macro risk" days), the model adapts to different market regimes.

Key Results

The empirical results demonstrate a clear "safety premium":

  • Raw PPO: Achieved a strong 12.7% annual return but suffered a 4.05% semantic violation rate (trading aggressively when news suggested extreme risk).
  • Gated-CSRC: Reduced the violation rate to 0.00% while maintaining an 11.7% annual return.
  • The "Safety Premium": The 100-basis-point drop in return is the measurable cost of institutional-grade safety.
  • Statistical Significance: Exact McNemar testing confirmed the compliance gain at $p < 10^{-15}$, proving the result isn't just a fluke of the data.
  • Ablation: Traditional sentiment lexicons (like Loughran-McDonald) failed to reproduce this safety, proving that the contextual reasoning of the LLM is doing the heavy lifting.

Limitations and Future Work

  • Latency: The current system is designed for end-of-day rebalancing. Adapting rolling conformal calibration to high-frequency "streaming" news tapes remains a challenge.
  • LLM Hallucinations: While schema-validation helps, the system still relies on a single LLM pass. The authors suggest future work could use committee-based validation where multiple LLMs must agree on the risk state.
  • Fixed Geometry: The mapping from semantic fields to geometric shapes is currently a "frozen domain-prior." Future iterations could potentially learn these mappings dynamically.

Summary updated

Abstract

Reinforcement-learning portfolio policies can optimize allocations from prices, covariances, and prior positions, yet they lack a calibrated, replayable mechanism for certifying that a proposed allocation respects a bounded risk envelope before execution. Regulators increasingly expect automated portfolio systems to provide exactly this kind of pre-trade audit trail, interpretable risk limit, and human-oversight mechanism. Gated Conformal Semantic Risk Control addresses this gap by separating return-seeking allocation from text-conditioned downside-risk verification. An instruction-tuned language model maps timestamped disclosures into schema-validated semantic risk states over macro, liquidity, earnings, and sector channels. These states induce correlated ellipsoidal factor-shock uncertainty sets whose conformal radii are calibrated by rolling finite-sample prediction over localized semantic nonconformity buckets. An asymmetric second-order cone gate then checks each raw PPO proposal against a certified worst-case semantic loss budget. The gate stays inactive for compliant proposals and intervenes only when that budget is exceeded. In walk-forward out-of-sample tests on nine liquid U.S. Select Sector SPDR ETFs, Raw PPO earns a 12.7% annual return while incurring a 4.05% semantic violation rate. Gated-CSRC removes all observed out-of-sample semantic limit breaches while retaining an 11.7% annual return. This 100-basis-point auditable safety premium is smaller than the yield loss imposed by unconditional hard projection, and exact McNemar testing confirms the compliance gain at $p < 10^{-15}$. Loughran-McDonald lexicon controls and time-shuffled text controls fail to reproduce this certificate.
BibTeX
@misc{zarei2026conformal,
  author = {Mohammad Zarei and Amirhossein MohammadpourAzari and Moslem Habibi},
  title = {{Conformal Risk Certificates for Portfolio Optimization Under Uncertainty: A Gated Reinforcement-Learning Approach}},
  year = {2026},
  eprint = {2611.14699},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.14699},
}
Figure