Understanding distributional ambiguity via non-robust chance constraint

Shumin Ma, Cheuk Hang Leung, Qi Wu, Wei Liu, Nanbo Peng

TL;DR

This paper bridges the gap between abstract "ambiguity sets" in Distributionally Robust Optimization (DRO) and practical business decisions by reformulating DRO problems as non-robust chance-constrained optimization (CCO) problems. This allows decision-makers to interpret the size of uncertainty sets in terms of familiar risk preferences like loss thresholds and probabilities, particularly for heavy-tailed financial data.

What Problem Does This Paper Address?

In many real-world applications, especially in finance, we face uncertainty about the true underlying data distribution. Distributionally Robust Optimization (DRO) is a powerful framework to handle this by optimizing for the worst-case scenario within a defined "ambiguity set" of possible distributions. However, a major hurdle is interpreting the size of this ambiguity set, often defined by abstract parameters like the "ambiguity radius" or divergence measures (e.g., KL divergence). These parameters lack direct business meaning, making it difficult for decision-makers to choose appropriate levels of robustness. Furthermore, traditional DRO methods often struggle with heavy-tailed distributions common in finance. This paper aims to make DRO more interpretable and applicable to heavy-tailed data by connecting it to chance-constrained optimization (CCO), which uses more intuitive risk parameters.

Methods

The core of this paper lies in establishing theoretical connections between DRO and CCO.

  1. Reformulating DRO as Mean-Deviation Problems: The authors show that for a general class of $\phi$-divergences, a DRO problem can be asymptotically equivalent to a mean-deviation problem. Crucially, the ambiguity radius in the DRO problem now directly controls the risk preference in this new formulation, offering a more interpretable way to manage uncertainty.
  2. Connecting DRO to CCO:
    • When decision variables have a boundedness constraint, a DRO problem can be precisely cast as a CCO problem without distributional uncertainty.
  3. When decision variables are unbounded, the CCO problem consistently outperforms the DRO problem, regardless of the ambiguity set size, divergence measure, or tail heaviness of the data.
  4. High-Order Expansion: To handle heavy-tailed distributions (which KL divergence struggles with), the paper utilizes high-order expansions of the $\phi$-divergence. This allows the framework to accommodate divergence measures like the Cressie-Read divergence, which are suitable for heavy tails (e.g., student's t-distribution, log-normal distribution).
  5. Portfolio Selection as a Case Study: The authors apply their framework to the portfolio selection problem, a common financial application. They derive explicit formulas for optimal strategies under both DRO and CCO formulations and compare their performance.

Datasets

The paper uses a combination of synthetic and real-world datasets for evaluation:

  • Synthetic Data: Used to test the accuracy of the 2nd and 4th order reformulations of the DRO problem and to analyze the impact of tail heaviness on the interpretation of the ambiguity radius.
  • Empirical Daily Asset Returns: Data from four major asset classes (Equity indexes, US Treasuries, Currencies, Commodities) over 40 years. This data is known to exhibit heavy tails, making it suitable for testing the paper's approach with Cressie-Read divergence.
  • High-Frequency Intraday Stock Returns: 5-minute returns from 15 Hang Seng Index constituent stocks over a 3-year period. This dataset is used to study how the equivalent ambiguity radius changes with increasing data availability and to demonstrate the practical value of robust protection in dynamic portfolio rebalancing.

Key Insights and Ideas

  • Bridging the Gap: Ambiguity Radius to Risk Preference: The most significant insight is translating the abstract "ambiguity radius" of DRO into concrete business terms like "loss threshold" and "probability of loss" in CCO. This makes DRO much more accessible and actionable for decision-makers.
  • Heavy Tails are Key: The paper emphasizes the importance of handling heavy-tailed distributions, which are prevalent in finance. Their use of $\phi$-divergences beyond KL divergence is crucial for this.
  • CCO Outperforms DRO (in some cases): The finding that CCO performs uniformly better than DRO when decision variables are unbounded is counter-intuitive and highlights the potential limitations of traditional DRO in certain scenarios.
  • Data Availability Matters: For a given level of tail probability protection, more data leads to a smaller required ambiguity set (smaller $p$), as uncertainty decreases with more information.
  • Tail Heaviness Demands Larger Ambiguity Sets: To achieve the same level of tail probability protection, DRO problems centered around heavy-tailed distributions require larger ambiguity sets compared to those centered around lighter-tailed distributions.

Key Results

  • Theoretical Equivalence: The paper establishes theoretical equivalences between DRO and mean-deviation problems, and between DRO and CCO problems under specific conditions.
  • Portfolio Optimization Performance: In empirical tests using portfolio selection, the dynamic allocation strategy derived from the DRO framework consistently outperformed strategies based on the nominal distribution or the classical Mean-Variance framework. This outperformance could be substantial (up to 7 times higher returns in some cases).
  • Interpretation of Ambiguity Radius: Tables and figures demonstrate how the ambiguity radius $p$ can be mapped to equivalent CCO parameters $(\epsilon, \delta)$ for various asset classes and data distributions. For instance, Table 3 shows that for equity, an ambiguity radius of $3.5 \times 10^{-4}$ (with a student t-distribution) is equivalent to a 2% chance of loss below a 3.35% threshold.
  • Impact of Tail Heaviness: Figure 1 clearly shows that for the same level of tail probability protection ($\epsilon$), distributions with heavier tails (Lognormal, Student t3) require a larger loss threshold ($\delta$) compared to a Normal distribution.

Limitations and Future Work

  • Approximation Accuracy: While high-order expansions are used, the paper acknowledges that these are approximations. The accuracy of the 2nd and 4th order reformulations is tested, but higher orders might be needed for extreme cases.
  • Computational Complexity: Solving CCO problems can still be computationally intensive, especially for high-dimensional problems, although they are often more tractable than DRO.
  • Generalizability of CCO Outperformance: The finding that CCO outperforms DRO when strategies are unbounded is significant but might depend on the specific utility function and constraints. Further exploration of this is suggested.
  • Future Work: The authors suggest exploring more complex sets $X$ (beyond the simple unbounded and bounded cases) and using numerical analysis to further investigate the interpretation of the ambiguity radius through chance constraints. They also hint at the potential for this framework to be applied to other robust optimization problems beyond portfolio selection.

Summary updated

Abstract

This paper provides a non-robust interpretation of the distributionally robust optimization (DRO) problem by relating the distributional uncertainties to the chance probabilities. Our analysis allows a decision-maker to interpret the size of the ambiguity set, which is often lack of business meaning, through the chance parameters constraining the objective function. We first show that, for general ϕ-divergences, a DRO problem is asymptotically equivalent to a class of mean-deviation problems. These mean-deviation problems are not subject to uncertain distributions, and the ambiguity radius in the original DRO problem now plays the role of controlling the risk preference of the decision-maker. We then demonstrate that a DRO problem can be cast as a chance-constrained optimization (CCO) problem when a boundedness constraint is added to the decision variables. Without the boundedness constraint, the CCO problem is shown to perform uniformly better than the DRO problem, irrespective of the radius of the ambiguity set, the choice of the divergence measure, or the tail heaviness of the center distribution. Thanks to our high-order expansion result, a notable feature of our analysis is that it applies to divergence measures that accommodate well heavy tail distributions such as the student t-distribution and the lognormal distribution, besides the widely-used Kullback-Leibler (KL) divergence, which requires the distribution of the objective function to be exponentially bounded. Using the portfolio selection problem as an example, our comprehensive testings on multivariate heavy-tail datasets, both synthetic and real-world, shows that this business-interpretation approach is indeed useful and insightful.
BibTeX
@inproceedings{ma2019understanding,
  author = {Shumin MA and Cheuk Hang LEUNG and Qi WU and Wei Liu and Nanbo PENG},
  title = {{Understanding distributional ambiguity via non-robust chance constraint}},
  booktitle = {ICAIF},
  year = {2019},
  doi = {10.1145/3383455.3422522},
}
Figure