Loss Control with Rank-one Covariance Estimate for Short-term Portfolio Optimization

Zhao-Rong Lai, Liming Tan, Xiaotian Wu, Liangda FangJMLR 2020 · OpenReview

TL;DR

This paper tackles the challenge of short-term portfolio optimization (SPO) in dynamic financial markets where traditional covariance estimates fail due to limited data. The authors introduce a novel rank-one covariance estimate and a corresponding loss control scheme (SPOLC) that effectively captures instantaneous risk and avoids extreme losses, achieving state-of-the-art performance across various risk and return metrics.

What Problem Does This Paper Address?

Short-term portfolio optimization (SPO) is notoriously difficult because financial characteristics like expected returns and covariances are constantly changing. This means we only have a small window of recent data ($w$) to make decisions, which is often much smaller than the number of assets ($d$). This "undersampled" condition, coupled with the fact that asset returns don't follow strict statistical distributions, renders traditional covariance estimation methods unreliable. These methods, designed for stable, well-sampled data, become statistically inefficient and inconsistent, leading to poor risk measurement and vulnerability to extreme losses. The paper aims to bridge this gap by developing a robust covariance estimation technique and a loss control strategy specifically for the challenging SPO environment.

Methods

The core innovation lies in reframing covariance estimation not as a statistical problem but as an operator problem within the space of symmetric matrices ($S^d$). The authors propose:

  • Rank-Related Structure Investigation: They delve into the rank-related structure of $S^d$, analyzing determinantal varieties and tangent spaces. This allows them to decompose the space into orthogonal components, isolating the most significant risk information.
  • Rank-One Covariance Estimate ($\hat{\Sigma}_{RO}$): By focusing on the "principal rank-one tangent space" (the one that captures the most significant risk structure), they derive a novel rank-one covariance estimate. This estimate is derived from the Gram matrix $S = X^TX$ and leverages the dominant spectral component.
  • Loss Control Scheme (SPOLC): This estimate is then integrated into a loss control optimization framework. The objective is to maximize the minimum increasing factor across the recent trading window, effectively hedging against worst-case scenarios. This is formulated as a quadratic programming problem.

Datasets

The authors evaluate their proposed method on 7 benchmark datasets:

  • Daily Stock Data: Dow Jones Industrial Average (DJIA), Standard & Poor 500 (SP500), Toronto Stock Exchange (TSE), China Stock Index 300 (HS300), and NYSE19 (a newly constructed dataset of 47 NYSE stocks).
  • Daily Fund Data: FOF (a newly constructed dataset of 24 Chinese mutual funds).
  • Monthly Portfolio Data: FRENCH (32 North American portfolios from Kenneth R. French's Data Library).

Key Insights and Ideas

  • Covariance as an Operator: Shifting the perspective from statistical estimation to operator theory is crucial for handling undersampled and non-Gaussian financial data.
  • Rank-One Dominance: In SPO, the most significant risk information is often concentrated in a single "principal rank-one tangent space," making a rank-one estimate highly effective.
  • Orthogonal Decomposition: Decomposing the space of symmetric matrices into orthogonal components allows for the isolation of meaningful risk structures from noise.
  • Worst-Case Optimization: Directly optimizing for the minimum increasing factor (worst-case performance) provides robust downside risk control.

Key Results

The proposed SPOLC system demonstrates superior performance across various metrics:

  • Extreme Losses and Downside Risk: SPOLC achieves state-of-the-art performance in controlling extreme losses and downside risk, consistently outperforming other SPO systems in Value at Risk (VaR), Downside Semideviation (DSDV), and Maximum Drawdown (MDD) across most datasets. For instance, it achieves the highest VaRs at confidence levels of 90% and 95%.
  • Investing Incomes: SPOLC also shows competitive investing incomes, outperforming passive strategies (Market, 1/d) and other active SPO systems in Cumulative Wealth (CW) and Mean Excess Return (MER) on daily datasets.
  • Risk-Adjusted Returns: Metrics like Calmar Ratio (CR), Sharpe Ratio (SR), and Information Ratio (IR) show SPOLC is competitive in trading off risk and return, often achieving high rankings.
  • Robustness: SPOLC demonstrates robustness to transaction costs and is computationally efficient, making it suitable for practical applications.
  • Covariance Estimate Comparison: The proposed rank-one covariance estimate ($\hat{\Sigma}_{RO}$) significantly outperforms the traditional unbiased covariance ($\hat{\Sigma}_{UB}$), the Gram matrix ($S=X^TX$), and the Nonlinear Shrinkage of the Covariance Matrix (NSCM) method in the SPO context.

Limitations and Future Work

  • Transaction Costs: The current model considers only fixed-rate transaction costs, not bid-ask spreads, which are also important in real-world trading.
  • Illiquid Assets: The datasets used might contain some illiquid assets, which could potentially inflate results.
  • Unified SPO/LPO Framework: The authors suggest that exploring a unified framework for both short-term (SPO) and long-term (LPO) portfolio optimization is an interesting avenue for future research.

Summary updated

Abstract

In short-term portfolio optimization (SPO), some financial characteristics like the expected return and the true covariance might be dynamic. Then there are only a small window size $w$ of observations that are sufficiently close to the current moment and reliable to make estimations. $w$ is usually much smaller than the number of assets $d$, which leads to a typical undersampled problem. Worse still, the asset price relatives are not likely subject to any proper distributions. These facts violate the statistical assumptions of the traditional covariance estimates and invalidate their statistical efficiency and consistency in risk measurement. In this paper, we propose to reconsider the function of covariance estimates in the perspective of operators, and establish a rank-one covariance estimate in the principal rank-one tangent space at the observation matrix. Moreover, we propose a loss control scheme with this estimate, which effectively catches the instantaneous risk structure and avoids extreme losses. We conduct extensive experiments on $7$ real-world benchmark daily or monthly data sets with stocks, funds and portfolios from diverse regional markets to show that the proposed method achieves state-of-the-art performance in comprehensive downside risk metrics and gains good investing incomes as well. It offers a novel perspective of rank-related approaches for undersampled estimations in SPO.
BibTeX
@article{lai2020loss,
  author = {Zhao-Rong Lai and Liming Tan and Xiaotian Wu and Liangda Fang},
  title = {{Loss Control with Rank-one Covariance Estimate for Short-term Portfolio Optimization}},
  journal = {J. Mach. Learn. Res.},
  year = {2020},
  url = {https://openreview.net/forum?id=YaRSmHobC8},
}
Figure