Conditional Asset Pricing Transformer

Hao Fu, Xinbing Kong, Zeyu Li, Junfan MaoarXiv 2026 · arXiv

TL;DR

The Conditional Asset Pricing Transformer (CAP-T) leverages the "attention" mechanism to capture complex, non-linear interactions between different firms to predict stock returns. By decomposing returns into risk-based compensation and conditional mispricing (alpha), it provides a high-performance forecasting tool that is also economically interpretable.

What Problem Does This Paper Address?

In the world of finance, "factor models" are the bread and butter of asset pricing. They assume that a stock's return is driven by its exposure to certain broad risks (like the overall market or firm size). However, traditional models have two major blind spots:

  1. Linearity: They often assume relationships are simple and linear, missing the "non-linear" reality of financial markets.
  2. Firm Isolation: Most models look at a firm’s characteristics (like profitability) in a vacuum. In reality, firms exist in a web of competition, supply chains, and shared economic environments. A tech company’s profitability means something different when its competitors are struggling versus when the whole sector is booming.

The authors tackle these gaps by asking: Can we use the Transformer architecture—the same tech behind LLMs—to "attend" to the entire cross-section of the market and better separate risk from mispricing?

Methods

The authors introduce a multi-stage framework called CAP-T. The core innovation is using cross-firm attention to allow the characteristics of one firm to inform the expected returns of another.

The process follows a sophisticated pipeline:

  1. Initial Estimation: A transformer learns the overall conditional expected returns for all firms simultaneously.
  2. Local Factor Discovery: Using a technique called Kernel-Weighted Principal Component Analysis (PCA) on the residuals of the first stage, the model identifies the "local factor loading space"—essentially finding the hidden risk dimensions currently active in the market.
  3. Structural Decomposition: The expected returns are projected onto this risk space. This mathematically separates the return into two distinct targets: Factor Risk Compensation (what you get paid for taking known risks) and Conditional Mispricing (the "alpha" or extra return not explained by risk).
  4. Component Learning: Two separate transformers are then trained to predict these specific components. This is crucial because the relationships that drive risk might be totally different from those that drive mispricing.
  5. Theoretical Grounding: Unlike many "black box" AI papers, this one provides rigorous statistical guarantees. They use manifold approximation theory to show that the model's complexity is governed by the intrinsic dimension of the market state, not just the raw number of input variables.

Datasets

The paper evaluates CAP-T using two primary sources:

  • Simulated Data: A synthetic panel of 120 firms over 600 periods with known non-linear risk exposures to test if the model can actually recover the "ground truth."
  • U.S. Equities: A massive monthly panel spanning 1965 to 2020. It includes 167 firms (after filtering for data consistency) and 150 firm characteristics drawn from CRSP and Compustat (e.g., valuation ratios, momentum, investment growth).

Key Insights and Ideas

  • Attention as an Economic Map: The "aha" moment comes from visualizing the attention weights. Without being given any industry labels, the model's attention mechanism naturally clustered firms with documented economic links—like Boeing and its supplier Curtiss-Wright, or pharmaceutical giants Abbott and Pfizer.
  • The "Intrinsic Dimension" Advantage: The authors show that while the market has thousands of data points (ambient dimension), it actually moves on a much lower-dimensional "manifold" (intrinsic dimension). CAP-T is designed to exploit this geometry, making it more efficient than standard neural networks.
  • Information Specialization: The model reveals that different data "signals" matter for different components. Market-related characteristics (like volatility) dominate risk prediction, while valuation and investment metrics (like dividend yield or inventory growth) are the primary drivers of the alpha (mispricing) component.

Key Results

CAP-T significantly outperforms existing benchmarks like Instrumented PCA (IPCA) and "DNN-varying" models:

  • Sharpe Ratio: In a long-only portfolio strategy, CAP-T achieved a net annualized Sharpe ratio of 0.85, compared to 0.69 for the best-performing deep learning benchmark and 0.67 for IPCA.
  • Predictive Accuracy ($R^2$): The model maintained positive out-of-sample $R^2$ for both total returns and individual components across various market conditions, whereas traditional models often struggled to stay positive.
  • Robustness: The performance gains held steady whether the model used ReLU or Softmax attention, and across different "depths" (number of layers) of the transformer.

Limitations and Future Work

The authors identify a few areas for growth:

  • Structured Data Only: Currently, the model relies on pre-calculated financial ratios. A natural next step is to feed the transformer "unstructured" data like financial news text or satellite imagery of retail parking lots.
  • Inference Uncertainty: While the paper provides error bounds, the authors note that accounting for uncertainty across multiple learning stages (multistep estimation) remains a complex econometric challenge.
  • Firm Universe: The empirical study focused on a balanced panel of 167 firms for statistical clarity; scaling this to the thousands of stocks in the broader market while maintaining the "cross-firm attention" computational efficiency is a likely future engineering hurdle.

Summary updated

Abstract

In this paper, we propose a conditional asset pricing transformer (CAP-T) that captures nonlinear interactions among firms through attention to forecast excess returns. In the first stage, a transformer estimates conditional expected returns, and kernel-weighted principal component analysis of its residuals estimates the local factor loading space. Projecting the conditional mean onto this space separates factor risk compensation from conditional mispricing. Then, in the second stage, separate transformers learn these two components, whose predictions are combined to forecast returns. As a result, the proposed framework decomposes returns into conditional mispricing, factor risk compensation, a centered factor component, and an unpredictable innovation. We establish approximation and generalization bounds and characterize how first-stage prediction errors propagate through local factor estimation and component learning, providing statistical guaranties for conditional mispricing, factor loadings, and factor risk premia. Finally, simulations and empirical studies demonstrate the predictive and interpretive benefits of the proposed method.
BibTeX
@misc{fu2026conditional,
  author = {Hao Fu and Xinbing Kong and Zeyu Li and Junfan Mao},
  title = {{Conditional Asset Pricing Transformer}},
  year = {2026},
  eprint = {2611.19783},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.19783},
}
Figure