Deep Learning for Beamforming in Multi-User Continuous Aperture Array (CAPA) Systems

Jia Guo, Yuanwei Liu, Hyundong Shin, Arumugam NallanathanarXiv 2024 · DOI · arXiv

This paper, recently accepted for IEEE Globecom 2024, introduces a novel deep learning approach to one of the most promising but mathematically daunting technologies for 6G: Continuous Aperture Arrays (CAPA).

TL;DR

The authors propose DeepCAPA, a framework that uses Graph Neural Networks (GNNs) to optimize beamforming in continuous antenna surfaces. By proving that optimal beamforming solutions lie in a finite subspace and using auxiliary "proxy" networks to handle complex integrals, they achieve higher spectral efficiency and orders-of-magnitude faster inference than traditional numerical methods.

What Problem Does This Paper Address?

As we move toward 6G, researchers are looking beyond "massive MIMO" (which uses many discrete antennas) toward Holographic MIMO or Continuous Aperture Arrays (CAPA). Instead of separate antenna elements spaced half a wavelength apart, CAPA uses a nearly continuous metasurface to transmit signals. This promises the "ultimate" capacity limit for wireless channels.

However, CAPA introduces a massive computational headache: Functional Optimization.

  1. Infinite Dimensions: In traditional systems, beamforming is a vector (finite). In CAPA, it is a continuous current distribution function (infinite-dimensional). Standard Deep Neural Networks (DNNs) cannot handle infinite-dimensional inputs or outputs.
  2. No Closed-Form Loss: Training a DNN usually requires a clear mathematical "loss function." In CAPA, the objective functions (like Spectral Efficiency) involve complex integrals over the surface area that don't have closed-form expressions, making it impossible to use standard gradient descent (backpropagation).

Methods

The authors tackle these challenges with a three-pronged strategy:

  • Dimensionality Reduction via Math: They mathematically prove that the optimal beamforming function always lies in a subspace spanned by the users' conjugate channel responses. This allows them to represent an "infinite" function using a finite set of coefficients ($b_{jk}$), which a DNN can process.
  • The DeepCAPA Architecture: They split the task into three specialized networks:
  • PolicyNet: Learns the mapping from user locations to beamforming coefficients.
  • ProjNet: An auxiliary network that learns to approximate the power constraint integrals.
  • ValueNet: An auxiliary network that approximates the Spectral Efficiency (SE) integrals.
  • Symmetry-Aware GNNs: The authors prove that the beamforming problem has a property called Permutation Equivariance (PE)—essentially, if you swap the labels of two users, their beamforming solutions should swap accordingly. They designed their architecture as a Graph Neural Network (GNN) to bake this physical symmetry into the model, which significantly improves learning efficiency.
  • Alternative Training: To solve the "no closed-form loss" problem, they use the ProjNet and ValueNet as "differentiable proxies." They train these proxies to mimic the complex integrals, allowing gradients to flow back to the PolicyNet during training.

Datasets

The paper uses synthetically generated datasets based on a Line-of-Sight (LoS) channel model for CAPA systems.

  • Training Set: Up to 50,000 samples of user locations and corresponding channel responses.
  • Scenarios: Evaluated with $K=4$ and $K=8$ users in a downlink system.
  • Benchmarks: Compared against Match-Filtering (MF), WMMSE (a standard iterative optimizer), and a state-of-the-art Fourier-based discretization method.

Key Insights and Ideas

  • The Subspace Shortcut: The most critical "aha" moment is the proof that you don't need to search the entire infinite space of functions. By focusing only on the subspace of channel responses, the authors turned a functional optimization problem into a parameter optimization problem.
  • Neural Integrals: Using DNNs (ProjNet/ValueNet) to approximate integrals is a clever workaround for the "black box" nature of CAPA math. It allows the system to be trained end-to-end without needing a human to solve the calculus first.
  • Graph Modeling Matters: The authors show that "heuristic" graph modeling (just connecting nodes) can lead to a "property mismatch." By systematically modeling the graph based on the mathematical properties of the optimization problem, the GNN performs much better than a standard fully connected network.

Key Results

  • Spectral Efficiency (SE): DeepCAPA achieved higher SE than both Match-Filtering and the Fourier-based method. It also approached the theoretical upper bound of discrete arrays as the number of antennas tends toward infinity.
  • Inference Speedup: This is the most dramatic result. DeepCAPA's inference time was approximately 0.02 seconds. In contrast, the WMMSE algorithm took ~43 seconds, and the Fourier-based method took over 300 seconds. This makes DeepCAPA viable for real-time 6G applications.
  • Sample Efficiency: Because the GNN exploits permutation symmetry, it requires significantly fewer training samples to reach high performance compared to a standard MLP (FNN).

Limitations and Future Work

  • Line-of-Sight Only: The current channel model assumes only LoS paths. Real-world environments with heavy multipath scattering (like urban "canyons") will require more complex channel modeling.
  • Hardware Realities: While CAPA is theoretically continuous, actual hardware implementations (metasurfaces) are still composed of very small, discrete meta-atoms. The gap between "nearly continuous" and "mathematically continuous" needs further exploration.
  • Future Directions: The authors suggest extending this framework to optimize for Energy Efficiency (EE) and incorporating joint user scheduling and power allocation.

Summary updated

Abstract

A DeepCAPA (Deep Learning for Continuous Aperture Array (CAPA)) framework is proposed to learn beamforming in CAPA systems. The beamforming optimization problem is firstly formulated, and it is mathematically proved that the optimal beamforming lies in the subspace spanned by users' conjugate channel responses. Two challenges are encountered when directly applying deep neural networks (DNNs) for solving the formulated problem, i) both the input and output spaces are infinite-dimensional, which are not compatible with DNNs. The finite-dimensional representations of inputs and outputs are derived to address this challenge. ii) A closed-form loss function is unavailable for training the DNN. To tackle this challenge, two additional DNNs are trained to approximate the operations without closed-form expressions for expediting gradient back-propagation. To improve learning performance and reduce training complexity, the permutation equivariance properties of the mappings to be learned are mathematically proved. As a further advance, the DNNs are designed as graph neural networks to leverage the properties. Numerical results demonstrate that: i) the proposed DeepCAPA framework achieves higher spectral efficiency and lower inference complexity compared to match-filtering and state-of-art Fourier-based discretization method, and ii) DeepCAPA approaches the performance upper bound of optimizing beamforming in the spatially discrete array-based system as the number of antennas in a fixed-sized area tends toward infinity.
BibTeX
@misc{guo2024deep,
  author = {Jia Guo and Yuanwei Liu and Hyundong Shin and Arumugam Nallanathan},
  title = {{Deep Learning for Beamforming in Multi-User Continuous Aperture Array (CAPA) Systems}},
  year = {2024},
  eprint = {2411.09104},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2411.09104},
}
Figure