Joint Beamforming and Phase Shifts Design for RIS-Aided Multi-User Full-Duplex Systems in Smart Cities

Kunbei Pan, Bin Zhou, Wei Zhang, Cheng JuSensors 2023 · DOI

TL;DR

This paper tackles the challenge of maximizing spectral efficiency in urban smart city wireless networks by jointly optimizing beamforming and Reconfigurable Intelligent Surface (RIS) phase shifts in a Full-Duplex (FD) system. They propose a novel two-step algorithm combining successive convex approximation (SCA) and soft actor-critic (SAC) deep reinforcement learning to efficiently handle complex interference scenarios, outperforming existing methods.

What Problem Does This Paper Address?

The paper addresses the limitations of current wireless communication systems, particularly in the context of 6G and the Internet of Things (IoT) in smart cities. While Full-Duplex (FD) technology promises to double spectral efficiency (SE) by allowing simultaneous transmission and reception, it suffers from self-interference (SI). Reconfigurable Intelligent Surfaces (RIS) offer a promising solution to enhance signal coverage and quality with low power consumption. However, combining FD and RIS introduces new challenges, specifically "loop-interference" (LI) from the RIS reflecting signals back to the FD base station. In complex urban environments with blockages and reflections, this LI, combined with residual SI, can significantly degrade performance, negating the benefits of FD-RIS systems. The paper aims to overcome these interference issues by jointly optimizing system parameters in realistic urban outdoor scenarios.

Methods

The authors propose a two-step optimization approach to tackle the non-convex problem of maximizing spectral efficiency.

  1. Beamforming Design (Subproblem 1): This subproblem focuses on optimizing the transmitting and receiving beamforming matrices. To handle the non-convexity, they employ a Successive Convex Approximation (SCA) technique. This involves approximating the objective function and constraints with convex lower bounds, transforming the problem into a solvable convex optimization problem that can be addressed using tools like CVX.
  2. RIS Phase Shifts Design (Subproblem 2): This subproblem optimizes the phase shifts of the RIS elements. Given the discrete nature of RIS phase shifts and the non-convexity, they introduce a Soft Actor-Critic (SAC) deep reinforcement learning (DRL) algorithm. SAC is a model-free DRL approach known for its stability and ability to handle discrete action spaces, making it suitable for optimizing RIS phase shifts. The algorithm learns an optimal policy by interacting with the environment, aiming to maximize the sum SE.

These two subproblems are solved iteratively until convergence, forming a joint optimization strategy.

Datasets

The paper does not explicitly mention training or evaluating on pre-existing datasets. Instead, it relies on simulated data generated based on a defined system model and parameters for two typical urban outdoor scenarios. The performance is evaluated against various benchmarks, including exhaustive search, fixed-point iteration, continuous phase shifts, and random phase shifts methods.

Key Insights and Ideas

  • Interference is Key: The paper highlights that in urban environments, the interplay between residual SI and RIS-induced LI is a critical bottleneck for FD-RIS systems, not just the inherent FD SI.
  • Scenario-Specific Interference: The authors identify two distinct urban scenarios where either UL-to-DL interference (UDI) or LI becomes the dominant interference factor, necessitating tailored optimization strategies.
  • DRL for Discrete Optimization: The successful application of SAC DRL for optimizing discrete RIS phase shifts demonstrates its power in handling complex, real-world communication constraints.
  • Joint Optimization is Crucial: Optimizing beamforming and RIS phase shifts jointly, rather than independently, leads to significant performance gains, especially in challenging interference conditions.
  • RIS Location Matters: The placement of the RIS significantly impacts performance, with optimal locations found closer to the BS or IoT devices depending on the scenario.

Key Results

  • The proposed joint beamforming and phase shift design algorithm achieves performance only slightly lower than the exhaustive search method (considered an upper bound for discrete phase shifts) but with significantly reduced computational complexity.
  • The proposed algorithm outperforms the fixed-point iteration scheme and other baseline methods.
  • In scenario two, where LI is more pronounced, the proposed algorithm shows superior performance, demonstrating its advantage in mitigating complex interference in urban environments.
  • The performance gains from RIS are substantial, with the proposed algorithm achieving significant improvements compared to scenarios without RIS or with random phase shifts. For instance, in scenario one, RIS deployment on the BS side yielded a 135% performance gain.
  • The algorithm demonstrates robustness across various parameters, including the number of RIS elements, the number of resolution bits, and residual SI levels.

Limitations and Future Work

  • Perfect CSI Assumption: The paper assumes perfect channel state information (CSI) is known, which is idealistic in practice. The authors suggest that considering imperfect CSI would be a valuable future research direction.
  • SE vs. EE: While the paper focuses on maximizing spectral efficiency (SE), it acknowledges that the RIS-aided system is also power-saving. Future work could involve formulating an energy efficiency (EE) objective function to further investigate this aspect.
  • Model-Based vs. Model-Free: The paper uses a model-free DRL approach for phase shifts. Exploring model-based DRL or hybrid approaches could offer alternative optimization strategies.
  • Real-World Deployment: The study is based on simulations. Further research on practical implementation and validation in real-world testbeds would be beneficial.

Summary updated

Abstract

Full-duplex (FD) and reconfigurable intelligent surface (RIS) are potential technologies for achieving wireless communication effectively. Therefore, in theory, the RIS-aided FD system is supposed to enhance spectral efficiency significantly for the ubiquitous Internet of Things devices in smart cities. However, this technology additionally induces the loop-interference (LI) of RIS on the residual self-interference (SI) of the FD base station, especially in complicated urban outdoor environments, which will somewhat counterbalance the performance benefit. Inspired by this, we first establish an objective and constraints considering the residual SI and LI in two typical urban outdoor scenarios. Then, we decompose the original problem into two subproblems according to the variable types and jointly design the beamforming matrices and phase shifts vector methods. Specifically, we propose a successive convex approximation algorithm and a soft actor-critic deep reinforcement learning-related scheme to solve the subproblems alternately. To prove the effectiveness of our proposal, we introduce benchmarks of RIS phase shifts design for comparison. The simulation results show that the performance of the low-complexity proposed algorithm is only slightly lower than the exhaustive search method and outperforms the fixed-point iteration scheme. Moreover, the proposal in scenario two is more outstanding, demonstrating the application predominance in urban outdoor environments.
BibTeX
@inproceedings{pan2023joint,
  author = {Kunbei Pan and Bin Zhou and Wei Zhang and Cheng Ju},
  title = {{Joint Beamforming and Phase Shifts Design for RIS-Aided Multi-User Full-Duplex Systems in Smart Cities}},
  booktitle = {Sensors},
  year = {2023},
  doi = {10.3390/s24010121},
}
Figure