Large Language Model Enhanced Multi-Agent Systems for 6G Communications

Feibo Jiang, Yubo Peng, Li Dong, Kezhi Wang, Kun Yang, Cunhua Pan, Dusit Niyato, Octavia A. Dobre

TL;DR

This paper proposes a novel framework that integrates Large Language Models (LLMs) into multi-agent systems to solve complex 6G communication tasks. By utilizing a "retrieval-planning-evaluation" loop, the system can autonomously design specialized communication modules—like semantic communication encoders—using natural language requirements.

What Problem Does This Paper Address?

The transition to 6G requires managing hyper-dynamic environments, heterogeneous devices (IoT, UAVs), and diverse application needs (VR, autonomous driving). Traditional "discriminative" AI/ML models are often too specialized, struggle with long-term dependencies in dynamic networks, and require extensive retraining for new tasks.

While LLMs offer a "universal" reasoning capability, they face significant hurdles in the 6G domain:

  1. Data Privacy: 6G standards and private network data aren't in public training sets.
  2. Domain Specificity: Native LLMs lack deep technical knowledge of 6G protocols.
  3. Reasoning Gaps: LLMs can "hallucinate" or fail at complex logical optimization tasks required for resource scheduling or channel estimation.

Methods

The authors introduce a multi-agent system (MAS) architecture designed to bridge the gap between general-purpose LLMs and specialized 6G requirements. The framework consists of three core modules:

  • Multi-agent Data Retrieval (MDR): Instead of relying on the LLM's internal memory, this module uses a Secure Agent to validate requests and a Condensate/Inference Agent pair to extract and summarize relevant technical knowledge from a private vector database (e.g., recent research papers and standards).
  • Multi-agent Collaborative Planning (MCP): This module uses Planning Agents to decompose a high-level natural language task into a sequence of sub-tasks. It employs techniques like Chain-of-Thought (CoT) and Plan-and-Solve to ensure logical consistency.
  • Multi-agent Evaluation and Reflexion (MER): This is the "self-correction" loop. An Evaluation Agent scores the output, while Reflexion and Refinement Agents provide fine-grained feedback (e.g., "fix this syntax error" or "adjust this parameter") to iteratively improve the solution.

Datasets

The authors validated their system through a case study involving the design of a Semantic Communication (SC) system:

  • Knowledge Base: A selection of research papers from arXiv relevant to 6G and semantic communications.
  • Evaluation Dataset: The Cornell Movie-Dialogs Corpus (8,000 dialogues for training, 2,000 for testing) was used to test the performance of the autonomously designed SC model in transmitting text data.

Key Insights and Ideas

  • From Discriminative to Generative: The paper argues for a paradigm shift where AI isn't just a "classifier" but a "system designer" that understands intent.
  • Cognitive Synergy: By using multiple agents with distinct roles (e.g., one to retrieve, one to plan, one to critique), the system avoids the biases and "hallucinations" common in single-agent LLM interactions.
  • Autonomous Architecture Evolution: In the case study, the system initially proposed a simple Multi-Layer Perceptron (MLP) architecture. Through the MER loop, it autonomously "realized" that a Long Short-Term Memory (LSTM) network would better handle the temporal dependencies of text, leading to a superior design without human intervention.
  • Natural Language Interface: The system allows network engineers to describe goals (e.g., "design a model with <2M parameters and >0.6 BLEU score") in plain English, which the MAS then translates into executable Python code.

Key Results

The authors tasked the system with creating a Python-based Semantic Communication model for text transmission over an AWGN channel.

  • Performance: The final autonomously designed model achieved a BLEU score of 0.68 at an SNR of 10 dB, exceeding the user's requirement of 0.6.
  • Efficiency: The model was constrained to 1,826,762 parameters, staying under the 2,000,000 parameter limit set for edge device compatibility.
  • Iterative Improvement: Quantitative results showed that the "Evaluative Score" of the system's designs increased significantly over four iterations of the reflexion loop, demonstrating the effectiveness of the self-learning mechanism.

Limitations and Future Work

The authors identify three primary challenges for deploying this in real-world 6G networks:

  1. Resource Constraints: LLMs are computationally expensive. Running these multi-agent loops at the "edge" (on routers or base stations) requires significant optimization or model compression.
  2. Latency: 6G demands millisecond-level responses. The iterative reasoning process of LLMs currently takes seconds or minutes, making it unsuitable for real-time physical layer adjustments.
  3. Cooperation vs. Competition: As more agents are added, managing the communication overhead and potential conflicts between agent goals becomes a complex research problem.

Summary updated

Abstract

The rapid development of the large language model (LLM) presents huge opportunities for 6G communications – for example, network optimization and management – by allowing users to input task requirements to LLMs with natural language. However, directly applying native LLMs in 6G encounters various challenges, such as a lack of communication data and knowledge, and limited logical reasoning, evaluation, and refinement abilities. Integrating LLMs with the capabilities of retrieval, planning, memory, evaluation, and reflection in agents can greatly enhance the potential of LLMs for 6G communications. To this end, we propose CommLLM, a multi-agent system with customized communication knowledge and tools for solving communication-related tasks using natural language. This system consists of three components: multi-agent data retrieval (MDR), which employs the condensate and inference agents to refine and summarize communication knowledge from the knowledge base, expanding the knowledge boundaries of LLMs in 6G communications; multi-agent collaborative planning (MCP), which utilizes multiple planning agents to generate feasible solutions for the communication-re-lated task from different perspectives based on the retrieved knowledge; and multi-agent evaluation and reflection (MER), which utilizes the evaluation agent to assess the solutions, and applies the reflection agent and refinement agent to provide improvement suggestions for current solutions. Finally, we validate the effectiveness of the proposed multi-agent system by designing a semantic communication system as a case study of 6G communications.
BibTeX
@article{jiang2024large,
  author = {Feibo Jiang and Yubo Peng and Li Dong and Kezhi Wang and Kun Yang and Cunhua Pan and Dusit Niyato and Octavia A. Dobre},
  title = {{Large Language Model Enhanced Multi-Agent Systems for 6G Communications}},
  journal = {IEEE Wirel. Commun},
  year = {2024},
  doi = {10.1109/mwc.016.2300600},
}

Loading related content...

Figure