Multi-Attribute Auction-Based Resource Allocation for Twins Migration in Vehicular Metaverses: A GPT-Based DRL Approach

Yongju Tong, Junlong Chen, Minrui Xu, Jiawen Kang, Zehui Xiong, Dusit Niyato, Chau Yuen, Zhu Han

TL;DR

This paper proposes a novel framework for migrating "Vehicle Twins" (digital representations of cars) between roadside units in a vehicular metaverse. By combining a multi-attribute double Dutch auction with a GPT-based Deep Reinforcement Learning (DRL) approach, the system optimizes resource allocation while balancing price, vehicle location, and provider reputation.

What Problem Does This Paper Address?

In a "Vehicular Metaverse," vehicles rely on Vehicle Twins (VTs)—resource-intensive digital models that sync physical and virtual spaces for applications like AR navigation and 3D entertainment. Because Roadside Units (RSUs) have limited coverage and vehicles move quickly, these VTs must frequently "migrate" from one RSU to another to maintain a seamless experience.

Allocating resources for these migrations is a massive headache. Standard auctions usually only care about price, but for a metaverse to feel "immersive," factors like the RSU’s physical distance (latency) and its historical reliability (reputation) are just as important. Furthermore, traditional auction mechanisms are often slow or computationally expensive, making them ill-suited for the split-second decisions required on the road.

Methods

The authors introduce a two-stage Multi-Attribute Double Dutch Auction (MADDA) mechanism:

  1. Stage 1: Resource-Attribute Matching: The system uses the Kuhn-Munkres (KM) algorithm to create a weighted bipartite graph. This ensures that vehicles (buyers) are only matched with RSUs (sellers) that actually meet their specific needs for CPU, storage, and bandwidth, while also factoring in location and reputation.
  2. Stage 2: Winner Determination and Pricing: Once matched, the parties enter a Double Dutch Auction. Here, the "buyer clock" starts high and ticks down, while the "seller clock" starts low and ticks up.
  3. The GPT Innovation: Instead of using a fixed step size for these "clocks," the authors use a Generative Pre-trained Transformer (GPT)-based DRL agent. By treating the auction process as a sequence (a trajectory of states, actions, and rewards), the GPT model learns to adjust the auction clocks dynamically. This allows the auction to reach a "clearing price" much faster and more efficiently than standard reinforcement learning algorithms.

Datasets

The study relies on a custom-built simulation environment designed to mimic a vehicular network.

  • Scale: Scenarios involving 50 to 200 Vehicular Users (VUs) and 50 to 200 RSUs.
  • Parameters: Resource requirements were set between 40–80 units; vehicle migration distances ranged from 0.8 to 1.0 km; and initial reputation values were set at 0.5.
  • Comparison Baselines: The model was tested against Soft Actor-Critic (SAC), random adjustment methods, and traditional fixed-step Double Dutch Auctions.

Key Insights and Ideas

  • Auctions as Sequences: The most clever "aha moment" is treating the auction rounds as a sequence modeling problem. Transformers (like GPT) are designed to find patterns in sequences; by applying this to auction "trajectories," the agent can predict the optimal price jump to maximize social welfare while minimizing the number of messages exchanged.
  • Reputation "Freshness": The model includes a time-decay factor for reputation. An RSU that was reliable a year ago but has been glitchy recently will see its score drop quickly, ensuring vehicles aren't migrated to failing infrastructure.
  • Beyond the Dollar: By making "Location" and "Reputation" formal attributes in the auction, the system treats user experience (immersion) as a commodity just as valuable as the bid price.

Key Results

  • Higher Social Welfare: The GPT-based DRL scheme achieved a social welfare score approximately 9.2% higher than SAC and 22.8% higher than random methods.
  • Efficiency: The GPT approach significantly reduced "information exchange costs"—essentially, it reached a deal in fewer steps, which is critical for low-latency vehicular environments.
  • Economic Robustness: The authors mathematically proved and experimentally verified that their mechanism maintains Individual Rationality (no one loses money by participating) and Incentive Compatibility (truthful bidding is the best strategy).
  • Reputation Sensitivity: The system showed a 42% to 51% improvement in rewards when reputation attributes were factored into the matching process compared to baseline methods.

Limitations and Future Work

While the simulation results are promising, the paper primarily operates in a controlled environment. Real-world vehicular networks face unpredictable "jitter," hardware failures, and varying signal interference that might challenge the GPT agent's training.

The authors suggest that future work will focus on making the GPT-based DRL more robust to environmental changes and exploring how these models can predict vehicle movement patterns before the migration is even requested, further reducing latency.

Summary updated

Abstract

Vehicular Metaverses are developed to enhance the modern automotive industry with an immersive and safe experience among connected vehicles and roadside infrastructures, e.g., RoadSide Units (RSUs). For seamless synchronization with virtual spaces, Vehicle Twins (VTs) are constructed as digital representations of physical entities. However, resource-intensive VTs updating and high mobility of vehicles require intensive computation, communication, and storage resources, especially for their migration among RSUs with limited coverages. To address these issues, we propose an attribute-aware auction-based mechanism to optimize resource allocation during VTs migration by considering both price and non-monetary attributes, e.g., location and reputation. In this mechanism, we propose a two-stage matching for vehicular users and Metaverse service providers in multi-attribute resource markets. First, the resource attributes matching algorithm obtains the resource attributes perfect matching, namely, buyers and sellers can participate in a double Dutch auction (DDA). Then, we train a DDA auctioneer using a generative pre-trained transformer (GPT)-based deep reinforcement learning (DRL) algorithm to adjust the auction clocks efficiently during the auction process. We compare the performance of social welfare and auction information exchange costs with state-of-the-art baselines under different settings. Simulation results show that our proposed GPT-based DRL auction schemes have better performance than others.
BibTeX
@article{tong2025multi,
  author = {Yongju Tong and Junlong Chen and Minrui Xu and Jiawen Kang and Zehui Xiong and Dusit Niyato and Chau Yuen and Zhu Han},
  title = {{Multi-Attribute Auction-Based Resource Allocation for Twins Migration in Vehicular Metaverses: A GPT-Based DRL Approach}},
  journal = {IEEE Trans. Cogn. Commun. Netw.},
  year = {2025},
  url = {https://openreview.net/forum?id=uCqkhSMyvP},
}

Loading related content...

Figure