AI-Driven Digital Twin Framework for Warehouse Logistics Automation Optimization

Md Mahinur Alam, Kanita Jerin Tanha, Shadman Sakib, Min Gyu KimarXiv 2026 · arXiv

TL;DR

This paper introduces a novel framework that combines Deep Reinforcement Learning (DRL) with high-fidelity Digital Twins to optimize warehouse "slotting"—the art of deciding where to store products. By integrating a sophisticated DQN agent with a FlexSim-based simulation via the Asset Administration Shell (AAS) standard, the authors achieved a nearly 30% reduction in picking time and a 35% boost in overall throughput.

What Problem Does This Paper Address?

In the world of logistics, "slotting" is a critical but difficult puzzle: where should you put an item to minimize the time a picker spends traveling to get it? Traditional warehouses often use static strategies (e.g., "all electronics go in Zone A"). However, consumer demand is volatile. A static setup can’t handle sudden spikes in specific products, leading to congested aisles and idle forklifts.

While Reinforcement Learning (RL) has been proposed for this before, most research happens in "toy" environments that don't reflect the messy reality of a warehouse. There is a significant gap between theoretical RL models and practical, high-fidelity Digital Twins (DT) that can synchronize with physical assets in real-time.

Methods

The authors bridge this gap with a three-part architecture:

  1. The Digital Twin (FlexSim): They built a detailed 3D discrete-event simulation of a four-zone warehouse, complete with racks, conveyors, and autonomous transporters.
  2. The Middleware (Asset Administration Shell): To ensure the RL agent can "talk" to both the digital and physical worlds interchangeably, they used the AAS framework. This standardizes how data (like stock levels) and commands (like reslotting plans) are exchanged.
  3. The Brain (Hybrid DQN Agent): Instead of a simple neural network, they designed a custom Deep Q-Network (DQN) architecture:
  4. 1D-CNN: Extracts spatial patterns (e.g., which racks are currently crowded).
  5. BiLSTM: Captures temporal trends (e.g., how demand for an item has changed over the last hour).
  6. Bahdanau Attention: Allows the model to focus on the most "operationally critical" time steps when making a decision.
Fig. 1: Proposed AI-Driven Digital Twin Framework for Smart Warehouse Logistics, Physical-to-Digital Synchroniza- tion via Asset Administration Shell with Reinforcement Learn- ing Based Dynamic Reslotting Optimization.

The agent uses Action Masking to prevent it from trying to put items in full racks, and a complex reward function that balances picking speed against the "cost" of moving an item to a new slot.

Datasets

The study does not use a static public dataset. Instead, it utilizes a high-fidelity synthetic dataset generated within the FlexSim environment. The simulation models a 500-SKU product catalog across 16 double-sided racks. This approach allows the agent to learn from "streaming" operational data, mimicking a real-world deployment where the model learns as the warehouse operates.

Key Insights and Ideas

  • The "Cascading Effect": One of the most important findings is that intelligent slotting isn't just about shorter walks. By placing high-demand items optimally, the framework reduced transporter idle time from 40% down to nearly zero. This creates a "cascading" efficiency gain across the entire pipeline, from the receiving dock to the shipping sink.
  • Spatial + Temporal = Success: The ablation study (comparing different model types) proved that you need both spatial awareness (CNN) and memory (BiLSTM) to win. Removing the attention mechanism or the CNN significantly increased the variance and decreased the performance of the agent.
  • Shadow Evaluation: Because the agent lives in the Digital Twin environment, the system can perform "shadow evaluations"—testing a new slotting strategy in the simulation to ensure it works before ever moving a single physical pallet.
Fig. 3: Ablation study comparing average picking time across Q-network architecture variants.

Key Results

The framework was tested against a standard "static slotting" baseline (where items are assigned zones based on category). The DQN-Agent showed massive improvements:

  • Average Picking Time: Reduced by 29.66% (from 169.22s to 118.32s).
  • System Throughput: Increased by 35.42% (from ~23 to ~31 orders per hour).
  • Travel Distance: Decreased by 18.54%.
  • Productive Utilization: Transporters reached over 98% utilization, effectively eliminating non-productive idle time.
Fig. 4: FlexSim dashboard comparison between the proposed framework DQN-Agent and Static Slotting baseline across per- transporter travel distance, utilization state distribution, and warehouse throughput.

Limitations and Future Work

While the results are impressive, the authors note a few areas for growth:

  • Sim-to-Real Transition: Although the AAS framework is designed for physical integration, this specific paper focuses on the Digital Twin and simulation. Real-world hurdles like sensor noise or mechanical breakdowns weren't the primary focus.
  • Scaling: The current model uses a four-zone layout. Future work could explore how this scales to massive, multi-story fulfillment centers.
  • Multi-Agent Coordination: The current DQN agent makes centralized decisions. Moving toward a multi-agent RL approach where individual forklifts or zones have their own "intelligence" could further improve resilience.

Summary updated

Abstract

In recent years, warehouse logistics optimization has increasingly focused on intelligent, data-driven systems to enhance operational efficiency. Conventional static product placement strategies are being progressively replaced by dynamic slotting approaches that can adapt to real-time variations in warehouse conditions. In this work, we present a novel framework that employs a reinforcement learning agent integrated within a FlexSim-based Digital Twin environment for real-time product placement optimization. The proposed agent continuously learns from streaming operational data, enabling it to reduce picking time while improving overall system throughput. The simulation environment models a four-zone warehouse layout with forklift-based material handling and leverages the Asset Administration Shell framework to ensure seamless interaction between the learning agent, physical asset, and the digital twin. Experimental evaluation demonstrates substantial performance gains, with the proposed approach achieving a 29.66\% reduction in average picking time, a 35.42\% increase in throughput, and an 18.54\% decrease in travel distance.
BibTeX
@misc{alam2026ai,
  author = {Md Mahinur Alam and Kanita Jerin Tanha and Md Tanjin Alam and Shadman Sakib and Min Gyu Kim},
  title = {{AI-Driven Digital Twin Framework for Warehouse Logistics Automation Optimization}},
  year = {2026},
  eprint = {2610.38101},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.38101},
}

Loading related content...

Figure