DOA Estimation with Lightweight Network on LLM-Aided Simulated Acoustic Scenes

Haowen Li, Zhengding Luo, Dongyuan Shi, Boxiang Wang, Junwei Ji, Ziyi Yang, Woon-Seng GanarXiv 2025 · DOI · arXiv

Introduction

Direction-of-Arrival (DOA) estimation—the process of determining the spatial origin of a sound source—is a fundamental component in technologies ranging from noise-canceling headphones to smart home assistants. Despite its importance, current DOA models often struggle to generalize from "sterile" synthetic training environments to the complex, semantically rich acoustic scenes of the real world. Furthermore, high-performance models frequently demand computational resources that exceed the capabilities of low-power edge devices.

This paper introduces LightDOA, a highly efficient neural network designed for real-time DOA estimation. To train this model effectively, the researchers developed the Both Ears Wide Open (BEWO) dataset, leveraging Large Language Models (LLMs) to simulate realistic acoustic environments with diverse semantic contexts.

LLM-Aided Simulation Pipeline

The core innovation in data generation is a three-step pipeline that moves beyond simple noise convolution. By integrating LLMs, the researchers ensure that the training data is not only physically accurate but also semantically grounded.

The three-step LLM-aided pipeline: Data Preparation, Attribute Induction via GPT-4, and Audio Simulation.
  1. Data Preparation: Audio samples from AudioCaps are filtered to ensure single-source descriptions and high semantic similarity between audio and captions (using CLAP scores).
  2. Attribute Induction: GPT-4(o) is used to enrich simple captions (e.g., "she is talking") with spatial attributes such as source position, distance, and scene size.
  3. Audio Simulation: These attributes parameterize physical simulators like Pyroomacoustics or gpuRIR to generate spatialized stereo audio.

LightDOA Architecture

LightDOA is engineered for extreme efficiency, utilizing only ~39k parameters. The architecture focuses on the Interaural Phase Difference (IPD) as the primary spatial cue. To maintain a low computational footprint, it employs depthwise separable convolutions—a technique popularized by the MobileNet family—followed by a Gated Recurrent Unit (GRU) for temporal modeling. The DOA task is framed as a classification problem, where the 180° front-facing arc is discretized into specific angular bins.

The BEWO Dataset

The BEWO dataset, derived from AudioCaps, provides the diverse acoustic scenes necessary for robust training. It includes a wide array of non-speech sounds, such as water pouring or animals barking, situated in varied environments.

Angular distribution of sound sources within the BEWO dataset, showing the frequency of samples across the 180° arc.

Due to the dual-microphone setup lacking Head-Related Transfer Functions (HRTFs), the dataset utilizes a front-back mapping to resolve ambiguity, folding the full 360° field into a 180° arc.

Key Results

LightDOA demonstrates that efficiency does not require sacrificing accuracy. In benchmarks against significantly larger models, LightDOA achieved:

  • 57.96% accuracy at 5° resolution, outperforming the CRNN (~311k parameters) and MTL-DOA (~285M parameters).
  • 85.45% accuracy at 20° resolution.

These results underscore the effectiveness of combining a lean architecture with semantically rich, LLM-aided training data.

Conclusion and Future Work

LightDOA provides a scalable solution for DOA estimation on edge devices. While current limitations include front-back ambiguity and a focus on single-source scenarios, future work will explore multi-source localization, elevation estimation, and the integration of HRTFs to further bridge the gap between simulation and reality.

Summary updated

Abstract

Direction-of-Arrival (DOA) estimation is critical in spatial audio and acoustic signal processing, with wide-ranging applications in real-world. Most existing DOA models are trained on synthetic data by convolving clean speech with room impulse responses (RIRs), which limits their generalizability due to constrained acoustic diversity. In this paper, we revisit DOA estimation using a recently introduced dataset constructed with the assistance of large language models (LLMs), which provides more realistic and diverse spatial audio scenes. We benchmark several representative neural-based DOA methods on this dataset and propose LightDOA, a lightweight DOA estimation model based on depthwise separable convolutions, specifically designed for mutil-channel input in varying environments. Experimental results show that LightDOA achieves satisfactory accuracy and robustness across various acoustic scenes while maintaining low computational complexity. This study not only highlights the potential of spatial audio synthesized with the assistance of LLMs in advancing robust and efficient DOA estimation research, but also highlights LightDOA as efficient solution for resource-constrained applications.
BibTeX
@misc{li2025doa,
  author = {Haowen Li and Zhengding Luo and Dongyuan Shi and Boxiang Wang and Junwei Ji and Ziyi Yang and Woon-Seng Gan},
  title = {{DOA Estimation with Lightweight Network on LLM-Aided Simulated Acoustic Scenes}},
  year = {2025},
  eprint = {2511.08012},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2511.08012},
}
Figure