Background Fades, Foreground Leads: Curriculum-Guided Background Pruning for Efficient Foreground-Centric Collaborative Perception

Yuheng Wu, Xiangbo Gao, Quang Tau, Zhengzhong Tu, Dongman LeearXiv 2025 · DOI · arXiv

Abstract

Collaborative perception allows Connected and Autonomous Vehicles (CAVs) to overcome individual sensing limitations by sharing data. However, the strict bandwidth constraints of vehicular networks necessitate efficient communication strategies. While traditional foreground-centric methods reduce data by transmitting only object-related features, they often sacrifice critical environmental context. This paper introduces FadeLead, a framework that employs a curriculum-based training strategy to "internalize" essential background context into compact foreground features. By gradually pruning background transmission during training, FadeLead enables vehicles to maintain high-fidelity situational awareness while sharing as little as 1% of their data.

Introduction: The Bandwidth-Context Dilemma

In collaborative perception, CAVs share sensor data to mitigate occlusions and extend sensing range. A fundamental challenge is the trade-off between communication bandwidth and perception accuracy. Most existing methods are foreground-centric, prioritizing the transmission of features from detected objects. However, the "background"—comprising roads, buildings, and empty space—provides vital semantic context for scene layout and object disambiguation.

The authors identify a "Background Paradox": preliminary experiments reveal that transmitting ground-truth background features can actually lead to better perception performance than transmitting foreground objects alone. This suggests that the background is not merely noise but a primary source of contextual information.

The Background Paradox: (a) AP comparison showing background (BG) features often outperform foreground (FG) alone; (b) Feature map visualization demonstrating that BG encodes essential contextual cues missing in FG-only transmissions.

Methodology: The FadeLead Framework

FadeLead addresses this paradox through a "scaffolding" approach to training, ensuring that background context is learned and embedded into foreground representations before being pruned for inference.

Overview of the FadeLead architecture, featuring Foreground-Context Attention (FCA), Curricular Background Pruning (CBP), and Foreground Amplification Fusion (FAF).

1. Foreground-Context Attention (FCA)

FCA refines the foreground mask by incorporating point cloud density as a prior. It utilizes multi-scale deformable attention to aggregate global context from the entire Bird’s-Eye-View (BEV) map into the foreground features. This ensures that the transmitted foreground data is already enriched with environmental information.

2. Curricular Background Pruning (CBP)

CBP is the core innovation of FadeLead. During the initial stages of training, the model is permitted to transmit informative background regions. As training progresses, an annealing schedule gradually reduces this background transmission to zero. This curriculum forces the model to internalize the necessary background information into the foreground features, effectively "fading" the background while the foreground "leads" the perception task.

3. Foreground Amplification Fusion (FAF)

The FAF module handles the integration of shared features at the receiver. It employs cross-agent interaction modeling to ensure that incoming data from other CAVs amplifies the ego-vehicle's detections without introducing harmful noise or redundant information.

Experimental Results

FadeLead was evaluated on three major benchmarks: OPV2V (simulated V2V), V2X-R (4D radar simulation), and DAIR-V2X (real-world V2I).

Performance under Bandwidth Pressure

FadeLead demonstrates superior efficiency compared to state-of-the-art methods like Where2Comm and CoSDH. At an extremely low 1% selection ratio, FadeLead achieved an Average Precision (AP) improvement of +2.36 to +4.68 over competing methods. Notably, the performance at 1% transmission is nearly comparable to that at 10%, indicating that the model successfully packs almost all required context into a minimal data footprint.

Qualitative Analysis

Visualizations of post-fusion feature maps show that FadeLead produces cleaner and sharper results. It effectively fills in occluded regions where other methods fail, demonstrating the successful internalization of contextual cues.

Conclusion and Future Work

FadeLead presents a novel paradigm for efficient collaborative perception by treating background context as a temporary training scaffold. While the curriculum's pacing requires careful tuning to avoid under-learning or over-reliance, the results prove that background information can be effectively embedded into foreground features. Future research may explore adaptive annealing schedules tailored to scene complexity and extending this internalization concept to tasks beyond 3D object detection, such as motion prediction.

Summary updated

Abstract

Collaborative perception enhances the reliability and spatial coverage of autonomous vehicles by sharing complementary information across vehicles, offering a promising solution to long-tail scenarios that challenge single-vehicle perception. However, the bandwidth constraints of vehicular networks make transmitting the entire feature map impractical. Recent methods, therefore, adopt a foreground-centric paradigm, transmitting only predicted foreground-region features while discarding the background, which encodes essential context. We propose FadeLead, a foreground-centric framework that overcomes this limitation by learning to encapsulate background context into compact foreground features during training. At the core of our design is a curricular learning strategy that leverages background cues early on but progressively prunes them away, forcing the model to internalize context into foreground representations without transmitting background itself. Extensive experiments on both simulated and real-world benchmarks show that FadeLead outperforms prior methods under different bandwidth settings, underscoring the effectiveness of context-enriched foreground sharing.
BibTeX
@misc{wu2025background,
  author = {Yuheng Wu and Xiangbo Gao and Quang Tau and Zhengzhong Tu and Dongman Lee},
  title = {{Background Fades, Foreground Leads: Curriculum-Guided Background Pruning for Efficient Foreground-Centric Collaborative Perception}},
  year = {2025},
  eprint = {2510.19250},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2510.19250},
}
Figure