Where Demand Meets Supply: Spatial Elastic Consensus for Low-Bandwidth Collaborative Perception

Linshan YanarXiv 2026 · arXiv

TL;DR

Spatial Elastic Consensus (SEC) is a new framework for collaborative perception that slashes communication overhead by ensuring vehicles only share data that is both "in demand" by the receiver and "in supply" by the sender. By reversing the standard order of feature refinement and masking, SEC guarantees strict adherence to tiny bandwidth budgets (as low as 64 KiB) while maintaining high-fidelity 3D detection in complex driving environments.

What Problem Does This Paper Address?

Autonomous vehicles often suffer from "blind spots" caused by physical occlusions (like a large truck blocking a sensor's view) or limited sensor range. Collaborative Perception (CP) allows connected vehicles to share their sensor data to see through these obstacles. However, sharing high-dimensional feature maps over wireless networks is incredibly expensive.

Existing methods struggle with two main issues:

  1. Redundancy: Most systems are "sender-driven," meaning a collaborator sends what it thinks is important, often wasting bandwidth on areas the ego vehicle can already see clearly.
  2. Receptive-Field Leakage (Dilation): Standard pipelines apply spatial convolutions after selecting which data tokens to send. This causes isolated data points to "bleed" into neighboring cells, silently inflating the actual data transmitted and violating strict bandwidth constraints.

Methods

The authors introduce Spatial Elastic Consensus (SEC), which rests on three primary technical pillars:

  • Bilateral Demand-Supply Consensus: Instead of a one-sided decision, the ego vehicle generates a "demand map" (where it lacks information) and the collaborator generates a "supply map" (what it can see). A single-round Hadamard product (element-wise multiplication) of these maps creates a consensus gate. A token is only transmitted if both vehicles agree it is necessary.
  • Anti-Dilation Refine-before-Mask: To solve the budget inflation problem, SEC moves feature refinement ahead of the selection mask. By refining the features first and then applying a hard top-$k$ selection, the system ensures that exactly $k$ tokens are sent, making the budget an "architectural invariant."
  • Lightweight Deformable Aggregation: To handle the inevitable "pose drift" (slight misalignments between vehicles' coordinate systems), the system uses an 8-point deformable sampler. This allows the ego vehicle to adaptively sample collaborator features, compensating for spatial context lost during the sparse selection process.
The SEC architecture showing the bilateral consensus and deformable aggregation engines.

Datasets

The researchers evaluated SEC across three major benchmarks:

  • OPV2V: A large-scale simulated dataset for vehicle-to-vehicle (V2V) collaborative perception.
  • V2XSet: Another simulation benchmark designed specifically for V2X (Vehicle-to-Everything) communication challenges.
  • DAIR-V2X: A real-world dataset containing cooperative sensing data from vehicles and roadside infrastructure units.

Key Insights and Ideas

  • Joint Decision-Making is Essential: The "aha moment" is that bandwidth efficiency isn't just about compression; it's about relevance. By treating selection as a joint "demand-supply" agreement, the system naturally ignores ego-visible redundancy.
  • Order of Operations Matters: The paper highlights a subtle but critical flaw in previous sparse selection methods: applying convolutions after masking (mask-before-refine) destroys sparsity. Moving refinement before the mask (refine-before-mask) is the only way to guarantee a fixed bit-budget at inference.
  • Sparse is Sufficient: SEC demonstrates that at a 64 KiB budget—representing only about 0.76% of the total available feature cells—a vehicle can still retain nearly 99% of the accuracy of an unconstrained broadcast.
Figure 1. Concept of SEC. Top: pre-communication scene and available information. Bottom: ego demand and collaborator supply jointly select specific regions for transmission, with all other areas untransmitted.

Key Results

SEC consistently outperformed state-of-the-art methods, particularly under stringent bandwidth limits:

  • Accuracy: At a 64 KiB budget, SEC achieved 80.81% [email protected] on OPV2V, beating the previous best method by over 2.3 points.
  • Efficiency: It achieves this high performance while using only 1/16th of the payload of a full broadcast.
  • Robustness: The system proved highly resilient to pose noise (up to 0.6m/3°) and communication latency (up to 500ms), maintaining higher accuracy than competitors like How2comm and CoSDH in degraded conditions.
  • Latency: The consensus engine is extremely fast, adding only about 0.6ms of overhead to the total 9.1ms processing pipeline.
Diagnostic analyses showing SEC's superior performance across different bandwidths, pose errors, and latencies.

Limitations and Future Work

While SEC is highly effective, the authors note a few areas for further exploration:

  • Training Stability: The discrete top-$k$ selection can cause gradient oscillations. The authors used a "foreground warm-up" and auxiliary losses to stabilize training, suggesting that the optimization landscape for such sparse systems is non-trivial.
  • Multi-Agent Scaling: While the cost grows linearly with the number of collaborators, the current study primarily focuses on scenarios with up to four collaborators. Scaling to extremely dense urban environments with dozens of agents may require additional hierarchical selection logic.
  • Temporal Dynamics: The current framework is primarily spatial; integrating temporal consensus (what do I need now based on what I saw before) could further optimize bandwidth.

Summary updated

Abstract

Occlusions and limited sensor range make ego-only 3D perception insufficient for safe driving. Collaborative perception addresses this by enabling connected vehicles to share complementary observations, yet it remains constrained by tight vehicular communication budgets. While spatial selection is more flexible than fixed-rate feature compression, existing selectors remain largely sender-driven and waste scarce bandwidth on ego-visible targets. Furthermore, applying convolutions after masking spreads isolated tokens into their neighborhoods, silently violating low-bandwidth constraints. To address this, we propose Spatial Elastic Consensus (SEC), a bandwidth-adaptive framework centered on bilateral demand-supply consensus. Instead of unilateral token selection, the ego vehicle formulates a content-aware demand prior while each collaborator evaluates its local supply. This single-round consensus allocates the token budget to critical ego-missed evidence rather than ego-visible redundancy, without transmitting dense maps. To guarantee exact budget compliance, an anti-dilation refine-before-mask pipeline refines features prior to discrete token selection, preventing receptive-field leakage. A lightweight deformable sampler then aggregates these sparse messages with learned local offsets, compensating for the spatial context lost to token selection and mitigating inter-agent pose drift. Evaluated at a stringent 64KiB budget, SEC consistently achieves the best [email protected] on the simulated OPV2V and V2XSet datasets and the real-world DAIR-V2X dataset. These results demonstrate that combining bilateral consensus with budget-exact transmission is key to efficient low-bandwidth collaborative perception.
BibTeX
@misc{yan2026where,
  author = {Linshan Yan},
  title = {{Where Demand Meets Supply: Spatial Elastic Consensus for Low-Bandwidth Collaborative Perception}},
  year = {2026},
  eprint = {2611.22439},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.22439},
}
Figure