BoW Pooling: A Plug-and-Play Unit for Feature Aggregation of Point Clouds

Xiang Zhang, Xiao Sun, Zhouhui LianAAAI 2021 · DOI

In the rapidly evolving field of 3D computer vision, processing point clouds—collections of $(x, y, z)$ coordinates representing 3D shapes—presents a unique challenge. Because point clouds are inherently unordered, neural networks must utilize "symmetric functions" to ensure that the output remains invariant to the order of the input points. While standard architectures like PointNet and DGCNN rely heavily on max pooling for this task, a recent paper presented at AAAI-21 introduces a more sophisticated alternative: BoW Pooling.

The Limitations of Max Pooling

Standard max pooling has become the default choice for feature aggregation due to its simplicity. However, the authors identify two critical flaws in this approach:

  1. Information Loss: Max pooling only retains the single maximum value for each feature dimension, potentially discarding subtle but highly discriminative geometric details.
  2. Equal Importance Fallacy: It often treats many points as having roughly equal weight in the global descriptor. In reality, certain "key points" are far more important for defining a shape's identity than others.

The BoW Pooling Architecture

To address these issues, the researchers proposed a modular Bag-of-Words (BoW) Pooling layer. This unit replaces the standard max pooling operation with a statistical, histogram-based aggregation method. The layer is built on three core pillars:

  • The Dictionary: The module maintains a learned dictionary of $K$ clustering centers, or "visual words," which represent common geometric primitives found in 3D data.
  • Truncated Linear Unit (TLU): Unlike traditional hard or soft assignments, the TLU assigns a point’s feature only to its top-$L$ nearest centers. This sparsity suppresses noise from irrelevant local descriptors and forces the network to focus on the most salient geometric features.
  • Mixing Update Strategy: To ensure the dictionary remains representative, the authors employ a hybrid training approach. They combine standard Backpropagation (BP) with periodic Expectation-Maximization (EM) steps, re-centering the visual words based on the actual distribution of features in the training data.

Identifying Geometric Primitives

By representing a shape as a histogram of primitives (e.g., identifying that an object contains specific "wheel" or "frame" primitives), the network gains a more holistic understanding of the geometry. This allows the model to identify specific key points that define the object's structure.

Visualization of key geometric primitives identified on a horse point cloud using BoW Pooling.
Key point detection on a human figure, illustrating the model's focus on discriminative features.

Experimental Results and Robustness

The researchers evaluated BoW Pooling across several standard benchmarks, including ModelNet40 (classification), SHREC15 (non-rigid retrieval), and S3DIS (semantic segmentation). The results demonstrated consistent improvements across the board:

  • Classification: On ModelNet40, integrating BoW Pooling into the DGCNN backbone pushed overall accuracy from 92.9% to 93.4%.
  • Shape Retrieval: The most significant gains occurred in non-rigid shape retrieval. On the SHREC15 dataset, the Nearest Neighbor (NN) metric for the DGCNN backbone skyrocketed from 62.40% to 90.00%.
  • Robustness: The TLU's ability to focus on essential key points makes the model remarkably resilient to missing data. In experiments where parts of 3D shapes were removed, BoW-equipped models maintained significantly higher accuracy than those using standard max pooling.

Conclusion

BoW Pooling offers a powerful, plug-and-play alternative to traditional feature aggregation methods. By moving from simple maxima to statistical histograms of geometric primitives, it provides a more robust and detailed representation of 3D shapes. Its modular nature allows it to be easily integrated into existing architectures, making it a versatile tool for enhancing 3D classification, retrieval, and segmentation tasks.

Summary updated

BibTeX
@inproceedings{zhang2021bow,
  author = {Xiang Zhang and Xiao Sun and Zhouhui Lian},
  title = {{BoW Pooling: A Plug-and-Play Unit for Feature Aggregation of Point Clouds}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2021},
  doi = {10.1609/aaai.v35i4.16453},
}
Figure