Abstract
The "Less is More" (LiM3D) framework addresses the high computational and annotation costs of 3D LiDAR segmentation. By introducing sparse depthwise separable convolution (SDSC), motion-aware frame sampling (ST-RFD), and reflectivity-informed pseudo-labeling, the authors achieve state-of-the-art accuracy with significantly reduced model complexity, using 2.3× fewer parameters and 641× fewer computations than contemporary models.
Introduction
3D semantic segmentation serves as the "eyes" of autonomous vehicles, enabling them to distinguish between roads, pedestrians, and vehicles using LiDAR point clouds. However, the field currently faces a "complexity crisis" characterized by high annotation costs, model bloat, and data redundancy. Labeling 3D point clouds is notoriously slow and expensive, while state-of-the-art models often rely on massive architectures that are difficult to deploy on edge hardware. Furthermore, uniform frame sampling often leads to redundant training on static scenes, causing overfitting and wasted compute. The LiM3D framework proposes a semi-supervised approach to do more with less labeled data and reduced model complexity.
Methodology
The LiM3D framework introduces three primary innovations to address the challenges of efficiency and data scarcity:
- Sparse Depthwise Separable Convolution (SDSC): Inspired by MobileNet, the authors adapt depthwise separable convolutions for 3D sparse data. By splitting standard 3D convolutions into spatial "depthwise" and "pointwise" steps, they reduce parameter counts by approximately 50% without sacrificing accuracy.
- Spatio-Temporal Redundant Frame Downsampling (ST-RFD): This strategy uses vehicle motion to select the most informative frames. By calculating similarity between adjacent images (using SSIM) as a proxy for LiDAR redundancy, it samples more frames during rapid scene changes and fewer when the vehicle is stationary.
- Reflectivity-Informed Soft Pseudo-Labeling: LiM3D improves semi-supervised learning by incorporating LiDAR reflectivity, which represents material properties. Furthermore, instead of discarding "unreliable" (high-entropy) predictions, the framework stores them in a category-wise memory bank to serve as negative samples in a contrastive loss function.
Experiments and Results
The method was evaluated on SemanticKITTI (a large-scale dataset with 20 semantic classes) and ScribbleKITTI (a weakly annotated version where only 8% of points are labeled).
Key results include:
- Superior Accuracy: On SemanticKITTI (using only 5% of labels), LiM3D achieved 59.5% mIoU, significantly outperforming larger models like Cylinder3D and LaserMix.
- Massive Efficiency Gains: The SDSC module enabled a 2.3× reduction in model parameters and a staggering 641× reduction in Multiply-Add operations (MACs) compared to baseline models.
- Sampling Intelligence: The ST-RFD strategy provided a consistent boost of ~1.0% mIoU over uniform sampling by ensuring the training set was maximally diverse.
Discussion and Conclusion
LiM3D demonstrates that efficiency can act as a regularizer; smaller architectures like SDSC are actually less prone to overfitting when training on small data subsets compared to their heavyweight counterparts. A key insight is the "utility of uncertainty," where unreliable predictions are leveraged as negative samples to better define class boundaries. Additionally, using reflectivity as a material proxy helps the model generalize even when labels are scarce.
Future work aims to reduce the dependency on RGB camera images for the ST-RFD sampling strategy and extend SDSC efficiency gains to point-based or graph-based networks. Further optimization for real-time inference latency on low-power automotive chips remains a priority for deployment.
Summary updated