Introduction
In the domain of edge AI, computational efficiency is paramount. While architectures such as MobileNet and ShuffleNet have significantly advanced mobile vision through depthwise separable convolutions, they often encounter a performance plateau when operating under extremely restricted computational budgets (e.g., below 40 MFLOPs).
HBONet addresses this limitation by introducing the Harmonious Bottleneck (HBO). The authors identify a critical constraint in existing bottleneck designs: they primarily optimize the channel dimension while maintaining a constant spatial resolution within the block. HBONet proposes treating spatial and channel dimensions as orthogonal axes that can be jointly optimized to maximize representational capacity within a fixed FLOP budget.
Methods: The Harmonious Bottleneck
The core innovation of HBONet is the HBO module. Unlike the standard "Inverted Bottleneck" used in MobileNetV2, which expands and then contracts channels at a fixed resolution, the HBO module incorporates a nested spatial transformation.
The module follows a four-step process:
- Spatial Contraction: A strided depthwise convolution downsamples the spatial resolution at the beginning of the block.
- Channel Expansion-Contraction: Within this reduced spatial footprint, the model performs channel expansion and contraction. The reduced resolution allows for a significantly wider channel expansion without exceeding the FLOP limit.
- Spatial Expansion: Upsampling restores the spatial resolution to align with the shortcut connection.
- Bilateral Symmetry & Feature Reuse: The module utilizes a concatenation path where half of the output channels are derived directly from the input, promoting feature reuse and further reducing computational overhead.
Key Insights
- Spatial-Channel Reciprocity: Shrinking the spatial map provides the "computational budget" required to increase channel depth, leading to more diverse feature representations.
- Micro-Architecture Optimization: By moving spatial downsampling inside the bottleneck block rather than treating it as a macro-architectural transition, HBONet achieves more granular control over model complexity.
- Preserving Linearity: To prevent information loss in narrow layers, HBONet maintains linear bottlenecks, consistent with the design principles of MobileNetV2.
Experimental Results
HBONet was evaluated on ImageNet classification, PASCAL VOC object detection, and Market-1501 person re-identification. The results consistently demonstrate that HBONet outperforms MobileNetV2, particularly at the lower boundary of computational resources.
On ImageNet, HBONet achieved a 6.6% top-1 accuracy improvement over MobileNetV2 at the ~14 MFLOPs level. In object detection tasks, HBONet-based SSD models showed up to a 6.3% mAP improvement in constrained settings. Furthermore, for person re-identification, the architecture provided a 5.0% Rank-1 accuracy boost.
Conclusion and Future Work
HBONet demonstrates that joint optimization of spatial and channel dimensions can push the boundaries of ultra-lightweight neural networks. While the current design is hand-engineered, future work could involve integrating the HBO module into Neural Architecture Search (NAS) frameworks to discover even more efficient configurations. Additionally, exploring the impact of hardware-specific optimizations for upsampling operations remains a key area for practical deployment.
Summary updated