Introduction
Standard convolutional neural networks (CNNs) like ResNet or VGG are typically optimized for datasets with around 1,000 classes. Scaling these architectures to 10,000 or more categories introduces significant optimization difficulties and computational complexity. Monolithic networks often fail to capture the varying learning complexities of diverse object types. DeepME addresses these challenges using a "Mixture of Experts" (MoE) framework that semantically clusters categories into overlapping task groups.
Methods
The DeepME framework operates in three distinct stages to manage large-scale classification efficiently.
- Soft Spectral Clustering (SSC): Categories are grouped based on semantic correlations derived from WordNet. Unlike hard clustering, SSC allows categories to belong to multiple task groups, facilitating information sharing across experts.
- Learning Base Deep Networks: Specialized base networks (VGG16) are trained for each task group. The training process utilizes a loss function that incorporates visual and semantic similarity regularization.
- Gate Network Training: A central gate network learns to assign confidence scores to each expert. It ensures consistency across overlapping classes and suppresses irrelevant experts through a specialized hinge loss function.
Datasets and Benchmarking
The model was evaluated on ImageNet10K, a subset of the full ImageNet database containing approximately 9 million images across 10,184 categories. The dataset was split into training (85%), validation (5%), and testing (10%) sets.
Key Results
DeepME achieves state-of-the-art performance on ImageNet10K, significantly outperforming standard monolithic scaling and previous mixture models.
| Model | Top-1 Accuracy | Top-5 Accuracy |
|---|---|---|
| DeepME (Proposed) | 32.13% | 59.79% |
| DMDE (Previous SOTA) | 29.51% | 56.49% |
| VGG16-Ext (Standard) | 27.62% | 53.17% |
| DeepME-NoGate (Ablation) | 7.84% | 29.85% |
Ablation studies highlight the critical role of the gate network; without it, accuracy drops to 7.84%, demonstrating that adaptive fusion is essential for large-scale tasks.
Conclusion
DeepME demonstrates that semantic grouping and adaptive expert fusion are powerful tools for scaling image classification. While training multiple experts is computationally intensive, the gains in accuracy—especially for "hard" classes—are substantial. Future work will focus on end-to-end integration and more advanced fusion mechanisms like attention.
Summary updated