Towards Imbalanced Image Classification: A Generative Adversarial Network Ensemble Learning Method

Yangru Huang, Yi Jin, Yidong Li, Zhiping Lin

Introduction: The Challenge of Class Imbalance

In the field of meteorological monitoring, the transition from expensive specialized sensors to ubiquitous surveillance cameras offers a cost-effective path toward high-resolution weather data. However, a significant hurdle remains: class imbalance. In many regions, common weather conditions like "sunny" or "cloudy" occur with high frequency, while critical events such as "snowy" or "hazy" days are rare, often accounting for less than 2% of annual data.

Visual representation of class imbalance in weather datasets, where common conditions like 'sunny' dominate rare events like 'snowy'.

Standard machine learning models are inherently "accuracy-hungry," often optimizing for the majority class at the expense of the minority. A model that predicts "sunny" 100% of the time in a 98% sunny dataset achieves high accuracy but fails its primary purpose of detecting rare weather events. This paper proposes a robust framework to solve this imbalance through generative data augmentation and ensemble learning.

The GAN-ENN Ensemble Framework

The authors introduce a multi-stage pipeline designed to balance datasets and improve classification stability. The architecture integrates generative modeling, feature extraction, and a voting-based classification committee.

The complete GAN-ENN ensemble learning architecture, illustrating the flow from data generation to final classification.

1. Data Augmentation via DCGAN

Rather than simple oversampling—which can lead to overfitting by duplicating existing images—the framework employs a Deep Convolutional Generative Adversarial Network (DCGAN). The GAN learns the underlying distribution of minority classes to generate entirely new, synthetic images of rain, snow, or haze, effectively expanding the diversity of the training set.

2. Feature Extraction and Data Cleaning

To process these images, the team utilizes a pre-trained VGG16 network to extract high-level feature vectors. Recognizing that GANs can occasionally produce distorted or unrealistic samples, the authors apply the Edited Nearest Neighbors (ENN) rule. This algorithm identifies and removes "noisy" generated samples whose labels contradict the majority of their neighbors in the feature space, ensuring only high-quality data informs the model.

3. Ensemble Classification

To ensure robust performance, the framework avoids reliance on a single algorithm. Instead, it uses an ensemble of four distinct classifiers: k-Nearest Neighbors (KNN), Support Vector Machines (SVM), Random Forest (RF), and AdaBoost. The final weather classification is determined by a majority vote among these models.

Experimental Results

The framework, designated as +GAN+ENN, was evaluated across three datasets: the Multi-class Weather Image (MWI) set, the larger Multi-class Weather Dataset (MWD) with 65,000 images, and a laboratory-curated self-made dataset.

Key findings include:

  • Superior Accuracy: On the MWD dataset, the ensemble reached an accuracy of 99.16%, a significant leap from the 89.32% achieved using original imbalanced data.
  • The Cleaning Advantage: The inclusion of the ENN cleaning step consistently outperformed raw GAN augmentation. By removing "unfriendly" neighbors, the model avoids the confusion caused by distorted synthetic images.
  • Ensemble Stability: While SVM proved to be the strongest individual classifier, the voting method provided the highest overall performance, catching nuances in lighting and shadows that single models might miss.

Conclusion and Future Directions

The study demonstrates that combining generative models with intelligent data cleaning and ensemble learning can effectively overcome the limitations of skewed real-world data. While the system excels at generating high-quality haze and fog images, the authors note that visually similar conditions—such as light rain versus light snow—remain a challenge for current generative models. Future work will focus on refining these generative techniques to better distinguish between visually complex minority classes.

Summary updated

Abstract

Learning from minority class has been a significant and challenging task which has many potential applications. Weather classification is such a case of imbalanced label distribution. This is because in places like Beijing, some types of weather, such as rain and snow, are relatively rare compared to sunny and haze days. Existing methods are primary to classify the weather conditions relying on expensive sensors or human assistance, which however usually are expensive and time-consuming. In this paper, we propose a new ensemble framework based on the advanced generative adversarial network and an effective data cleaning way to address the class imbalance problem for weather classification. The proposed method not only generates new and reliable samples for the minority class to restore balance, but also filters those generated samples which are unreliable. Experiments show that our approach outperforms the state-of-the-art methods by a huge margin for imbalanced weather classification on several benchmark data sets.
BibTeX
@article{huang2020towards,
  author = {Yangru Huang and Yi Jin and Yidong Li and Zhiping Lin},
  title = {{Towards Imbalanced Image Classification: A Generative Adversarial Network Ensemble Learning Method}},
  journal = {IEEE Access},
  year = {2020},
  doi = {10.1109/access.2020.2992683},
}
Figure