Enhancing Training Set for Face Detection Based on SVM

Ruiping Wang, Jie Chen, Shiguang Shan, Xilin Chen, Wen GaoJournal of Software 2009 · DOI

Abstract According to Support Vector Machine (SVM) theory, samples located near the decision boundary typically contain more classification information than those further away. This paper explores boundary enhancement for face detection by proposing an algorithm based on SVM and an Improved Reduced Set (IRS) method. The IRS algorithm incorporates Image Euclidean Distance (IMED) into the kernel function to improve iterative approximation performance. This allows for the generation of informative virtual samples near the boundary to expand and improve the training set distribution. Experimental results on the MIT+CMU frontal face test set demonstrate that training an AdaBoost-based face detector with this enhanced set significantly improves detection performance.

Introduction

In machine learning tasks like face detection, the quality and distribution of training data are paramount. Standard datasets often lack sufficient examples near the decision boundary—the "edge cases" that distinguish a face from a near-face. SVM theory identifies these critical samples as Support Vectors (SVs). This research addresses the sample distribution problem by synthesizing high-value virtual samples to fill the gap near the decision boundary, thereby helping classifiers learn more precise boundaries.

Methodology

The proposed framework utilizes a nonlinear method to generate synthetic training examples through two primary components: the Improved Reduced Set (IRS) algorithm and the Image Euclidean Distance (IMED) metric.

Workflow

The process begins by training an initial SVM on a base dataset to identify support vectors. The IRS algorithm is then employed to generate virtual "Reduced Set Vectors" (RSVs) that approximate the decision function. By embedding IMED—which accounts for spatial correlations between pixels—into the kernel, the generated samples become more robust and representative of real-world image variations.

Workflow of the training set enhancement algorithm

These virtual samples are added back into the original training set to create an "Enhanced Set," which is then used to train a final, efficient classifier such as AdaBoost.

Experimental Results

The effectiveness of the IRS-IMED approach was evaluated using the MIT+CMU frontal face test set. The researchers compared the approximation performance of different distance metrics within the IRS framework.

Comparison of approximation error across different distance metrics

As shown in the approximation error curves, the IMED-RSV and TD-RSV methods reach a stable approximation of the decision boundary much faster and with lower error than the standard Euclidean Distance (ED-RSV). This improved approximation translates directly to better classifier performance. The final detector achieved a 90.73% detection rate on the MIT+CMU set with only 48 false alarms, consistently outperforming models trained on the original, unenhanced dataset.

Conclusion

This paper demonstrates that generating synthetic boundary samples using SVM and IRS with spatial distance metrics can significantly boost the generalization of face detectors. While the generation process is computationally intensive, the resulting high-quality training data allows for the creation of more robust final classifiers. Future work may explore more efficient distance measures and the application of this technique to multi-class problems.

Summary updated

Abstract

根据支持向量机(support vector machine,简称SVM)理论,对基于边界的分类算法(geometric approach)而言,类别边界附近的样本通常比其他样本包含有更多的分类信息.基于这一基本思路,以人脸检测问题为例,探讨了对给定训练样本集进行边界增强的问题,并为此而提出了一种基于支持向量机和改进的非线性精简集算法IRS(improved reduced set)的训练集边界样本增强算法,用以扩大训练集并改善其样本分布.其中,所谓IRS算法是指在精简集(reduced set)算法的核函数中嵌入一种新的距离度量——图像欧式距离——来改善其迭代近似性能,IRS可以有效地生成新的、位于类别边界附近的虚拟样本以增强给定训练集.为了验证算法的有效性,采用增强的样本集训练基于AdaBoost的人脸检测器,并在MIT+CMU正面人脸测试库上进行了测试.实验结果表明,通过这种方法能够有效地提高最终分类器的人脸检测性能.
BibTeX
@article{wang2009enhancing,
  author = {Ruiping Wang and Jie Chen and Shiguang Shan and Xilin Chen and Wen Gao},
  title = {{Enhancing Training Set for Face Detection Based on SVM}},
  journal = {Journal of Software},
  year = {2009},
  doi = {10.3724/sp.j.1001.2008.02921},
}
Figure