A Multiple Moving Object Segmentation Algorithm Based on Background Modeling and Adaptive Clustering

Zhengyi Hu, Qingchang Tan, Kun Zhang, Xin WangInternational Journal of Signal Processing Image Processing and Pattern Recognition 2015 · DOI

Abstract

This paper introduces the Background Modeling and Adaptive Clustering (BMAC) algorithm for robust moving object segmentation in video sequences. BMAC addresses the challenges of uneven lighting and overlapping targets by combining a tiered background modeling approach with a novel self-organizing clustering technique. By utilizing Chebyshev inequality for rapid pixel classification and Kernel Density Estimation (KDE) for ambiguous regions, the algorithm achieves high precision with reduced computational overhead. Furthermore, an adaptive clustering method based on pixel space connectivity and a perpendicular split mechanism allows for multi-object segmentation without a pre-defined number of clusters. Experimental results on real-world traffic surveillance footage demonstrate that BMAC provides superior segmentation accuracy and faster convergence compared to traditional methods.

Introduction

Moving object detection and segmentation are fundamental components of intelligent video surveillance and traffic management systems. Despite significant progress, accurately isolating multiple targets remains difficult in dynamic environments characterized by noise, illumination changes, and target proximity. Traditional background subtraction methods often struggle with complex backgrounds, while standard clustering algorithms like K-means require the number of targets ($k$) to be specified in advance—a requirement that is impractical for real-time, unpredictable scenes.

Methodology

1. Hybrid Background Modeling

The BMAC algorithm employs a multi-stage background modeling process to optimize both speed and accuracy. Initially, the Chebyshev inequality is applied as a fast statistical filter to categorize pixels into definite background or foreground points based on variance.

Pixels that cannot be confidently classified are labeled as "suspicious points" and processed using Kernel Density Estimation (KDE). This non-parametric approach models the probability density function of pixel intensities, providing high accuracy for complex regions while avoiding the high computational cost of applying KDE to the entire frame. Finally, an adaptive thresholding mechanism adjusts classification boundaries based on local image variance, ensuring robustness across different lighting conditions.

2. Adaptive Clustering

After foreground extraction, the algorithm groups pixels into distinct objects using a self-organizing iterative process.

Pixel Space Connectivity Rate

To distinguish between closely moving objects, the algorithm defines a "pixel space connectivity rate." This metric evaluates the spatial relationship between pixels within a local neighborhood, moving beyond simple Euclidean distance to ensure that cohesive objects are treated as single units.

Figure 4: Illustration of the pixel space connectivity rate calculation between foreground pixels.

Self-Organizing Split and Merge

The clustering stage iteratively refines object boundaries through splitting and merging operations. A perpendicular split method is used to divide clusters with low internal connectivity, effectively separating targets that are spatially near but distinct. Conversely, clusters that exhibit high connectivity and proximity are merged. This allows the system to automatically determine the number of objects in the scene without human intervention.

Figure 2: The perpendicular split method and adaptive clustering logic for multi-object segmentation.

Experimental Results

The BMAC algorithm was evaluated using 336×448 traffic surveillance video captured in real-world conditions. The results highlight several key advantages:

  • Efficiency: The hybrid modeling approach significantly reduced processing time compared to pure KDE, maintaining near-real-time performance suitable for surveillance.
  • Accuracy: BMAC successfully segmented individual vehicles even when they were driving in close proximity, a scenario where K-means often failed by either over-segmenting a single vehicle or merging distinct targets.
  • Convergence: The iterative clustering process reached stability in approximately 8 iterations, nearly twice as fast as the standard ISODATA algorithm.

Conclusion

The BMAC algorithm provides an effective solution for multiple moving object segmentation by intelligently combining statistical filtering with adaptive clustering. By eliminating the need for a pre-set number of clusters and focusing computational resources on ambiguous pixels, BMAC achieves a balance of speed and precision suitable for practical applications. Future research may focus on refining the empirical parameters to further enhance the algorithm's autonomy across diverse environmental conditions.

Summary updated

Abstract

A multiple moving object segmentation algorithm based on Background Modeling and Adaptive Clustering (named as BMAC) algorithm is proposed in this paper. For moving object segmentation, the algorithm uses Chebyshev inequality and the kernel density estimation method to do background modeling firstly. Then in order to classify image pixels as background points, foreground points and suspicious points, an adaptive threshold algorithm is proposed accordingly. After using background modeling, adaptive clustering is used for multi-object segmentation. It defines pixel space connectivity rate and designs a perpendicular split method, initial cluster adaptive splitting and merging self-organizing the iterative clustering segmentation algorithm, without pre-set number of clustering, completes multi-object segmentation for the foreground image. The segmentation results are consistent with the human visual judgment, the use of space connectivity information improve the accuracy of clustering segmentation, comparison and analysis the experimental results show that the proposed algorithm is feasible, rapid and effective.
BibTeX
@article{hu2015multiple,
  author = {Zhengyi Hu and Qingchang Tan and Kun Zhang and Xin Wang},
  title = {{A Multiple Moving Object Segmentation Algorithm Based on Background Modeling and Adaptive Clustering}},
  journal = {International Journal of Signal Processing Image Processing and Pattern Recognition},
  year = {2015},
  doi = {10.14257/ijsip.2015.8.12.27},
}
Figure