Salient Object Detection via Objectness Proposals

Tam V. NguyenAAAI 2015 · DOI

Introduction

Salient object detection (SOD) is a fundamental task in computer vision aimed at identifying regions in an image that naturally attract human attention. Historically, SOD models have been categorized into biologically-inspired approaches, which mimic human visual systems, and computationally-oriented models, which leverage mathematical contrast. A persistent challenge in this field is the "objectness" problem: distinguishing between a high-contrast region (e.g., a bright sky) and a coherent physical object (e.g., a bird). Furthermore, many state-of-the-art models are too computationally intensive for real-time applications like robotics. This paper introduces a system that bridges the gap between visual interest and objecthood by integrating fast objectness proposals with foreground and compactness cues.

Methodology

The proposed system utilizes a four-step pipeline to generate pixel-accurate saliency maps efficiently.

Overview of the proposed saliency detection pipeline, integrating objectness, foreground, and compactness maps.
  1. Objectness Map: The system employs the Binarized Normed Gradients (BING) method to generate approximately 1,000 object proposals. BING is selected for its extreme efficiency, operating at roughly 300 frames per second (fps). These proposals are aggregated to form an initial "objectness map."
  2. Foreground Map: By analyzing the background margins of the image, the algorithm computes a foreground map that prioritizes regions likely to contain the primary subject rather than the surrounding environment.
  3. Compactness Map: The image is over-segmented into 100 superpixels using the Simple Linear Iterative Clustering (SLIC) algorithm. The spatial distribution of these superpixels is evaluated; since salient objects are typically spatially compact, this map filters out scattered "noisy" regions.
  4. Integration: The final saliency map is produced by pixel-level multiplication of the objectness, foreground, and compactness maps. This ensures that high saliency is only assigned to regions that simultaneously appear to be objects, reside in the foreground, and maintain spatial coherence.

Evaluation and Results

The objectness proposal generator was trained on the VOC2007 dataset, while the complete system was evaluated using the MSRA-1000 benchmark, which contains 1,000 images with human-annotated ground truth.

ROC curve analysis on the MSRA-1000 dataset comparing the proposed method against established baselines.

The experimental results demonstrate that the proposed method ("Ours") consistently outperforms several established baselines, including AIM, IT, and SR, in terms of Receiver Operating Characteristic (ROC) curve analysis. Beyond accuracy, the system achieves a processing speed of 0.07 seconds per image (~15 fps) on a standard PC (Intel i7 3.3 GHz). This is significantly faster than many competing methods; for example, the AIM method requires 62.4 seconds for the same task.

Key Insights and Limitations

The core innovation lies in treating saliency detection as a subset of object detection. By using a "weak" but fast object detector (BING) as a prior, the system avoids distractions from high-contrast background textures. The combination of global structural cues (objectness) and local spatial cues (compactness) allows the model to handle objects of various scales effectively.

However, the system's performance is inherently dependent on the quality of the initial object proposals. If the BING estimator fails to detect an object due to extreme camouflage or unusual geometry, the final saliency map will likely be inaccurate. Additionally, the use of 100 superpixels—a choice made to maintain real-time speeds—may lead to a loss of fine detail in complex scenes with multiple small salient objects. Despite these limitations, the system's efficiency makes it a strong candidate for integration into broader computer vision pipelines for autonomous systems.

Summary updated

BibTeX
@inproceedings{nguyen2015salient,
  author = {Tam V. Nguyen},
  title = {{Salient Object Detection via Objectness Proposals}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2015},
  doi = {10.1609/aaai.v29i1.9279},
}
Figure