DISC: Deep Image Saliency Computing via Progressive Representation Learning

Tianshui Chen, Liang Lin, Lingbo Liu, Xiaonan Luo, Xuelong Li

Abstract

DISC introduces a progressive coarse-to-fine framework for salient object detection. By utilizing two stacked convolutional neural networks (CNNs)—one for global context and another for local refinement—the model generates pixel-accurate saliency maps. The integration of superpixel-based pooling layers, specifically Intra-superpixel smoothing (ISS) and Inter-superpixel voting (ISV), ensures spatial consistency. This data-driven approach allows the model to outperform traditional hand-crafted priors and achieve state-of-the-art performance on major benchmarks.

Introduction

In computer vision, "saliency" refers to the identification of the most informative or attention-grabbing regions in an image. Historically, researchers relied on mathematical priors, such as center-bias or high local contrast. However, these hand-crafted assumptions are often brittle; local contrast methods may only highlight boundaries, while global methods can fail in cluttered environments. DISC addresses these limitations by moving toward a purely data-driven, end-to-end learning framework capable of handling complex backgrounds and preserving fine object details.

Methodology: Coarse-to-Fine Progressive Learning

The core innovation of DISC is its two-stage architecture designed to mimic human visual perception—glancing at a scene to find regions of interest before focusing to resolve details.

The DISC architecture: Coarse representation learning identifies global saliency, followed by fine representation learning for pixel-level refinement.

Coarse-Level and Fine-Level Networks

The process begins with the Coarse-Level CNN, which analyzes the entire image to determine the "where" and "what" of salient objects. To ensure the output respects object boundaries, the authors integrate Superpixel-based Local Context Information (SLCI) via two novel pooling layers: Intra-superpixel smoothing (ISS), which averages saliency scores within regions for consistency, and Inter-superpixel voting (ISV), which refines scores based on regional similarity.

Subsequently, the Fine-Level CNN focuses on local patches guided by the coarse map. It processes the original image patch, the corresponding coarse saliency patch, and a "spatial regularization" map to produce a high-resolution, pixel-accurate final map.

Technical Innovations

Beyond the progressive structure, DISC introduces several key technical refinements:

  • Hinge Loss Integration: Instead of standard classification, the authors embed a Support Vector Machine (SVM)-like hinge loss directly into the CNN, improving visual quality and accuracy.
  • Non-parametric Spatial Regularization: Rather than hard-coding a center-bias prior, the network learns spatial distributions implicitly by using an average of all ground-truth maps from the training set as an additional input channel.

Experimental Results

The model was evaluated on major benchmarks including MSRA10K, ECSSD, and PASCAL1500. DISC demonstrated exceptional robustness, performing well across diverse datasets without fine-tuning, suggesting it learns fundamental features of saliency rather than just memorizing specific datasets.

Qualitative comparison of DISC (c) against ground truth (b) and various traditional methods (d-h) across different image types.

Quantitatively, on the MSRA10K dataset, DISC achieved a precision of 97.3% and a 15.3% improvement in recall over previous state-of-the-art methods. As shown in the comparison above, DISC (column c) consistently produces maps that are closer to the ground truth (column b) than traditional methods based on local or global contrast (columns d-e). Furthermore, the system is efficient, processing maps in approximately 75ms on a single GPU. The authors also demonstrated task-oriented flexibility; by fine-tuning on specific categories like "butterflies," the model could be adapted from generic saliency to specific object detection.

Conclusion

DISC successfully bridges traditional computer vision techniques like superpixels with modern deep learning. While the fine-level map depends on the quality of the coarse-level output, the framework represents a significant step forward in data-driven saliency detection. Future work may involve incorporating higher-level semantic knowledge and extending the model to video saliency, where temporal consistency becomes critical.

Summary updated

Abstract

Salient object detection increasingly receives attention as an important component or step in several pattern recognition and image processing tasks. Although a variety of powerful saliency models have been intensively proposed, they usually involve heavy feature (or model) engineering based on priors (or assumptions) about the properties of objects and backgrounds. Inspired by the effectiveness of recently developed feature learning, we provide a novel Deep Image Saliency Computing (DISC) framework for fine-grained image saliency computing. In particular, we model the image saliency from both the coarse- and fine-level observations, and utilize the deep convolutional neural network (CNN) to learn the saliency representation in a progressive manner. Specifically, our saliency model is built upon two stacked CNNs. The first CNN generates a coarse-level saliency map by taking the overall image as the input, roughly identifying saliency regions in the global context. Furthermore, we integrate superpixel-based local context information in the first CNN to refine the coarse-level saliency map. Guided by the coarse saliency map, the second CNN focuses on the local context to produce fine-grained and accurate saliency map while preserving object details. For a testing image, the two CNNs collaboratively conduct the saliency computing in one shot. Our DISC framework is capable of uniformly highlighting the objects-of-interest from complex background while preserving well object details. Extensive experiments on several standard benchmarks suggest that DISC outperforms other state-of-the-art methods and it also generalizes well across datasets without additional training. The executable version of DISC is available online: http://vision.sysu.edu.cn/projects/DISC.
BibTeX
@article{chen2015disc,
  author = {Tianshui Chen and Liang Lin and Lingbo Liu and Xiaonan Luo and Xuelong Li},
  title = {{DISC: Deep Image Saliency Computing via Progressive Representation Learning}},
  journal = {IEEE Trans. Neural Networks Learn. Syst.},
  year = {2015},
  doi = {10.1109/tnnls.2015.2506664},
}
Figure