Detecting and localizing edges composed of steps, peaks and roofs

Pietro Perona, Jitendra Malik

Abstract

Standard edge detectors often fail because they assume all edges are simple "steps." This paper proves that linear filters (like the Canny detector) inherently struggle to accurately locate "composite" edges—mixtures of steps, peaks, and roofs—and introduces a quadratic filtering approach that achieves zero localization error while remaining immune to false positives caused by smooth shading.

Introduction: The Problem with Step Edges

In the early 1990s, computer vision relied heavily on the "step edge" model: the idea that an edge is a sudden jump in brightness. However, real-world physics is messier. Due to mutual illumination, specularities, and surface geometry, edges are often a combination of steps, delta functions (lines), and roofs (ramps).

Examples of composite edge profiles including steps, ramps, and delta functions.

The authors identify two major flaws in existing linear edge detectors:

  1. Systematic Localization Error: When an edge is "composite" (e.g., a step plus a small peak), a linear filter will shift the detected edge position away from the true boundary.
  2. Shading Sensitivity: Linear filters often mistake smooth, constant brightness gradients (shading) for actual edges, leading to "false positives" unless high thresholds are used, which might then discard real, low-contrast edges.

Methods: Moving to Quadratic Filtering

The core innovation is moving from linear filtering to quadratic filtering. Instead of looking for maxima in a single linear filter response, the authors look for maxima in the "energy" of the signal. This is calculated as the sum of squares of responses from a family of filters: $W = \sum (I * f_i)^2$.

Specifically, they use Hilbert pairs—pairs of even and odd filters (like a second derivative of a Gaussian and its Hilbert transform). This makes the detector "phase-independent," allowing it to detect a step, a line, or a roof at the exact same location without bias. Furthermore, they show that the Hilbert transform of the second derivative of a Gaussian ($G''_H$) is particularly effective, offering 32% better immunity to shading than standard Gaussian derivatives.

To handle 2D images, a windowed approach and a technique based on Singular Value Decomposition (SVD) are used to approximate the filter response at any orientation. This allows the system to represent multiple orientations at a single point, preventing the "rounding" of corners and junctions common in other detectors.

Key Results and Localization Accuracy

The authors provide a mathematical proof that any fixed, finite family of linear filters will have systematic localization errors for certain composite edges. In contrast, the quadratic filter achieves zero systematic localization error for composite edges.

Localization performance of the proposed quadratic filter on various edge profiles, demonstrating zero systematic error across steps, deltas, and roofs.

Evaluation on synthetic 1D signals proved zero localization error for various composite edge profiles. Qualitatively, the detector maintains the integrity of T-junctions where standard detectors often "break" or round the intersection. By allowing for multiple dominant orientations at a single pixel, the algorithm can localize T-junctions and corners without typical blurring or "breaking" seen in detectors that assume only one edge direction per pixel.

Conclusion

While computationally more complex than linear methods at the time of publication, this approach addresses fundamental theoretical limits of edge detection. By moving to a phase-independent quadratic energy model, the system provides a more robust and accurate foundation for higher-level computer vision tasks like surface reconstruction and object recognition.

Summary updated

Abstract

The projection of depth or orientation discontinuities in a physical scene results in image intensity edges which are not ideal step edges but are more typically a combination of step, peak and roof profiles. Most edge detection schemes ignore the composite nature of these edges, resulting in systematic errors in detection and localization. The problem of detecting and localizing these edges is addressed, along with the problem of false responses in smoothly shaded regions with constant gradient of the image brightness. A class of nonlinear filters, known as quadratic filters, is appropriate for this task, while linear filters are not. Performance criteria are derived for characterizing the SNR, localization and multiple responses of these filters in a manner analogous to Canny's criteria for linear filters. A two-dimensional version of the approach is developed which has the property of being able to represent multiple edges at the same location and determine the orientation of each to any desired precision. This permits junctions to be localized without rounding. Experimental results are presented.<
BibTeX
@inproceedings{perona1990detecting,
  author = {Pietro Perona and Jitendra Malik},
  title = {{Detecting and localizing edges composed of steps, peaks and roofs}},
  booktitle = {IEEE/CVF International Conference on Computer Vision},
  year = {1990},
  doi = {10.1109/iccv.1990.139492},
}

Loading related content...

Figure