Hough Transform Implementation For Event-Based Systems: Concepts and Challenges

Sajjad Seifozzakerini, Wei-Yun Yau, Kezhi Mao, Hossein NejatiFrontiers Comput. Neurosci 2018 · DOI · OpenReview

TL;DR

This paper proposes an extended 3D Hough Transform (HT) specifically designed for event-based vision systems like Dynamic Vision Sensors (DVS). By incorporating a third dimension into the parameter space and implementing it with Spiking Neural Networks (SNNs), the authors achieve robust line segment detection, noise suppression, and efficient hardware implementation without requiring traditional CPUs or large memory footprints.

What Problem Does This Paper Address?

Traditional computer vision algorithms, like the Hough Transform (HT), are designed for frame-based cameras that capture images at discrete time intervals. However, these algorithms struggle with the unique output of event-based sensors, such as Dynamic Vision Sensors (DVS). DVS cameras, which are inspired by biological vision, report changes in pixel intensity asynchronously with high temporal resolution (microseconds). This event-based output, while offering advantages like low latency and high dynamic range, is not directly compatible with conventional frame-based algorithms. Applying existing HT methods to DVS data often leads to issues like increased computational complexity, difficulty in detecting line segments with specific lengths and locations, and susceptibility to noise. This paper aims to bridge this gap by adapting the HT for event-based systems and demonstrating its efficient implementation using Spiking Neural Networks (SNNs).

Methods

The core of this work is the development of an extended 3D Hough Transform (HT). Instead of the traditional 2D parameter space (slope and intercept) for line detection, the authors introduce a third dimension, 'd', representing the position of a point along the detected line relative to a perpendicular line from the origin. This 3D parameter space (θ, r, d) allows for more precise line segment detection, including start and end points, and better handling of noise.

To implement this 3D HT efficiently, the paper leverages Spiking Neural Networks (SNNs). SNNs, which mimic biological neural communication through spikes, are well-suited for event-based data and can be implemented directly on hardware like FPGAs, avoiding the need for traditional CPUs and large memory. The authors propose using a Leaky Integrate-and-Fire (LIF) neuron model, adapted to handle the polarity of DVS events.

Key methodological contributions include:

  • 3D Parameter Space: Extending the HT parameter space to (θ, r, d) for richer line segment characterization.
  • SNN Implementation: Mapping the 3D parameter space onto an SNN for efficient, hardware-accelerated processing.
  • Inhibitory Connections: Utilizing lateral inhibitory connections within the SNN to suppress redundant line detections and noise.
  • Parameter Space Quantization: Developing a non-uniform quantization strategy for the parameter space to optimize neuron allocation and accuracy.
  • Event Polarity Handling: Adapting the LIF neuron model to account for the positive and negative events generated by DVS cameras.

Datasets

The paper does not explicitly mention specific named datasets. Instead, it relies on synthetic data generated to simulate DVS output for various scenarios, such as:

  • A moving square to demonstrate basic event generation.
  • A moving circle to illustrate event distribution in terms of distance and angle.
  • Noisy scenes (e.g., a laptop, a building) to showcase noise removal capabilities.

The focus is on demonstrating the algorithm's principles rather than on evaluating performance against established benchmarks.

Key Insights and Ideas

  • The 3D HT is crucial for event-based systems: The addition of the 'd' dimension in the Hough parameter space is not just an extension but a fundamental requirement for robustly handling the sparse, event-driven nature of DVS data. It allows for distinguishing between actual line segments and noise that might coincidentally align.
  • SNNs are a natural fit for event-based vision: The asynchronous, spike-based communication of SNNs directly aligns with the event-based output of DVS cameras, enabling efficient, low-power hardware implementations.
  • Inhibition is key for cleaning noisy event streams: Lateral inhibition in SNNs effectively acts as a mechanism to suppress spurious line detections, allowing the algorithm to focus on meaningful structures.
  • Non-uniform parameter space quantization matters: Simply quantizing the parameter space uniformly can lead to inefficiencies. The proposed approach optimizes quantization based on the geometric properties of lines, leading to better accuracy and resource utilization.
  • Event polarity is important: Ignoring the polarity of DVS events can lead to imbalanced neuron excitations and require compensatory threshold adjustments. Incorporating polarity handling in the SNN neuron model leads to more robust and natural processing.

Key Results

The paper presents a proof-of-concept demonstrating the effectiveness of their extended 3D HT and SNN implementation.

  • Noise Reduction: Experiments show that the proposed method effectively cleans noisy event streams, preserving important details while removing spurious events (Figure 13).
  • Line Segment Detection: The algorithm can detect line segments with specific lengths and locations, and even end points, which is a limitation of conventional HT.
  • Circle Detection: The method successfully detects the boundary of a moving circle as a series of small lines, with a narrower distribution of events around the boundary after processing (Figure 14).
  • Hardware Efficiency: The SNN implementation on FPGA is highlighted as a significant advantage, enabling real-time processing without high computational costs or large memory requirements. The authors suggest that around 40K neurons are sufficient for a 128x128 frame, a substantial reduction from theoretical estimates.

Limitations and Future Work

  • Post-processing for Shape Detection: While the method effectively extracts line segments, detecting arbitrary shapes requires an additional post-processing layer to search the 3D parameter space for specific patterns.
  • Parameter Tuning: The "goodness" of event removal and the detection of specific details depend on the application and require careful tuning of parameters, such as the size of the line segment considered.
  • Future Work: The authors suggest several avenues for future research, including:
  • Shape encoding using the 3D HT.
  • Invariant template matching for encoded shapes.
  • Object detection and tracking in multi-view scenarios.
  • Further investigation into inhibitory connections and parameter space quantization for specific applications.

Summary updated

Abstract

p>Hough transform (HT) is one of the most well-known techniques in computer vision that has been the basis of many practical image processing algorithms. HT however is designed to work for frame-based systems such as conventional digital cameras. Recently, event-based systems such as Dynamic Vision Sensor (DVS) cameras, has become popular among researchers. Event-based cameras have a significantly high temporal resolution (1 μs), but each pixel can only detect change and not color. As such, the conventional image processing algorithms cannot be readily applied to event-based output streams. Therefore, it is necessary to adapt the conventional image processing algorithms for event-based cameras. This paper provides a systematic explanation, starting from extending conventional HT to 3D HT, adaptation to event-based systems, and the implementation of the 3D HT using Spiking Neural Networks (SNNs). Using SNN enables the proposed solution to be easily realized on hardware using FPGA, without requiring CPU or additional memory. In addition, we also discuss techniques for optimal SNN-based implementation using efficient number of neurons for the required accuracy and resolution along each dimension, without increasing the overall computational complexity. We hope that this will help to reduce the gap between event-based and frame-based systems.</p>
BibTeX
@article{seifozzakerini2018hough,
  author = {Sajjad Seifozzakerini and Wei-Yun Yau and Kezhi Mao and Hossein Nejati},
  title = {{Hough Transform Implementation For Event-Based Systems: Concepts and Challenges}},
  journal = {Frontiers Comput. Neurosci.},
  year = {2018},
  doi = {10.3389/fncom.2018.00103},
}
Figure