Particle Image Velocimetry Algorithm Based on Spike Camera Adaptive Integration

Xiaoqiang Li, Cynthia Wu, Yichao Wang, Hongyuan Li, Yuan Li, Tiejun Huang, Yuhao Huang, Pengyu LvSensors 2025 · DOI

TL;DR

This paper introduces a novel Particle Image Velocimetry (PIV) algorithm that leverages neuromorphic spike cameras to overcome severe overexposure issues common in high-illumination environments, particularly at liquid-gas interfaces. By adaptively integrating spike data based on local illumination and particle motion, the method significantly improves particle detection and velocity estimation accuracy in challenging scenarios.

What Problem Does This Paper Address?

Particle Image Velocimetry (PIV) is a powerful technique for measuring fluid flow by tracking particles. However, in scenarios with intense light, such as reflections or scattering at liquid-gas interfaces, images become overexposed. This overexposure saturates pixels, obscuring the particles and making accurate velocity measurements impossible. Traditional high-speed cameras struggle with the wide dynamic range required to capture both bright and dim regions simultaneously. Existing methods to mitigate overexposure, like fluorescent tracers or polarization filters, have limitations in terms of signal strength, applicability, or complexity. This paper aims to solve the problem of accurately measuring velocity fields in these overexposed regions where particle detection is severely compromised.

Methods

The core of this work is a PIV algorithm designed for spike cameras, a type of neuromorphic vision sensor. Unlike traditional cameras that capture full frames, spike cameras output asynchronous "spikes" only when a pixel's light intensity changes significantly. This event-driven nature offers a high dynamic range and temporal resolution.

The proposed algorithm involves three main steps:

  1. Signal Acquisition: Using a spike camera to capture high-frequency digital spike signals.
  2. Spike Signal Preprocessing: This crucial step involves:
  3. Target-Background Segmentation: Differentiating between particle signals and high-illumination background noise.
  4. Background Suppression: Actively reducing the intensity of high-illumination background regions to prevent overexposure. This is achieved by analyzing spike intervals to estimate light intensity and adjusting integration times.
  5. Adaptive Integral Spike Image Reconstruction: This is the novel part. Instead of a fixed integration time, the algorithm adaptively integrates spike data for each particle based on:
  6. Regional Background Illumination: Adjusting integration based on the local light intensity.
  7. Spike Frequency Features: Considering the particle's motion speed (inferred from spike frequency). This adaptive integration aims to maximize the Signal-to-Noise Ratio (SNR) for each particle, leading to clearer reconstructed images suitable for PIV.

Datasets

The paper does not explicitly mention training datasets. However, it uses two primary methods for validation:

  • Synthetic Data: A simulated laminar flow field with a high-illumination liquid-gas interface was generated. This synthetic dataset allowed for precise control over ground-truth velocity fields and overexposure conditions.
  • Experimental Data: Data was collected from a custom-built gravity circulation small turbulent water tunnel. This experiment involved a superhydrophobic coating on the bottom wall, which induced specular reflection and thus overexposure.

Key Insights and Ideas

  • Spike Cameras as a Solution for Dynamic Range: The inherent event-driven nature of spike cameras provides a significant advantage in handling extreme illumination variations, a fundamental limitation of traditional frame-based sensors.
  • Adaptive Integration is Key: Simply capturing spike data isn't enough. The adaptive integration strategy, which dynamically adjusts integration time based on local illumination and particle motion, is critical for reconstructing high-quality images from noisy spike streams.
  • Physics-Driven Approach for Scarce Data: In overexposed scenarios, obtaining sufficient training data for deep learning methods is difficult. This paper's physics-driven approach, focusing on signal processing and adaptive integration, offers a viable alternative.
  • Targeted Background Suppression: Effectively segmenting and suppressing high-illumination background regions is as important as enhancing particle signals for accurate PIV.

Key Results

  • Simulation: In overexposed regions, the spike-based PIV algorithm achieved an average flow velocity estimation error that was 8.594 times lower than that of frame-based cameras. In non-overexposed regions, performance was comparable.
  • Experiment: The spike camera successfully captured continuous high-density particle trajectories, enabling measurable and continuous velocity fields even in the presence of strong reflections from the superhydrophobic coating. This resulted in a high-quality reconstructed image where particles were clearly resolved, unlike the severely overexposed images from frame-based cameras.
  • Image Quality: The spike camera's adaptive integration effectively mitigated overexposure, preserving particle details and the gas-liquid boundary, which were completely obscured in frame-based camera images.

Limitations and Future Work

  • Limitations:
    • The paper notes that while the algorithm shows significant improvement, further enhancement is needed for complex flow fields with quadratic and logarithmic velocity gradients, as the advantage over RMSE decreased in these scenarios.
  • The current study focused on a unidirectional flow scene.
  • Future Work:
    • The authors suggest optimizing and extending the algorithm for flow field observation experiments involving multiphase turbulent boundaries with multidirectional and complex illumination.
  • Further research is needed to improve performance in more complex flow gradient scenarios.

Summary updated

Abstract

In particle image velocimetry (PIV), overexposure is particularly common in regions with high illumination. In particular, strong scattering or background reflection at the liquid-gas interface will make the overexposure phenomenon more obvious, resulting in local pixel saturation, which will significantly reduce the particle image quality, and thus reduce the particle recognition rate and the accuracy of velocity field estimation. This study addresses the overexposure challenges in particle image velocimetry applications, mainly to address the challenge that the velocity field cannot be measured due to the difficulty in effectively detecting particles in the exposed area. In order to address the challenge of overexposure, this paper does not use traditional frame-based high-speed cameras, but instead proposes a particle image velocimetry algorithm based on adaptive integral spike camera data using a neuromorphic vision sensor (NVS). Specifically, by performing target-background segmentation on high-frequency digital spike signals, the method suppresses high illumination background regions and thus effectively mitigates overexposure. Then the spike data are further adaptively integrated based on both regional background illumination characteristics and the spike frequency features of particles with varying velocities, resulting in high signal-to-noise ratio (SNR) reconstructed particle images. Flow field computation is subsequently conducted using the reconstructed particle images, with validation through both simulation and experiment. In simulation, in the overexposed area, the average flow velocity estimation error of frame-based cameras is 8.594 times that of spike-based cameras. In the experiments, the spike camera successfully captured continuous high-density particle trajectories, yielding measurable and continuous velocity fields. Experimental results demonstrate that the proposed particle image velocimetry algorithm based on the adaptive integration of the spike camera effectively addresses overexposure challenges caused by high illumination of the liquid-gas interface in flow field measurements.
BibTeX
@inproceedings{li2025particle,
  author = {Xiaoqiang Li and Cynthia Wu and Yichao Wang and Hongyuan Li and Yuan Li and Tiejun Huang and Yuhao Huang and Pengyu Lv},
  title = {{Particle Image Velocimetry Algorithm Based on Spike Camera Adaptive Integration}},
  booktitle = {Sensors},
  year = {2025},
  doi = {10.3390/s25206468},
}
Figure