Abstract
Video deblurring is a critical task for restoring clarity to sequences affected by motion blur. Traditional approaches often rely on computationally intensive alignment modules, such as optical flow or deformable convolutions, which limit their real-time applicability. This paper introduces the Deep Discriminative Spatial and Temporal Network (DSTNet), a lightweight framework that achieves state-of-the-art performance without explicit alignment. By leveraging dynamic spatial filters, discriminative temporal fusion, and wavelet-based feature propagation, DSTNet offers a highly efficient solution for high-quality video restoration.
Introduction
The challenge of video deblurring lies in effectively aggregating information across multiple frames to recover sharp details. Most existing methods attempt to align neighboring frames to a reference frame before fusion. However, alignment is inherently difficult when frames are severely blurred, and the associated computational cost (FLOPs) is often prohibitive for mobile or edge devices. DSTNet shifts the paradigm from explicit alignment to discriminative fusion, utilizing adaptive modules to extract and propagate relevant features efficiently.
Methodology
The DSTNet architecture is composed of three primary components designed for efficiency and accuracy:
- Channel-wise Gated Dynamic Network (CWGDN): Standard convolutions use static kernels that are content-agnostic. CWGDN instead uses a Multi-Layer Perceptron (MLP) to generate dynamic filters that adapt to the specific spatial characteristics of each frame. This allows the model to capture complex spatial details with significantly fewer parameters than Transformer-based architectures.
- Discriminative Temporal Feature Fusion (DTFF): To avoid the pitfalls of inaccurate alignment, DTFF employs a gating mechanism that "discriminates" between useful and noisy features from adjacent frames. This ensures that only high-quality temporal information contributes to the restoration process.
- Wavelet-based Feature Propagation (WaveletFP): Long-range temporal information is crucial for consistent deblurring. DSTNet propagates features in the wavelet domain, focusing on low-frequency components. This strategy reduces the accumulation of artifacts and lowers the computational burden compared to full-resolution feature propagation.
Experimental Results
DSTNet was benchmarked against leading models on the GoPro, DVD, and BSD datasets.
Quantitative Performance
On the GoPro dataset, the "Ours-L" version of DSTNet achieved a peak signal-to-noise ratio (PSNR) of 35.05 dB. As shown in Figure 1, DSTNet occupies the upper-left quadrant of the performance-efficiency plot, indicating superior accuracy at a fraction of the computational cost of rivals like BasicVSR++ and Restormer.
Efficiency and Speed
The base DSTNet model operates at approximately 12.5 frames per second (FPS) on an NVIDIA RTX A6000. This represents a 5x to 30x speedup over high-performance models such as RVRT or EDVR. Furthermore, the model is highly compact, with parameter counts as low as 7.45M.
Qualitative Analysis
Visual results demonstrate DSTNet's ability to recover sharp edges and fine textures in dynamic scenes, effectively handling real-world motion blur.
Conclusion
DSTNet provides a robust and efficient framework for video deblurring by replacing heavy alignment modules with discriminative and dynamic components. Its ability to maintain high accuracy while significantly reducing computational overhead makes it a promising candidate for real-world video processing applications. Future research will focus on improving robustness to abrupt scene transitions through semantic scene understanding.
Summary updated