A Dataset and Model for Realistic License Plate Deblurring

Haoyan Gong, Yuzheng Feng, Zhenrong Zhang, Xianxu Hou, Jingxin Liu, Siqi Huang, Hongbin LiuIJCAI 2024

Introduction

In intelligent traffic systems, motion blur remains a significant hurdle for automated license plate recognition. Fast-moving vehicles and challenging lighting conditions often produce images that are unreadable by standard OCR systems. This paper addresses two primary gaps in the field: the lack of realistic training data and the need for models that prioritize character structural integrity over general image sharpness.

The LPBlur Dataset: Bridging the Data Gap

Most existing deblurring models rely on synthetic data generated through mathematical kernels. However, these fail to capture the complexities of real-world motion blur, such as sensor noise and overexposure. To solve this, the authors introduced LPBlur, a large-scale dataset containing 10,288 paired sharp and blurred images.

The data was captured using a custom dual-camera system. "Camera S" utilized a short exposure to provide ground-truth sharp images, while "Camera L" used a longer exposure to capture authentic motion blur. This setup ensures that the model learns from the actual physical degradations encountered on the road across various conditions, including low light and rain.

LPDGAN: Architecture for Character-Centric Deblurring

The proposed License Plate Deblurring Generative Adversarial Network (LPDGAN) moves beyond standard convolutional neural networks by focusing on the unique requirements of license plate imagery.

Architecture of LPDGAN featuring Swin Transformer blocks and specialized modules for text reconstruction and character-level discrimination.

The architecture incorporates three key innovations:

  1. Multi-scale Feature Extraction: Utilizing Swin Transformer blocks, the model captures long-range dependencies, effectively resolving "ghosting" artifacts where character fragments are smeared across the frame.
  2. Text Reconstruction Module (TRM): By integrating a pre-trained CRNN recognition model, the generator is supervised to maintain the structural integrity of alphanumeric characters, ensuring readability rather than just visual smoothness.
  3. Partition Discriminator Module (PDM): Unlike global discriminators, the PDM inspects randomly selected individual characters. This forces the generator to focus on fine-grained details, preventing the "hallucination" of incorrect symbols.

Experimental Results

LPDGAN was evaluated against five state-of-the-art (SOTA) methods, including Pix2Pix and MSSNet. Quantitatively, LPDGAN achieved a PSNR of 29.95 and an SSIM of 0.7950 in normal lighting conditions.

Qualitative comparison of LPDGAN against state-of-the-art deblurring methods. LPDGAN produces significantly sharper characters that closely match the ground truth.

More importantly, the model significantly improved readability. In low-light scenarios, LPDGAN achieved a Text Levenshtein Distance (TLD) of 0.81, outperforming the next best model (LBAG at 1.13). Overall, using LPDGAN-restored images led to a 21.24% improvement in license plate recognition accuracy compared to other SOTA methods.

Conclusion

By combining a realistic dataset (LPBlur) with a character-aware generative model (LPDGAN), this research provides a robust solution for license plate deblurring. While future work will focus on expanding geographic diversity and handling more complex character sets, the current results demonstrate a clear path forward for enhancing intelligent traffic systems.

Summary updated

BibTeX
@inproceedings{gong2024dataset,
  author = {Haoyan Gong and Yuzheng Feng and Zhenrong Zhang and Xianxu Hou and Jingxin Liu and Siqi Huang and Hongbin Liu},
  title = {{A Dataset and Model for Realistic License Plate Deblurring}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2024},
}
Figure