Enhancing Vehicle Re-identification and Matching for Weaving Analysis

Mei Qiu, Wei Lin, Stanley Y. P. Chien, Lauren A. Christopher, Yaobin Chen, Shu Hu

Introduction

Highway weaving zones—areas where entry and exit ramps are closely spaced—represent significant challenges for traffic management. Understanding the precise movement of vehicles between specific lanes at these points is crucial for optimizing road design and safety. However, traditional tracking methods often fail due to the non-overlapping nature of highway camera views and the low resolution of distant surveillance footage.

A Two-Phase Framework for Weaving Analysis

To address these challenges, this research introduces a specialized framework that combines deep learning-based re-identification (ReID) with robust spatio-temporal matching.

The proposed two-phase framework for weaving analysis, encompassing dataset generation, ReID model training, and spatio-temporal matching.

The framework operates in two distinct phases:

  1. Phase 1: Dataset and Model Training: A custom ReID model is developed using a Vision Transformer (ViT) backbone. The model is trained using ID Loss and Triplet Loss to create a feature space where images of the same vehicle are clustered together, even across different camera views.
  2. Phase 2: Weaving Analysis and Matching: The system utilizes a modified Hungarian Matching algorithm to link vehicle detections. This algorithm goes beyond simple visual similarity by incorporating a cost matrix that accounts for visual similarity (cosine distance), spatio-temporal constraints (travel time deviations), and vehicle type filtering.

The VeID-Weaving Dataset

A core contribution of this work is the VeID-Weaving dataset, designed to reflect the harsh realities of highway monitoring. Containing 78,979 images of 4,902 unique vehicles across 9 weaving areas, it presents a significantly higher difficulty level than standard benchmarks.

Sample images from the VeID-Weaving dataset, highlighting the low resolution and diverse vehicle types encountered in real-world highway surveillance.

Notably, 86% of the images in this dataset are smaller than 200 pixels. This low resolution, combined with varying viewpoints (front vs. rear) and the presence of visually similar vehicles, makes accurate ReID a formidable task.

Key Insights and Performance

The research highlights several critical factors in successful weaving analysis:

  • Physics as a Prior: Incorporating travel time constraints into the matching algorithm is essential. It helps distinguish between visually identical vehicles by filtering out candidates that could not physically have traveled between cameras in the observed timeframe.
  • The Drone Advantage: Comparative analysis showed that drone-mounted cameras often outperform fixed highway cameras due to better viewing angles and higher resolution, which are vital for capturing identifiable vehicle features.
  • Precision and Reliability: While the ReID model achieved a Mean Average Precision (mAP) of 47.8%, the overall system demonstrated high precision (up to 94.7%) in real-world weaving segments. This indicates that while not every vehicle is matched, the matches produced are highly reliable for statistical traffic analysis.

Conclusion and Future Directions

This framework provides a robust baseline for lane-level traffic pattern estimation in complex highway environments. Future work will focus on addressing viewpoint mismatch through multi-view feature fusion and implementing adaptive thresholds to better handle varying traffic densities and environmental conditions.

Summary updated

Abstract

Vehicle weaving on highways contributes to traffic congestion, raises safety issues, and underscores the need for sophisticated traffic management systems. Current tools are inadequate in offering precise and comprehensive data on lane-specific weaving patterns. This paper introduces an innovative method for collecting non-overlapping video data in weaving zones, enabling the generation of quantitative insights into lane-specific weaving behaviors. Our experimental results confirm the efficacy of this approach, delivering critical data that can assist transportation authorities in enhancing traffic control and roadway infrastructure. More information about our dataset can be found here: VeID-Weaving.
BibTeX
@inproceedings{qiu2024enhancing,
  author = {Mei Qiu and Wei Lin and Stanley Y. P. Chien and Lauren A. Christopher and Yaobin Chen and Shu Hu},
  title = {{Enhancing Vehicle Re-identification and Matching for Weaving Analysis}},
  booktitle = {AVSS},
  year = {2024},
  url = {https://openreview.net/forum?id=BakJDUjqWr},
}

Loading related content...

Figure