iTASK - Intelligent Traffic Analysis Software Kit

Minh-Triet Tran, Tam V. Nguyen, Trung-Hieu Hoang, Trung-Nghia Le, Khac-Tuan Nguyen, Dat-Thanh Dinh, Thanh-An Nguyen, Hai-Dang Nguyen, Xuan-Nhat Hoang, Trong-Tung Nguyen, Viet-Khoa Vo-Ho, Trong-Le Do, Lam Nguyen, Minh-Quan Le, Hoang-Phuc Nguyen-Dinh, Trong-Thang Pham, Xuan-Vy Nguyen, E-Ro Nguyen, Quoc-Cuong Tran, Hung Tran, Hieu Dao, Mai-Khiem Tran, Quang-Thuc Nguyen, Tien-Phat Nguyen, The-Anh Vu-Le, Gia-Han Diep, Minh N. Do

Introduction

The Intelligent Traffic Analysis Software Kit (iTASK) is a modular framework designed to address three pivotal challenges in smart city infrastructure: vehicle flow counting, multi-camera vehicle re-identification (Re-ID), and traffic anomaly detection. Developed for the AI City Challenge 2020, iTASK integrates advanced deep learning techniques, such as GAN-based future prediction, with traditional computer vision paradigms like "Bag of Attributes" retrieval to achieve robust performance in complex urban environments.

Traffic analysis is foundational to the "AI City" vision but faces significant hurdles. Vehicle counters often fail due to occlusions and lane confusion at intricate intersections. Re-ID is complicated by the visual similarity of vehicles (e.g., identical white sedans), where standard deep learning features may overlook distinguishing details. Finally, anomaly detection—such as identifying crashes or stalled vehicles—often suffers from latency, making it difficult to pinpoint the exact onset of an event.

Methodology

Refined Motion-Specific ROIs for Vehicle Counting

To overcome the limitations of global detectors, iTASK employs "motion-specific Regions of Interest" (m-ROIs). Instead of monitoring the entire scene, the system defines specific zones corresponding to allowed movements, such as left turns or straight-through traffic. By utilizing CenterNet with various backbones (e.g., ResNet, DLA) to track vehicles exclusively within these m-ROIs, the framework significantly reduces errors related to lane-switching and occlusions.

Refined Motion-Specific ROIs (m-ROIs) and the refinement process for accurate vehicle counting.

Bag of Vehicle Attributes for Re-Identification

The Re-ID module treats vehicle identification as a document retrieval problem. In this analogy, a vehicle is a "document," and its specific attributes—such as decals (scene text), brand logos, wheel types, and light configurations—are "words." The system combines standard deep metric embeddings from a Triplet Net with a secondary "attribute distance" calculation. This multi-faceted approach allows the model to distinguish between visually similar vehicles by focusing on unique "signatures" that global features might miss.

The Bag of Vehicle Attributes Retrieval Module, showing the integration of attribute descriptors and re-ranking for vehicle Re-ID.

Forward-Backward Refinement for Anomaly Detection

Anomaly detection is handled through a dual-phase approach:

  1. Forward Prediction: A UNet-based Generative Adversarial Network (GAN) predicts the subsequent frame based on current motion patterns. Significant deviations between the predicted and actual frames trigger an anomaly flag.
  2. Backward Tracking: Once a stall or incident is detected, the system tracks the vehicle backward in time. This retrospective analysis allows for precise temporal localization, identifying the exact moment the vehicle stopped or changed direction abruptly.

Evaluation and Results

The iTASK framework was evaluated on the AI City Challenge 2020 datasets across three tracks:

  • Track 4 (Anomaly Detection): Achieved an S4 score of 0.9059 and an F1 score of 0.9421, ranking 5th out of 13 teams.
  • Track 1 (Vehicle Flow Counting): Earned an S1 score of 0.8297, placing 10th out of 18 teams.
  • Track 2 (Vehicle Re-ID): Achieved a mAP of 0.3882, placing 26th out of 41 teams.

Key Insights

A major contribution of iTASK is the "Document" analogy for vehicles, which provides a structured way to handle fine-grained Re-ID. Furthermore, the implementation of backward tracking solves the "temporal localization" problem inherent in reactive anomaly detectors. The system also emphasizes adaptability, using specialized detectors for varying lighting conditions (day vs. night) and vehicle sizes.

Conclusion and Future Work

While iTASK demonstrated strong performance in anomaly detection and counting, the Re-ID results suggest that the "Bag of Attributes" approach could benefit from more robust feature fusion. Future work will focus on integrating automated scene text recognizers and expanding the attribute set to further enhance discriminative power in open-world environments.

Summary updated

Abstract

Traffic flow analysis is essential for intelligent transportation systems. In this paper, we introduce our Intelligent Traffic Analysis Software Kit (iTASK) to tackle three challenging problems: vehicle flow counting, vehicle re-identification, and abnormal event detection. For the first problem, we propose to real-time track vehicles moving along the desired direction in corresponding motion-of-interests (MOIs). For the second problem, we consider each vehicle as a document with multiple semantic words (i.e., vehicle attributes) and transform the given problem to classical document retrieval. For the last problem, we propose to forward and backward refine anomaly detection using GAN-based future prediction and backward tracking completely stalled vehicle or sudden-change direction, respectively. Experiments on the datasets of traffic flow analysis from AI City Challenge 2020 show our competitive results, namely, S1 score of 0.8297 for vehicle flow counting in Track 1, mAP score of 0.3882 for vehicle re-identification in Track 2, and S4 score of 0.9059 for anomaly detection in Track 4. All data and source code are publicly available on our project page.
BibTeX
@inproceedings{tran2020itask,
  author = {Minh-Triet Tran and Tam V. Nguyen and Trung-Hieu Hoang and Trung-Nghia Le and Khac-Tuan Nguyen and Dat-Thanh Dinh and Thanh-An Nguyen and Hai-Dang Nguyen and Xuan-Nhat Hoang and Trong-Tung Nguyen and Viet-Khoa Vo-Ho and Trong-Le Do and Lam Nguyen and Minh-Quan Le and Hoang-Phuc Nguyen-Dinh and Trong-Thang Pham and Xuan-Vy Nguyen and E-Ro Nguyen and Quoc-Cuong Tran and Hung Tran and Hieu Dao and Mai-Khiem Tran and Quang-Thuc Nguyen and Tien-Phat Nguyen and The-Anh Vu-Le and Gia-Han Diep and Minh N. Do},
  title = {{iTASK - Intelligent Traffic Analysis Software Kit}},
  booktitle = {Workshops @ CVPR},
  year = {2020},
  doi = {10.1109/cvprw50498.2020.00314},
}
Figure