Detection of Illegal U-turn Vehicles by Optical Flow Analysis

Chang-Ho Song, Jaesung LeeThe Journal of Korean Institute of Communications and Information Sciences 2014 · DOI

Abstract

Today, Intelligent Vehicle Detection Systems (IVDS) seek to reduce negative factors such as accidents beyond merely gathering traffic information. This paper proposes a detection algorithm for illegal U-turn vehicles, which can cause critical accidents among road traffic law violations. We hypothesized that if calculated optical flow vectors appeared on an illegal U-turn path, they would likely be caused by illegal U-turn vehicles. To reduce high computational complexity, we utilized the Pyramid Lucas-Kanade algorithm to track specific key-points, such as corners. Furthermore, we detected the center lane using color information and the Progressive Probabilistic Hough Transform (PPHT) to restrict analysis to a specific Region of Interest (ROI). Finally, we selected vectors on the illegal U-turn path and calculated reliability to confirm the detection. Experimental results show that the proposed algorithm is efficient and suitable for real-time applications.

1. Introduction

Illegal U-turns are a major cause of fatal traffic accidents, yet detecting them automatically in real-time remains a challenge for Intelligent Vehicle Detection Systems (IVDS). Traditional video analysis often struggles with the high computational cost of "dense" optical flow—the pattern of apparent motion calculated for every pixel in a scene. Calculating motion for every pixel in a high-resolution video feed is too slow for real-time enforcement. Furthermore, environmental noise like moving shadows or swaying trees can trigger false positives.

Conceptual illustration of illegal U-turn paths across the center line

This research addresses these challenges by proposing a sparse optical flow pipeline that focuses on specific regions of interest (ROI) and utilizes reliability verification to distinguish vehicles from background noise.

2. Proposed Methodology

The authors developed a multi-stage pipeline designed to minimize unnecessary calculations and maximize processing speed.

Flowchart of the proposed illegal U-turn detection algorithm

2.1 Lane Detection and ROI Setting

Instead of analyzing the whole frame, the system first identifies the yellow center line. It converts the image from RGB to the HSV color space, which is more robust for isolating specific colors under varying light. It then uses the Progressive Probabilistic Hough Transform (PPHT) to find the straight line of the median. A narrow Region of Interest (ROI) is then drawn around this line to focus the motion analysis.

2.2 Feature Point Selection and Sparse Optical Flow

To further save time, the system uses Harris Corner Detection. Rather than tracking every pixel, it only tracks "corners"—points with high intensity changes in multiple directions—which are more stable and easier to follow across frames. The system applies the Pyramid Lucas-Kanade (PLK) algorithm to these corner points. This "sparse" approach tracks only the selected features within the ROI.

2.3 U-turn Logic and Reliability Verification

The system looks for motion vectors that are perpendicular to the center line (horizontal movement). To filter out noise (like a shadow crossing the line), it uses a reliability algorithm that clusters these vectors. If a group of vectors moves cohesively and exceeds a reliability threshold, it is flagged as an illegal U-turn.

3. Experimental Results

The algorithm was evaluated using real-world footage (640 x 480 resolution) recorded near the Korea National University of Transportation. The proposed method showed a dramatic improvement in speed compared to standard dense optical flow methods:

  • Dense Optical Flow (Full Frame): 116.43 ms
  • Proposed Sparse PLK (Full Frame): 24.12 ms
  • Proposed Sparse PLK (Within ROI): 6.43 ms

The ROI-based sparse method is approximately 18 times faster than traditional dense full-frame analysis. In testing, the reliability verification successfully filtered out non-vehicle motion, resulting in a 0% false detection rate for the provided test samples.

4. Conclusion

By combining color-based lane detection with sparse optical flow focused on a specific ROI, the proposed system achieves high accuracy with a processing time of just 6.43ms per frame. This efficiency makes it a viable solution for real-time traffic enforcement. Future work will explore improving robustness under adverse weather conditions and handling complex occlusion scenarios in dense traffic.

Summary updated

Abstract

오늘날 지능형 영상 검지기 시스템(Intelligent Vehicle Detection System)이 추구하는 방향은 기존 시스템의 교통 소통 정보 습득을 넘어서 교통정체, 사고 등과 같은 부정적인 요인을 줄이는 것이다. 본 논문에서는 도로 교통법규 위반 상황 중에서 가장 치명적인 사고를 유발 할 수 있는 불법 유턴 차량을 검지하는 알고리즘을 제안한다. 영상의 옵티컬 플로우 벡터(Optical Flow Vector)를 구하고 이 벡터가 불법 유턴 경로 상에 나타난다면 불법 유턴차량에 의해 생긴 벡터일 확률이 높을 것이라는 점에 착안하여 연구를 진행했다. 옵티컬 플로우 벡터를 구하기 전에 연산량 절감을 위하여 코너(corner)와 같은 특징점을 선지정한 후 그 점들에 대해서만 추적하는 피라미드 루카스-카나데(pyramid Lucas-Kanade) 알고리즘을 사용했다. 이 알고리즘은 연산량이 매우 높기 때문에 먼저 컬러 정보와 진보된 확률적 허프 변환(progressive probabilistic hough transform)으로 중앙선을 검출하고 그 주위 영역에만 적용시켰다. 그리고 검출된 벡터들 중 불법 유턴 경로위의 벡터들을 선별하고 이 벡터들이 불법 유턴 차량에 의해 생긴 벡터들인지 확인하기 위해 신뢰도를 검증하여 불법 유턴 차량을 검지하였다. 최종적으로 알고리즘의 성능을 평가하기 위해 알고리즘별 처리시간을 측정하였으며 본 논문에서 제안한 알고리즘이 효율적임을 증명하였다. Today, Intelligent Vehicle Detection System seeks to reduce the negative factors, such as accidents over to get the traffic information of existing system. This paper proposes detection algorithm for the illegal U-turn vehicles which can cause critical accident among violations of road traffic laws. We predicted that if calculated optical flow vectors were shown on the illegal U-turn path, they would be cause of the illegal U-turn vehicles. To reduce the high computational complexity, we use the algorithm of pyramid Lucas-Kanade. This algorithm only track the key-points likely corners. Because of the high computational complexity, we detect center lane first through the color information and progressive probabilistic hough transform and apply to the around of center lane. And then we select vectors on illegal U-turn path and calculate reliability to check whether vectors is cause of the illegal U-turn vehicles or not. Finally, In order to evaluate the algorithm, we calculate process time of the type of algorithm and prove that proposed algorithm is efficiently.
BibTeX
@article{song2014detection,
  author = {Chang-Ho Song and Jaesung Lee},
  title = {{Detection of Illegal U-turn Vehicles by Optical Flow Analysis}},
  journal = {The Journal of Korean Institute of Communications and Information Sciences},
  year = {2014},
  doi = {10.7840/kics.2014.39c.10.948},
}
Figure