Lane departure warning systems have gained considerable research interest in the past decade for its promising usage in automotive, where lane detection and tracking is applied. However, it is a challenging task to improve the robustness of lane detection due to environmental factors, such as perspective effect, possible low visibility of lanes, and partial occlusions. To deal with these issues, we propose a reliable vision-based real-time lane markings detection and tracking system that can adapt to various environmental conditions. The lane detection is composed of three stages: pre-processing, Adaptive Region of Interest (AROI) setting, and lane marking detection and tracking. In the pre-processing stage, smoothing and edge detection operators are applied on input frames to automatically obtain binary images, then, lane markings segmentation are carried out. After that, An Adaptive Region of Interest is extracted to reduce the computational complexity. In the subsequent detection stages, Kalman filter is employed to track road boundaries detected in the AROI using Progressive Probabilistic Hough Transform (PPHT) in the next frame. Based on road boundaries and the vehicle's position, the proposed algorithm decides if the vehicle has drifted off the lane. For the performance evaluation of lane detection and tracking, real-life datasets for both urban roads and highways in various lighting conditions are used. Applying our method to Catltech dataset, the average correct detection rate is 93.82%. In addition, the proposed method outperforms that of the state-of-the-art methods in processing time (21.54ms/frame).

/pdf/a-lane-tracking-method-based-on-progressive-probabilistic-7fw6l38676.pdf

A Lane Tracking Method Based on Progressive Probabilistic Hough Transform

Single image dehazing based on learning of haze layers

Lane detection plays an important role in improving autopilot's safety. In this paper, a novel lane-division-lines detection method is proposed, which exhibits good performances in abnormal illumination and lane occlusion. It includes three major components: First, the captured image is converted to aerial view to make full use of parallel lanes' characteristics. Second, a ridge detector is proposed to extract each lane's feature points and remove noise points with an adaptable neural network (ANN). Last, the lane-division-lines are accurately fitted by an improved random sample consensus (RANSAC), termed the (regional) gaussian distribution random sample consensus (G-RANSAC). To test the performances of this novel lane detection method, we proposed a new index named the lane departure index (LDI) describing the departure degree between true lane and predicted lane. Experimental results verified the superior performances of the proposed method over others in different testing scenarios, respectively achieving 99.02%, 96.92%, 96.65% and 91.61% true-positive rates (TPR); and 66.16, 54.85, 55.98 and 52.61 LDIs in four different types of testing scenarios.

A Lane Detection Method Based on a Ridge Detector and Regional G-RANSAC.

Autonomous vehicles and advanced driver assistance systems are predicted to provide higher safety and reduce fuel and energy consumption and road traffic emissions. Lane detection and tracking are the advanced key features of the advanced driver assistance system. Lane detection is the process of detecting white lines on the roads. Lane tracking is the process of assisting the vehicle to remain in the desired path, and it controls the motion model by using previously detected lane markers. There are limited studies in the literature that provide state-of-art findings in this area. This study reviews previous studies on lane detection and tracking algorithms by performing a comparative qualitative analysis of algorithms to identify gaps in knowledge. It also summarizes some of the key data sets used for testing algorithms and metrics used to evaluate the algorithms. It is found that complex road geometries such as clothoid roads are less investigated, with many studies focused on straight roads. The complexity of lane detection and tracking is compounded by the challenging weather conditions, vision (camera) quality, unclear line-markings and unpaved roads. Further, occlusion due to overtaking vehicles, high-speed and high illumination effects also pose a challenge. The majority of the studies have used custom based data sets for model testing. As this field continues to grow, especially with the development of fully autonomous vehicles in the near future, it is expected that in future, more reliable and robust lane detection and tracking algorithms will be developed and tested with real-time data sets.

Review on Lane Detection and Tracking Algorithms of Advanced Driver Assistance System

Global positioning system (GPS) trajectory map matching projects GPS coordinates to the road network. Most existing algorithms focus on the geometric and topological relationships of the road network, while did not make full use of the historical road network information and floating car data. In this study, the authors proposed a deep learning enabled vehicle trajectory map-matching method with advanced spatial–temporal analysis (DST-MM). The algorithm mainly focused on the following three aspects: (i) analyse the spatial relevancy from the prospective of geometric analysis, topology analysis and intersection analysis; (ii) to make full use of the historical and real-time data, a deep learning model was conducted to extract the road network and vehicle trajectory features and (iii) establish a speed prediction model and nest it in the temporal analysis structure. It narrows down the path search range through establishing the dynamic candidate graph. Experimental results show that the proposed DST-MM algorithm outperforms the existing algorithms in terms of matching accuracy for low-sampling frequencies GPS data, especially in the central urban area.

https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/iet-its.2020.0486

Deep learning enabled vehicle trajectory map-matching method with advanced spatial–temporal analysis

Vision-based lane-detection methods provide low-cost density information about roads for autonomous vehicles. In this paper, we propose a robust and efficient method to expand the application of these methods to cover low-speed environments. First, the reliable region near the vehicle is initialized and a series of rectangular detection regions are dynamically constructed along the road. Then, an improved symmetrical local threshold edge extraction is introduced to extract the edge points of the lane markings based on accurate marking width limitations. In order to meet real-time requirements, a novel Bresenham line voting space is proposed to improve the process of line segment detection. Combined with straight lines, polylines, and curves, the proposed geometric fitting method has the ability to adapt to various road shapes. Finally, different status vectors and Kalman filter transfer matrices are used to track the key points of the linear and nonlinear parts of the lane. The proposed method was tested on a public database and our autonomous platform. The experimental results show that the method is robust and efficient and can meet the real-time requirements of autonomous vehicles.

Robust Lane-Detection Method for Low-Speed Environments.

The data collected by floating cars is an important source for lane-level map production. Compared with other data sources, this method is a low-cost but challenging way to generate high-accuracy maps. In this paper, we propose a data correction algorithm for low-frequency floating car data. First, we preprocess the trajectory data by an adaptive density optimizing method to remove the noise points with large mistakes. Then, we match the trajectory data with OpenStreetMap (OSM) using an efficient hierarchical map matching algorithm. Lastly, we correct the floating car data by an OSM-based physical attraction model. Experiments are conducted exploiting the data collected by thousands of taxies over one week in Wuhan City, China. The results show that the accuracy of the data is improved and the proposed algorithm is demonstrated to be practical and effective.

A Data Correction Algorithm for Low-Frequency Floating Car Data.

As an important role in autonomous vehicles or advanced driving assistance systems, lane detection uses the onboard camera high up on the windshield to provide the vehicle’s lateral offset within its own lane in a real-time, low-cost way. In this paper, we propose an efficient, robust lane detection method based on histogram of oriented vanishing points. First, the lane features are extracted by symmetrical local threshold. Then, the lines are generated from oriented vanishing points. The lines crossing most features are selected and oriented vanishing points are updated by the overlap between features and selected lines. Last step will be repeated for getting stable oriented vanishing points. Therefore, the last selected lines are most likely to be lane lines. Finally, Validate and select the best lane lines. The proposed method has been tested on a public dataset. The experimental results show that the method can improve robustness under real-time automated driving.

Lane Detection Based on Histogram of Oriented Vanishing Points

Lane detection algorithm based on monocular camera is one of the most popular methods in recent years, which can meet the requirement of real-time and robust for autonomous vehicle. In this way, the position of lane markers can be transferred from perspective space to road space base on the planar road assumption. However, large numbers of road scenes, especially the up and down slope road environment, cannot meet this requirement.In this paper, we propose a multiple vanishing point detection method to reconstruct the road space in slope scenes. In order to improve the accuracy of vanishing point estimation, the road images are decomposed into near and far regions. We extract candidate lane markers in near region by using multiscale convolution kernel and Hough Transform at first. Then, the lane markers in far region can be detected based on the result of near region. At last, different vanishing points are extracted in near and far regions. With the help of a vanishing point based on camera model, we can project both of near and far regions into road space. The experiment is conducted on our self-driving car ‘TuLian’ in campus environment.

Lane Detection and Road Surface Reconstruction Based on Multiple Vanishing Point & Symposia

Lane information plays an important role in high-definition (HD) maps because it provides invaluable road information for autonomous vehicles. The most widely used lane extraction method for HD maps is based on mobile mapping systems, and it is prohibitively costly and time-consuming. In this study, we propose a novel approach for lane information extraction based on crowdsourcing vehicles equipped with monocular cameras and global navigation satellite system devices for recording road images and position data. First, we propose a lane mask propagation network to detect the lane markings in images, which are then projected from a perspective space into a three-dimensional space in accordance with the position data. Second, we propose a data management method to store lane information in the cloud data center. An improved density-based spatial clustering of applications with noise clustering algorithm and a gradual fitting algorithm are used to remove the outliers and improve the lane data accuracy. The proposed method is quantitatively evaluated against a real-world HD map produced by a mobile mapping vehicle. The experimental results show that more than 80% of the extracted lane markings meet the accuracy requirements of HD maps. In conclusion, our method can be used as a low-cost and efficient approach for updating the lane information in HD maps for autonomous vehicles.

Yuan Guo

Papers

Robust Lane-Detection Method for Low-Speed Environments.

A Data Correction Algorithm for Low-Frequency Floating Car Data.

Lane Detection Based on Histogram of Oriented Vanishing Points

Lane Detection and Road Surface Reconstruction Based on Multiple Vanishing Point & Symposia

Lane Information Extraction for High Definition Maps Using Crowdsourced Data