VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition
Seokju Lee,Junsik Kim,Jae Shin Yoon,Seunghak Shin,Oleksandr Bailo,Namil Kim,Tae-Hee Lee,Hyun Seok Hong,Seung-hoon Han,In So Kweon +9 more
- pp 1965-1973
TLDR
In this paper, a unified end-to-end trainable multi-task network that jointly handles lane and road marking detection and recognition that is guided by a vanishing point under adverse weather conditions is proposed.Abstract:
In this paper, we propose a unified end-to-end trainable multi-task network that jointly handles lane and road marking detection and recognition that is guided by a vanishing point under adverse weather conditions. We tackle rainy and low illumination conditions, which have not been extensively studied until now due to clear challenges. For example, images taken under rainy days are subject to low illumination, while wet roads cause light reflection and distort the appearance of lane and road markings. At night, color distortion occurs under limited illumination. As a result, no benchmark dataset exists and only a few developed algorithms work under poor weather conditions. To address this shortcoming, we build up a lane and road marking benchmark which consists of about 20,000 images with 17 lane and road marking classes under four different scenarios: no rain, rain, heavy rain, and night. We train and evaluate several versions of the proposed multi-task network and validate the importance of each task. The resulting approach, VPGNet, can detect and classify lanes and road markings, and predict a vanishing point with a single forward pass. Experimental results show that our approach achieves high accuracy and robustness under various conditions in realtime (20 fps). The benchmark and the VPGNet model will be publicly availableread more
Citations
More filters
Proceedings ArticleDOI
Hierarchical Road Topology Learning for Urban Mapless Driving
TL;DR: In this article , the authors tackle the problem of online road map extraction via leveraging the sensory system aboard the vehicle itself and design a structured model where a graph representation of the road network is generated in a hierarchical fashion within a fully convolutional network.
Journal ArticleDOI
Feasibility Analysis and Implementation of Adaptive Dynamic Reconfiguration of CNN Accelerators
Ke Han,Yingqi Luo +1 more
TL;DR: In this paper , a regression model for CNNs runtime prediction and a guidance scheme for adaptive reconfiguration combined with the characteristics of Deep Learning Processor Unit (DPU) is proposed.
Posted Content
Harmonious Semantic Line Detection via Maximal Weight Clique Selection
TL;DR: Wang et al. as discussed by the authors developed two networks: selection network (S-Net) and harmonization network (H-Net), which can detect harmonious semantic lines effectively and efficiently.
Book ChapterDOI
Vision-Based System for Road Lane Detection and Lane Type Classification
TL;DR: In this paper , a method for the detection and classification of road lane boundaries is proposed, which can decrease the number of accidents and increase the safety of passengers in an autonomous vehicle.
Learning to Detect Geometric Structures from Images for 3D Parsing
TL;DR: Zhou et al. as mentioned in this paper proposed a method to extract high-level geometric structures from images and use them for 3D parsing, such as lines, junctions, planes, vanishing points, and symmetry.
References
More filters
Proceedings ArticleDOI
ImageNet: A large-scale hierarchical image database
TL;DR: A new database called “ImageNet” is introduced, a large-scale ontology of images built upon the backbone of the WordNet structure, much larger in scale and diversity and much more accurate than the current image datasets.
Proceedings ArticleDOI
Histograms of oriented gradients for human detection
Navneet Dalal,Bill Triggs +1 more
TL;DR: It is shown experimentally that grids of histograms of oriented gradient (HOG) descriptors significantly outperform existing feature sets for human detection, and the influence of each stage of the computation on performance is studied.
Book ChapterDOI
Microsoft COCO: Common Objects in Context
Tsung-Yi Lin,Michael Maire,Serge Belongie,James Hays,Pietro Perona,Deva Ramanan,Piotr Dollár,C. Lawrence Zitnick +7 more
TL;DR: A new dataset with the goal of advancing the state-of-the-art in object recognition by placing the question of object recognition in the context of the broader question of scene understanding by gathering images of complex everyday scenes containing common objects in their natural context.
Proceedings ArticleDOI
Fully convolutional networks for semantic segmentation
TL;DR: The key insight is to build “fully convolutional” networks that take input of arbitrary size and produce correspondingly-sized output with efficient inference and learning.
Proceedings ArticleDOI
You Only Look Once: Unified, Real-Time Object Detection
TL;DR: Compared to state-of-the-art detection systems, YOLO makes more localization errors but is less likely to predict false positives on background, and outperforms other detection methods, including DPM and R-CNN, when generalizing from natural images to other domains like artwork.