Method for Automated Assessment of Potholes, Cracks and Patches from Road Surface Video Clips

doi:10.1016/J.SBSPRO.2013.11.124

Home
/
Papers
/
Method for Automated Assessment of Potholes, Cracks and Patches from Road Surface Video Clips

Journal Article•DOI•

Method for Automated Assessment of Potholes, Cracks and Patches from Road Surface Video Clips

Lokeshwor Huidrom¹, Lalit K Das², S K Sud²•Institutions (2)

Council of Scientific and Industrial Research¹, Indian Institutes of Technology²

02 Dec 2013-Procedia - Social and Behavioral Sciences (Elsevier)-Vol. 104, pp 312-321

TL;DR: A robust method for automated detection and assessment of potholes, cracks and patches from real life video clips of Indian highways is proposed in this article, where the proposed method can be used for determining maintenance levels of Indian roads and taking further appropriate actions for repair and rehabilitation.

read less

About: This article is published in Procedia - Social and Behavioral Sciences.The article was published on 2013-12-02 and is currently open access. It has received 99 citations till now.

...read moreread less

Citations

PDF

Open Access

More filters

Journal Article•DOI•

A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure

[...]

Christian Koch¹, Kristina Georgieva², Varun Kasireddy³, Burcu Akinci³, Paul Fieguth⁴ - Show less +1 more•Institutions (4)

University of Nottingham¹, Ruhr University Bochum², Carnegie Mellon University³, University of Waterloo⁴

01 Apr 2015-Advanced Engineering Informatics

TL;DR: This review paper presents the current state of practice of assessing the visual condition of vertical and horizontal civil infrastructure; in particular of reinforced concrete bridges, precast concrete tunnels, underground concrete pipes, and asphalt pavements.

...read moreread less

652 citations

Journal Article•DOI•

Image-Based Pothole Detection System for ITS Service and Road Management System

[...]

Seung-Ki Ryu, Taehyeong Kim¹, Young-Ro Kim•Institutions (1)

Korea Institute of Civil Engineering and Building Technology¹

16 Sep 2015-Mathematical Problems in Engineering

TL;DR: The results are promising, and the information extracted using the proposed pothole detection method can be used, not only in determining the preliminary maintenance for a road management system and in taking immediate action for their repair and maintenance, but also in providing alert information of potholes to drivers as one of ITS services.

...read moreread less

Abstract: Potholes can generate damage such as flat tire and wheel damage, impact and damage of lower vehicle, vehicle collision, and major accidents. Thus, accurately and quickly detecting potholes is one of the important tasks for determining proper strategies in ITS (Intelligent Transportation System) service and road management system. Several efforts have been made for developing a technology which can automatically detect and recognize potholes. In this study, a pothole detection method based on two-dimensional (2D) images is proposed for improving the existing method and designing a pothole detection system to be applied to ITS service and road management system. For experiments, 2D road images that were collected by a survey vehicle in Korea were used and the performance of the proposed method was compared with that of the existing method for several conditions such as road, recording, and brightness. The results are promising, and the information extracted using the proposed method can be used, not only in determining the preliminary maintenance for a road management system and in taking immediate action for their repair and maintenance, but also in providing alert information of potholes to drivers as one of ITS services.

...read moreread less

111 citations

Journal Article•DOI•

A review on automated pavement distress detection methods

[...]

Tom Coenen¹, Amir Golroo²•Institutions (2)

University of Twente¹, Amirkabir University of Technology²

17 Sep 2017-Cogent engineering

TL;DR: In this paper, a literature review on pavement distresses and related detection methods is presented, and a gap analysis is conducted which is concluded that in particular the distresses related to pavement microtexture need serious additional research in order to be implemented in a cost-effective fashion.

...read moreread less

Abstract: In recent years, extensive research has been conducted on pavement distress detection. A large part of these studies applied automated methods to capture different distresses. In this paper, a literature review on the distresses and related detection methods are presented. This review also includes commercial solutions. Thereafter, a gap analysis is conducted which is concluded that in particular the distresses related to pavement micro-texture need serious additional research in order to be implemented in a cost-effective fashion. Depth-related distresses are detectible fairly well, but rely on expensive tools.

...read moreread less

108 citations

Cites background or methods from "Method for Automated Assessment of ..."

...Huidrom et al. (2013) proposed to collect data with video cameras from which images were extracted....
[...]
...Video camera Huidrom et al. (2013) proposed to collect data with video cameras from which images were extracted. In this respect, the application was comparable to the area-scan and line-scan cameras. These are to be used for identification of patches, among cracks and potholes, as these three types of distresses have clear 2-D characteristics. Prasanna, Dana, Gucunski, and Basily (2012) conducted video imaging for identifying cracks. A comparable method was developed by Radopoulou and Brilakis (2015) who used the video images from already installed parking cameras on passenger cars. Also, potholes detection on the basis of video cameras has been researched (Koch & Brilakis, 2011). Just as the patch detection as described before, rear view parking cameras integrated in modern passenger cars are used for data collection. A fish-eye lens is installed in order to widen the angle of view of the camera. Dash cameras (also called black-box cameras) were studied by Hadjidemetriou et al. (2016) for detecting patches, as high resolution is not a prerequisite....
[...]
...Video camera Huidrom et al. (2013) proposed to collect data with video cameras from which images were extracted. In this respect, the application was comparable to the area-scan and line-scan cameras. These are to be used for identification of patches, among cracks and potholes, as these three types of distresses have clear 2-D characteristics. Prasanna, Dana, Gucunski, and Basily (2012) conducted video imaging for identifying cracks. A comparable method was developed by Radopoulou and Brilakis (2015) who used the video images from already installed parking cameras on passenger cars....
[...]
...Video camera Huidrom et al. (2013) proposed to collect data with video cameras from which images were extracted. In this respect, the application was comparable to the area-scan and line-scan cameras. These are to be used for identification of patches, among cracks and potholes, as these three types of distresses have clear 2-D characteristics. Prasanna, Dana, Gucunski, and Basily (2012) conducted video imaging for identifying cracks....
[...]
...Video camera Huidrom et al. (2013) proposed to collect data with video cameras from which images were extracted....
[...]

Review and Analysis of Pothole Detection Methods

[...]

Taehyeong Kim, Seung-Ki Ryu

01 Jan 2014

TL;DR: In this paper, the authors investigate and analyze pothole detection methods which have developed and propose a potential direction of developing a pothhole detection method to accurately and efficiently detect potholes.

...read moreread less

Abstract: As one type of pavement distresses, potholes are important clues indicating structural defects of the asphalt road, and accurately detecting these potholes is one of important tasks for determining proper strategies of asphalt-surfaced pavement maintenance and rehabilitation. However, manually detecting and evaluating methods are expensive and timeconsuming. Thus, several efforts have been made for developing a technology which can automatically detect and recognize potholes, which may contribute to improvement of survey efficiency and pavement quality through prior investigation and immediate action. In this study, we investigate and analyze pothole detection methods which have developed and propose a potential direction of developing a pothole detection method to accurately and efficiently detect potholes.

...read moreread less

107 citations

Additional excerpts

...Keywords: Pothole, Detecting, Vibration, 3D reconstruction, 2D images, Video...
[...]

Journal Article•DOI•

Road Surface Monitoring Using Smartphone Sensors: A Review.

[...]

Shahram Sattar¹, Songnian Li¹, Michael A. Chapman¹•Institutions (1)

Ryerson University¹

09 Nov 2018-Sensors

TL;DR: Current approaches for using smartphones for road surface anomaly detection are reviewed and compared, and further opportunities for research using smartphones in road surface anomalies detection are highlighted.

...read moreread less

Abstract: Road surface monitoring is a key factor to providing smooth and safe road infrastructure to road users. The key to road surface condition monitoring is to detect road surface anomalies, such as potholes, cracks, and bumps, which affect driving comfort and on-road safety. Road surface anomaly detection is a widely studied problem. Recently, smartphone-based sensing has become increasingly popular with the increased amount of available embedded smartphone sensors. Using smartphones to detect road surface anomalies could change the way government agencies monitor and plan for road maintenance. However, current smartphone sensors operate at a low frequency, and undersampled sensor signals cause low detection accuracy. In this study, current approaches for using smartphones for road surface anomaly detection are reviewed and compared. In addition, further opportunities for research using smartphones in road surface anomaly detection are highlighted.

...read moreread less

107 citations

1
2
3
4
…
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20

Collapse

References

PDF

Open Access

More filters

Journal Article•DOI•

A linear-time component-labeling algorithm using contour tracing technique

[...]

Fu Chang¹, Chun-Jen Chen¹, Chi-Jen Lu¹•Institutions (1)

Academia Sinica¹

01 Feb 2004-Computer Vision and Image Understanding

TL;DR: A new linear-time algorithm is presented in this paper that simultaneously labels connected components and their contours in binary images and extracts component contours and sequential orders of contour points, which can be useful for many applications.

...read moreread less

599 citations

"Method for Automated Assessment of ..." refers methods in this paper

...Apply connected component labeling (Chang et al., 2004) and chain coding techniques (Yang et al., 1994) to count the number of objects or regions of interest and estimate the area (A) and perimeter (P) of each of the object; 10....
[...]

Journal Article•DOI•

Pothole detection in asphalt pavement images

[...]

Christian Koch¹, Ioannis Brilakis²•Institutions (2)

Ruhr University Bochum¹, Georgia Institute of Technology²

01 Aug 2011-Advanced Engineering Informatics

TL;DR: This methodology has been implemented in a MATLAB prototype, trained and tested on 120 pavement images, and the results show that this method can detect potholes in asphalt pavement images with reasonable accuracy.

...read moreread less

450 citations

Journal Article•DOI•

Critical Assessment of Pavement Distress Segmentation Methods

[...]

Yichang Tsai¹, Vivek Kaul¹, Russell M. Mersereau¹•Institutions (1)

Georgia Institute of Technology¹

01 Jan 2010-Journal of Transportation Engineering-asce

TL;DR: The dynamic optimization-based method, which was previously used for segmenting low signal-to-noise ratio (SNR) digital radiography images, outperforms the other five methods based on the authors' scoring measure.

...read moreread less

Abstract: Image segmentation is the crucial step in automatic image distress detection and classification (e.g., types and severities) and has important applications for automatic crack sealing. Although many researchers have developed pavement distress detection and recognition algorithms, full automation has remained a challenge. This is the first paper that uses a scoring measure to quantitatively and objectively evaluate the performance of six different segmentation algorithms. Up-to-date research on pavement distress detection and segmentation is comprehensively reviewed to identify the research need. Six segmentation methods are then tested using a diverse set of actual pavement images taken on interstate highway I-75/I-85 near Atlanta and provided by the Georgia Department of Transportation with varying lighting conditions, shadows, and crack positions to differentiate their performance. The dynamic optimization-based method, which was previously used for segmenting low signal-to-noise ratio (SNR) digital radiography images, outperforms the other five methods based on our scoring measure. It is robust to image variations in our data set but the computation time required is high. By critically assessing the strengths and limitations of the existing algorithms, the paper provides valuable insight and guideline for future algorithm development that are important in automating image distress detection and classification.

...read moreread less

188 citations

Proceedings Article•DOI•

Vibration-Based System for Pavement Condition Evaluation

[...]

Bill Yu¹, Xianbao Yu¹•Institutions (1)

Case Western Reserve University¹

04 Aug 2006

TL;DR: In this article, a vibration-based pavement evaluation system was developed for preliminary evaluation of pavement conditions based on the mechanical responses of the testing vehicle when driving on the pavement, and a testing system was set up and data were collected to validate the measurement concept, which indicated that there is a good correlation between vibration responses and the pavement conditions.

...read moreread less

Abstract: Proper evaluation of pavement conditions provides important decision-support to implement preventative rehabilitation. Traditional method for pavement inspection relies on human observation that has low-efficiency and is subjective to errors. More recent tool for pavement distress inspection utilizes digital video and image analyses to record and identify the pavement surface conditions. This significantly increased the inspection efficiency and reliability. However, the video based system requires large storage space and extensive computation for image processing. It is also difficult to automate the pavement rating. This paper describes the use of recent data acquisition hardware to develop a vibration-based system for preliminary evaluation of pavement conditions. In analogy to the video record which looks at the surface of the pavement, the vibration-based system feels the ground conditions based on mechanical responses of the testing vehicle. The interactions of the ground and vehicle can be described by a model where vehicle is under random force excitations. The distresses of the pavement, including the cracks and surface rutting, impose impacting forces on the vehicle. The frequency and magnitude of the forces are dependent on the extent and magnitude of pavement distresses. On the other hand, the pavement surface conditions can be estimated from the recorded responses of the testing vehicle when driving on the pavement. A testing system was set up and data were collected to validate the measurement concept. Analyses of the testing data indicate that there is a good correlation between vibration responses and the pavement conditions. Factors such as the driving speed and the transition of vehicle motion were investigated. The vibration-based pavement evaluation system described in this paper has the advantage of small storage requirement, cost-effective and amenable for automatic real-time data processing. While this system does not provide the complete details of distress characteristics as by video-based system, it can be an inexpensive tool for routine inspections to provide preliminary evaluation of pavement conditions.

...read moreread less

87 citations

"Method for Automated Assessment of ..." refers background in this paper

...…overall review of literature reflects that existing 3D-image based methods have a high cost in terms of equipments and computations; while the vibration (sensor) based methods lack accuracy and reliability (Yu & Yu, 2006; Koch & Brilakis, 2011) with limited applications to road distress assessment....
[...]

Journal Article•DOI•

Analysis of segmentation algorithms for pavement distress images

[...]

Haris N. Koutsopoulos¹, Haris N. Koutsopoulos², Ibrahim El Sanhouri¹, Allen B. Downey³•Institutions (3)

Massachusetts Institute of Technology¹, Carnegie Mellon University², University of California, Berkeley³

01 Nov 1993-Journal of Transportation Engineering-asce

TL;DR: This work examines algorithms for segmenting pavement images and evaluates their effectiveness in separating the distresses from the background, and indicates that the relaxation and regression thresholding methods consistently outperform the other methods.

...read moreread less

Abstract: Collection and analysis of pavement distress data is an important component of any pavement-management system. Various systems are currently under development that automate this process. They consist of appropriate hardware for the acquisition of pavement distress images and, in some cases, software for the analysis of the collected data. An important step in the automatic interpretation of images is segmentation, the process of extracting the objects of interest (distresses) from the background. We examine algorithms for segmenting pavement images and evaluate their effectiveness in separating the distresses from the background. The methods examined include the Otsu method, Kittler’s method, a modified relaxation method, and a method is based on a threshold estimated by regression analysis. Comparison of the algorithms on a data set of asphalt pavement images indicates that the relaxation and regression thresholding methods consistently outperform the other methods. The regression thresholding method has the potential to become the method of choice due to its computational advantage over the relaxation method.

...read moreread less

50 citations