A number of image processing techniques IPTs have been implemented for detecting civil infrastructure defects to partially replace human-conducted onsite inspections. These IPTs are primarily used to manipulate images to extract defect features, such as cracks in concrete and steel surfaces. However, the extensively varying real-world situations e.g., lighting and shadow changes can lead to challenges to the wide adoption of IPTs. To overcome these challenges, this article proposes a vision-based method using a deep architecture of convolutional neural networks CNNs for detecting concrete cracks without calculating the defect features. As CNNs are capable of learning image features automatically, the proposed method works without the conjugation of IPTs for extracting features. The designed CNN is trained on 40 K images of 256 × 256 pixel resolutions and, consequently, records with about 98% accuracy. The trained CNN is combined with a sliding window technique to scan any image size larger than 256 × 256 pixel resolutions. The robustness and adaptability of the proposed approach are tested on 55 images of 5,888 × 3,584 pixel resolutions taken from a different structure which is not used for training and validation processes under various conditions e.g., strong light spot, shadows, and very thin cracks. Comparative studies are conducted to examine the performance of the proposed CNN using traditional Canny and Sobel edge detection methods. The results show that the proposed method shows quite better performances and can indeed find concrete cracks in realistic situations.

/pdf/deep-learning-based-crack-damage-detection-using-1cucavd1rf.pdf

Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks

Computer vision-based techniques were developed to overcome the limitations of visual inspection by trained human resources and to detect structural damage in images remotely, but most methods detect only specific types of damage, such as concrete or steel cracks. To provide quasi real-time simultaneous detection of multiple types of damages, a Faster Region-based Convolutional Neural Network (Faster R-CNN)-based structural visual inspection method is proposed. To realize this, a database including 2,366 images (with 500 × 375 pixels) labeled for five types of damages—concrete crack, steel corrosion with two levels (medium and high), bolt corrosion, and steel delamination—is developed. Then, the architecture of the Faster R-CNN is modified, trained, validated, and tested using this database. Results show 90.6%, 83.4%, 82.1%, 98.1%, and 84.7% average precision (AP) ratings for the five damage types, respectively, with a mean AP of 87.8%. The robustness of the trained Faster R-CNN is evaluated and demonstrated using 11 new 6,000 × 4,000-pixel images taken of different structures. Its performance is also compared to that of the traditional CNN-based method. Considering that the proposed method provides a remarkably fast test speed (0.03 seconds per image with 500 × 375 resolution), a framework for quasi real-time damage detection on video using the trained networks is developed.

Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types

https://nottingham-repository.worktribe.com/preview/745918/Manuscript_KochEtAl_2015_accepted.pdf

A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure

Regular inspection of nuclear power plant components is important to guarantee safe operations. However, current practice is time consuming, tedious, and subjective, which involves human technicians reviewing the inspection videos and identifying cracks on reactors. A few vision-based crack detection approaches have been developed for metallic surfaces, and they typically perform poorly when used for analyzing nuclear inspection videos. Detecting these cracks is a challenging task since they are tiny, and noisy patterns exist on the components’ surfaces. This study proposes a deep learning framework, based on a convolutional neural network (CNN) and a Naive Bayes data fusion scheme, called NB-CNN, to analyze individual video frames for crack detection while a novel data fusion scheme is proposed to aggregate the information extracted from each video frame to enhance the overall performance and robustness of the system. To this end, a CNN is proposed to detect crack patches in each video frame, while the proposed data fusion scheme maintains the spatiotemporal coherence of cracks in videos, and the Naive Bayes decision making discards false positives effectively. The proposed framework achieves a 98.3% hit rate against 0.1 false positives per frame that is significantly higher than state-of-the-art approaches as presented in this paper.

NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion

Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring

Bridge monitoring and maintenance is an expensive yet essential task in maintaining a safe national transportation infrastructure. Traditional monitoring methods use visual inspection of bridges on a regular basis and often require inspectors to travel to the bridge of concern and determine the deterioration level of the bridge. Automation of this process may result in great monetary savings and can lead to more frequent inspection cycles. One aspect of this automation is the detection of cracks and deterioration of a bridge. This paper provides a comparison of the effectiveness of four crack-detection techniques: fast Haar transform (FHT), fast Fourier transform, Sobel, and Canny. These imaging edge-detection algorithms were implemented in MatLab and simulated using a sample of 50 concrete bridge images (25 with cracks and 25 without). The results show that the FHT was significantly more reliable than the other three edge-detection techniques in identifying cracks.

Analysis of edge-detection techniques for crack identification in bridges

This paper presents an instrument based on a new architecture called "Remote Wiring and Measurement Laboratory" ( RwmLAB) acting as a local multicircuit board on a common distributed panel on the Internet. Matrix switching, data acquisition, data processing and analysis, and graphical unit interface enabled-devices characterize the RwmLAB. RwmLAB is intended to address real-time remote wiring of electrical and electronic circuits and real data acquisition over the Internet instead of using simulated data. This Web-based instrument allows for flexibility and the spontaneous delivery of laboratory material and ensures a global access to a worldwide audience.

A Web-based electrical and electronics remote wiring and measurement laboratory (RwmLAB) instrument

This paper describes a system composed of hardware and software to allow an individual to create an electronic circuit using a web interface. The user interface would simulate an electronic breadboard, such as students usually use in a typical undergraduate electronics lab. A matrix of relays would allow the actual components to be connected in any manner that the user specifies over the web. In this way, a user will be able to remotely wire up a variety of circuits and take measurements without needing to physically be in the laboratory.

Remote wiring and measurement lab

Nuts And Volts: A Web Based Hands On Electrical And Electronics Remote Wiring And Measurement Laboratory (Rwmlab)

This paper presents an instrument based on a new architecture called "Remote Wiring and Measurement Laboratory (RwmLAB)"; acting as a local multi-circuit board on a common distributed panel on the Internet. Matrix switching, data acquisition, data processing and analysis, and graphical unit interface enabled-device characterizes the RwmLAB. RwmLAB is intended to address real-time remote wiring of electrical and electronic circuits, and real data acquisition over the Internet instead of using simulated data. This Web-based instrument allows for flexibility and the spontaneous delivery of laboratory material, and ensures a global access to a worldwide audience.

M. Kelly

Papers

Analysis of edge-detection techniques for crack identification in bridges

A Web-based electrical and electronics remote wiring and measurement laboratory (RwmLAB) instrument

Remote wiring and measurement lab

Nuts And Volts: A Web Based Hands On Electrical And Electronics Remote Wiring And Measurement Laboratory (Rwmlab)

A Web-based hands-on real-time electrical and electronics remote wiring and measurement laboratory (RwmLAB) instrument