Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related works

doi:10.1186/S40327-015-0029-Z

Home
/
Papers
/
Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related works

Journal Article•DOI•

Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related works

Youngjib Ham¹, Kevin Han², Jacob J. Lin², Mani Golparvar-Fard²•Institutions (2)

Florida International University¹, University of Illinois at Urbana–Champaign²

06 Jan 2016-Visualization in Engineering (Springer)-Vol. 4, Iss: 1, pp 1-8

TL;DR: The most relevant works from Civil Engineering, Computer Vision, and Robotics communities are presented and compared in terms of their potential to lead to automatic construction monitoring and civil infrastructure condition assessment.

read less

Abstract: Over the past few years, the application of camera-equipped Unmanned Aerial Vehicles (UAVs) for visually monitoring construction and operation of buildings, bridges, and other types of civil infrastructure systems has exponentially grown. These platforms can frequently survey construction sites, monitor work-in-progress, create documents for safety, and inspect existing structures, particularly for hard-to-reach areas. The purpose of this paper is to provide a concise review of the most recent methods that streamline collection, analysis, visualization, and communication of the visual data captured from these platforms, with and without using Building Information Models (BIM) as a priori information. Specifically, the most relevant works from Civil Engineering, Computer Vision, and Robotics communities are presented and compared in terms of their potential to lead to automatic construction monitoring and civil infrastructure condition assessment.

...read moreread less

Content maybe subject to copyright Report

Citations

PDF

Open Access

More filters

Book•

Unmanned Aerial Vehicles: A Survey on Civil Applications and Key Research Challenges

[...]

Hazim Shakhatreh¹, Ahmad Sawalmeh², Ahmad Sawalmeh³, Ala Al-Fuqaha⁴, Ala Al-Fuqaha⁵, Zuochao Dou, Eyad Almaita⁶, Issa Khalil⁷, Noor Shamsiah Othman², Abdallah Khreishah⁸, Mohsen Guizani⁹ - Show less +7 more•Institutions (9)

Yarmouk University¹, Universiti Tenaga Nasional², Northern Borders University³, Western Michigan University⁴, Khalifa University⁵, Tafila Technical University⁶, Qatar Computing Research Institute⁷, New Jersey Institute of Technology⁸, University of Idaho⁹

26 Aug 2021

TL;DR: The use of unmanned aerial vehicles (UAVs) is growing rapidly across many civil application domains, including real-time monitoring, providing wireless coverage, remote sensing, search and rescue, delivery of goods, security and surveillance, precision agriculture, and civil infrastructure inspection.

...read moreread less

Abstract: The use of unmanned aerial vehicles (UAVs) is growing rapidly across many civil application domains, including real-time monitoring, providing wireless coverage, remote sensing, search and rescue, delivery of goods, security and surveillance, precision agriculture, and civil infrastructure inspection. Smart UAVs are the next big revolution in the UAV technology promising to provide new opportunities in different applications, especially in civil infrastructure in terms of reduced risks and lower cost. Civil infrastructure is expected to dominate more than $45 Billion market value of UAV usage. In this paper, we present UAV civil applications and their challenges. We also discuss the current research trends and provide future insights for potential UAV uses. Furthermore, we present the key challenges for UAV civil applications, including charging challenges, collision avoidance and swarming challenges, and networking and security-related challenges. Based on our review of the recent literature, we discuss open research challenges and draw high-level insights on how these challenges might be approached.

...read moreread less

901 citations

Cites methods from "Visual monitoring of civil infrastr..."

...The employment of image processing techniques allows for monitoring and assessing the construction projects, as well as performing inspection of the infrastructure such as surveying construction sites, work progress monitoring, inspection of bridges, irrigation structures monitoring, detection of construction damage and surfaces degradation [91], [103]....
[...]

Journal Article•DOI•

A literature review of next-generation smart sensing technology in structural health monitoring

[...]

Sandeep Sony¹, Shea Laventure¹, Ayan Sadhu¹•Institutions (1)

University of Western Ontario¹

01 Mar 2019-Structural Control & Health Monitoring

TL;DR: The state‐of‐the‐art methods have been presented by conducting a detailed literature review of the recent applications of smartphones, UAVs, cameras, and robotic sensors used in acquiring and analyzing the vibration data for structural condition monitoring and maintenance.

...read moreread less

301 citations

Journal Article•DOI•

Adopting Internet of Things for the development of smart buildings: A review of enabling technologies and applications

[...]

Mengda Jia¹, Ali Komeily¹, Yueren Wang², Ravi S. Srinivasan¹•Institutions (2)

University of Florida¹, Microsoft²

01 May 2019-Automation in Construction

TL;DR: It is argued that a mature adoption of IoT technologies in the building industry is not yet realized and, therefore, calls for more attention from researchers in the relevant fields from the application perspective.

...read moreread less

267 citations

Cites background from "Visual monitoring of civil infrastr..."

...More prevalent are the use of Unmanned Aerial Vehicles (UAV)-based video monitoring for construction safety [26]....
[...]

Journal Article•DOI•

A Review of the Piezoelectric Electromechanical Impedance Based Structural Health Monitoring Technique for Engineering Structures

[...]

Wongi S. Na, Jongdae Baek¹•Institutions (1)

KAIST¹

24 Apr 2018-Sensors

TL;DR: The studies applied for the past decade related to the EMI technique have been reviewed and new concepts and ideas proposed by various authors are also surveyed, and the paper concludes with a discussion of the potential directions for future works.

...read moreread less

Abstract: The birth of smart materials such as piezoelectric (PZT) transducers has aided in revolutionizing the field of structural health monitoring (SHM) based on non-destructive testing (NDT) methods. While a relatively new NDT method known as the electromechanical (EMI) technique has been investigated for more than two decades, there are still various problems that must be solved before it is applied to real structures. The technique, which has a significant potential to contribute to the creation of one of the most effective SHM systems, involves the use of a single PZT for exciting and sensing of the host structure. In this paper, studies applied for the past decade related to the EMI technique have been reviewed to understand its trend. In addition, new concepts and ideas proposed by various authors are also surveyed, and the paper concludes with a discussion of the potential directions for future works.

...read moreread less

187 citations

Journal Article•DOI•

Historic Building Information Modelling: performance assessment for diagnosis-aided information modelling and management

[...]

S. Bruno, Mariella De Fino, Fabio Fatiguso

01 Feb 2018-Automation in Construction

TL;DR: A new methodology toward Diagnosis-Aided Historic Building Information Modelling and Management (DA-HBIMM) is proposed as a framework to be developed in order to address smart knowledge acquisition, collection and notification of assessed performances and eventual risks, by cognitive automation and artificial intelligence, in the near future.

...read moreread less

176 citations

1
2
3
4
…
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76

Collapse

References

PDF

Open Access

More filters

Proceedings Article•DOI•

LOAM: Lidar Odometry and Mapping in Real-time

[...]

Ji Zhang¹, Sanjiv Singh¹•Institutions (1)

Carnegie Mellon University¹

12 Jul 2014

TL;DR: The method achieves both low-drift and low-computational complexity without the need for high accuracy ranging or inertial measurements and can achieve accuracy at the level of state of the art offline batch methods.

...read moreread less

Abstract: We propose a real-time method for odometry and mapping using range measurements from a 2-axis lidar moving in 6-DOF. The problem is hard because the range measurements are received at different times, and errors in motion estimation can cause mis-registration of the resulting point cloud. To date, coherent 3D maps can be built by off-line batch methods, often using loop closure to correct for drift over time. Our method achieves both low-drift and low-computational complexity without the need for high accuracy ranging or inertial measurements. The key idea in obtaining this level of performance is the division of the complex problem of simultaneous localization and mapping, which seeks to optimize a large number of variables simultaneously, by two algorithms. One algorithm performs odometry at a high frequency but low fidelity to estimate velocity of the lidar. Another algorithm runs at a frequency of an order of magnitude lower for fine matching and registration of the point cloud. Combination of the two algorithms allows the method to map in real-time. The method has been evaluated by a large set of experiments as well as on the KITTI odometry benchmark. The results indicate that the method can achieve accuracy at the level of state of the art offline batch methods.

...read moreread less

1,879 citations

Journal Article•DOI•

Mobile 3D mapping for surveying earthwork projects using an Unmanned Aerial Vehicle (UAV) system

[...]

Sebastian Siebert, Jochen Teizer¹•Institutions (1)

Georgia Institute of Technology¹

01 May 2014-Automation in Construction

TL;DR: The performance evaluation of a UAV system that was built to rapidly and autonomously acquire mobile three-dimensional mapping data and its execution for the generation of 3D point clouds from digital mobile images is presented.

...read moreread less

661 citations

"Visual monitoring of civil infrastr..." refers background or methods in this paper

...…can be applied to visual data for construction performance monitoring and civil infrastructure dez Galarreta et al. 2015; Kerle 2999; Qin 2014; Siebert & Teizer 2014; ang & Elaksher 2012; Zollmann et al. 2014)) mann 2999; Fiorillo et al. 2012; Gao et al. 2011; Kluckner et al. 2011; felscheid…...
[...]
...…and N (Michael et al. 2014) ge detection for identifying N (Eschmann 2999) ra system mounted on the Y (Xie et al. 2012) or PhotoScan software N (Siebert & Teizer 2014) tion and Orthophoto N (Fiorillo et al. 2012) under different environmental N (Gheisari et al. 2014; Irizarry et al.…...
[...]

Proceedings Article•DOI•

Vision based MAV navigation in unknown and unstructured environments

[...]

Michael Blosch¹, Stephan Weiss¹, Davide Scaramuzza¹, Roland Siegwart¹•Institutions (1)

Institute of Robotics and Intelligent Systems¹

03 May 2010

TL;DR: This is the first work describing a micro aerial vehicle able to navigate through an unexplored environment (independently of any external aid like GPS or artificial beacons), which uses a single camera as only exteroceptive sensor.

...read moreread less

Abstract: Within the research on Micro Aerial Vehicles (MAVs), the field on flight control and autonomous mission execution is one of the most active. A crucial point is the localization of the vehicle, which is especially difficult in unknown, GPS-denied environments. This paper presents a novel vision based approach, where the vehicle is localized using a downward looking monocular camera. A state-of-the-art visual SLAM algorithm tracks the pose of the camera, while, simultaneously, building an incremental map of the surrounding region. Based on this pose estimation a LQG/LTR based controller stabilizes the vehicle at a desired setpoint, making simple maneuvers possible like take-off, hovering, setpoint following or landing. Experimental data show that this approach efficiently controls a helicopter while navigating through an unknown and unstructured environment. To the best of our knowledge, this is the first work describing a micro aerial vehicle able to navigate through an unexplored environment (independently of any external aid like GPS or artificial beacons), which uses a single camera as only exteroceptive sensor.

...read moreread less

443 citations

Journal Article•DOI•

Collaborative mapping of an earthquake-damaged building via ground and aerial robots

[...]

Nathan Michael¹, Shaojie Shen¹, Kartik Mohta¹, Yash Mulgaonkar¹, Vijay Kumar¹, Keiji Nagatani², Yoshito Okada², Seiga Kiribayashi², Kazuki Otake², Kazuya Yoshida², Kazunori Ohno², Eijiro Takeuchi², Satoshi Tadokoro² - Show less +9 more•Institutions (2)

University of Pennsylvania¹, Tohoku University²

01 Sep 2012-Journal of Field Robotics

TL;DR: Results from field experiments conducted with a team of ground and aerial robots engaged in the collaborative mapping of an earthquake-damaged building that was damaged during the 2011 Tohoku earthquake are reported.

...read moreread less

Abstract: We report recent results from field experiments conducted with a team of ground and aerial robots engaged in the collaborative mapping of an earthquake-damaged building. The goal of the experimental exercise is the generation of three-dimensional maps that capture the layout of a multifloor environment. The experiments took place in the top three floors of a structurally compromised building at Tohoku University in Sendai, Japan that was damaged during the 2011 Tohoku earthquake. We provide details of the approach to the collaborative mapping and report results from the experiments in the form of maps generated by the individual robots and as a team. We conclude by discussing observations from the experiments and future research topics. © 2012 Wiley Periodicals, Inc. (This work builds upon the conference paper (Michael et al., 2012).)

...read moreread less

331 citations

"Visual monitoring of civil infrastr..." refers background or methods in this paper

...…condition assessment Autonomy Sensor A Priori Literature Autonomous Camera None (ARIA (Team 2015; Fernan Yamamoto et al. 2014; Zh RGB-D None (Michael et al. 2014) Semi-autonomous Camera None (Dobson et al. 2013; Esch Matsuoka et al. 2012; We Manual Camera Model-driven (Han et al. 2015; Lin,…...
[...]
...N (Kluckner et al. 2011) nes (3D models) for a Y (Wen et al. 2014) N (Wefelscheid et al. 2011) ing RGB-D sensors and N (Michael et al. 2014) ge detection for identifying N (Eschmann 2999) ra system mounted on the Y (Xie et al. 2012) or PhotoScan software N (Siebert & Teizer 2014) tion and…...
[...]
...The latest efforts such as (Michael et al. 2014) have focused on experimenting a variant of SLAM Table 1 The level of autonomy in UAV-based visual data collection condition assessment Autonomy Sensor A Priori Literature Autonomous Camera None (ARIA (Team 2015; Fernan Yamamoto et al. 2014; Zh RGB-D…...
[...]
...The latest efforts such as (Michael et al. 2014) have focused on experimenting a variant of SLAM...
[...]
...The latest efforts such as (Michael et al. 2014) have focused on experimenting a variant of SLAM Table 1 The level of autonomy in UAV-based visual data collection condition assessment Autonomy Sensor A Priori Literature Autonomous Camera None (ARIA (Team 2015; Fernan Yamamoto et al. 2014; Zh RGB-D None (Michael et al. 2014) Semi-autonomous Camera None (Dobson et al. 2013; Esch Matsuoka et al. 2012; We Manual Camera Model-driven (Han et al. 2015; Lin, Han None (Gheisari et al. 2014; Irizar 2012; Ye et al. 2014) using RGD-B for scanning post-disaster buildings, yet there is almost little to no work reported on actively testing these algorithms for producing 3D maps on civil infrastructure systems for construction monitoring or condition assessment purposes....
[...]

Journal Article•DOI•

A review of rotorcraft Unmanned Aerial Vehicle (UAV) developments and applications in civil engineering

[...]

P.C.K. Liu, Albert Y. Chen, Yin-Nan Huang, Jen-Yu Han, Jihn-Sung Lai, Shih-Chung Kang¹, Tzong-Hann Wu, Ming-Chang Wen, Meng-Han Tsai - Show less +5 more•Institutions (1)

National Taiwan University¹

01 Jun 2014-Smart Structures and Systems

TL;DR: An overview of the state of UAV developments and their possible applications in civil engineering is given and the latest developments in technologies related to UAVs are reviewed, such as control theories, navigation methods, and image processing.

...read moreread less

Abstract: Civil engineers always face the challenge of uncertainty in planning, building, and maintaining infrastructure. These works rely heavily on a variety of surveying and monitoring techniques. Unmanned aerial vehicles (UAVs) are an effective approach to obtain information from an additional view, and potentially bring significant benefits to civil engineering. This paper gives an overview of the state of UAV developments and their possible applications in civil engineering. The paper begins with an introduction to UAV hardware, software, and control methodologies. It also reviews the latest developments in technologies related to UAVs, such as control theories, navigation methods, and image processing. Finally, the paper concludes with a summary of the potential applications of UAV to seismic risk assessment, transportation, disaster response, construction management, surveying and mapping, and flood monitoring and assessment.

...read moreread less

261 citations

"Visual monitoring of civil infrastr..." refers background in this paper

...o reproduction in any medium, provided you giv the Creative Commons license, and indicate if particularly for hard-to-reach areas (Liu et al. 2014)....
[...]
...…author information is available at the end of the article © 2016 Ham et al. Open Access This article is International License (http://creativecommons.o reproduction in any medium, provided you giv the Creative Commons license, and indicate if particularly for hard-to-reach areas (Liu et al. 2014)....
[...]
...The rapid advances in sensing, battery, and aeronautics technologies, together with autonomous navigation methods and equipped low-cost digital cameras have helped make UAVs more affordable, reliable, and easy to operate (Liu et al. 2014)....
[...]