The days where swarms of unmanned aerial vehicles (UAVs) will occupy our skies are fast approaching due to the introduction of cost-efficient and reliable small aerial vehicles and the increasing demand for use of such vehicles in a plethora of civil applications. Governments and industry alike have been heavily investing in the development of UAVs. As such it is important to understand the characteristics of networks with UAVs to enable the incorporation of multiple, coordinated aerial vehicles into the air traffic in a reliable and safe manner. To this end, this survey reports the characteristics and requirements of UAV networks for envisioned civil applications over the period 2000–2015 from a communications and networking viewpoint. We survey and quantify quality-of-service requirements, network-relevant mission parameters, data requirements, and the minimum data to be transmitted over the network. Furthermore, we elaborate on general networking related requirements such as connectivity, adaptability, safety, privacy, security, and scalability. We also report experimental results from many projects and investigate the suitability of existing communication technologies for supporting reliable aerial networking.

Survey on Unmanned Aerial Vehicle Networks for Civil Applications: A Communications Viewpoint

The use of unmanned aerial vehicles (UAVs) is growing rapidly across many civil application domains, including real-time monitoring, providing wireless coverage, remote sensing, search and rescue, delivery of goods, security and surveillance, precision agriculture, and civil infrastructure inspection. Smart UAVs are the next big revolution in the UAV technology promising to provide new opportunities in different applications, especially in civil infrastructure in terms of reduced risks and lower cost. Civil infrastructure is expected to dominate more than $45 Billion market value of UAV usage. In this paper, we present UAV civil applications and their challenges. We also discuss the current research trends and provide future insights for potential UAV uses. Furthermore, we present the key challenges for UAV civil applications, including charging challenges, collision avoidance and swarming challenges, and networking and security-related challenges. Based on our review of the recent literature, we discuss open research challenges and draw high-level insights on how these challenges might be approached.

Unmanned Aerial Vehicles: A Survey on Civil Applications and Key Research Challenges

Robot assistants and professional coworkers are becoming a commodity in domestic and industrial settings. In order to enable robots to share their workspace with humans and physically interact with them, fast and reliable handling of possible collisions on the entire robot structure is needed, along with control strategies for safe robot reaction. The primary motivation is the prevention or limitation of possible human injury due to physical contacts. In this survey paper, based on our early work on the subject, we review, extend, compare, and evaluate experimentally model-based algorithms for real-time collision detection, isolation, and identification that use only proprioceptive sensors. This covers the context-independent phases of the collision event pipeline for robots interacting with the environment, as in physical human–robot interaction or manipulation tasks. The problem is addressed for rigid robots first and then extended to the presence of joint/transmission flexibility. The basic physically motivated solution has already been applied to numerous robotic systems worldwide, ranging from manipulators and humanoids to flying robots, and even to commercial products.

/pdf/robot-collisions-a-survey-on-detection-isolation-and-vhl8g5nyiu.pdf

Robot Collisions: A Survey on Detection, Isolation, and Identification

Deep reinforcement learning has emerged as a promising and powerful technique for automatically acquiring control policies that can process raw sensory inputs, such as images, and perform complex behaviors. However, extending deep RL to real-world robotic tasks has proven challenging, particularly in safety-critical domains such as autonomous flight, where a trial-and-error learning process is often impractical. In this paper, we explore the following question: can we train vision-based navigation policies entirely in simulation, and then transfer them into the real world to achieve real-world flight without a single real training image? We propose a learning method that we call CAD$^2$RL, which can be used to perform collision-free indoor flight in the real world while being trained entirely on 3D CAD models. Our method uses single RGB images from a monocular camera, without needing to explicitly reconstruct the 3D geometry of the environment or perform explicit motion planning. Our learned collision avoidance policy is represented by a deep convolutional neural network that directly processes raw monocular images and outputs velocity commands. This policy is trained entirely on simulated images, with a Monte Carlo policy evaluation algorithm that directly optimizes the network's ability to produce collision-free flight. By highly randomizing the rendering settings for our simulated training set, we show that we can train a policy that generalizes to the real world, without requiring the simulator to be particularly realistic or high-fidelity. We evaluate our method by flying a real quadrotor through indoor environments, and further evaluate the design choices in our simulator through a series of ablation studies on depth prediction. For supplementary video see: this https URL

CAD2RL: Real Single-Image Flight without a Single Real Image

Aerial manipulation aims at combining the versatility and the agility of some aerial platforms with the manipulation capabilities of robotic arms. This letter tries to collect the results reached by the research community so far within the field of aerial manipulation, especially from the technological and control point of view. A brief literature review of general aerial robotics and space manipulation is carried out as well.

/pdf/aerial-manipulation-a-literature-review-2gq2uh3t8a.pdf

Aerial Manipulation: A Literature Review

Urban search and rescue missions raise special requirements on robotic systems. Small aerial systems provide essential support to human task forces in situation assessment and surveillance. As external infrastructure for navigation and communication is usually not available, robotic systems must be able to operate autonomously. A limited payload of small aerial systems poses a great challenge to the system design. The optimal tradeoff between flight performance, sensors, and computing resources has to be found. Communication to external computers cannot be guaranteed; therefore, all processing and decision making has to be done on board. In this article, we present an unmanned aircraft system design fulfilling these requirements. The components of our system are structured into groups to encapsulate their functionality and interfaces. We use both laser and stereo vision odometry to enable seamless indoor and outdoor navigation. The odometry is fused with an inertial measurement unit in an extended Kalman filter. Navigation is supported by a module that recognizes known objects in the environment. A distributed computation approach is adopted to address the computational requirements of the used algorithms. The capabilities of the system are validated in flight experiments, using a quadrotor.

/pdf/toward-a-fully-autonomous-uav-research-platform-for-indoor-1561t1mp5j.pdf

Toward a Fully Autonomous UAV: Research Platform for Indoor and Outdoor Urban Search and Rescue

We introduce our new quadrotor platform for realizing autonomous navigation in unknown indoor/outdoor environments. Autonomous waypoint navigation, obstacle avoidance and flight control is implemented on-board. The system does not require a special environment, artificial markers or an external reference system. We developed a monolithic, mechanically damped perception unit which is equipped with a stereo camera pair, an Inertial Measurement Unit (IMU), two processor-and an FPGA board. Stereo images are processed on the FPGA by the Semi-Global Matching algorithm. Keyframe-based stereo odometry is fused with IMU data compensating for time delays that are induced by the vision pipeline. The system state estimate is used for control and on-board 3D mapping. An operator can set waypoints in the map, while the quadrotor autonomously plans its path avoiding obstacles. We show experiments with the quadrotor flying from inside a building to the outside and vice versa, traversing a window and a door respectively. A video of the experiments is part of this work. To the best of our knowledge, this is the first autonomously flying system with complete on-board processing that performs waypoint navigation with obstacle avoidance in geometrically unconstrained, complex indoor/outdoor environments.

http://vigir.missouri.edu/~gdesouza/Research/Conference_CDs/IEEE_IROS_2013/media/files/0927.pdf

Stereo vision based indoor/outdoor navigation for flying robots

Micro air vehicles have become very popular in recent years. Autonomous navigation of such systems plays an important role in many industrial applications as well as in search-and-rescue scenarios. We present a quadrotor that performs autonomous navigation in complex indoor and outdoor environments. An operator selects target positions in the onboard map and the system autonomously plans an obstacle-free path and flies to these locations. An onboard stereo camera and inertial measurement unit are the only sensors. The system is independent of external navigation aids such as GPS. No assumptions are made about the structure of the unknown environment. All navigation tasks are implemented onboard the system. A wireless connection is only used for sending images and a three-dimensional 3D map to the operator and to receive target locations. We discuss the hardware and software setup of the system in detail. Highlights of the implementation are the field-programmable-gate-array-based dense stereo matching of 0.5 Mpixel images at a rate of 14.6 Hz using semiglobal matching, locally drift-free visual odometry with key frames, and sensor data fusion with compensation of measurement delays of 220i¾?ms. We show the robustness of the approach in simulations and experiments with ground truth. We present the results of a complex, autonomous indoor/outdoor flight and the exploration of a coal mine with obstacle avoidance and 3D mapping.

Autonomous Vision-based Micro Air Vehicle for Indoor and Outdoor Navigation

Flying in unknown environments may lead to unforeseen collisions, which may cause serious damage to the robot and/or its environment. In this context, fast and robust collision detection combined with safe reaction is, therefore, essential and may be achieved using external wrench information. Also, deliberate physical interaction requires a control loop designed for such a purpose and may require knowledge of the contact wrench. In principle, the external wrench may be measured or estimated. Whereas measurement poses large demands on sensor equipment, additional weight, and overall system robustness, in this paper we present a novel model-based method for external wrench estimation in flying robots. The algorithm is based on the onboard inertial measurement unit and the robot's dynamics model only. We design admittance and impedance controllers that use this estimate for sensitive and robust physical interaction. Furthermore, the performance of several collision detection and reaction schemes is investigated in order to ensure collision safety. The identified collision location and associated normal vector located on the robot's convex hull may then be used for sensorless tactile sensing. Finally, a low-level collision reflex layer is provided for flying robots when obstacle avoidance fails, also under wind influence. Our experimental and simulation results show evidence that the methodologies are easily implemented and effective in practice.

External Wrench Estimation, Collision Detection, and Reflex Reaction for Flying Robots

Flying in unknown environments can lead to unwanted collisions with the environment. If not being accounted for, these may cause serious damage to the robot and/or its environment. Fast and robust collision detection combined with safe reaction is therefore essential in this context. Deliberate physical interaction may also be required in some applications. The robot can then switch into an interaction mode when contact occurs. The control loop must also be designed with interaction in mind. To implement these mechanisms, knowledge of environmental interaction forces is required. In principle, they may be measured or estimated. In this paper, we present a novel model-based method for external wrench estimation in flying robots. The estimation is based on proprioceptive sensors and the robot’s dynamics model only. Using this estimate, we also design admittance and impedance controllers for sensitive and robust physical interaction. We also investigate the performance of our collision detection and reaction schemes in order to guarantee collision safety. Upon collision, we determine the collision location and normal located on the robot’s geometric model. The method relies on the complete wrench information provided by our scheme. This allows applications such as tactile environment mapping.

/pdf/a-unified-framework-for-external-wrench-estimation-lfr62ari4v.pdf

Teodor Tomic

Papers

Toward a Fully Autonomous UAV: Research Platform for Indoor and Outdoor Urban Search and Rescue

Stereo vision based indoor/outdoor navigation for flying robots

Autonomous Vision-based Micro Air Vehicle for Indoor and Outdoor Navigation

External Wrench Estimation, Collision Detection, and Reflex Reaction for Flying Robots

A Unified Framework for External Wrench Estimation, Interaction Control and Collision Reflexes for Flying Robots