This paper reviews some main results and progress in distributed multi-agent coordination, focusing on papers published in major control systems and robotics journals since 2006. Distributed coordination of multiple vehicles, including unmanned aerial vehicles, unmanned ground vehicles, and unmanned underwater vehicles, has been a very active research subject studied extensively by the systems and control community. The recent results in this area are categorized into several directions, such as consensus, formation control, optimization, and estimation. After the review, a short discussion section is included to summarize the existing research and to propose several promising research directions along with some open problems that are deemed important for further investigations.

/pdf/an-overview-of-recent-progress-in-the-study-of-distributed-1xnb6e12se.pdf

An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination

This article reviews some main results and progress in distributed multi-agent coordination, focusing on papers published in major control systems and robotics journals since 2006. Distributed coordination of multiple vehicles, including unmanned aerial vehicles, unmanned ground vehicles and unmanned underwater vehicles, has been a very active research subject studied extensively by the systems and control community. The recent results in this area are categorized into several directions, such as consensus, formation control, optimization, task assignment, and estimation. After the review, a short discussion section is included to summarize the existing research and to propose several promising research directions along with some open problems that are deemed important for further investigations.

An Overview of Recent Progress in the Study of Distributed Multi-agent Coordination

Wireless sensor networks (WSNs) monitor dynamic environments that change rapidly over time. This dynamic behavior is either caused by external factors or initiated by the system designers themselves. To adapt to such conditions, sensor networks often adopt machine learning techniques to eliminate the need for unnecessary redesign. Machine learning also inspires many practical solutions that maximize resource utilization and prolong the lifespan of the network. In this paper, we present an extensive literature review over the period 2002–2013 of machine learning methods that were used to address common issues in WSNs. The advantages and disadvantages of each proposed algorithm are evaluated against the corresponding problem. We also provide a comparative guide to aid WSN designers in developing suitable machine learning solutions for their specific application challenges.

https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?article=3963&context=sis_research

Machine Learning in Wireless Sensor Networks: Algorithms, Strategies, and Applications

Currently, the network traffic control systems are mainly composed of the Internet core and wired/wireless heterogeneous backbone networks. Recently, these packet-switched systems are experiencing an explosive network traffic growth due to the rapid development of communication technologies. The existing network policies are not sophisticated enough to cope with the continually varying network conditions arising from the tremendous traffic growth. Deep learning, with the recent breakthrough in the machine learning/intelligence area, appears to be a viable approach for the network operators to configure and manage their networks in a more intelligent and autonomous fashion. While deep learning has received a significant research attention in a number of other domains such as computer vision, speech recognition, robotics, and so forth, its applications in network traffic control systems are relatively recent and garnered rather little attention. In this paper, we address this point and indicate the necessity of surveying the scattered works on deep learning applications for various network traffic control aspects. In this vein, we provide an overview of the state-of-the-art deep learning architectures and algorithms relevant to the network traffic control systems. Also, we discuss the deep learning enablers for network systems. In addition, we discuss, in detail, a new use case, i.e., deep learning based intelligent routing. We demonstrate the effectiveness of the deep learning-based routing approach in contrast with the conventional routing strategy. Furthermore, we discuss a number of open research issues, which researchers may find useful in the future.

State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow’s Intelligent Network Traffic Control Systems

We present a novel, deeply embedded robotics middleware and programming environment. It uses a multithreaded, publish-subscribe design pattern and provides a Unix-like software interface for micro controller applications. We improve over the state of the art in deeply embedded open source systems by providing a modular and standards-oriented platform. Our system architecture is centered around a publish-subscribe object request broker on top of a POSIX application programming interface. This allows to reuse common Unix knowledge and experience, including a bash-like shell. We demonstrate with a vertical takeoff and landing (VTOL) use case that the system modularity is well suited for novel and experimental vehicle platforms. We also show how the system architecture allows a direct interface to ROS and to run individual processes either as native ROS nodes on Linux or nodes on the micro controller, maximizing interoperability. Our microcontroller-based execution environment has substantially lower latency and better hardware connectivity than a typical Robotics Linux system and is therefore well suited for fast, high rate control tasks.

/pdf/px4-a-node-based-multithreaded-open-source-robotics-50m35kksn5.pdf

PX4: A node-based multithreaded open source robotics framework for deeply embedded platforms

This article presents a survey on publicly available open-source projects (OSPs) on quadrotor unmanned aerial vehicles (UAVs). Recently, there has been increasing interest in quadrotor UAVs. Exciting videos have been published on the Internet by many research groups and have attracted much attention from the public [1][7]. Relatively simple structures of quadrotors has promoted interest from academia, UAV industries, and radio-control (RC) hobbyists alike. Unlike conventional helicopters, swashplates, which are prone to failure without constant maintenance, are not required. Furthermore, the diameter of individual rotors can be reduced as a result of the presence of four actuators [8].

Build Your Own Quadrotor: Open-Source Projects on Unmanned Aerial Vehicles

The Cucker-Smale (CS) flocking model is an interacting particle system, in which each particle updates its velocity by adding to it a weighted average of the differences of its velocity with those of other particles. It has been shown that by using the C-S model, the velocities of particles converge to a common value despite the absence of a central command. In this note, we make an extension of the C-S model by introducing additional interaction terms between agents which we refer to as the inter-particle bonding force, in order to incorporate collision avoidance between agents, and at the same time achieve tighter spatial configurations. The proposed inter-particle bonding force makes use of position and velocity information of other agents in order to achieve such separation and cohesion. With the inter-particle bonding forces and the velocity-alignment term of the original C-S model, we show the emergent behavior of asymptotic flocking to spatial equilibrium configurations.

Cucker-Smale Flocking With Inter-Particle Bonding Forces

This paper presents an obstacle avoidance scheme for autonomous vehicles as an active safety procedure in unknown environments. Safe trajectories are generated using the non-linear model predictive framework, in which the simplified dynamics of the vehicle are used to predict the state of the vehicle over the look-ahead horizon. To compensate for the slight dissimilarity between the simplified model and the actual vehicle, a separate controller is designed to track the generated trajectory. The longitudinal dynamics of the vehicle are controlled using the inverse dynamics of the vehicle powertrain model, and the lateral dynamics are controlled using a linear quadratic regulator. In the non-linear model predictive framework, to obtain safe trajectories, local obstacle information is incorporated into the performance index using a parallax-based method. Simulation results on a full non-linear vehicle model show that the proposed combination of model-predictive-control-based trajectory generation and...

Obstacle avoidance of autonomous vehicles based on model predictive control

Target localization, whose goal is to estimate the location of an unknown target, is one of the key issues in applications of wireless sensor networks (WSNs). With recent advances in fabrication technology, deployments of large-scale WSNs have become economically feasible. However, there exist issues such as limited communication and the curse of dimensionality in applying machine-learning algorithms such as support vector regression (SVR) on large-scale WSNs. Here, in order to overcome such issues, we propose an ensemble implementation of SVR for the problem of target localization. The convergence property of the localization algorithm using the ensemble SVR is verified, and the robustness of the proposed scheme against measurement noise is analyzed. Furthermore, experimental results confirm that the estimation performance of the proposed method is more accurate and robust to measurement noise than the conventional SVR predictor.

Target Localization Using Ensemble Support Vector Regression in Wireless Sensor Networks

In some of recent advances in automation of construction equipment, much research has been conducted on the control of hydraulic excavators in both industry and academia for the benefit of safety and efficiency. However, most relevant works have employed model-based control approaches that require a mathematical representation of the target plant. For hydraulic excavators, obtaining a useful dynamic model for control can be challenging due to the nonlinearity of the hydraulic servo system. With this in mind, this paper investigates the feasibility of an online learning control framework based on echo-state networks (ESNs) to the position control of hydraulic excavators. While ESNs are a class of recurrent neural networks, the training of ESNs corresponds to solving a linear regression problem, thus making it suitable for online implementation. By exploiting the dynamic properties of ESNs, the deployed control framework uses the input and output signals of the plant to learn an inverse model, which is then used to simultaneously generate control inputs to track the desired trajectory. Experiments conducted on a 21-ton class hydraulic excavator show the promising results in that accurate tracking is achieved even in the absence of a dynamic model.

Jaemann Park

Papers

Build Your Own Quadrotor: Open-Source Projects on Unmanned Aerial Vehicles

Cucker-Smale Flocking With Inter-Particle Bonding Forces

Obstacle avoidance of autonomous vehicles based on model predictive control

Target Localization Using Ensemble Support Vector Regression in Wireless Sensor Networks

Online Learning Control of Hydraulic Excavators Based on Echo-State Networks