Planning algorithms are impacting technical disciplines and industries around the world, including robotics, computer-aided design, manufacturing, computer graphics, aerospace applications, drug design, and protein folding. This coherent and comprehensive book unifies material from several sources, including robotics, control theory, artificial intelligence, and algorithms. The treatment is centered on robot motion planning but integrates material on planning in discrete spaces. A major part of the book is devoted to planning under uncertainty, including decision theory, Markov decision processes, and information spaces, which are the “configuration spaces” of all sensor-based planning problems. The last part of the book delves into planning under differential constraints that arise when automating the motions of virtually any mechanical system. Developed from courses taught by the author, the book is intended for students, engineers, and researchers in robotics, artificial intelligence, and control theory as well as computer graphics, algorithms, and computational biology.

Planning Algorithms: Introductory Material

By a switched system, we mean a hybrid dynamical system consisting of a family of continuous-time subsystems and a rule that orchestrates the switching between them. The article surveys developments in three basic problems regarding stability and design of switched systems. These problems are: stability for arbitrary switching sequences, stability for certain useful classes of switching sequences, and construction of stabilizing switching sequences. We also provide motivation for studying these problems by discussing how they arise in connection with various questions of interest in control theory and applications.

Basic problems in stability and design of switched systems

to be done in this area. Face recognition is a problem that scarcely clamoured for attention before the computer age but, having surfaced, has involved a wide range of techniques and has attracted the attention of some fine minds (David Mumford was a Fields Medallist in 1974). This singular application of mathematical modelling to a messy applied problem of obvious utility and importance but with no unique solution is a pretty one to share with students: perhaps, returning to the source of our opening quotation, we may invert Duncan's earlier observation, 'There is an art to find the mind's construction in the face!'.

Linear and nonlinear waves, by G. B. Whitham. Pp.636. £50. 1999. ISBN 0 471 35942 4 (Wiley).

We explore in this chapter questions of existence and uniqueness for solutions to stochastic differential equations and offer a study of their properties. This endeavor is really a study of diffusion processes. Loosely speaking, the term diffusion is attributed to a Markov process which has continuous sample paths and can be characterized in terms of its infinitesimal generator.

Stochastic Differential Equations

Reinforcement learning offers to robotics a framework and set of tools for the design of sophisticated and hard-to-engineer behaviors. Conversely, the challenges of robotic problems provide both inspiration, impact, and validation for developments in reinforcement learning. The relationship between disciplines has sufficient promise to be likened to that between physics and mathematics. In this article, we attempt to strengthen the links between the two research communities by providing a survey of work in reinforcement learning for behavior generation in robots. We highlight both key challenges in robot reinforcement learning as well as notable successes. We discuss how contributions tamed the complexity of the domain and study the role of algorithms, representations, and prior knowledge in achieving these successes. As a result, a particular focus of our paper lies on the choice between model-based and model-free as well as between value-function-based and policy-search methods. By analyzing a simple problem in some detail we demonstrate how reinforcement learning approaches may be profitably applied, and we note throughout open questions and the tremendous potential for future research.

/pdf/reinforcement-learning-in-robotics-a-survey-4w4397qx9i.pdf

Reinforcement learning in robotics: A survey

Traffic waves are phenomena that emerge when the vehicular density exceeds a critical threshold. Considering the presence of increasingly automated vehicles in the traffic stream, a number of research activities have focused on the influence of automated vehicles on the bulk traffic flow. In the present article, we demonstrate experimentally that intelligent control of an autonomous vehicle is able to dampen stop-and-go waves that can arise even in the absence of geometric or lane changing triggers. Precisely, our experiments on a circular track with more than 20 vehicles show that traffic waves emerge consistently, and that they can be dampened by controlling the velocity of a single vehicle in the flow. We compare metrics for velocity, braking events, and fuel economy across experiments. These experimental findings suggest a paradigm shift in traffic management: flow control will be possible via a few mobile actuators (less than 5%) long before a majority of vehicles have autonomous capabilities.

Dissipation of stop-and-go waves via control of autonomous vehicles: Field experiments

Introduction to the Mathematical Theory of Control

Traffic Flow on Networks

This paper is concerned with a fluidodynamic model for traffic flow. More precisely, we consider a single conservation law, deduced from the conservation of the number of cars, defined on a road network that is a collection of roads with junctions. The evolution problem is underdetermined at junctions; hence we choose to have some fixed rules for the distribution of traffic plus optimization criteria for the flux. We prove existence of solutions to the Cauchy problem and we show that the Lipschitz continuous dependence by initial data does not hold in general, but it does hold under special assumptions.Our method is based on a wave front tracking approach [A. Bressan, Hyperbolic Systems of Conservation Laws. The One-dimensional Cauchy Problem, Oxford University Press, Oxford, UK, 2000] and works also for boundary data and time-dependent coefficients of traffic distribution at junctions, including traffic lights.

Traffic Flow on a Road Network

This paper is concerned with a fluidodynamic model for traffic flow. More precisely, we consider a single conservation law, deduced from conservation of the number of cars, defined on a road network that is a collection of roads with junctions. The evolution problem is underdetermined at junctions, hence we choose to have some fixed rules for the distribution of traffic plus an optimization criteria for the flux. We prove existence, uniqueness and stability of solutions to the Cauchy problem. 
Our method is based on wave front tracking approach, (B), and works also for boundary data and time dependent coefficients of traffic distribution at junctions, so including traffic lights.

Benedetto Piccoli

Papers

Dissipation of stop-and-go waves via control of autonomous vehicles: Field experiments

Introduction to the Mathematical Theory of Control

Traffic Flow on Networks

Traffic Flow on a Road Network

Traffic Flow on a Road Network