Showing papers in "IEEE Transactions on Robotics in 2022"

FAST-LIO2: Fast Direct LiDAR-Inertial Odometry

Abstract: This article presents FAST-LIO2: a fast, robust, and versatile LiDAR-inertial odometry framework. Building on a highly efficient tightly coupled iterated Kalman filter, FAST-LIO2 has two key novelties that allow fast, robust, and accurate LiDAR navigation (and mapping). The first one is directly registering raw points to the map (and subsequently update the map, i.e., mapping) without extracting features. This enables the exploitation of subtle features in the environment and, hence, increases the accuracy. The elimination of a hand-engineered feature extraction module also makes it naturally adaptable to emerging LiDARs of different scanning patterns; the second main novelty is maintaining a map by an incremental k-dimensional (k-d) tree data structure, incremental k-d tree ( ikd-Tree ), that enables incremental updates (i.e., point insertion and delete) and dynamic rebalancing. Compared with existing dynamic data structures (octree, R $^\ast$ -tree, and nanoflann k-d tree), ikd-Tree achieves superior overall performance while naturally supports downsampling on the tree. We conduct an exhaustive benchmark comparison in 19 sequences from a variety of open LiDAR datasets. FAST-LIO2 achieves consistently higher accuracy at a much lower computation load than other state-of-the-art LiDAR-inertial navigation systems. Various real-world experiments on solid-state LiDARs with small field of view are also conducted. Overall, FAST-LIO2 is computationally efficient (e.g., up to 100 Hz odometry and mapping in large outdoor environments), robust (e.g., reliable pose estimation in cluttered indoor environments with rotation up to 1000 deg/s), versatile (i.e., applicable to both multiline spinning and solid-state LiDARs, unmanned aerial vehicle (UAV) and handheld platforms, and Intel- and ARM-based processors), while still achieving a higher accuracy than existing methods. Our implementation of the system FAST-LIO2 and the data structure ikd-Tree are both open-sourced on Github.

Past, Present, and Future of Aerial Robotic Manipulators

Abstract: This article analyzes the evolution and current trends in aerial robotic manipulation, comprising helicopters, conventional underactuated multirotors, and multidirectional thrust platforms equipped with a wide variety of robotic manipulators capable of physically interacting with the environment. It also covers cooperative aerial manipulation and interconnected actuated multibody designs. The review is completed with developments in teleoperation, perception, and planning. Finally, a new generation of aerial robotic manipulators is presented with our vision of the future.

GVINS: Tightly Coupled GNSS–Visual–Inertial Fusion for Smooth and Consistent State Estimation

Abstract: Visual–inertial odometry (VIO) is known to suffer from drifting, especially over long-term runs. In this article, we present GVINS, a nonlinear optimization-based system that tightly fuses global navigation satellite system (GNSS) raw measurements with visual and inertial information for real-time and drift-free stateestimation. Our system aims to provide accurate global six-degree-of-freedom estimation under complex indoor–outdoor environments, where GNSS signals may be intermittent or even inaccessible. To establish the connection between global measurements and local states, a coarse-to-fine initialization procedure is proposed to efficiently calibrate the transformation online and initialize GNSS states from only a short window of measurements. The GNSS code pseudorange and Doppler shift measurements, along with visual and inertial information, are then modeled and used to constrain the system states in a factor graph framework. For complex and GNSS-unfriendly areas, the degenerate cases are discussed and carefully handled to ensure robustness. Thanks to the tightly coupled multisensor approach and system design, our system fully exploits the merits of three types of sensors and is able to seamlessly cope with the transition between indoor and outdoor environments, where satellites are lost and reacquired. We extensively evaluate the proposed system by both simulation and real-world experiments, and the results demonstrate that our system substantially suppresses the drift of the VIO and preserves the local accuracy in spite of noisy GNSS measurements. The versatility and robustness of the system are verified on large-scale data collected in challenging environments. In addition, experiments show that our system can still benefit from the presence of only one satellite, whereas at least four satellites are required for its conventional GNSS counterparts.

Safe Control With Learned Certificates: A Survey of Neural Lyapunov, Barrier, and Contraction Methods for Robotics and Control

Abstract: Learning-enabled control systems have demonstrated impressive empirical performance on challenging control problems in robotics, but this performance comes at the cost of reduced transparency and lack of guarantees on the safety or stability of the learned controllers. In recent years, new techniques have emerged to provide these guarantees by learning certificates alongside control policies—these certificates provide concise data-driven proofs that guarantee the safety and stability of the learned control system. These methods not only allow the user to verify the safety of a learned controller but also provide supervision during training, allowing safety and stability requirements to influence the training process itself. In this article, we provide a comprehensive survey of this rapidly developing field of certificate learning. We hope that this article will serve as an accessible introduction to the theory and practice of certificate learning, both to those who wish to apply these tools to practical robotics problems and to those who wish to dive more deeply into the theory of learning for control.

Human-in-the-Loop Control of Soft Exosuits Using Impedance Learning on Different Terrains

Abstract: Many previous works of soft wearable exoskeletons (exosuit) target at improving the human locomotion assistance, without considering the impedance adaption to interact with the unpredictable dynamics and external environment, preferably outside the laboratory environments. This article proposes a novel hierarchical human-in-the-loop paradigm that aims to produce suitable assistance powers for cable-driven lower limb exosuits to aid the ankle joint in pushing off the ground. It includes two primary loop layers: impedance learning in the external loop and human-in-the-loop adaptive management in the inner loop. Considering unknown terrains, its impedance model can be transferred to a quadratic programming problem with specified constraints, which a designed primal-dual optimization prototype then solves. Then, the presented impedance learning strategy is introduced to regulate the impedance model with the adaptive assistant powers for humans on different terrains. An adaptive controller is designed in the inner loop to balance the nonlinearities and compliance existing in the human-exosuit coexistence, while the robust mechanism compensates for disturbances to facilitate trajectory management without employing the general regressor. The advantage of the proposed technique over conventional solutions with fixed impedance parameters is that it can improve human walking performance over different terrains. Experiments demonstrate the significance of the approach.

Soft Robotic Suits: State of the Art, Core Technologies, and Open Challenges

Abstract: Wearable robots are undergoing a disruptive transition, from the rigid machines that populated the science-fiction world in the early 1980s to lightweight robotic apparel, hardly distinguishable from our daily clothes. In less than a decade of development, soft robotic suits have achieved important results in human motor assistance and augmentation. In this article, we start by giving a definition of soft robotic suits and proposing a taxonomy to classify existing systems. We then critically review the modes of actuation, the physical human–robot interface and the intention-detection strategies of state-of-the-art soft robotic suits, highlighting the advantages and limitations of different approaches. Finally, we discuss the impact of this new technology on human movements, for both augmenting human function and supporting motor impairments, and identify areas that are in need of further development.

Human-in-the-Loop Control of Soft Exosuits Using Impedance Learning on Different Terrains

Abstract: Many previous works of soft wearable exoskeletons (exosuit) target at improving the human locomotion assistance, without considering the impedance adaption to interact with the unpredictable dynamics and external environment, preferably outside the laboratory environments. This article proposes a novel hierarchical human-in-the-loop paradigm that aims to produce suitable assistance powers for cable-driven lower limb exosuits to aid the ankle joint in pushing off the ground. It includes two primary loop layers: impedance learning in the external loop and human-in-the-loop adaptive management in the inner loop. Considering unknown terrains, its impedance model can be transferred to a quadratic programming problem with specified constraints, which a designed primal-dual optimization prototype then solves. Then, the presented impedance learning strategy is introduced to regulate the impedance model with the adaptive assistant powers for humans on different terrains. An adaptive controller is designed in the inner loop to balance the nonlinearities and compliance existing in the human-exosuit coexistence, while the robust mechanism compensates for disturbances to facilitate trajectory management without employing the general regressor. The advantage of the proposed technique over conventional solutions with fixed impedance parameters is that it can improve human walking performance over different terrains. Experiments demonstrate the significance of the approach.

Independent Control Strategy of Multiple Magnetic Flexible Millirobots for Position Control and Path Following

Abstract: Magnetically actuated small-scale robots have great potential for numerous applications in remote, confined, or enclosed environments. Multiple small-scale robots enable cooperation and increase the operating efficiency. However, independent control of multiple magnetic small-scale robots is a great challenge, because the robots receive identical control inputs from the same external magnetic field. In this article, we propose a novel strategy of completely decoupled independent control of magnetically actuated flexible swimming millirobots. A flexible millirobot shows a crawling motion on a flat plane within an oscillating magnetic field. Millirobots with different magnetization directions have the same velocity response curve to the oscillating magnetic field but with a difference of phase. We designed and fabricated a group of up to four heterogeneous millirobots with identical geometries and different magnetization directions. According to their velocity response curves, an optimal direction of oscillating magnetic field is calculated to induce a desired velocity vector for the millirobot group, one of which is nonzero and the others are approximately zero. The strategy is verified by experiments of independent position control of up to four millirobots and independent path following control of up to three millirobots with small errors. We further expect that with this independent control strategy, the millirobots will be able to cooperate to finish complicated tasks.

Trajectory Planning and Optimization for Robotic Machining Based On Measured Point Cloud

Abstract: Industrial robots are characterized by good flexibility and a large working space, and offer a new approach for the machining of large and complex parts with small machining allowances (extra material allowed for subsequent machining). Parts of this type (such as aircraft skin parts, wind turbine blades, etc.) are easily deformed due to their large scale and low stiffness. Therefore, these parts cannot be directly machined according to the designed model. A feasible method is to plan a robotic machining path by using the point clouds of parts after clamping from onsite measurement which contains inherent defects of measurement such as noise points and abrupt points. In this article, a novel method is proposed to plan and optimize a robotic machining path that meets the requirements of smoothness, dexterity, and stiffness based on the point cloud from onsite measurement. The dual nonuniform rational B-spline curves of the machining path points and tool axis points are generated at first. Next, an objective function of smoothness optimization is established to filter out the local mutation of the path by considering the constraints of both the deformation energy and the deviation. Then, the objective function of robot postures optimization is established to optimize dexterity and Cartesian stiffness of a robot during the machining process. To show the feasibility of the proposed method, simulation and experiments are carried out. It is proved that the proposed method can generate a smooth machining trajectory. The stability of joint rotation and the rigidity and dexterity of the robot are improved during the machining process.

Independent Control Strategy of Multiple Magnetic Flexible Millirobots for Position Control and Path Following

Abstract: Magnetically actuated small-scale robots have great potential for numerous applications in remote, confined, or enclosed environments. Multiple small-scale robots enable cooperation and increase the operating efficiency. However, independent control of multiple magnetic small-scale robots is a great challenge, because the robots receive identical control inputs from the same external magnetic field. In this article, we propose a novel strategy of completely decoupled independent control of magnetically actuated flexible swimming millirobots. A flexible millirobot shows a crawling motion on a flat plane within an oscillating magnetic field. Millirobots with different magnetization directions have the same velocity response curve to the oscillating magnetic field but with a difference of phase. We designed and fabricated a group of up to four heterogeneous millirobots with identical geometries and different magnetization directions. According to their velocity response curves, an optimal direction of oscillating magnetic field is calculated to induce a desired velocity vector for the millirobot group, one of which is nonzero and the others are approximately zero. The strategy is verified by experiments of independent position control of up to four millirobots and independent path following control of up to three millirobots with small errors. We further expect that with this independent control strategy, the millirobots will be able to cooperate to finish complicated tasks.

Scan Context++: Structural Place Recognition Robust to Rotation and Lateral Variations in Urban Environments

Abstract: Place recognition is a key module in robotic navigation. The existing line of studies mostly focuses on visual place recognition to recognize previously visited places solely based on their appearance. In this article, we address structural place recognition by recognizing a place based on structural appearance, namely from range sensors. Extending our previous work on a rotation invariant spatial descriptor, the proposed descriptor completes a generic descriptor robust to both rotation (heading) and translation when roll–pitch motions are not severe. We introduce two subdescriptors and enable topological place retrieval followed by the 1-degree of freedom semimetric localization, thereby bridging the gap between topological place retrieval and metric localization. The proposed method has been evaluated thoroughly in terms of environmental complexity and scale. The source code is available and can easily be integrated into existing light detection and ranging simultaneous localization and mapping.

A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontiers

Abstract: Active simultaneous localization and mapping (SLAM) is the problem of planning and controlling the motion of a robot to build the most accurate and complete model of the surrounding environment. Since the first foundational work in active perception appeared, more than three decades ago, this field has received increasing attention across different scientific communities. This has brought about many different approaches and formulations, and makes a review of the current trends necessary and extremely valuable for both new and experienced researchers. In this article, we survey the state of the art in active SLAM and take an in-depth look at the open challenges that still require attention to meet the needs of modern applications. After providing a historical perspective, we present a unified problem formulation and review the well-established modular solution scheme, which decouples the problem into three stages that identify, select, and execute potential navigation actions. We then analyze alternative approaches, including belief-space planning and deep reinforcement learning techniques, and review related work on multirobot coordination. This article concludes with a discussion of new research directions, addressing reproducible research, active spatial perception, and practical applications, among other topics.

MADER: Trajectory Planner in Multiagent and Dynamic Environments

Abstract: This article presents MADER, a 3-D decentralized and asynchronous trajectory planner for UAVs that generates collision-free trajectories in environments with static obstacles, dynamic obstacles, and other planning agents. Real-time collision avoidance with other dynamic obstacles or agents is done by performing outer polyhedral representations of every interval of the trajectories and then including the plane that separates each pair of polyhedra as a decision variable in the optimization problem. MADER uses our recently developed MINVO basis to obtain outer polyhedral representations with volumes 2.36 and 254.9 times, respectively, smaller than the Bernstein or B-Spline bases used extensively in the planning literature. Our decentralized and asynchronous algorithm guarantees safety with respect to other agents by including their committed trajectories as constraints in the optimization and then executing a collision check-recheck scheme. Finally, extensive simulations in challenging cluttered environments show up to a 33.9% reduction in the flight time, and a 88.8% reduction in the number of stops compared to the Bernstein and B-Spline bases, shorter flight distances than centralized approaches, and shorter total times on average than synchronous decentralized approaches.

Multilevel Operation Strategy of a Vascular Interventional Robot System for Surgical Safety in Teleoperation

Abstract: Remote-controlled vascular interventional robots have great potential for use in minimally invasive vascular surgeries in recent years due to their ability to reduce the occupational risk of surgeons and improve the stability and accuracy of surgical procedures. However, blood vessels will suffer from the damage caused by collision with medical instruments to some extent even though the surgeries are very successful. Moreover, when surgeons perform unsafe operations, the unsafe operations will not only seriously affect surgical safety (or even cause serious complications) but also restrict the continuity of operation. In this article, a multilevel concept for operating force is first introduced into surgical procedures as a reference for the choice and design of operation strategies. Based on this concept, a novel multilevel operation strategy is first proposed to reduce blood vessel damage, ensure surgical safety, and allow for continuous operation. This strategy can remind surgeons about the operative conditions in real-time, reduce collision to blood vessels, and eliminate unsafe operations online. A prototype was fabricated and calibrated through calibration experiments and the performance of the multilevel operation strategy was validated through in vitro and ex vivo experiments. Experimental results demonstrate the engineering effectiveness of the proposed method and motivate the need for further in vivo studies to evaluate improvement on surgical safety.

Geometrically Constrained Trajectory Optimization for Multicopters

Abstract: In this article, we present an optimization-based framework for multicopter trajectory planning subject to geometrical configuration constraints and user-defined dynamic constraints. The basis of the framework is a novel trajectory representation built upon our novel optimality conditions for unconstrained control effort minimization. We design linear-complexity operations on this representation to conduct spatial–temporal deformation under various planning requirements. Smooth maps are utilized to exactly eliminate geometrical constraints in a lightweight fashion. A variety of state-input constraints are supported by the decoupling of dense constraint evaluation from sparse parameterization and the backward differentiation of flatness map. As a result, this framework transforms a generally constrained multicopter planning problem into an unconstrained optimization that can be solved reliably and efficiently. Our framework bridges the gaps among solution quality, planning efficiency, and constraint fidelity for a multicopter with limited resources and maneuvering capability. Its generality and robustness are both demonstrated by applications to different flight tasks. Extensive simulations and benchmarks are also conducted to show its capability of generating high-quality solutions while retaining the computation speed against other specialized methods by orders of magnitude.

Kalman-Filter-Based, Dynamic 3-D Shape Reconstruction for Steerable Needles With Fiber Bragg Gratings in Multicore Fibers

Abstract: Steerable needles are a promising technology to provide safe deployment of tools through complex anatomy in minimally invasive surgery, including tumor-related diagnoses and therapies. For the 3-D localization of these instruments in soft tissue, fiber Bragg gratings (FBGs) based reconstruction methods have gained in popularity because of the inherent advantages of optical fibers in a clinical setting, such as flexibility, immunity to electromagnetic interference, nontoxicity, and the absence of line-of-sight issues. However, methods proposed thus far focus on shape reconstruction of the steerable needle itself, where accuracy is susceptible to errors in interpolation and curve fitting methods used to estimate the curvature vectors along the needle. In this study, we propose reconstructing the shape of the path created by the steerable needle tip based on the follow-the-leader nature of many of its variants. By assuming that the path made by the tip is equivalent to the shape of the needle, this novel approach paves the way for shape reconstruction through a single set of FBGs at the needle tip, which provides curvature information about every section of the path during navigation. We propose a Kalman-filter-based sensor fusion method to update the curvature information about the sections as they are continually estimated during the insertion process. The proposed method is validated through simulation, in vitro and ex vivo experiments employing a programmable bevel-tip steerable needle (PBN). The results show clinically acceptable accuracy, with 2.87-mm mean PBN tip position error, and a standard deviation of 1.63 mm for a 120-mm 3-D insertion.

Inchworm Inspired Multimodal Soft Robots With Crawling, Climbing, and Transitioning Locomotion

Abstract: Although many soft robots, capable of crawling or climbing, have been well developed, integrating multimodal locomotion into a soft robot for transitioning between crawling and climbing still remains elusive. In this work, we present a class of inchworm-inspired multimodal soft crawling-climbing robots (SCCRs) that can achieve crawling, climbing, and transitioning between horizontal and vertical planes. Inspired by the inchworm’s multimodal locomotion, which depends on the “ $\Omega$ ” deformation of the body and controllable friction force of feet, we develop the SCCR by 1) three pneumatic artificial muscles based body designed to produce “ $\Omega$ ” deformation; 2) two negative pressure suckers adopted to generate controllable friction forces. Then a simplified kinematic model is developed to characterize the kinematic features of the SCCRs. Lastly, a control strategy is proposed to synchronously control the “ $\Omega$ ” deformation and sucker friction forces for multimodal locomotion. The experimental results demonstrate that the SCCR can move at a maximum speed of 21 mm/s (0.11 body length/s) on horizontal planes and 15 mm/s (0.079 body length/s) on vertical walls. Furthermore, the SCCR can work in confined spaces, carry a payload of 500 g (about 15 times the self-weight) on horizontal planes or 20 g on vertical walls, and move in aquatic environments.

Robust Odometry and Mapping for Multi-LiDAR Systems With Online Extrinsic Calibration

Abstract: Combining multiple LiDARs enables a robot to maximize its perceptual awareness of environments and obtain sufficient measurements, which is promising for simultaneous localization and mapping (SLAM). This article proposes a system to achieve robust and simultaneous extrinsic calibration, odometry, and mapping for multiple LiDARs. Our approach starts with measurement preprocessing to extract edge and planar features from raw measurements. After a motion and extrinsic initialization procedure, a sliding window-based multi-LiDAR odometry runs onboard to estimate poses with an online calibration refinement and convergence identification. We further develop a mapping algorithm to construct a global map and optimize poses with sufficient features together with a method to capture and reduce data uncertainty. We validate our approach’s performance with extensive experiments on 10 sequences (4.60-km total length) for the calibration and SLAM and compare it against the state of the art. We demonstrate that the proposed work is a complete, robust, and extensible system for various multi-LiDAR setups. The source code, datasets, and demonstrations are available at: https://ram-lab.com/file/site/m-loam .

A Survey on Swarm Microrobotics

Abstract: The small size and wireless actuation of microrobots make them potential candidates for minimally invasive medicine. To advance microrobots to future clinical application, microrobotics researchers have investigated a number of key issues, in which swarm control is a primary challenge and is attracting increasing attention. As a single microrobot has limited volume and surface area, clinically relevant tasks, including in-vivo tracking, usually require simultaneous control of a large swarm of microrobots. Unlike macroscale robots, implementing on-board actuators and sensors for microrobots is challenging, which differentiates swarm microrobotics from other swarm robotics approaches. This article systematically summarizes the state of the art for this emerging field, including actuation systems with different power sources, swarm behaviors modeling and simulation, swarm control strategies, and targeted biomedical applications. Actuation principles of microrobot swarms are categorized in detail, and critical comparisons are made to provide guidance and insight for future swarm microrobotics researchers. Considering the unique features of swarm microrobotics compared to traditional swarm robotics, this article also emphasizes the modeling, simulation, and control of microrobot swarms. Furthermore, recent biomedical applications of microrobot swarms are summarized to illustrate specific application scenarios. Finally, we provide an assessment of the future directions of swarm microrobotics.

Proximity Perception in Human-Centered Robotics: A Survey on Sensing Systems and Applications

Abstract: Proximity perception is a technology that has the potential to play an essential role in the future of robotics. It can fulfill the promise of safe, robust, and autonomous systems in industry and everyday life, alongside humans, as well as in remote locations in space and underwater. In this survey article, we cover the developments of this field from the early days up to the present, with a focus on human-centered robotics. In this domain, proximity sensors are typically deployed in two scenarios: first, on the exterior of manipulator arms to support safety and interaction functionality, and second, on the inside of grippers or hands to support grasping and exploration. Therefore, based on this observation, in the beginning of this article, we propose a categorization to organize the use cases of proximity sensors in human-centered robotics. Then, we devote effort to present the sensing technologies and different measuring principles that have been developed over the years, also providing a summary in form of a table. Following, we review the literature regarding the applications that have been proposed. Finally, we give an overview of the most important trends that will shape the future of this domain.

LCDNet: Deep Loop Closure Detection and Point Cloud Registration for LiDAR SLAM

Abstract: Loop closure detection is an essential component of simultaneous localization and mapping (SLAM) systems, which reduces the drift accumulated over time. Over the years, several deep learning approaches have been proposed to address this task; however, their performance has been subpar compared to handcrafted techniques, especially while dealing with reverse loops. In this article, we introduce the novel loop closure detection network (LCDNet) that effectively detects loop closures in light detection and ranging (LiDAR) point clouds by simultaneously identifying previously visited places and estimating the six degrees of freedom relative transformation between the current scan and the map. LCDNet is composed of a shared encoder, a place recognition head that extracts global descriptors, and a relative pose head that estimates the transformation between two point clouds. We introduce a novel relative pose head based on the unbalanced optimal transport theory that we implement in a differentiable manner to allow for end-to-end training. Extensive evaluations of LCDNet on multiple real-world autonomous driving datasets show that our approach outperforms state-of-the-art loop closure detection and point cloud registration techniques by a large margin, especially while dealing with reverse loops. Moreover, we integrate our proposed loop closure detection approach into a LiDAR SLAM library to provide a complete mapping system and demonstrate the generalization ability using different sensor setup in an unseen city.

Myoelectric or Force Control? A Comparative Study on a Soft Arm Exosuit

Abstract: The intention-detection strategy used to drive an exosuit is fundamental to evaluate the effectiveness and acceptability of the device. Yet, current literature on wearable soft robotics lacks evidence on the comparative performance of different control approaches for online intention-detection. In the present work, we compare two different and complementary controllers on a wearable robotic suit, previously formulated and tested by our group; a model-based myoelectric control (myoprocessor), which estimates the joint torque from the activation of target muscles, and a force control that estimates human torques using an inverse dynamics model (dynamic arm). We test them on a cohort of healthy participants performing tasks replicating functional activities of daily living involving a wide range of dynamic movements. Our results suggest that both controllers are robust and effective in detecting human–motor interaction, and show comparable performance for augmenting muscular activity. In particular, the biceps brachii activity was reduced by up to 74% under the assistance of the dynamic arm and up to 47% under the myoprocessor, compared to a no-suit condition. However, the myoprocessor outperformed the dynamic arm in promptness and assistance during movements that involve high dynamics. The exosuit work normalized with respect to the overall work was $68.84 \pm 3.81\%$ when it was ran by the myoprocessor, compared to $45.29 \pm 7.71\%$ during the dynamic arm condition. The reliability and accuracy of motor intention detection strategies in wearable device is paramount for both the efficacy and acceptability of this technology. In this article, we offer a detailed analysis of the two most widely used control approaches, trying to highlight their intrinsic structural differences and to discuss their different and complementary performance.

FASTER: Fast and Safe Trajectory Planner for Navigation in Unknown Environments

Abstract: Planning high-speed trajectories for UAVs in unknown environments requires algorithmic techniques that enable fast reaction times to guarantee safety as more information about the environment becomes available. The standard approaches that ensure safety by enforcing a “stop” condition in the free-known space can severely limit the speed of the vehicle, especially in situations where much of the world is unknown. Moreover, the ad-hoc time and interval allocation scheme usually imposed on the trajectory also leads to conservative and slower trajectories. This work proposes FASTER (Fast and Safe Trajectory Planner) to ensure safety without sacrificing speed. FASTER obtains high-speed trajectories by enabling the local planner to optimize in both the free-known and unknown spaces. Safety is ensured by always having a safe back-up trajectory in the free-known space. The MIQP formulation proposed also allows the solver to choose the trajectory interval allocation. FASTER is tested extensively in simulation and in real hardware, showing flights in unknown cluttered environments with velocities up to 7.8 m/s, and experiments at the maximum speed of a skid-steer ground robot (2 m/s).

Perceptive Locomotion through Nonlinear Model Predictive Control

Abstract: Dynamic locomotion in rough terrain requires accurate foot placement, collision avoidance, and planning of the underactuated dynamics of the system. Reliably optimizing for such motions and interactions in the presence of imperfect and often incomplete perceptive information is challenging. We present a complete perception, planning, and control pipeline, that can optimize motions for all degrees of freedom of the robot in real-time. To mitigate the numerical challenges posed by the terrain a sequence of convex inequality constraints is extracted as local approximations of foothold feasibility and embedded into an online model predictive controller. Steppability classification, plane segmentation, and a signed distance field are precomputed per elevation map to minimize the computational effort during the optimization. A combination of multiple-shooting, real-time iteration, and a filter-based line-search are used to solve the formulated problem reliably and at high rate. We validate the proposed method in scenarios with gaps, slopes, and stepping stones in simulation and experimentally on the ANYmal quadruped platform, resulting in state-of-the-art dynamic climbing.

BiConMP: A Nonlinear Model Predictive Control Framework for Whole Body Motion Planning

Abstract: Online planning of whole-body motions for legged robots is challenging due to the inherent nonlinearity in the robot dynamics. In this work, we propose a nonlinear model predictive control (MPC) framework, the BiConMP which can generate whole body trajectories online by efficiently exploiting the structure of the robot dynamics. BiConMP is used to generate various cyclic gaits on a real quadruped robot and its performance is evaluated on different terrain, countering unforeseen pushes, and transitioning online between different gaits. Furthermore, the ability of BiConMP to generate nontrivial acyclic whole-body dynamic motions on the robot is presented. The same approach is also used to generate various dynamic motions in MPC on a humanoid robot (Talos) and another quadruped robot (AnYmal) in simulation. Finally, an extensive empirical analysis on the effects of planning horizon and frequency on the nonlinear MPC framework is reported and discussed.

Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systems

Abstract: Multi-robot simultaneous localization and mapping (SLAM) is a crucial capability to obtain timely situational awareness over large areas. Real-world applications demand multi-robot SLAM systems to be robust to perceptual aliasing and to operate under limited communication bandwidth; moreover, it is desirable for these systems to capture semantic information to enable high-level decision-making and spatial artificial intelligence. This article presents $ \mathsf{{Kimera-Multi}} $ , a multi-robot system that: 1) is robust and capable of identifying and rejecting incorrect inter- and intrarobot loop closures resulting from perceptual aliasing; 2) is fully distributed and only relies on local (peer-to-peer) communication to achieve distributed localization and mapping; and 3) builds a globally consistent metric-semantic 3-D mesh model of the environment in real time, where faces of the mesh are annotated with semantic labels. $ \mathsf{{Kimera-Multi}} $ is implemented by a team of robots equipped with visual-inertial sensors. Each robot builds a local trajectory estimate and a local mesh using $ \mathsf{{Kimera}} $ . When communication is available, robots initiate a distributed place recognition and robust pose graph optimization protocol based on a distributed graduated nonconvexity algorithm. The proposed protocol allows the robots to improve their local trajectory estimates by leveraging inter-robot loop closures while being robust to outliers. Finally, each robot uses its improved trajectory estimate to correct the local mesh using mesh deformation techniques. We demonstrate $ \mathsf{{Kimera-Multi}} $ in photo-realistic simulations, SLAM benchmarking datasets, and challenging outdoor datasets collected using ground robots. Both real and simulated experiments involve long trajectories (e.g., up to 800 m per robot). The experiments show that $ \mathsf{{Kimera-Multi}} $ : 1) outperforms the state of the art in terms of robustness and accuracy; 2) achieves estimation errors comparable to a centralized SLAM system while being fully distributed; 3) is parsimonious in terms of communication bandwidth; 4) produces accurate metric-semantic 3-D meshes; and 5) is modular and can also be used for standard 3-D reconstruction (i.e., without semantic labels) or for trajectory estimation (i.e., without reconstructing a 3-D mesh).

A Nonlinear Model Predictive Control for the Position Tracking of Cable-Driven Parallel Robots

Abstract: This article proposes a nonlinear model predictive control (NMPC) strategy for the position tracking of cable-driven parallel robots (CDPRs). The NMPC formulation handles explicitly the cable tensions and their limits. Accordingly, the cable tension distribution is performed as an integral part of the NMPC feedback control strategy, which notably allows the CDPR to operate on the wrench-feasible workspace boundaries without failure. In order to integrate the cable tension minimization within the NMPC formulation, the concept of wrench equivalent optimality (WEO) is introduced. The WEO is a nonnegative measure able to evaluate if the wrench generated by a given cable tension vector can be generated by an alternative tension vector with smaller 2-norm. The redundancy resolution performed by means of the minimization of the WEO enables the stability of the closed-loop system to be proved. More precisely, sufficient conditions for the uniform asymptotic stability are deduced using results from the analysis of NMPC schemes without terminal constraints and costs. Furthermore, the proposed NMPC strategy is validated experimentally on a fully constrained 6 degree-of-freedom CDPR.

Origami-Inspired Soft Actuators for Stimulus Perception and Crawling Robot Applications

Abstract: Origami has been proved as a valuable tool to develop deployable, multifunctional, and tunable devices for diverse engineering applications. Inspired by the Kresling origami, this article presents a soft pneumatic actuator with vacuum control to realize the compound motion of twist and contraction. The twist direction varies as the crease angle changes and it offers pure contraction after combining two actuators with reverse creases. Our actuator can lift 180 folds of its weight and achieve the contraction ratio of 47%, while the response time is below 0.3 s. The origami-based actuator can realize an adjustable bistable property, leading to the possibility for external stimulus detection and mechanical memory devices, where the sensitivity can be regulated by the initial vacuum pressure. Through several actuators, we demonstrate the reconfigurable crawling robots capable of worm-like creep, alternating-step locomotion as well as obstacle detection. After activating all the actuators, the four-actuator robot with two working modes is validated to perform agilely for confined space navigation, showing our actuator has the potential in soft robotics applications.

TAMOLS: Terrain-Aware Motion Optimization for Legged Systems

Abstract: Terrain geometry is, in general, nonsmooth, nonlinear, nonconvex, and, if perceived through a robot-centric visual unit, appears partially occluded and noisy. This article presents the complete control pipeline capable of handling the aforementioned problems in real-time. We formulate a trajectory optimization problem that jointly optimizes over the base pose and footholds, subject to a height map. To avoid converging into undesirable local optima, we deploy a graduated optimization technique. We embed a compact, contact-force free stability criterion that is compatible with the nonflat ground formulation. Direct collocation is used as transcription method, resulting in a nonlinear optimization problem that can be solved online in less than ten milliseconds. To increase robustness in the presence of external disturbances, we close the tracking loop with a momentum observer. Our experiments demonstrate stair climbing, walking on stepping stones, and over gaps, utilizing various dynamic gaits.

Energy-Efficient Path Planning of Reconfigurable Robots in Complex Environments

Abstract: Planning the energy-efficient and collision-free paths for reconfigurable robots in complex environments is more challenging than conventional fixed-shaped robots due to their flexible degrees of freedom while navigating through tight spaces. This article presents a novel algorithm, energy-efficient batch informed trees* (BIT*) for reconfigurable robots, which incorporates BIT*, an informed, anytime sampling-based planner, with the energy-based objectives that consider the energy cost for robot’s each reconfigurable action. Moreover, it proposes to improve the direct sampling technique of informed RRT* by defining an $L^2$ greedy informed set that shrinks as a function of the state with the maximum admissible estimated cost instead of shrinking as a function of the current solution, thereby improving the convergence rate of the algorithm. Experiments were conducted on a tetromino hinged-based reconfigurable robot as a case study to validate our proposed path planning technique. The outcome of our trials shows that the proposed approach produces energy-efficient solution paths, and outperforms existing techniques on simulated and real-world experiments.