scispace - formally typeset
Search or ask a question

Showing papers on "Obstacle avoidance published in 2022"


Journal ArticleDOI
TL;DR: This work develops miniature but fully autonomous drones with a trajectory planner that can function in a timely and accurate manner based on limited information from onboard sensors and is integrated into the developed palm-sized swarm platform with onboard perception, localization, and control.
Abstract: Aerial robots are widely deployed, but highly cluttered environments such as dense forests remain inaccessible to drones and even more so to swarms of drones. In these scenarios, previously unknown surroundings and narrow corridors combined with requirements of swarm coordination can create challenges. To enable swarm navigation in the wild, we develop miniature but fully autonomous drones with a trajectory planner that can function in a timely and accurate manner based on limited information from onboard sensors. The planning problem satisfies various task requirements including flight efficiency, obstacle avoidance, and inter-robot collision avoidance, dynamical feasibility, swarm coordination, and so on, thus realizing an extensible planner. Furthermore, the proposed planner deforms trajectory shapes and adjusts time allocation synchronously based on spatial-temporal joint optimization. A high-quality trajectory thus can be obtained after exhaustively exploiting the solution space within only a few milliseconds, even in the most constrained environment. The planner is finally integrated into the developed palm-sized swarm platform with onboard perception, localization, and control. Benchmark comparisons validate the superior performance of the planner in trajectory quality and computing time. Various real-world field experiments demonstrate the extensibility of our system. Our approach evolves aerial robotics in three aspects: capability of cluttered environment navigation, extensibility to diverse task requirements, and coordination as a swarm without external facilities. Description A fully autonomous swarm composed of palm-sized drones with versatile task extensibility in the wild is realized.

95 citations


Journal ArticleDOI
TL;DR: Zhang et al. as discussed by the authors proposed a path planning with dynamic obstacle avoidance method of the manipulator based on a deep reinforcement learning algorithm soft actor-critic (SAC) to avoid the moving obstacle in the environment and make real-time planning.

38 citations


Journal ArticleDOI
TL;DR: This letter proposes a distributed approach for multi-robot navigation which combines the concept of reciprocal velocity obstacle (RVO) and the scheme of deep reinforcement learning (DRL) to solve the reciprocal collision avoidance problem under limited information.
Abstract: The challenges to solving the collision avoidance problem lie in adaptively choosing optimal robot velocities in complex scenarios full of interactive obstacles. In this letter, we propose a distributed approach for multi-robot navigation which combines the concept of reciprocal velocity obstacle (RVO) and the scheme of deep reinforcement learning (DRL) to solve the reciprocal collision avoidance problem under limited information. The novelty of this work is threefold: (1) using a set of sequential VO and RVO vectors to represent the interactive environmental states of static and dynamic obstacles, respectively; (2) developing a bidirectional recurrent module based neural network, which maps the states of a varying number of surrounding obstacles to the actions directly; (3) developing a RVO area and expected collision time based reward function to encourage reciprocal collision avoidance behaviors and trade off between collision risk and travel time. The proposed policy is trained through simulated scenarios and updated by the actor-critic based DRL algorithm. We validate the policy in complex environments with various numbers of differential drive robots and obstacles. The experiment results demonstrate that our approach outperforms the state-of-art methods and other learning based approaches in terms of the success rate, travel time, and average speed.

30 citations


Journal ArticleDOI
TL;DR: In this paper , an uncertain moving obstacle avoidance method based on the improved velocity obstacle method was designed to reduce the distance and time of obstacle avoidance, and a series of experiments were carried out in the pool that validates the proposed methods are also presented.

30 citations


Journal ArticleDOI
01 Jan 2022
TL;DR: In this paper, a target-tracking controller for the UAVs is developed to meet the requirements of payload dynamics and obstacle avoidance, and the authors also present simulation results to demonstrate the benefits of the proposed problem formulation for a multiobstacle environment.
Abstract: Control barrier functions have been widely studied and applied to safety-critical systems, including multi-agent obstacle avoidance problems. In this work, we apply control barrier functions to a collaborative transportation problem involving two unmanned aerial vehicles (UAVs) moving a payload around obstacles as they deliver it to a target location. We develop a target-tracking controller for the UAVs, which is constrained to meet the requirements of payload dynamics and obstacle avoidance. We also present simulation results to demonstrate the benefits of the proposed problem formulation for a multi-obstacle environment.

28 citations


Journal ArticleDOI
TL;DR: In this paper , the authors present a framework for the safety-critical control of robotic systems, when safety is defined on safe regions in the configuration space, and synthesize a safe velocity based on control barrier function theory without relying on a high-fidelity dynamical model of the robot.
Abstract: This paper presents a framework for the safety-critical control of robotic systems, when safety is defined on safe regions in the configuration space. To maintain safety, we synthesize a safe velocity based on control barrier function theory without relying on a -- potentially complicated -- high-fidelity dynamical model of the robot. Then, we track the safe velocity with a tracking controller. This culminates in model-free safety critical control. We prove theoretical safety guarantees for the proposed method. Finally, we demonstrate that this approach is application-agnostic. We execute an obstacle avoidance task with a Segway in high-fidelity simulation, as well as with a Drone and a Quadruped in hardware experiments.

23 citations


Journal ArticleDOI
01 Jan 2022
TL;DR: In this article, an adaptive coverage control strategy for multi-agent systems with obstacle avoidance in the presence of actuator faults and time-varying uncertainties is presented based on a leader-follower approach.
Abstract: This letter presents an adaptive coverage control strategy for multi-agent systems with obstacle avoidance in the presence of actuator faults and time-varying uncertainties. The strategy is based on a leader-follower approach. Assuming that the motion of the leader is given, one distributes the followers within the leader’s obstacle-free sensing range so that collisions with obstacles can be avoided. An optimized distribution is achieved through the Centroidal Voronoi Tessellation (CVT) and a function approximation technique based immersion and invariance (FATII) coverage controller is constructed to realize the CVT. The stability of the FATII coverage controller is established and its validity is tested by simulations.

21 citations


Journal ArticleDOI
TL;DR: Wang et al. as mentioned in this paper proposed a Deep Reinforcement Learning (DRL)-based method that enables unmanned aerial vehicles (UAVs) to execute navigation tasks in multi-obstacle environments with randomness and dynamics.

20 citations


Journal ArticleDOI
Chandeok Park1
TL;DR: In this paper , a formation potential is defined to derive a formation control law for virtual structure, which enables multiple spacecraft to maintain polygonal or tetrahedral formation and avoid collision with obstacles.

19 citations


Journal ArticleDOI
Liwei Yang, Lixia Fu, Ping Li, Jianlin Mao, Ning Guo 
09 Jan 2022-Machines
TL;DR: An enhanced hybrid algorithm is proposed by considering the excellent search capability of the ant colony optimization (ACO) for global paths and the advantages of the dynamic window approach (DWA) for local obstacle avoidance.
Abstract: To further improve the path planning of the mobile robot in complex dynamic environments, this paper proposes an enhanced hybrid algorithm by considering the excellent search capability of the ant colony optimization (ACO) for global paths and the advantages of the dynamic window approach (DWA) for local obstacle avoidance. Firstly, we establish a new dynamic environment model based on the motion characteristics of the obstacles. Secondly, we improve the traditional ACO from the pheromone update and heuristic function and then design a strategy to solve the deadlock problem. Considering the actual path requirements of the robot, a new path smoothing method is present. Finally, the robot modeled by DWA obtains navigation information from the global path, and we enhance its trajectory tracking capability and dynamic obstacle avoidance capability by improving the evaluation function. The simulation and experimental results show that our algorithm improves the robot’s navigation capability, search capability, and dynamic obstacle avoidance capability in unknown and complex dynamic environments.

19 citations


Proceedings ArticleDOI
01 Jan 2022
TL;DR: In this article , a target-tracking controller for the UAVs is developed to meet the requirements of payload dynamics and obstacle avoidance, and the authors also present simulation results to demonstrate the benefits of the proposed problem formulation for a multiobstacle environment.
Abstract: Control barrier functions have been widely studied and applied to safety-critical systems, including multi-agent obstacle avoidance problems. In this work, we apply control barrier functions to a collaborative transportation problem involving two unmanned aerial vehicles (UAVs) moving a payload around obstacles as they deliver it to a target location. We develop a target-tracking controller for the UAVs, which is constrained to meet the requirements of payload dynamics and obstacle avoidance. We also present simulation results to demonstrate the benefits of the proposed problem formulation for a multi-obstacle environment.

Journal ArticleDOI
TL;DR: In this paper , an adaptive barrier Lyapunov function based obstacle avoidance control scheme is proposed for AUV, where the adaptive law is used to approximate the dynamic uncertainties and external disturbances, and the control scheme limits the tracking error within the preset range and thus ensures the safety of the AUV.

Journal ArticleDOI
TL;DR: An algorithm is proposed to train a neural network model via supervising learning using the collected data to replicate the human decision-making process under the same navigation scenario of a mobile robot with a finite number of motion types without global environmental information.
Abstract: A mobile robot is a futuristic technology that is changing the industry of automobiles as well as boosting the operations of on-demand services and applications. The navigation capability of mobile robots is a crucial task and one of the complex processes that guarantees moving from a starting position to a destination. To prevent any potential incidents or accidents, navigation must focus on the obstacle avoidance issue. This paper considers the navigation scenario of a mobile robot with a finite number of motion types without global environmental information. In addition, appropriate human decisions on motion types were collected in situations involving various obstacle features, and the corresponding environmental information was also recorded with the human decisions to establish a database. Further, an algorithm is proposed to train a neural network model via supervising learning using the collected data to replicate the human decision-making process under the same navigation scenario. The performance of the neural network-based decision-making method was cross-validated using both training and testing data to show an accuracy level close to 90%. In addition, the trained neural network model was installed on a virtual mobile robot within a mobile robot navigation simulator to interact with the environment and to make the decisions, and the results showed the effectiveness and efficacy of the proposed algorithm.

Journal ArticleDOI
TL;DR: In this article , a distributed adaptive formation tracking control protocol with a built-in obstacle avoidance mechanism is developed, where a radial basis function neural network is used to model the unknown nonlinearity of vehicle dynamics in each vehicle and repulsive potentials are employed for obstacle avoidance.
Abstract: This paper deals with the problem of distributed formation tracking control and obstacle avoidance of multi-vehicle systems (MVSs) in complex obstacle-laden environments. The MVS under consideration consists of a leader vehicle with an unknown control input and a group of follower vehicles, connected via a directed interaction topology, subject to simultaneous unknown heterogeneous nonlinearities and external disturbances. The central aim is to achieve effective and collision-free formation tracking control for the nonlinear and uncertain MVS with obstacles encountered in formation maneuvering, while not demanding global information of the interaction topology. Toward this goal, a radial basis function neural network is used to model the unknown nonlinearity of vehicle dynamics in each vehicle and repulsive potentials are employed for obstacle avoidance. Furthermore, a scalable distributed adaptive formation tracking control protocol with a built-in obstacle avoidance mechanism is developed. It is proved that, with the proposed protocol, the resulting formation tracking errors are uniformly ultimately bounded and obstacle collision avoidance is guaranteed. Comprehensive simulation results are elaborated to substantiate the effectiveness and the promising collision avoidance performance of the proposed scalable adaptive formation control approach.

Journal ArticleDOI
TL;DR: In this paper , a real-time motion planning method for manipulators for simultaneous obstacle avoidance and target tracking is proposed, where the robot can avoid colliding with obstacles by easily defining virtual fences, which are described by a group of level set functions.
Abstract: Motion planning is a core issuein the field of robotic control, which directly affects the programming efficiency of robots. In this article, we study the motion planning problem of manipulators for simultaneous obstacle avoidance and target tracking, and propose a novel real-time planning method in a complex workspace. One important feature of the proposed method is that the robot can avoid colliding with obstacles by easily defining “virtual fences,” which are described by a group of level set functions. Thus, the feasible space can be abstracted as inequality constraints. Taking the predefined task, physical constraints, and feasible space constraints into consideration, the motion planning problem is formulated into a quadratic programming (QP) one, in which the redundant degrees of freedom are used to optimize the velocities of the robot. Then, the control command is obtained by an established recurrent neural network, which is capable of solving the QP problem in an online manner. Theoretical conduction and verification in several typical workspaces demonstrate the efficacy of the established method, such as the abilityto remove physical fences, quick rearrangement, and performance optimization.

Journal ArticleDOI
TL;DR: Wang et al. as mentioned in this paper proposed a fusion algorithm named RACO that can quickly and safely reach the designated target area in a complex dynamic environment, which greatly improves the convergence performance of the algorithm and shortens the global path length.
Abstract: This paper focuses on the problem that the current path planning algorithm is not mature enough to achieve the expected goal in a complex dynamic environment. In light of the ant colony optimization (ACO) with good robustness and strong search ability, and the rolling window method (RWM) with better planning effect in local path planning problems, we propose a fusion algorithm named RACO that can quickly and safely reach the designated target area in a complex dynamic environment. This paper first improves the ant colony optimization, which greatly improves the convergence performance of the algorithm and shortens the global path length. On this basis, we propose a second-level safety distance determination rule to deal with the special problem of the research object encountering obstacles with unknown motion rules, in order to perfect the obstacle avoidance function of the fusion algorithm in complex environments. Finally, we carry out simulation experiments through MATLAB, and at the same time conduct three-dimensional simulation of algorithm functions again on the GAZEBO platform. It is verified that the algorithm proposed in this paper has good performance advantages in path planning and dynamic obstacle avoidance.

Journal ArticleDOI
TL;DR: In this article , a decision-making agent based on reinforcement learning is designed for establishing an obstacle avoidance strategy of an autonomous surface vessel (ASV), and the Modified Deep Deterministic Policy Gradient (MDDPG) method is proposed to solve the sparse feedback in obstacle avoidance issue.

Journal ArticleDOI
TL;DR: In this article , a new framework is developed in light of a hierarchical manner with the obtained environmental information and gradually solving navigation problems layer by layer, consisting of environmental mapping, path generation, CCPP, and dynamic obstacle avoidance.
Abstract: With the introduction of autonomy into the precision agriculture process, environmental exploration, disaster response, and other fields, one of the global demands is to navigate autonomous vehicles to completely cover entire unknown environments. In the previous complete coverage path planning (CCPP) research, however, autonomous vehicles need to consider mapping, obstacle avoidance, and route planning simultaneously during operating in the workspace, which results in an extremely complicated and computationally expensive navigation system. In this study, a new framework is developed in light of a hierarchical manner with the obtained environmental information and gradually solving navigation problems layer by layer, consisting of environmental mapping, path generation, CCPP, and dynamic obstacle avoidance. The first layer based on satellite images utilizes a deep learning method to generate the CCPP trajectory through the position of the autonomous vehicle. In the second layer, an obstacle fusion paradigm in the map is developed based on the unmanned aerial vehicle (UAV) onboard sensors. A nature-inspired algorithm is adopted for obstacle avoidance and CCPP re-joint. Equipped with the onboard LIDAR equipment, autonomous vehicles, in the third layer, dynamically avoid moving obstacles. Simulated experiments validate the effectiveness and robustness of the proposed framework.

Journal ArticleDOI
01 Jun 2022-Sensors
TL;DR: This review starts with the development of SLAM (Simultaneous Localization and Mapping) and proceeds to a review of V-SLAM (Visual- SLAM) from its proposal to the present, with a summary of its historical milestones.
Abstract: With the significant increase in demand for artificial intelligence, environmental map reconstruction has become a research hotspot for obstacle avoidance navigation, unmanned operations, and virtual reality. The quality of the map plays a vital role in positioning, path planning, and obstacle avoidance. This review starts with the development of SLAM (Simultaneous Localization and Mapping) and proceeds to a review of V-SLAM (Visual-SLAM) from its proposal to the present, with a summary of its historical milestones. In this context, the five parts of the classic V-SLAM framework—visual sensor, visual odometer, backend optimization, loop detection, and mapping—are explained separately. Meanwhile, the details of the latest methods are shown; VI-SLAM (Visual inertial SLAM) is reviewed and extended. The four critical techniques of V-SLAM and its technical difficulties are summarized as feature detection and matching, selection of keyframes, uncertainty technology, and expression of maps. Finally, the development direction and needs of the V-SLAM field are proposed.

Journal ArticleDOI
TL;DR: In this article, a hybrid controller for the autonomous path-following maneuver of a nonholonomic wheeled mobile robotic (WMR) system subjected to static and dynamic obstacles is presented.

Journal ArticleDOI
TL;DR: In this paper , a hybrid controller for the autonomous path-following maneuver of a nonholonomic wheeled mobile robotic (WMR) system subjected to static and dynamic obstacles is presented.

Journal ArticleDOI
TL;DR: On-line tuning of navigation functions based on sensor readings of obstacles and the robot state upon detection of new obstacles in the environment are introduced and the correctness of the navigation controller in terms of obstacle avoidance and arrival to the target is established.
Abstract: Mobile robot navigation functions provide geometric path planning that can be used to control the physical mobile robot system. This letter extends the theory of mobile robot navigation functions to planar environments populated by unknown obstacles. The robot has knowledge of the environment outer boundary but must use an obstacle sensor with sector-shape footprint during navigation. The letter introduces on-line tuning of navigation functions based on sensor readings of obstacles and the robot state upon detection of new obstacles in the environment. The letter describes a feedback control law that changes its structure according to the current navigation function, with trajectory damping that ensures smooth monotonic approach to the target. The correctness of the navigation controller in terms of obstacle avoidance and arrival to the target is established. In addition to the analytic guarantees, simulation studies describe the robot system state parameters during navigation in an office floor environment populated by unknown obstacles.

Journal ArticleDOI
TL;DR: In this article , an adaptive neuro-fuzzy inference system (ANFIS) is used to calculate an obstacle avoidance steering angle for a wheeled mobile robot with three ultrasonic sensors.

Journal ArticleDOI
TL;DR: In this paper , a distributed cooperative control algorithm was proposed to address the problem of collision avoidance and obstacle avoidance for multiple quadrotors during the formation tracking process, where a repulsion function based on Hooke's law with damping was proposed.
Abstract: This letter proposes a novel distributed cooperative control algorithm to address the problem of collision avoidance and obstacle avoidance for multiple quadrotors during the formation tracking process. The proposed algorithm couples collision avoidance and obstacle avoidance schemes into the control layer. To avoid collisions between quadrotors in time, a repulsion function based on Hooke’s law with damping is proposed, which fully considers the relative position and relative velocity between quadrotors. In addition, based on the obstacle avoidance behavior of pigeons, a split-merge strategy is designed for multiple quadrotors to avoid static and dynamic obstacles. The split-merge strategy is driven by the relative position between the quadrotors and the obstacles, and it can calculate the optimal velocity to keep the quadrotors away from obstacles in the field of view. Several simulations and outdoor experiments for multiple quadrotors are presented to verify the effectiveness of the theoretical results.

Journal ArticleDOI
01 Jun 2022
TL;DR: Wang et al. as discussed by the authors proposed a slice-based heuristic fast marching tree based on joint space to achieve real-time path planning speed without modeling or training the workspace in advance.
Abstract: With the emergence of Industry 4.0, high productivity is critically dependent on robot manipulators. However, building an efficient and safe work environment with robot manipulators remains a challenge of hardware capability. The optimal path planning of the robot manipulator usually encounters shortcomings in low computational speed and tedious training after changing assembly lines and increases the risk during human–robot collaboration (HRC). To solve such a problem, we propose a path planning, named slice-based heuristic fast marching tree, based on joint space to achieve real-time path planning speed without modeling or training the workspace in advance. Our experimental results indicate that the time consumed for path planning in static environments is only from 0.51 s to 1.63 s, tested by a 6-DOF general-purpose industrial manipulator and different cylindrical obstacle placements. The time for path replanning in dynamic environments is from 0.62 s to 0.88 s.

Journal ArticleDOI
TL;DR: In this article , a dynamic window approach with virtual manipulators (DWV) is proposed for local path planning considering static and dynamic obstacles for a mobile robot in an environment with dynamic obstacles, the obstacle-avoidable paths which include non-straight line and non-arc paths are generated.
Abstract: Local path planning considering static and dynamic obstacles for a mobile robot is one of challenging research topics. Conventional local path planning methods generate path candidates by assuming constant velocities for a certain period time. Therefore, path candidates consist of straight line and arc paths. These path candidates are not suitable for dynamic environments and narrow spaces. This paper proposes a novel local path planning method based on dynamic window approach with virtual manipulators (DWV). DWV consists of dynamic window approach (DWA) and virtual manipulator (VM). DWA is the local path planning method that performs obstacle avoidance for static obstacles under robot constraints. DWA also generates straight line and arc path candidates by assuming constant velocities. VM generates velocities of reflective motion by using virtual manipulators and environmental information. DWV generates path candidates by variable velocities modified by VM and predicted positions of static and dynamic obstacles. Therefore, in an environment with dynamic obstacles, the obstacle-avoidable paths which include non-straight line and non-arc paths are generated. The effectiveness of the proposed method was confirmed from simulation and experimental results.

Journal ArticleDOI
01 May 2022-Sensors
TL;DR: An APF-ACO algorithm based on an improved artificial potential field algorithm and improved ant colony algorithm is proposed to solve the problem of submarine underwater global path planning and local dynamic obstacle avoidance.
Abstract: Navigating safely in complex marine environments is a challenge for submarines because proper path planning underwater is difficult. This paper decomposes the submarine path planning problem into global path planning and local dynamic obstacle avoidance. Firstly, an artificial potential field ant colony algorithm (APF-ACO) based on an improved artificial potential field algorithm and improved ant colony algorithm is proposed to solve the problem of submarine underwater global path planning. Compared with the Optimized ACO algorithm proposed based on a similar background, the APF-ACO algorithm has a faster convergence speed and better path planning results. Using an inflection point optimization algorithm greatly reduces the number and length of inflection points in the path. Using the Clothoid curve fitting algorithm to optimize the path results, a smoother and more stable path result is obtained. In addition, this paper uses a three-dimensional dynamic obstacle avoidance algorithm based on the velocity obstacle method. The experimental results show that the algorithm can help submarines to identify threatening dynamic obstacles and avoid collisions effectively. Finally, we experimented with the algorithm in the submarine underwater semi-physical simulation system, and the experimental results verified the effectiveness of the algorithm.

Journal ArticleDOI
TL;DR: The results demonstrate that predatory intent does not operate a monopoly on the fly's steering when attacking a target, and that simple guidance combinations can explain obstacle avoidance during interceptive tasks.
Abstract: ABSTRACT The miniature robber fly Holcocephala fusca intercepts its targets with behaviour that is approximated by the proportional navigation guidance law. During predatory trials, we challenged the interception of H. fusca performance by placing a large object in its potential flight path. In response, H. fusca deviated from the path predicted by pure proportional navigation, but in many cases still eventually contacted the target. We show that such flight deviations can be explained as the output of two competing navigational systems: pure-proportional navigation and a simple obstacle avoidance algorithm. Obstacle avoidance by H. fusca is here described by a simple feedback loop that uses the visual expansion of the approaching obstacle to mediate the magnitude of the turning-away response. We name the integration of this steering law with proportional navigation ‘combined guidance’. The results demonstrate that predatory intent does not operate a monopoly on the fly's steering when attacking a target, and that simple guidance combinations can explain obstacle avoidance during interceptive tasks.

Journal ArticleDOI
TL;DR: In this paper , the convergence time of an adaptive sliding mode controller applied to an autonomous vessel prototype subject to bounded perturbations is defined as a user input conditioning the controller design and tuning.

Journal ArticleDOI
TL;DR: In this article , an iron needle was controlled by a three-degree-of-freedom (3-DoF) manipulator and magnetized by precessing magnetic fields.
Abstract: A dynamic self-assembly is a promising approach for inducing the collective behavior of agents to perform coordinated tasks at small scales. However, efficient pattern formation and navigation in environments with complex conditions remain a challenge. In this article, we propose a strategy for micromanipulation using dynamically self-assembled magnetic droplets with needle guidance. An iron needle was controlled by a three-degree-of-freedom (3-DoF) manipulator and magnetized by precessing magnetic fields. The process of self-assembly was optimized based on real-time vision feedback and a genetic algorithm. Affected by the locally induced field gradient near the needle, reconfigurable assembled magnetic droplets were formed beneath the air-liquid interface with high time efficiency, and the geometric center of the pattern was determined. Following the magnetized needle, assembled patterns were navigated along preplanned paths and exhibited reversible pattern expansion and shrinkage. Moreover, cargo can be trapped and caged by exploiting the induced fluid flow around the assembled droplets. To perform cargo transportation tasks in a multiple-obstacle environment, an optimal path planner with obstacle-avoidance capability was designed based on the particle swarm optimization (PSO) algorithm. Experiments demonstrated effective pattern formation, navigation, cargo trapping, and obstacle-avoidance transportation. The proposed method opens new prospects of using a dynamically self-assembled pattern as an untethered end-effector for micromanipulation. Note to Practitioners —This article was motivated by the recent interest in utilizing the collective behavior of small-scale active agents to perform micromanipulation tasks. Driven by external magnetic fields, building blocks are gathered and assembled, yielding a dynamically stable pattern. To perform practical tasks, efficient pattern formation, control, and navigation are required. Besides, obstacles often exist in the working environment, challenging pattern navigation, and manipulation tasks. The strategy presented here is developed for micromanipulation using dynamically self-assembled magnetic droplets with needle guidance. The three-axis Helmholtz coil system is applied to rotate the droplets and magnetize the iron needle. Algorithms are designed to guide and optimize the pattern formation, navigation, and cargo trapping process. Magnetic droplets are real-time tracked, and ordered assembled patterns are formed in an optimized way. Following the needle, the pattern was navigated and performed cargo manipulation tasks with obstacle-avoidance capability. Experimental results have validated the proposed strategy in pattern formation, navigation, and cargo manipulation in a multiple-obstacle environment.