Robust visual-inertial localization with weak GPS priors for repetitive UAV flights
Julian Surber,Lucas Teixeira,Margarita Chli +2 more
- pp 6300-6306
TLDR
A new system using the UAV's onboard visual-inertial sensor suite to first build a Reference Map of the Uav's workspace during a piloted reconnaissance flight is proposed, shown to outperform GPS localization significantly and diminishes drift effects via global image-based alignment for consistently robust performance.Abstract:
Agile robots, such as small Unmanned Aerial Vehicles (UAVs) can have a great impact on the automation of tasks, such as industrial inspection and maintenance or crop monitoring and fertilization in agriculture. Their deploy-ability, however, relies on the UAV's ability to self-localize with precision and exhibit robustness to common sources of uncertainty in real missions. Here, we propose a new system using the UAV's onboard visual-inertial sensor suite to first build a Reference Map of the UAV's workspace during a piloted reconnaissance flight. In subsequent flights over this area, the proposed framework combines keyframe-based visual-inertial odometry with novel geometric image-based localization, to provide a real-time estimate of the UAV's pose with respect to the Reference Map paving the way towards completely automating repeated navigation in this workspace. The stability of the system is ensured by decoupling the local visual-inertial odometry from the global registration to the Reference Map, while GPS feeds are used as a weak prior for suggesting loop closures. The proposed framework is shown to outperform GPS localization significantly and diminishes drift effects via global image-based alignment for consistently robust performance.read more
Citations
More filters
Journal ArticleDOI
CoHOG: A Light-Weight, Compute-Efficient, and Training-Free Visual Place Recognition Technique for Changing Environments
TL;DR: This letter presents a novel, compute-efficient and training-free approach based on Histogram- of-Oriented-Gradients (HOG) descriptor for achieving state-of-the-art performance-per-compute-unit in Visual Place Recognition (VPR).
Proceedings ArticleDOI
GOMSF: Graph-Optimization Based Multi-Sensor Fusion for robust UAV Pose estimation
TL;DR: A decoupled Graph-Optimization based Multi-Sensor Fusion approach (GOMSF) that combines generic 6 Degree-of-Freedom (DoF) visual-inertial odometry poses and 3 DoF globally referenced positions to infer the global 6 DoF pose of the robot in real-time is proposed.
Proceedings ArticleDOI
The Urban Last Mile Problem: Autonomous Drone Delivery to Your Balcony
TL;DR: This paper builds a prototype system that is able to fly to the approximate delivery location using GPS and then find the exact drop-off location using visual navigation, and test the system components in simulated environments, including the visual navigation and collision avoidance.
Journal ArticleDOI
There's No Place Like Home: Visual Teach and Repeat for Emergency Return of Multirotor UAVs During GPS Failure
Michael Warren,Melissa Greeff,Bhavit Patel,Jack Collier,Angela P. Schoellig,Timothy D. Barfoot +5 more
TL;DR: This letter presents a vision-based route-following system for the autonomous, safe return of UAVs under primary navigation failure such as GPS jamming, and examines the performance of the visual localization algorithm under a variety of conditions.
Journal ArticleDOI
Persistent Stereo Visual Localization on Cross-Modal Invariant Map
TL;DR: A stereo camera based visual localization method using a modified laser map, which takes the advantage of both the low cost of camera, and high geometric precision of laser data to achieve long-term performance is proposed.
References
More filters
Proceedings ArticleDOI
Parallel Tracking and Mapping for Small AR Workspaces
Georg Klein,David W. Murray +1 more
TL;DR: A system specifically designed to track a hand-held camera in a small AR workspace, processed in parallel threads on a dual-core computer, that produces detailed maps with thousands of landmarks which can be tracked at frame-rate with accuracy and robustness rivalling that of state-of-the-art model-based systems.
Proceedings ArticleDOI
BRISK: Binary Robust invariant scalable keypoints
TL;DR: A comprehensive evaluation on benchmark datasets reveals BRISK's adaptive, high quality performance as in state-of-the-art algorithms, albeit at a dramatically lower computational cost (an order of magnitude faster than SURF in cases).
Proceedings ArticleDOI
DTAM: Dense tracking and mapping in real-time
TL;DR: It is demonstrated that a dense model permits superior tracking performance under rapid motion compared to a state of the art method using features; and the additional usefulness of the dense model for real-time scene interaction in a physics-enhanced augmented reality application is shown.
Journal ArticleDOI
Keyframe-based visual-inertial odometry using nonlinear optimization
TL;DR: This work forms a rigorously probabilistic cost function that combines reprojection errors of landmarks and inertial terms and compares the performance to an implementation of a state-of-the-art stochastic cloning sliding-window filter.