Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras
Rui Wang,Martin Schworer,Daniel Cremers +2 more
- pp 3923-3931
TLDR
Stereo Direct Sparse Odometry (Stereo DSO) as discussed by the authors integrates constraints from static stereo into the bundle adjustment pipeline of temporal multi-view stereo to improve tracking accuracy and robustness.Abstract:
We propose Stereo Direct Sparse Odometry (Stereo DSO) as a novel method for highly accurate real-time visual odometry estimation of large-scale environments from stereo cameras. It jointly optimizes for all the model parameters within the active window, including the intrinsic/extrinsic camera parameters of all keyframes and the depth values of all selected pixels. In particular, we propose a novel approach to integrate constraints from static stereo into the bundle adjustment pipeline of temporal multi-view stereo. Real-time optimization is realized by sampling pixels uniformly from image regions with sufficient intensity gradient. Fixed-baseline stereo resolves scale drift. It also reduces the sensitivities to large optical flow and to rolling shutter effect which are known shortcomings of direct image alignment methods. Quantitative evaluation demonstrates that the proposed Stereo DSO outperforms existing state-of-the-art visual odometry methods both in terms of tracking accuracy and robustness. Moreover, our method delivers a more precise metric 3D reconstruction than previous dense/semi-dense direct approaches while providing a higher reconstruction density than feature-based methods.read more
Citations
More filters
Journal ArticleDOI
Learning vision based autonomous lateral vehicle control without supervision
TL;DR: In this article , the authors proposed a framework to mitigate these problems from merely an unlabeled sequence of images by using Model Predictive Control (MPC) to implicitly infer the steering labels and synthesized images at deviated trajectories are included in the training distribution for enhanced robustness of the neural network model.
Book ChapterDOI
E-Graph: Minimal Solution for Rigid Rotation with Extensibility Graphs
TL;DR: Zhang et al. as discussed by the authors proposed a new minimal solution to solve relative rotation estimation between two images without overlapping areas by exploiting a new graph structure, which is called Extensibility Graph (E-Graph).
Journal ArticleDOI
Monocular Visual-Inertial Odometry for Agricultural Environments
TL;DR: Zhang et al. as discussed by the authors proposed a monocular visual-inertial odometry system with modifications to the existing state-of-the-art monocular VIO system VINS-mono, which can effectively improve the localization accuracy of agriculture robots in the agricultural environment.
Proceedings ArticleDOI
Image-based Localization for Self-driving Vehicles Based on Online Network Adjustment in A Dynamic Scope
TL;DR: Li et al. as discussed by the authors proposed a solution that can accurately estimate the vehicle position and orientation, which can provide an alternative solution for camera pose estimation, which is a crucial component for self-driving vehicles.
Journal ArticleDOI
DPO: Direct Planar Odometry with Stereo Camera
Filipe C. A. Lins,Nicolas dos Santos Rosa,Valdir Grassi,Adelardo Adelino Dantas de Medeiros,Pablo Javier Alsina +4 more
TL;DR: In this article , the authors proposed a stereo plane-based direct visual odometry (VO) method, which uses planes as features in the sliding window optimization and uses a dual quaternion as pose parameterization.
References
More filters
Proceedings ArticleDOI
The Cityscapes Dataset for Semantic Urban Scene Understanding
Marius Cordts,Mohamed Omran,Sebastian Ramos,Timo Rehfeld,Markus Enzweiler,Rodrigo Benenson,Uwe Franke,Stefan Roth,Bernt Schiele +8 more
TL;DR: This work introduces Cityscapes, a benchmark suite and large-scale dataset to train and test approaches for pixel-level and instance-level semantic labeling, and exceeds previous attempts in terms of dataset size, annotation richness, scene variability, and complexity.
Journal ArticleDOI
Vision meets robotics: The KITTI dataset
TL;DR: A novel dataset captured from a VW station wagon for use in mobile robotics and autonomous driving research, using a variety of sensor modalities such as high-resolution color and grayscale stereo cameras and a high-precision GPS/IMU inertial navigation system.
Journal ArticleDOI
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
TL;DR: ORB-SLAM as discussed by the authors is a feature-based monocular SLAM system that operates in real time, in small and large indoor and outdoor environments, with a survival of the fittest strategy that selects the points and keyframes of the reconstruction.
Proceedings ArticleDOI
Parallel Tracking and Mapping for Small AR Workspaces
Georg Klein,David W. Murray +1 more
TL;DR: A system specifically designed to track a hand-held camera in a small AR workspace, processed in parallel threads on a dual-core computer, that produces detailed maps with thousands of landmarks which can be tracked at frame-rate with accuracy and robustness rivalling that of state-of-the-art model-based systems.
Journal ArticleDOI
MonoSLAM: Real-Time Single Camera SLAM
TL;DR: The first successful application of the SLAM methodology from mobile robotics to the "pure vision" domain of a single uncontrolled camera, achieving real time but drift-free performance inaccessible to structure from motion approaches is presented.