We propose to use binary strings as an efficient feature point descriptor, which we call BRIEF. We show that it is highly discriminative even when using relatively few bits and can be computed using simple intensity difference tests. Furthermore, the descriptor similarity can be evaluated using the Hamming distance, which is very efficient to compute, instead of the L2 norm as is usually done.

As a result, BRIEF is very fast both to build and to match. We compare it against SURF and U-SURF on standard benchmarks and show that it yields a similar or better recognition performance, while running in a fraction of the time required by either.

/pdf/brief-binary-robust-independent-elementary-features-3jmhn8yy0j.pdf

BRIEF: binary robust independent elementary features

Effective and efficient generation of keypoints from an image is a well-studied problem in the literature and forms the basis of numerous Computer Vision applications. Established leaders in the field are the SIFT and SURF algorithms which exhibit great performance under a variety of image transformations, with SURF in particular considered as the most computationally efficient amongst the high-performance methods to date. In this paper we propose BRISK1, a novel method for keypoint detection, description and matching. A comprehensive evaluation on benchmark datasets reveals BRISK's adaptive, high quality performance as in state-of-the-art algorithms, albeit at a dramatically lower computational cost (an order of magnitude faster than SURF in cases). The key to speed lies in the application of a novel scale-space FAST-based detector in combination with the assembly of a bit-string descriptor from intensity comparisons retrieved by dedicated sampling of each keypoint neighborhood.

/pdf/brisk-binary-robust-invariant-scalable-keypoints-3adnwt29g4.pdf

BRISK: Binary Robust invariant scalable keypoints

A large number of vision applications rely on matching keypoints across images. The last decade featured an arms-race towards faster and more robust keypoints and association algorithms: Scale Invariant Feature Transform (SIFT)[17], Speed-up Robust Feature (SURF)[4], and more recently Binary Robust Invariant Scalable Keypoints (BRISK)[I6] to name a few. These days, the deployment of vision algorithms on smart phones and embedded devices with low memory and computation complexity has even upped the ante: the goal is to make descriptors faster to compute, more compact while remaining robust to scale, rotation and noise. To best address the current requirements, we propose a novel keypoint descriptor inspired by the human visual system and more precisely the retina, coined Fast Retina Keypoint (FREAK). A cascade of binary strings is computed by efficiently comparing image intensities over a retinal sampling pattern. Our experiments show that FREAKs are in general faster to compute with lower memory load and also more robust than SIFT, SURF or BRISK. They are thus competitive alternatives to existing keypoints in particular for embedded applications.

/pdf/freak-fast-retina-keypoint-53hq67wxuq.pdf

FREAK: Fast Retina Keypoint

Learning OpenCV puts you in the middle of the rapidly expanding field of computer vision. Written by the creators of the free open source OpenCV library, this book introduces you to computer vision and demonstrates how you can quickly build applications that enable computers to "see" and make decisions based on that data.The second edition is updated to cover new features and changes in OpenCV 2.0, especially the C++ interface.Computer vision is everywherein security systems, manufacturing inspection systems, medical image analysis, Unmanned Aerial Vehicles, and more. OpenCV provides an easy-to-use computer vision framework and a comprehensive library with more than 500 functions that can run vision code in real time. Whether you want to build simple or sophisticated vision applications, Learning OpenCV is the book any developer or hobbyist needs to get started, with the help of hands-on exercises in each chapter.This book includes:A thorough introduction to OpenCV Getting input from cameras Transforming images Segmenting images and shape matching Pattern recognition, including face detection Tracking and motion in 2 and 3 dimensions 3D reconstruction from stereo vision Machine learning algorithms

Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library

Inspired by Weber's Law, this paper proposes a simple, yet very powerful and robust local descriptor, called the Weber Local Descriptor (WLD). It is based on the fact that human perception of a pattern depends not only on the change of a stimulus (such as sound, lighting) but also on the original intensity of the stimulus. Specifically, WLD consists of two components: differential excitation and orientation. The differential excitation component is a function of the ratio between two terms: One is the relative intensity differences of a current pixel against its neighbors, the other is the intensity of the current pixel. The orientation component is the gradient orientation of the current pixel. For a given image, we use the two components to construct a concatenated WLD histogram. Experimental results on the Brodatz and KTH-TIPS2-a texture databases show that WLD impressively outperforms the other widely used descriptors (e.g., Gabor and SIFT). In addition, experimental results on human face detection also show a promising performance comparable to the best known results on the MIT+CMU frontal face test set, the AR face data set, and the CMU profile test set.

/pdf/wld-a-robust-local-image-descriptor-1cbl4w5nom.pdf

WLD: A Robust Local Image Descriptor

We explore the suitability of different feature detectors for the task of image registration, and in particular for visual odometry, using two criteria: stability (persistence across viewpoint change) and accuracy (consistent localization across viewpoint change). In addition to the now-standard SIFT, SURF, FAST, and Harris detectors, we introduce a suite of scale-invariant center-surround detectors (CenSurE) that outperform the other detectors, yet have better computational characteristics than other scale-space detectors, and are capable of real-time implementation.

/pdf/censure-center-surround-extremas-for-realtime-feature-2ln7xovzjz.pdf

CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching

The challenge in the DARPA Learning Applied to Ground Robots (LAGR) project is to autonomously navigate a small robot using stereo vision as the main sensor. During this project, we demonstrated a complete autonomous system for off-road navigation in unstructured environments, using stereo vision as the main sensor. The system is very robust—we can typically give it a goal position several hundred meters away and expect it to get there. In this paper we describe the main components that comprise the system, including stereo processing, obstacle and free space interpretation, long-range perception, online terrain traversability learning, visual odometry, map registration, planning, and control. At the end of 3 years, the system we developed outperformed all nine other teams in final blind tests over previously unseen terrain. © 2008 Wiley Periodicals, Inc.

/pdf/mapping-navigation-and-learning-for-off-road-traversal-3tjc7ckjpf.pdf

Mapping, navigation, and learning for off-road traversal

We present a fast integrated approach for online segmentation of images for outdoor robots. A compact color and texture descriptor has been developed to describe local color and texture variations in an image. This descriptor is then used in a two-stage fast clustering framework using K-means to perform online segmentation of natural images. We present results of applying our descriptor for segmenting a synthetic image and compare it against other state-of-the-art descriptors. We also apply our segmentation algorithm to the task of detecting natural paths in outdoor images. The whole system has been demonstrated to work online alongside localization, 3D obstacle detection, and planning.

/pdf/fast-color-texture-segmentation-for-outdoor-robots-2rrtqw4gup.pdf

Fast color/texture segmentation for outdoor robots

The challenge in the DARPA Learning Applied to Ground Robots (L AGR) project is to autonomously navigate a small robot using stereo visio n as the main sensor. During this project, we demonstrated a complete autonomous system for off-road navigation in unstructured environments, using stereo vis ion as the main sensor. The system is very robust – we can typically give it a goal posi ti n several hundred meters away, and expect it to get there. In this paper we d escribe the main components that comprise the system, including stereo proc essing, obstacle and freespace interpretation, long-range perception, online terrain traversability learning, visual odometry, map registration, planning, and cont rol. At the end of three years, the system we developed outperformed all 9 other team s in final blind tests over previously-unseen terrain.

/pdf/mapping-navigation-and-learning-for-off-road-traversal-33jrwe20vb.pdf

Mapping, navigation, and learning for off-road traversal: Konolige et al.: Mapping, Navigation, and Learning for Off-Road Traversal

Interpreting laser data to allow autonomous robot navigation on paved as well as dirt roads using a fixed angle 2D laser scanner is a daunting task. This paper introduces an algorithm for terrain classification that fuses seven distinctly different classifiers: raw height, roughness, step size, curvature, slope, width and invalid data. These are then used to extract road borders, traversable terrain and identify obstacles. Experimental results are shown and discussed. The results were obtained using a DTU developed mobile robot, and the autonomous tests were conducted in a national park environment.

Morten Rufus Blas

Papers

CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching

Mapping, navigation, and learning for off-road traversal

Fast color/texture segmentation for outdoor robots

Mapping, navigation, and learning for off-road traversal: Konolige et al.: Mapping, Navigation, and Learning for Off-Road Traversal

Traversable terrain classification for outdoor autonomous robots using single 2D laser scans