Appearance-based segmentation of indoors/outdoors sequences of spherical views
read more
Citations
Visual Place Recognition: A Survey
Vision-based topological mapping and localization methods
Fast Hybrid Relocation in Large Scale Metric-Topologic-Semantic Map
A compact RGB-D map representation dedicated to autonomous navigation
Vision-based Assistive Indoor Localization
References
Visual Place Categorization: Problem, dataset, and algorithm
Taking Online Maps Down to Street Level
Localization in Urban Environments Using a Panoramic Gist Descriptor
Hierarchical map building using visual landmarks and geometric constraints
Autonomous Navigation of Vehicles from a Visual Memory Using a Generic Camera Model
Related Papers (5)
Dense Omnidirectional RGB-D Mapping of Large-scale Outdoor Environments for Real-time Localization and Autonomous Navigation
Frequently Asked Questions (12)
Q2. What are the future works mentioned in the paper "Appearance-based segmentation of indoors/outdoors sequences of spherical views" ?
For future work, the authors plan to improve their algorithm robustness to illumination condition following [ 6 ] and its rotation independence. De-rotation mechanism can be applied as rotations can be estimated from spectra.
Q3. What is the way to detect change-points?
The segmentation algorithm relies on an efficient change-point detection based on multi-hypothesis testing and allowing constant time computation.
Q4. What is the purpose of the algorithm?
In a longer term, the segmentation algorithm could be coupled with a loop closure detection algorithm in orderto improve change-point localization stability and with a semantic level by adding place classification and labelling.
Q5. What is the meaning of spherical harmonics?
Pml corresponds to the associated Legendre polynomials with x ∈ [−1, 1] such that:Pml (x) = (−1)m(1− x2)m/22ll!dl+mdxl+m (x2 − 1)l (3)Every function defined on the sphere surface can be decomposed in a sum of spherical harmonics as follows:f = ∑l∈N∑|m|≤lfml Y m l (4)The fml coefficients are obtained from a function f by:fml =∫η∈S2 f(η)Y ml (η)dη (5)If fml = 0 for all l > L, f is said to be band limited with a bandwidth L. The coefficients set fml is called the spherical Fourier transform or the spectrum of f .
Q6. What is the description of a place?
As descriptors are based on appearance frequencies, when the robot approaches walls, frequencies become lower and a new topological place is defined.
Q7. What is the spherical harmonics spectrum code?
the spherical harmonics spectrum code is highly parallelizable and might take great advantage of a C/C++ parallel implementation.
Q8. What is the size of the sliding window?
Considering the density function estimation constraints aforementioned, the sliding window has to be sufficiently large for a correct estimation.
Q9. What is the density function for each hypothesis?
Let’s assume the density functions under each hypothesis, i.e. f0 and f1, follow a multivariate normal distribution:f0 ∼ N (µ0,Σ0 f1 ∼ N (µ1,Σ1) (10)As each hypothesis is characteristic of one topological place, density functions characterize the structural parameters of topological places.
Q10. What is the definition of spherical harmonics?
Spherical harmonics being a frequency description of the spherical image, the authors propose to directly use the spectrum as a structure descriptor.
Q11. How long does the spherical harmonics spectrum computation take?
Spherical harmonics spectrum computation requires 290ms using the implementation described above (the sphere is sampled with 62500 samples uniformly distributed).
Q12. What is the frequency information of the spherical image?
Frequency information corresponds to band number l and orientation information to parameter m (the higher l is, the higher the frequency is, see fig.