Open AccessProceedings Article
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
Charles R. Qi,Li Yi,Hao Su,Leonidas J. Guibas +3 more
- Vol. 30, pp 5099-5108
Reads0
Chats0
TLDR
PointNet++ as discussed by the authors applies PointNet recursively on a nested partitioning of the input point set to learn local features with increasing contextual scales, and proposes novel set learning layers to adaptively combine features from multiple scales.Abstract:
Few prior works study deep learning on point sets. PointNet is a pioneer in this direction. However, by design PointNet does not capture local structures induced by the metric space points live in, limiting its ability to recognize fine-grained patterns and generalizability to complex scenes. In this work, we introduce a hierarchical neural network that applies PointNet recursively on a nested partitioning of the input point set. By exploiting metric space distances, our network is able to learn local features with increasing contextual scales. With further observation that point sets are usually sampled with varying densities, which results in greatly decreased performance for networks trained on uniform densities, we propose novel set learning layers to adaptively combine features from multiple scales. Experiments show that our network called PointNet++ is able to learn deep point set features efficiently and robustly. In particular, results significantly better than state-of-the-art have been obtained on challenging benchmarks of 3D point clouds.read more
Citations
More filters
Posted Content
JSNet: Joint Instance and Semantic Segmentation of 3D Point Clouds
Lin Zhao,Wenbing Tao +1 more
TL;DR: Wang et al. as mentioned in this paper proposed a joint instance and semantic segmentation approach, which is called JSNet, in order to address the instance and semantic segmentation of 3D point clouds simultaneously, and evaluated the proposed JSNet on a large-scale 3D indoor point cloud dataset S3DIS and a part dataset ShapeNet.
Posted Content
Deep AutoEncoder-based Lossy Geometry Compression for Point Clouds.
TL;DR: This paper proposes the first autoencoder-based geometry compression codec that directly takes point clouds as input rather than voxel grids or collections of images, and shows that the proposed method outperforms the test model for categories 1 and 3 published by MPEG-3DG group on the 125th meeting.
Posted Content
Deep Learning for 3D Point Clouds: A Survey
TL;DR: Wang et al. as mentioned in this paper presented a comprehensive review of recent progress in deep learning methods for point clouds, including 3D shape classification, 3D object detection and tracking, and 3D point cloud segmentation.
Posted Content
What You See is What You Get: Exploiting Visibility for 3D Object Detection
TL;DR: A simple approach to augmenting voxel-based networks with visibility by adding an additional stream for visibility input is described, which can significantly improve the overall detection accuracy of a state-of-the-art 3D detector.
Journal ArticleDOI
A comprehensive survey of LIDAR-based 3D object detection methods with deep learning for autonomous driving
TL;DR: A comprehensive survey of LIDAR-based 3D object detection methods is presented wherein an analysis of existing methods is addressed by taking into account a new categorisation that relies upon a common operational pipeline which describes the end-to-end functionality of each method.