Open AccessProceedings Article
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
Charles R. Qi,Li Yi,Hao Su,Leonidas J. Guibas +3 more
- Vol. 30, pp 5099-5108
Reads0
Chats0
TLDR
PointNet++ as discussed by the authors applies PointNet recursively on a nested partitioning of the input point set to learn local features with increasing contextual scales, and proposes novel set learning layers to adaptively combine features from multiple scales.Abstract:
Few prior works study deep learning on point sets. PointNet is a pioneer in this direction. However, by design PointNet does not capture local structures induced by the metric space points live in, limiting its ability to recognize fine-grained patterns and generalizability to complex scenes. In this work, we introduce a hierarchical neural network that applies PointNet recursively on a nested partitioning of the input point set. By exploiting metric space distances, our network is able to learn local features with increasing contextual scales. With further observation that point sets are usually sampled with varying densities, which results in greatly decreased performance for networks trained on uniform densities, we propose novel set learning layers to adaptively combine features from multiple scales. Experiments show that our network called PointNet++ is able to learn deep point set features efficiently and robustly. In particular, results significantly better than state-of-the-art have been obtained on challenging benchmarks of 3D point clouds.read more
Citations
More filters
Posted Content
JSIS3D: Joint Semantic-Instance Segmentation of 3D Point Clouds with Multi-Task Pointwise Networks and Multi-Value Conditional Random Fields
TL;DR: A multi-task pointwise network that simultaneously performs two tasks: predicting the semantic classes of 3D points and embedding the points into high-dimensional vectors so that points of the same object instance are represented by similar embeddings.
Proceedings ArticleDOI
Semantic Classification of 3D Point Clouds with Multiscale Spherical Neighborhoods
TL;DR: In this article, a new definition of multiscale neighborhoods in 3D point clouds is introduced, based on spherical neighborhoods and proportional subsampling, allowing the computation of features with a consistent geometrical meaning, which is not the case when using k-nearest neighbors.
Book ChapterDOI
Image2Mesh: A learning framework for single image 3D reconstruction
Jhony Kaesemodel Pontes,Chen Kong,Sridha Sridharan,Simon Lucey,Anders Eriksson,Clinton Fookes +5 more
TL;DR: In this article, a simple and lightweight learning framework is developed to reconstruct high-quality 3D meshes from a single image by using a compact representation that encodes a mesh using free-form deformation and sparse linear combination in a small dictionary of 3D models.
Journal ArticleDOI
P2P-NET: bidirectional point displacement net for shape transform
TL;DR: P2P-NET as discussed by the authors learns geometric transformations between point-based shape representations from two domains, e.g., meso-skeletons and surfaces, partial and complete scans, etc.
Posted Content
Neural Radiance Flow for 4D View Synthesis and Video Processing
TL;DR: This work uses a neural implicit representation that learns to capture the 3D occupancy, radiance, and dynamics of the scene, and demonstrates that the learned representation can serve as an implicit scene prior, enabling video processing tasks such as image super-resolution and de-noising without any additional supervision.