Plane segmentation is a basic task in the automatic reconstruction of indoor and urban environments from unorganized point clouds acquired by laser scanners. As one of the most common plane-segmentation methods, standard Random Sample Consensus (RANSAC) is often used to continually detect planes one after another. However, it suffers from the spurious-plane problem when noise and outliers exist due to the uncertainty of randomly sampling the minimum subset with 3 points. An improved RANSAC method based on Normal Distribution Transformation (NDT) cells is proposed in this study to avoid spurious planes for 3D point-cloud plane segmentation. A planar NDT cell is selected as a minimal sample in each iteration to ensure the correctness of sampling on the same plane surface. The 3D NDT represents the point cloud with a set of NDT cells and models the observed points with a normal distribution within each cell. The geometric appearances of NDT cells are used to classify the NDT cells into planar and non-planar cells. The proposed method is verified on three indoor scenes. The experimental results show that the correctness exceeds 88.5% and the completeness exceeds 85.0%, which indicates that the proposed method identifies more reliable and accurate planes than standard RANSAC. It also executes faster. These results validate the suitability of the method.

An Improved RANSAC for 3D Point Cloud Plane Segmentation Based on Normal Distribution Transformation Cells

This study had two main aims: (1) to provide a comprehensive review of terrestrial laser scanner (TLS) point cloud registration methods and a better understanding of their strengths and weaknesses; and (2) to provide a large-scale benchmark data set (Wuhan University TLS: Whu-TLS) to support the development of cutting-edge TLS point cloud registration methods, especially deep learning-based methods. In particular, we first conducted a thorough review of TLS point cloud registration methods in terms of pairwise coarse registration, pairwise fine registration, and multiview registration, as well as analyzing their strengths, weaknesses, and future research trends. We then reviewed the existing benchmark data sets (e.g., ETH Dataset and Robotic 3D Scanning Repository) for TLS point cloud registration and summarized their limitations. Finally, a new benchmark data set was assembled from 11 different environments (i.e., subway station, high-speed railway platform, mountain, forest, park, campus, residence, riverbank, heritage building, underground excavation, and tunnel environments) with variations in the point density, clutter, and occlusion. In addition, we summarized future research trends in this area, including auxiliary data-guided registration, deep learning-based registration, and multi-temporal point cloud registration.

Registration of large-scale terrestrial laser scanner point clouds: A review and benchmark

Taiwan is a highly informational country, and a robust traffic network is not only critical to the national economy, but is also an important infrastructure for economic development. This paper aims to integrate government open data and global positioning system (GPS) technology to build an instant image-based traffic assistant agent with user-friendly interfaces, thus providing more convenient real-time traffic information for users and relevant government units. The proposed system is expected to overcome the difficulty of accurately distinguishing traffic information and to solve the problem of some road sections not providing instant information. Taking the New Taipei City Government traffic open data as an example, the proposed system can display information pages at an optimal size on smartphones and other computer devices, and integrate database analysis to instantly view traffic information. Users can enter the system without downloading the application and can access the cross-platform services using device browsers. The proposed system also provides a user reporting mechanism, which informs vehicle drivers on congested road sections about road conditions. Comparison and analysis of the system with similar applications shows that although they have similar functions, the proposed system offers more practicability, better information accessibility, excellent user experience, and approximately the optimal balance (a kind of symmetry) of the important items of the interface design.

/pdf/a-balance-interface-design-and-instant-image-based-traffic-4r9j76igie.pdf

A Balance Interface Design and Instant Image-based Traffic Assistant Agent Based on GPS and Linked Open Data Technology

Three-dimensional (3-D) urban models are an integral part of numerous applications, such as urban planning and performance simulation, mapping and visualization, emergency response training and entertainment, among others. We consolidate various algorithms proposed for reconstructing 3-D models of urban objects from point clouds. Urban models addressed in this review include buildings, vegetation, utilities such as roads or power lines and free-form architectures such as curved buildings or statues, all of which are ubiquitous in a typical urban scenario. While urban modeling, building reconstruction, in particular, clearly demand specific traits in the models, such as regularity, symmetry, and repetition; most of the traditional and state-of-the-art 3-D reconstruction algorithms are designed to address very generic objects of arbitrary shapes and topology. The recent efforts in the urban reconstruction arena, however, strive to accommodate the various pressing needs of urban modeling. Strategically, urban modeling research nowadays focuses on the usage of specialized priors, such as global regularity, Manhattan-geometry or symmetry to aid the reconstruction, or efficient adaptation of existing reconstruction techniques to the urban modeling pipeline. Aimed at an in-depth exploration of further possibilities, we review the existing urban reconstruction algorithms, prevalent in computer graphics, computer vision and photogrammetry disciplines, evaluate their performance in the architectural modeling context, and discuss the adaptability of generic mesh reconstruction techniques to the urban modeling pipeline. In the end, we suggest a few directions of research that may be adopted to close in the technology gaps.

LiDAR Point Clouds to 3-D Urban Models$:$ A Review

Mobile Laser Scanning (MLS) is a versatile remote sensing technology based on Light Detection and Ranging (lidar) technology that has been utilized for a wide range of applications. Several previous reviews focused on applications or characteristics of these systems exist in the literature, however, reviews of the many innovative data processing strategies described in the literature have not been conducted in sufficient depth. To this end, we review and summarize the state of the art for MLS data processing approaches, including feature extraction, segmentation, object recognition, and classification. In this review, we first discuss the impact of the scene type to the development of an MLS data processing method. Then, where appropriate, we describe relevant generalized algorithms for feature extraction and segmentation that are applicable to and implemented in many processing approaches. The methods for object recognition and point cloud classification are further reviewed including both the general concepts as well as technical details. In addition, available benchmark datasets for object recognition and classification are summarized. Further, the current limitations and challenges that a significant portion of point cloud processing techniques face are discussed. This review concludes with our future outlook of the trends and opportunities of MLS data processing algorithms and applications.

Object Recognition, Segmentation, and Classification of Mobile Laser Scanning Point Clouds: A State of the Art Review.

The integration of multi-platform, multi-angle, and multi-temporal LiDAR data has become important for geospatial data applications. This paper presents a comprehensive review of LiDAR data registration in the fields of photogrammetry and remote sensing. At present, a coarse-to-fine registration strategy is commonly used for LiDAR point clouds registration. The coarse registration method is first used to achieve a good initial position, based on which registration is then refined utilizing the fine registration method. According to the coarse-to-fine framework, this paper reviews current registration methods and their methodologies, and identifies important differences between them. The lack of standard data and unified evaluation systems is identified as a factor limiting objective comparison of different methods. The paper also describes the most commonly-used point cloud registration error analysis methods. Finally, avenues for future work on LiDAR data registration in terms of applications, data, and technology are discussed. In particular, there is a need to address registration of multi-angle and multi-scale data from various newly available types of LiDAR hardware, which will play an important role in diverse applications such as forest resource surveys, urban energy use, cultural heritage protection, and unmanned vehicles.

Registration of Laser Scanning Point Clouds: A Review

Terrestrial laser scanning (TLS) and mobile laser scanning (MLS) data can be used to obtain abundant and precise side information of trees. Therefore, it can enable extracting individual tree parameters, such as the tree height, crown size, crown base height, and diameter at breast height, and it can provide basic data for forest research and management. This study proposes a technical framework for segmenting individual trees from TLS and MLS data. This framework contains six steps: 1) data preprocessing, 2) octree construction, 3) spatial clustering, 4) stem detection, 5) initial segmentation, and 6) overlapped canopy segmentation. This framework makes two main contributions: 1) a top-down hierarchical segmentation approach, including connectivity-based spatial clustering (regional scale), stem-based initial segmentation (individual tree scale), and fine segmentation of overlapped canopy (canopy scale), is proposed to reduce technical difficulties and improve process efficiency; and 2) a modified node similarity calculation for normalized cut method aiming at segmenting overlapped canopy, which can effectively separate neighboring trees even if their canopies are overlapped, is proposed. The proposed framework was tested on a leaves-off terrestrial LiDAR dataset and a leaves-on mobile LiDAR dataset. For terrestrial LiDAR data, our framework achieved completeness of 92.4%, correctness of 95.4%, and F-score of 0.94. For mobile LiDAR data, the corresponding values were 94.0%, 93.7%, and 0.94.

Segmentation of Individual Trees From TLS and MLS Data

Accessibility based on Gravity-Radiation model and Google Maps API: A case study in Australia

Farmland is a fundamental resource for human survival and development. However, farmland fragmentation has become a serious problem, causing ecological damage and low crop production efficiency in many parts of the world. Based on remote sensing and socioeconomic data, we used landscape pattern indices, Morphological Spatial Pattern Analysis (MSPA), and Markov chain models to analyze the temporal and spatial pattern changes in farmland in South Jiangsu Province (the first "Modernization Demonstration Zone" in China) during 1985-2010. Our results demonstrated that the total farmland area decreased by ca. 24% and the farmland pattern became fragmented during 1985-2008: core farmland decreased and islet farmland increased. Additionally, the farmland patch density (PD) increased and three other landscape indices (NLSI, MESH, and COHESION) showed significant decreases. Although the fragmentation rate slowed after 2008, the convergence rate to a stationary farmland distribution became faster, and transitions tended to be less deterministic after 2000. Economic and population growth and policy changes positively contributed to this phenomenon. Therefore, the primary task of farmland protection should be to preserve contiguous farmlands and reduce scattered patches in order to promote farmland connectivity.

/pdf/analysis-of-farmland-fragmentation-in-china-modernization-4imyaxdt04.pdf

Analysis of farmland fragmentation in China Modernization Demonstration Zone since “Reform and Openness”: a case study of South Jiangsu Province

Change detection is a major issue for urban area monitoring. In this paper, a new three-step point-based method for detecting changes to buildings and trees using airborne light detection and ranging (LiDAR) data is proposed. First, the airborne LiDAR data from two dates are accurately registered using the iterative closest point algorithm, and a progressive triangulated irregular network densification filtering algorithm is used to separate ground points from non-ground points. Second, an octree is generated from the non-ground points to store and index the irregularly-distributed LiDAR points. Finally, by comparing the LiDAR points from two dates and using the AutoClust algorithm, those areas of buildings and trees in the urban environment that have changed are determined effectively and efficiently. The key contributions of this approach are the development of a point-based method to effectively solve the problem of objects at different scales, and the establishment of rules to detect changes in buildings and trees to urban areas, enabling the use of the point-based method over large areas. To evaluate the proposed method, a series of experiments using aerial images are conducted. The results demonstrate that satisfactory performance can be obtained using the proposed approach.

Manchun Li

Papers

Registration of Laser Scanning Point Clouds: A Review

Segmentation of Individual Trees From TLS and MLS Data

Accessibility based on Gravity-Radiation model and Google Maps API: A case study in Australia

Analysis of farmland fragmentation in China Modernization Demonstration Zone since “Reform and Openness”: a case study of South Jiangsu Province

Using Octrees to Detect Changes to Buildings and Trees in the Urban Environment from Airborne LiDAR Data