Recent trends in cultural heritage 3D survey: The photogrammetric computer vision approach

Access to complex reality-based 3d models using virtual reality solutions

In recent years, many studies revealed the advantages of using airborne oblique images for obtaining improved 3D city models (e.g. including facades and building footprints). Expensive airborne cameras, installed on traditional aerial platforms, usually acquired the data. The purpose of this paper is to evaluate the possibility of acquire and use oblique images for the 3D reconstruction of a historical building, obtained by UAV (Unmanned Aerial Vehicle) and traditional COTS (Commercial Off-the-Shelf) digital cameras (more compact and lighter than generally used devices), for the realization of high-level-of-detail architectural survey. The critical issues of the acquisitions from a common UAV (flight planning strategies, ground control points, check points distribution and measurement, etc.) are described. Another important considered aspect was the evaluation of the possibility to use such systems as low cost methods for obtaining complete information from an aerial point of view in case of emergency problems or, as in the present paper, in the cultural heritage application field. The data processing was realized using SfM-based approach for point cloud generation: different dense image-matching algorithms implemented in some commercial and open source software were tested. The achieved results are analysed and the discrepancies from some reference LiDAR data are computed for a final evaluation. The system was tested on the S. Maria Chapel, a part of the Novalesa Abbey (Italy).

/pdf/uav-photogrammetry-with-oblique-images-first-analysis-on-1mv2xznndl.pdf

Uav photogrammetry with oblique images: first analysis on data acquisition and processing

In the context of precision viticulture, remote sensing in the optical domain offers a potential way to map crop structure characteristics, such as vegetation cover fraction, row orientation or leaf area index, that are later used in decision support tools. A method based on the RGB color model imagery acquired with an unmanned aerial vehicle (UAV) is proposed to describe the vineyard 3D macro-structure. The dense point cloud is first extracted from the overlapping RGB images acquired over the vineyard using the Structure from Motion algorithm implemented in the Agisoft PhotoScan software. Then, the terrain altitude extracted from the dense point cloud is used to get the 2D distribution of height of the vineyard. By applying a threshold on the height, the rows are separated from the row spacing. Row height, width and spacing are then estimated as well as the vineyard cover fraction and the percentage of missing segments along the rows. Results are compared with ground measurements with root mean square error (RMSE) = 9.8 cm for row height, RMSE = 8.7 cm for row width and RMSE = 7 cm for row spacing. The row width, cover fraction, as well as the percentage of missing row segments, appear to be sensitive to the quality of the dense point cloud. Optimal flight configuration and camera setting are therefore mandatory to access these characteristics with a good accuracy.

https://hal.archives-ouvertes.fr/hal-01454675/document

Using 3D Point Clouds Derived from UAV RGB Imagery to Describe Vineyard 3D Macro-Structure

/pdf/documentation-of-heritage-buildings-using-close-range-uav-1vmr31qfbq.pdf

Documentation of heritage buildings using close‐range UAV images: dense matching issues, comparison and case studies

. 3D detailed models derived from digital survey techniques have increasingly developed and focused in many field of application. The high detailed content and accuracy of such models make them so attractive and usable for large sets of purposes in Cultural Heritage. The present paper focuses on one of the main techniques used nowadays for Cultural Heritage survey and documentation: the image matching approach or Structure from Motion (SfM) technique. According to the low cost nature and the rich content of derivable information, these techniques are extremely strategic in poor available resources sectors such as Cultural Heritage documentation. After an overview of the employed algorithms and used approaches of SfM computer vision based techniques, the paper is focused in a critical analysis of the strategy used by two common employed software: the commercial suite Agisoft Photoscan and the open source tool MicMac realized by IGN France. The experimental section is focused on the description of applied tests (from RPAS data to terrestrial acquisitions), purposed to compare different solutions in various featured study cases. Finally, the accuracy assessment of the achieved products is compared and analyzed according to the strategy employed by the studied software.

/pdf/sfm-for-orthophoto-to-generation-a-winning-approach-for-53sas31gva.pdf

SfM for Orthophoto to Generation: A Winning Approach for Cultural Heritage Knowledge

. Recognizing the various advantages offered by 3D new metric survey technologies in the Cultural Heritage documentation phase, this paper presents some tests of 3D model generation, using different methods, and their possible fusion. With the aim to define potentialities and problems deriving from integration or fusion of metric data acquired with different survey techniques, the elected test case is an outstanding Cultural Heritage item, presenting both widespread and specific complexities connected to the conservation of historical buildings. The site is the Staffarda Abbey, the most relevant evidence of medieval architecture in Piedmont. This application faced one of the most topical architectural issues consisting in the opportunity to study and analyze an object as a whole, from twice location of acquisition sensors, both the terrestrial and the aerial one. In particular, the work consists in the evaluation of chances deriving from a simple union or from the fusion of different 3D cloudmodels of the abbey, achieved by multi-sensor techniques. The aerial survey is based on a photogrammetric RPAS (Remotely piloted aircraft system) flight while the terrestrial acquisition have been fulfilled by laser scanning survey. Both techniques allowed to extract and process different point clouds and to generate consequent 3D continuous models which are characterized by different scale, that is to say different resolutions and diverse contents of details and precisions. Starting from these models, the proposed process, applied to a sample area of the building, aimed to test the generation of a unique 3Dmodel thorough a fusion of different sensor point clouds. Surely, the describing potential and the metric and thematic gains feasible by the final model exceeded those offered by the two detached models.

/pdf/fusion-of-3d-models-derived-from-tls-and-image-based-3x9n4367i5.pdf

Fusion of 3D models derived from TLS and image-based techniques for CH enhanced documentation

. The paper presents the workflow and the results of an ultrasonic 3D investigation and a 3D survey application aimed at the assessment of the internal integrity of an ancient sculpture. The work aimed at highlighting the ability of methods devoted to the 3D geometry acquisition of small objects when applied to diagnosis performed by geophysical investigation. In particular, two methods widely applied for small objects modelling are considered and compared, the digital Photogrammetry with the Structure from Motion (SFM) technique and hand-held 3D scanners. The study concludes with the aim to enhance the final graphical representation of the tomographic results and to subject the obtained results to a quantitative analysis. The survey is applied to the Egyptian naophorous statue of Amenmes and Reshpu, which dates to the reign of Ramses II (1279-1213 BC) or later and is now preserved in the Civic Archaeological Museum in Bologna. In order to evaluate the internal persistency of fractures and visible damages, a 3D Ultrasonic Tomographic Imaging (UTI) test has been performed and a multi-sensor survey (image and range based) was conducted, in order to evaluate the locations of the source and receiver points as accurate as possible The presented test allowed to evaluate the material characteristics, its porosity and degradation state, which particularly affect the lower part of the statue. More in general, the project demonstrated how solution coming from the field of 3D modelling of Cultural Heritage allow the application of 3D ultrasonic tomography also on objects with complex shapes, in addition to the improved representation of the obtained results.

/pdf/multi-source-3d-models-supporting-ultrasonic-test-to-52ckyk2f3r.pdf

Multi-source 3d models supporting ultrasonic test to investigate an egyptian sculpture of the archaeological museum in bologna

Stratigraphic analysis, used in principle for study of archaeological excavation, has been adapted and applied to upstanding structures with the same aim to reconstruct a building's history. Stratigraphy, as well as data excavation management, has found a useful and versatile tool in geographic information systems (GISs). Such systems allow support of this kind of analysis, which is mainly related to the reconstruction of the chronological sequence, statistical analysis, and their representation. This paper examines the process that leads to the production of information and storage in a GIS, applicable for the management of the stratigraphy of an upstanding structure. This process involves data acquisition, processing, 3D modelling, 2D representation, graphical entities, and their topological relationships, determinations, and representations. We also touch on the relationship between 3D GIS and 2D GIS; even if complex 3D archives are currently achievable, from another point of view it can be also useful for carrying out a 2D workflow aiming at achieving sharable guidelines that are valuable for specialists in Cultural Heritage conservation.

Elisabetta Donadio

Papers

SfM for Orthophoto to Generation: A Winning Approach for Cultural Heritage Knowledge

Fusion of 3D models derived from TLS and image-based techniques for CH enhanced documentation

Multi-source 3d models supporting ultrasonic test to investigate an egyptian sculpture of the archaeological museum in bologna

Data collection and management for stratigraphic analysis of upstanding structures

Three-Dimensional (3D) Modelling and Optimization for Multipurpose Analysis and Representation of Ancient Statues