Fully Automatic, Omnidirectional Acquisition of Geometry and Appearance in the Context of Cultural Heritage Preservation
TL;DR: Using the world’s first full-spherical scanner, this work proposes a user-friendly reconstruction process that is specifically tailored to the needs of digitizing and representing cultural heritage artifacts, and specifically addresses the problem that invaluable or fragile artifacts may not be turned over during acquisition.
Abstract: Effective documentation and display of ancient objects is an essential task in the field of cultural heritage conservation. Digitization plays an important role in the process of creating, preserving, and accessing objects in digital space. Up to the present day, industrial scanners are used for this task, which focus mainly on the detailed reconstruction of the object’s geometry only. However, particularly important for a faithful digital presentation of the object is the appearance information—that is, a description of the used materials and how they interact with incident light. Using the world’s first full-spherical scanner, we propose a user-friendly reconstruction process that is specifically tailored to the needs of digitizing and representing cultural heritage artifacts. More precisely, our hardware specifically addresses the problem that invaluable or fragile artifacts may not be turned over during acquisition. Nevertheless, we can digitize the object completely, including its bottom. Further, by integrating appearance information into our digitization, we achieve a far more faithful digital replica with a quality comparable to a real picture of the object. But in contrast to a static picture, our representation allows one to interactively change the viewing and lighting directions freely. In addition, the results are very memory efficient, consuming only several megabytes per scanned object. In cooperation with museums and a private collector, we digitized several cultural heritage artifacts to demonstrate the feasibility of the proposed process.
Citations
More filters
Book•
01 Jan 1997
TL;DR: This book is a good overview of the most important and relevant literature regarding color appearance models and offers insight into the preferred solutions.
Abstract: Color science is a multidisciplinary field with broad applications in industries such as digital imaging, coatings and textiles, food, lighting, archiving, art, and fashion. Accurate definition and measurement of color appearance is a challenging task that directly affects color reproduction in such applications. Color Appearance Models addresses those challenges and offers insight into the preferred solutions. Extensive research on the human visual system (HVS) and color vision has been performed in the last century, and this book contains a good overview of the most important and relevant literature regarding color appearance models.
496 citations
02 Nov 2015
TL;DR: This short course sheds light on the acquisition ecosystem with three of its most important components that consist in accurate acquisition methods for geometry and reflectance as well as strategies towards an efficient acquisition pipeline to fulfill the demands of industry with respect to mass digitization of 3D contents.
Abstract: The demands for digital 3D content for numerous applications such as video games, movies, virtual prototyping, advertisement, virtual reality, augmented reality or even digital preservation of cultural heritage objects has led to a need for efficient and accurate automatic acquisition systems for both geometry and reflectance. This short course sheds light on the acquisition ecosystem with three of its most important components that consist in accurate acquisition methods for geometry and reflectance as well as strategies towards an efficient acquisition pipeline to fulfill the demands of industry with respect to mass digitization of 3D contents. In this context, this course provides a thorough overview of the standard methods for the acquisition of both geometry and reflectance of surfaces with different types of reflectance behavior ranging from diffuse over opaque to specular surfaces or even translucent and transparent surfaces. These standard acquisition techniques are - by design - only well-suited for a limited range of surface materials and, hence, not adequate if no prior information with respect to the surface reflectance behavior is available. For this reason, we also discuss recent advances towards an efficient, fully automatic acquisition in the scope of the concluding remarks.
52 citations
Cites methods from "Fully Automatic, Omnidirectional Ac..."
...The investigations in [Köhler et al. 2013; Nöll et al. 2013; Nöll et al. 2015] are based on the “OrCam” acquisition device that allows both a reconstruction of the full 3D geometry of the object and a respective SVBRDF model....
[...]
TL;DR: This bespoke AR experience harnessed the cutting-edge live-action capture technique of volumetric video to create a digital tour guide that playfully embellished the museological experience of the museum visitors.
Abstract: Cross-reality technologies are quickly establishing themselves as commonplace platforms for presenting objects of historical, scientific, artistic, and cultural interest to the public. In this space, augmented reality (AR) is notably successful in delivering cultural heritage applications, including architectural and environmental heritage reconstruction, exhibition data management and representation, storytelling, and exhibition curation. Generally, it has been observed that the nature of information delivery in applications created for narrating exhibitions tends to be informative and formal. Here we report on the assessment of a pilot scene for a prototype AR application that attempts to break this mold by employing a humorous and playful mode of communication. This bespoke AR experience harnessed the cutting-edge live-action capture technique of volumetric video to create a digital tour guide that playfully embellished the museological experience of the museum visitors. This applied research article consists of measuring, presenting, and discussing the appeal, interest, and ease of use of this ludic AR storytelling strategy mediated via AR technology in a cultural heritage context.
21 citations
TL;DR: A multimodal digitization pipeline for scenes that require scene reassembly after reconstruction of the object surfaces is contributed, which includes measurement of bidirectional reflectance distribution functions and high dynamic range imaging of the lighting environment.
Abstract: Transparent objects require acquisition modalities that are very different from the ones used for objects with more diffuse reflectance properties. Digitizing a scene where objects must be acquired with different modalities requires scene reassembly after reconstruction of the object surfaces. This reassembly of a scene that was picked apart for scanning seems unexplored. We contribute with a multimodal digitization pipeline for scenes that require this step of reassembly. Our pipeline includes measurement of bidirectional reflectance distribution functions and high dynamic range imaging of the lighting environment. This enables pixelwise comparison of photographs of the real scene with renderings of the digital version of the scene. Such quantitative evaluation is useful for verifying acquired material appearance and reconstructed surface geometry, which is an important aspect of digital content creation. It is also useful for identifying and improving issues in the different steps of the pipeline. In this work, we use it to improve reconstruction, apply analysis by synthesis to estimate optical properties, and to develop our method for scene reassembly.
12 citations
01 Jan 2017
TL;DR: This work introduces CultLab3D, a recent approach to 3D mass digitization, annotation, and archival storage by the Competence Center for Cultural Heritage Digitization at the Fraunhofer Institute for Computer Graphics Research IGD, regarded as one of the first feasible approaches worldwide to enable fast, efficient, and cost-effective 3D digitization.
Abstract: In the heritage field, the demand for fast and efficient 3D digitization technologies for historic remains is increasing. Besides, 3D has proven to be a promising approach to enable precise reconstructions of cultural heritage objects. Even though 3D technologies and postprocessing tools are widespread and approaches to semantic enrichment and storage of 3D models are just emerging, only few approaches enable mass capture and computation of 3D virtual models from zoological and archeological findings. To illustrate how future 3D mass digitization systems may look like, we introduce CultLab3D, a recent approach to 3D mass digitization, annotation, and archival storage by the Competence Center for Cultural Heritage Digitization at the Fraunhofer Institute for Computer Graphics Research IGD. CultLab3D can be regarded as one of the first feasible approaches worldwide to enable fast, efficient, and cost-effective 3D digitization. It is specifically designed to automate the entire process and thus allows to scan and archive large amounts of heritage objects for documentation and preservation in the best possible quality, taking advantage of integrated 3D visualization and annotation within regular Web browsers using technologies such as WebGl and X3D.
9 citations
References
More filters
TL;DR: This paper presents a method for extracting distinctive invariant features from images that can be used to perform reliable matching between different views of an object or scene and can robustly identify objects among clutter and occlusion while achieving near real-time performance.
Abstract: This paper presents a method for extracting distinctive invariant features from images that can be used to perform reliable matching between different views of an object or scene. The features are invariant to image scale and rotation, and are shown to provide robust matching across a substantial range of affine distortion, change in 3D viewpoint, addition of noise, and change in illumination. The features are highly distinctive, in the sense that a single feature can be correctly matched with high probability against a large database of features from many images. This paper also describes an approach to using these features for object recognition. The recognition proceeds by matching individual features to a database of features from known objects using a fast nearest-neighbor algorithm, followed by a Hough transform to identify clusters belonging to a single object, and finally performing verification through least-squares solution for consistent pose parameters. This approach to recognition can robustly identify objects among clutter and occlusion while achieving near real-time performance.
46,906 citations
TL;DR: New results are derived on the minimum number of landmarks needed to obtain a solution, and algorithms are presented for computing these minimum-landmark solutions in closed form that provide the basis for an automatic system that can solve the Location Determination Problem under difficult viewing.
Abstract: A new paradigm, Random Sample Consensus (RANSAC), for fitting a model to experimental data is introduced. RANSAC is capable of interpreting/smoothing data containing a significant percentage of gross errors, and is thus ideally suited for applications in automated image analysis where interpretation is based on the data provided by error-prone feature detectors. A major portion of this paper describes the application of RANSAC to the Location Determination Problem (LDP): Given an image depicting a set of landmarks with known locations, determine that point in space from which the image was obtained. In response to a RANSAC requirement, new results are derived on the minimum number of landmarks needed to obtain a solution, and algorithms are presented for computing these minimum-landmark solutions in closed form. These results provide the basis for an automatic system that can solve the LDP under difficult viewing
23,396 citations
"Fully Automatic, Omnidirectional Ac..." refers methods in this paper
...Using the initial intrinsics estimate, we compute the essential matrix E using RANSAC [Fischler and Bolles 1981]. We then use a factorization [Hartley and Zisserman 2003] of E to derive the initial extrinsics for the first camera pair. Then we use a midpoint triangulation to estimate the 3D positions for the 2D–2D correspondences and perform a global optimization using sparse bundle adjustment (SBA) [Lourakis and Argyros 2009]. After this, we iteratively add every view by the procedure proposed in Köhler et al. [2013]:...
[...]
Book•
01 Jan 2000TL;DR: In this article, the authors provide comprehensive background material and explain how to apply the methods and implement the algorithms directly in a unified framework, including geometric principles and how to represent objects algebraically so they can be computed and applied.
Abstract: From the Publisher:
A basic problem in computer vision is to understand the structure of a real world scene given several images of it. Recent major developments in the theory and practice of scene reconstruction are described in detail in a unified framework. The book covers the geometric principles and how to represent objects algebraically so they can be computed and applied. The authors provide comprehensive background material and explain how to apply the methods and implement the algorithms directly.
15,558 citations
01 Jan 2001
TL;DR: This book is referred to read because it is an inspiring book to give you more chance to get experiences and also thoughts and it will show the best book collections and completed collections.
Abstract: Downloading the book in this website lists can give you more advantages. It will show you the best book collections and completed collections. So many books can be found in this website. So, this is not only this multiple view geometry in computer vision. However, this book is referred to read because it is an inspiring book to give you more chance to get experiences and also thoughts. This is simple, read the soft file of the book and you get it.
14,282 citations
"Fully Automatic, Omnidirectional Ac..." refers methods in this paper
...We then use a factorization [Hartley and Zisserman 2003] of E to derive the initial extrinsics for the first camera pair....
[...]
TL;DR: In this article, the problem of least square problems with non-linear normal equations is solved by an extension of the standard method which insures improvement of the initial solution, which can also be considered an extension to Newton's method.
Abstract: The standard method for solving least squares problems which lead to non-linear normal equations depends upon a reduction of the residuals to linear form by first order Taylor approximations taken about an initial or trial solution for the parameters.2 If the usual least squares procedure, performed with these linear approximations, yields new values for the parameters which are not sufficiently close to the initial values, the neglect of second and higher order terms may invalidate the process, and may actually give rise to a larger value of the sum of the squares of the residuals than that corresponding to the initial solution. This failure of the standard method to improve the initial solution has received some notice in statistical applications of least squares3 and has been encountered rather frequently in connection with certain engineering applications involving the approximate representation of one function by another. The purpose of this article is to show how the problem may be solved by an extension of the standard method which insures improvement of the initial solution.4 The process can also be used for solving non-linear simultaneous equations, in which case it may be considered an extension of Newton's method. Let the function to be approximated be h{x, y, z, • • • ), and let the approximating function be H{oc, y, z, • • ■ ; a, j3, y, ■ • ■ ), where a, /3, 7, • ■ ■ are the unknown parameters. Then the residuals at the points, yit zit • • • ), i = 1, 2, ■ • • , n, are
11,253 citations