3D Appearance Super-Resolution With Deep Learning
Yawei Li,Vagia Tsiminaki,Radu Timofte,Marc Pollefeys,Luc Van Gool +4 more
- pp 9663-9672
Reads0
Chats0
TLDR
Wang et al. as mentioned in this paper proposed a 3D appearance super-resolution (3DASR) dataset based on the existing ETH3D [42], SyB3R [31], MiddleBury, and our Collection of 3D scenes from TUM [21], Fountain [51] and Relief [53].Abstract:
We tackle the problem of retrieving high-resolution (HR) texture maps of objects that are captured from multiple view points. In the multi-view case, model-based super-resolution (SR) methods have been recently proved to recover high quality texture maps. On the other hand, the advent of deep learning-based methods has already a significant impact on the problem of video and image SR. Yet, a deep learning-based approach to super-resolve the appearance of 3D objects is still missing. The main limitation of exploiting the power of deep learning techniques in the multi-view case is the lack of data. We introduce a 3D appearance SR (3DASR) dataset based on the existing ETH3D [42], SyB3R [31], MiddleBury, and our Collection of 3D scenes from TUM [21], Fountain [51] and Relief [53]. We provide the high- and low-resolution texture maps, the 3D geometric model, images and projection matrices. We exploit the power of 2D learning-based SR methods and design networks suitable for the 3D multi-view case. We incorporate the geometric information by introducing normal maps and further improve the learning process. Experimental results demonstrate that our proposed networks successfully incorporate the 3D geometric information and super-resolve the texture maps.read more
Citations
More filters
Journal ArticleDOI
Deep Learning for Image Super-Resolution: A Survey
TL;DR: A survey on recent advances of image super-resolution techniques using deep learning approaches in a systematic way, which can roughly group the existing studies of SR techniques into three major categories: supervised SR, unsupervised SR, and domain-specific SR.
Proceedings ArticleDOI
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression
TL;DR: This paper analyzes two popular network compression techniques, i.e. filter pruning and low-rank decomposition, in a unified sense and proposes to compress the whole network jointly instead of in a layer-wise manner.
Proceedings ArticleDOI
Learning Filter Basis for Convolutional Neural Network Compression
TL;DR: This paper tries to reduce the number of parameters of CNNs by learning a basis of the filters in convolutional layers, and validate the proposed solution for multiple CNN architectures on image classification and image super-resolution benchmarks.
Proceedings ArticleDOI
Leveraging 2D Data to Learn Textured 3D Mesh Generation
TL;DR: This work presents the first generative model of textured 3D meshes, and introduces a new generation process that guarantees no self-intersections arise, based on the physical intuition that faces should push one another out of the way as they move.
Posted Content
Unsupervised Real-world Image Super Resolution via Domain-distance Aware Training
TL;DR: This paper proposes a novel domain-distance aware super-resolution (DASR) approach for unsupervised real-world image SR and results show that DASR consistently outperforms state-of-the-art un supervised SR approaches in generating SR outputs with more realistic and natural textures.
References
More filters
Proceedings ArticleDOI
ImageNet: A large-scale hierarchical image database
TL;DR: A new database called “ImageNet” is introduced, a large-scale ontology of images built upon the backbone of the WordNet structure, much larger in scale and diversity and much more accurate than the current image datasets.
Proceedings ArticleDOI
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Christian Ledig,Lucas Theis,Ferenc Huszar,Jose Caballero,Andrew Cunningham,Alejandro Acosta,Andrew Peter Aitken,Alykhan Tejani,Johannes Totz,Zehan Wang,Wenzhe Shi +10 more
TL;DR: SRGAN as mentioned in this paper proposes a perceptual loss function which consists of an adversarial loss and a content loss, which pushes the solution to the natural image manifold using a discriminator network that is trained to differentiate between the super-resolved images and original photo-realistic images.
Proceedings ArticleDOI
A non-local algorithm for image denoising
TL;DR: A new measure, the method noise, is proposed, to evaluate and compare the performance of digital image denoising methods, and a new algorithm, the nonlocal means (NL-means), based on a nonlocal averaging of all pixels in the image is proposed.
Proceedings ArticleDOI
A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics
TL;DR: In this paper, the authors present a database containing ground truth segmentations produced by humans for images of a wide variety of natural scenes, and define an error measure which quantifies the consistency between segmentations of differing granularities.
Journal ArticleDOI
Image Super-Resolution Via Sparse Representation
TL;DR: This paper presents a new approach to single-image superresolution, based upon sparse signal representation, which generates high-resolution images that are competitive or even superior in quality to images produced by other similar SR methods.