Open AccessProceedings Article
Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization.
Xun Huang,Serge Belongie +1 more
Reads0
Chats0
TLDR
In this article, adaptive instance normalization (AdaIN) is proposed to align the mean and variance of the content features with those of the style features, which enables arbitrary style transfer in real-time.Abstract:
Gatys et al. recently introduced a neural algorithm that renders a content image in the style of another image, achieving so-called style transfer. However, their framework requires a slow iterative optimization process, which limits its practical application. Fast approximations with feed-forward neural networks have been proposed to speed up neural style transfer. Unfortunately, the speed improvement comes at a cost: the network is usually tied to a fixed set of styles and cannot adapt to arbitrary new styles. In this paper, we present a simple yet effective approach that for the first time enables arbitrary style transfer in real-time. At the heart of our method is a novel adaptive instance normalization (AdaIN) layer that aligns the mean and variance of the content features with those of the style features. Our method achieves speed comparable to the fastest existing approach, without the restriction to a pre-defined set of styles. In addition, our approach allows flexible user controls such as content-style trade-off, style interpolation, color & spatial controls, all using a single feed-forward neural network.read more
Citations
More filters
Posted Content
Self-Supervised Viewpoint Learning From Image Collections
Siva Karthik Mustikovela,Varun Jampani,Shalini De Mello,Sifei Liu,Umar Iqbal,Carsten Rother,Jan Kautz +6 more
TL;DR: This work proposes a novel learning framework which incorporates an analysis-by-synthesis paradigm to reconstruct images in a viewpoint aware manner with a generative network, along with symmetry and adversarial constraints to successfully supervise the authors' viewpoint estimation network.
Posted Content
Dual Gaussian-based Variational Subspace Disentanglement for Visible-Infrared Person Re-Identification
TL;DR: A carefully designed dual Gaussian-based variational auto-encoder (DG-VAE), which disentangles an identity-discriminable and an Identity-ambiguous cross-modality feature subspace, following a mixture-of-Gaussians (MoG) prior and a standard Gaussian distribution prior, respectively.
Book ChapterDOI
Long-Term Cloth-Changing Person Re-identification
Xuelin Qian,Wenxuan Wang,Li Zhang,Fangrui Zhu,Yanwei Fu,Tao Xiang,Yu-Gang Jiang,Xiangyang Xue +7 more
TL;DR: Li et al. as discussed by the authors proposed a Long-Term Cloth-Changing (LTCC) Re-ID (Perosn_ReID) dataset, which contains people captured over a long period of time with frequent clothing changes.
Journal ArticleDOI
MVSNet++: Learning Depth-Based Attention Pyramid Features for Multi-View Stereo
TL;DR: This work proposes MVSNet++, an end-to-end trainable network for dense depth estimation and designs three loss functions and integrate Curriculum Learning framework into the training process, which can lead to an accurate reconstruction of 3D model reconstruction.
Posted Content
CalliGAN: Style and Structure-aware Chinese Calligraphy Character Generator.
TL;DR: This work proposes a novel method of generating high-quality Chinese calligraphy characters over state-of-the-art methods measured through numerical evaluations and human subject studies by incorporating Chinese characters' component information into its model.
References
More filters
Proceedings Article
Adam: A Method for Stochastic Optimization
Diederik P. Kingma,Jimmy Ba +1 more
TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
Journal ArticleDOI
Generative Adversarial Nets
Ian Goodfellow,Jean Pouget-Abadie,Mehdi Mirza,Bing Xu,David Warde-Farley,Sherjil Ozair,Aaron Courville,Yoshua Bengio +7 more
TL;DR: A new framework for estimating generative models via an adversarial process, in which two models are simultaneously train: a generative model G that captures the data distribution and a discriminative model D that estimates the probability that a sample came from the training data rather than G.
Proceedings Article
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Sergey Ioffe,Christian Szegedy +1 more
TL;DR: Applied to a state-of-the-art image classification model, Batch Normalization achieves the same accuracy with 14 times fewer training steps, and beats the original model by a significant margin.
Book ChapterDOI
Microsoft COCO: Common Objects in Context
Tsung-Yi Lin,Michael Maire,Serge Belongie,James Hays,Pietro Perona,Deva Ramanan,Piotr Dollár,C. Lawrence Zitnick +7 more
TL;DR: A new dataset with the goal of advancing the state-of-the-art in object recognition by placing the question of object recognition in the context of the broader question of scene understanding by gathering images of complex everyday scenes containing common objects in their natural context.