Unified Deep Supervised Domain Adaptation and Generalization
Saeid Motiian,Marco Piccirilli,Donald A. Adjeroh,Gianfranco Doretto +3 more
- pp 5716-5726
Reads0
Chats0
TLDR
This work provides a unified framework for addressing the problem of visual supervised domain adaptation and generalization with deep models by reverting to point-wise surrogates of distribution distances and similarities by exploiting the Siamese architecture.Abstract:
This work provides a unified framework for addressing the problem of visual supervised domain adaptation and generalization with deep models. The main idea is to exploit the Siamese architecture to learn an embedding subspace that is discriminative, and where mapped visual domains are semantically aligned and yet maximally separated. The supervised setting becomes attractive especially when only few target data samples need to be labeled. In this scenario, alignment and separation of semantic probability distributions is difficult because of the lack of data. We found that by reverting to point-wise surrogates of distribution distances and similarities provides an effective solution. In addition, the approach has a high “speed” of adaptation, which requires an extremely low number of labeled target training samples, even one per category can be effective. The approach is extended to domain generalization. For both applications the experiments show very promising results.read more
Citations
More filters
Journal Article
Domain Generalization via Frequency-based Feature Disentanglement and Interaction
TL;DR:
Proceedings ArticleDOI
BoosterNet: Improving Domain Generalization of Deep Neural Nets using Culpability-Ranked Features
TL;DR: BoosterNet as mentioned in this paper proposes a lean add-on network that can be simply added to any arbitrary core network to improve its generalization capability without requiring any changes in its architecture or training procedure.
Journal ArticleDOI
Out-of-Domain Generalization From a Single Source: An Uncertainty Quantification Approach
TL;DR: In this paper , a meta-learning based adversarial domain augmentation method is proposed to solve the problem of out-of-domain generalization, where adversarial training is used to create "fictitious" yet "challenging" populations from which a model can learn to generalize with theoretical guarantees.
Journal ArticleDOI
Neuron Coverage-Guided Domain Generalization
TL;DR: In this paper , the authors focus on the domain generalization task where domain knowledge is unavailable, and even worse, only samples from a single domain can be utilized during training, and they aim to improve the generalization capability by maximizing the neuron coverage of DNN with the gradient similarity regularization between the original and augmented samples.
Posted Content
Learning to see across Domains and Modalities.
TL;DR: This thesis will focus on a family of transfer learning methods applied to the task of visual object recognition, specifically image classification, and on the real life issues of robotic perception, specifically RGB-D recognition.
References
More filters
Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
Journal ArticleDOI
Gradient-based learning applied to document recognition
Yann LeCun,Léon Bottou,Léon Bottou,Yoshua Bengio,Yoshua Bengio,Yoshua Bengio,Patrick Haffner +6 more
TL;DR: In this article, a graph transformer network (GTN) is proposed for handwritten character recognition, which can be used to synthesize a complex decision surface that can classify high-dimensional patterns, such as handwritten characters.
Journal ArticleDOI
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky,Jia Deng,Hao Su,Jonathan Krause,Sanjeev Satheesh,Sean Ma,Zhiheng Huang,Andrej Karpathy,Aditya Khosla,Michael S. Bernstein,Alexander C. Berg,Li Fei-Fei +11 more
TL;DR: The ImageNet Large Scale Visual Recognition Challenge (ILSVRC) as mentioned in this paper is a benchmark in object category classification and detection on hundreds of object categories and millions of images, which has been run annually from 2010 to present, attracting participation from more than fifty institutions.
Journal Article
Visualizing Data using t-SNE
TL;DR: A new technique called t-SNE that visualizes high-dimensional data by giving each datapoint a location in a two or three-dimensional map, a variation of Stochastic Neighbor Embedding that is much easier to optimize, and produces significantly better visualizations by reducing the tendency to crowd points together in the center of the map.
Journal ArticleDOI
The Pascal Visual Object Classes (VOC) Challenge
TL;DR: The state-of-the-art in evaluated methods for both classification and detection are reviewed, whether the methods are statistically different, what they are learning from the images, and what the methods find easy or confuse.