Open AccessProceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
Reads0
Chats0
TLDR
This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.Abstract:
In this work we investigate the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting. Our main contribution is a thorough evaluation of networks of increasing depth using an architecture with very small (3x3) convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers. These findings were the basis of our ImageNet Challenge 2014 submission, where our team secured the first and the second places in the localisation and classification tracks respectively. We also show that our representations generalise well to other datasets, where they achieve state-of-the-art results. We have made our two best-performing ConvNet models publicly available to facilitate further research on the use of deep visual representations in computer vision.read more
Citations
More filters
Journal ArticleDOI
Deep Learning for Single Image Super-Resolution: A Brief Review
TL;DR: This survey reviews representative deep learning-based SISR methods and group them into two categories according to their contributions to two essential aspects of S ISR: The exploration of efficient neural network architectures for SISS and the development of effective optimization objectives for deep SISr learning.
Posted Content
Wider or Deeper: Revisiting the ResNet Model for Visual Recognition
TL;DR: This paper starts from a group of relatively shallow networks, which perform as well or even better than the current state-of-the-art models on the ImageNet classification dataset, and initialize fully convolutional networks (FCNs) using pre-trained models, and tune them for semantic image segmentation.
Proceedings ArticleDOI
A Multi-stream Bi-directional Recurrent Neural Network for Fine-Grained Action Detection
TL;DR: This paper presents a multi-stream bi-directional recurrent neural network for fine-grained action detection that significantly outperforms state-of-the-art action detection methods on both datasets.
Posted Content
Contrastive Representation Distillation
TL;DR: In contrastive learning as discussed by the authors, a student is trained to capture more information in the teacher's representation of the data than the teacher network, which can be used to transfer knowledge from one neural network to another.
Posted Content
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
TL;DR: This review introduces the history of CNN, some classic and advanced CNN models are introduced, and an overview of various convolutions is provided, including those key points making them reach state-of-the-art results.
References
More filters
Proceedings ArticleDOI
ImageNet: A large-scale hierarchical image database
TL;DR: A new database called “ImageNet” is introduced, a large-scale ontology of images built upon the backbone of the WordNet structure, much larger in scale and diversity and much more accurate than the current image datasets.
Proceedings ArticleDOI
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
TL;DR: RCNN as discussed by the authors combines CNNs with bottom-up region proposals to localize and segment objects, and when labeled training data is scarce, supervised pre-training for an auxiliary task, followed by domain-specific fine-tuning, yields a significant performance boost.
Posted Content
Fully Convolutional Networks for Semantic Segmentation
TL;DR: It is shown that convolutional networks by themselves, trained end- to-end, pixels-to-pixels, improve on the previous best result in semantic segmentation.
Journal ArticleDOI
Backpropagation applied to handwritten zip code recognition
Yann LeCun,Bernhard E. Boser,John S. Denker,D. Henderson,Richard Howard,W. Hubbard,Lawrence D. Jackel +6 more
TL;DR: This paper demonstrates how constraints from the task domain can be integrated into a backpropagation network through the architecture of the network, successfully applied to the recognition of handwritten zip code digits provided by the U.S. Postal Service.
Journal ArticleDOI
The Pascal Visual Object Classes Challenge: A Retrospective
TL;DR: A review of the Pascal Visual Object Classes challenge from 2008-2012 and an appraisal of the aspects of the challenge that worked well, and those that could be improved in future challenges.