Analysis and Importance of Deep Learning for Video Aesthetic Assessments

ImageNet Classification with Deep Convolutional Neural Networks

Abstract: We trained a large, deep convolutional neural network to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes. On the test data, we achieved top-1 and top-5 error rates of 37.5% and 17.0% which is considerably better than the previous state-of-the-art. The neural network, which has 60 million parameters and 650,000 neurons, consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully-connected layers with a final 1000-way softmax. To make training faster, we used non-saturating neurons and a very efficient GPU implementation of the convolution operation. To reduce overriding in the fully-connected layers we employed a recently-developed regularization method called "dropout" that proved to be very effective. We also entered a variant of this model in the ILSVRC-2012 competition and achieved a winning top-5 test error rate of 15.3%, compared to 26.2% achieved by the second-best entry.

ImageNet classification with deep convolutional neural networks

Abstract: We trained a large, deep convolutional neural network to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes. On the test data, we achieved top-1 and top-5 error rates of 37.5% and 17.0%, respectively, which is considerably better than the previous state-of-the-art. The neural network, which has 60 million parameters and 650,000 neurons, consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully connected layers with a final 1000-way softmax. To make training faster, we used non-saturating neurons and a very efficient GPU implementation of the convolution operation. To reduce overfitting in the fully connected layers we employed a recently developed regularization method called "dropout" that proved to be very effective. We also entered a variant of this model in the ILSVRC-2012 competition and achieved a winning top-5 test error rate of 15.3%, compared to 26.2% achieved by the second-best entry.

Multi-column deep neural networks for image classification

Abstract: Traditional methods of computer vision and machine learning cannot match human performance on tasks such as the recognition of handwritten digits or traffic signs. Our biologically plausible, wide and deep artificial neural network architectures can. Small (often minimal) receptive fields of convolutional winner-take-all neurons yield large network depth, resulting in roughly as many sparsely connected neural layers as found in mammals between retina and visual cortex. Only winner neurons are trained. Several deep neural columns become experts on inputs preprocessed in different ways; their predictions are averaged. Graphics cards allow for fast training. On the very competitive MNIST handwriting benchmark, our method is the first to achieve near-human performance. On a traffic sign recognition benchmark it outperforms humans by a factor of two. We also improve the state-of-the-art on a plethora of common image classification benchmarks.

The Hierarchical Hidden Markov Model: Analysis and Applications

Abstract: We introduce, analyze and demonstrate a recursive hierarchical generalization of the widely used hidden Markov models, which we name Hierarchical Hidden Markov Models (HHMM) Our model is motivated by the complex multi-scale structure which appears in many natural sequences, particularly in language, handwriting and speech We seek a systematic unsupervised approach to the modeling of such structures By extending the standard Baum-Welch (forward-backward) algorithm, we derive an efficient procedure for estimating the model parameters from unlabeled data We then use the trained model for automatic hierarchical parsing of observation sequences We describe two applications of our model and its parameter estimation procedure In the first application we show how to construct hierarchical models of natural English text In these models different levels of the hierarchy correspond to structures on different length scales in the text In the second application we demonstrate how HHMMs can be used to automatically identify repeated strokes that represent combination of letters in cursive handwriting

Studying aesthetics in photographic images using a computational approach

Abstract: Aesthetics, in the world of art and photography, refers to the principles of the nature and appreciation of beauty Judging beauty and other aesthetic qualities of photographs is a highly subjective task Hence, there is no unanimously agreed standard for measuring aesthetic value In spite of the lack of firm rules, certain features in photographic images are believed, by many, to please humans more than certain others In this paper, we treat the challenge of automatically inferring aesthetic quality of pictures using their visual content as a machine learning problem, with a peer-rated online photo sharing Website as data source We extract certain visual features based on the intuition that they can discriminate between aesthetically pleasing and displeasing images Automated classifiers are built using support vector machines and classification trees Linear regression on polynomial terms of the features is also applied to infer numerical aesthetics ratings The work attempts to explore the relationship between emotions which pictures arouse in people, and their low-level content Potential applications include content-based image retrieval and digital photography