scispace - formally typeset
Open AccessProceedings ArticleDOI

The State of the Art: Object Retrieval in Paintings using Discriminative Regions

TLDR
This work draws upon recent work in mid-level discriminative patches to develop a novel method for reranking paintings based on their spatial consistency with natural images of an object category, which combines both class based and instance based retrieval in a single framework.
Abstract
The objective of this work is to recognize object categories (such as animals and vehicles) in paintings, whilst learning these categories from natural images. This is a challenging problem given the substantial differences between paintings and natural images, and variations in depiction of objects in paintings. We first demonstrate that classifiers trained on natural images of an object category have quite some success in retrieving paintings containing that category. We then draw upon recent work in mid-level discriminative patches to develop a novel method for reranking paintings based on their spatial consistency with natural images of an object category. This method combines both class based and instance based retrieval in a single framework. We quantitatively evaluate the method over a number of classes from the PASCAL VOC dataset, and demonstrate significant improvements in rankings of the retrieved paintings over a variety of object categories.

read more

Content maybe subject to copyright    Report

Citations
More filters
Posted Content

Domain Adaptation for Visual Applications: A Comprehensive Survey

TL;DR: An overview of domain adaptation and transfer learning with a specific view on visual applications and the methods that go beyond image categorization, such as object detection or image segmentation, video analyses or learning visual attributes are overviewed.
Proceedings ArticleDOI

Ceci n'est pas une pipe: A deep convolutional network for fine-art paintings classification

TL;DR: This paper trains an end-to-end deep convolution model to investigate the capability of the deep model in fine-art painting classification problem and employs the recently publicly available large-scale “Wikiart paintings” dataset that consists of more than 80,000 paintings.
Book ChapterDOI

In Search of Art

TL;DR: The objective of this work is to find objects in paintings by learning object-category classifiers from available sources of natural images.
Book ChapterDOI

Visual Link Retrieval in a Database of Paintings

TL;DR: It is shown that pre-trained convolutional neural network can perform better for this task than other machine vision methods aimed at photograph analysis and retrieval performance can be significantly improved by fine-tuning a network specifically for thistask.
References
More filters
Proceedings ArticleDOI

Histograms of oriented gradients for human detection

TL;DR: It is shown experimentally that grids of histograms of oriented gradient (HOG) descriptors significantly outperform existing feature sets for human detection, and the influence of each stage of the computation on performance is studied.
Journal ArticleDOI

Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

TL;DR: New results are derived on the minimum number of landmarks needed to obtain a solution, and algorithms are presented for computing these minimum-landmark solutions in closed form that provide the basis for an automatic system that can solve the Location Determination Problem under difficult viewing.
Journal ArticleDOI

The Pascal Visual Object Classes (VOC) Challenge

TL;DR: The state-of-the-art in evaluated methods for both classification and detection are reviewed, whether the methods are statistically different, what they are learning from the images, and what the methods find easy or confuse.
Book

Multiple view geometry in computer vision

TL;DR: In this article, the authors provide comprehensive background material and explain how to apply the methods and implement the algorithms directly in a unified framework, including geometric principles and how to represent objects algebraically so they can be computed and applied.

Multiple View Geometry in Computer Vision.

TL;DR: This book is referred to read because it is an inspiring book to give you more chance to get experiences and also thoughts and it will show the best book collections and completed collections.
Related Papers (5)