The State of the Art: Object Retrieval in Paintings using Discriminative Regions

Elliot Crowley and Andrew Zisserman

In Proceedings British Machine Vision Conference 2014
http://dx.doi.org/10.5244/C.28.38

Abstract

The objective of this work is to recognize object categories (such as animals and vehicles) in paintings, whilst learning these categories from natural images. This is a challenging problem given the substantial differences between paintings and natural images, and variations in depiction of objects in paintings. We first demonstrate that classifiers trained on natural images of an object category have some success in retrieving paintings containing that category. We then draw upon recent work in mid-level discriminative patches to develop a novel method for re-ranking paintings based on their spatial consistency with natural images of an object category. This method combines both class based and instance based retrieval in a single framework. We quantitatively evaluate the method over a number of classes from the PASCAL VOC dataset, and demonstrate significant improvements in rankings of the retrieved paintings over a variety of object categories.

Session

Poster Session

Files

Extended Abstract (PDF, 1 page, 2.9M)
Paper (PDF, 12 pages, 2.9M)
Bibtex File

Citation

Elliot Crowley, and Andrew Zisserman. The State of the Art: Object Retrieval in Paintings using Discriminative Regions. Proceedings of the British Machine Vision Conference. BMVA Press, September 2014.

BibTex

@inproceedings{BMVC.28.38
	title = {The State of the Art: Object Retrieval in Paintings using Discriminative Regions},
	author = {Crowley, Elliot and Zisserman, Andrew},
	year = {2014},
	booktitle = {Proceedings of the British Machine Vision Conference},
	publisher = {BMVA Press},
	editors = {Valstar, Michel and French, Andrew and Pridmore, Tony}
	doi = { http://dx.doi.org/10.5244/C.28.38 }
}