Interactive Shadow Removal and Ground Truth for Variable Scene Categories

Han Gong and Darren Cosker

In Proceedings British Machine Vision Conference 2014
http://dx.doi.org/10.5244/C.28.36

Abstract

We present an interactive, robust and high quality method for fast shadow removal. To perform detection we use an on-the-fly learning approach guided by two rough user inputs for the pixels of the shadow and the lit area. From this we derive a fusion image that magnifies shadow boundary intensity change due to illumination variation. After detection, we perform shadow removal by registering the penumbra to a normalised frame which allows us to efficiently estimate non-uniform shadow illumination changes, resulting in accurate and robust removal. We also present the first reliable, validated and multi-scene category ground truth for shadow removal algorithms which overcomes limitations in existing data sets -- such as inconsistencies between shadow and shadow-free images and limited variations of shadows. Using our data, we perform what we believe to be the most thorough comparison of state of the art shadow removal methods to date. Our algorithm outperforms the state of the art, and we supply our executable and evaluation data and scripts to encourage future open comparisons.

Session

Poster Session

Files

Extended Abstract (PDF, 1 page, 542K)
Paper (PDF, 11 pages, 2.2M)
Supplemental Materials (ZIP, 9.8M)
Bibtex File

Citation

Han Gong, and Darren Cosker. Interactive Shadow Removal and Ground Truth for Variable Scene Categories. Proceedings of the British Machine Vision Conference. BMVA Press, September 2014.

BibTex

@inproceedings{BMVC.28.36
	title = {Interactive Shadow Removal and Ground Truth for Variable Scene Categories},
	author = {Gong, Han and Cosker, Darren},
	year = {2014},
	booktitle = {Proceedings of the British Machine Vision Conference},
	publisher = {BMVA Press},
	editors = {Valstar, Michel and French, Andrew and Pridmore, Tony}
	doi = { http://dx.doi.org/10.5244/C.28.36 }
}