Multi-Modality Feature Transform: An Interactive Image Segmentation Approach

Moustafa Meshry, Ahmed Taha and Marwan Torki

Abstract

Introducing suitable features in the scribble-based foreground-background (Fg/Bg) segmentation problem is crucial. In many cases, the object of interest has different regions with different color modalities. The same applies to a non-uniform background. Fg/Bg color modalities can even overlap when the appearance is solely modeled using color spaces like RGB or Lab. In this paper, we purposefully discriminate Fg scribbles from Bg scribbles for a better representation. This is achieved by learning a discriminative embedding space from the user-provided scribbles. The transformation between the original features and the embedded features is calculated. This transformation is used to project unlabeled features onto the same embedding space. The transformed features are then used in a supervised classification manner to solve the Fg/Bg segmentation problem. We further refine the results using a self-learning strategy, by expanding scribbles and recomputing the embedding and transformations. Finally, we evaluate our algorithms and compare their performance against the state-of-the-art methods on the ISEG dataset with clear improvements over competing methods.

Session

Poster 1

Files

Extended Abstract (PDF, 2M)
Paper (PDF, 7M)

DOI

10.5244/C.29.72
https://dx.doi.org/10.5244/C.29.72

Citation

Bibtex

@inproceedings{BMVC2015_72,
	title={Multi-Modality Feature Transform: An Interactive Image Segmentation Approach},
	author={Moustafa Meshry and Ahmed Taha and Marwan Torki},
	year={2015},
	month={September},
	pages={72.1-72.12},
	articleno={72},
	numpages={12},
	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
	publisher={BMVA Press},
	editor={Xianghua Xie, Mark W. Jones, and Gary K. L. Tam},
	doi={10.5244/C.29.72},
	isbn={1-901725-53-7},
	url={https://dx.doi.org/10.5244/C.29.72}
}