Semantic Segmentation for Real-World Data by Jointly Exploiting Supervised and Transferrable Knowledge

Li-Hsien Lu and Chiou-Ting Hsu

Abstract

This paper addresses two major challenges in semantic segmentation for real-world data. First, with ever-increasing semantic labels, we need a more pragmatic approach other than existing fully-supervised methods. Second, semantic segmentation for very small or rarely-appeared objects are still very challenging for existing methods. In this paper, we propose to (1) fully utilize the predicted label information from an existing supervised model and to (2) infer newly generated labels via label transfer from a real-world dataset. We propose a "content-adaptive" and "label-aware" MRF framework to jointly exploiting both the supervised and label-transferrable knowledge. The proposed method needs no off-line training and can easily adapt to real-world data. Experimental results on SIFT Flow and LMSun datasets demonstrate the effectiveness of the proposed method, and show promising performance over state-of-the-art methods under the real-world scenario.

Session

Posters 2

Files

Extended Abstract (PDF, 267K)
Paper (PDF, 1M)

DOI

10.5244/C.30.84
https://dx.doi.org/10.5244/C.30.84

Citation

Bibtex

        @inproceedings{BMVC2016_84,
        	title={Semantic Segmentation for Real-World Data by Jointly Exploiting Supervised and Transferrable Knowledge },
        	author={Li-Hsien Lu and Chiou-Ting Hsu},
        	year={2016},
        	month={September},
        	pages={84.1-84.12},
        	articleno={84},
        	numpages={12},
        	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
        	publisher={BMVA Press},
        	editor={Richard C. Wilson, Edwin R. Hancock and William A. P. Smith},
        	doi={10.5244/C.30.84},
        	isbn={1-901725-59-6},
        	url={https://dx.doi.org/10.5244/C.30.84}
        }