Which is the better inpainted image? Learning without subjective annotation

Mariko Isogawa, Dan Mikami, Kosuke Takahashi and Hideaki Kimata

Abstract

This paper proposes a learning-based quality evaluation framework for inpainted results that does not require any subjectively annotated training data. Image inpainting, which removes and restores unwanted regions in images, is widely acknowledged as a task whose results are quite difficult to evaluate objectively. Thus, existing learning-based image quality assessment (IQA) methods for inpainting require subjectively annotated data for training. However, subjective annotation requires huge cost and subjects’ judgment occasionally differs from person to person in accordance with the judgment criteria. To overcome these difficulties, the proposed framework uses simulated failure results of inpainted images whose subjective qualities are controlled as the training data. This approach enables preference order between pairwise inpainted images to be successfully estimated even if the task is quite subjective.

Session

Spotlights

Files

Paper (PDF)
Supplementary (PDF)
Video (MP4)

DOI

10.5244/C.31.5
https://dx.doi.org/10.5244/C.31.5

Citation

Bibtex

            @inproceedings{BMVC2017_5,
                title={Which is the better inpainted image? Learning without subjective annotation},
                author={Mariko Isogawa, Dan Mikami, Kosuke Takahashi and Hideaki Kimata},
                year={2017},
                month={September},
                pages={5.1-5.12},
                articleno={5},
                numpages={12},
                booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
                publisher={BMVA Press},
                editor={Tae-Kyun Kim, Stefanos Zafeiriou, Gabriel Brostow and Krystian Mikolajczyk},
                doi={10.5244/C.31.5},
                isbn={1-901725-60-X},
                url={https://dx.doi.org/10.5244/C.31.5}
            }