General Deep Image Completion with Lightweight Conditional Generative Adversarial Networks

Ching-Wei Tseng, Hung Jin Lin and Shang-Hong Lai

Abstract

Recent image completion researches using deep neural networks approaches have shown remarkable progress by using generative adversarial networks (GANs). However, these approaches still have the problems of large model sizes and lack of generality for various types of corruptions. In addition, the conditional GANs often suffer from the mode collapse and unstable training problems. In this paper, we overcome these shortcomings in the previous models by proposing a lightweight model of conditional GANs with integrating a stable way in adversarial training. Moreover, we present a new training strategy to trigger the model to learn how to complete different types of corruptions or missing regions in images. Experimental results demonstrate qualitatively and quantitatively that the proposed model provides significant improvement over a number of representative image completion methods on public datasets.

Session

Posters

Files

PDF iconPaper (PDF)
PDF iconSupplementary (PDF)

DOI

10.5244/C.31.80
https://dx.doi.org/10.5244/C.31.80

Citation

Ching-Wei Tseng, Hung Jin Lin and Shang-Hong Lai. General Deep Image Completion with Lightweight Conditional Generative Adversarial Networks. In T.K. Kim, S. Zafeiriou, G. Brostow and K. Mikolajczyk, editors, Proceedings of the British Machine Vision Conference (BMVC), pages 80.1-80.13. BMVA Press, September 2017.

Bibtex

            @inproceedings{BMVC2017_80,
                title={General Deep Image Completion with Lightweight Conditional Generative Adversarial Networks},
                author={Ching-Wei Tseng, Hung Jin Lin and Shang-Hong Lai},
                year={2017},
                month={September},
                pages={80.1-80.13},
                articleno={80},
                numpages={13},
                booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
                publisher={BMVA Press},
                editor={Tae-Kyun Kim, Stefanos Zafeiriou, Gabriel Brostow and Krystian Mikolajczyk},
                doi={10.5244/C.31.80},
                isbn={1-901725-60-X},
                url={https://dx.doi.org/10.5244/C.31.80}
            }