Flow Based Video Super-Resolution with Spatio-temporal Patch Similarity

Joan Duran and Antoni Buades

Abstract

The goal of super-resolution is to fuse several low-resolution images of the same scene into a single one with increased resolution. The classical formulation assumes that the super-resolved image is related to the low-resolution frames by warping, convolution and subsampling. Algorithms divide into those using explicit registration and those avoiding it. The first ones combine for each pixel the information in its estimated trajectory. The second ones exploit both spatial and temporal redundancy. We propose to combine both ideas, making use of optical flow and exploiting spatio-temporal redundancy with patch-based techniques. The proposed non-linear filtering takes into account patch similarities, automatically correcting the flow inaccuracies and avoiding the need of occlusion detection. Total variation and nonlocal regularization are used for the deconvolution stage.

Session

Posters

Files

Paper (PDF)

DOI

10.5244/C.31.147
https://dx.doi.org/10.5244/C.31.147

Citation

Bibtex

            @inproceedings{BMVC2017_147,
                title={Flow Based Video Super-Resolution with Spatio-temporal Patch Similarity},
                author={Joan Duran and Antoni Buades},
                year={2017},
                month={September},
                pages={147.1-147.12},
                articleno={147},
                numpages={12},
                booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
                publisher={BMVA Press},
                editor={Tae-Kyun Kim, Stefanos Zafeiriou, Gabriel Brostow and Krystian Mikolajczyk},
                doi={10.5244/C.31.147},
                isbn={1-901725-60-X},
                url={https://dx.doi.org/10.5244/C.31.147}
            }