Sparse and Noisy to Dense Depth Map Upsampling Based on Mesh and Colour Consistency

Hanshin Lim and Junseok Lee

Abstract

The paper presents a mesh- and colour-consistency-based depth map upsampling method from sparse depth information with various sampling structures under noisy conditions. In addition, we applied the proposed method to generate spatially consistent depth maps and a dense 3D point cloud from a sparse and noisy initial 3D point cloud. In the proposed method, triangulation is first performed on an image plane, whose sparse depth information is contaminated by noise and have irregular sampling structures. Then, an iterative discontinuity-preserving noise reduction process is enforced in the triangulation. After the noise reduction, a depth assignment method based on colour consistency and triangulation is used to generate a dense depth map. The experiment results show that the proposed method can provide a more accurate depth map than previous sparse-to-dense depth map upsampling methods.

Session

Posters

Files

Paper (PDF)

DOI

10.5244/C.31.142
https://dx.doi.org/10.5244/C.31.142

Citation

Bibtex

            @inproceedings{BMVC2017_142,
                title={Sparse and Noisy to Dense Depth Map Upsampling Based on Mesh and Colour Consistency},
                author={Hanshin Lim and Junseok Lee},
                year={2017},
                month={September},
                pages={142.1-142.12},
                articleno={142},
                numpages={12},
                booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
                publisher={BMVA Press},
                editor={Tae-Kyun Kim, Stefanos Zafeiriou, Gabriel Brostow and Krystian Mikolajczyk},
                doi={10.5244/C.31.142},
                isbn={1-901725-60-X},
                url={https://dx.doi.org/10.5244/C.31.142}
            }