Reflectance and Shape Estimation with a Light Field Camera under Natural Illumination

Trung Ngo, Hajime Nagahara, Ko Nishino, Rin-ichiro Taniguchi and Yasushi Yagi

Abstract

Reflectance and shape are two important components in visually perceiving the real world. Inferring the reflectance and shape of an object through cameras is a fundamental research topic in the field of computer vision. While three-dimensional shape recovery is pervasive with varieties of approaches and practical applications, reflectance recovery has only emerged recently. Reflectance recovery is a challenging task that is usually conducted in controlled environments, such as a laboratory environment with a special apparatus. However, it is desirable that the reflectance be recovered in the field with a handy camera so that reflectance can be jointly recovered with the shape. To that end, we present a solution that simultaneously recovers the reflectance and shape (i.e., dense depth and normal maps) of an object under natural illumination with commercially available handy cameras. We employ a light field camera to capture one light field image of the object, and a 360-degree camera to capture the illumination.

Session

Posters

Files

Paper (PDF)

DOI

10.5244/C.31.110
https://dx.doi.org/10.5244/C.31.110

Citation

Bibtex

            @inproceedings{BMVC2017_110,
                title={Reflectance and Shape Estimation with a Light Field Camera under Natural Illumination},
                author={Trung Ngo, Hajime Nagahara, Ko Nishino, Rin-ichiro Taniguchi and Yasushi Yagi},
                year={2017},
                month={September},
                pages={110.1-110.13},
                articleno={110},
                numpages={13},
                booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
                publisher={BMVA Press},
                editor={Tae-Kyun Kim, Stefanos Zafeiriou, Gabriel Brostow and Krystian Mikolajczyk},
                doi={10.5244/C.31.110},
                isbn={1-901725-60-X},
                url={https://dx.doi.org/10.5244/C.31.110}
            }