Spatio-Temporal Consistency to Detect and Segment Carried Objects

Farnoosh Ghadiri, Robert Bergevin and Guillaume-Alexandre Bilodeau

Abstract

We present a new method to detect carried objects and to segment them accurately after detection. The proposed method includes several contributions: first, a new superpixel-based descriptor is proposed to identify carried object-like candidate regions using human shape modelling. Second, integrating spatio-temporal information of candidate regions to detect carried objects. We exploit the consistency of recurring carried object candidates viewed over time to detect the final carried object locations based on their motion and location priors. Last, the detected carried object regions are accurately segmented. Compared to existing methods, our approach is not only focusing on detecting carried objects. It takes a step forward and accurately segment them. Our method to carried object segmentation couples local appearance cues with location priors of the detected carried objects to produce accurate segmentation.

Session

Spotlights

Files

PDF iconPaper (PDF)
MP4 iconVideo (MP4)

DOI

10.5244/C.31.6
https://dx.doi.org/10.5244/C.31.6

Citation

Farnoosh Ghadiri, Robert Bergevin and Guillaume-Alexandre Bilodeau. Spatio-Temporal Consistency to Detect and Segment Carried Objects. In T.K. Kim, S. Zafeiriou, G. Brostow and K. Mikolajczyk, editors, Proceedings of the British Machine Vision Conference (BMVC), pages 6.1-6.12. BMVA Press, September 2017.

Bibtex

            @inproceedings{BMVC2017_6,
                title={Spatio-Temporal Consistency to Detect and Segment Carried Objects},
                author={Farnoosh Ghadiri, Robert Bergevin and Guillaume-Alexandre Bilodeau},
                year={2017},
                month={September},
                pages={6.1-6.12},
                articleno={6},
                numpages={12},
                booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
                publisher={BMVA Press},
                editor={Tae-Kyun Kim, Stefanos Zafeiriou, Gabriel Brostow and Krystian Mikolajczyk},
                doi={10.5244/C.31.6},
                isbn={1-901725-60-X},
                url={https://dx.doi.org/10.5244/C.31.6}
            }