Deformable Part-based Fully Convolutional Network for Object Detection

Taylor Mordan, Nicolas Thome, Gilles Henaff and Matthieu Cord

Abstract

Existing region-based object detectors are limited to regions with fixed box geometry to represent objects, even if those are highly non-rectangular. In this paper we introduce DP-FCN, a deep model for object detection which explicitly adapts to shapes of objects with deformable parts. Without additional annotations, it learns to focus on discriminative elements and to align them, and simultaneously brings more invariance for classification and geometric information to refine localization. DP-FCN is composed of three main modules: a Fully Convolutional Network to efficiently maintain spatial resolution, a deformable part-based RoI pooling layer to optimize positions of parts and build invariance, and a deformation-aware localization module explicitly exploiting displacements of parts to improve accuracy of bounding box regression. We experimentally validate our model and show significant gains. DP-FCN achieves state-of-the-art performances of 83.1% and 80.

Session

Orals - Scene Understanding

Files

Paper (PDF)
Supplementary (PDF)

DOI

10.5244/C.31.88
https://dx.doi.org/10.5244/C.31.88

Citation

Bibtex

            @inproceedings{BMVC2017_88,
                title={Deformable Part-based Fully Convolutional Network for Object Detection},
                author={Taylor Mordan, Nicolas Thome, Gilles Henaff and Matthieu Cord},
                year={2017},
                month={September},
                pages={88.1-88.14},
                articleno={88},
                numpages={14},
                booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
                publisher={BMVA Press},
                editor={Tae-Kyun Kim, Stefanos Zafeiriou, Gabriel Brostow and Krystian Mikolajczyk},
                doi={10.5244/C.31.88},
                isbn={1-901725-60-X},
                url={https://dx.doi.org/10.5244/C.31.88}
            }