Mapping Auto-context Decision Forests to Deep ConvNets for Semantic Segmentation

David Richmond, Dagmar Kainmueller, Michael Yang, Eugene Myers and Carsten Rother

Abstract

We consider the task of pixel-wise semantic segmentation given a small set of labeled training images. Among two of the most popular techniques to address this task are Random Forests (RF) and Neural Networks (NN). In this work, we explore the relationship between two special forms of these techniques: stacked RFs (namely Auto-context) and deep Convolutional Neural Networks (ConvNet). Our main contribution is to show that Auto-context can be mapped to a deep ConvNet with novel architecture, and thereby trained end-to-end. This mapping can be viewed as an intelligent initialization of a deep ConvNet, enabling training even in the face of very limited amounts of training data. We also demonstrate an approximate mapping back from the refined ConvNet to a second stacked RF, with improved performance over the original. We experimentally verify that these mappings outperform stacked RFs for two different applications in computer vision and biology: Kinect-based body part labeling from depth images, and somite segmentation in microscopy images of developing zebrafish.

Session

Video events, robot vision and deep learning

Files

PDF iconExtended Abstract (PDF, 424K)
PDF iconPaper (PDF, 2M)
PDF iconSupplemental Materials (PDF, 486K)

DOI

10.5244/C.30.144
https://dx.doi.org/10.5244/C.30.144

Citation

David Richmond, Dagmar Kainmueller, Michael Yang, Eugene Myers and Carsten Rother. Mapping Auto-context Decision Forests to Deep ConvNets for Semantic Segmentation. In Richard C. Wilson, Edwin R. Hancock and William A. P. Smith, editors, Proceedings of the British Machine Vision Conference (BMVC), pages 144.1-144.12. BMVA Press, September 2016.

Bibtex

        @inproceedings{BMVC2016_144,
        	title={Mapping Auto-context Decision Forests to Deep ConvNets for Semantic Segmentation},
        	author={David Richmond, Dagmar Kainmueller, Michael Yang, Eugene Myers and Carsten Rother},
        	year={2016},
        	month={September},
        	pages={144.1-144.12},
        	articleno={144},
        	numpages={12},
        	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
        	publisher={BMVA Press},
        	editor={Richard C. Wilson, Edwin R. Hancock and William A. P. Smith},
        	doi={10.5244/C.30.144},
        	isbn={1-901725-59-6},
        	url={https://dx.doi.org/10.5244/C.30.144}
        }