Impatient DNNs - Deep Neural Networks with Dynamic Time Budgets

Manuel Amthor, Erik Rodner and Joachim Denzler

Abstract

We propose Impatient Deep Neural Networks (DNNs) which deal with dynamic time budgets during application. They allow for individual budgets given a priori for each test example and for anytime prediction, i.e., a possible interruption at multiple stages during inference while still providing output estimates. Our approach can therefore tackle the computational costs and energy demands of DNNs in an adaptive manner, a property essential for real-time applications. Our Impatient DNNs are based on a new general framework of learning dynamic budget predictors using risk minimization, which can be applied to current DNN architectures by adding early prediction and additional loss layers. A key aspect of our method is that all of the intermediate predictors are learned jointly. In experiments, we evaluate our approach for different budget distributions, architectures, and datasets. Our results show a significant gain in expected accuracy compared to common baselines.

Session

Posters 2

Files

Extended Abstract (PDF, 372K)
Paper (PDF, 2M)
Supplemental Materials (ZIP, 71K)

DOI

10.5244/C.30.116
https://dx.doi.org/10.5244/C.30.116

Citation

Bibtex

        @inproceedings{BMVC2016_116,
        	title={Impatient DNNs - Deep Neural Networks with Dynamic Time Budgets},
        	author={Manuel Amthor, Erik  Rodner and Joachim Denzler},
        	year={2016},
        	month={September},
        	pages={116.1-116.12},
        	articleno={116},
        	numpages={12},
        	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
        	publisher={BMVA Press},
        	editor={Richard C. Wilson, Edwin R. Hancock and William A. P. Smith},
        	doi={10.5244/C.30.116},
        	isbn={1-901725-59-6},
        	url={https://dx.doi.org/10.5244/C.30.116}
        }