A Case Study in the use of ROC curves for Algorithm Design

P A Bromiley, P Courtney and N A Thacker

We describe the development of a vision system to detect natural events in a low resolution image stream. The work involves the assessment of algorithmic design decisions to maximise detection reliability. This assessment is carried out by comparing measures and estimates made by the system under development with measures obtained independently. We show that even when these independent measures are themselves noisy, their independence can serve to guide decisions and allow perfomance estimates to be made. Although presented here for one particular system design, we believe that such an approach will be applicable to other situations whan an image-based system is to be used in the analysis of natural scenes in situations where precise ground truth is not available.

PDF version

Home Contents Author index Keyword index

Valid CSS! Valid HTML 4.01!

This document produced for BMVC 2001