Confidence and Diversity for Active Selection of Feedback in Image Retrieval

Bhavin Modi and Adriana Kovashka

Abstract

Image search is a challenging problem because of the need to model any concept the user might want to retrieve. One recent solution to the problem allows the user to give feedback on the current set of results, by answering questions about how the relative attributes of individual returned images relate to his/her target image. We show how to ask more informative questions. In our active selection formulation that determines about which attribute the system should next ask a question, we account for the confidence of relative attribute models. In addition to asking about reliably modeled attributes, the system is also encouraged to ask diverse questions, by computing question diversity on both the attribute and image levels. We show that both of our novel active selection criteria, confidence and diversity, help improve search results on three datasets.

Session

Posters

Files

Paper (PDF)

DOI

10.5244/C.31.53
https://dx.doi.org/10.5244/C.31.53

Citation

Bibtex

            @inproceedings{BMVC2017_53,
                title={Confidence and Diversity for Active Selection of Feedback in Image Retrieval},
                author={Bhavin Modi and Adriana Kovashka},
                year={2017},
                month={September},
                pages={53.1-53.14},
                articleno={53},
                numpages={14},
                booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
                publisher={BMVA Press},
                editor={Tae-Kyun Kim, Stefanos Zafeiriou, Gabriel Brostow and Krystian Mikolajczyk},
                doi={10.5244/C.31.53},
                isbn={1-901725-60-X},
                url={https://dx.doi.org/10.5244/C.31.53}
            }