A comparison of dense region detectors for image search and fine-grained classification

Ahmet Iscen (1) , Giorgos Tolias (1) , Philippe-Henri Gosselin (2) , Hervé Jégou (1)

1 LinkMedia - Creating and exploiting explicit links between multimedia fragments
2 ETIS - UMR 8051 - Equipes Traitement de l'Information et Systèmes

We consider a pipeline for image classification or search based on coding approaches like Bag of Words or Fisher vectors. In this context, the most common approach is to extract the image patches regularly in a dense manner on several scales. This paper proposes and evaluates alternative choices to extract patches densely. Beyond simple strategies derived from regular interest region detectors, we propose approaches based on super-pixels, edges, and a bank of Zernike filters used as detectors. The different approaches are evaluated on recent image retrieval and fine-grain classification benchmarks. Our results show that the regular dense detector is outperformed by other methods in most situations, leading us to improve the state of the art in comparable setups on standard retrieval and fined-grain benchmarks. As a byproduct of our study, we show that existing methods for blob and super-pixel extraction achieve high accuracy if the patches are extracted along the edges and not around the detected regions.

Mots clés: dense keypoints; image retrieval; fine-grained classification; Zernike polynomials

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Ahmet Iscen, Giorgos Tolias, Philippe-Henri Gosselin, Hervé Jégou. A comparison of dense region detectors for image search and fine-grained classification. IEEE Transactions on Image Processing, 2015, pp.00. ⟨10.1109/TIP.2015.2423557⟩. ⟨hal-01143201⟩