Saliency-based multi-feature modeling for semantic image retrieval

C. Bai 1 J.-N. Chen 1 L. Huang 1 K. Kpalma 2 S. Chen 1
1 College of Computer Science
2 IETR - Institut d'Electronique et de Télécommunications de Rennes
Abstract : Semantic gap is an important challenging problem in content-based image retrieval (CBIR) up to now. Bag-of-words (BOW) framework is a popular approach that tries to reduce the semantic gap in CBIR. In this paper, an approach integrating visual saliency model with BOW is proposed for semantic image retrieval. Images are firstly segmented into background regions and foreground objects by a visual saliency-based segmentation method. And then multi-features including Scale Invariant Feature Transform (SIFT) features packed in BOW are extracted from regions and objects respectively and fused considering different characteristics of background regions and foreground objects. Finally, a fusion of z-score normalized Chi-Square distance is adopted as the similarity measurement. This proposal has been implemented on two widely used benchmark databases and the results evaluated in terms of mean Average Precision (mAP) show that our proposal outperforms the referred state-of-the-art approaches. © 2017 Elsevier Inc.
Keywords : Visual saliency Bag of words Semantic gap Semantic image retrieval
Type de document :
Article dans une revue
Journal of Visual Communication and Image Representation, Elsevier, 2018, 50, pp.199-204. 〈10.1016/j.jvcir.2017.11.021〉
Liste complète des métadonnées
https://hal-univ-rennes1.archives-ouvertes.fr/hal-01671560
Contributeur : Laurent Jonchère <>
Soumis le : vendredi 22 décembre 2017 - 13:48:42
Dernière modification le : jeudi 7 février 2019 - 14:45:21

Identifiants

Collections

UNIV-RENNES1 | IETR | UNIV-NANTES | UR1-UFR-ISTIC | IETR-VAADER | UNIV-RENNES | INSA-GROUPE

Citation

C. Bai, J.-N. Chen, L. Huang, K. Kpalma, S. Chen. Saliency-based multi-feature modeling for semantic image retrieval. Journal of Visual Communication and Image Representation, Elsevier, 2018, 50, pp.199-204. 〈10.1016/j.jvcir.2017.11.021〉. 〈hal-01671560〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

128