Abstract
Current multimedia search technology is, especially in commercial applications, heavily based on text annotations. However, there are many applications such as image hosting web sites (e.g. Flickr or Picasa) where the text metadata are of poor quality in general. Searching such collections only by text gives usually rather unsatisfactory results. On the other hand, multimedia retrieval systems based purely on content can retrieve visually similar results but lag behind with the ability to grasp the semantics expressed by text annotations. In this paper, we propose various ranking techniques that can be transparently applied on any content-based retrieval system in order to improve the search results quality and user satisfaction. We demonstrate the usefulness of the approach on two large real-life datasets indexed by the MUFIN system. The improvement of the ranked results was evaluated by real users using an online survey.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Batko, M., Kohoutkova, P., Novak, D.: CoPhIR image collection under the microscope. In: Proceedings of SISAP 2009, pp. 47–54 (2009)
Batko, M., Novak, D., Zezula, P.: MESSIF: Metric similarity search implementation framework. In: Thanos, C., Borri, F., Candela, L. (eds.) Digital Libraries: Research and Development. LNCS, vol. 4877, pp. 1–10. Springer, Heidelberg (2007)
Bolettieri, P., Esuli, A., Falchi, F., Lucchese, C., Perego, R., Piccioli, T., Rabitti, F.: CoPhIR: a test collection for content-based image retrieval. CoRR abs/0905.4627 (2009)
Jing, Y., Baluja, S.: VisualRank: Applying PageRank to large-scale image search. IEEE Trans. on Pattern Analysis and Machine Intell. 30(11), 1877–1890 (2008)
van Leuken, R.H., Garcia, L., Olivares, X., van Zwol, R.: Visual diversification of image search results. In: Proc. of the 18th International Conference on World Wide Web, pp. 341–350. ACM, New York (2009)
Liu, D., Hua, X.S., Wang, M., Zhang, H.J.: Retagging social images based on visual and semantic consistency. In: Proceedings of WWW 2010, pp. 1149–1150. ACM, New York (2010)
Liu, D., Hua, X.S., Yang, L., Wang, M., Zhang, H.J.: Tag ranking. In: Proceedings of WWW 2009, pp. 351–360. ACM, New York (2009)
Liu, Y., Zhang, D., Lu, G., Ma, W.Y.: A survey of content-based image retrieval with high-level semantics. Pattern Recognition 40(1), 262–282 (2007)
Liu, Y., Mei, T., Hua, X.S.: Crowdreranking: exploring multiple search engines for visual search reranking. In: Proceedings of SIGIR 2009, pp. 500–507. ACM, New York (2009)
MPEG-7: Multimedia content description interfaces. Part 3: Visual. ISO/IEC 15938-3:2002 (2002)
Novak, D., Batko, M., Zezula, P.: Generic similarity search engine demonstrated by an image retrieval application. In: Proceedings of SIGIR 2009, p. 840 (2009)
Park, G., Baek, Y., Lee, H.K.: Web image retrieval using majority-based ranking approach. Multimedia Tools and Applications 31(2), 195–219 (2006)
Skopal, T., Dohnal, V., Batko, M., Zezula, P.: Distinct nearest neighbors queries for similarity search in very large multimedia databases. In: Proceedings of WIDM 2009, pp. 11–14. ACM, New York (2009)
Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. on Pattern Analysis and Machine Intell. 22(12), 1349–1380 (2000)
Tian, X., Tao, D., Hua, X.S., Wu, X.: Active reranking for web image search. Trans. Img. Proc. 19(3), 805–820 (2010)
Wang, L., Yang, L., Tian, X.: Query aware visual similarity propagation for image search reranking. In: Proceedings of MM 2009, pp. 725–728. ACM, New York (2009)
Zezula, P., Amato, G., Dohnal, V., Batko, M.: Similarity Search: The Metric Space Approach. In: Advances in Database Systems, vol. 32. Springer, Heidelberg (2006)
Zhou, X.S., Huang, T.S.: Relevance feedback in image retrieval: A comprehensive review. Multimedia Systems 8(6), 536–544 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Budikova, P., Batko, M., Zezula, P. (2011). Similarity Query Postprocessing by Ranking. In: Detyniecki, M., Knees, P., Nürnberger, A., Schedl, M., Stober, S. (eds) Adaptive Multimedia Retrieval. Context, Exploration, and Fusion. AMR 2010. Lecture Notes in Computer Science, vol 6817. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27169-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-27169-4_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-27168-7
Online ISBN: 978-3-642-27169-4
eBook Packages: Computer ScienceComputer Science (R0)