Abstract
In recent years multimedia researchers have attempted to design content-based image retrieval systems. However, despite the development of these systems, the term “content” has still remained rather ill defined, and this has made the evaluation of such systems problematic. This paper proposes a method for the creation of a reference image set in which the similarity of each image pair is estimated by two independent methods — by the subjective evaluation of human observers, and by the use of “visual content words” as basis vectors that allow the multidimensional content of each image to be represented with a content vector. The similarity measure computed with these content vectors is shown to correlate with the subjective judgment of human observers, and thus provides both a more objective method for evaluating and expressing image content, and a possible path to automating the process of content-based indexing in the future.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chang, E. Y., Li Beitao, and Li Chen. “Toward Perception-Based Image Retrieval.” Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries. IEEE Comput. Soc Los Alamitos CA USA, 2000. viii+119.
Frese, T., C. A. Bouman, and J. P. Allebach. “Methodology for Designing Image Similarity Metrics Based on Human Visual System Models.” Proceedings of the SPIE The Intl Society for Optical Engineering 3016 (1997): 472–83.
Jorgensen, C, and R. Srihari. “Creating a Web-Based Image Database for Benchmarking Image Retrieval Systems.” Proceedings of the SPIE The International Society for Optical Engineering 3644 (1999): 534–41.
Kam, A. H., et al. “Content Based Image Retrieval through Object Extraction and Querying.“ Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries. IEEE Comput. Soc Los Alamitos CA USA, 2000. viii+119.
La Cascia, M., S. Sethi, and S. Sclaroff. “Combining Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web.” Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173). IEEE Comput. Soc Los Alamitos CA USA, 1998. viii+115.
Leung, T., and J. Malik. “Recognizing Surfaces Using Three-Dimensional Textons.” Proceedings of the Seventh IEEE International Conference on Computer Vision. IEEE Comput. Soc Los Alamitos CA USA, 1999. 2 vol. xxvii+1258.
Ma, W. Y., Deng Yining, and B. S. Manjunath. “Tools for Texture/Color Based Search of Images.” Proceedings of the SPIE The International Society for Optical Engineering 3016 (1997): 496–507.
Manmatha, R., and S. S. Ravela. “Syntactic Characterization of Appearance and Its Application to Image Retrieval.“ Proceedings of the SPIE The International Society for Optical Engineering 3016 (1997): 484–95.
MacArthur, S. D., C. E. Brodley, and Shyu Chi Ren. “Relevance Feedback Decision Trees in Content-Based Image Retrieval.” Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries. IEEE Comput. Soc Los Alamitos CA USA, 2000. viii+119.
Ravishankar Rao, A. “Identifying High Level Features of Texture Perception.” CVGIP: Graphical Models and Image Processing 55.3 (1993): 218–33.
Shyu, C. R., et al. “Local Versus Global Features for Content-Based Image Retrieval.” Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173). IEEE Comput. Soc Los Alamitos CA USA, 1998. viii+115.
Smith, J. R. “Image Retrieval Evaluation.” Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173). IEEE Comput. Soc Los Alamitos CA USA, 1998. viii+115.
Yihong, Gong, G. Proietti, and C. Faloutsos. “Image Indexing and Retrieval Based on Human Perceptual Color Clustering.” Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231). IEEE Comput. Soc Los Alamitos CA USA, 1998. xvii+970.
The NaturePix reference image set is in the public domain, and may be downloaded at http://cubic.asu.edu/vccl/imagesets/naturepix.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Black, J.A., Fahmy, G., Panchanathan, S. (2002). A Method for Evaluating the Performance of Content-Based Image Retrieval Systems Based on Subjectively Determined Similarity between Images. In: Lew, M.S., Sebe, N., Eakins, J.P. (eds) Image and Video Retrieval. CIVR 2002. Lecture Notes in Computer Science, vol 2383. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45479-9_38
Download citation
DOI: https://doi.org/10.1007/3-540-45479-9_38
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43899-1
Online ISBN: 978-3-540-45479-3
eBook Packages: Springer Book Archive