Abstract
The objective of this pilot study is to investigate relevance judgments made by end-users when searching for image information. The pilot study involved 10 undergraduate students from the Department of Journalism and Media Studies at Rutgers University using the AccuNet/AP Photo Archive to retrieve specific, general, and subjective photos. The study identified core relevance criteria used across the three different image searches, and found that the participants in the general and subjective image searches relied more on personal feelings and textual information of photos to make relevance judgments, while the participants in the specific image search depended more on the features of objects in photos. Four textual representations–caption, object name, location, and creation date, were chosen to see how useful they were for the participants making relevance judgments. The results show that location was the most useful information among the four textual representations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Saracevic, T.: Relevance: A review of and a framework for the thinking on the notion in information science. Journal of the American Society for Information Science 26, 321–343 (1975)
Saracevic, T.: Modeling interaction in information retrieval (IR): A review and proposal. In: Proceedings of the 59th Annual Meeting of the American Society for Information Science, vol. 33, pp. 3–9 (1996)
Schamber, L.: Relevance and information behavior. Annual Review of Information Science and Technology 29, 3–48 (1994)
Shatford, L.S.: Some issues in the indexing of images. Journal of the American Society for Information Science 4, 583–588 (1994)
Schamber, L.: User’s criteria for evaluation in a multimedia environment. Proceedings of the American Society of Information Science 28, 126–133 (1991)
Barry. C. L.: User-defined relevance criteria: An exploratory study. Journal of the American Society for Information Society, 45, 149-159 (1994)
Park, T.K.: The natural of relevance in information retrieval: An empirical study. Library Quarterly 63, 318–351 (1993)
Wang, P.: A cognitive model of document selection of real users of information retrieval systems. Doctoral dissertation, University of Maryland, College Park, MD (1994)
Hirsh, S.G.: Relevance determination in children’s use of electronic resources: A case study. Proceedings of the American Society for Information Science 35, 63–72 (1998)
Choi, Y., Rasmussen, E.: Users’ relevance criteria in image retrieval in American history. Information Processing and Management 38, 695–726 (2002)
Markkula, M., Sormunen, E.: End-user searching challenges indexing practices in the digital newspaper photo archive. Information Retrieval 1, 259–285 (2000)
Enser, P., McGregor, C.: Analysis of visual information retrieval queries. Report on Project G16412 to the British Library Research and Development Department. British Library, London (1992)
Chen, H.-L.: An analysis of image queries in the field of art history. Journal of the American Society for Information Science and Technology 52, 260–273 (2001)
Shatford, S.: Analyzing the subject of a picture: A theoretical approach. Cataloging & Classification Quarterly 6, 39–62 (1986)
Ornager, S.: The newspaper image database: Empirical supported analysis of users’ topology and word association clusters. In: Proceedings of the 19th Annual Conference on Research and Development in Information Retrieval. SIGIR, pp. 190–197 (1995)
Jorgensen, C.: Indexing images: Testing an image description template. In: Proceedings of the 59th Annual Meeting of the American Society for Information Science, vol. 33, pp. 209-213(1996)
Fidel, R.: Image retrieval task: Implications for the design and evaluation of image databases. The New Review of Hypermedia and Multimedia 3, 181–199 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hung, TY., Zoeller, C., Lyon, S. (2005). Relevance Judgments for Image Retrieval in the Field of Journalism: A Pilot Study. In: Fox, E.A., Neuhold, E.J., Premsmit, P., Wuwongse, V. (eds) Digital Libraries: Implementing Strategies and Sharing Experiences. ICADL 2005. Lecture Notes in Computer Science, vol 3815. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11599517_9
Download citation
DOI: https://doi.org/10.1007/11599517_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30850-8
Online ISBN: 978-3-540-32291-7
eBook Packages: Computer ScienceComputer Science (R0)