Orland Hoeber
Abbas Pirmoradi Bezanjani
ABSTRACT
Keywords contain important contextual information about search results within academic digital library search interfaces. However, such information tends to be underutilized within modern search interface designs. In prior work, methods for visually linking keywords between search results have been proposed and studied. In this research, we analyze the design space and propose a new approach that aggregates the keywords over all items on the search engine results page (SERP), visually linking them back to their source search result. We have created interactive and static versions of both interfaces, and conducted a controlled laboratory study to assess the impact of the interfaces on measures of utility (efficiency, effectiveness, feature use) and perceived value (usefulness, ease of use, satisfaction, user engagement, knowledge gain, and interest gain). The findings from this research show the merit of using keywords to provide summaries of documents and search result sets, the value of making keywords interactive, and the benefit of using visualization to interactively link information within a search engine results page. The differences between providing the keywords along side each document or aggregated over the entire SERP were minimal, suggesting that it does not matter how the keywords are represented as long as they can be used to interactively reveal relationships among the search results.
Supplemental Material
Available for Download
docx
CHIIR2024-Visual Keyword:Result Linking Questionnaires.docx (27.8 KB)
Questionnaires used in the user study described in the paper "Visual Keyword/Result Linking: Using Interaction to Dynamically Reveal Relationships" published in CHIIR 2024.
- Jae-wook Ahn, Peter Brusilovsky, Jonathan Grady, Daqing He, and Radu Florian. 2010. Semantic annotation based exploratory search for information analysts. Information Processing & Management 46, 4 (2010), 383–402. https://doi.org/10.1016/j.ipm.2010.02.001Google Scholar
Digital Library
- Anne Aula, Päivi Majaranta, and Kari-Jouko Räihä. 2005. Eye-tracking reveals the personal styles for search result evaluation. In Proceedings of the 2005 IFIP TC13 International Conference on Human-Computer Interaction. Springer-Verlag, Berlin, Heidelberg, 1058–1061. https://doi.org/10.1007/11555261_104Google ScholarDigital Library
- Nicholas Belkin. 2015. People, interacting with information. SIGIR Forum 49, 2 (2015), 13–27. https://doi.org/10.1145/2888422.2888424Google ScholarDigital Library
- Nicholas Belkin, Susan Dumais, Jean Scholtz, and Ross Wilkinson. 2004. Evaluating interactive information retrieval systems: Opportunities and challenges. In Proceedings of the CHI Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York, USA, 1594–1595. https://doi.org/10.1145/985921.986162Google ScholarDigital Library
- Pia Borlund. 2003. The IIR evaluation model: A framework for evaluation of interactive information retrieval systems. Information Research 8, 2 (2003), 3–8. http://www.informationr.net/ir/8-3/paper152.htmlGoogle Scholar
- Joseph Chee Chang, Nathan Hahn, Adam Perer, and Aniket Kittur. 2019. SearchLens: Composing and capturing complex user interests for exploratory search. In Proceedings of the ACM Annual Conference on Intelligent User Interfaces. ACM Press, New York, USA, 498–509. https://doi.org/10.1145/3301275.3302321Google ScholarDigital Library
- Cecilia di Sciascio, Peter Brusilovsky, and Eduardo Veas. 2018. A study on user-controllable social exploratory search. In Proceedings of the ACM Annual Conference on Intelligent User Interfaces. ACM Press, New York, USA, 353–364. https://doi.org/10.1145/3172944.3172986Google ScholarDigital Library
- Souvick Ghosh, Manasa Rath, and Chirag Shah. 2018. Searching as learning: Exploring search behavior and learning outcomes in learning-related tasks. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (New Brunswick, NJ, USA) (CHIIR ’18). Association for Computing Machinery, New York, NY, USA, 22–31. https://doi.org/10.1145/3176349.3176386Google ScholarDigital Library
- Marti A. Hearst. 2009. Search User Interfaces. Cambridge University Press, Cambridge, UK.Google Scholar
- Orland Hoeber. 2008. Web information retrieval support systems: The future of web search. In Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology. IEEE, New York, USA, 29–32. https://doi.org/10.1109/WIIAT.2008.151Google ScholarDigital Library
- Orland Hoeber. 2018. Information visualization for interactive information retrieval. In Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval. ACM Press, New York, USA, 371–374. https://doi.org/10.1145/3176349.3176898Google ScholarDigital Library
- Orland Hoeber and Soumya Shukla. 2022. A study of visually linked keywords to support exploratory browsing in academic search. Journal of the American Society for Information Science and Technology 73, 8 (2022), 1171–1191. https://doi.org/10.1002/asi.24623Google ScholarCross Ref
- Orland Hoeber and Dale Storie. 2022. Information seeking within academic digital libraries: A survey of graduate student search strategies. In Proceedings of the 22nd ACM/IEEE Joint Conference on Digital Libraries. ACM Press, New York, USA, Article 25, 5 pages. https://doi.org/10.1145/3529372.3533286Google ScholarDigital Library
- Orland Hoeber and Dale Storie. 2023. Graduate student search strategies within academic digital libraries. International Journal on Digital Libraries (2023). https://doi.org/10.1007/s00799-023-00378-xGoogle ScholarCross Ref
- Orland Hoeber and Xue Dong Yang. 2008. Evaluating WordBars in exploratory web search scenarios. Information Processing & Management 44, 2 (2008), 485–510. https://doi.org/10.1016/j.ipm.2007.07.003Google ScholarDigital Library
- Antti Kangasrääsiö, Dorota Glowacka, and Samuel Kaski. 2015. Improving controllability and predictability interactive recommendation interfaces for exploratory search. In Proceedings of the ACM Annual Conference on Intelligent User Interfaces. ACM Press, New York, USA, 247–251. https://doi.org/10.1145/2678025.2701371Google ScholarDigital Library
- Taraneh Khazaei and Orland Hoeber. 2017. Supporting academic search tasks through citation visualization and exploration. International Journal on Digital Libraries 18, 1 (2017), 59–72. https://doi.org/10.1007/s00799-016-0170-xGoogle ScholarDigital Library
- Kurt Koffka. 1935. Principles of Gestalt Psychology. Routledge, London, UK.Google Scholar
- Ralf Krestel, Gianluca Demartini, and Eelco Herder. 2011. Visual interfaces for stimulating exploratory search. In Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. ACM Press, New York, USA, 393–394. https://doi.org/10.1145/1998076.1998151Google ScholarDigital Library
- Bill Kules and Robert Capra. 2009. Designing exploratory search tasks for user studies of information seeking support systems. In Proceedings of the ACM/IEEE Joint Conference on Digital Libraries. ACM Press, New York, USA, 419–420. https://doi.org/10.1145/1555400.1555492Google ScholarDigital Library
- Bjorn Lantz. 2013. Equidistance of Likert-type scales and validation of inferential methods using experiments and simulations. Electronic Journal of Business Research Methods 11, 1 (2013), 16–28.Google Scholar
- Yiling Lin, Jae-Wook Ahn, Peter Brusilovsky, Daqing He, and William Real. 2010. ImageSieve: Exploratory search of museum archives with named entity-based faceted browsing. Proceedings of the American Society for Information Science and Technology 47, 1 (2010), 1–10. https://doi.org/10.1002/meet.14504701217Google ScholarCross Ref
- Chang Liu, Ying-Hsang Liu, Jingjing Liu, and Ralf Bierig. 2021. Search Interface Design and Evaluation. Foundations and Trends in Information Retrieval 15, 3–4 (2021), 243–416. https://doi.org/10.1561/1500000073Google ScholarDigital Library
- David Maxwell and Claudia Hauff. 2021. LogUI: contemporary logging infrastructure for web-based experiments. In Proceedings of the European Conference on Information Retrieval. 525–530. https://doi.org/10.1007/978-3-030-72240-1_59Google ScholarDigital Library
- Alan Medlar, Jing Li, and Dorota Głowacka. 2021. Query suggestions as summarization in exploratory search. In Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval. ACM Press, New York, USA, 119–128. https://doi.org/10.1145/3406522.3446020Google ScholarDigital Library
- Heather L. O’Brien, Paul Cairns, and Mark Hall. 2018. A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. International Journal of Human-Computer Studies 112 (2018), 28–39. https://doi.org/10.1016/j.ijhcs.2018.01.004Google ScholarCross Ref
- Falk Scholer and Andrew Turpin. 2009. Metric and relevance mismatch in retrieval evaluation. In Proceedings of the Asia Information Retrieval Symposium. Springer-Verlag, Berlin, Germany, 50–62. https://doi.org/10.1007/978-3-642-04769-5_5Google ScholarDigital Library
- Soumya Shukla and Orland Hoeber. 2021. Visually linked keywords to support exploratory browsing. In Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval. ACM Press, New York, USA, 273–277. https://doi.org/10.1145/3406522.3446037Google ScholarDigital Library
- Pertti Vakkari. 2003. Task-based information searching. Annual Review of Information Science and Technology 37, 1 (2003), 413–464. https://doi.org/10.1002/aris.1440370110Google ScholarCross Ref
- Viswanath Venkatesh and Fred D. Davis. 2000. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science 46, 2 (2000), 186–204. https://doi.org/10.1287/mnsc.46.2.186.11926Google ScholarDigital Library
- Matthew O. Ward, Georges Grinstein, and Daniel Keim. 2015. Interactive Data Visualization: Foundations, Techniques, and Applications (2nd ed.). CRC Press, Boca Raton, USA.Google Scholar
- Colin Ware. 2012. Information Visualization: Perception for Design (2nd ed.). Elsevier, San Francisco, USA.Google Scholar
- Ryen W. White and Resa A. Roth. 2009. Exploratory Search: Beyond the Query-Response Paradigm. Morgan & Claypool Publishers, San Rafael, CA. https://doi.org/10.2200/S00174ED1V01Y200901ICR003Google ScholarCross Ref
- Max Wilson. 2011. Interfaces for information retrieval. In Interactive Information Seeking, Behaviour and Retrieval, Ian Ruthven and Diane Kelly (Eds.). Facet Publishing, London, UK, 139–170. https://doi.org/10.29085/9781856049740.010Google ScholarCross Ref
Index Terms
- Visual Keyword/Result Linking: Using Interaction to Dynamically Reveal Relationships
Recommendations
Directing and Combining Multiple Queries for Exploratory Search by Visual Interactive Intent Modeling
Human-Computer Interaction – INTERACT 2021AbstractIn interactive information-seeking, a user often performs many interrelated queries and interactions covering multiple aspects of a broad topic of interest. Especially in difficult information-seeking tasks the user may need to find what is in ...
Visually Linked Keywords to Support Exploratory Browsing
CHIIR '21: Proceedings of the 2021 Conference on Human Information Interaction and RetrievalAcademic digital library searchers often employ exploratory search strategies when faced with the complex search task of finding academic literature on a topic that is new to them. Unfortunately, the interfaces employed by academic digital libraries ...
Personalized support in exploratory search
IIIX '12: Proceedings of the 4th Information Interaction in Context SymposiumComplex tasks like answering research questions or solving problems require to carry out longitudinal processes where different information objects need to be gathered, collected, interpreted, analyzed, and evaluated [1]. Such a process normally ...
Comments