Alan Medlar
ABSTRACT
Query suggestions have been shown to benefit users performing information retrieval tasks. In exploratory search, however, users may lack the necessary domain knowledge to assess the relevance of query suggestions with respect to their information needs. In this article, we investigate the use of alternative queries in exploratory search. Alternative queries are queries that would retrieve similar search results to those currently visible on-screen. They are independent of the original search query and can, therefore, be updated dynamically as users scroll through search results. In addition to being follow-on queries, alternative queries serve as keyword summaries of the current search results page to help users assess whether results are inline with their search intents. We investigated the use of alternative queries in scientific literature search and their impact on user behavior and perception. In a user study, participants inspected half as many documents per query when alternative queries were present, but were exposed to over 40% more search results overall. Despite using them extensively as follow-on queries, user feedback focused on the summarization properties offered by alternative queries; finding it reassuring that documents were relevant to their search goals.
- Jae-wook Ahn, Peter Brusilovsky, Jonathan Grady, Daqing He, and Radu Florian. 2010. Semantic annotation based exploratory search for information analysts. Information processing & management , Vol. 46, 4 (2010), 383--402.Google Scholar
- Kumaripaba Athukorala, Dorota Głowacka, Giulio Jacucci, Antti Oulasvirta, and Jilles Vreeken. 2016a. Is exploratory search different? A comparison of information search behavior for exploratory and lookup tasks. Journal of the Association for Information Science and Technology , Vol. 67, 11 (2016), 2635--2651.Google ScholarDigital Library
- Kumaripaba Athukorala, Alan Medlar, Antti Oulasvirta, Giulio Jacucci, and Dorota Glowacka. 2016b. Beyond relevance: adapting exploration/exploitation in information retrieval. In Proceedings of the 21st International Conference on Intelligent User Interfaces. ACM, 359--369.Google ScholarDigital Library
- Kumaripaba Athukorala, Antti Oulasvirta, Dorota Głowacka, Jilles Vreeken, and Giulio Jacucci. 2014. Narrow or broad?: Estimating subjective specificity in exploratory search. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management. ACM, 819--828.Google ScholarDigital Library
- Santosh Kumar Bharti and Korra Sathya Babu. 2017. Automatic keyword extraction for text summarization: A survey. arXiv preprint arXiv:1704.03242 (2017).Google Scholar
- Sumit Bhatia, Debapriyo Majumdar, and Prasenjit Mitra. 2011. Query suggestions in the absence of query logs. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval . 795--804.Google ScholarDigital Library
- John Brooke et almbox. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry , Vol. 189, 194 (1996), 4--7.Google Scholar
- Huanhuan Cao, Daxin Jiang, Jian Pei, Qi He, Zhen Liao, Enhong Chen, and Hang Li. 2008. Context-aware query suggestion by mining click-through and session data. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. 875--883.Google ScholarDigital Library
- Claudio Carpineto, Renato De Mori, Giovanni Romano, and Brigitte Bigi. 2001. An information-theoretic approach to automatic query expansion. ACM Transactions on Information Systems (TOIS) , Vol. 19, 1 (2001), 1--27.Google ScholarDigital Library
- Duen Horng Chau, Aniket Kittur, Jason I Hong, and Christos Faloutsos. 2011. Apolo: making sense of large network data by combining rich user interaction and machine learning. In Proceedings of the SIGCHI conference on human factors in computing systems. 167--176.Google ScholarDigital Library
- Dongho Choi. 2017. A Study of Information Seeking Behavior: Investigating Exploratory Behavior in Physical & Online Spaces .Rutgers The State University of New Jersey-New Brunswick.Google Scholar
- Fernando Diaz, Bhaskar Mitra, and Nick Craswell. 2016. Query Expansion with Locally-Trained Word Embeddings. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics . 367--377.Google ScholarCross Ref
- Marian Dörk, Sheelagh Carpendale, Christopher Collins, and Carey Williamson. 2008. Visgets: Coordinated visualizations for web-based information exploration and discovery. IEEE Transactions on Visualization and Computer Graphics , Vol. 14, 6 (2008), 1205--1212.Google ScholarDigital Library
- Tamas E Doszkocs. 1978. AID, an associative interactive dictionary for online searching. Online Review , Vol. 2, 2 (1978), 163--173.Google ScholarCross Ref
- Dorota Glowacka, Tuukka Ruotsalo, Ksenia Konuyshkova, Samuel Kaski, Giulio Jacucci, et almbox. 2013. Directing exploratory search: Reinforcement learning from user interactions with keywords. In Proceedings of the 2013 international conference on Intelligent user interfaces. ACM, 117--128.Google ScholarDigital Library
- Brynjar Gretarsson, John O?donovan, Svetlin Bostandjiev, Tobias Höllerer, Arthur Asuncion, David Newman, and Padhraic Smyth. 2012. Topicnets: Visual analysis of large text corpora with topic modeling. ACM Transactions on Intelligent Systems and Technology (TIST) , Vol. 3, 2 (2012), 1--26.Google ScholarDigital Library
- Qi He, Daxin Jiang, Zhen Liao, Steven CH Hoi, Kuiyu Chang, Ee-Peng Lim, and Hang Li. 2009. Web query recommendation via sequential query prediction. In 2009 IEEE 25th international conference on data engineering. IEEE, 1443--1454.Google ScholarDigital Library
- Geoffrey E Hinton and Ruslan R Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science , Vol. 313, 5786 (2006), 504--507.Google Scholar
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation , Vol. 9, 8 (1997), 1735--1780.Google Scholar
- K Sparck Jones, Steve Walker, and Stephen E. Robertson. 2000. A probabilistic model of information retrieval: development and comparative experiments. Information processing & management , Vol. 36, 6 (2000), 779--840.Google Scholar
- Rosie Jones, Benjamin Rey, Omid Madani, and Wiley Greiner. 2006. Generating query substitutions. In Proceedings of the 15th international conference on World Wide Web. ACM, 387--396.Google ScholarDigital Library
- Mika K"aki. 2005. Findex: search result categories help users when document ranking fails. In Proceedings of the SIGCHI conference on Human factors in computing systems . 131--140.Google Scholar
- Antti Kangasr"a"asiö , Yi Chen, Dorota Głowacka, and Samuel Kaski. 2016. Interactive Modeling of Concept Drift and Errors in Relevance Feedback. In Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization. ACM, 185--193.Google Scholar
- Diane Kelly, Karl Gyllstrom, and Earl W Bailey. 2009. A comparison of query and term suggestion features for interactive searching. In Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval. 371--378.Google ScholarDigital Library
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).Google Scholar
- Jürgen Koenemann and Nicholas J Belkin. 1996. A case for interaction: A study of interactive information retrieval behavior and effectiveness. In Proceedings of the SIGCHI conference on human factors in computing systems. 205--212.Google ScholarDigital Library
- Saar Kuzi, Anna Shtok, and Oren Kurland. 2016. Query expansion using word embeddings. In Proceedings of the 25th ACM international on conference on information and knowledge management. ACM, 1929--1932.Google ScholarDigital Library
- Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In International Conference on Machine Learning. 1188--1196.Google ScholarDigital Library
- Matteo Lissandrini, Davide Mottin, Themis Palpanas, and Yannis Velegrakis. 2020. Graph-Query Suggestions for Knowledge Graph Exploration. In Proceedings of The Web Conference 2020. 2549--2555.Google ScholarDigital Library
- Shixia Liu, Michelle X Zhou, Shimei Pan, Yangqiu Song, Weihong Qian, Weijia Cai, and Xiaoxiao Lian. 2012. Tiara: Interactive, topic-based visual text summarization and analysis. ACM Transactions on Intelligent Systems and Technology (TIST) , Vol. 3, 2 (2012), 1--28.Google ScholarDigital Library
- Chao Ma and Bin Zhang. 2018. A New Query Recommendation Method Supporting Exploratory Search Based on Search Goal Shift Graphs. IEEE Transactions on Knowledge and Data Engineering , Vol. 30, 11 (2018), 2024--2036.Google ScholarDigital Library
- G. Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM , Vol. 49, 4 (2006), 41--46.Google ScholarDigital Library
- Justin Matejka, Tovi Grossman, and George Fitzmaurice. 2012. Citeology: visualizing paper genealogy. In CHI'12 Extended Abstracts on Human Factors in Computing Systems. ACM, 181--190.Google ScholarDigital Library
- Alan Medlar and Dorota Glowacka. 2018. How Consistent is Relevance Feedback in Exploratory Search?. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. ACM, 1615--1618.Google ScholarDigital Library
- Alan Medlar, Kalle Ilves, Ping Wang, Wray Buntine, and Dorota Glowacka. 2016. PULP: A system for exploratory search of scientific literature. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 1133--1136.Google ScholarDigital Library
- Alan Medlar, Joel Pyykkö, and Dorota Glowacka. 2017. Towards Fine-Grained Adaptation of Exploration/Exploitation in Information Retrieval. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (Limassol, Cyprus) (IUI '17). Association for Computing Machinery, New York, NY, USA, 623--627. https://doi.org/10.1145/3025171.3025205Google ScholarDigital Library
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems. 3111--3119.Google Scholar
- Mandar Mitra, Amit Singhal, and Chris Buckley. 1998. Improving automatic query expansion. In Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 206--214.Google ScholarDigital Library
- Saeed Mohajeri, Hamman W Samuel, Osmar R Zalane, and Davood Rafiei. 2016. BubbleNet: An innovative exploratory search and summarization interface with applicability in health social media. In 2016 International Conference on Digital Economy (ICDEc). IEEE, 37--44.Google ScholarCross Ref
- Atsushi Otsuka, Yohei Seki, Noriko Kando, and Tetsuji Satoh. 2012. QAque: faceted query expansion techniques for exploratory search using community QA resources. In Proceedings of the 21st International Conference on World Wide Web. 799--806.Google ScholarDigital Library
- Pearl Pu, Li Chen, and Rong Hu. 2011. A user-centric evaluation framework for recommender systems. In Proceedings of the fifth ACM conference on Recommender systems. ACM, 157--164.Google ScholarDigital Library
- Joseph John Rocchio. 1971. Relevance feedback in information retrieval. The SMART retrieval system: experiments in automatic document processing (1971), 313--323.Google Scholar
- Tuukka Ruotsalo, Giulio Jacucci, and Samuel Kaski. 2020. Interactive faceted query suggestion for exploratory search: Whole-session effectiveness and interaction engagement. Journal of the Association for Information Science and Technology (2020).Google Scholar
- Mark Sanderson and Bruce Croft. 1999. Deriving concept hierarchies from text. In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval . 206--213.Google ScholarDigital Library
- Hinrich Schütze, Christopher D Manning, and Prabhakar Raghavan. 2008. Introduction to information retrieval . Vol. 39. Cambridge University Press Cambridge.Google Scholar
- Milad Shokouhi. 2013. Learning to personalize query auto-completion. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval . 103--112.Google ScholarDigital Library
- Alessandro Sordoni, Yoshua Bengio, Hossein Vahabi, Christina Lioma, Jakob Grue Simonsen, and Jian-Yun Nie. 2015. A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management . 553--562.Google ScholarDigital Library
- Ryen W White, Mikhail Bilenko, and Silviu Cucerzan. 2007. Studying the use of popular destinations to enhance web search interaction. In Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval. 159--166.Google ScholarDigital Library
- Ryen W White and Resa A Roth. 2009. Exploratory search: Beyond the query-response paradigm. Synthesis lectures on information concepts, retrieval, and services , Vol. 1, 1 (2009), 1--98.Google ScholarDigital Library
- Hamed Zamani and W Bruce Croft. 2017. Relevance-based word embedding. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 505--514.Google ScholarDigital Library
- Jian Zhao, Christopher Collins, Fanny Chevalier, and Ravin Balakrishnan. 2013. Interactive exploration of implicit and explicit relations in faceted datasets. IEEE Transactions on Visualization and Computer Graphics , Vol. 19, 12 (2013), 2080--2089.Google ScholarDigital Library
- Jianling Zhong, Weiwei Guo, Huiji Gao, and Bo Long. 2020. Personalized Query Suggestions. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval . 1645--1648.Google ScholarDigital Library
Index Terms
- Query Suggestions as Summarization in Exploratory Search
Recommendations
Graph Learning for Exploratory Query Suggestions in an Instant Search System
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge ManagementSearch systems in online content platforms are typically biased toward a minority of highly consumed items, reflecting the most common user behavior of navigating toward content that is already familiar and popular. Query suggestions are a powerful tool ...
Type-ahead exploratory search through typo and word order tolerant autocompletion
There is an increasing interest on recommending to the user instantly (during typing characters) queries and query results. This is evidenced by the emergence of several systems that offer such functionalities, e.g. Google Instant Search for Web ...
Intent models for contextualising and diversifying query suggestions
CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge ManagementThe query suggestion or auto-completion mechanisms help users to type less while interacting with a search engine. A basic approach that ranks suggestions according to their frequency in query logs is suboptimal. Firstly, many candidate queries with the ...
Comments