Antti Kangasrääsiö
ABSTRACT
In exploratory search, when a user directs a search engine using uncertain relevance feedback, usability problems regarding controllability and predictability may arise. One problem is that the user is often modelled as a passive source of relevance information, instead of an active entity trying to steer the system based on evolving information needs. This may cause the user to feel that the response of the system is inconsistent with her steering. Another problem arises due to the sheer size and complexity of the information space, and hence of the system, as it may be difficult for the user to anticipate the consequences of her actions in this complex environment. These problems can be mitigated by interpreting the user's actions as setting a goal for an optimization problem regarding the system state, instead of passive relevance feedback, and by allowing the user to see the predicted effects of an action before committing to it. In this paper, we present an implementation of these improvements in a visual user-controllable search interface. A user study involving exploratory search for scientific literature gives some indication on improvements in task performance, usability, perceived usefulness and user acceptance.
Supplemental Material
- Anick, P. Using terminological feedback for web search refinement: A log-based study. In Proc. of SIGIR, ACM (2003), 88--95. Google Scholar
Digital Library
- Brooke, J. SUS - A quick and dirty usability scale. Usability Evaluation in Industry 189 (1996), 194.Google Scholar
- Chau, D. H., Kittur, A., Hong, J. I., and Faloutsos, C. Apolo: making sense of large network data by combining rich user interaction and machine learning. In Proc. of CHI, ACM (2011), 167--176. Google ScholarDigital Library
- Cutting, D. R., Karger, D. R., Pedersen, J. O., and Tukey, J. W. Scatter/gather: A cluster-based approach to browsing large document collections. In Proc. of SIGIR, ACM (1992), 318--329. Google ScholarDigital Library
- Glowacka, D., Ruotsalo, T., Konyushkova, K., Athukorala, K., Kaski, S., and Jacucci, G. Directing exploratory search: Reinforcement learning from user interactions with keywords. In Proc. of IUI, ACM (2013), 117--128. Google ScholarDigital Library
- Karimzadehgan, M., and Zhai, C. Exploration exploitation tradeoff in interactive relevance feedback. In Proc. of CIKM, ACM (2010), 1397--1400. Google ScholarDigital Library
- Kelly, D., and Fu, X. Elicitation of term relevance feedback: An investigation of term source and context. In Proc. of SIGIR, ACM (2006), 453--460. Google ScholarDigital Library
- Kules, B., Wilson, M., Schraefel, M. C., and Shneiderman, B. From keyword search to exploration: How result visualization aids discovery on the web. Tech. rep., 2008.Google Scholar
- Parra, D., Brusilovsky, P., and Trattner, C. See what you want to see: Visual user-driven approach for hybrid recommendation. In Proc. of IUI, ACM (2014), 235--240. Google ScholarDigital Library
- Pu, P., Chen, L., and Hu, R. A user-centric evaluation framework for recommender systems. In Proc. of RecSys, ACM (2011), 157--164. Google ScholarDigital Library
- Radlinski, F., Kleinberg, R., and Joachims, T. Learning diverse rankings with multi-armed bandits. In Proc. of ICML, ACM (2008), 784--791. Google ScholarDigital Library
- Teevan, J., Alvarado, C., Ackerman, M. S., and Karger, D. R. The perfect search engine is not enough: a study of orienteering behavior in directed search. In Proc. of CHI, ACM (2004), 415--422. Google ScholarDigital Library
- Verbert, K., Parra, D., Brusilovsky, P., and Duval, E. Visualizing recommendations to support exploration, transparency and controllability. In Proc. of IUI, ACM (2013), pp. 351--362. Google ScholarDigital Library
- Weber, R. Basic content analysis. Sage, 1990.Google ScholarCross Ref
- Yee, K.-P., Swearingen, K., Li, K., and Hearst, M. Faceted metadata for image search and browsing. In Proc. of CHI, ACM (2003), 401--408. Google ScholarDigital Library
Index Terms
- Improving Controllability and Predictability of Interactive Recommendation Interfaces for Exploratory Search
Recommendations
Interactive Modeling of Concept Drift and Errors in Relevance Feedback
UMAP '16: Proceedings of the 2016 Conference on User Modeling Adaptation and PersonalizationIn exploratory search tasks, users usually start with considerable uncertainty about their search goals, and so the search intent of the user may be volatile as the user is constantly learning and reformulating her search hypothesis during the search. ...
Dealing with Concept Drift in Exploratory Search: An Interactive Bayesian Approach
IUI '16 Companion: Companion Publication of the 21st International Conference on Intelligent User InterfacesIn exploratory search, when the user formulates a query iteratively through relevance feedback, it is likely that the feedback given earlier requires adjustment later on. The main reason for this is that the user learns while searching, which causes ...
Collaborative multi-paradigm exploratory search
WebScience '08: Proceedings of the hypertext 2008 workshop on Collaboration and collective intelligenceNew challenges for advanced web search interfaces and visualization tools arise as user needs shift from traditional lookup tasks towards more open ended search activities collectively described as exploratory search. Exploratory search opens new ...
Comments