Antti Oulasvirta
Janne P. Hukkinen
Barry Schwartz
ABSTRACT
In numerous everyday domains, it has been demonstrated that increasing the number of options beyond a handful can lead to paralysis and poor choice and decrease satisfaction with the choice. Were this so-called paradox of choice to hold in search engine use, it would mean that increasing recall can actually work counter to user satisfaction if it implies choice from a more extensive set of result items. The existence of this effect was demonstrated in an experiment where users (N=24) were shown a search scenario and a query and were required to choose the best result item within 30 seconds. Having to choose from six results yielded both higher subjective satisfaction with the choice and greater confidence in its correctness than when there were 24 items on the results page. We discuss this finding in the wider context of "choice architecture"--that is, how result presentation affects choice and satisfaction.
- Asch, S. Forming Impressions of Personality. Taylor&Francis Group, 2004 (Re-print, original printed 1946.)Google Scholar
- Aula, A., Jhaveri, N., and Käki, M. Information search and re-access strategies of experienced web users. In Proc. WWW 2005, ACM Press (2005), New York, USA, pp. 583--592. Google ScholarDigital Library
- Aula, A., Majaranta, P., and Raiha, K. Eye-tracking reveals the personal styles for search result evaluation. Lecture Notes in Computer Science 3585 (2005), 1058. Google ScholarDigital Library
- Beitzel, S., Jensen, E., Chowdhury, A., Grossman, D., and Frieder, O. Hourly analysis of a very large topically categorized web query log. In Proc. SIGIR'04, ACM Press (2004), New York, USA, pp. 321--328. Google ScholarDigital Library
- Broder, A. A taxonomy of web search. SIGIR Forum 36, 2 (2002), 3--10. Google ScholarDigital Library
- Brookes, B. Measurement in information science: objective and subjective metrical space. Journal of the American Society for Information Science 31, 4 (1980), 248--255.Google ScholarCross Ref
- Byrne, M., John, B., Wehrle, N., and Crow, D. The tangled web we wove: A taskonomy of WWW use. In Proc. CHI'99, ACM Press (1999), New York, USA, pp. 544--551. Google ScholarDigital Library
- Clancy, K., and Wachsler, R. Positional effects in shared-cost surveys. Public Opinion Quarterly 35, 2 (1971), 258--265.Google ScholarCross Ref
- Clarke, C., Agichtein, E., Dumais, S., and White, R. The influence of caption features on clickthrough patterns in web search. In Proc. SIGIR'07, ACM Press (2007), New York, USA, pp. 135--142. Google ScholarDigital Library
- Cutrell, E., and Guan, Z. What are you looking for?: an eye-tracking study of information usage in web search. In Proc. CHI'07, ACM Press (2007), New York, USA, pp. 407--416. Google ScholarDigital Library
- Eisenberg, M., and Barry, C. Order effects: A study of the possible influence of presentation order on user judgments of document relevance. JASIS 39, 5 (1988), 293--300.Google ScholarCross Ref
- Granka, L., Joachims, T., and Gay, G. Eye-tracking analysis of user behavior in www search. In Proc. SIGIR'04, ACM Press (2004), New York, USA, pp. 478--479. Google ScholarDigital Library
- Hogarth, R., and Einhorn, H. Order effects in belief updating: The belief-adjustment model. Cognitive Psychology 24, 1 (1992), 1--55.Google ScholarCross Ref
- Huang, M., and Wang, H. The influence of document presentation order and number of documents judged on users' judgments of relevance. JASIST 55, 11 (2004), 970--979. Google ScholarDigital Library
- Iyengar, S., and Lepper, M. When choice is demotivating: Can one desire too much of a good thing? Journal of Personality and Social Psychology 79, 6 (2000), 995--1006.Google ScholarCross Ref
- Iyengar, S., Jiang, W., and Huberman, G. How much choice is too much? contributions to 401 (k) retirement plans. Pension Design and Structure: New Lessons from Behavioral Finance (2004), 83--96.Google Scholar
- Jansen, B., and Spink, A. An analysis of web documents retrieved and viewed. In Internet Computing Conference (2003).Google Scholar
- Jansen, B., Spink, A., and Pedersen, J. A temporal comparison of altavista web searching. Journal of the American Society for Information Science and Technology 56, 6 (2005), 559--570. Google ScholarDigital Library
- Kahneman, D., and Tversky, A. Prospect theory: An analysis of decision under risk. Bradford Books, 2004.Google Scholar
- Katzer, J., and Snyder, H. Toward a more realistic assessment of information retrieval performance. In Proc. ASIS 1990, pp. 80--85.Google Scholar
- Kellar, M., Watters, C., and Shepherd, M. A goal-based classification of web information tasks. In Proc. ASIST'06.Google Scholar
- Keppel, G., and Wickens, T.D. Design and Analysis: A Researcher's Handbook (4th International Ed.). Upper Saddle River, NJ: Pearson Prentice-Hall.Google Scholar
- Kochen, M. Principles of information retrieval. Los Angeles, CA: Melville, 1974.Google Scholar
- Lorigo, L., Pan, B., Hembrooke, H., Joachims, T., Granka, L., and Gay, G. The influence of task and gender on search and evaluation behavior using google. Information Processing and Management 42, 4 (2006), 1123--1131. Google ScholarDigital Library
- Mogilner, C., Rudnick, T., and Iyengar, S. The mere categorization effect: How the presence of categories increases choosers' perceptions of assortment variety and outcome satisfaction. Journal of Consumer Research 35 (2008), 202--215.Google ScholarCross Ref
- Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G., and Granka, L. In Google we trust: Users' decisions on rank, position, and relevance. Journal of Computer-Mediated Communication 12, 3 (2007), 801--823.Google ScholarCross Ref
- Parker, L., and Johnson, R. Does order of presentation affect users' judgment of documents? JASIS 41, 7 (1990), 493--494.Google Scholar
- Schwartz, B. The Paradox of Choice: Why More Is Less. Harper Perennial, 2005.Google Scholar
- Schwartz, B., Ward, A., Monterosso, J., Lyubomirsky, S., White, K., and Lehman, D. Maximizing versus satisficing: Happiness is a matter of choice. Journal of Personality and Social Psychology 83, 5 (2002), 1178--1197.Google ScholarCross Ref
- Shah, A., and Wolford, G. Buying behavior as a function of parametric variation of number of choices. Psychological Science 18, 5 (2007), 369--370.Google ScholarCross Ref
- Silverstein, C., Marais, H., Henzinger, M., and Moricz, M. Analysis of a very large web search engine query log. ACM SIGIR Forum 33 (1999), 6--12. Google ScholarDigital Library
- Teevan, J. How people recall search result lists. In Proc. CHI'06, ACM Press (2006), New York, USA, pp. 1415--1420. Google ScholarDigital Library
- Thaler, R., and Sunstein, C. Nudge. New Haven: Yale University Press, 2008Google Scholar
Index Terms
- When more is less: the paradox of choice in search engine use
Recommendations
Choice overload in search engine use?
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsSearch engines typically return so many results that choosing from the list might be predicted to suffer from the effects of "choice overload". Preliminary work has reported just such an effect [12]. In this paper a series of three experiments was ...
The mediating effects of habit on continuance intention
Consumer attitudes are stronger predictors of continuance intention, with or without any mediation effects from habit.Consumer satisfaction was moderated by habit; which means that consumers can enhance their level of satisfaction by developing a ...
An analysis of web proxy logs with query distribution pattern approach for search engines
This study presents an analysis of users' queries directed at different search engines to investigate trends and suggest better search engine capabilities. The query distribution among search engines that includes spawning of queries, number of terms ...
Comments