Abstract
This article presents a classification method that makes possible the detection of important decision strategies that people use in nonrisky multiattribute decision tasks. The classification method incorporates a multimethod approach that combines elements of both structural modeling and process tracing. We begin with a discussion of nine common characteristics of decision strategies and then classify 13 decision strategies on the basis of these characteristics. Next, we demonstrate that six of the characteristics can be used to develop one outcome-based and three process-based metrics. In addition, we present an algorithm that shows how to use the metrics. We demonstrate that using our metrics in conjunction with a measure for direction of search allows identification of most of the 13 decision strategies. Finally, we outline the potential of our research for the design of decision support systems such as online shops.
Article PDF
Similar content being viewed by others
References
Abelson, R. P., & Levi, A. (1985). Decision making and decision theory. In G. Lindzey & E. Aronson (Eds.), The handbook of social psychology (3rd ed., pp. 231–309). New York: Random House.
Anderson, N. H. (1974). Algebraic models of perception. In E. C. Carterette & M. P. Friedman (Eds.), Handbook of perception (Vol. 2). New York: Academic Press.
Arch, D. C., Bettman, J. R., & Kakkar, P. (1978). Subjects’ information processing in information display board studies. In H. K. Hunt (Ed.), Advances in consumer research (Vol. 5, pp. 555–560). Ann Arbor, MI: Association for Consumer Research.
Awad, N. F., Jones, J. L., & Zhang, J. (2006). Does search mater? Using online clickstream data to examine the relationship between online search and purchase behavior. In D. Straub, S. Klein, W. Haseman, & C. Washburne (Eds.), Proceedings of the Twenty-Seventh International Conference on Information Systems (pp. 1159–1174). Milwaukee, WI: Association for Information Systems.
Ball, C. (1997). A comparison of single-step and multiple-step transition analyses of multiattribute decision strategies. Organizational Behavior & Human Decision Processes, 69, 195–204.
Bettman, J. R., & Park, C. W. (1980). Effects of prior knowledge and experience and phase of the choice process on consumer decision processes: A protocol analysis. Journal of Consumer Research, 7, 234–248.
Biggs, S. F., Bedard, J. C., Gaber, B. G., & Linsmeier, T. J. (1985). The effects of task size and similarity on the decision behavior of bank loan officers. Management Science, 31, 970–987.
Billings, R. S., & Marcus, S. (1983). Measures of compensatory and noncompensatory models of decision behavior: Process tracing versus policy capturing. Organizational Behavior & Human Performance, 31, 331–352.
Billings, R. S., & Scherer, L. L. (1988). The effects of response mode and importance on decision-making strategies: Judgment versus choice. Organizational Behavior & Human Decision Processes, 41, 1–19.
Böckenholt, U., & Hynan, L. S. (1994). Caveats on a process-tracing measure and a remedy. Journal of Behavioral Decision Making, 7, 103–117.
Bowman, V. J., & Colantoni, C. S. (1973). Majority rule under transitivity constraints. Management Science, 19, 1029–1041.
Brehmer, B. (1994). The psychology of linear judgement models. Acta Psychologica, 87, 137–154.
Bröder, A. (2002). Take the best, Dawes’ rule, and compensatory decision strategies: A regression-based classification method. Quality & Quantity, 36, 219–238.
Browne, G. J., Pitts, M. G., & Wetherbe, J. C. (2007). Cognitive stopping rules for terminating information search in online tasks. MIS Quarterly, 31, 89–104.
Brucks, M. (1988). Search monitor: An approach for computercontrolled experiments involving customer information search. Journal of Customer Research, 15, 117–121.
Bucklin, R. E., & Sismeiro, C. (2003). A model of Web site browsing behavior estimated on clickstream data. Journal of Marketing Research, 40, 249–267.
Chatterjee, P., Hoffman, D. L., & Novak, T. P. (2003). Modeling the clickstream: Implications for Web-based advertising efforts. Marketing Science, 22, 520–542.
Cook, G. J. (1993). An empirical investigation of information search strategies with implications for decision support system design. Decision Sciences, 24, 683–697.
Cook, G. J., & Swain, M. R. (1993). A computerized approach to decision process tracing for decision support system design. Decision Sciences, 24, 931–952.
Cook, R. L., & Stewart, T. R. (1975). A comparison of seven methods for obtaining subjective descriptions of judgmental policy. Organizational Behavior & Human Performance, 13, 31–45.
Coombs, C. H. A. (1964). Theory of data. New York: Wiley.
Costa-Gomes, M., Crawford, V. P., & Broseta, B. (2001). Cognition and behavior in normal-form games: An experimental study. Econometrica, 69, 1193–1235.
Cothey, V. (2002). A longitudinal study of World Wide Web users’ information-searching behavior. Journal of the American Society for Information Science & Technology, 53, 67–78.
Covey, J. A., & Lovie, A. D. (1998). Information selection and utilization in hypothesis testing: A comparison of process-tracing and structural analysis techniques. Organizational Behavior & Human Decision Processes, 75, 56–74.
Dahlstrand, V., & Montgomery, H. (1984). Information search and evaluation processes in decision-making: A computer-based processtracing study. Acta Psychologica, 56, 113–123.
Dawes, R. M. (1964). Social selection based on multidimensional criteria. Journal of Abnormal & Social Psychology, 68, 104–109.
Dawes, R. M. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34, 571–582.
Dawes, R. M., & Corrigan, B. (1974). Linear models in decision making. Psychological Bulletin, 81, 95–106.
Einhorn, H. J. (1970). The use of non-linear, noncompensatory models in decision making. Psychological Bulletin, 73, 221–230.
Einhorn, H. J. (1971). Use of nonlinear, noncompensatory models as a function of task and amount of information. Organizational Behavior & Human Performance, 6, 1–27.
Einhorn, H. J., & Hogarth, R. M. (1975). Unit weighting schemes for decision making. Organizational Behavior & Human Performance, 13, 171–192.
Einhorn, H. J., Kleinmuntz, D. N., & Kleinmuntz, B. (1979). Linear regression and process-tracing models of judgment. Psychological Review, 86, 465–485.
Ericsson, K. A., & Simon, H. A. (1980). Verbal protocols as data. Psychological Review, 87, 215–251.
Ericsson, K. A., & Simon, H. A. (1984). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
Fishburn, P. C. (1974). Lexographic orders, utilities and decision rules: A survey. Management Science, 20, 1442–1471.
Ford, J. K., Schmitt, N., Schechtmann, S. L., Hults, B. M., & Doherty, M. L. (1989). Process tracing methods: Contributions, problems and neglected research questions. Organizational Behavior & Human Decision Processesv, 43, 75–117.
Gensch, D. H. (1987). A two-stage disaggregate attribute choice model. Marketing Science, 6, 223–231.
Gigerenzer, G., & Goldstein, D. G. (1996). Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review, 103, 650–669.
Goldstein, D. G., & Gigerenzer, G. (2002). Models of ecological rationality: The recognition heuristic. Psychological Review, 109, 75–90.
Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York: Wiley.
Harte, J. M., & Koele, P. (1995). A comparision of different methods for the elicitation of attribute weights: Structural modeling, process tracing, and self-reports. Organizational Behavior & Human Decision Processes, 64, 49–64.
Harte, J. M., & Koele, P. (2001). Modelling and describing human judgment processes: The multiattribute evaluation case. Thinking & Reasoning, 7, 29–49.
Hastie, R., & Dawes, R. M. (2001). Rational choice in an uncertain world: The psychology of judgment and decision making. Thousand Oaks, CA: Sage.
Hayek, F. A. (1962). Rules, perception, and intelligibility. Proceedings of the British Academy, 48, 321–344.
Hogarth, R. M. (1975). Decision time as a function of task complexity. In D. Wendt & C. A. J. Viek (Eds.), Utility, probability, and human decision making (pp. 321–338). Dordrecht: Riedel.
Huber, O., Wider, R., & Huber, O. W. (1997). Active information search and complete information presentation in naturalistic risky decision tasks. Acta Psychologica, 95, 15–29.
Inada, K. I. (1964). A note on the simple majority decision rule. Econometrica, 32, 525–531.
Inada, K. I. (1969). The simple majority decision rule. Econometrica, 37, 490–506.
Jacoby, J., Chestnut, R. W., Weigl, K. C., & Fisher, W. (1976). Prepurchase information acquisition: Description of a process methodology, research paradigm, and pilot investigation. In B. B. Anderson (Ed.), Advances in consumer research (Vol. 3, pp. 306–314). Cincinnati, OH: Association for Consumer Research.
Jaillet, H. F. (2002). Web metrics: Measuring patterns in online shopping. Journal of Consumer Behavior, 2, 369–381.
Jarvenpaa, S. L. (1989). The effect of task demands and graphical format on information processing strategies. Management Science, 35, 285–303.
Jasper, J. D., & Levin, I. P. (2001). Validating a new process tracing method for decision making. Behavior Research Methods, Instruments, & Computers, 33, 496–512.
Jasper, J. D., & Shapiro, J. (2002). MouseTrace: A better mousetrap for catching decision processes. Behavior Research Methods, Instruments, & Computers, 34, 364–374.
Johnson, E. J., Moe, W. W., Fader, P. S., Bellman, S., & Lohse, G. L. (2004). On the depth and dynamics of online search behavior. Management Science, 50, 299–308.
Johnson, E. J., & Payne, J. W. (1985). Effort and accuracy in choice. Management Science, 31, 395–414.
Jungermann, H., Pfister, H.-R., & Fischer, K. (2005). Die Psychologie der Entscheidung: Eine Einführung (2nd ed.). Heidelberg: Elsevier.
Just, M. A., & Carpenter, P. A. (1976). Eye fixations and cognitive processes. Cognitive Psychology, 8, 441–480.
Keeney, R. L., & Raiffa, H. (1976). Decisions with multiple objects: Preferences and value tradeoffs. New York: Wiley.
Klayman, J. (1982). Simulations of six decision strategies: Comparisons of search patterns, processing characteristics, and response to task complexity (Working Paper No. 100). Chicago: University of Chicago, Center for Decision Research.
Klayman, J. (1983). Analysis of predecisional information search patterns. In P. Humphreys, O. Svenson, & A. Vári (Eds.), Analysing and aiding decision processes (pp. 401–414). Amsterdam: North-Holland.
Klayman, J. (1985). Children’s decision strategies and their adaptation to task characteristics. Organizational Behavior & Human Decision Processes, 35, 179–201.
Lee, W. (1971). Decision theory and human behavior. New York: Wiley.
Levin, I. P., & Jasper, J. D. (1995). Phased narrowing: A new process tracing method for decision making. Organizational Behavior & Human Decision Processes, 64, 1–8.
Lohse, G. L., & Johnson, E. J. (1996). A comparison of two process tracing methods for choice tasks. Organizational Behavior & Human Decision Processes, 68, 28–43.
Lohse, G. L., & Spiller, P. (1998). Electronic shopping: The effect of customer interfaces on traffic and sales. Communications of the ACM, 41, 81–87.
Miller, G. A. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63, 81–97.
Montgomery, A. L., Hosanagar, K., Krishnan, R., & Clay, K. B. (2004). Designing a better shopbot. Management Science, 50, 189–206.
Montgomery, H. (1983). Decision rules and the search for a dominance structure: Towards a process model of decision making. In P. Humphreys, O. Svenson, & A. Vári (Eds.), Analysing and aiding decision processes (pp. 343–369). Amsterdam: North-Holland.
Montgomery, H., & Svenson, O. (1976). On decision rules and information processing strategies for choices among multiattribute alternatives. Scandinavian Journal of Psychology, 17, 283–291.
Mynatt, C. R., Doherty, M. E., & Dragan, W. (1993). Information relevance, working memory, and the consideration of alternatives. Quarterly Journal of Experimental Psychology, 46A, 759–778.
Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice Hall.
Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal protocols on mental processes. Psychological Review, 84, 231–259.
Olshavsky, R. W. (1979). Task complexity and contingent processing in decision making: A replication and extension. Organizational Behavior & Human Performance, 24, 300–316.
Payne, J. W. (1976). Task complexity and contingent processing in decision making: An information search and protocol analysis. Organizational Behavior & Human Decision Processes, 16, 366–387.
Payne, J. W., Bettman, J. R., Coupey, E., & Johnson, E. J. (1992). A constructive process view of decision making: Multiple strategies in judgment and choice. Acta Psychologica, 80, 107–141.
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1993). The adaptive decision maker. Cambridge: Cambridge University Press.
Payne, J. W., & Braunstein, M. L. (1978). Risky choice: An examination of information acquisition behavior. Memory & Cognition, 6, 554–561.
Payne, J. W., Braunstein, M. L., & Carroll, J. S. (1978). Exploring predecisional behavior: An alternative approach to decision research. Organizational Behavior & Human Decision Processes, 22, 17–44.
Pollay, R. W. (1970). A model of decision times in difficult decision situations. Psychological Review, 77, 274–281.
Russo, J. E. (1978a). Adaptation of cognitive processes to eye movement systems. In J. W. Senders, D. F. Fisher, & R. A. Monty (Eds.), Eye movements and higher psychological functions (pp. 89–109). Hillsdale, NJ: Erlbaum.
Russo, J. E. (1978b). Eye fixations can save the world: A critical evaluation and a comparison between eye fixations and other information processing methodologies. In H. K. Hunt (Ed.), Advances in consumer research (Vol. 5, pp. 561–570). Ann Arbor, MI: Association for Consumer Research.
Russo, J. E., & Dosher, B. A. (1983). Strategies for multiattribute binary choice. Journal of Experimental Psychology: Learning, Memory, & Cognition, 9, 676–696.
Russo, J. E., & Rosen, L. D. (1975). An eye fixation analysis of multialternative choice. Memory & Cognition, 3, 267–276.
Sen, A. K. (1966). A possibility theorem on majority decisions. Econometrica, 34, 491–499.
Sen, A. K., & Pattanaik, P. K. (1969). Necessary and sufficient conditions for rational choice under majority decision. Journal of Economic Theory, 1, 178–202.
Simon, H. A. (1955). A behavioral model of rational choice. Quarterly Journal of Economics, 69, 99–118.
Slovic, P., & Lichtenstein, S. (1971). Comparison of Bayesian and regression approaches to the study of information processing in judgment. Organizational Behavior & Human Performance, 6, 649–744.
Summers, D. A., Taliaferro, J. D., & Fletcher, D. J. (1970). Subjective vs. objective description of judgment policy. Psychonomic Science, 18, 249–250.
Svenson, O. (1979). Process descriptions of decision making. Organizational Behavior & Human Performance, 23, 86–112.
Svenson, O. (1983). Decision rules and information processing in decision making. In L. Sjöberg, T. Tyszka, & J. Wise (Eds.), Human decision making (pp. 131–162). Bodafors, Sweden: Doxa.
Tabatabai, M. (1998). Investigation of decision making process: A hypermedia approach. Interacting With Computers, 9, 385–396.
Todd, P., & Benbasat, I. (1987). Process tracing methods in decision support systems research: Exploring the black box. MIS Quarterly, 11, 492–512.
Todd, P., & Benbasat, I. (1991). An experimental investigation of the impact of computer based decision aids on decision making strategies. Information Systems Research, 2, 87–115.
Tversky, A. (1969). Intransitivity of preferences. Psychological Review, 76, 31–48.
Tversky, A. (1972). Elimination by aspects: A theory of choice. Psychological Review, 79, 281–299.
van Raaij, W. F. (1976). Consumer choice behaviour: An informationprocessing approach. Tilburg, The Netherlands: Katholieke Hogeschool te Tilburg.
Venkatesh, V., & Agarwal, R. (2006). Turning visitors into customers: A usability-centric perspective on purchase behavior in electronic channels. Management Science, 52, 367–382.
von Winterfeldt, D., & Fischer, G. W. (1975). Multiattribute utility theory: Models and assessment procedures. In D. Wendt & C. A. J. Viek (Eds.), Utility, probability, and human decision making (pp. 47–86). Dordrecht: Riedel.
Westenberg, M. R. M., & Koele, P. (1994). Multi-attribute evalua-tion processes: Methodological and conceptional issues. Acta Psychologica, 87, 65–84.
Wilkins, L. T. (1964). Appendix IV: Confidence and competence in decision making. In Social deviance: Social policy, action and research (pp. 294–304). London: Tavistock.
Williamson, J., Ranyard, R., & Cuthbert, L. (2000). A conversationbased process tracing method for use with naturalistic decisions: An evaluation study. British Journal of Psychology, 91, 203–221.
Wright, P., & Barbour, F. (1977). Phased decision strategies: Sequels to an initial screening (Research Paper No. 353). Stanford, CA: Stanford University, Graduate School of Business.
Yntema, D. B., & Torgerson, W. S. (1961). Man-computer cooperation in decision requiring common sense. IRE Transactions of Human Factors in Electronics, 2, 20–26.
Author information
Authors and Affiliations
Corresponding author
Additional information
E.B. was supported by Austrian Science Fund (FWF) Grant P18907-G11.
Rights and permissions
About this article
Cite this article
Riedl, R., Brandstätter, E. & Roithmayr, F. Identifying decision strategies: A process- and outcome-based classification method. Behavior Research Methods 40, 795–807 (2008). https://doi.org/10.3758/BRM.40.3.795
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BRM.40.3.795