Abstract
An online version of a Picture Story Exercise (PSE) was administered to 180 participants to assess implicit motives for achievement, affiliation, and power. First, data were analyzed with respect to different aspects of participant behavior (dropout, writing time, story length, setting). Second, online data were compared with data collected in the laboratory (n = 93). Results regarding motive density, internal consistency, picture profiles, and position effects were comparable among samples and consistent with previous research (Pang and Schultheiss in J Person Assess 85:280–294, 2005; Schultheiss and Brunstein in J Person Assess 77: 71–86, 2001). In addition, online participants completed self-report measures assessing explicit motives and the Big Five personality factors. Explicit motives showed no substantial overlap with PSE motive scores, replicating previous research. Personality factors revealed gender differences in correlates: men with a high implicit power motive reported less agreeableness and conscientiousness. Results suggest that administering the PSE online yields reliable and valid data.
Similar content being viewed by others
Notes
For a recent list of studies conducted online see the American Psychological Society (APS) experiment list maintained by John Krantz: http://psych.hanover.edu/research/exponnet.html.
The PSE assessment was part of a questionnaire for a larger research project on long-term relationships.
Six participants did not provide stories to all four picture cues and were therefore not included in the analysis for overall word count.
When we used raw motive scores we found the same effects: both the Picture × Motive interaction, F(2, 215) = 70.28, p < 0.001, n² = 0.25, and the three-way interaction were significant, F(6, 211) = 2.34, p < 0.05. n² = 0.01.
References
Atkinson, J. W. (1981). Studying personality in the context of an advanced motivational psychology. American Psychologist, 36, 117–128.
Baumann, N., Kaschel, R., & Kuhl, J. (2005). Striving for unwanted goals: Stress-dependent discrepancies between explicit and implicit achievement motives reduce subjective well-being and increase psychosomatic symptoms. Journal of Personality and Social Psychology, 89, 781–799.
Birnbaum, M. H. (2001). Introduction to behavioral research on the Internet. Upper Saddle River, NJ: Prentice Hall.
Birnbaum, M. H. (2004a). Methodological and ethical issues in conducting social psychology research via the Internet. In C. Sansone, C. C. Morf, & A. T. Panter (Eds.), Handbook of methods in social psychology (pp. 359–382). Thousand Oaks, CA: Sage.
Birnbaum, M. H. (2004b). Human research and data collection via the internet. Annual Review of Psychology, 55, 803–832.
Blankenship, V., & Zoota, A. L. (1998). Comparing power imagery in TATs written by hand or on the computer. Behavior Research Methods, Instruments, & Computers, 30, 441–448.
Block, J. (1985). A longitudinal study of ego and cognitive development. Research grant application. Berkeley: University of California Department of Psychology.
Brunstein, J. C., & Hoyer, S. (2002). Implizites und explizites Leistungsstreben: Befunde zur Unabhängigkeit zweier Motivationssysteme [Implicit versus explicit achievement strivings: Empirical evidence of the independence of two motivational systems]. Zeitschrift für Pädagogische Psychologie, 16, 51–62.
Brunstein, J. C., & Maier, G. W. (2005). Implicit and self-attributed motives to achieve: Two separate but interacting needs. Journal of Personality and Social Psychology, 89, 205–222.
Brunstein, J. C., Schultheiss, O. C., & Grässmann, R. (1998). Personal goals and emotional well-being: The moderating role of motive dispositions. Journal of Personality and Social Psychology, 75, 494–508.
Buchanan, T. (2000). Potential of the Internet for personality research. In M. H. Birnbaum (Ed.), Psychological experiments on the Internet (pp. 121–140). San Diego: Academic Press.
Buchanan, T. (2001). Online personality assessment. In U.-D. Reips & M. Bosnjak (Eds.), Dimensions of internet science (pp. 57–74). Lengerich, Germany: Pabst Science Publishers.
Buchanan, T., Johnson, J. A., & Goldberg, L. R. (2005). Implementing a five- personality inventory for use on the internet. European Journal of Psychological Assessment, 21, 115–127.
Buchanan, T., & Smith, J. L. (1999). Using the internet for psychological research: Personality testing on the world-wide web. British Journal of Psychology, 90, 125–144.
deCharms, R., Morrison, H., Reitman, W., & McClelland, D. (1955). Behavioral correlates of directly measured and indirectly measured achievement motivation. In D. McClelland (Ed.), Studies in motivation. New York: Appleton-Century-Crofts.
Dillman, D. A., & Bowker, D. K. (2001). The Web questionnaire challenge to survey methodologists. In U.-D. Reips & M. Bosnjak (Eds.), Dimensions of internet science (pp. 159–178). Lengerich, Germany: Pabst Science Publishers.
Eagly, A. H. (1987). Sex differences in social behavior: A social-role interpretation. Hillsdale, NJ: Erlbaum.
Eagly, A. H. (1997). Sex differences in social behavior: Comparing social role theory and evolutionary psychology. American Psychologist, 52(12), 1380–1383.
Emmons, R. A., & McAdams, D. P. (1991). Personal strivings and motive dispositions: Exploring the links. Personality and Social Psychology Bulletin, 17(6), 648–654.
Falbo, T. (1977). Relationships between sex, sex role, and social influence. Psychology of Women Quarterly, 2(1), 62–72.
Frick, A., Bächtiger, M. T., & Reips, U.-D. (2001). Financial incentives, personal information, and drop-outs in online studies. In U.-D. Reips & M. Bosnjak (Eds.), Dimensions of internet science (pp. 209–219). Lengerich: Pabst Science Publishers.
Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004). Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. American Psychologist, 59, 93–104.
Job, V., & Brandstätter, V. (2009). To get a taste of your goals: Creating motive-goal congruence by affect-focus goal-fantasy. Journal of Personality, 77, 1527–1560.
Job, V., Oertig, D., Allemand, M., & Brandstätter, V. (in press). Motive-discrepancies as antecedents of unhealthy eating behavior. Journal of Personality.
Kehr, H. M. (2004). Implicit/explicit motive discrepancies and volitional depletion among managers. Personality and Social Psychology Bulletin, 30, 315–327.
King, L. A. (1995). Wishes, motives, goals, and personal memories: Relations of measures of human motivation. Journal of Personality, 63, 985–1007.
Klinger, E. (1968). Short-term stability and concurrent validity of TAT and need scores: Achievement, affiliation and hostile press. In Proceedings of the 76th Annual Convention of the American Psychological Association, American Psychologist, 23, 878.
Langan-Fox, J., & Grant, S. (2006). The thematic apperception test: Towards a standard measure of the big three motives. Journal of Personality Assessment, 87, 277–291.
Lundy, A. C. (1980). Conditions of test administration and TAT validity. Unpublished manuscript, Harvard University, Department of Psychology and Social Relations.
Lundy, A. C. (1981). Situationally evoked schema sets in TAT-based research: A cognitive explanation for differential TAT validity. Unpublished doctoral dissertation, Harvard University.
Lundy, A. C. (1985). The reliability of the thematic apperception test. Journal of Personality Assessment, 49, 141–145.
McClelland, D. C. (1985). Human motivation. Glenview, IL: Scott, Foresman.
McClelland, D. C. (1991). The personal value questionnaire. Boston: McBer & Company.
McClelland, D. C., & Jemmott, J. B. (1980). Power motivation, stress and physical illness. Journal of Human Stress, 6, 6–15.
McClelland, D. C., Koestner, R., & Weinberger, J. (1989). How do self-attributed and implicit motives differ? Psychological Review, 96, 690–702.
McClelland, D. C., & Pilon, D. A. (1983). Sources of adult motives in patterns of parent behavior in early childhood. Journal of Personality and Social Psychology, 44, 564–574.
Mischel, W., & Shoda, Y. (1995). A cognitive-affective system theory of personality: Reconceptualizing situations, dispositions, dynamics, and invariance in personality structure. Psychological Review, 102, 246–268.
Murray, H. A. (1943). Thematic apperception test manual. Cambridge: Harvard University Press.
Musch, J., & Klauer, K. C. (2002). Psychological experimenting on the World Wide Web: Investigating content effects in syllogistic reasoning. In B. Batinic, U.-D. Reips, & M. Bosnjak (Eds.), Online social sciences (pp. 181–212). Göttingen, Germany: Hogrefe.
Pang, J. S., & Schultheiss, O. C. (2005). Assessing implicit motives in U.S. college students: Effects of picture type and position, gender and ethnicity, and cross-cultural comparisons. Journal of Personality Assessment, 85, 280–294.
Rammstedt, B., & John, O. P. (2007). Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality, 41, 203–212.
Reips, U.-D. (2000). The web experiment method: Advantages, disadvantages, and solutions. In M. H. Birnbaum (Ed.), Psychological experiments on the Internet (pp. 89–117). San Diego: Academic Press.
Reips, U.-D. (2001). The web experimental psychology lab: Five years of data collection on the internet. Behavior Research Methods, Instruments, & Computers, 33, 201–211.
Reips, U.-D. (2002a). Standards for internet experimenting. Experimental Psychology, 49(4), 243–256.
Reips, U.-D. (2002b). Internet-based psychological experimenting: Five dos and five don’ts. Social Science Computer Review, 20(3), 241–249.
Reips, U.-D. (2002c). Context effects in web surveys. In B. Batinic, U.-D. Reips, & M. Bosnjak (Eds.), Online social sciences. Seattle, WA: Hogrefe & Huber.
Reips, U.-D., & Bosnjak, M. (2001). Dimensions of internet science. Lengerich, Germany: Pabst Science Publishers.
Reips, U.-D., Morger, V., & Meier B. (2001). Fünfe gerade sein lassen: Listenkontexteffekte beim Kategorisieren [“Letting five be equal”: List context effects in categorization]. Unpublished manuscript.
Reips, U.-D., & Neuhaus, C. (2002). WEXTOR: A Webbased tool for generating and visualizing experimental designs and procedures. Behavior Research Methods, Instruments, and Computers, 34, 234–240.
Reuman, D. A. (1982). Ipsative behavioral variability and the quality of thematic apperceptive measurement of the achievement motive. Journal of Personality and Social Psychology, 43(5), 1098–1110.
Schultheiss, O. C. (2008). Implicit motives. In O. P. John, R. W. Robins, & L. A. Pervin (Eds.), Handbook of personality: Theory and research (3rd ed., pp. 603–633). New York: Guilford.
Schultheiss, O. C., & Brunstein, J. C. (2001). Assessment of implicit motives with a research version of the TAT: Picture profiles, gender differences, and relations to other personality measures. Journal of Personality Assessment, 77, 71–86.
Schultheiss, O. C., & Brunstein, J. C. (Eds.). (2010). Implicit motives. New York, NY: Oxford University Press.
Schultheiss, O. C., Liening, S., & Schad, D. (2008a). The reliability of a picture story exercise measure of implicit motives: Estimates of internal consistency, retest reliability, and ipsative stability. Journal of Research in Personality, 42, 1560–1571.
Schultheiss, O. C., & Pang, J. S. (2007). Measuring implicit motives. In R. W. Robins, R. C. Fraley, & R. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 322–344). New York: Guilford.
Schultheiss, O. C., Wirth, M. M., Waugh, C. E., Stanton, S. J., Meier, E., & Reuter-Lorenz, P. (2008b). Exploring the motivational brain: Effects of implicit power motivation on brain activation in response to facial expressions of emotion. Social Cognitive and Affective Neuroscience, 3, 333–343.
Schultheiss, O. C., Yankova, D., Dirlikov, B., & Schad, D. (2009). Are implicit and explicit motive measures statistically independent? A fair and balanced test using the picture story exercise and a cue- and response-matched questionnaire measure. Journal of Personality Assessment, 91, 72–81.
Schwarz, S., & Reips, U.-D. (2001). CGI versus JavaScript: A web experiment on the reversed hindsight bias. In U.-D. Reips & M. Bosnjak (Eds.), Dimensions of internet science (pp. 75–90). Lengerich, Germany: Pabst Science.
Smith, C. P. (1992). Motivation and personality: Handbook of thematic content analysis. New York: Cambridge University Press.
Smith, C. P., Feld, S. C., & Franz, C. E. (1992). Methodological considerations: Steps in research employing content analysis systems. In C. P. Smith (Ed.), Motivation and personality: Handbook of thematic content analysis (pp. 515–536). New York: Cambridge University Press.
Spangler, W. D. (1992). Validity of questionnaire and TAT measures of need for achievement: Two meta-analyses. Psychological Bulletin, 112, 140–154.
Stanton, S. J., & Schultheiss, O. C. (2009). The hormonal correlates of implicit power motivation. Journal of Research in Personality, 43, 942–949.
Thrash, T. M., Elliot, A. J., & Schultheiss, O. C. (2007). Methodological and dispositional predictors of congruence between implicit and explicit need for achievement. Personality and Social Psychology Bulletin, 33, 961–974.
Winter, D. G. (1988). The power motive in women and men. Journal of Personality and Social Psychology, 54, 510–515.
Winter, D. G. (1991). Manual for scoring motive imagery in running text. Unpublished manuscript, University of Michigan.
Winter, D. G. (1992). Power motivation revisited. In C. P. Smith (Ed.), Motivation and personality: Handbook of thematic content analysis (pp. 311–324). Cambridge: University Press.
Winter, D. G. (1994). Manual for scoring motive imagery in running text (4th edn). Unpublished manuscript, Department of Psychology, University of Michigan, Ann Arbor.
Winter, D. G. (2010). Power in the person: Exploring the psychological underground of power. In A. Guinote & T. Vescio (Eds.), The social psychology of power. New York: The Guilford Press.
Winter, D. G., John, O. P., Stewart, A. J., Klohnen, E. C., & Duncan, L. E. (1998). Traits and motives: Toward an integration of two traditions in personality research. Psychological Review, 105, 230–250.
Winter, D. G., & Stewart, A. J. (1977). Power motive reliability as a function of test-retest instructions. Journal of Consulting and Clinical Psychology, 45, 436–440.
Winter, D. G., & Stewart, A. J. (1978). The power motive. In H. London & J. Exner (Eds.), Dimensions of personality (pp. 391–447). New York: Wiley.
Woike, B., Lavezzary, E., & Barsky, J. (2001). The influence of implicit motives on memory processes. Journal of Personality and Social Psychology, 81, 935–945.
Woike, B., McLeod, S., & Goggin, M. (2003). Implicit and explicit motives influence accessibility to different autobiographical knowledge. Personality and Social Psychology Bulletin, 29, 1046–1055.
Acknowlegments
This research was supported in part by the Studienstiftung des deutschen Volkes with a scholarship awarded to the first author. We thank Alena Friedrich, Yousuf Haq, and Rebecca Wheeler, for their help in collecting and coding the data, Carol Dweck and Ulf Reips for their support in conducting this research, and Gregory Walton and David Yeager for helpful comments on the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bernecker, K., Job, V. Assessing implicit motives with an online version of the picture story exercise. Motiv Emot 35, 251–266 (2011). https://doi.org/10.1007/s11031-010-9175-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11031-010-9175-8