Skip to main content
SpringerLink
Log in

Bidirectional semantic interference between action and speech

  • Original Article
  • Published:
Psychological Research Aims and scope Submit manuscript

Abstract

Research on embodied cognition assumes that language processing involves modal simulations that recruit the same neural systems that are usually used for action execution. If this is true, one should find evidence for bidirectional crosstalk between action and language. Using a direct matching paradigm, this study tested if action–languages interactions are bidirectional (Experiments 1 and 2), and whether the effect of crosstalk between action perception and language production is due to facilitation or interference (Experiment 3). Replicating previous findings, we found evidence for crosstalk when manual actions had to be performed simultaneously to action–word perception (Experiment 1) and also when language had to be produced during simultaneous perception of hand actions (Experiment 2). These findings suggest a clear bidirectional relationship between action and language. The latter crosstalk effect was due to interference between action and language (Experiment 3). By extending previous research of embodied cognition, the present findings provide novel evidence suggesting that bidirectional functional relations between action and language are based on similar conceptual–semantic representations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Barsalou, L. W. (2007). Grounding symbolic operations in the brain’s modal systems. In G. R. Semin & E. R. Smith (Eds.), Embodied grounding: Social, cognitive, affective, and neuroscientific approaches (pp. 9–42). New York: Cambridge University Press.

    Google Scholar 

  • Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645.

    Article  PubMed  Google Scholar 

  • Barsalou, L. W., & Wiemer-Hastings, K. (2005). Situating abstract concepts. In D. Pecher & R. Zwaan (Eds.), Grounding cognition: The role of perception and action in memory, language, and thought (pp. 129–163). New York: Cambridge University Press.

    Chapter  Google Scholar 

  • Beringer, J. (2000). Experimental Runtime System (Version 3.32). [Computer software]. Frankfurt am Main, Germany: BeriSoft Corporation.

  • Bernardis, P., & Gentilucci, M. (2005). Speech and gesture share the same communication system. Neuropsychologia, 44, 178–190.

    Article  PubMed  Google Scholar 

  • Bertenthal, B. I., Longo, M. R., & Kosobud, A. (2006). Imitative response tendencies following observation of intransitive actions. Journal of Experimental Psychology: Human Perception and Performance, 32, 210–225.

    Article  PubMed  Google Scholar 

  • Blakemore, S. J., & Frith, C. (2005). The role of motor contagion in the prediction of action. Neuropsychologia, 43, 260–267.

    Article  PubMed  Google Scholar 

  • Boulenger, V., Roy, A. C., Paulignan, Y., Déprez, V., Jeannerod, M., & Nazir, T. A. (2006). Cross-talk between language processes and overt motor behaviour in the first 200 ms of processing. Journal of Cognitive Neuroscience, 18, 1607–1615.

    Article  PubMed  Google Scholar 

  • Brass, M., Bekkering, H., Wohlschläger, A., & Prinz, W. (2000). Compatibility between observed and executed finger movements: Comparing symbolic, spatial, and imitative cues. Brain Cognition, 44, 124–143.

    Article  Google Scholar 

  • Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, B., & Rizzolatti, G. (2005). Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research, 24, 355–363.

    Article  PubMed  Google Scholar 

  • Chersi, F., Thill, S., Ziemke, T., & Borghi, A. M. (2010). Sentence processing: linking language to motor chains. Frontiers in neurorobotics, 4, 4.

    Article  PubMed  Google Scholar 

  • D’Ausilio, A., Pulvermüller, F., Salmas, P., et al. (2009). The motor somatotopy of speech perception. Current Biology, 19, 381–385.

    Article  PubMed  Google Scholar 

  • Decety, J., Perani, D., Jeannerod, M., Bettinardi, V., Tadardy, B., Woods, R., et al. (1994). Mapping motor representations with positron emission tomography. Nature, 371, 600–602.

    Article  PubMed  Google Scholar 

  • Fadiga, L., Craighero, L., Buccino, G., & Rizzolatti, G. (2002). Speech listening specifically modulates the excitability of tongue muscles: a TMS study. European Journal of Neuroscience, 15, 399–402.

    Article  PubMed  Google Scholar 

  • Fodor, J. A. (1983). Modularity of mind: An essay on faculty psychology. Cambridge: MIT Press.

    Google Scholar 

  • Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996). Action recognition in the premotor cortex. Brain, 119, 593–609.

    Article  PubMed  Google Scholar 

  • Gentilucci, M., & Dalla Volta, R. (2008). Spoken language and arm gesture are controlled by the same motor control system. Quarterly Journal of Experimental Psychology, 61, 944–957.

    Article  Google Scholar 

  • Gentilucci, M., Dalla Volta, R., & Gianelli, C. (2008). When the hand speak. Journal of Physiology–Paris, 102, 21–30.

    Google Scholar 

  • Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review, 9, 558–565.

    Article  Google Scholar 

  • Glenberg, A. M., Sato, M., & Cattaneo, L. (2008a). Use-induced motor plasticity affects the processing of abstract and concrete language. Current Biology, 18, R290–R291.

    Article  PubMed  Google Scholar 

  • Glenberg, A. M., Sato, M., Cattaneo, L., Riggio, L., Palumbo, D., & Buccino, G. (2008b). Processing abstract language modulates motor system activity. Quarterly Journal of Experimental Psychology, 61, 905–919.

    Article  Google Scholar 

  • Grèzes, J., Armony, J. L., Rowe, J., & Passingham, R. E. (2003). Activations related to “mirror” and “canonical” neurones in the human brain: An fMRI study. Neuroimage, 18, 928–937.

    Article  PubMed  Google Scholar 

  • Heyes, C. (2001). Causes and consequences of imitation. Trends in Cognitive Sciences, 5, 253–261.

    Article  PubMed  Google Scholar 

  • Iacoboni, M., & Wilson, S. M. (2006). Beyond a single area: Motor control and language within a neural architecture encompassing Broca’s area. Cortex, 42, 503–506.

    Article  PubMed  Google Scholar 

  • Iacoboni, M., Woods, R. P., Brass, M., Bekkering, H., Mazziotta, J. C., & Rizzolatti, G. (1999). Cortical mechanisms of human imitation. Science, 286, 2526–2528.

    Article  PubMed  Google Scholar 

  • Kaschak, M. P., & Glenberg, A. M. (2000). Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory and Language, 43, 508–529.

    Article  Google Scholar 

  • Koski, L., Wohlschläger, A., Bekkering, H., Woods, R. P., Dubeau, M.-C., Mazziotta, J. C., et al. (2002). Modulation of motor and premotor activity during imitation of target-directed actions. Cerebral Cortex, 12, 847–855.

    Article  PubMed  Google Scholar 

  • Krauss, R. M., Dushay, R. A., Chen, Y. S., & Rauscher, F. (1995). The communicative value of conversational hand gestures. Journal of Experimental Social Psychology, 31(6), 533–552.

    Article  Google Scholar 

  • Krauss, R. M., Morrel-Samuels, P., & Colasante, C. (1991). Do conversational hand gestures communicate? Journal of Personality and Social Psychology, 61(5), 743–754.

    Article  PubMed  Google Scholar 

  • Levelt, W. J., Richardson, G., & La Heij, W. (1985). Pointing and voicing in deictic expressions. Journal of Memory and Language, 24, 133–164.

    Article  Google Scholar 

  • Liepelt, R., von Cramon, D. Y., & Brass, M. (2008a). What is matched in direct matching? Intention attribution modulates motor priming. Journal of Experimental Psychology: Human Perception and Performance, 34, 578–591.

    Article  PubMed  Google Scholar 

  • Liepelt, R., von Cramon, D. Y., & Brass, M. (2008b). How do we infer others’ goals from non-stereotypic actions? The outcome of context-sensitive inferential processing in right inferior parietal and posterior temporal cortex. NeuroImage, 43, 784–792.

    Article  PubMed  Google Scholar 

  • Mahon, B. Z., & Caramazza, A. (2008). A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. Journal of Physiology–Paris, 102, 59–70.

    Google Scholar 

  • McNeill, D. (1992). Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.

    Google Scholar 

  • Meltzoff, A. N., & Moore, M. K. (1997). Explaining facial imitation: A theoretical model. Early Development and Parenting, 6, 179–192.

    Article  Google Scholar 

  • Nishitani, N., Schürmann, M., Amunts, K., & Hari, R. (2005). Broca’s region: From action to language. Physiology, 20, 60–69.

    Article  PubMed  Google Scholar 

  • Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh Inventory. Neuropsychologia, 9, 97–113.

    Article  PubMed  Google Scholar 

  • Press, C., Bird, G., Flach, R., & Heyes, C. (2005). Robotic movement elicits automatic imitation. Cognitive Brain Research, 25, 632–640.

    Article  PubMed  Google Scholar 

  • Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6, 576–582.

    Article  PubMed  Google Scholar 

  • Pulvermüller, F., & Fadiga, L. (2010). Active perception: sensorimotor circuits as a cortical basis for language. Nature Reviews Neuroscience, 11, 351–360.

    Article  PubMed  Google Scholar 

  • Rizzolatti, G., & Arbib, M. A. (1998). Language within our grasp. Trends in Neurosciences, 21, 188–194.

    Article  PubMed  Google Scholar 

  • Rizzolatti, G., & Arbib, M. A. (1999). From grasping to speech: Imitation might provide a missing link: Reply. Trends in Neurosciences, 22, 152.

    Article  PubMed  Google Scholar 

  • Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169–192.

    Article  PubMed  Google Scholar 

  • Rizzolatti, G., Fadiga, L., Gallese, V., & Fogassi, L. (1996). Premotor cortex and the recognition of motor actions. Brain Research. Cognitive Brain Research, 3, 131–141.

    Article  PubMed  Google Scholar 

  • Rizzolatti, G., Fogassi, L., & Gallese, V. (2001). Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Reviews Neuroscience, 2, 661–670.

    Article  PubMed  Google Scholar 

  • Rueschemeyer, S.-A., Lindemann, O., van Rooij, D., van Dam, W., & Bekkering, H. (2010). Effects of intentional motor actions on embodied language processing. Experimental Psychology, 57, 260–266.

    Article  PubMed  Google Scholar 

  • Sato, M., Mengarelli, M., Riggio, L., Gallese, V., & Buccino, G. (2008). Task related modulation of the motor system during language processing. Brain and Language, 105, 83–90.

    Article  PubMed  Google Scholar 

  • Springer, A., & Prinz, W. (2010). Action semantics modulate action prediction. The Quarterly Journal of Experimental Psychology, 63, 2141–2158.

    Article  PubMed  Google Scholar 

  • Stürmer, B., Aschersleben, G., & Prinz, W. (2000). Correspondence effects with manual gestures and postures: A study of imitation. Journal of Experimental Psychology, 26, 1746–1759.

    Google Scholar 

  • Tettamanti, M., Buccino, G., Saccuman, M. C., Gallese, V., Danna, M., Scifo, P., et al. (2005). Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience, 17, 273–281.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Junior Group “Neurocognition of Joint Action”, Department of Psychology, Westfälische Wilhelms-University, Fliednerstrasse 21, 48149, Muenster, Germany

    Roman Liepelt

  2. Department of Psychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany

    Roman Liepelt, Thomas Dolk & Wolfgang Prinz

Authors
  1. Roman Liepelt
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas Dolk
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wolfgang Prinz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Roman Liepelt.

Additional information

The authors wish to thank Patricia Grocke for help with data acquisition.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liepelt, R., Dolk, T. & Prinz, W. Bidirectional semantic interference between action and speech. Psychological Research 76, 446–455 (2012). https://doi.org/10.1007/s00426-011-0390-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00426-011-0390-z

Keywords

Search

Navigation