Abstract
Existing evidence has shown that adjectives modulate the grasp-compatibility effect elicited by object nouns. The aim of the present study was to investigate the role of syntax on the sensorimotor activation elicited by nouns in a grasp-compatibility task. We assessed two languages with different syntactic rules, Italian in Experiment 1 and English in Experiment 2. In both experiments, an adjective-noun pair was shown on the screen. The adjective was always in a pre-nominal position and denoted either a disadvantageous quality of the object graspability (e.g., sharp) or the object colour (e.g., reddish). Participants had to categorize the object nouns as natural or artifact, performing a precision or a power reach-to-grasp movement. On different trials, the grasp response was compatible or incompatible with the grip typically used to manipulate the object indicated by the noun. In Experiment 1 (Italian language) the adjective-noun order violated the syntactic order and no difference emerged between reaction times on compatible and incompatible trials (no grasp compatibility effect). In Experiment 2 (English language), the adjective-noun order followed the syntactic rule. Results showed a grasp-compatibility effect when a colour adjective was presented before a natural object noun. When a disadvantageous adjective preceded an artifact or a natural object noun, an inverted grasp-compatibility effect emerged with slower responses on compatible than incompatible trials. Taken together, these findings suggest that adjectives can shape the sensorimotor activation elicited by nouns of graspable objects only when the syntax is correct. Results are discussed with respect to embodied cognition theories.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anelli, F., Borghi, A. M., & Nicoletti, R. (2012). Grasping the pain: Motor resonance with dangerous affordances. Consciousness and Cognition, 21(4), 1627–1639. https://doi.org/10.1016/j.concog.2012.09.001
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255–278. https://doi.org/10.1016/j.jml.2012.11.001
Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59(August), 617–645. https://doi.org/10.1146/annurev.psych.59.103006.093639
Bates, D., Mächler, M., Bolker, B. M., & Walker, S. C. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1). https://doi.org/10.18637/jss.v067.i01
Berndt, E., Dudschig, C., & Kaup, B. (2018). Green as a cbemcuru: Modal as well as amodal color cues can help to solve anagrams. Psychological Research, 0(0), 1–11. https://doi.org/10.1007/s00426-018-1055-y
Bompas, A., Kendall, G., & Sumner, P. (2013). Spotting fruit versus picking fruit as the selective advantage of human colour vision. I-Perception, 4(2), 84–94. https://doi.org/10.1068/i0564
Borghi, A. M., & Cangelosi, A. (2014). Action and language integration: From humans to cognitive robots. Topics in Cognitive Science, 6(3), 344–358. https://doi.org/10.1111/tops.12103
Borghi, A. M., & Riggio, L. (2015). Stable and variable affordances are both automatic and flexible. Frontiers in Human Neuroscience, 9(March), 351. https://doi.org/10.3389/fnhum.2015.00351
Box, G., & Cox, D. (1964). An analysis of transformations: Applying the Box-Cox transformation. Journal of the Royal Satistical Society, Series B, 26, 211–252.
Britt, A. E., Ferrara, C., & Mirman, D. (2016). Distinct effects of lexical and semantic competition during picture naming in younger adults, older adults, and people with aphasia. Frontiers in Psychology, 7(JUN), 1–17. https://doi.org/10.3389/fpsyg.2016.00813
Bub, D. N., & Masson, M. E. J. (2010). On the nature of hand-action representations evoked during written sentence comprehension. Cognition, 116(3), 394–408. https://doi.org/10.1016/j.cognition.2010.06.001
Bub, D. N., & Masson, M. E. J. (2012). On the dynamics of action representations evoked by names of manipulable objects. Journal of Experimental Psychology: General, 141(3), 502–517. https://doi.org/10.1037/a0026748
Buccino, G., Sato, M., Cattaneo, L., Rodà, F., & Riggio, L. (2009). Broken affordances, broken objects: A TMS study. Neuropsychologia, 47(14), 3074–3078. https://doi.org/10.1016/j.neuropsychologia.2009.07.003
Buccino, G., Colagè, I., Gobbi, N., & Bonaccorso, G. (2016). Grounding meaning in experience: A broad perspective on embodied language. Neuroscience and Biobehavioral Reviews, 69, 69–78. https://doi.org/10.1016/j.neubiorev.2016.07.033
Castiello, U. (1996). Grasping a fruit: Selection for action. Journal of Experimental Psychology: Human Perception and Performance, 22(3), 582–603. https://doi.org/10.1037/0096-1523.22.3.582
Castiello, U. (1999). Mechanisms of selection for the control of hand action. Trends in Cognitive Sciences, 3(7), 264–271. https://doi.org/10.1016/S1364-6613(99)01346-7
Castiello, U. (2005). The neuroscience of grasping. Nature Reviews Neuroscience, 6(9), 726–736. https://doi.org/10.1038/nrn1744
Cattaneo, Z., Devlin, J. T., Salvini, F., Vecchi, T., & Silvanto, J. (2010). The causal role of category-specific neuronal representations in the left ventral premotor cortex (PMv) in semantic processing. Neuroimage, 49(3), 2728–2734.
Coulson, S., King, J. W., & Kutas, M. (1998). Expect the unexpected: Event-related brain potentials to morphosyntactic violations. Language and Cognitive Processes, 13(1), 21–58.
Creem-Regehr, S. H., & Lee, J. N. (2005). Neural representations of graspable objects: Are tools special? Cognitive Brain Research, 22(3), 457–469. https://doi.org/10.1016/j.cogbrainres.2004.10.006
Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25(1), 7–29. https://doi.org/10.1177/0956797613504966
Del Maschio, N., Fedeli, D., Garofalo, G., & Buccino, G. (2022). Evidence for the concreteness of abstract language: A meta-analysis of neuroimaging studies. Brain Sciences, 12(1), 1–21. https://doi.org/10.3390/brainsci12010032
Ellis, R., & Tucker, M. (2000). Micro-affordance: The potentiation of components of action by seen objects. British Journal of Psychology, 91(4), 451–471. https://doi.org/10.1348/000712600161934
Fadiga, L., Craighero, L., & D’Ausilio, A. (2009). Broca’s area in language, action, and music. Annals of the New York Academy of Sciences, 1169, 448–458. https://doi.org/10.1111/j.1749-6632.2009.04582.x
Ferri, F., Riggio, L., Gallese, V., & Costantini, M. (2011). Objects and their nouns in peripersonal space. Neuropsychologia, 49(13), 3519–3524. https://doi.org/10.1016/j.neuropsychologia.2011.09.001
Friederici, A. D., Hahne, A., & Mecklinger, A. (1996). Temporal structure of syntactic parsing: Early and late event-related brain potential effects. Journal of Experimental Psychology: Learning Memory and Cognition, 22(5), 1219–1248. https://doi.org/10.1037/0278-7393.22.5.1219
Gallese, V. (2008). Mirror neurons and the social nature of language: The neural exploitation hypothesis. Social Neuroscience, 3(3–4), 317–333. https://doi.org/10.1080/17470910701563608
Gallese, V., & Lakoff, G. (2005). The brain’s concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, 22(3–4), 455–479. https://doi.org/10.1080/02643290442000310
Garofalo, G., & Riggio, L. (2022). Influence of colour on object motor representation. Neuropsychologia, 164(October 2021), 108103. https://doi.org/10.1016/j.neuropsychologia.2021.108103
Garofalo, G., Marino, B. F. M., Bellelli, S., & Riggio, L. (2021). Adjectives modulate sensorimotor activation driven by nouns. Cognitive Science, 45(3), 1–36. https://doi.org/10.1111/cogs.12953
Garofalo, G., Magliocco, F., Silipo, F., Riggio, L., & Buccino, G. (2022). What matters is the underlying experience: Similar motor responses during processing observed hand actions and hand-related verbs. Journal of Neuropsychology, 16(2), 389–406. https://doi.org/10.1111/jnp.12270
Gentilucci, M., Benuzzi, F., Bertolani, L., Daprati, E., & Gangitano, M. (2000). Language and motor control. Experimental Brain Research, 133(4), 468–490. https://doi.org/10.1007/s002210000431
Glover, S. (2004). Separate visual representations in the planning and control of action. Behavioral and Brain Sciences, 27(01), 3–78. https://doi.org/10.1017/s0140525x04280025
Glover, S., & Dixon, P. (2002). Semantics affect the planning but not control of grasping. Experimental Brain Research, 146(3), 383–387. https://doi.org/10.1007/s00221-002-1222-6
Glover, S., Rosenbaum, D. A., Graham, J., & Dixon, P. (2004). Grasping the meaning of words. Experimental Brain Research, 154(1), 103–108. https://doi.org/10.1007/s00221-003-1659-2
Gough, P. M., Riggio, L., Chersi, F., Sato, M., Fogassi, L., & Buccino, G. (2012). Nouns referring to tools and natural objects differentially modulate the motor system. Neuropsychologia, 50(1), 19–25. https://doi.org/10.1016/j.neuropsychologia.2011.10.017
Gough, P. M., Campione, G. C., & Buccino, G. (2013). Fine tuned modulation of the motor system by adjectives expressing positive and negative properties. Brain and Language, 125(1), 54–59. https://doi.org/10.1016/j.bandl.2013.01.012
Green, P., & Macleod, C. J. (2016). SIMR: An R package for power analysis of generalized linear mixed models by simulation. Methods in Ecology and Evolution, 7(4), 493–498. https://doi.org/10.1111/2041-210X.12504
Grèzes, J., Tucker, M., Armony, J., Ellis, R., & Passingham, R. E. (2003). Objects automatically potentiate action: An fMRI study of implicit processing. European Journal of Neuroscience, 17(12), 2735–2740. https://doi.org/10.1046/j.1460-9568.2003.02695.x
Hagoort, P. (2003). Interplay between syntax and semantics during sentence comprehension: ERP effects of combining syntactic and semantic violations. Journal of Cognitive Neuroscience, 15(6), 883–899. https://doi.org/10.1162/089892903322370807
Hansen, T., Olkkonen, M., Walter, S., & Gegenfurtner, K. R. (2006). Memory modulates color appearance. Nature Neuroscience, 9(11), 1367–1368. https://doi.org/10.1038/nn1794
Hasting, A. S., Kotz, S. A., & Friederici, A. D. (2007). Setting the stage for automatic syntax processing: The mismatch negativity as an indicator of syntactic priming. Journal of Cognitive Neuroscience, 19(3), 386–400. https://doi.org/10.1162/jocn.2007.19.3.386
Jax, S. A., & Buxbaum, L. J. (2010). Response interference between functional and structural actions linked to the same familiar object. Cognition, 115(2), 350–355. https://doi.org/10.1016/j.cognition.2010.01.004
Jeannerod, M. (1984). The timing of natural prehension movements. Journal of Motor Behavior, 16(3), 235–254. https://doi.org/10.1080/00222895.1984.10735319
Kemmerer, D. (2022). Revisiting the relation between syntax, action, and left BA44. Frontiers in Human Neuroscience, 16(September), 1–14. https://doi.org/10.3389/fnhum.2022.923022
Klein Entink, R. H., Kuhn, J.-T., Hornke, L. F., & Fox, J.-P. (2009). Evaluating cognitive theory: A joint modeling approach using responses and response times. Psychological Methods, 14(1), 54–75. https://doi.org/10.1037/a0014877
Klepp, A., Niccolai, V., Sieksmeyer, J., Arnzen, S., Indefrey, P., Schnitzler, A., & Biermann-Ruben, K. (2017). Body-part specific interactions of action verb processing with motor behaviour. Behavioural Brain Research, 328(December 2016), 149–158. https://doi.org/10.1016/j.bbr.2017.04.002
Kline, R. B. (2004). Beyond significance testing: Reforming data analysis methods in behavioral research. A. P. Association. https://doi.org/10.1037/10693-000
Koranda, M. J., Bulgarelli, F., Weiss, D. J., & MacDonald, M. C. (2020). Is language production planning emergent from action planning? A Preliminary Investigation. Frontiers in Psychology, 11(June), 1–11. https://doi.org/10.3389/fpsyg.2020.01193
Lachmair, M., de la Vega, C. D. I., & Kaup, B. (2016). Constructing meaning for up and down situated sentences : Is a sentence more than the sum of its words ? Language and Cognition, 8, 604–628. https://doi.org/10.1017/langcog.2015.11
Lebkuecher, A. L., Schwob, N., Kabasa, M., Gussow, A. E., MacDonald, M. C., & Weiss, D. J. (2022). Hysteresis in motor and language production. Quarterly Journal of Experimental Psychology. https://doi.org/10.1177/17470218221094568
Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013). Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology, 49(4), 764–766. https://doi.org/10.1016/j.jesp.2013.03.013
Makris, S., Hadar, A. A., & Yarrow, K. (2011). Viewing objects and planning actions: On the potentiation of grasping behaviours by visual objects. Brain and Cognition, 77(2), 257–264. https://doi.org/10.1016/j.bandc.2011.08.002
Makris, S., Hadar, A. A., & Yarrow, K. (2013). Are object affordances fully automatic? A case of covert attention. Behavioral Neuroscience, 127(5), 797–802. https://doi.org/10.1037/a0033946
Marino, B. F. M., Gallese, V., Buccino, G., & Riggio, L. (2012). Language sensorimotor specificity modulates the motor system. Cortex, 48(7), 849–856. https://doi.org/10.1016/j.cortex.2010.12.003
Marino, B. F. M., Gough, P. M., Gallese, V., Riggio, L., & Buccino, G. (2013). How the motor system handles nouns : A behavioral study. Psychological Research, 77, 64–73. https://doi.org/10.1007/s00426-011-0371-2
Marino, B. F. M., Sirianni, M., Volta, R. D., Magliocco, F., Silipo, F., Quattrone, A., & Buccino, G. (2014). Viewing photos and reading nouns of natural graspable objects similarly modulate motor responses. Frontiers in Human Neuroscience, 8(DEC), 1–10. https://doi.org/10.3389/fnhum.2014.00968
Martin, A. (2016). GRAPES—Grounding representations in action, perception, and emotion systems: How object properties and categories are represented in the human brain. Psychonomic Bulletin & Review, 23(4), 979–990. https://doi.org/10.3758/s13423-015-0842-3
Martin, A., Haxby, J. V., Lalonde, F. M., Wiggs, C. L., & Ungerleider, L. G. (1995). Discrete cortical regions associated with knowledge of color and knowledge of action. Science, 270(5233), 102–105. https://doi.org/10.1126/science.270.5233.102
Matuschek, H., Kliegl, R., Vasishth, S., Baayen, H., & Bates, D. (2017). Balancing Type I error and power in linear mixed models. Journal of Memory and Language, 94, 305–315. https://doi.org/10.1016/j.jml.2017.01.001
Morey, R. D. (2008). Confidence intervals from normalized data: A correction to Cousineau (2005). Tutorials in Quantitative Methods for Psychology, 4(2), 61–64. https://doi.org/10.20982/tqmp.04.2.p061
Naor-Raz, G., Tarr, M. J., & Kersten, D. (2003). Is color an intrinsic property of object representation? Perception, 32(6), 667–680. https://doi.org/10.1068/p5050
Neville, H., Nicol, J. L., Barss, A., Forster, K. I., & Garrett, M. F. (1991). Syntactically based sentence processing classes: Evidence from event-related brain potentials. Journal of Cognitive Neuroscience, 3(2), 151–165. https://doi.org/10.1162/jocn.1991.3.2.151
Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9(1), 97–113. https://doi.org/10.1016/0028-3932(71)90067-4
Osterhout, L., & Holcomb, P. J. (1993). Event-related brain potentials elicited by syntactic anomaly. Journal of Memory and Language, 8(4), 439–483.
Osterhout, L., & Mobley, L. A. (1995). Event-related brain potentials elicited by failure to agree. Journal of Memory and Language, 34(6), 739–773. https://doi.org/10.1006/jmla.1995.1033
Papitto, G., Lugli, L., Borghi, A. M., Pellicano, A., & Binkofski, F. (2021). Embodied negation and levels of concreteness: A TMS study on German and Italian language processing. Brain Research, 1767(April), 147523. https://doi.org/10.1016/j.brainres.2021.147523
Pulvermüller, F. (1999). Words in brain s language. Behavioral and Brain Science, 22(1999), 253–336.
Pulvermüller, F. (2010). Brain embodiment of syntax and grammar: Discrete combinatorial mechanisms spelt out in neuronal circuits. Brain and Language, 112(3), 167–179. https://doi.org/10.1016/j.bandl.2009.08.002
Pulvermüller, F. (2013). How neurons make meaning: Brain mechanisms for embodied and abstract-symbolic semantics. Trends in Cognitive Sciences, 17(9), 458–470. https://doi.org/10.1016/j.tics.2013.06.004
Pulvermüller, F., & Fadiga, L. (2010). Active perception: Sensorimotor circuits as a cortical basis for language. Nature Reviews Neuroscience, 11(5), 351–360. https://doi.org/10.1038/nrn2811
R Core Team. (2020). R: A language and environment for statistical computing (3.6.3). R Foundation for Statistical Computing.
Richter, T., Zwaan, R. A., & Hoever, I. (2009). Acquiring experiential traces in word – referent learning. Memory & Cognition, 37(8), 1187–1196. https://doi.org/10.3758/MC.37.8.1187
Riggio, L., Patteri, I., Oppo, A., & Buccino, G. (2006). The role of affordances in inhibition of return. Psychonomic Bulletin & Review, 13(6), 1085–1090.
Rounis, E., Van Polanen, V., & Davare, M. (2018). A direct effect of perception on action when grasping a cup. Scientific Reports, 8(1), 1–11. https://doi.org/10.1038/s41598-017-18591-5
Roy, A. C., & Arbib, M. A. (2005). The syntactic motor system. Gesture, 5(1–2), 7–37. https://doi.org/10.1075/gest.5.1.03roy
Roy, A. C., Curie, A., Nazir, T., Paulignan, Y., des Portes, V., Fourneret, P., & Deprez, V. (2013). Syntax at hand: Common syntactic structures for actions and language. PLoS ONE, 8(8), 1–11. https://doi.org/10.1371/journal.pone.0072677
Rueschemeyer, S.-A., van Rooij, D., Lindemann, O., Willems, R. M., & Bekkering, H. (2010). The function of words: distinct neural correlates for words denoting differently manipulable objects. Journal of Cognitive Neuroscience, 22(8), 1844–1851. https://doi.org/10.1162/jocn.2009.21310
Sakreida, K., Effnert, I., Thill, S., Menz, M. M., Jirak, D., Eickhoff, C. R., Ziemke, T., Eickhoff, S. B., Borghi, A. M., & Binkofski, F. (2016). Affordance processing in segregated parieto-frontal dorsal stream sub-pathways. Neuroscience and Biobehavioral Reviews, 69, 89–112. https://doi.org/10.1016/j.neubiorev.2016.07.032
Santana, E. J., & De Vega, M. (2013). An ERP study of motor compatibility effects in action language. Brain Research, 1526, 71–83. https://doi.org/10.1016/j.brainres.2013.06.020
Sassenhagen, J., & Alday, P. M. (2016). A common misapplication of statistical inference: Nuisance control with null-hypothesis significance tests. Brain and Language, 162, 42–45. https://doi.org/10.1016/j.bandl.2016.08.001
Serianni, L. (1989). Grammatica Italiana: Suoni, forme, costrutti. Utet.
Sieksmeyer, J., Klepp, A., Niccolai, V., Metzlaff, J., Schnitzler, A., & Biermann-ruben, K. (n.d.). Influence of manner adverbs on action verb processing. Springer International Publishing. https://doi.org/10.1007/978-3-030-50200-3
Simmons, W. K., Ramjee, V., Beauchamp, M. S., McRae, K., Martin, A., Barsalou, L. W., Beauchamp, M. S., McRae, K., Martin, A., & Barsalou, L. W. (2007). A common neural substrate for perceiving and knowing about color. Neuropsychologia, 45(12), 2802–2810. https://doi.org/10.1016/j.neuropsychologia.2007.05.002
Symes, E., Tucker, M., Ellis, R., Vainio, L., & Ottoboni, G. (2008). Grasp preparation improves change detection for congruent objects. Journal of Experimental Psychology: Human Perception and Performance, 34(4), 854–871. https://doi.org/10.1037/0096-1523.34.4.854
Taylor, L. J., & Zwaan, R. A. (2008). Motor resonance and linguistic focus. Quarterly Journal of Experimental Psychology, 61(6), 896–904. https://doi.org/10.1080/17470210701625519
Therriault, D. J., Yaxley, R. H., & Zwaan, R. A. (2009). The role of color diagnosticity in object recognition and representation. Cognitive Processing, 10(4), 335–342. https://doi.org/10.1007/s10339-009-0260-4
Tucker, M., & Ellis, R. (2004). Action priming by briefly presented objects. Acta Psychologica, 116(2), 185–203. https://doi.org/10.1016/j.actpsy.2004.01.004
Vainio, L., Symes, E., Ellis, R., Tucker, M., & Ottoboni, G. (2008). On the relations between action planning, object identification, and motor representations of observed actions and objects. Cognition, 108(2), 444–465. https://doi.org/10.1016/j.cognition.2008.03.007
Vigliocco, G., Meteyard, L., Andrews, M., & Kousta, S. (2009). Toward a theory of semantic representation. Language and Cognition, 1(2), 219–247. https://doi.org/10.1515/langcog.2009.011
Visani, E., Magliocco, F., Sebastiano, D. R., Duran, D., Garofalo, G., Magliocco, F., Silipo, F., & Buccino, G. (2021). The semantics of natural objects and tools in the brain : A combined behavioural and MEG study. Brain Sciences, 12(1), 1–22. https://doi.org/10.3390/brainsci12010097
Zwaan, R. A., & Taylor, L. J. (2006). Seeing, acting, understanding: Motor resonance in language comprehension. Journal of Experimental Psychology: General, 135(1), 1–11. https://doi.org/10.1037/0096-3445.135.1.1
Funding
This work was partially supported by the University of Bologna (AlmaIdea grant).
Author information
Authors and Affiliations
Contributions
GG: Conceptualization, data curation, formal analysis; investigation; software; visualization; writing – original draft; EG: Project administration; supervision; writing – original draft; writing – review and editing; LR: conceptualization; methodology; writing - original draft; writing - review and editing.
Corresponding author
Ethics declarations
Competing interests
The authors declare that no competing interests exist.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open practices statement
The datasets generated during the current study are shared via figshare repository: https://figshare.com/account/articles/23744025. None of the experiments was preregistered.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Garofalo, G., Gherri, E. & Riggio, L. Syntax matters in shaping sensorimotor activation driven by nouns. Mem Cogn 52, 285–301 (2024). https://doi.org/10.3758/s13421-023-01460-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/s13421-023-01460-0