Abstract
In this article, we propose that gestures play an important role in the connection between sensorimotor experience and language. Gestures may be the link between bodily experience and verbal expression that advocates of “embodied cognition” have postulated. In a developmental sequence of communicative action, gestures, which are initially similar to action sequences, substantially shorten and represent actions in metonymic form. In another process, action sequences are based on kinesthetic schemata that themselves find their metaphoric expression in language. Again, gestures enact kinesthetic schemata that are correlated with verbal expressions. Examples from a large database are used to illustrate the various processes by means of which language arises when students conduct school science investigations.
Similar content being viewed by others
Abstract
Agre, P.E. (1997). Computation and Human Experience. Cambridge: Cambridge University Press.
Allen, C. and Saidel, E. (1998). The Evolution of Reference. In D. Cummins and C. Allen (Eds.), The Evolution of Mind. Oxford: Oxford University Press.
Anderson, J.R. (1985). Cognitive Psychology and its Implications. San Francisco, CA: Freeman.
Bates, E. (1999). Plasticity, Localization and Language Development. In S.H. Broman and J.M. Fletcher (Eds.), The Changing Nervous System: Neurobehavioral Consequences of Early Brain Disorders. New York: Oxford University Press.
Bates, E., Thal, D., Finlay, B.L. and Janovsky, J. (1992). Early Language Development and its Neural Correlates. In I. Rapin and S. Segalowitz (Vol. Eds.), Handbook of Neuropsychology, Vol. 7: Child Neurology. Amsterdam: Elsevier.
Beattie, G. and Coughlan, J. (1998). Do Iconic Gestures Have a Functional Role in Lexical Access? An Experimental Study of the Effects of Repeating a Verbal Message on Gesture Production. Semiotica 119: 221–249.
Brooks, R.A. and Stein, L.A. (1994). Building Brains for Bodies. Autonomous Robots 1: 7–25.
Butterworth, B. and Hadar, U. (1989). Gesture, Speech, and Computational Stages: A Reply to McNeill. Psychological Review 96: 168–174.
Church, R.B. and Goldin-Meadow, S. (1986). The Mismatch Between Gesture and Speech as an Index of Transitional Knowledge. Cognition 23: 43–71.
Churchland, P.S. and Sejnowski, T.J. (1992). The Computational Brain. Cambridge, MA: MIT Press.
Cole, M. and Scribner, S. (1974). Culture and Thought. New York: Wiley.
Corballis, M. (1999). The Gestural Origins of Language. American Scientist 87: 138–145.
Crowder, E.M. and Newman, D. (1993). Telling What they Know: The Role of Gesture and Language in Children's Science Explanations. Pragmatics and Cognition 1: 341–376.
Decety, J. and Grèzes, J. (1999). Neural Mechanisms Subserving the Perception of Human Actions. Trends in Cognitive Sciences 3: 172–178.
Donald, M.W. (1999). Preconditions for the Evolution of Protolanguages. In M. Corballis and S. Lea (Eds.), Evolution of Homind Mind. Cambridge: Oxford University Press.
diSessa, A.A. (1993). Toward an Epistemology of Physics. Cognition and Instruction 10: 105–225.
Dreyfus, H.L. (1992). What Computers Still Can't Do: A Critique of Artificial Reason. Cambridge, MA: MIT Press.
Dreyfus, H.L. and Dreyfus, S.E. (1988, Winter). Making a Mind Versus Modeling the Brain: Artificial Intelligence Back at a Branchpoint. Daedalus 117: 15–43.
Eco, U. (1984). Semiotics and the Philosophy of Language. Bloomington: Indiana University Press.
Freedman, N. (1977). Hands, Words, and Mind: On the Structuralization of Body Movement During Discourse and the Capacity for Verbal Presentation. In N. Freedman and S. Grand (Eds.), Communicative Structures and Psychic Structures. New York: Plenum Press.
Gibson, J.J. (1986). The Ecological Approach to Visual Perception. Hillsdale, NJ: Lawrence Erlbaum Associates.
Gibson, K.R. (1988). Brain Size and the Evolution of Language. In M. Landsberg (Ed.), The Genesis of Language: A Different Judgement of Evidence. Berlin: Mouton de Gruyter.
Goldin-Meadow, S., Alibali, M. and Church, R.B. (1993). Transitions in Concept Acquisition: Using the Hands to Read the Mind. Psychological Review 100: 279–297.
Goldin-Meadow, S., McNeill, D. and Singleton, J.L. (1996). Silence is Liberating: Removing the Handcuffs on Grammatical Expression in the Manual Modality. Psychological Review 103: 34–55.
Grandin, T. (2000). My Experiences with Visual Thinking Sensory Problems and Communication Difficulties. Available at http://www.autism.org/temple/visual.html. (Accessed May 26, 2001).
Gregory, B. (1990). Inventing Reality: Physics as Language. New York: Wiley and Sons.
Hadar, U. and Butterworth, B. (1997). Iconic Gestures, Imagery, and Word Retrieval in Speech. Semiotica 115: 147–172.
Hanna, J.L. (1979). To Dance is Human. Austin, TX: University of Texas Press.
Ibáñez, T. (1994). Constructing a Representation or Representing a Construction? Theory and Psychology 4: 363–381.
Ingold, T. (1993). Relations Between Visual-Gestural and Vocal-Auditory Modalities of Communication. In K.R. Gibson and T. Ingold (Eds.), Tools, Language and Cognition in Human Evolution. Great Britain: Cambridge University Press.
Johnson, M. (1987). The Body in the Mind: The Bodily Basis of Imagination, Reason, and Meaning. Chicago: Chicago University Press.
Krauss, R.M. and Hadar, U. (1999). The Role of Speech-Related Arm/Hand Gestures in Word Retrieval. In L.S. Messing and R. Campbell (Eds.), Gesture, Speech, and Sign. New York: Oxford University Press.
Lakoff, G. (1987). Women, Fire, and Dangerous Things: What Categories Reveal About the Mind. Chicago: University of Chicago Press.
Lakoff, G. and Johnson, M. (1999). Philosophy in the Flesh: The Embodied Mind and its Challenge to Western Thought. New York: Basic Books.
Langacker, R. (1987). Foundations of Cognitive Grammar, Vol. 1. Stanford, CA: Stanford University Press.
Lave, J. (1988). Cognition in Practice: Mind, Mathematics and Culture in Everyday Life. Cambridge: Cambridge University Press.
LeBaron, C.D. and Streeck, J. (2000). Gestures, Knowledge, and the World. In D. McNeill (Ed.), Gestures in Action, Language, and Culture. Cambridge: Cambridge University Press.
McNeill, D. (1985). So You Think Gestures are Non-Verbal? Psychological Review 92: 350–371.
McNeill, D. (1992). Hand and Mind: What Gestures Reveal About Thought. Chicago: University of Chicago Press.
McNeill, D. (1999). Triangulating the Growth Point - Arriving at Consciousness. In L.S. Messing and R. Campbell (Eds.), Gesture, Speech, and Sign. New York: Oxford University Press.
Merleau-Ponty, M. (1945). Phénoménologie de la Perception. Paris: Gallimard.
Moore, C.L. (1988). Beyond Words. New York: Gordon & Breach.
Ochs, E., Jacoby, S. and Gonzales, P. (1994). Interpretive Journeys: How Physicists Talk and Travel Through Graphic Space. Configurations 2: 151–171.
Pessoa, L., Thompson, E. and Noë, A. (1998). Finding Out About Filling In: A Guide to Perceptual Completion for Visual Science and the Philosophy of Perception. Behavioral and Brain Sciences 21: 723–802.
Petersen, S.E., van Mier, H., Fiez, J.A. and Raichle, M.E. (1998). The Effects of Practice on the Functional Anatomy of Task Performance. Proceedings of the National Academy of Sciences USA 95: 853–860.
Piaget, J. (1970). Genetic Epistemology. New York: Norton.
Robbins, K.A., Jeffery, C. and Robbins, S. (2000). Visualization of Splitting and Merging Processes. Journal of Visual Languages and Computing 11(6): 593–614.
Quine, W.V. (1995). From Stimulus to Science. Cambridge, MA: Harvard University Press.
Reeke, G.N. and Edelman, G.M. (1988, Winter). Real Brains and Artificial Intelligence. Daedalus 117: 143–173.
Rizzolatti, G., Fadiga, L., Fogassi, L. and Gallese, V. (1997). The Space Around Us. Science 277: 190–191.
Roth, W.-M. (1996a). Art and Artifact of Children's Designing: A Situated Cognition Perspective. The Journal of the Learning Sciences 5: 129–166.
Roth, W.-M. (1996b). Thinking with Hands, Eyes, and Signs: Multimodal Science Talk in a Grade 6/7 Unit on Simple Machines. Interactive Learning Environments 4: 170–187.
Roth, W.-M. (1999). Discourse and Agency in School Science Laboratories. Discourse Processes 28 (1): 27–60.
Roth, W.-M. (2000). From Gesture to Scientific Language. Journal of Pragmatics 32 (11): 1683–1714.
Roth, W.-M. (in press). From Epistemic (Ergotic) Actions to Scientific Discourse: Do Gestures Obtain a Bridging Function? Pragmatics and Cognition.
Roth, W.-M. and Bowen, G.M. (2001). Professionals Read Graphs: A Semiotic Analysis. Journal for Research in Mathematics Education 32 (2), 159–194.
Roth, W.-M. and Lawless, D.V. (2002). Signs, Deixis, and the Emergence of Scientific Explanation. Semiotica 138: 95–130.
Roth, W.-M., McRobbie, C., Lucas, K.B. and Boutonné, S. (1997). The Local Production of Order in Traditional Science Laboratories: A Phenomenological Analysis. Learning and Instruction 7 (2): 107–136.
Simon, H.A. (1981). The Science of the Artificial (2nd ed). Cambridge, MA: MIT Press.
Smith, B. and Casati, R. (1994). Naïve Physics: An Essay in Ontology. Philosophical Psychology 7 (2): 225–244.
Steels, L. (1997). The Synthetic Modeling of Language Origins. Evolution of Communication 1 (1): 1–34.
Streeck, J. (1996a). How To Do Things With Things: Objets Trouvés and Symbolization. Human Studies 19: 365–384.
Streeck, J. (1996b, November). Vis-à-Vis an Embodied Mind. Paper Presented at the Annual Meeting of the American Anthropological Association, San Francisco, CA.
Suchman, L.A. (1987). Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge: Cambridge University Press.
Turkheimer, E. (1998). Heritability and Biological Explanation. Psychological Review 105: 782–791.
von Uexküll, J. (1973). Theoretische Biologie [Theoretical biology]. Frankfurt: Suhrkamp Verlag. (First published in 1928).
Varela, F.J., Thompson, E. and Rosch, E. (1993). The Embodied Mind: Cognitive Science and Human Experience. Cambridge, MA: MIT Press.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Roth, WM., Lawless, D.V. How Does the Body Get Into the Mind?. Human Studies 25, 333–358 (2002). https://doi.org/10.1023/A:1020127419047
Issue Date:
DOI: https://doi.org/10.1023/A:1020127419047