Abstract
Three experiments follow up on Easton and Basala’s (1982) report that the “McGurk effect” (an influence of a visibly mouthed utterance on a dubbed acoustic one) does not occur when utterances are real words rather than nonsense syllables. In contrast, with real-word stimuli, Easton and Basala report a strong reverse effect whereby a dubbed soundtrack strongly affects identification of lipread words. In Experiment 1, we showed that a strong McGurk effect does obtain when dubbed real words are discrepant with observed words in consonantal place of articulation. A second experiment obtained only a weak reverse effect of dubbed words on judgments of lipread words. A final experiment was designed to provide a sensitive test of effects of lipread words on judgments of heard words and of heard words on judgments of lipread words. The findings reinforced those of the first two experiments that both effects occur, but, with place-of-articulation information discrepant across the modalities, the McGurk effect is strong and the reverse effect weak.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Campbell, R., Garwood, J., Franklin, S., Howard, D., Landis, T., &Regard, M. (1990). Neuropsychological studies of auditory-visual fusion illusions: Four case studies and their implications.Neuropsychologia,28, 787–802.
Easton, R. D., &Basala, M. (1982). Perceptual dorninance during lipreading.Perception & Psychophysics,32, 562–570.
Fowler, C. A. (1986). An event approach to a theory of speech perception from a direct-realist perspective.Journal of Phonetics,14, 3–28.
Fowler, C. A. (1991). Auditory perception is not special: We see the world, we feel the world, we hear the world.Journal of the Acoustical Society of America,89, 2910–2915.
Fowler, C. A., &Dekle, D. J. (1991). Listening with eye and hand: Cross-modal contributions to speech perception.Journal of Experimental Psychology: Human Perception & Performance,17, 816–828.
Liberman, A. M., &Mattingly, I. G. (1985). The motor theory revised.Cognition,21, 1–36.
Macdonald, J., &McGurk, H. (1978). Visual influences on speech perception processes.Perception & Psychophysics,24, 253–257.
Massaro, D. (1987).Speech perception by ear and by eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
McGurk, H., &Macdonald, J. (1976). Hearing lips and seeing voices: A new illusion.Nature,264, 746–748.
Rosenblum, L. (1989).Effort perception of speech and nonspeech events: An audio-visual investigation. Unpublished doctoral dissertation, University of Connecticut, Storrs, CT.
Rosenblum, L., &Fowler, C. A. (1991). An audio-visual investigation of the loudness/effort effect for speech and nonspeech perception.Journal of Experimental Psychology: Human Perception & Performance,17, 976–985.
Summerfield, A. Q. (1987), Some preliminaries to a comprehensive account of audio-visual speech perception. In B. Dodd & R. Campbell (Eds.),Hearing by eye: The psychology of lip-reading (pp. 3–51). Hillsdale, NJ: Erlbaum.
Summerfield, A. Q., &McGrath, R. (1984). Detection and resolution of audio-visual incompatibility in the perception of vowels.Quarterly Journal of Experimental Psychology,36A, 51–74.
Author information
Authors and Affiliations
Additional information
This research was supported in part by NICHD Grant HD01994 to Haskins Laboratories.
Rights and permissions
About this article
Cite this article
Dekle, D.J., Fowler, C.A. & Funnell, M.G. Audiovisual integration in perception of real words. Perception & Psychophysics 51, 355–362 (1992). https://doi.org/10.3758/BF03211629
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/BF03211629