Abstract
An experiment was conducted to investigate the claims made by Bruce and Young (1986) for the independence of facial identity and facial speech processing. A well-reported phenomenon in audiovisual speech perception—theMcGurk effect (McGurk & MacDonald, 1976), in which synchronous but conflicting auditory and visual phonetic information is presented to subjects—was utilized as a dynamic facial speech processing task. An element of facial identity processing was introduced into this task by manipulating the faces used for the creation of the McGurk-effect stimuli such that (1) they were familiar to some subjects and unfamiliar to others, and (2) the faces and voices used were either congruent (from the same person) or incongruent (from different people). A comparison was made between the different subject groups in their susceptibility to the McGurk illusion, and the results show that when the faces and voices are incongruent, subjects who are familiar with the faces are less susceptible to McGurk effects than those who are unfamiliar with the faces. The results suggest that facial identity and facial speech processing are not entirely independent, and these findings are discussed in relation to Bruce and Young’s (1986) functional model of face recognition.
Article PDF
Similar content being viewed by others
References
Bowers, D., Bauer, R. M., Coslett, H. B., &Heilman, K. M. (1985). Processing faces by patients with unilateral hemisphere lesions: 1. Dissociation between judgements of facial affect and facial identity.Brain & Cognition,4, 258–272.
Bruce, V. (1979). Searching for politicians: An information-processing approach to face recognition.Quarterly Journal of Experimental Psychology,31, 373–395.
Bruce, V. (1983). Recognising faces.Philosophical Transactions of the Royal Society of London: Series B,302, 423–436.
Bruce, V. (1986). Influences of familiarity on the processing of faces.Perception,15, 387–397.
Bruce, V., &Young, A. (1986). Understanding face recognition.British Journal of Psychology,77, 305–327.
Burton, A. M., Young, A. W., Bruce, V., Johnston, R. A., &Ellis, A.W. (1991). Understanding covert recognition.Cognition,39, 129–166.
Campbell, R., Landis, T., &Regard, M. (1986). Face recognition and lipreading.Brain,109, 509–521.
de Gelder, B., Vroomen, J., &van der Heide, L. (1991). Face recognition and lip reading in autism.European Journal of Cognitive Psychology,3, 69–86.
Dodd, B. (1977). The role of vision in the perception of speech.Perception,6, 31–40.
Ellis, H. D. (1981). Theoretical aspects of face recognition. In G. M. Davies, H. D. Ellis, & J. W. Shepherd (Eds.),Perceiving and remembering faces (pp. 171–197). London: Academic Press.
Ellis, H. D. (1983). The role of the right hemisphere in face perception. In A. W. Young (Ed.),Functions of the right cerebral hemisphere (pp. 33–64). London: Academic Press.
Ellis, H. D. (1986). Processes underlying face recognition. In R. Bruyer (Ed.),The neuropsychology of face perception and facial expression (pp. 1–27). Hillsdale, NJ: Erlbaum.
Etcoff, N. L. (1984). Selective attention to facial identity and facial emotion.Neuropsychologia,22, 281–295.
Fowler, C. A., &Dekle, D. J. (1991). Listening with eye and hand: Cross-modal contributions to speech perception.Journal of Experimental Psychology: Human Perception & Performance,17, 816–828.
Frith, U. (1989).Autism: Explaining the enigma. Oxford, U.K.: Basil Blackwell.
Green, K. P., Kuhl, P. K., &Meltzoff, A. N. (1988). Factors affecting the integration of auditory and visual information in speech: The effect of vowel environment.Journal of the Acoustical Society of America,84, SI55.
Green, K. P., Kuhl, P. K., Meltzoff, A. N., &Stevens, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect.Perception & Psychophysics,50, 524–536.
Hasselmo, M. E., Rolls, E. T., &Bayliss, G. C. (1989). The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey.Behavioural Brain Research,32, 203–218.
Hay, D. C., &Young, A. W. (1982). The human face. In A. W. Ellis (Ed.),Normality and pathology in cognitive functions (pp. 173–202). London: Academic Press.
MacDonald, J., &McGurk, H. (1978). Visual influences on speech perception processes.Perception & Psychophysics,24, 253–257.
Massaro, D. W. (1987). Speech perception by ear and eye. In B. Dodd & R. Campbell (Eds.),Hearing by eye: The psychology of lip-reading (pp. 53–83). London: Erlbaum.
Massaro, D. W., &Cohen, M. M. (1983). Evaluation and integration of visual and auditory information in speech perception.Journal of Experimental Psychology: Human Perception & Performance,9, 753–771.
McGurk, H., &MacDonald, J. (1976). Hearing lips and seeing voices.Nature,264, 746–748.
Nygaard, L. C., Sommers, M. S., &Pisoni, D. B. (1994). Speech perception as a talker-contingent process.Psychological Science,5, 42–45.
Reisberg, D., McLean, J., &Goldfield, A. (1987). Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli. In B. Dodd & R. Campbell (Eds.),Hearing by eye: The psychology of lip-reading (pp. 97–113). London: Erlbaum.
Sumby, W. H., &Pollack, I. (1954). Visual contribution to speech intelligibility in noise.Journal of the Acoustical Society of America,26, 212–215.
Summerfield, Q. (1979). Use of visual information for phonetic perception.Phonetica,36, 314–331.
Summerfield, Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. In B. Dodd & R. Campbell (Eds.),Hearing by eye: The psychology of lip-reading (pp. 3–51). London: Erlbaum.
Summerfield, Q., &McGrath, M. (1984). Detection and resolution of audio-visual incompatibility in the perception of vowels.Quarterly Journal of Experimental Psychology,36A, 51–74.
Welch, R. B., &Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy.Psychological Bulletin,88, 638–667.
Williams, C. E. (1964).The effects of selected factors on the aural identification of speakers (Report No. EDS-TDR-65-153, Section III). Hanscom Field, MA: Air Force Systems Command, Electronic Systems Division.
Young, A. W., McWeeny, K. H., Hay, D. C., &Ellis, A. W. (1986). Matching familiar and unfamiliar faces on identity and expression.Psychological Research,48, 63–68.
Young, A. W., Newcombe, F., De Haan, E. H. F., Small, M., &Hay, D. C. (1993). Face perception after brain injury. Selective impairments affecting identity and expression.Brain,116, 941–959.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported in part by Grant R000233560 from the Economic and Social Research Council.
Rights and permissions
About this article
Cite this article
Walker, S., Bruce, V. & O’Malley, C. Facial identity and facial speech processing: Familiar faces and voices in the McGurk effect. Perception & Psychophysics 57, 1124–1133 (1995). https://doi.org/10.3758/BF03208369
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03208369