Abstract
Anxious individuals have been shown to interpret others’ emotional states negatively. Since most studies have used facial expressions as emotional cues, we examined whether trait anxiety affects the recognition of emotion in a dynamic face and voice that were presented in synchrony. The face and voice cues conveyed either matched (e.g., happy face and voice) or mismatched emotions (e.g., happy face and angry voice). Participants with high or low trait anxiety were to indicate the perceived emotion using one of the cues while ignoring the other. The results showed that individuals with high trait anxiety were more likely to interpret others’ emotions in a negative manner, putting more weight on the to-be-ignored angry cues. This interpretation bias was found regardless of the cue modality (i.e., face or voice). Since trait anxiety did not affect recognition of the face or voice cues presented in isolation, this interpretation bias appears to reflect an altered integration of the face and voice cues among anxious individuals.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Becker DV, Kenrick DT, Neuberg SL, Blackwell KC, Smith DM (2007) The confounded nature of angry men and happy women. J Per Soc Psychol 92:179–190
Bertelson P, de Gelder B (2004) The psychology of multimodal perception. In: Spence C, Driver J (eds) Crossmodal space and crossmodal attention. Oxford University Press, Oxford, pp 151–177
Bishop SJ (2007) Neurocognitive mechanisms of anxiety: an integrative account. Trends Cogn Sci 11:307–316
Bishop S, Duncan J, Brett M, Lawrence AD (2004) Prefrontal cortical function and anxiety: controlling attention to threat-related stimuli. Nat Neurosci 7:184–188
Campanella S, Bruyer R, Froidbise S, Rossignol M, Joassin F, Kornreich C, Noel X, Verbanck P (2010) Is two better than one? A cross-modal oddball paradigm reveals greater sensitivity of the P300 to emotional face-voice associations. Clin Neurophysiol 121:1855–1862
Collignon O, Girard S, Gosselin F, Roy S, Saint-Amour D, Lassonde M, Lepore F (2008) Audio-visual integration of emotion expression. Brain Res 1242:126–135
Cooper RM, Rowe AC, Penton-Voak IS (2008) The role of trait anxiety in the recognition of emotional facial expressions. J Anxiety Disord 22:1120–1127
de Gelder B, Vroomen J (2000) The perception of emotions by ear and by eye. Cogn Emot 14:289–311
de Gelder B, Vroomen J, Bertelson P (1998) Upright but not inverted faces modify the perception of emotion in the voice. Cahiers de Psychologie Cognitive 17:1021–1032
de Gelder B, Pourtois G, Weiskrantz L (2002) Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures. Proc Natl Acad Sci USA 99:4121–4126
Egner T, Etkin A, Gale S, Hirsh J (2008) Dissociable neural systems resolve conflict from emotional versus nonemotional distracters. Cereb Cortex 18:1475–1484
Ethofer T, Anders S, Erb M, Droll C, Royen L, Saur R, Reiterer S, Grodd W, Wildgruber D (2006) Impact of voice on emotional judgment of faces: an event-related fMRI study. Hum Brain Mapp 27:707–714
Etkin A, Egner T, Peraza DM, Kandel ER, Hirsch J (2006) Resolving emotional conflict: a role for the rostral anterior cingulate cortex in modulating activity in the amygdala. Neuron 51:871–882
Eysenck MW, Derakshan N, Santos R, Calvo MG (2007) Anxiety and cognitive performance: attentional control theory. Emotion 7:336–353
Haas B, Omura K, Constable RT, Canli T (2007) Emotional conflict and neuroticism: Personality-dependent activation in the amygdala and subgenual anterior cingulated. Behav Neurosci 121:249–256
Kreifelts B, Ethofer T, Grodd W, Erb M, Wildgruber D (2007) Audiovisual integration of emotional signals in voice and face: An event-related fMRI study. NeuroImage 37:1445–1456
Mathews A, MacLeod C (1998) A cognitive model of selective processing in anxiety. Cogn Ther Res 22:539–560
Meredith MA, Stein BE (1983) Interactions among converging sensory inputs in the superior colliculus. Science 221:389–391
Mohlman J, Carmin CN, Price RB (2007) Jumping to interpretations. Social anxiety disorder and the identification of emotional facial expressions. Behav Res Ther 45:591–599
Munhall KG, Gribble P, Sacco L, Ward M (1996) Temporal constraints on the McGurk Effect. Percept Psychophys 58:351–362
Pourtois G, Debatisse D, Despland PA, de Gelder B (2002) Facial expressions modulate the time course of long latency auditory brain potentials. Brain Res Cogn Brain Res 14:99–105
Quadflieg S, Wendt B, Mohr A, Miltner WHR, Straube T (2007) Recognition and evaluation of emotional prosody in individuals with generalized social phobia: A pilot study. Behav Res Ther 45:3096–3103
Quadflieg S, Mohr A, Mentzel HJ, Miltner WHR, Straube T (2008) Modulation of the neural network involved in the processing of angry prosody: The role of task-relevance and social phobia. Biol Psychol 78:129–137
Richards A, French CC, Calder AJ, Webb B, Fox R, Young AW (2002) Anxiety-related bias in the classification of emotionally ambiguous facial expressions. Emotion 2:273–287
Shimizu H, Imae K (1981) State-Trait Anxiety Inventory no nihongoban (daigakuseiyo) no sakusei [Development of the Japanese edition of the Spielberger State-Trait Anxiety Inventory (STAI) for student use]. Japanese Journal of Educational Psychology 29:62–67
Spielberger CD, Gorsuch RL, Lushene RE (1970) Manual for the state-trait anxiety inventory. Consulting Psychologists Press, Palo Alto
Tanaka A, Koizumi A, Imai H, Hiramatsu S, Hiramoto E, de Gelder B (2010) I feel your voice: Cultural differences in the multisensory perception of emotion. Psychol Sci 21:1259–1262
van Wassenhove V, Grant KW, Poeppel D (2007) Temporal window of integration in bimodal speech. Neuropsychologia 45:598–607
Vroomen J, Collier R, Mozziconacci S (1993) Duration and intonation in emotional speech. Proceedings of the Third European Conference on Speech Communication and Technology, Berlin 577–580
Yoon KL, Zinbarg RE (2008) Interpreting neutral faces as threatening is a default mode for socially anxious individuals. J Abnorm Psychl 117:680–685
Acknowledgments
A.K. was supported by the Japanese Society for the Promotion of Science Research Fellowship for Young Scientists (20-11352). A.T. was supported by a Grant-in-Aid for Specially Promoted Research No. 19001004 from the Ministry of Education, Culture, Sports, Science and Technology, Japan, the Postdoctoral Fellowships for Research Abroad from the Japan Society for the Promotion of Science, and a SCOPE Grant for Young ICT Researchers No. 102103011 from the MIC, Japan.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Koizumi, A., Tanaka, A., Imai, H. et al. The effects of anxiety on the interpretation of emotion in the face–voice pairs. Exp Brain Res 213, 275–282 (2011). https://doi.org/10.1007/s00221-011-2668-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-011-2668-1