Abstract
A previous study in the visual domain showed that similar spatial patterns of electroencephalography (EEG) power can be seen when subjects are visually presented with short videos of faces expressing emotions. As a corollary study we examine both the auditory and visual expressions of the same emotions to understand how listeners process auditory-only and visual-only expressions of affective stimuli in functional EEG (fEEG) and functional near-infrared-spectroscopy (fNIRS) signals. For this purpose we utilize fEEG directed transfer functions (DTF) analysis in very short windows of 250 ms which potentially is of interest of brain-computer/machine-interfacring (BCI/BMI) application with utilization of affective (limbic) responses from human brains. The preliminary results with affective paradigms confirm the hypothesis of cortical emotional responses in fEEG and fNIRS.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cichocki, A., Washizawa, Y., Rutkowski, T., Bakardjian, H., Phan, A.H., Choi, S., Lee, H., Zhao, Q., Zhang, L., Li, Y.: Noninvasive BCIs: Multiway signal-processing array decompositions. Computer 41(10) (2008) 34–42.
Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M.: Brain–computer interfaces for communication and control. Clin. Neurophysiol. 113 (2002) 767–791.
Pessoa, L.: On the relationship between emotion and cognition. Nat. Rev. Neurosci. 9 (2008) 148–158.
Rutkowski, T.M., Cichocki, A., Ralescu, A.L., Mandic, D.P.: Emotional states estimation from multichannel EEG maps. In Wang, R., Gu, F., Shen, E., eds.: Advances in Cognitive Neurodynamics ICCN 2007 Proceedings of the International Conference on Cognitive Neurodynamics. Neuroscience, Springer, Berlin, Heidelberg (2008) 695–698.
Lehrer, J.: How We Decide. Boston, MA, New York, NY: Houghton Mifflin Harcourt Publishing Company, (2009).
Baron-Cohen, S.: Mind Reading – The Interactive Guide to Emotions. London: Jessica Kingsley Publishers, (2004).
Rutkowski, T.M., Cichocki, A., Tanaka, T., Mandic, D.P., Cao, J., Ralescu, A.L.: Multichannel spectral pattern separation – an EEG processing application. In Proceedings of the 2009 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP2009), Taipei, Taiwan, IEEE Press (2009) 373–376.
Kaminski, M., Blinowska, K.: A new method of the description of the information flow in the brain structures. Biol. Cybern. 65(3) (1991) 203–210.
Acknowledgments
The research presented in this paper was supported in part by the Japan Society for the Promotion of Science grant no. 21360179.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media B.V.
About this paper
Cite this paper
Rutkowski, T.M., Zhao, Q., Cichocki, A., Tanaka, T., Mandic, D.P. (2011). Towards Affective BCI/BMI Paradigms – Analysis of fEEG and fNIRS Brain Responses to Emotional Speech and Facial Videos. In: Wang, R., Gu, F. (eds) Advances in Cognitive Neurodynamics (II). Springer, Dordrecht. https://doi.org/10.1007/978-90-481-9695-1_100
Download citation
DOI: https://doi.org/10.1007/978-90-481-9695-1_100
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-90-481-9694-4
Online ISBN: 978-90-481-9695-1
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)