Abstract
A system capable of monitoring its user’s mental workload can evaluate the suitability of its interface and interactions for user’s current cognitive status and properly change them when necessary. Galvanic skin response (GSR) and eye blinks are cognitive load measures which can be captured conveniently and at low cost. The present study has assessed multiple features of these two signals in classification of cognitive workload level. The experiment included arithmetic tasks with four difficulty levels and two types of machine learning algorithms have been applied for classification. Obtained results show that the studied features of blink and GSR can reasonably discriminate workload levels and combining features of the two modalities improves the accuracy of cognitive load classification. We have achieved around 75% for binary classification and more than 50% for four-class classification.
Chapter PDF
Similar content being viewed by others
References
Bentivoglio, A.R., Bressman, S.B., Cassetta, E., Carretta, D., Tonali, P., Albanese, A.: Analysis of Blink Rate Patterns in Normal Subjects. Movement Disorders 12, 1028–1034 (1997)
Berka, C., Levendowski, D.J., Lumicao, M.N., Yau, A., Davis, G., Zivkovic, V.T., Olmstead, R.E., Tremoulet, P.D., Craven, P.L.: EEG Correlates of Task Engagement and Mental Workload in Vigilance, Learning, and Memory Tasks. Aviation, Space, and Environmental Medicine 78, B231–B244 (2007)
Chandler, P., Sweller, J.: Cognitive Load While Learning to Use a Computer Program. Applied Cognitive Psychology 10, 151–170 (1996)
Chanel, G., Kronegg, J., Grandjean, D., Pun, T.: Emotion assessment: Arousal evaluation using EEG’s and peripheral physiological signals. In: Gunsel, B., Jain, A.K., Tekalp, A.M., Sankur, B. (eds.) MRCS 2006. LNCS, vol. 4105, pp. 530–537. Springer, Heidelberg (2006)
Chen, S., Epps, J., Ruiz, N., Chen, F.: Eye Activity as a Measure of Human Effort in HCI. In: International Conference on Intelligent User Interfaces, pp. 315–318. ACM Press (2011)
Fogarty, C., Stern, J.A.: Eye movements and blinks: Their Relationship to Higher Cognitive Processes. International Journal of Psychophysiology 8, 35–42 (1989)
Haapalainen, E., Seungjun, K., Forlizzi, J.F., Dey, A.K.: Psycho-Physiological Measures for Assessing Cognitive Load. In: International Conference on Ubiquitous Computing. ACM Press (2010)
Holland, M.K., Tarlow, G.: Blinking and Mental Load. Psychological Reports 31, 119–127 (1972)
Horlings, R., Datcu, D., Rothkrantz, L.J.: Emotion Recognition Using Brain Activity. In: International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing, pp. II.1.1–II.1.6. ACM (2008)
Huttunen, K., Keränen, H., Väyrynen, E., Pääkkönen, R., Leino, T.: Effect of Cognitive Load on Speech Prosody in Aviation: Evidence from Military Simulator Flights. Applied Ergonomics 42, 348–357 (2011)
Ikehara, C.S., Crosby, M.E.: Assessing Cognitive Load with Physiological Sensors. In: Hawaii International Conference on System Sciences, p. 295a (2005)
Knoll, A., Wang, Y., Chen, F., Xu, J., Ruiz, N., Epps, J., Zarjam, P.: Measuring cognitive workload with low-cost electroencephalograph. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part IV. LNCS, vol. 6949, pp. 568–571. Springer, Heidelberg (2011)
Lipp, O.V., Neumann, D.L.: Attentional Blink Reflex Modulation in a Continuous Performance Task is Modality Specific. Psychophysiology 41, 417–425 (2004)
Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., Arnaldi, B.: A Review of Classification Algorithms for EEG-Based Brain-Computer Interfaces. Journal of Neural Engineering 4, R1–R13 (2007)
Nakasone, A., Prendinger, H., Ishizuka, M.: Emotion Recognition from Electromyography and Skin Conductance. In: International Workshop on Biosignal Interpretation, pp. 219–222 (2005)
Niculescu, A., Cao, Y., Nijholt, A.: Stress and Cognitive Load in Multimodal Conversational Interactions. In: International Conference on Human-Computer Interaction, pp. 891–895. Springer (2009)
Nourbakhsh, N., Wang, Y., Chen, F., Calvo, R.A.: Using Galvanic Skin Response for Cognitive Load Measurement in Arithmetic and Reading Tasks. In: Australian Computer-Human Interaction Conference, pp. 420–423. ACM Press (2012)
Paas, F.G.W.C.: Training Strategies for Attaining Transfer of Problem-Solving Skill in Statistics: A Cognitive-Load Approach. Journal of Educational Psychology 84, 429–434 (1992)
Paas, F.G.W.C., Van Merriënboer, J.G.: Instructional Control of Cognitive Load in the Training of Complex Cognitive Tasks. Educational Psychology Review 6, 351–371 (1994)
Paas, F.G.W.C., Van Merriënboer, J.G.: Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach. Journal of Educational Psychology 86, 122–133 (1994)
Ruiz, N., Taib, R., Shi, Y., Choi, E.H., Chen, F.: Using Pen Input Features as Indices of Cognitive Load. In: International Conference on Multimodal Interfaces, pp. 315–318. ACM Press (2007)
Sakr, G.E., Elhajj, I.H., Wejinya, U.C.: Multi Level SVM for Subject Independent Agitation Detection. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics, pp. 538–543 (2009)
Sebe, N., Lew, M.S., Cohen, I., Garg, A., Huang, T.S.: Emotion Recognition Using a Cauchy Naive Bayes Classifier. In: 2002 Proceedings of the 16th International Conference on Pattern Recognition, vol. 1, pp. 17–20. IEEE (2002)
Setz, C., Arnrich, B., Schumm, J., Marca, R.L., Tr, G., Ehlert, U.: Discriminating Stress From Cognitive Load Using a Wearable EDA Device. Technology 14, 410–417 (2010)
Shi, Y., Ruiz, N., Taib, R., Choi, E.H., Chen, F.: Galvanic Skin Response (GSR) as an Index of Cognitive Load. In: Computer/Human Interaction Conference Work-in-Progress, pp. 2651–2656. ACM Press (2007)
Wang, W., Li, Z., Wang, Y., Chen, F.: Indexing Cognitive Workload Based on Pupillary Response under Luminance and Emotional Changes. In: International Conference on Intelligent User Interfaces, pp. 247–256. ACM Press (2013)
Xu, J., Wang, Y., Chen, F., Choi, E.: Pupillary Response Based Cognitive Workload Measurement under Luminance Changes. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part II. LNCS, vol. 6947, pp. 178–185. Springer, Heidelberg (2011)
Yeo, M., Li, X., Shen, K., Wildersmith, E.: Can SVM Be Used for Automatic EEG Detection of Drowsiness During Car Driving? Safety Science 47, 115–124 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
Nourbakhsh, N., Wang, Y., Chen, F. (2013). GSR and Blink Features for Cognitive Load Classification. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2013. INTERACT 2013. Lecture Notes in Computer Science, vol 8117. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40483-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-40483-2_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40482-5
Online ISBN: 978-3-642-40483-2
eBook Packages: Computer ScienceComputer Science (R0)