Abstract
In this paper, we propose a facial expression recognition method for non-frontal faces using RGB-D camera. The method uses the depth information of the RGB-D camera to calculate the face pose, modeled using a cylinder. Feature points obtained by the RGB-D camera, modified by the face pose, are compared with Action Units of the Facial Action Coding System for recognition of facial expression. Experiments were conducted using facial images in three types of angles and four expressions: anger, sadness, happiness, and surprise. Results of the experiments have shown that the method is rather robust to roll rotations than yaw and pitch rotations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chibelushi, C.C., Bourel, F.: Facial expression recognition: a brief tutorial overview. In: CVonline: On-Line Compendium of Computer Vision (2003)
Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27, 803–816 (2009)
Ren, F., Huang, Z.: Facial expression recognition based on AAM-SIFT and adaptive regional weighting. IEEJ Trans. Electr. Electron. Eng. 10(6), 713–722 (2015). doi:10.1002/tee.22151
Tian, Y.L., Kanade, T., Cohn, J.: Facial expression analysis. In: Moeslund, T.B., Hilton, A., Krüger, V., Sigal, L. (eds.) Handbook of Face Recognition, pp. 247–275. Springer, New York (2005)
Kumano, S., Otsuka, K., Yamato, J., Maeda, E., Sato, Y.: Pose-Invariant facial expression recognition using variable-intensity templates. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part I. LNCS, vol. 4843, pp. 324–334. Springer, Heidelberg (2007)
Ekman, P., Friesen, W.V.: Facial Action Coding System: Investigator’s Guide. Consulting Psychologists Press, Palo Alto (1978)
Acknowledgments
This research was partially supported by JSPS KAKENHI Grand Number 15H01712.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Inoue, Y., Nishide, S., Ren, F. (2016). Facial Expression Recognition Adaptive to Face Pose Using RGB-D Camera. In: Fujita, H., Ali, M., Selamat, A., Sasaki, J., Kurematsu, M. (eds) Trends in Applied Knowledge-Based Systems and Data Science. IEA/AIE 2016. Lecture Notes in Computer Science(), vol 9799. Springer, Cham. https://doi.org/10.1007/978-3-319-42007-3_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-42007-3_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42006-6
Online ISBN: 978-3-319-42007-3
eBook Packages: Computer ScienceComputer Science (R0)