Abstract
Identity recognition using 3D scans of the face has been recently proposed as an alternative or complementary solution to conventional 2D face recognition approaches based on still images or videos. In fact, face representations based on 3D data are expected to be much more robust to pose changes and illumination variations than 2D images, thus allowing accurate face recognition also in real-world applications with unconstrained acquisition. Based on these premises, in this Chapter we will first introduce the general and main methodologies for 3D face data acquisition and preprocessing, also presenting some 3D benchmark databases and performance indicators used for evaluation and comparison. Then, we will discuss some of the results recently achieved on this subject, also presenting current trends and challenges of the research.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
3DMD: http://www.3dmd.com
Alyüz, N., Gökberk, B., Akarun, L.: 3D face recognition system for expression and occlusion invariance. In: IEEE 2nd International Conferance on Biometrics: Theory, Applications, and Systems, Washington, DC, USA, pp. 1–7 (2008)
Amberg, B., Knothe, R., Vetter, T.: SHREC’08 entry: Shape based face recognition with a morphable model. In: IEEE International Conference on Shape Modeling and Applications, Stoney Brook, NY, pp. 253–254 (2008)
Bagdanov, A.D., Del Bimbo, A., Masi, I.: The Florence 2D/3D hybrid face dataset. In: Joint ACM Workshop on Human Gesture and Behavior Understanding (J-HGBU 2011), Arizona, USA, pp. 79–80 (2011)
Berretti, S., Ben Amor, B., Daoudi, M., del Bimbo, A.: 3D facial expression recognition using SIFT descriptors of automatically detected keypoints. The Visual Computer 27(11), 1021–1036 (2011)
Berretti, S., Del Bimbo, A.: Modeling spatial relationships between 3D objects. In: 18th International Conference on Pattern Recognition (ICPR 2006), Honk-Kong, China, vol. 1, pp. 119–122 (2006)
Berretti, S., Del Bimbo, A., Pala, P.: Description and retrieval of 3D face models using iso-geodesic stripes. In: ACM International Workshop on Multimedia Information Retrieval, Santa Barbara, CA, pp. 13–22 (2006)
Berretti, S., Del Bimbo, A., Pala, P.: 3D face recognition using iso-geodesic stripes. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(12), 2162–2177 (2010)
Berretti, S., Del Bimbo, A., Pala, P.: Facial curves between keypoints for recognition of 3D faces with missing parts. In: IEEE CVPR Workshop on Multi Modal Biometrics, Colorado Springs, Colorado, pp. 49–54 (2011)
Berretti, S., del Bimbo, A., Pala, P.: Real-time expression recognition from dynamic sequences of 3D facial scans. In: Proc. 5th Eurographics/ACM SIGGRAPH Workshop on 3D Object Retrieval (3DOR 2012), Cagliari, Italy, pp. 85–92 (2012)
Berretti, S., Del Bimbo, A., Pala, P.: Superfaces: A super-resolution model for 3D faces. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012 Ws/Demos, Part I. LNCS, vol. 7583, pp. 73–82. Springer, Heidelberg (2012)
Berretti, S., Del Bimbo, A., Pala, P.: Sparse matching of salient facial curves for recognition of 3d faces with missing parts. IEEE Transactions on Information Forensics and Security (to appear, 2013)
Besl, P.J., Mc Kay, N.D.: A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14(2), 239–256 (1992)
Beumier, C., Acheroy, M.: Face verification from 3D and grey level clues. Pattern Recognition Letters 22(12), 1321–1329 (2001)
Bowyer, K.W., Chang, K.I., Flynn, P.J.: A survey of approaches to three dimensional face recognition. In: International Conference on Pattern Recognition, Cambridge, United Kingdom, pp. 358–361 (2004)
Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Three dimensional face recognition. International Journal of Computer Vision 64(1), 5–30 (2005)
Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Robust expression-invariant face recognition from partially missing data. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 396–408. Springer, Heidelberg (2006)
Chang, K.I., Bowyer, K.W., Flynn, P.J.: An evaluation of multimodal 2d+3D face biometrics. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(4), 619–624 (2005)
Chang, K.I., Bowyer, K.W., Flynn, P.J.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(6), 1695–1700 (2006)
Chen, Y., Medioni, G.: Object modelling by registration of multiple range images. Image and Vision Computing 10(3), 145–155 (1992)
Claes, P., Smeets, D., Hermans, J., Vandermeulen, D., Suetens, P.: SHREC’11 track: Robust fitting of statistical model. In: Eurographics Workshop on 3D Object Retrieval, Llandudno, UK, pp. 89–95 (2011)
Colombo, A., Cusano, C., Schettini, R.: Gappy PCA classification for occlusion tolerant 3D face detection. Journal of Mathematical Imaging and Vision 35(3), 193–207 (2009)
Cook, J., Chandran, V., Fookes, C.: 3D face recognition using log-gabor templates. In: British Machine Vision Conference, Edinburgh, United Kingdom, vol. 2, pp. 769–778 (2006)
Daoudi, M., ter Haar, F., Veltkamp, R.: SHREC contest session on retrieval of 3D face scans. In: Shape Modeling International, Stoney Brook, NY (2008)
Drira, H., Ben Amor, B., Daoudi, M., Srivastava, A.: Pose and expression-invariant 3D face recognition using elastic radial curves. In: British Machine Vision Conference, Aberystwyth, UK, pp. 1–11 (2010)
Faltemier, T.C., Bowyer, K.W., Flynn, P.J.: A region ensemble for 3D face recognition. IEEE Transactions on Information Forensics and Security 3(1), 62–73 (2008)
Faltemier, T.C., Bowyer, K.W., Flynn, P.J.: Using multi-instance enrollment to improve performance of 3D face recognition. Computer Vision and Image Understanding 112(2), 114–125 (2008)
Farkas, L.G., Munro, I.R.: Anthropometric Facial Proportions in Medicine. Thomas Books, Springfield (1987)
Gupta, S., Markey, M.K., Bovik, A.C.: Anthropometric 3D face recognition. International Journal of Computer Vision 90(3), 331–349 (2010)
Huang, D., Ardabilian, M., Wang, Y., Chen, L.: 3-D face recognition using eLBP-based facial facial description and local feature hybrid matching. IEEE Transactions on Information Forensics and Security 7(5), 1551–1564 (2012)
Huang, D., Zhang, G., Ardabilian, M., Wang, Y., Chen, L.: 3D Face Recognition using Distinctiveness Enhanced Facial Representations and Local Feature Hybrid Matching. In: IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS), Washington D.C., USA, pp. 1–7 (2010)
Husken, M., Brauckmann, M., Gehlen, S., Malsburg, C.: Strategies and benefits of fusion of 2d and 3D face recognition. In: IEEE Workshop Face Recognition Grand Challenge, San Diego, CA (2005)
Kakadiaris, I.A., Passalis, G., Toderici, G., Murtuza, N., Lu, Y., Karampatziakis, N., Theoharis, T.: Three-dimensional face recognition in the presence of facial expressions: An annotated deformable approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(4), 640–649 (2007)
Kinect: http://www.xbox.com
Konica Minolta: http://sensing.konicaminolta.us/products/vivid-910-3d-laser-scanner/
Lee, J.C., Milios, E.: Matching range images of human faces. In: International Conference on Computer Vision, Osaka, Japan, pp. 722–726 (1990)
Li, H., Chen, L.: SHREC’11 track: Salient points. In: Eurographics Workshop on 3D Object Retrieval, Llandudno, UK, pp. 89–95 (2011)
Lowe, D.: Distinctive image features from scale-invariant key points. International Journal of Computer Vision 60(2), 91–110 (2004)
Lu, X., Jain, A.K.: Deformation modeling for robust 3D face matching. In: Conference on Computer Vision and Pattern Recognition, New York, NY, pp. 1377–1383 (2006)
Maes, C., Fabry, T., Keustermans, J., Smeets, D., Suetens, P., Vandermeulen, D.: Feature detection on 3D face surfaces for pose normalisation and recognition. In: IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS), Washington D.C., USA, pp. 1–6 (2010)
Mian, A.S., Bennamoun, M., Owens, R.: An efficient multimodal 2D-3D hybrid approach to automatic face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(11), 1927–1943 (2007)
Mian, A.S., Bennamoun, M., Owens, R.: Keypoint detection and local feature matching for textured 3D face recognition. International Journal of Computer Vision 79(1), 1–12 (2008)
Moreno, A.B., Sánchez, Á.: Gavabdb: A 3D face database. In: Workshop on Biometrics on the Internet, Vigo, Spain, pp. 75–80 (2004)
Pan, G., Han, S., Wu, Z., Wang, Y.: 3D face recognition using mapped depth images. In: Conference on Computer Vision and Pattern Recognition, San Diego, CA, vol. 3, pp. 175–181 (2005)
Passalis, G., Kakadiaris, I.A., Theoharis, T., Toderici, G., Murtuza, N.: Evaluation of 3D face recognition in the presence of facial expressions: an annotated deformable model approach. In: IEEE Workshop on Face Recognition Grand Challenge Experiments, San Diego, CA, vol. 3, pp. 171–179 (2005)
Passalis, G., Perakis, P., Theoharis, T., Kakadiaris, I.A.: Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 33(10), 1938–1951 (2011)
Perakis, P., Passalis, G., Theoharis, T., Toderici, G., Kakadiaris, I.A.: Partial matching of interpose 3D facial data for face recognition. In: International Conference on Biometrics: Theory, Applications, and Systems, Washington, DC, pp. 1–8 (2009)
Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: IEEE Workshop on Face Recognition Grand Challenge Experiments, San Diego, CA, pp. 947–954 (2005)
Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Worek, W.: Preliminary face recognition grand challenge results. In: International Conference on Automatic Face and Gesture Recognition, Southampton, UK, pp. 15–24 (2006)
Phillips, P.J., Grother, P., Micheals, R.J., Blackburn, D., Tabassi, E., Bone, M.: FRVT 2002: Evaluation report. Tech. rep., National Institute of Standards and Technology, NIST (2003)
Phillips, P.J., Scruggs, W.T., O’Toole, A.J., Flynn, P.J., Bowyer, K.W., Schott, C.L., Sharpe, M.: FRVT 2006 and ICE 2006 large-scale results. Tech. rep., National Institute of Standards and Technology (NIST), Gaithersburg, MD (2007)
Queirolo, C.C., Silva, L., Bellon, O.R., Segundo, M.P.: 3D face recognition using simulated annealing and the surface interpenetration measure. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(2), 206–219 (2010)
Samir, C., Srivastava, A., Daoudi, M.: 3D face recognition using shapes of facial curves. In: International Conference on Acoustics, Speech, and Signal Processing, Toulouse, France, vol. V, pp. 933–936 (2006)
Sandbach, G., Zafeiriou, S., Pantic, M., Rueckert, D.: Recognition of 3D facial expression dynamics. Image and Vision Computing (2012) (in press)
Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus database for 3D face analysis. In: Schouten, B., Juul, N.C., Drygajlo, A., Tistarelli, M. (eds.) BIOID 2008. LNCS, vol. 5372, pp. 47–56. Springer, Heidelberg (2008)
ter Haar, F., Veltkamp, R.: SHREC’08 entry: 3D face recognition using facial contour curves. In: IEEE International Conference on Shape Modeling and Applications, Stoney Brook, NY, pp. 259–260 (2008)
Tola, E., Lepetit, V., Fua, P.: A fast local descriptor for dense matching. In: International Conference on Computer Vision and Pattern Recognition, Anchorage, AK, pp. 1–8 (2008)
University of Notre Dame Biometrics Datasets (2008), http://www3.nd.edu/~cvrl/CVRL/Data_Sets.html
Veltkamp, R., van Jole, S., Drira, H., Ben Amor, B., Daoudi, M., Li, H., Chen, L., Claes, P., Smeets, D., Hermans, J., Vandermeulen, D., Suetens, P.: SHREC’11 track: 3D face models retrieval. In: Eurographics Workshop on 3D Object Retrieval, Llandudno, UK, pp. 89–95 (2011)
Wang, Y., Chiang, M.C., Thompson, P.M.: Mutual information-based 3D surface matching with applications to face recognition and brain mapping. In: International Conference on Computer Vision, Beijing, China, pp. 527–534 (2005)
Wang, Y., Liu, J., Tang, X.: Robust 3D face recognition by local shape difference boosting. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(12), 1858–1870 (2010)
Wang, Y., Tang, X., Liu, J., Pan, G., Xiao, R.: 3D face recognition by local shape difference boosting. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 603–616. Springer, Heidelberg (2008)
Xu, D., Hu, P., Cao, W., Li, H.: SHREC’08 entry: 3D face recognition using moment invariants. In: IEEE International Conference on Shape Modeling and Applications, Stoney Brook, NY, pp. 261–262 (2008)
Yan, P., Bowyer, K.W.: A fast algorithm for icp-based 3D shape biometrics. Computer Vision and Image Understanding 107(3), 195–202 (2007)
Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.: A 3d facial expression database for facial behavior research. In: Proc. IEEE Int. Conf. on Automatic Face and Gesture Recognition, Southampton, UK, pp. 211–216 (2006)
Zhang, Z.: Iterative point matching for registration of free-form curves and surfaces. International Journal of Computer Vision 13(2), 119–152 (1994)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Survey 35(4), 399–458 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Berretti, S., Del Bimbo, A., Pala, P. (2014). About 3D Faces. In: Cipolla, R., Battiato, S., Farinella, G. (eds) Registration and Recognition in Images and Videos. Studies in Computational Intelligence, vol 532. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-44907-9_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-44907-9_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-44906-2
Online ISBN: 978-3-642-44907-9
eBook Packages: EngineeringEngineering (R0)