Abstract
Extending recognition to uncontrolled situations is a key challenge for practical face recognition systems. Finding efficient and discriminative facial appearance descriptors is crucial for this. Most existing approaches use features of just one type. Here we argue that robust recognition requires several different kinds of appearance information to be taken into account, suggesting the use of heterogeneous feature sets. We show that combining two of the most successful local face representations, Gabor wavelets and Local Binary Patterns (LBP), gives considerably better performance than either alone: they are complimentary in the sense that LBP captures small appearance details while Gabor features encode facial shape over a broader range of scales. Both feature sets are high dimensional so it is beneficial to use PCA to reduce the dimensionality prior to normalization and integration. The Kernel Discriminative Common Vector method is then applied to the combined feature vector to extract discriminant nonlinear features for recognition. The method is evaluated on several challenging face datasets including FRGC 1.0.4, FRGC 2.0.4 and FERET, with promising results.
Keywords
- Face Recognition
- Linear Discriminant Analysis
- Local Binary Pattern
- Gabor Wavelet
- Kernel Principal Component Analysis
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ahonen, T., Hadid, A., Pietikainen, M.: Face recognition with local binary patterns. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 469–481. Springer, Heidelberg (2004)
Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: Application to face recognition. IEEE TPAMI 28(12) (2006)
Ben-Yacoub, S., Abdeljaoued, Y., Mayoraz, E.: Fusion of face and speech data for person identity verification. IDIAP-RR 03, IDIAP (1999)
Cevikalp, H., Neamtu, M., Wilkes, M.: Discriminative common vector method with kernels. IEEE TNN 17(6), 1550–1565 (2006)
Cevikalp, H., Neamtu, M., Wilkes, M., Barkana, A.: Discriminative common vectors for face recognition. IEEE TPAMI 27(1), 4–13 (2005)
Chang, K., Bowyer, K., Flynn, P., Chen, X.: Multi-biometrics using facial appearance, shape and temperature. In: Proc. AFGR 2004, pp. 43–48 (2004)
Chen, L.-F., Liao, H.-Y.M., Ko, M.-T., Lin, J.-C., Yu, G.-J.: A new lda-based face recognition system which can solve the small sample size problem. Pattern Recognition 33(10), 1713–1726 (2000)
Hotelling, H.: Analysis of a complex of statistical variables into principal components. J. Educational Psychology 24, 417–441 (1933)
Huang, Y.S., Suen, C.Y.: A method of combining multiple experts for the recognition of unconstrained handwritten numerals. IEEE TPAMI 17(1), 90–94 (1995)
Jain, A., Nandakumar, K., Ross, A.: Score normalization in multimodal biometric systems. Pattern Recognition 38(12), 2270–2285 (2005)
Kittler, J., Hatef, M., Duin, R.P., Matas, J.: On combining classifiers. IEEE TPAMI 20(3), 226–239 (1998)
Lades, M., Vorbruggen, J.C., Buhmann, J., Lange, J., von der Malsburg, C., Wurtz, R.P., Konen, W.: Distortion invariant object recognition in the dynamic link architecture. IEEE Trans. Comput. 42(3), 300–311 (1993)
Lai, P.L., Fyfe, C.: Kernel and nonlinear canonical correlation analysis. IJCNN 04, 4614 (2000)
Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: NIPS, pp. 556–566 obtainable2 (2000)
Liu, C.: Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance. IEEE TPAMI 28(5), 725–737 (2006)
Liu, C., Wechsler, H.: A shape- and texture-based enhanced fisher classifier for face recognition. IEEE TIP 10(4), 598–608 (2001)
Lu, X., Wang, Y., Jain, A.: Combining classifiers for face recognition. In: ICME 2003. Multimedia and Expo. 2003 (2003)
Ojala, T., Pietikainen, M., Harwood, D.: A comparative study of texture measures with classification based on feature distributions. Pattern Recognition 29 (1996)
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invarianat texture classification with local binary patterns. IEEE TPAMI 24(7), 971–987 (2002)
Comon, P.: Independent component analysis-a new concept? Signal Processing 43, 287–314 (1994)
Phillips, P.J., Flynn, P.J., Scruggs, W.T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.J.: Overview of the face recognition grand challenge. In: Proc. CVPR 2005, San Diego, CA, pp. 947–954 (2005)
Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The FERET evaluation methodology for face-recognition algorithms. IEEE TPAM 22(10), 1090–1104 (2000)
Ross, A., Jain, A.: Information fusion in biometrics. Pattern Recogn. Lett. 24(13), 2115–2125 (2003)
Fisher, R.R.: The use of multiple measurements in taxonomic problems. Ann. Eugen 7, 179–188 (1936)
Scholkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge (2001)
Swets, D.L., Weng, J.: Using discriminant eigenfeatures for image retrieval. IEEE TPAMI 18(8), 831–836 (1996)
Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. In: Zhou, S.K. (ed.) AMFG 2007. LNCS, vol. 4778, pp. 168–182. Springer, Heidelberg (2007)
Wiskott, L., Fellous, J.-M., Kruger, N., von der Malsburg, C.: Face recognition by elastic bunch graph matching. IEEE TPAMI 19(7), 775–779 (1997)
Yang, J., Yang, J.-Y.: Generalized k-l transform based combined feature extraction. Pattern Recognition 35(1), 295–297 (2002)
Zhang, W., Shan, S., Gao, W., Zhang, H.: Local Gabor Binary Pattern Histogram Sequence (LGBPHS): A novel non-statistical model for face representation and recognition. In: Proc. ICCV 2005, Beijing, China, pp. 786–791 (2005)
Zhao, W., Chellappa, R., Krishnaswamy, A.: Discriminant analysis of principal components for face recognition. In: FG 1998, Washington, DC, USA, p. 336 (1998)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Survey 34(4), 399–485 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tan, X., Triggs, B. (2007). Fusing Gabor and LBP Feature Sets for Kernel-Based Face Recognition. In: Zhou, S.K., Zhao, W., Tang, X., Gong, S. (eds) Analysis and Modeling of Faces and Gestures. AMFG 2007. Lecture Notes in Computer Science, vol 4778. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75690-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-540-75690-3_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75689-7
Online ISBN: 978-3-540-75690-3
eBook Packages: Computer ScienceComputer Science (R0)