Skip to main content
SpringerLink
Log in

Elastic Shape Models for Face Analysis Using Curvilinear Coordinates

  • Published:
Journal of Mathematical Imaging and Vision Aims and scope Submit manuscript

Abstract

This paper studies the problem of analyzing variability in shapes of facial surfaces using a Riemannian framework, a fundamental approach that allows for joint matchings, comparisons, and deformations of faces under a chosen metric. The starting point is to impose a curvilinear coordinate system, named the Darcyan coordinate system, on facial surfaces; it is based on the level curves of the surface distance function measured from the tip of the nose. Each facial surface is now represented as an indexed collection of these level curves. The task of finding optimal deformations, or geodesic paths, between facial surfaces reduces to that of finding geodesics between level curves, which is accomplished using the theory of elastic shape analysis of 3D curves. The elastic framework allows for nonlinear matching between curves and between points across curves. The resulting geodesics between facial surfaces provide optimal elastic deformations between faces and an elastic metric for comparing facial shapes. We demonstrate this idea using examples from FSU face database.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)

    Article  Google Scholar 

  2. Beumier, C., Acheroy, M.: Automatic 3D face authentication. J. Image Vis. Comput. 18(4), 315–321 (2000)

    Article  Google Scholar 

  3. Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Efficient computation of isometry-invariant distances between surfaces. SIAM J. Sci. Comput. 28(5), 1812–1836 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  4. Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Three-dimensional face recognition. Int. J. Comput. Vis. 64(1), 5–30 (2005)

    Article  Google Scholar 

  5. Chang, K.I., Bowyer, K.W., Flynn, P.J.: Multiple nose region matching for 3D face recognition under varying facial expression. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1695–1700 (2006)

    Article  Google Scholar 

  6. Charpiat, G., Faugeras, O., Keriven, R.: Approximations of shape metrics and application to shape warping and empirical shape statistics. J. Found. Comput. Math. 5(1), 1–58 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  7. Chui, H., Rangarajan, A.: A new algorithm for non-rigid point matching. In: Proc. of IEEE Conferences on CVPR, pp. 44–51 (2000)

  8. Do Carmo, M.P.: Differential Geometry of Curves and Surfaces. Prentice Hall, New York (1976)

    MATH  Google Scholar 

  9. Glaunes, J., Trouvé, A., Younes, L.: Diffeomorphic matching of distributions: A new approach for unlabelled point-sets and sub-manifolds matching. In: CVPR (2), pp. 712–718 (2004)

  10. Glaunes, J., Trouve, A., Younes, L.: Modeling planar shape variation via Hamiltonian flows of curves. In: Krim, H., Yezzi, A. (eds.) Statistics and Analysis of Shapes. Birkhauser, Basel (2006)

    Google Scholar 

  11. Grenander, U.: General Pattern Theory. Oxford University Press, Oxford (1993)

    Google Scholar 

  12. Grenander, U., Miller, M.I.: Computational anatomy: An emerging discipline. Q. Appl. Math. 56(4), 617–694 (1998)

    MATH  MathSciNet  Google Scholar 

  13. Grenander, U., Srivastava, A., Saini, S.: A pattern-theoretic characterization of biological growth. IEEE Trans. Med. Imag. 26(5), 648–659 (2007)

    Article  Google Scholar 

  14. Gupta, S., Markey, M.K., Aggarwal, J., Bovik, A.C.: Three dimensional face recognition based on geodesic and euclidean distances. In: Proceedings of IS&T/SPIE Symposium on Electronic Imaging: Vision Geometry XV (2007)

  15. Hallinan, P.W., Gordon, G.G., Yuille, A.L., Giblin, P., Mumford, D.: Two- and Three-Dimensional Patterns of Face. A.K. Peters, Wellesley (1999)

    MATH  Google Scholar 

  16. Hesher, C., Srivastava, A., Erlebacher, G.: A novel technique for recognizing faces using range images. In: Proceedings of ISSPA, 2003, Paris, France (2003)

  17. Joshi, S., Srivastava, A., Klassen, E., Jermyn, I.H.: Removing shape-preserving transformations in square-root elastic (SRE) framework for shape analysis of curves. In: Proc. of Sixth Workshop on Energy Minimization Methods in CVPR (EMMCVPR) (2007)

  18. Joshi, S.H., Klassen, E., Srivastava, A., Jermyn, I.H.: An efficient representation for computing geodesics between n-dimensional elastic shapes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2007

  19. Kakadiaris, I.A., Passalis, G., Toderici, G., Murtuza, M.N., Karampatziakis, N., Theoharis, T.: Three-dimensional face recognition in the presence of facial expressions: An annotated deformable model approach. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 1–10 (2007)

    Article  Google Scholar 

  20. Kendall, D.G.: Shape manifolds, procrustean metrics and complex projective spaces. Bull. Lond. Math. Soc. 16, 81–121 (1984)

    Article  MATH  MathSciNet  Google Scholar 

  21. Kilian, M., Mitra, N.J., Pottmann, H.: Geometric modeling in shape space. In: Proceedings of SIGGRAPH (2007)

  22. Klassen, E., Srivastava, A.: Geodesics between 3D closed curves using path straightening. In: European Conference on Computer Vision, vol. 1, pp. 95–106 (2006)

  23. Klassen, E., Srivastava, A., Mio, W., Joshi, S.H.: Analysis of planar shapes using geodesic paths on shape spaces. IEEE Trans. Pattern Anal. Mach. Intell. 26(3), 372–383 (2004)

    Article  Google Scholar 

  24. Kotropoulos, C., Tefas, A., Pitas, I.: Frontal face authentication using morphological elastic graph matching. IEEE Trans. Image Process. 9(4), 555–560 (2000)

    Article  Google Scholar 

  25. Litke, N., Droske, M., Rumpf, M., Schröder, P.: An image processing approach to surface matching. In: Desbrun, M., Pottmann, H. (eds.) Third Eurographics Symposium on Geometry Processing, pp. 207–216 (2005)

  26. Lu, X., Jain, A.K.: Deformation analysis for 3D face matching. In: Proc. 7th IEEE Workshop on Applications of Computer Vision, pp. 99–104. Breckenridge (2005)

  27. Lu, X., Jain, A.K., Colbry, D.: Matching 2.5D face scans to 3D models. IEEE Trans. Pattern Anal. Mach. Intell. 28(1), 31–43 (2006)

    Article  Google Scholar 

  28. Memoli, F., Sapiro, G.: A theoretical and computational framework for isometry invariant recognition of point cloud data. Found. Comput. Math. 5(3), 313–347 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  29. Michor, P.W., Mumford, D.: Riemannian geometries on spaces of plane curves. J. Eur. Math. Soc. 8, 1–48 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  30. Miller, M.I., Younes, L.: Group actions, homeomorphisms, and matching: A general framework. Int. J. Comput. Vis. 41(1/2), 61–84 (2001)

    Article  MATH  Google Scholar 

  31. Mio, W., Srivastava, A., Joshi, S.H.: On shape of plane elastic curves. Int. J. Comput. Vis. 73(3), 307–324 (2007)

    Article  Google Scholar 

  32. Mpiperis, I., Malassiotis, S., Strintzis, M.G.: 3-D face recognition with the geodesic polar representation. IEEE Trans. Information Forensics Security 2(3), 537–547 (2007)

    Article  Google Scholar 

  33. Osada, R., Funkhouser, T., Chazells, B., Dobkin, D.: Matching 3D models with shape distributions. In: IEEE Shape Modeling International, May 2001

  34. Samir, C., Srivastava, A., Daoudi, M.: Three-dimensional face recognition using shapes of facial curves. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1858–1863 (2006)

    Article  Google Scholar 

  35. Samir, C., Srivastava, A., Daoudi, M.: 3D face recognition using shapes of facial curves. In: Proceedings of ICASSP, 2006, Special Session on Statistical Inferences on Nonlinear Manifolds with Applications in Signal and Image Processing, May 2006

  36. Samir, C., Srivastava, A., Daoudi, M., Klassen, E.: An intrinsic framework for analysis of facial surfaces. Int. J. Comput. Vis. (2007, in review)

  37. Schmidt, F.R., Clausen, M., Cremers, D.: Shape matching by variational computation of geodesics on a manifold. In: Pattern Recognition (Proc. DAGM). LNCS, vol. 4174, pp. 142–151. Springer, Berlin (2006)

    Chapter  Google Scholar 

  38. Sebastian, T.B., Klein, P.N., Kimia, B.B.: On aligning curves. IEEE Trans. Pattern Anal. Mach. Intell. 25(1), 116–125 (2003)

    Article  Google Scholar 

  39. Spivak, M.: A Comprehensive Introduction to Differential Geometry, vol. I and II. Publish or Perish, Berkeley (1979)

    Google Scholar 

  40. Wang, S., Wang, Y., Jin, M., Gu, X., Samaras, D.: 3D surface matching and recognition using conformal geometry. In: CVPR (2), pp. 2453–2460 (2006)

  41. Wang, Y., Chiang, M.-C., Thompson, P.: Mutual information-based 3D surface matching with applications to face recognition and brain mapping. In: International Conference on Computer Vision (2005)

  42. Wiskott, L., Fellous, J.-M., Krüger, N., von der Malsburg, C.: Face recognition by elastic bunch graph matching. In: Jain, L.C., Halici, U., Hayashi, I., Lee, S.B. (eds.) Intelligent Biometric Techniques in Fingerprint and Face Recognition, pp. 355–396. CRC Press, Boca Raton (1999). Chap. 11

    Google Scholar 

  43. Yezzi, A.-J., Mennucci, A.: Conformal metrics and true “gradient flows” for curves. In: Proceedings of the Tenth IEEE International Conference on Computer Vision, vol. 1, pp. 913–919 (2005)

  44. Younes, L.: Computable elastic distance between shapes. SIAM J. Appl. Math. 58(2), 565–586 (1998)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Statistics, Florida State University, Tallahassee, FL, 32306, USA

    A. Srivastava

  2. Institut Telecom, Telecom Lille1, LIFL (UMR USTL/CNRS 8022), Villeneuve d’Ascq, France

    C. Samir & M. Daoudi

  3. Department of Electrical Engineering, Florida State University, Tallahassee, FL, 32306, USA

    S. H. Joshi

Authors
  1. A. Srivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. Samir
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. S. H. Joshi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. M. Daoudi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. Srivastava.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Srivastava, A., Samir, C., Joshi, S.H. et al. Elastic Shape Models for Face Analysis Using Curvilinear Coordinates. J Math Imaging Vis 33, 253–265 (2009). https://doi.org/10.1007/s10851-008-0073-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10851-008-0073-6

Keywords

Search

Navigation