Skip to main content
SpringerLink
Log in

3-D Heart Modeling and Motion Estimation Based on Continuous Distance Transform Neural Networks and Affine Transform

  • Published:
Journal of VLSI signal processing systems for signal, image and video technology Aims and scope Submit manuscript

Abstract

In this paper, we apply the previously proposed continuous distance transform neural network (CDTNN) to represent 3-D endocardial (inner) and epicardial (outer) contours and quantitatively estimate the motion of left ventricles of human hearts from ultrasound images acquired using transesophageal echo-cardiography. This CDTNN has many good properties as the conventional distance transforms, which are suitable for 3-D object representation and deformation estimation. We have successfully represented the 3-D epicardia and endocardia of left ventricles using CDTNNs trained by as few as 7.5% of the manually traced data. The mean absolute error in the testing for one patient over the 27 testing planes were (1.4 ± 1.2 mm) for the endocardium, (1.3 ± 1.0 mm) for the epicardium at end diastole and (1.4 ± 1.2 mm) for the endocardium vs. 1.2 ± 1.0 mm for the epicardium at end systole. The absolute error measured compares favorably with the human inter-observer variability reported for analyzing distances. With this unique distance transform representation that is continuous and differentiable, we are also able to systematically and effectively measure the amount of 3-D heart motion in terms of affine transform.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. F.H. Sheehan, E.L. Bolson, H.T. Dodge, D.G. Mathey, J. Schofer, and H.W. Woo, “Advantages and applications of the centerline method for characterizing regional ventricular function”, Circulation, Vol. 74, pp. 293–305, 1986.

    Article  Google Scholar 

  2. H. Delingette, M. Hebert, and K. Ikeuchi, “A spherical representation for the recognition of curved objects”, 1993 IEEE 4th International Conference on Computer Vision, Berlin, German, pp. 103–112, 1993.

  3. O.D. Faugeras and M. Hebert, “The representation, recognition, and locating of 3-D Objects”, Int'l. J. Rob. Res., Vol. 5, No.3, pp. 27–52, Fall 1986.

    Article  Google Scholar 

  4. R.M. Bolle, “Information extraction about complex three-dimensional objects from visual data”, Ph.D. Dissertation, Brown University, May 1984. (Also Brown Univ. Tech. Rep. LEMS 6.)

  5. R.M. Bolle and D.B. Cooper, “On optimally combining pieces of information, with application to estimating 3-D complex-object position from range data”, IEEE Trans. on PAMI, Vol. 8, No.5, pp. 619–637, Sept. 1986.

    Article  Google Scholar 

  6. J. Ponce and D. Chelberg, “Finding the limbs and cusps of generalized cylinders”, Int. J. Comp. Vision, Vol. 1, No.3, 1987.

  7. R.J. Bolle and B.C. Vermuri, “On three-dimensional surface reconstruction methods”, IEEE Trans. on PAMI, Vol. 13, No.1, pp. 1–13, Jan. 1991.

    Article  Google Scholar 

  8. A.P. Pentland, “Perceptual organization using three-dimensional information”, Artificial Intelligence,Vol. 28, No.2, pp. 293–331, 1986.

    Article  MathSciNet  Google Scholar 

  9. S.B. Kang and K. Ikeuchi, “The complex EGI: A new representation for 3-D pose determination”, IEEE Trans. PAMI, Vol. 15, No.7, July 1993.

  10. G. Taubin, “Algebraic nonplanar curve and surface estimation in 3-space with applications to position estimation”, Technical Report, Brown University, LEMS-43, Feb. 1988.

  11. B.K. Horn, “Extended Gaussian images”, Proc. of the IEEE, Vol. 72, No.12, Dec. 1984.

  12. G. Taubin, “Estimation of planar curves, surfaces, and nonplanar space curves defined by implicit equations with applications to edge and range image segmentation”, IEEE Trans. on PAMI, Vol. 13, No.11, pp. 1115–1138, Nov. 1991.

    Article  Google Scholar 

  13. K. Hornik, “Multilayer feedforward networks are universal approximators”, Neural Networks, Vol. 2, No.5, pp. 359–366, 1989.

    Article  Google Scholar 

  14. G. Taubin, F. Cukierman, S. Sullivan, J. Ponce, and D.J. Kriegman, “Parameterized families of polynomials for bounded algebraic curve and surface fitting”, IEEE Trans. on PAMI, Vol. 16, No.3, pp. 287–303, March 1994.

    Article  MATH  Google Scholar 

  15. D. Keren, D. Cooper, and J. Subrahmonia, “Describing complicated objects by implicit polynomials”, IEEE Trans. on PAMI, Vol. 16, No.1, pp. 38–53, Jan. 1994.

    Article  Google Scholar 

  16. J.N. Hwang and P.S. Lewis, “From nonlinear optimization to neural network learning”, Procceedings 24th Asilomar Conf. on Signals, Systems, and Computers, Pacific Grove, CA, pp. 985–989, Nov. 1990.

  17. Y.H. Tseng, “Neural network techniques for invariant recognition and motion tracking of 3-D objects”, Ph.D. Dissertation, University of Washington, Seattle, WA, June 1995.

    Google Scholar 

  18. J.N. Hwang, J.J. Choi, S. Oh, and R.J. Marks II, “Query based learning applied to partially trained multilayer perceptrons”, IEEE Trans. on Neural Networks, Vol. 2, No.1, pp. 131–136, Jan. 1991.

    Article  Google Scholar 

  19. Y.H. Tseng, J.N. Hwang, and F.H. Sheehan, “3-D heart contour delineation and motion tracking of ultrasound images using continuous distance transform neural networks”, in IEEE Workshop on Neural Networks for Signal Processing, Kyoto, Japan, Sept. 1996.

  20. P. Vignola, A. Bloch, A. Kaplan, H. Walker, P. Chiotellis, and G. Myers, “Interobserver variability in echocardiography”, J. Clin. Ultrasound, Vol. 5, pp. 238–242, 1978.

    Article  Google Scholar 

  21. J.N. Hwang and Y.H. Tseng, “Neural network representation of continuous 3-D distance transform for invariant object recognition”, Int. Conf. on Neural Networks, Orlando, Florida, pp. 4066–4071, June 1994.

  22. J.N. Hwang and Y.H. Tseng, “Mental image transformation for 3D motion estimation”, Int. Journal of System Engineering, Vol. 4, pp. 183–194, 1994.

    Google Scholar 

  23. C. Bundesen and A. Larsen, “Visual transformation of size”, Journal of Experimental Psychology: Human Perception and Performance, Vol. 1, No.3, pp. 214–220, 1975.

    Google Scholar 

  24. S.M. Kosslyn, Image and Mind, Harvard University Press, MA, 1980.

    Google Scholar 

  25. R.N. Shepard and L.A. Cooper, Mental Images and Their Transformations, MIT Press, Cambridge, Massachusetts, 1982.

    Google Scholar 

  26. G.I. Chiou and J.N. Hwang, “A knowledge driven stochastic active contour model (KBS-SNAKE) for contour finding of distinct features”, IEEE Trans. on Image Processing, Vol. 4, No.10, pp. 1407–1416, Oct. 1995.

    Article  Google Scholar 

  27. H.G. Barrow, J.M. Tenenbaum, R.C. Bolles, and H.C. Wolf, “Parametric correspondence and chamfer matching: Two new techniques for image matching”, Proceedings, 5th Int. Joint Conf. Artificial Intelligence, Cambridge, MA, pp. 659–663, 1977.

  28. G. Borgefors, “An improved version of the chamfer matching algorithm”, Proceedings 7th Int. Conf. Pattern Recognition, Montreal Canada, pp. 1175–1177, 1984.

  29. G. Borgefors, “Hierarchical chamfer matching: A parametric edge matching algorithm”, IEEE Trans. on PAMI, Vol. 10, No.6, pp. 849–865, Nov. 1988.

    Article  Google Scholar 

  30. S. Konstadt, H. Abrahams, M. Nejat, and D. Reich, “Are wall thickening measurements reproducible”, Anesth Analg., Vol. 78, No.1, pp. 619–623, 1994.

    Google Scholar 

  31. D. Nguyen and B. Widrow, “The truck backer-upper: An example of self-learning in neural networks”, Int. Joint Conf. on Neural Networks (IJCNN), Washington, D.C., pp. II357–II363, June 1989.

Download references

Author information

Authors and Affiliations

  1. Information Processing Laboratory, Dept. of Elect. Engr., University of Washington, Box 352500, Seattle, WA, 98195, USA

    Yen-Hao Tseng & Jenq-Neng Hwang

  2. Division of Cardiology, School of Medicine, University of Washington, Seattle, WA, 98195, USA

    Florence H. Sheehan

Authors
  1. Yen-Hao Tseng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jenq-Neng Hwang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Florence H. Sheehan
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tseng, YH., Hwang, JN. & Sheehan, F.H. 3-D Heart Modeling and Motion Estimation Based on Continuous Distance Transform Neural Networks and Affine Transform. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology 18, 207–218 (1998). https://doi.org/10.1023/A:1007981013458

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1007981013458

Keywords

Search

Navigation