Copyright © 2004 Elsevier Inc. All rights reserved.
Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video
Received 1 May 2003;
References and further reading may be available for this article. To view references and further reading you must purchase this article.
Abstract
3D video [IEEE Multimedia (1997) 18] is the ultimate image media recording dynamic visual events in the real world as is; it records time varying 3D object shape with high fidelity surface properties (i.e., color and texture). Its applications cover wide varieties of personal and social human activities: entertainment (e.g., 3D game and 3D TV), education (e.g., 3D animal picture books), sports (e.g., sport performance analysis), medicine (e.g., 3D surgery monitoring), culture (e.g., 3D archive of traditional dances), and so on. In this paper, we propose: (1) a PC cluster system for real-time reconstruction of dynamic 3D object action from multi-view video images, (2) a deformable 3D mesh model for reconstructing the accurate dynamic 3D object shape, and (3) an algorithm of rendering natural-looking texture on the 3D object surface from the multi-view video images. Experimental results with quantitative performance evaluations demonstrate the effectiveness of these methods in generating high fidelity 3D video from multi-view video images.
Keywords: Dynamic 3D shape reconstruction; Real-time processing; PC cluster; Multi-viewpoint video; Deformable mesh model; Video texture mapping
Article Outline
- 1. Introduction
- 2. Basic scheme of 3D video generation
- 3. Real-time dynamic 3D object shape reconstruction system
- 3.1. Real-time 3D shape reconstruction without camera actions
- 3.2. Real-time 3D shape reconstruction with camera actions
- 4. Dynamic 3D shape from multi-view images using deformable mesh model
- 4.1. Deformable 3D mesh model for intra-frame deformation
- 4.2. Forces at each vertex
- 4.3. Performance evaluation
- 4.4. Dynamic shape recovery using deformable 3D mesh model
- 4.5. Experimental results
- 5. High fidelity texture mapping algorithm
- 5.1. Naive algorithm: viewpoint independent patch-based method
- 5.2. Viewpoint dependent vertex-based texture mapping algorithm
- 5.3. Performance evaluation
- 6. Conclusion
- Acknowledgements
- References







E-mail Article
Add to my Quick Links

Cited By in Scopus (25)






