Skip to main content

Image-Based Deformation of Objects in Real Scenes

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 3804))

Abstract

We present a new method for deforming an object in a static real scene, which interacts with animated synthetic characters. Unlike the existing method – making a new synthetic object to substitute for the interacting object in the real scene, we directly deform the object in image space using an image-warping technique with assistance from a simplified 3D sub-model. The deformed image sequence is processed further using the Expression Ratio Image (ERI) technique to apply the illumination changes generated by the deformation. Using this method, we can maintain the photo-realistic rendering quality of the scene efficiently by preserving the appearance of the object in the real scene as it is.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Birn, J.: Digital Lighting & Rendering. New Riders Press, Indianapolis (2000)

    Google Scholar 

  2. Debevec, P.: HDRI and Image-Based Lighting. In: SIGGRAPH 2003 Course Notes No.19 (2003)

    Google Scholar 

  3. Liu, Z., Shan, Y., Zhang, Z.: Expresive Expression Mapping with Ratio Image. In: Proceedings of SIGGRAPH 2001, pp. 271–276 (2001)

    Google Scholar 

  4. Blasko, G.: Vision-based Camera Matching Using Markers. In: Proceedings of CESCG 2000 (2000)

    Google Scholar 

  5. Gomes, J., Darsa, L., Costa, B., Velho, L.: Warping and Morphing of Graphical Objects. In: SIGGRAPH 1995 Course Notes No.3 (1995)

    Google Scholar 

  6. Barr, A.H.: Global and Local Deformations of Solid Primitives. In: Proceedings of SIGGRAPH 1984, pp. 21–30 (1984)

    Google Scholar 

  7. Smith, A.R.: Planar 2-Pass Texture Mapping and Warping. In: Proceedings of SIGGRAPH 1987, pp. 263–271 (1987)

    Google Scholar 

  8. Smithe, D.B.: A Two-Pass Mesh Warping Algorithm for Object Transformation and Image Interpolation. Technical Report 1030, ILM Computer Graphics Department, Lucas_lm (1990)

    Google Scholar 

  9. Beier, T., Neely, S.: Feature-Based Image Metamorphosis. In: Proceedings of SIGGRAPH 1992, pp. 263–271 (1992)

    Google Scholar 

  10. Lee, S.-Y., Chwa, K.-Y., Shin, S.-Y., Wolberg, G.: Image Metamorphosis Using Snakes and Free-Form Deformations. In: Proceedings of SIGGRAPH 1995, pp. 439–448 (1995)

    Google Scholar 

  11. McMillan, L., Bishop, G.: Plenoptic modeling: An Image-based rendering system. In: Proceedings of SIGGRAPH 1995, pp. 39–46 (1995)

    Google Scholar 

  12. Chen, S.E.: QuickTime VR - An Image-Based Approach to Virtual Environment Navigation. In: ACM SIGGRAPH 1995 Conference Proceedings, pp. 29–38 (1995)

    Google Scholar 

  13. Mark, W.R., McMillan, L., Bishop, G.: Post-Rendering 3D Warping. In: Proceedings 1997 Symposiums on Interactive 3D Graphics, pp. 7–16 (1997)

    Google Scholar 

  14. Chen, S.E., Williams, L.: View Interpolation for Image Synthesis. In: SIGGRAPH 1993 Conference Proceedings, pp. 279–288 (1993)

    Google Scholar 

  15. Shade, J., Gortler, S.J., He, L.W., Szeliski, R.: Layered Depth Images. In: Proceedings of SIGGRAPH 1998, pp. 231–242 (1998)

    Google Scholar 

  16. Liebowitz, D., Criminisi, A., Zisserman, A.: Creating Architectural Models from Images. In: EuroGraphics 1999 Conference Proceedings, pp. 39–50 (1999)

    Google Scholar 

  17. Debevec, P., Taylor, C., Malik, J.: Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach. In: Proceedings of SIGGRAPH 1996, pp. 11–20 (1996)

    Google Scholar 

  18. Chuang, Y., Goldman, D., Zheng, K., Curless, B., Salesin, D., Szeliski, R.: Animating Pictures With Stochastic Motion Textures. In: Proceedings of SIGGRAPH 2005, pp. 853–860 (2005)

    Google Scholar 

  19. Wright, S.: Digital Compositing for Film and Video. Focal Press (2001)

    Google Scholar 

  20. Witkin, A., Baraff, D., Blum, M., Monheit, G.: Physically Based Modeling: Principles and Practice. In: SIGGRAPH Course Notes 19 (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chung, HV., Lee, IK. (2005). Image-Based Deformation of Objects in Real Scenes. In: Bebis, G., Boyle, R., Koracin, D., Parvin, B. (eds) Advances in Visual Computing. ISVC 2005. Lecture Notes in Computer Science, vol 3804. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11595755_20

Download citation

  • DOI: https://doi.org/10.1007/11595755_20

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-30750-1

  • Online ISBN: 978-3-540-32284-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics