Image-based rendering of complex scenes from a multi-camera rig
Image-based rendering of complex scenes from a multi-camera rig
- Author(s): J.-F. Evers-Senne and R. Koch
- DOI: 10.1049/ip-vis:20045104
For access to this article, please select a purchase option:
Buy article PDF
Buy Knowledge Pack
IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.
Thank you
Your recommendation has been sent to your librarian.
- Author(s): J.-F. Evers-Senne 1 and R. Koch 1
-
-
View affiliations
-
Affiliations:
1: Christian-Albrechts-University Kiel, Germany
-
Affiliations:
1: Christian-Albrechts-University Kiel, Germany
- Source:
Volume 152, Issue 4,
August 2005,
p.
470 – 480
DOI: 10.1049/ip-vis:20045104 , Print ISSN 1350-245X, Online ISSN 1359-7108
Image-based rendering is a method to synthesise novel views from a set of given real images. Two methods to extrapolate novel views of complex scenes with occlusions and large depth discontinuities from images of a moving uncalibrated multi-camera rig are discribed. The real camera viewpoints are calibrated from the image data and dense depth maps are estimated for each real view. Novel views are synthesised from this representation with view-dependent image-based rendering techniques at interactive rates. Since the 3-D scene geometry is available in this approach, it is well suited for mixed reality applications where synthetic 3-D objects are seamlessly embedded in the novel view.
Inspec keywords: rendering (computer graphics); image representation; parameter estimation; image reconstruction; interpolation
Other keywords:
Subjects: Interpolation and function approximation (numerical analysis); Optical, image and video signal processing; Interpolation and function approximation (numerical analysis); Computer vision and image processing techniques; Graphics techniques
References
-
-
1)
- Woetzel, J., Koch, R.: `Origami virtual production system', IEE Proc. Vis. Image Signal Process, 2004, submitted in same issue of this journal.
-
2)
- Koch, R., Pollefeys, M., Van Gool, L.: `Multi viewpoint stereo from uncalibrated video sequences', Proc. ECCV, 1998, Springer-Verlag, Freiburg, LNCS 1406.
-
3)
- Levoy, M., Hanrahan, P.: `Light field rendering', Proc. SIGGRAPH, 1996, 30, p. 31–42Ann. Conf. Ser, .
-
4)
- M. Zwicker , H. Pfister , J. van Baar , M. Gross . (2001) Surface splatting, SIGGRAPH 2001, Computer Graphics. Proc..
-
5)
- E.H. Adelson , M. Landy , J.A. Moushon , J. Bergen . (1991) Computation models of visual processing, The plenoptic function and the elements of early vision.
-
6)
- W.-C. Chen , J.-Y. Bouguet , M.H. Chu , R. Grzeszczuk . (2002) Light field mapping: efficient representation and hardware rendering of surface light fields, SIGGRAPH 2002 Conference Proceedings.
-
7)
- J.-F. Evers-Senne , R. Koch . (2003) Image based interactive rendering with view dependent geometry, Eurographics, Computer Graphics Forum.
-
8)
- Fitzgibbon, A., Wexler, Y., Zisserman, A.: `Image-based rendering using image-based priors', Int. Conf. Computer Vision (ICCV), 2003, Nice, France.
-
9)
- Yang, R., Welch, G., Bishop, G.: `Real-time consensus-based scene reconstruction using commodity graphics hardware', Proc. Pacific Graphics, 2002, Tsinghua University, Beijing, China.
-
10)
- C. Buehler , M. Bosse , L. McMillan , S.J. Gortler , M.F. Cohen . (2001) Unstructured lumigraph rendering, SIGGRAPH 2001, Computer Graphics Proceedings.
-
11)
- Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: `The lumigraph', Proc. SIGGRAPH, 1996, 30, p. 43–54.
-
12)
- H. Pfister , M. Zwicker , J. van Baar , M. Gross . (2000) Surfels: surface elements as rendering primitives, Siggraph 2000, Computer Graphics Proc.
-
13)
- K. Pulli , M. Cohen , T. Duchamp , H. Hoppe , L. Shapiro , W. Stuetzle . (1997) View-based rendering: visualizing real objects from scanned range and color data, Rendering Techniques (Proc. Eighth Eurographics Workshop on Rendering.
-
14)
- McMillan, L., Bishop, G.: `Plenoptic modelling: an image-based rendering system', Computer Graphics, Ann. Conf. Ser., 1995, 29, p. 39–46.
-
15)
- J.-F. Evers-Senne , R. Koch . (2003) Image based rendering from handheld cameras using quad primitives, Vision, modeling, and visualization VMV: Proc..
-
16)
- S. Rusinkiewicz , M. Levoy . (2000) QSplat: a multiresolution point rendering system for large meshes, SIGGRAPH 2000, Computer Graphics Proc.
-
17)
- Debevec, P., Yu, Y., Boshokov, G.: `Efficient view-dependent image-based rendering with projective texture-mapping', CSD-98-1003, Tech., 1998.
-
18)
- Li, M., Magnor, M., Seidel, H.-P.: `Improved hardware-accelerated visual hull rendering', Proc. Vision, Modeling, and Visualization (VMV-2003), 2003, Munich, Germany, p. 151–158.
-
19)
- Wood, D., Azuma, D., Aldinger, K., Curless, B., Duchamp, T., Salesin, D.H., Stuetzle, W.: `Surface light fields for 3d photography', Proc. ACM SIGGRAPH, 2000.
-
20)
- Shum, H.-Y., Kang, S.B.: `A review of image-based rendering techniques', Proc. Visual Communications and Image Processing, 2000.
-
21)
- Zitnick, C.L., Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: `High-quality video view interpolation using a layered representation', Proc. ACM SIGGRAPH, 2004, Los Angeles, CA, p. 600–608.
-
22)
- M. Pollefeys , R. Koch , L.J. Van Gool . Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. Int. J. Comput. Vis. , 1 , 7 - 25
-
23)
- Heigl, B., Koch, R., Pollefeys, M.: `Plenoptic modeling and rendering from image sequences taken by a hand-held camera', Proc. DAGM, 1999.
-
24)
- J. Shade , S. Gortler , L.W. He , R. Szeliski . (1998) Layered depth images, Proc. ACM SIGGRAPH.
-
25)
- Vogelgsang, Ch., Greiner, G.: `Interactive range map rendering with depth interval texture slicing', Vision, Modelling and Visualization (VMV), November 2003, Munich, Germany.
-
26)
- Whitted, T., Levoy, M.: `The use of points as a display primitive', Tech. Rep, 1985.
-
1)
Related content
