doi:10.1016/S0097-8493(02)00285-6
Copyright © 2003 Elsevier Science Ltd. All rights reserved.
Technical section
Interactive reconstruction of virtual environments from video sequences
Advanced Interfaces Group, Department of Computer Science, University of Manchester, Oxford Road, Manchester, M13 9PL, UK
Accepted 27 November 2002. ;
Available online 15 February 2003.
References and further reading may be available for this article. To view references and further reading you must
purchase this article.
Abstract
There are many real-world applications of Virtual Reality requiring the construction of complex and accurate three-dimensional models that represent real environments. In this paper, we describe a rapid and robust semi-automatic system that allows such environments to be quickly and easily built from video sequences captured with standard consumer-level digital cameras. The system combines an automatic camera calibration algorithm with an interactive model-building phase, followed by automatic extraction and synthesis of surface textures from frames of the video sequence. The capabilities of the system are illustrated using a variety of example reconstructions.
Author Keywords: Virtual reality; Computer vision; Model building; Camera calibration; Structure and motion; Texture
Fig. 1. An overview of the calibration process: (a) lens distortion removal, (b) feature tracking, (c) projective reconstruction in an unknown projective basis and (d) self-calibration and coordinate-frame orientation.
Fig. 2. Primitive manipulation (left) and corresponding model reconstruction (right). See text for details.
Fig. 3. An example reconstruction from a 200 frame video sequence. Two frames from the sequence are shown, with the reconstructed model overlayed in wireframe. The texture-mapped reconstruction is shown on the right from a different viewpoint. Total calibration time for this sequence was less than 10 min and model reconstruction took an additional 5 min.
Fig. 4. A second reconstruction, taken from a 400 frame video sequence and built with 40 primitives. Calibration time for this sequence was around 20 min and the time required for model reconstruction was around 15 min.
Fig. 5. A reconstruction from a pan/tilt/zoom video sequence. Total calibration time for this sequence under 10 min and model reconstruction took an additional 10 min.