Copyright © 2006 Elsevier B.V. All rights reserved.
A body-mounted camera system for head-pose estimation and user-view image synthesis
Available online 24 October 2006.
References and further reading may be available for this article. To view references and further reading you must purchase this article.
Abstract
In this paper, we propose a body-mounted system to capture user experience as audio/visual information. The proposed system consists of two cameras (head-detection and wide angle) and a microphone. The head-detection camera captures user head motions, while the wide angle color camera captures user frontal view images. An image region approximately corresponding to user view is then synthesized from the wide angle image based on estimated human head motions. The synthesized image and head-motion data are stored in a storage device with audio data. This system overcomes the disadvantages of head-mounted cameras in terms of ease of putting on/taking off the device. It also has less obtrusive visual impact on third persons. Using the proposed system, we can simultaneously record audio data, images in the user field of view, and head gestures (nodding, shaking, etc.) simultaneously. These data contain significant information for recording/analyzing human activities and can be used in wider application domains such as a digital diary or interaction analysis. Experimental results demonstrate the effectiveness of the proposed system.
Keywords: Body-mounted camera; Head motion; User-view image; Wearable system







E-mail Article
Add to my Quick Links

Cited By in Scopus (0)

to 90




