Hyun Joon Shin
Jehee Lee
Abstract
Computer puppetry maps the movements of a performer to an animated character in real-time. In this article, we provide a comprehensive solution to the problem of transferring the observations of the motion capture sensors to an animated character whose size and proportion may be different from the performer's. Our goal is to map as many of the important aspects of the motion to the target character as possible, while meeting the online, real-time demands of computer puppetry. We adopt a Kalman filter scheme that addresses motion capture noise issues in this setting. We provide the notion of dynamic importance of an end-effector that allows us to determine what aspects of the performance must be kept in the resulting motion. We introduce a novel inverse kinematics solver that realizes these important aspects within tight real-time constraints. Our approach is demonstrated by its application to broadcast television performances.
- Ascension Technology Corp. 1996. Motion Star Installation and Operation Guide. Ascension Technology Corporation, Burlington, Vt.]]Google Scholar
- AZARBAYEJANI,A.AND PENTLAND, A. P. 1995. Recursive estimation of motion structure, and focal length. IEEE Trans. Pattern Anal. Mach. Intell. 17, 6, 562-575.]] Google ScholarDigital Library
- AZUMA,R.AND BISHOP, G. 1994. Improving static and dynamic registration in an optical see-through hmd. In Proceedings of SIGGRAPH'94. ACM, New York, pp. 197-204.]] Google ScholarDigital Library
- BADLER, N., HOLLICK,M.J.,AND GRANIERI, J. P. 1993. Real-time control of a virtual human using mininal sensors. Presence 2, 1, 82-86.]]Google ScholarDigital Library
- BINDIGANAVALE,R.AND BADLER, N. I. 1998. Motion abstraction and mapping with spatial constraints. In Proceedings of International Workshop, CAPTECH'98. Springer-Verlag, Wein, Austria, pp. 70-82.]] Google ScholarDigital Library
- BODENHEIMER, B., ROSE, C., ROSENTHAL,S.,AND PELLA, J. 1997. The process of motion capture: Dealing with the data. In Proceedings of the Eurographics Workshop on Computer Animation and Simulation'97. Springer-Verlag, Wein, Austria.]]Google ScholarCross Ref
- BROIDA,T.J.AND CHELLAPPA, R. 1986. Estimation of object motion parameters from noisy images. IEEE Trans. Pattern Anal. Machine Intell. 8, 1, 90-99.]] Google ScholarDigital Library
- CHOI, K.-J. AND KO, H.-S. 2000. On-line motion retargetting. J. Visual. Comput. Animation 11, 223-243.]]Google ScholarCross Ref
- FRIEDMANN, M., STARNER,T.,AND PENTLAND, A. 1991. Synchronization in virtual realities. Presence 1, 1, 139-144.]]Google ScholarCross Ref
- GIRARD,M.AND MACIEJEWSKI, A. A. 1985. Computational modeling for the computer animation of legged figures. In Proceedings of SIGGRAPH 85. ACM, New York, pp. 263-270.]] Google ScholarDigital Library
- GLEICHER, M. 1997. Motion editing with spacetime constraints. In Proceedings of 1997 Symposium on Interactive 3D Graphics. ACM, New York, pp. 139-148.]] Google ScholarDigital Library
- GLEICHER, M. 1998. Retargeting motion to new characters. In Proceedings of SIGGRAPH 98. ACM, New York, pp. 33-42.]] Google ScholarDigital Library
- GULLAPALLI, V., GELFAND,J.J.,LANE,S.H.,AND WILSON, W. W. 1996. Synergy-based learning of hybrid position/force control for redundant manipulators. In Proceedings of the 1996 IEEE International Conference on Robotics and Automation. IEEE Computer Society Press, Los Alamitos, Calif.]]Google ScholarCross Ref
- HANSON, C. 2000. Scheme. http://www-swiss.ai.mit.edu/projects/scheme/.]]Google Scholar
- KIM, M.-J., SHIN,S.Y.,AND KIM, M.-S. 1995. A general construction scheme for unit quaternion curves with simple high order derivatives. In Proceedings of SIGGRAPH'95. ACM, New York, pp. 369-376.]] Google ScholarDigital Library
- KOGA, Y., KONDO, K., KUFFER,J.,AND LATOMBE, J. 1994. Planning motions with intentions. In Proceedings of SIGGRAPH'94. ACM, New York, pp. 395-408.]] Google ScholarDigital Library
- KOREIN,J.U.AND BADLER, N. I. 1982. Techniques for generating the goal-directed motion of articulated structures. IEEE Comput. Graph. Appl. 2, 71-81.]]Google ScholarDigital Library
- LEE,J.AND SHIN, S. Y. 1999. A hierarchical approach to interactive motion editing for humanlike figures. In Proceedings of SIGGRAPH'99. ACM, New York, pp. 39-48.]] Google ScholarDigital Library
- MOLET, T., BOULIC, R., AND THALMANN, D. 1996. A real-time anatomical converter for human motion capture. In Proceedings of the Seventh Eurographics Workshop on Animation and Simulation. Springer-Verlag, Wein, Austria.]] Google ScholarDigital Library
- MOLET, T., BOULIC, R., AND THALMANN, D. 1999. Human motion capture driven by orientation measurements. Presence 8, 2, 187-203.]] Google ScholarDigital Library
- PADEN, B. 1986. Kinematics and control robot manipulators. Ph.D dissertation, University of California, Berkeley, Berkeley, Calif.]]Google Scholar
- POPOVIC,Z.AND WITKIN, A. 1999. Physically based motion transformation. In Proceedings of SIGGRAPH'99. ACM, New York, pp. 11-20.]] Google ScholarDigital Library
- Protozoa. 1999. Technology information. http://www.protozoa.com/Page 2/info index.html.]]Google Scholar
- ROSE,C.F.,GUENTER, B., BODENHEIMER,B.,AND COHEN, M. F. 1996. Efficient generation of motion transitions using spacetime constraints. In Proceedings of SIGGRAPH'96. ACM, New York, pp. 147-154.]] Google ScholarDigital Library
- STURMAN, D. J. 1998. Computer puppetry. IEEE Comput. Graph. Appl. 18, 1, 38-45.]] Google ScholarDigital Library
- TOLANI,D.AND BADLER, N. I. 1996. Real-time inverse kinematics of the human arm. Presence 5, 4, 393-401.]]Google ScholarDigital Library
- TOLANI, D., GOSWAMI, A., AND BADLER, N. 2000. Real-time inverse kinematics techniques for anthropomorphic limbs. Graph. Models 62,5.]]Google ScholarCross Ref
- WELCH,G.AND BISHOP, G. 1995. An introduction to the Kalman filter. Tech. Rep. TR95-041. Department of Computer Science. University of North Carolina at Chapel Hill, Chapel Hill, NC.]] Google ScholarDigital Library
- WELCH,G.AND BISHOP, G. 1997. Scaat: Incremental tracking with incomplete information. In Proceedings of SIGGRAPH'97. ACM, New York, pp. 333-344.]] Google ScholarDigital Library
- WHITNEY, D. J. 1969. Resolved motion rate control of manipulators and human prostheses. IEEE Trans. Man-Mach. Syst. 47-53.]]Google ScholarCross Ref
- ZHAO,J.AND BADLER, N. I. 1994. Inverse kinematics positioning using nonlinear programming for highly articulated figures. ACM Trans. Graph. 13, 4, 313-336.]] Google ScholarDigital Library
Index Terms
- Computer puppetry: An importance-based approach
Recommendations
Computer Puppetry
Computer puppetry is a subset of the wider practice of motion capture by computer. It differs from motion capture in that the results of human body motion are fully visualized in real time, as the motion is performed. It has important applications in ...
3D puppetry: a kinect-based interface for 3D animation
UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technologyWe present a system for producing 3D animations using physical objects (i.e., puppets) as input. Puppeteers can load 3D models of familiar rigid objects, including toys, into our system and use them as puppets for an animation. During a performance, the ...
Video puppetry: a performative interface for cutout animation
SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papersWe present a video-based interface that allows users of all skill levels to quickly create cutout-style animations by performing the character motions. The puppeteer first creates a cast of physical puppets using paper, markers and scissors. He then ...
Comments