Abstract
As robots begin to permeate the everyday human workspace to collaborate in innumerable and varied tasks, the robotic structure must adhere and replicate human-like gestures for effective interaction. Whether rehabilitation or augmentation, upper arm human-robot interaction is some of the most prevalent and investigated forms of collaboration. However, currently robotic control schemes fail to capture the true intricacies of anthropomorphic motion and intent during simple bi-manual manipulation tasks. This paper focuses on the introduction of bio-inspired control schemes for robot manipulators that coordinate with humans during dual arm object manipulation. Using experimental data captured from human subjects performing a variety of every-day bi-manual life tasks, we propose a bio-inspired controller for a robot arm, that is able to learn human inter- and intra-arm coordination during those tasks. Using dimensionality reduction techniques to make comprehensible the linear correlations of both arms in joint space we fit and utilize potential fields that attract the robot to human-like configurations. This method is then tested using real experimental data across multiple bi-manual tasks with a comparison made between the bio-inspired and traditional inverse kinematic controllers. Using a robotic kinematic chain identical to the human arm, models are evaluated for anthropomorphic configurations.
Similar content being viewed by others
References
Al-Gallaf, E.A.: Multi-fingered robot hand optimal task force distribution: neural inverse kinematics approach. Robot. Auton. Syst. 54(1), 34–51 (2006)
Artemiadis, P.K., Kyriakopoulos, K.J.: EMG-based control of a robot arm using low-dimensional embeddings. IEEE Trans. Robot. 26(2), 393–398 (2010)
Asfour, T., Dillmann, R.: Human-like motion of a humanoid robot arm based on a closed-form solution of the inverse kinematics problem. Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. 2, 1407–1412 (2003)
Bagnell, J.A., Cavalcanti, F., Cui, L.: An integrated system for autonomous robotics manipulation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2955–2962 (2012)
Beetz, M., Klank, U., Kresse, I., Maldonado, A., Mösenlechner, L., Pangercic, D., Rühr, T., Tenorth, M.: Robotic roommates making pancakes. In: 11th IEEE-RAS International Conference on Humanoid Robots (2011)
Berg, J., Miller, S., Goldberg, K., Abbeel, P.: Gravity-Based Robotic Cloth Folding, pp 409–424. Springer Berlin Heidelberg (2011)
Billard, A.: Learning human arm movements by imitation: evaluation of a biologically inspired connectionist architecture. Robot. Auton. Syst. 941, 1–16 (2001)
Caggiano, V., De Santis, A., Siciliano, B., Chianese, A.: A biomimetic approach to mobility distribution for a human-like redundant arm. In: Proceedings of the IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, pp. 393–398 (2006)
Cardoso de Oliveira, S.: The neuronal basis of bimanual coordination: recent neurophysiological evidence and functional models. Acta Psychol. 110(2), 139–159 (2002)
Cruse, H., Wischmeyer, E., Bruser, M., Brockfeld, P., Dress, A.: On the cost functions for the control of the human arm movement. Biol. Cybern. 62(6), 519–528 (1990)
Cutkosky, M.R.: On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Trans. Robot. Autom. 5(3), 269–279 (1989)
Debaere, F., Wenderoth, N., Sunaert, S., Van Hecke, P., Swinnen, S.P.: Cerebellar and premotor function in bimanual coordination: parametric neural responses to spatiotemporal complexity and cycling frequency. Neuroimage 21(4), 1416–1427 (2004)
Do, M., Azad, P., Asfour, T., Dillmann, R.: Imitation of human motion on a humanoid robot using non-linear optimization. In: 8th IEEE-RAS International Conference on Humanoid Robots, pp. 545–552 (2008)
Flash, T., Hogan, N.: The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5, 1688–1703 (1985)
Gamage, S.S.H.U., Lasenby, J.: New least squares solutions for estimating the average centre of rotation and the axis of rotation. J. Biomech. 35(1), 87–93 (2002)
Gharbi, M., Cortes, J., Simeon, T.: A sampling-based path planner for dual-arm manipulation. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics, 2008. AIM 2008, pp. 383–388 (2008)
Gribovskaya, E., Billard, A.: Combining dynamical systems control and programming by demonstration for teaching discrete bimanual coordination tasks to a humanoid robot. In: 3rd ACM/IEEE International Conference on Human-Robot Interaction, pp. 33–40 (2008)
Härtl, H.: Dextrous manipulation with multifingered robot hands including rolling and slipping of the fingertips. Robot. Auton. Syst. 14(1), 29–53 (1995)
Hwang, M.J., Lee, D.Y., Chung, S.Y.: Motion Planning of bimanual robot for assembly. In: IEEE International Conference on Systems, Man and Cybernetics, 2007. ISIC, pp. 240–245 (2007)
Jackson, J.E.: A user’s guide to principal components, vol. 587. Wiley (2005)
Khatib, O.: Real-time obstacle avoidance for manipulators and mobile robots. Int. J. Robot. Res. 5(1), 90–98 (1986)
Kim, C., Kim, D., Oh, Y.: Solving an inverse kinematics problem for a humanoid robots imitation of human motions using optimization. In: Proceedings of International Conference on Informatics in Control Automation and Robotics, pp. 85–92 (2005)
Kulic, D., Takano, W., Nakamura, Y.: Representability of human motions by factorial hidden markov models. In: Proceedings of IEEE/RSJ International Conference Intelligent Robots and Systems, pp. 2388–2393 (2007)
Lee, J., Sato, M., Wada, Y., Koike, Y.: Extraction of motor primitive in consideration of arm posture, movement direction and velocity using hidden markov model. In: Proceedings of the IEEE-EMBS Annual International Conference of the Engineering in Medicine and Biology Society, pp. 4385–4388 (2005)
McLachlan, G., Peel, D.: Finite Mixture Models. Wiley (2004)
Mohan, V., Morasso, P., Metta, G., Sandini, G.: A biomimetic, force-field based computational model for motion planning and bimanual coordination in humanoid robots. Auton. Robot. 27(3), 291–307 (2009)
Pollard, N.S., Hodgins, J.K., Riley, M. J., Atkeson, C. G.: Adapting human motion for the control of a humanoid robot. Proc. IEEE Int. Conf. Robot. Autom. 2, 1390–1397 (2002)
Potkonjak, V., Popovic, M., Lazarevic, M., Sinanovic, J.: Redundancy problem in writing: from human to anthropomorphic robot arm. IEEE Trans. Syst. Man Cybern. B 28, 790–805 (1998)
Ruhr, T., Sturm, J., Pangercic, D., Beetz, M., Cremers, D.: A generalized framework for opening doors and drawers in kitchen environments. In: Proceedings IEEE International Conference on Robotics and Automation (ICRA), pp. 3852–3858 (2012)
Schaal, S., Kotosaka, S., Sternad, D.: Nonlinear dynamical systems as movement primitives. In: IEEE International Conference on Humanoid Robotics, pp. 1–11 (2000)
Sciavicco, L., Siciliano, B.:Modeling and Control of Robot Manipulators. Springer (2000)
Shi, J.Q., Choi, T.: Gaussian Process Regression Analysis for Functional Data. CRC Press (2011)
Sian, N., Sakaguchi, T., Yokoi, K., Kawai, Y.: Operating humanoid robots in human environments. In: Proceedings of the Robotics, Science & Systems Workshop on Manipulation for Human Environments, Philadelphia (2006)
Smith, C., Karayiannidis, Y., Nalpantidis, L., Gratal, X., Qi, P., Dimarogonas, D. V., Kragic, D.: Dual arm manipulation—a survey. Robot. Auton. Syst. 60, 1340–1353 (2012)
Steffen, J., Elbrechter, C., Haschke, R., Ritter, H.: Bio-inspired motion strategies for a bimanual manipulation task. In: 2010 10th IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 625–630 (2010)
Steffen, J., Pardowitz, M., Ritter, H.: Using structured UKR manifolds for motion classification and segmentation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4785–4790 (2009)
Temprado, J.J., Swinnen, S.P., Carson, R.G., Tourment, A., Laurent, M.: Interaction of directional, neuromuscular and egocentric constraints on the stability of preferred bimanual coordination patterns, Human movement science (2003)
Inamura, T., Toshima, I., Tanie, H., Nakamura, Y.: Embodied symbol emergence based on mimesis theory. Int. J. Robot. Res. 23(3–5), 363–377 (2004)
Treffner, P.J., Turvey, M.T.: Symmetry, broken symmetry, and handedness in bimanual coordination dynamics. Exp. Brain Res. 107(3), 463–478 (1996)
Ude, A., Atkeson, C.G., Riley, M.: Programming full-body movements for humanoid robots by observation. Robot. Auton. Syst. 47(2), 93–108 (2004)
Uno, Y., Kawato, M., Suzuki, R.: Formation and control of optimal trajectory in human multijoint arm movement. Biol. Cybern. 61, 89–101 (1989)
Zacharias, F., Leidner, D., Schmidt, F., Borst, C., Hirzinger, G.: Exploiting structure in two-armed manipulation tasks for humanoid robots. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5446–5452 (2010)
Zhuang, J., LaConte, S., Peltier, S., Zhang, K., Hu, X.: Connectivity exploration with structural equation modeling: an fMRI study of bimanual motor coordination. Neuroimage 25(2), 462–470 (2005)
Zollner, R, Asfour, T, Dillmann, R.: Programming by demonstration: dual-arm manipulation tasks for humanoid robots. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 1, pp. 479–484 (2004)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Warren, S., Artemiadis, P. On the Control of Human-Robot Bi-Manual Manipulation. J Intell Robot Syst 78, 21–32 (2015). https://doi.org/10.1007/s10846-014-0055-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-014-0055-4