Abstract
Visual control of robot motion may benefit from enhanced camera field of view. With traditional cameras the available fields of view are only enough to view a region around the observed object (for eye-in-hand systems) or around the end-effector (for independent-eye systems). Central catadioptric systems have larger fields of view thus allowing the entire robot AND the surrounding objects to be imaged with a unique camera. Therefore, the whole robot’s articulated mechanism can be observed and its joints can be tracked and controlled simultaneously. This results in a new visual robot control concept where tracking and control are embedded together. Key to the understanding of both servoing and tracking is the central catadioptric Jacobian matrix linking the robot’s joint velocities to image observations. In spite of a more complex projection matrix associated with catadioptric sensors, we study the catadioptric Jacobian matrix and we show that it does not introduce any additional singularity with respect to the traditional pinhole camera model. Experiments showing a rigid body being tracked with a catadioptric camera are described.
The work was partially supported by Fundacão Calouste de Gulbenkian
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
W. Wilson, C. Hulls, and G. Belles,“Relative end effector control using Cartesian position-based visual servoing,” IEEE Trans. on Rob. & Aut., vol. 12, no. 5, pp. 684–696, October 1996.
B. Espiau, F. Chaumette, and P. Rives,“A new approach to visual servoing in robotics,” IEEE Trans. on Rob. & Aut., vol. 8, no. 3, pp. 313–326, June 1992.
F. Martin and R. Horaud, “Multiple Camera Tracking of Rigid Objects”, Research report 4268INRIA, Montbonnot, France, September 2001.
S. Hutchinson, G. Hager, and P. I. Corke, “A tutorial on visual servo control,” IEEE Trans, on Rob. & Aut., vol. 12, no. 5, pp. 651–670, October 1996.
J. Gluckman and S. Nayar,“Egomotion and Omnidirectional Cameras,” Proc. IEEE Int. Conf. on Computer Vision, pp. 999–1005, Bombay 1998.
S. Baker and S. Nayar,“A Theory of Catadioptric Image Formation,” Proc. IEEE Int. Conf. on Computer Vision, pp. 35–42, Bombay 1998.
T. Svoboda, T. Pajdla and V. Hlavac,“Motion Estimation Using Central Panoramic Cameras, ” Proc. IEEE Conference on Intelligent Vehicles, Stutgart Germany 1998.
C. Geyer and K. Daniilidis,“A Unifying Theory for Central Panoramic Systems and Practical Implications,” Proc. Eur. Conf. on Computer Vision, pp. 445–461, Dublin 2000.
J.P. Barreto and H. Araujo,“Geometric Properties of Central catadioptric Line Images,” Proc. Eur. Conf. on Computer Vision, Copenhag, Denmark, May 2002.
P. Baker, C. Fermuller, Y. Aloimonos and R. Pless,“A Spherical Eye From Multiple Cameras (Makes Better Models of the World),” in Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, Kauai, Haway, USA, December 2001.
F. Chaumette,“Potential Problems of Stability and Convergence in Image Based and Position Based Visual Servoing”, The Confluence of Vision and Control, Lecture Notes in Control and Information Systems, Vol. 237, pp 66–78, Springer-Verlag, 1998.
H. Michel and P. Rives,“Singularities in the determination of the situation of a robot effector from the perspective view of 3 points”, Research report 1850 INRIA, Sophia-Antipolis, France, February 1993.
A. Paulino and H. Araujo,“Multiple Robots in Geometric Formation: Control Structure and Sensing”, in Int. Symposium on Intelligent Robotic Systems, Reading, UK, 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Barreto, J.P., Martin, F., Horaud, R. (2003). Visual Servoing/Tracking Using Central Catadioptric Images. In: Siciliano, B., Dario, P. (eds) Experimental Robotics VIII. Springer Tracts in Advanced Robotics, vol 5. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36268-1_21
Download citation
DOI: https://doi.org/10.1007/3-540-36268-1_21
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00305-2
Online ISBN: 978-3-540-36268-5
eBook Packages: Springer Book Archive