Abstract
In the literature we find two classes of algorithms which, on the basis of two views of a scene, recover the rigid transformation between the views and subsequently the structure of the scene. The first class contains techniques which require knowledge of the correspondence or the motion field between the images and are based on the epipolar constraint. The second class contains so-called direct algorithms which require knowledge about the value of the flow in one direction only and are based on the positive depth constraint. Algorithms in the first class achieve the solution by minimizing a function representing deviation from the epipolar constraint while direct algorithms find the 3D motion that, when used to estimate depth, produces a minimum number of negative depth values. This paper presents a stability analysis of both classes of algorithms. The formulation is such that it allows comparison of the robustness of algorithms in the two classes as well as within each class. Specifically, a general statistical model is employed to express the functions which measure the deviation from the epipolar constraint and the number of negative depth values, and these functions are studied with regard to their topographic structure, specifically as regards the errors in the 3D motion parameters at the places representing the minima of the functions. The analysis shows that for algorithms in both classes which estimate all motion parameters simultaneously, the obtained solution has an error such that the projections of the translational and rotational errors on the image plane are perpendicular to each other. Furthermore, the estimated projection of the translation on the image lies on a line through the origin and the projection of the real translation.
Chapter PDF
References
G. Adiv. Determining 3D motion and structure from optical flow generated by several moving objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 7:384–401, 1985.
G. Adiv. Inherent ambiguities in recovering 3-D motion and structure from a noisy flow field. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11:477–489, 1989.
A. Bruss and B. K. P. Horn. Passive navigation. Computer Vision, Graphics, and Image Processing, 21:3–20, 1983.
W. Burger and B. Bhanu. Estimating 3-D egomotion from perspective image sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12:1040–1058, 1990.
K. Daniilidis. On the Error Sensitivity in the Recovery of Object Descriptions. PhD thesis, Department of Informatics, University of Karlsruhe, Germany, 1992. In German.
K. Daniilidis and M. E. Spetsakis. Understanding noise sensitivity in structure from motion. In Y. Aloimonos, editor, Visual Navigation: From Biological Systems to Unmanned Ground Vehicles, chapter 4. Lawrence Erlbaum Associates, Hillsdale, NJ, 1997.
C. Fermüller. Passive navigation as a pattern recognition problem. International Journal of Computer Vision, 14:147–158, 1995.
C. Fermüller and Y. Aloimonos. What is computed by structure from motion algorithms? Technical Report CAR-TR-863, Center for Automation Research, University of Maryland, 1997.
D. J. Heeger and A. D. Jepson. Subspace methods for recovering rigid motion I: Algorithm and implementation. International Journal of Computer Vision, 7:95–117, 1992.
B. K. P. Horn. Relative orientation. International Journal of Computer Vision, 4:59–78, 1990.
B. K. P. Horn and E. J. Weldon. Computationally efficient methods for recovering translational motion. In Proc. International Conference on Computer Vision, pages 2–11, 1987.
A. D. Jepson and D. J. Heeger. Subspace methods for recovering rigid motion II: Theory. Technical Report RBCV-TR-90-36, University of Toronto, 1990.
J. J. Koenderink and A. J. van Doorn. Two-plus-one-dimensional differential geometry. Pattern Recognition Letters, 15:439–443, 1994.
H. C. Longuet-Higgins. A computer algorithm for reconstructing a scene from two projections. Nature, 293:133–135, 1981.
H. C. Longuet-Higgins and K. Prazdny. The interpretation of a moving retinal image. Proc. Royal Society, London B, 208:385–397, 1980.
Q.-T. Luong and O. D. Faugeras. The fundamental matrix: Theory, algorithms, and stability analysis. International Journal of Computer Vision, 17:43–75, 1996.
S. J. Maybank. Algorithm for analysing optical flow based on the least-squares method. Image and Vision Computing, 4:38–42, 1986.
S. J. Maybank. A Theoretical Study of Optical Flow. PhD thesis, University of London, England, 1987.
K. Prazdny. Egomotion and relative depth map from optical flow. Biological Cybernetics, 36:87–102, 1980.
K. Prazdny. Determining instantaneous direction of motion from optical flow generated by a curvilinear moving observer. Computer Vision, Graphics, and Image Processing, 17:238–248, 1981.
J. H. Rieger and D. T. Lawton. Processing differential image motion. Journal of the Optical Society of America A, 2:354–359, 1985.
M. E. Spetsakis. Models of statistical visual motion estimation. Computer Vision, Graphics, and Image Processing, 60:300–312, 1994.
J. I. Thomas, A. Hanson, and J. Oliensis. Understanding noise: The critical role of motion error in scene reconstruction. In Proc. DARPA Image Understanding Workshop, pages 691–695, 1993.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fermüller, C., Aloimonos, Y. (1998). What is computed by structure from motion algorithms?. In: Burkhardt, H., Neumann, B. (eds) Computer Vision — ECCV'98. ECCV 1998. Lecture Notes in Computer Science, vol 1406. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0055678
Download citation
DOI: https://doi.org/10.1007/BFb0055678
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64569-6
Online ISBN: 978-3-540-69354-3
eBook Packages: Springer Book Archive