Abstract
We consider the stratified self-calibration (affine and metric reconstruction) problem from images acquired with a camera with unchanging internal parameters undergoing circular motion. The general stratified method (modulus constraints) is known to fail with this motion. In this paper we give a novel constraint on the plane at infinity in projective reconstruction for circular motion, the constant inter-frame motion constraint on the plane at infinity between every two adjacent views and a fixed view of the motion sequences, by making use of the facts that in many commercial systems rotation angles are constant. An initial solution can be obtained by using the first three views of the sequence, and Stratified Iterative Particle Swarm Optimization (SIPSO) is proposed to get an accurate and robust solution when more views are at hand. Instead of using the traditional optimization algorithm as the last step to obtain an accurate solution, in this paper, the whole motion sequence information is exploited before computing the camera calibration matrix, this results in a more accurate and robust solution. Once the plane at infinity is identified, the calibration matrices of the camera and a metric reconstruction can be readily obtained. Experiments on both synthetic and real image sequence are given, showing the accuracy and robustness of the new algorithm.
Similar content being viewed by others
References
Boyer, E.: Object models from contour sequences. In: European Conference on Computer Vision, pp. 109–118 (1996)
Cao, X.C., Xiao, J.J., Foroosh, H.: Self-calibration from turn-table sequences in presence of zoom and focus. Comput. Vis. Image Underst. 102, 227–237 (2006)
Faugeras, O.D., Luong, Q., Maybank, S.: Camera self-calibration: theory and experiments. In: International Conference on Computer Vision, pp. 321–334 (1992)
Fitzgibbon, A.W., Cross, G., Zisserman, A.: Automatic 3D model construction for turn-table sequences. In: Lecture Notes in Computer Science, vol. 1506, pp. 155–170. Springer, Berlin (1998)
Fredrik, K., Triggs, B.: Critical motions for auto-calibration when some intrinsic parameters can vary. J. Math. Imaging Vis. 13, 131–146 (2000)
Hartley, R.I.: Kruppa’s equations derived from the fundamental matrix. IEEE Trans. Pattern Anal. Mach. Intell. 19(10), 133–135 (1997)
Hartley, R.I., Hayman, E., Agapito, L.D., Reid, I.: Camera calibration and the search for infinity. In: International Conference on Computer Vision, pp. 510–517 (1999)
Heyden, A., Astrom, K.: Euclidean reconstruction from constant intrinsic parameters. In: Proceedings of the International Conference on Pattern Recognition (1996)
Jiang, G., Quan, L., Zisserman, A.: Geometry of single axis motions using conic fitting. IEEE Trans. Pattern Anal. Mach. Intell. 25(6), 604–616 (2001)
Kutulakos, K.N., Seitz, S.M.: A theory of shape by space carving. Int. J. Comput. Vis. 38(3), 199–218 (1998)
Liu, Y., Tsui, H., Wu, C.: Resolving ambiguities of self-calibration in turntable motion. In: Proceedings of the 15th International Conference on Pattern Recognition, pp. 865–868 (2000)
Maybank, S., Faugeras, O.D.: A theory of self-calibration of a moving camera. Int. J. Comput. Vis. 2(8), 123–151 (1992)
Niem, W.: Robust and fast modelling of 3d natural objects from multiple views. In: Proc. SPIE, pp. 388–397. SPIE Press, Bellingham (1994)
Pollefeys, M., Gool, L.V.: Stratified self-calibration with modulus constraint. IEEE Trans. Pattern Anal. Mach. Intell. 21(8), 707–724 (1999)
Schaffalitzky, F.: Direct solution of modulus constraints. In: Indian Conference on Computer Vision, Graphics and Image Processing, pp. 314–321 (2000)
Sturm, P.: Critical motion sequences for monocular self-calibration and uncalibrated Euclidean reconstruction. In: IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, USA, pp. 1100–1105 (1997)
Sturm, P., Triggs, B.: A factorization based algorithm for multi-image projective structure and motion. In: European Conference on Computer Vision, pp. 709–720 (1996)
Sullivan, S., Ponce, J.: Automatic model construction, pose estimation, and object recognition from photographs using triangular splines. IEEE Trans. Pattern Anal. Mach. Intell. 20(10), 1091–1097 (1998)
Szeliski, R.: Shape from rotation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 625–630 (1991)
Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Int. J. Comput. Vis. 9, 137–154 (1992)
Zhang, H., Yee, K., Wong, K.: Self-calibration of turntable sequences from silhouettes. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 5–14 (2004)
Zhang, Z.: Camera calibration with one-dimensional objects. IEEE Trans. Pattern Anal. Mach. Intell. 7(26), 892–899 (2004)
Acknowledgements
This work is supported by the National Natural Science Foundation of China (Grant nos. 61175075) and National High-tech Research and Development Projects (Grant nos. 2012AA112312). The authors also thank the anonymous reviewers for providing us constructive suggestions.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lu, X., Wang, Y., Xu, H. et al. A new method for camera stratified self-calibration under circular motion. Vis Comput 29, 1107–1119 (2013). https://doi.org/10.1007/s00371-012-0754-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-012-0754-4