Abstract
We present a method for active self-calibration of multi-camera systems consisting of pan-tilt zoom cameras. The main focus of this work is on extrinsic self-calibration using active camera control. Our novel probabilistic approach avoids multi-image point correspondences as far as possible. This allows an implicit treatment of ambiguities. The relative poses are optimized by actively rotating and zooming each camera pair in a way that significantly simplifies the problem of extracting correct point correspondences. In a final step we calibrate the entire system using a minimal number of relative poses. The selection of relative poses is based on their uncertainty. We exploit active camera control to estimate consistent translation scales for triplets of cameras. This allows us to estimate missing relative poses in the camera triplets. In addition to this active extrinsic self-calibration we present an extended method for the rotational intrinsic self-calibration of a camera that exploits the rotation knowledge provided by the camera’s pan-tilt unit to robustly estimate the intrinsic camera parameters for different zoom steps as well as the rotation between pan-tilt unit and camera. Quantitative experiments on real data demonstrate the robustness and high accuracy of our approach. We achieve a median reprojection error of \(0.95\) pixel.
Similar content being viewed by others
References
de Agapito, L., Hartley, R., Hayman, E.: Linear self-calibration of a rotating and zooming camera. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 15–21 (1999)
Bajramovic, F., Denzler, J.: Self-calibration with partially known rotations. In: Proceedings of the DAGM Symposium on Pattern Recognition, pp. 1–10 (2007)
Bajramovic, F., Denzler, J.: Global uncertainty-based selection of relative poses for multi camera calibration. In: Proceedings of the British Machine Vision Conference, vol. 2, pp 745–754 (2008)
Bajramovic, F., Brückner, M., Denzler, J.: An efficient shortest triangle paths algorithm applied to multi-camera self-calibration. J. Math. Imaging Visi. 1–14 (2011) (accepted for publication)
Brückner, M., Denzler, J.: Active self-calibration of multi-camera systems. In: Proceedings of the 32nd DAGM Symposium on Pattern Recognition, pp. 31–40. Springer, Berlin (2010)
Brückner, M., Bajramovic, F., Denzler, J.: Geometric and probabilistic image dissimilarity measures for common field of view detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2052–2057 (2009)
Chen, X., Davis, J., Slusallek, P.: Wide area camera calibration using virtual calibration objects. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 520–527 (2000)
Chippendale, P., Tobia, F.: Collective calibration of active camera groups. In: Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, pp. 456–461 (2005)
Conn, A.R., Gould, N.I.M., Toint, P.L.: Trust-Region Methods. SIAM Society for Industrial and Applied Mathematics, Philadelphia (2000)
Eichner, M., Ferrari, V.: Better appearance models for pictorial structures. In: BMVC, pp. 1–11 (2009)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Frahm, J.M., Koch, R.: Camera calibration with known rotation. In: ICCV, vol. 2, pp. 1418–1425 (2003)
Hartley, R.: Self-calibration from multiple views with a rotating camera. In: Proceedings of the European Conference on Computer Vision (ECCV). vol. 800, pp. 471–478. Springer (1994)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)
Hartley, R.I.: In defense of the eight-point algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 19(6), 580–593 (1997)
Hartley, R.I.: Self-calibration of stationary cameras. Int. J. Comput. Vis. 22(1), 5–23 (1997)
Heikkila, J., Silvén, O.: A four-step camera calibration procedure with implicit image correction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1106–1112 (1997)
Läbe, T., Förstner, W.: Automatic relative orientation of images. In: Proceedings of the 5th Turkish-German Joint Geodetic Days (2006)
Lourakis, M.I.A., Argyros, A.A.: SBA: a software package for generic sparse bundle adjustment. ACM Trans. Math. Softw. 36(1), 1–30 (2009)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Ma, Y., Soatto, S., Košecká, J., Sastry, S.: An Invitation to 3D Vision. Springer, Berlin (2004)
Martinec, D., Pajdla, T.: Robust rotation and translation estimation in multiview reconstruction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. (2007)
Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of the British Machine Vision Conference, pp. 384–393 (2002)
McGill, R., Tukey, J., Larsen, W.A.: Variations of boxplots. Am. Stat. 32, 12–16 (1978)
Nistér, D.: An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. 26, 756–770 (2004)
Schiller, I.: MIP-MultiCameraCalibration. http://mip.informatik.uni-kiel.de/tiki-index.php?page=Calibration, last visited on 22 Apr 2010 (2010)
Shi, J., Tomasi, C.: Good features to track. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)
Sinha, S., Pollefeys, M.: Towards calibrating a pan-tilt-zoom cameras network. In: Proceedings of the IEEE Workshop on Omnidirectional Vision (2004)
Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3d. In: SIGGRAPH, pp. 835–846 (2006)
Svoboda, T., Hug, H., Van Gool, L.: ViRoom-low cost synchronized multicamera system and its self-calibration. In: Proceedings of the DAGM Symposium on Pattern Recognition pp. 515–522. Springer, Berlin (2002)
Tordoff, B., Murray, D.: Violating rotating camera geometry: the effect of radial distortion on self-calibration. In: Proceedings of the International Conference on Pattern Recognition (2000)
Tordoff, B., Murray, D.: The impact of radial distortion on the self-calibration of rotating cameras. Comput. Vis. Image Underst. 96(1), 17–34 (2004)
Torr, P., Zisserman, A.: MLESAC: a new robust estimator with application to estimating image geometry. Comput. Vis. Image Underst. 78(1), 138–156 (2000)
Triggs, B., McLauchlan, P., Hartley, R., Fitzgibbon, A.: Bundle adjustmenta modern synthesis. Vis. Algorithms Theory Pract. 1883, 153–177 (2000)
Tsai, R.Y., Lenz, R.K.: A new technique for fully autonomous and efficient 3d robotics hand/eye calibration. IEEE Trans. Robotics Autom. 5(3), 345–357 (1989)
Vergés-Llahí, J., Moldovan, D., Wada, T.: A new reliability measure for essential matrices suitable in multiple view calibration. In: Proceedings of the International Conference on Computer Vision Theory and Applications, vol. 1, pp 114–121 (2008)
Willson, R.: Modeling and calibration of automated zoom lenses. In: Proceedings of the SPIE #2350: Videometrics III, pp. 170–186 (1994)
Zhang, Z.: Flexible camera calibration by viewing a plane from unknown orientations. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 666–673 (1999)
Acknowledgments
Marcel Brückner would like to thank the Carl Zeiss Foundation (Carl-Zeiss-Stiftung) for supporting his research.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Brückner, M., Bajramovic, F. & Denzler, J. Intrinsic and extrinsic active self-calibration of multi-camera systems. Machine Vision and Applications 25, 389–403 (2014). https://doi.org/10.1007/s00138-013-0541-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-013-0541-x