Abstract
Three-dimensional Endoscopy is an evolving field of research and offers great benefits for minimally invasive procedures. Besides the pure topology, color texture is an inevitable feature to provide an optimal visualization. Therefore, in this paper, we propose a sensor fusion of a Time-of-Flight (ToF) and an RGB sensor. This requires an intrinsic and extrinsic calibration of both cameras. In particular, the low resolution of the ToF camera (64×50 px) and inhomogeneous illumination precludes the use of standard calibration techniques. By enhancing the image data the use of self-encoded markers for automatic checkerboard detection, a re-projection error of less than 0.23 px for the ToF camera was achieved. The relative transformation of both sensors for data fusion was calculated in an automatic manner.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Rühl S, Bodenstedt S, Suwelack S, et al. Real-time surface reconstruction from stereo endoscopic images for intraoperative registration. Proc SPIE. 2011;7964:14.
Mersmann S, Müller M, Seitel A, et al. Time-of-flight camera technique for augmented reality in computer-assisted interventions. Proc SPIE. 2011;7964:2C.
Penne J, Schaller C, Engelbrecht R, et al. Laparoscopic quantitative 3D endoscopy for image guided surgery. Proc BVM. 2010; p. 16–20.
Gudmundsson SA, Sveinsson JR. TOF-CCD image fusion using complex wavelets. Proc ICASSP. 2011; p. 1557–60.
Lindner M, Kolb A. Data-fusion of PMD-based distance-information and high- resolution RGB-images. Proc ISSCS. 2007;1:121–4.
Forman C, Aksoy M, Hornegger J, et al. Self-encoded marker for optical prospective head motion correction in MRI. Med Image Anal. 2011;15(5):708–19.
Malin DF. Unsharp masking. AAS Photo-Bulletin. 1977;16:10–3.
Zhang Z. A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell. 1998;22:1330–4.
Horn BKP. Closed-form solution of absolute orientation using unit quaternions. J Opt Soc Am A. 1987;4(4):629–42.
Studholme C, Hill DLG, Hawkes DJ. An overlap invariant entropy measure of 3D medical image alignment. Pattern Recognit. 1999;32(1):71–86.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Haase, S., Forman, C., Kilgus, T., Bammer, R., Maier-Hein, L., Hornegger, J. (2012). ToF/RGB Sensor Fusion for Augmented 3D Endoscopy using a Fully Automatic Calibration Scheme. In: Tolxdorff, T., Deserno, T., Handels, H., Meinzer, HP. (eds) Bildverarbeitung für die Medizin 2012. Informatik aktuell. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28502-8_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-28502-8_21
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-28501-1
Online ISBN: 978-3-642-28502-8
eBook Packages: Computer Science and Engineering (German Language)