Marc Levoy
Mark Horowitz
Abstract
Confocal microscopy is a family of imaging techniques that employ focused patterned illumination and synchronized imaging to create cross-sectional views of 3D biological specimens. In this paper, we adapt confocal imaging to large-scale scenes by replacing the optical apertures used in microscopy with arrays of real or virtual video projectors and cameras. Our prototype implementation uses a video projector, a camera, and an array of mirrors. Using this implementation, we explore confocal imaging of partially occluded environments, such as foliage, and weakly scattering environments, such as murky water. We demonstrate the ability to selectively image any plane in a partially occluded environment, and to see further through murky water than is otherwise possible. By thresholding the confocal images, we extract mattes that can be used to selectively illuminate any plane in the scene.
Supplemental Material
Available for Download
- CHAI, J.-X., TONG, X., CHAN, S.-C. SHUM, H.-Y. "Plenoptic Sampling." Proc. SIGGRAPH 2000. Google Scholar
Digital Library
- CHAM, T.-J., REHG, J. M., SUKTHANKAR, R., SUKTHANKAR, G., "Shadow Elimination and Occluder Light Suppression for Multi-Projector Displays," Proc. PROCAMS 2003.Google Scholar
- CHUANG, Y.-Y., CURLESS, B., SALESIN, D. H., SZELISKI, R., "A Bayesian Approach to Digital Matting," Proc. CVPR 2001.Google Scholar
- COORG, S., TELLER, S., "Extracting Textured Vertical Facades from Controlled Close-Range Imagery," Proc. CVPR 1999.Google Scholar
- CORLE, T. R., KINO, G. S., Confocal Scanning Optical Microscopy and Related Imaging Systems, Academic Press, 1996.Google Scholar
- DEBEVEC, P., "Image-Based Lighting." IEEE Computer Graphics and Applications, Vol. 22, No. 2, March/April, 2002. Google ScholarDigital Library
- HAN, J. Y., PERLIN, K., "Measuring Bidirectional Texture Reflectance With a Kaleidoscope," Proc. SIGGRAPH 2003. Google ScholarDigital Library
- HARWIT, M., SLOANE, N. J. A., "Hadamard Transform Optics," Academic Press, 1979.Google Scholar
- ISAKSEN, A., MCMILLAN, L., GORTLER, S. J., "Dynamically Reparameterized Light Fields," Proc. SIGGRAPH 2000. Google ScholarDigital Library
- JAFFE, J. S., "Computer Modeling and the Design of Optimal Underwater Imaging Systems," J. Oceanic Eng., Vol. 15, No. 2, 1990.Google ScholarCross Ref
- JAFFE, J. S., MCLEAN, J., STRAND, M. P., MOORE, K. D., "Underwater Optical Imaging: Status and Prospects," Oceanography. Vol. 14, No. 3, 2001, pp. 66--76.Google ScholarCross Ref
- LEVOY, M., HANRAHAN, P., "Light Field Rendering," Proc. SIGGRAPH 1996. Google ScholarDigital Library
- MALZBENDER, T., GELB, D., WOLTERS, H., "Polynomial Texture Maps," Proc. SIGGRAPH 2001. Google ScholarDigital Library
- MASSELUS, V., PEERS, P., DUTRE, P., WILLEMS, Y. D., "Relighting with 4D incident light fields," Proc. SIGGRAPH 2003. Google ScholarDigital Library
- MIDDLETON, W., Vision Through the Atmosphere, University of Toronto Press, 1952.Google Scholar
- MOBLEY, C., Light and Water: Radiative Transfer in Natural Waters, Academic Press, 1994.Google Scholar
- OKASHI, T., Three-Dimensional Imaging Techniques, Academic Press, 1976.Google Scholar
- RUSINKIEWICZ, S., HALL-HOLT, O., LEVOY, M., "Real-Time 3D Model Acquisition," Proc. SIGGRAPH 2002. Google ScholarDigital Library
- SCHECHNER, Y. Y., KARPEL, N., "Clear Underwater Vision," Proc. CVPR 2004.Google Scholar
- SCHECHNER, Y., NAYAR., S., BELHUMEUR, P., "A Theory of Multiplexed Illumination." Proc. ICCV 2003. Google ScholarDigital Library
- SMITH, A., BLINN, J., "Blue Screen Matting," Proc. SIGGRAPH 1996. Google ScholarDigital Library
- VAISH, V., WILBURN, B., JOSHI, N., LEVOY, M., "Using Plane + Parallax for Calibrating Dense Camera Arrays." Proc. CVPR 2004.Google Scholar
- WILBURN, B., SMULSKI, M., LEE, K., HOROWITZ, M. A., "The Light Field Video Camera," Proc. SPIE Electronic Imaging 2002.Google Scholar
- WILSON, T., JUSKAITIS, R., NEIL, M., KOZUBEK, M., "Confocal Microscopy by Aperture Correlation," Optics Letters, 21(3), 1996.Google ScholarCross Ref
- ZAND, J., "Coded aperture imaging in high energy astronomy," NASA Laboratory for High Energy Astrophysics (LHEA) at NASA's GSFC, 1996. URL: http://theawww.gsfc.nasa.gov/docs/cai/.Google Scholar
Index Terms
- Synthetic aperture confocal imaging
Recommendations
Synthetic aperture confocal imaging
SIGGRAPH '04: ACM SIGGRAPH 2004 PapersConfocal microscopy is a family of imaging techniques that employ focused patterned illumination and synchronized imaging to create cross-sectional views of 3D biological specimens. In this paper, we adapt confocal imaging to large-scale scenes by ...
Short-lag spatial coherence combined with eigenspace-based minimum variance beamformer for synthetic aperture ultrasound imaging
Recently, short-lag spatial coherence (SLSC) imaging has been widely studied to improve image contrast and contrast-to-noise ratio (CNR) in ultrasound imaging. Nevertheless, SLSC is unable to provide a good imaging resolution. Eigenspace-based minimum ...
Template-driven segmentation of confocal microscopy images
High quality 3D visualization of anatomic structures is necessary for many applications. The anatomic structures first need to be segmented. A variety of segmentation algorithms have been developed for this purpose. For confocal microscopy images, the ...
Comments