A Structured-Light Approach for the Reconstruction of Complex Objects
DOI:
https://doi.org/10.14311/gi.6.32Keywords:
photogrammetric scanning, 3D reconstruction, triangulation, camera calibrationAbstract
Recently, one of the central issues in the fields of Photogrammetry, Computer Vision, Computer Graphics and Image Processing is the development of tools for the automatic reconstruction of complex 3D objects. Among various approaches, one of the most promising is Structured Light 3D scanning (SL) which combines automation and high accuracy with low cost, given the steady decrease in price of cameras and projectors. SL relies on the projection of different light patterns, by means of a video projector, on 3D object sur faces, which are recorded by one or more digital cameras. Automatic pattern identification on images allows reconstructing the shape of recorded 3D objects via triangulation of the optical rays corresponding to projector and camera pixels. Models draped with realistic phototexture may be thus also generated, reproducing both geometry and appearance of the 3D world. In this context, subject of our research is a synthesis of state-of-the-art as well as the development of novel algorithms, in order to implement a 3D scanning system consisting, at this stage, of one consumer digital camera (DSLR) and a video projector. In the following, the main principles of structured light scanning and the algorithms implemented in our system are presented, and results are given to demonstrate the potential of such a system. Since this work is part of an ongoing research project, future tasks are also discussed.References
Xiao, J., Fang, T., Zhao, P., Lhuillier, M., Quan, L.: Image-based street-side city modeling, ACM Transaction on Graphics (TOG), 28(2009) 5.
Teutsch, C.: Model-based Analysis and Evaluation of Point Sets from Optical 3D Laser Scanners, PhD Thesis, Magdeburger Schriften zur Visualisierung, Shaker Verlag, 2007.
Claes, K., Bruyninckx, H.: Robot positioning using structured light patterns suitable for self calibration and 3D tracking, Proceedings of the 2007 International Conference on Advanced Robotics, Jeju, Korea.
Cignoni, P., Scopigno, R.: Sampled 3D models for CH applications: A viable and enabling new medium or just a technological exercise? ACM Journal on Computing and Cultural Heritage, 1(2008)1. [5] CyArk Project. http://archive.cyark.org/about
D-COFORM. http://www.3dcoform.eu/
Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms, Proceedings CVPR, 1(2006), 519-528.
Strecha, C., Fransens, R., van Gool, L.: Combined depth and outlier estimation in multi-view stereo, Proceedings CVPR, 2(2006), 2394- 2401.
Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis, Proc. CVPR, 2007, 1-8.
Vu, H.H., Keriven, R., Labatut, P., Pons, J.-P.: Towards high-resolution large-scale multi-view stereo, Proc. CVPR, 2009.
Mercier, B., Meneveaux, D.: Shape from silhouette: Image pixels for marching cubes, Journal of WSCG, 13(2005), 112-118.
Prados, E., Faugeras, O.: Perspective shape from shading and viscosity solutions, Proc. 9th IEEE ICCV, vol. II, Nice, France, October 2003, 826-831.
Tankus, A., Sochen, N., Yeshurun, Y.: A new perspective on shape from-shading, Proc. 9th IEEE ICCV, vol. II, Nice, France, October 2003, 862-869.
Bouguet, J.-Y., Perona, P.: 3D photography on your desk, Proc. ICCV 1998, 43-50.
Winkelbach, S., Molkenstruck, S., Wahl, F.M.: Low-cost laser range scanner and fast surface registration approach, Proc. DAGM '06, Lecture Notes in Computer Science, vol. 4174, Springer, 2006, 718-728.
Prokos, A., Karras, G., Petsa, E.: Automatic 3D surface reconstruction by combining stereovision with the slitscanner approach, International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXVIII, Part 5, 2010, 505-509.
Gühring, J.: Dense 3-D surface acquisition by structured light using off-the-shelf components, Videometrics and Optical Methods for 3D Shape Measurement, 2001, 220-231.
Rocchini, C., Cignoni, P., Montani, C., Pingi, P., Scopigno, R.: A low cost 3D scanner based on structured light, EUROGRAPHICS 2001, 20 (2001)3.
Tchou, C.: Image-Based Models: Geometry and Reflectance Acquisition Systems, UC Berkeley, M.Sc. Thesis, 2002.
Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light, Proc. IEEE CVPR, 1(2003), 195-202.
Fechteler, P., Eisert, P., Rurainsky, J.: Fast and high resolution 3D face Scanning, Proc. ICIP, 2007.
Peng, T., Gupta, S.K.: Model and algorithms for point cloud construction using digital projection patterns, Journal of Computing and Information Science in Engineering, 7(2007)4, 372-381.
Koninckx, T., Griesser, A., van Gool, L.: Real-time range scanning of deformable surfaces by adaptively coded structured light, In: 3-D Digital Imaging & Modelling, Banff Canada, 2003, 293-300.
Peisen, S., Zhang, H.S.: Fast three-step phase-shifting algorithm, Applied Optics, 45(2006)21, 5086-5091.
Chen, S.Y., Li, Y.F., Zhang, J.: Vision processing for realtime 3-D data acquisition based on coded structured light, IEEE Transactions on Image Processing, 17(2008)2, 167-176.
Liu, K., Wang, Y., Lau, D.L., Hao, Q., Hassebrook, L.G.: Dual-frequency pattern scheme for high-speed 3-D shape measurement, Optical Express, 18(2010), 5229-5244.
Zhang, S.: Recent progresses on real-time 3-d shape measurement using digital fringe projection techniques, Optics and Lasers in Engineering, 40(2010), 149-158.
Schmalz, C., Angelopoulou, E.: A graph-based approach for robust single-shot structured light, IEEE International Workshop on Projector-Camera Systems, 2010.
Furukawa, R., Kawasaki, H.: Uncalibrated multiple image stereo system with arbitrarily movable camera and projector for wide range scanning, Proc. 5th 3DIM '05, 2005, 302-309.
Aliaga, D., Xu, Y.: Photogeometric structured light: a self-calibrating and multi-viewpoint framework for accurate 3D modeling, Proc. IEEE CVPR, 2008.
Gao, W., Wang, L., Hu, Z.: Flexible calibration of a portable structured light system through surface plane, Acta Automatica Sinica, 34(2008)11, 1358-1362.
Zhang, S., Huang, P.S.: Novel method for structured light system calibration, Optical Engineering 45(2006)8.
Knyaz, K.L.: Multi-media projector – single camera photogrammetric system for fast 3D reconstruction, International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXVIII, Part 5(2010), 343-348.
Douskos, V., Grammatikopoulos, L., Kalisperakis, I., Karras, G., Petsa, E.: FAUCCAL: An open source toolbox for fully automatic camera calibration. XXII CIPA Symposium on Digital Documentation, Interpretation & Presentation of Cultural Heritage, Kyoto, Japan, October 2009.
Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry, Pattern Recognition, 43(2010)8, 2666-2680.
Downloads
Published
Issue
Section
License
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).