Abstract
We suggest an efficient real-time method for removing occlusions when synthesizing intermediate views from two stereo images by stereo matching algorithm. The proposed method can carry out the correction of noise resulting from stereo matching, removal of occlusions to achieve high fidelity rendering, and parallel computing to achieve real-time synthesis. The proposed algorithm is compared with state-of-the-art algorithms to show its improved performance in terms of rendering and computational speed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lu, C., Wang, H., Ren, H., Shen, Y.: Virtual view synthesis for multi-view 3D display. In: Third International Joint Conference on Computational Science and Optimization, vol. 2, pp. 444–446 (2010)
Chan, S., Shum, H.Y., Ng, K.T.: Image-based rendering and synthesis. IEEE Signal Processing Magazine 24, 22–33 (2007)
Shum, H.Y., Kang, S.B.: A review of image-based rendering techniques. In: Visual Communications and Image Processing (VCIP), vol. 213, pp. 1–12 (2000)
Park, S., Jeong, H.: Real-time stereo vision FPGA chip with low error rate. In: 2007 International Conference on Multimedia and Ubiquitous Engineering (MUE 2007), pp. 751–756 (2007)
Park, S., Jeong, H.: VLSI architecture for MRF based stereo matching. International Journal of Computer Vision 4599, 55–64 (2007)
Jin, C., Jeong, H.: Intermediate view synthesis for multi-view 3D displays using belief propagation based stereo matching. In: Third International Conference on Convergence and Hybrid Information Technology (ICCIT 2008), pp. 919–924 (2008)
Wang, C., Zhao, L.: Intermediate view synthesis based on adaptive BP algorithm and view interpolation. Journal of Convergence Information Technology 5, 72–81 (2010)
Kim, H., Sohn, K.: Hierarchical disparity estimation with energy-based regularization. In: Proceedings of the International Conference on Image Processing, ICIP 2003, vol. 1, pp. I - 373-6 (2003)
Smolic, A., Muller, K., Dix, K., Merkle, P., Kauff, P., Wiegand, T.: Intermediate view interpolation based on multiview video plus depth for advanced 3d video systems. In: ICIP 2008, pp. 2448–2451 (2008)
Nozick, V., Saito, H.: Online Multiple View Computation for Autostereoscopic Display. In: Mery, D., Rueda, L. (eds.) PSIVT 2007. LNCS, vol. 4872, pp. 399–412. Springer, Heidelberg (2007)
Inamoto, N., Saito, H.: Virtual viewpoint replay for a soccer match by view interpolation from multiple cameras. IEEE Transactions on Multimedia 9, 1155–1166 (2007)
Kitahara, I., Ohta, Y.: Scalable 3d representation for 3d video display in a large-scale space. In: Proceedings of the Virtual Reality, pp. 45–52. IEEE (2003)
Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient belief propagation for early vision. International Journal of Computer Vision 70, 41–54 (2006)
Fusiello, A., Roberto, V., Trucco, E.: Efficient stereo with multiple windowing. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 858–863 (1997)
Lu, J., Rogmans, S., Lafruit, G., Catthoor, F.: Stream-centric stereo matching and view synthesis: A high-speed approach on gpus. IEEE Transactions on Circuits and Systems for Video Technology 19, 1598–1611 (2009)
Jain, A.K., Tran, L.C., Khoshabeh, R., Nguyen, T.Q.: Efficient stereo to multiview synthesis. In: 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 889–892 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cho, S., Ha, J., Jeong, H. (2013). Image Synthesis and Occlusion Removal of Intermediate Views by Stereo Matching. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7725. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37444-9_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-37444-9_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37443-2
Online ISBN: 978-3-642-37444-9
eBook Packages: Computer ScienceComputer Science (R0)