Abstract
DIBR is a promising technology for rendering new views of scenes from a collection of densely sampled images or videos. It has potential application in virtual reality, immersive, advanced visualization, and 3D television systems. However, due to imperfect depth maps and the illumination difference between reference images, annoying artifacts appear in the rendering image. To generate high-quality intermediate virtual viewpoint image, this paper proposes a novel virtual view rendering method based on DIBR. The proposed method consists of four main parts: luminance compensation based on histogram matching, isolated depth pixel removing, 3D warping with depth-based pixel interpolation, and background-based hole filling. Experimental results show that our method can obtain high-quality virtual view images and achieve satisfactory subjective visual effects.
Similar content being viewed by others
References
Cadik M, Herzog R, Mantiuk R (2012) New measurements reveal weaknesses of image quality metrics in evaluating graphics artifacts. ACM Trans Graph 31(6):147:1–147:10
Cetin AE, Smolic A (2009) 3DTV: Capture. Transmission, and Display of 3DVideo, eurasip journal on advances in signal processing 2009:1–2
Daribo I, Saito H (2011) A novel inpainting-based layered depth video for 3DTV, source. IEEE Trans Broadcast 57(2):533–541
De Silva DVSX, Fernando WAC, Nur G, Ekmekcioglu E, Worrall ST (2010) 3D video assessment with just noticeable difference in depth evaluation. Proceedings International Conference on Image Processing, ICIP, Hong Kong, China, pp 4013–4016
Do L, Bravo G, Zinger S (2012) GPU-accelerated real-time free-viewpoint DIBR for 3DTV. IEEE Trans Consum Electron 58(2):633–640
Hannuksela MM, Rusanovskyy D, Su W, Chen L, Li R, Aflaki P, Lan D, Joachimiak M, Li H, Gabbouj M (2013) Multi-view-video-plus-depth coding based on the advanced video coding standard. IEEE Trans Image Process 22(9):3449–3458
Heo J, Ho YS (2010) Improved context-based adaptive binary arithmetic coding over H.264/AVC for lossless depth Map coding. IEEE Signal Processing Letters 17(10):835–838
Lee DS, Ko MS, Seo YH, Kim DW, Yoo JS (2013) Illumination compensation for multi-view video based on layered histogram matching with depth information. Opt Commun 286(1):74–84
Lei J, Feng K, Wu M, Li S, and Hou C (2013), “Rate control of hierarchical B prediction structure for multi-view video coding,” Multimedia Tools and Applications, DOI: 10.1007/s11042-013-1386-z, pp.1-18
Li S, Lei J, Zhu C, Yu L, Hou C (2014) Pixel-based inter prediction in coded texture assisted depth coding. IEEE Signal Processing Letters 21(1):74–78
Liu S, Lai P, Tian D, Chen CW (2011) New depth coding techniques with utilization of corresponding video. IEEE Trans Broadcast 57(2):551–561
Mateusz G, Krzysztof W, Marek D (2008) View synthesis software and assessment of its performance, ISO/IEC JTC1/SC29/WG11 MPEG/M15672. Hannover, Germany
McMillan L Jr., (1997), An image-based approach to three-dimensional computer graphics, Ph.D. dissertation, University of North Carolina at Chapel Hill, Chapel Hill, NC
Merkle P, Morvan Y, Smolic A (2009) The effects of multi-view depth video compression on multi-view rendering. signal processing-image communication 24(1–2):73–88
Mori Y, Fukushima N, Fujii T, Tanimoto M (2008) View generation with 3D warping using depth information for FTV, the true vision - capture transmission and display of 3D video, 3DTV-CON 2008 proceedings. Istanbul, Turkey, pp 229–232
Müller K, Smolic A, Dix K, Kauff P, Wiegand T (2008) Reliability-based generation and view synthesis in layered depth video, proceedings of the 2008 I.E. 10th workshop on multimedia signal processing, MMSP 2008. Cairns, Australia, pp 34–39
Oh KJ, Yea S, Vetro A, Ho YS (2010) Virtual view synthesis method and self-evaluation metrics for free viewpoint television and 3D video. Int J Imaging Syst Technol 20(4):378–390
Smolic A (2011) 3D video and free viewpoint video-From capture to display. Pattern Recogn 44(9):1958–1968
Solh M, Alregib G (2012) Hierarchical hole-filling for depth-based view synthesis in FTV and 3D video. IEEE Journal on Selected Topics in Signal Processing 6(5):495–504
Sundaram M, Ramar K, Arumugam N (2011) Histogram modified local contrast enhancement for mammogram images. applied soft computing 11(8):5809–5816
Tanimoto M (2012) FTV: free-viewpoint television. signal processing-image communication 27(6):555–570
Tauber Z, Li Z, Drew M (2007) Disocclusion by inpainting for image-based rendering. IEEE Trans Syst Man Cybern Part C Appl Rev 37(4):527–540, Review, and preview
Wang M, Hu F, Li J (2011) Epipolar resampling of linear pushbroom satellite imagery by a new epipolarity model. isprs journal of photogrammetry and remote sensing 66(3):347–355
Yan X, and Luo Y (2011), Action recognition via cumulative histogram of multiple features, Optical Engineering, vol. 50, no.1
Zhao M, Chung R (2010) Critical line-set configurations to epipolar geometry determination and application to image line transfer. Pattern Recogn Lett 31(8):686–695
Zinger S, Do L, Peter HN (2012) Recent developments in free-viewpoint interpolation for 3DTV. 3D Research 3(1):1–6
Acknowledgment
This work was supported by the National Natural Science Foundation of China under Grant 60932007, by National 863 Program (No. 2012AA03A301), and by Ph.D. Programs Foundation of Ministry of Education of China (No. 20110032110029) and Key Projects in the Tianjin Science & Technology Pillar Program (grant 11ZCKFGX02000).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, L., Hou, C., Lei, J. et al. View generation with DIBR for 3D display system. Multimed Tools Appl 74, 9529–9545 (2015). https://doi.org/10.1007/s11042-014-2133-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2133-9