Skip to main content
Log in

View generation with DIBR for 3D display system

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

DIBR is a promising technology for rendering new views of scenes from a collection of densely sampled images or videos. It has potential application in virtual reality, immersive, advanced visualization, and 3D television systems. However, due to imperfect depth maps and the illumination difference between reference images, annoying artifacts appear in the rendering image. To generate high-quality intermediate virtual viewpoint image, this paper proposes a novel virtual view rendering method based on DIBR. The proposed method consists of four main parts: luminance compensation based on histogram matching, isolated depth pixel removing, 3D warping with depth-based pixel interpolation, and background-based hole filling. Experimental results show that our method can obtain high-quality virtual view images and achieve satisfactory subjective visual effects.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Cadik M, Herzog R, Mantiuk R (2012) New measurements reveal weaknesses of image quality metrics in evaluating graphics artifacts. ACM Trans Graph 31(6):147:1–147:10

    Article  Google Scholar 

  2. Cetin AE, Smolic A (2009) 3DTV: Capture. Transmission, and Display of 3DVideo, eurasip journal on advances in signal processing 2009:1–2

    Google Scholar 

  3. Daribo I, Saito H (2011) A novel inpainting-based layered depth video for 3DTV, source. IEEE Trans Broadcast 57(2):533–541

    Article  Google Scholar 

  4. De Silva DVSX, Fernando WAC, Nur G, Ekmekcioglu E, Worrall ST (2010) 3D video assessment with just noticeable difference in depth evaluation. Proceedings International Conference on Image Processing, ICIP, Hong Kong, China, pp 4013–4016

    Google Scholar 

  5. Do L, Bravo G, Zinger S (2012) GPU-accelerated real-time free-viewpoint DIBR for 3DTV. IEEE Trans Consum Electron 58(2):633–640

    Article  Google Scholar 

  6. Hannuksela MM, Rusanovskyy D, Su W, Chen L, Li R, Aflaki P, Lan D, Joachimiak M, Li H, Gabbouj M (2013) Multi-view-video-plus-depth coding based on the advanced video coding standard. IEEE Trans Image Process 22(9):3449–3458

    Article  Google Scholar 

  7. Heo J, Ho YS (2010) Improved context-based adaptive binary arithmetic coding over H.264/AVC for lossless depth Map coding. IEEE Signal Processing Letters 17(10):835–838

    Article  Google Scholar 

  8. Lee DS, Ko MS, Seo YH, Kim DW, Yoo JS (2013) Illumination compensation for multi-view video based on layered histogram matching with depth information. Opt Commun 286(1):74–84

    Article  Google Scholar 

  9. Lei J, Feng K, Wu M, Li S, and Hou C (2013), “Rate control of hierarchical B prediction structure for multi-view video coding,” Multimedia Tools and Applications, DOI: 10.1007/s11042-013-1386-z, pp.1-18

  10. Li S, Lei J, Zhu C, Yu L, Hou C (2014) Pixel-based inter prediction in coded texture assisted depth coding. IEEE Signal Processing Letters 21(1):74–78

    Article  Google Scholar 

  11. Liu S, Lai P, Tian D, Chen CW (2011) New depth coding techniques with utilization of corresponding video. IEEE Trans Broadcast 57(2):551–561

    Article  Google Scholar 

  12. Mateusz G, Krzysztof W, Marek D (2008) View synthesis software and assessment of its performance, ISO/IEC JTC1/SC29/WG11 MPEG/M15672. Hannover, Germany

    Google Scholar 

  13. McMillan L Jr., (1997), An image-based approach to three-dimensional computer graphics, Ph.D. dissertation, University of North Carolina at Chapel Hill, Chapel Hill, NC

  14. Merkle P, Morvan Y, Smolic A (2009) The effects of multi-view depth video compression on multi-view rendering. signal processing-image communication 24(1–2):73–88

    Article  Google Scholar 

  15. Mori Y, Fukushima N, Fujii T, Tanimoto M (2008) View generation with 3D warping using depth information for FTV, the true vision - capture transmission and display of 3D video, 3DTV-CON 2008 proceedings. Istanbul, Turkey, pp 229–232

    Book  Google Scholar 

  16. Müller K, Smolic A, Dix K, Kauff P, Wiegand T (2008) Reliability-based generation and view synthesis in layered depth video, proceedings of the 2008 I.E. 10th workshop on multimedia signal processing, MMSP 2008. Cairns, Australia, pp 34–39

    Google Scholar 

  17. Oh KJ, Yea S, Vetro A, Ho YS (2010) Virtual view synthesis method and self-evaluation metrics for free viewpoint television and 3D video. Int J Imaging Syst Technol 20(4):378–390

    Article  Google Scholar 

  18. Smolic A (2011) 3D video and free viewpoint video-From capture to display. Pattern Recogn 44(9):1958–1968

    Article  MathSciNet  Google Scholar 

  19. Solh M, Alregib G (2012) Hierarchical hole-filling for depth-based view synthesis in FTV and 3D video. IEEE Journal on Selected Topics in Signal Processing 6(5):495–504

    Article  Google Scholar 

  20. Sundaram M, Ramar K, Arumugam N (2011) Histogram modified local contrast enhancement for mammogram images. applied soft computing 11(8):5809–5816

    Article  Google Scholar 

  21. Tanimoto M (2012) FTV: free-viewpoint television. signal processing-image communication 27(6):555–570

    Article  Google Scholar 

  22. Tauber Z, Li Z, Drew M (2007) Disocclusion by inpainting for image-based rendering. IEEE Trans Syst Man Cybern Part C Appl Rev 37(4):527–540, Review, and preview

    Article  Google Scholar 

  23. Wang M, Hu F, Li J (2011) Epipolar resampling of linear pushbroom satellite imagery by a new epipolarity model. isprs journal of photogrammetry and remote sensing 66(3):347–355

    Article  Google Scholar 

  24. Yan X, and Luo Y (2011), Action recognition via cumulative histogram of multiple features, Optical Engineering, vol. 50, no.1

  25. Zhao M, Chung R (2010) Critical line-set configurations to epipolar geometry determination and application to image line transfer. Pattern Recogn Lett 31(8):686–695

    Article  Google Scholar 

  26. Zinger S, Do L, Peter HN (2012) Recent developments in free-viewpoint interpolation for 3DTV. 3D Research 3(1):1–6

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported by the National Natural Science Foundation of China under Grant 60932007, by National 863 Program (No. 2012AA03A301), and by Ph.D. Programs Foundation of Ministry of Education of China (No. 20110032110029) and Key Projects in the Tianjin Science & Technology Pillar Program (grant 11ZCKFGX02000).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jianjun Lei.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, L., Hou, C., Lei, J. et al. View generation with DIBR for 3D display system. Multimed Tools Appl 74, 9529–9545 (2015). https://doi.org/10.1007/s11042-014-2133-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2133-9

Keywords

Navigation