David Gómez
ABSTRACT
The encoding, delivery and interactive consumption of omnidirectional videos still face many challenges. Traditional encoding techniques, based on Equirectangular Projection (ERP) formats, introduce significant pixel redundancy. This has prompted the appearance of advanced solutions based on the segmentation in separate regions or tiles, and their selective delivery depending on the users' viewpoint. However, tiling techniques introduce further challenges. First, neighboring pixels are encoded separately, which may result in noticeable separations between regions. Second, they can involve synchronization problems when the users' viewpoints change. Third, they may require further extensions to existing technologies, such as Dynamic Adaptive Streaming over HTTP (DASH), which makes their adoption in current web browsers very challenging. The use of Cubemap Projection (CMP) is alternatively gaining popularity due to its advantages compared to ERP. However, it requires the streaming of the whole 360° area. This paper proposes a novel tiled Cubemap (TiCMP) strategy that overcomes all the mentioned limitations. TiCMP is based on dividing the cube into two tiles, adaptively streaming them based on the users' viewpoint, and playing them out in a synchronized manner in web-based players. Evaluation results demonstrate that TiCMP provides significant bandwidth savings, without negatively impacting the Quality of Experience (QoE) when compared to traditional Equirectangular- and Cubemap-based strategies.
- TechNavio. 2018. Global 360-degree Camera Market 2018-2022. TechNavio IRTNTR20869.Google Scholar
- M. Graff, C. Timmerer, C. Mueller. 2017. Towards Bandwidth Eficient Adaptive Streaming of Omnidirectional Video over HTTP, ACM MMSYS 2017. Google ScholarDigital Library
- HEVC/H.265 support in web browsers: https://caniuse.com/#search=hevc.Google Scholar
- MPEG-4 support in web browsers: https://caniuse.com/#search=MPEG-4Google Scholar
- VP9 support in web browsers: https://caniuse.com/#search=vp9Google Scholar
- Information Technology -- MPEG System Technology -- Part 6: Dynamic Adaptive Streaming over HTTP (DASH) ISO /IEC JTC 1/SC 29, Dated 2011-01-28 ISO /IEC FCD 23001-6.Google Scholar
- O. A. Niamut, et al. 2016. MPEG DASH SRD: spatial relationship description. ACM MMSYS 2016. Google ScholarDigital Library
- J. Le Feuvre, C. Concolato. 2016. Tiled-based adaptive streaming using MPEG-DASH. ACM MMSYS 2016. Google ScholarDigital Library
- L. D'Acunto, J. van den Berg, E. Thomas, O. Niamut. 2016. Using MPEG DASH SRD for zoomable and navigable video. ACM MMSYS 2016. Google ScholarDigital Library
- M. Hosseini, S. Viswanathan. 2016. Adaptive 360 VR Video Streaming: Divide and Conquer. IEEE ISM 2016.Google ScholarCross Ref
- K. K. Sreedhar, A. Aminlou, M. M. Hannuksela and M. Gabbouj. 2016. Viewport-Adaptive Encoding and Streaming of 360-Degree Video for Virtual Reality Applications. IEEE ISM 2016.Google Scholar
- R. Skupin, Y. Sanchez, C. Hellge and T. Schierl. 2016. Tile Based HEVC Video for Head Mounted Displays. IEEE ISM 2016.Google Scholar
- Information Technology -- MPEG System Technology --- Part 14: MP4 file format / ISO/IEC JTC 1/SC 29, Date 2003-11 ISO/IEC 14496-14:2003Google Scholar
- FFMPEG, 2018. https://www.ffmpeg.org/Google Scholar
- Joint Video Exploration. 2018. https://jvet.hhi.fraunhofer.de/Google Scholar
- Gstreamer. 2018. https://gstreamer.freedesktop.org/Google Scholar
- DASH.js player https://github.com/Dash-Industry-Forum/dash.js/wikiGoogle Scholar
- Three.js. 2018. https://threejs.org/Google Scholar
- M. Montagud, F. Boronat, B. Roig, A. Sapena. 2017 "How to perform AMP? Cubic adjustments for improving the QoE". Computer Communications. 103, C, 61--73, May 2017. Google ScholarDigital Library
Index Terms
- TiCMP: A lightweight and efficient Tiled Cubemap projection strategy for Immersive Videos in Web-based players
Recommendations
End-to-end DASH platform including a network-based and client-based adaptive quality switching module
MMSys '16: Proceedings of the 7th International Conference on Multimedia SystemsThis paper presents an end-to-end Dynamic Adaptive Streaming over HTTP (DASH) platform, developed by using open-source components. It includes and allows the configuration of all the required steps along the end-to-end media delivery chain, from the ...
An SDN-aided low-latency live video streaming over HTTP
AbstractDynamic adaptive streaming over HTTP (DASH) is the crucial factor in the rapid penetration of over-the-top (OTT) service providers for on-demand video streaming. It can also be used for live video streaming by the OTT providers. The recent ...
SABR: Network-Assisted Content Distribution for QoE-Driven ABR Video Streaming
State-of-the-art software-defined wide area networks (SD-WANs) provide the foundation for flexible and highly resilient networking. In this work, we design, implement, and evaluate a novel architecture (denoted as SABR) that leverages the benefits of ...
Comments