Duc V. Nguyen
Abstract
360-degree video has become increasingly popular nowadays. For effective transmission of bandwidth-intensive 360-degree video over networks, viewport-adaptive streaming has been introduced. In this article, we evaluate, for the first time, ten existing methods to understand the effectiveness of tile-based viewport adaptive streaming of 360-degree video. Experimental results show that tile-based methods can improve the average V-PSNR by up to 4.3 dB compared to a non-tiled method under low delay settings. Here, the V-PSNR is computed as the peak signal-to-noise ratio of the adapted viewport compared to the corresponding origin viewport. Also, different methods show different tradeoffs between average viewport quality and viewport quality variations. Especially, the performances of most tile-based methods decrease quickly as the segment duration and/or buffer size increase for the content with no main focus. Even, under long delay settings like HTTP Adaptive Streaming, it is found that the simple non-tiled method appears to be the best one. For the content with a strong viewing focus, it is found that the tile-based methods are less influenced by the segment duration and the buffer size. In addition, a comparison of the performances of the tile selection methods using two popular viewport estimation methods is conducted. It is interesting that there is only little difference found in performances of tile selection methods. The findings of this study are useful for service providers to make decisions on deployment of streaming solutions.
- P. R. Alface, J. Macq, and N. Verzijp. 2012. Interactive omnidirectional video delivery: A bandwidth-effective approach. Bell Labs Technical Journal 16, 4 (March 2012), 135--147.Google Scholar
- Y. Bao, H. Wu, T. Zhang, A. A. Ramli, and X. Liu. 2016. Shooting a moving target: Motion-prediction-based transmission for 360-degree videos. In IEEE Big Data. Washington, DC, 1161--1170.Google Scholar
- F. Bossen, B. Bross, K. Suhring, and D. Flynn. 2012. HEVC complexity and implementation analysis. IEEE Trans. Circuits Syst. Video Technol. 22, 12 (Dec. 2012), 1685--1696.Google ScholarDigital Library
- J. Chakareski, R. Aksu, X. Corbillon, G. Simon, and V. Swaminathan. 2018. Viewport-driven rate-distortion optimized 360 video streaming. In IEEE ICC. 1--7.Google Scholar
- Xavier Corbillon, Francesca De Simone, and Gwendal Simon. 2017. 360-degree video head movement dataset. In 8th ACM Multimedia Systems, (MMSys’17). Taipei, Taiwan, 199--204.Google Scholar
- Xavier Corbillon, Alisa Devlic, Gwendal Simon, and Jacob Chakareski. 2017. Viewport-adaptive navigable 360-degree video delivery. In IEEE ICC. Paris, France, 1--7. arXiv:1609.08042Google Scholar
- Attila Csipa, Xavier Hallade, and Chris Thompson. 2017. OpenTrack v2.2. https://github.com/opentrack/opentrack.Google Scholar
- M. Domanski, O. Stankiewicz, K. Wegner, and T. Grajek. 2017. Immersive visual media MPEG-I: 360 video, virtual navigation and beyond. In IEEE IWSSIP. Poznan, Poland, 1--9.Google Scholar
- Ching-Ling Fan, Jean Lee, and Kuan-Ta Chen. 2017. Fixation prediction for 360 video streaming in head-mounted virtual reality. In 8th ACM Multimedia System Conference. Taipei, Taiwan, 67--72.Google ScholarDigital Library
- FFmpeg team. 2017. FFmpeg. http://ffmpeg.org/.Google Scholar
- Fraunhofer HHI. 2016. HEVC Reference Software HM16.14. https://hevc.hhi.fraunhofer.de.Google Scholar
- Mario Graf, Christian Timmerer, and Christopher Mueller. 2017. Towards bandwidth efficient adaptive streaming of omnidirectional video over HTTP. In ACM MMSys’17. Taipei, Taiwan, 261--271.Google Scholar
- Gurobi Optimization LLC. [n.d.]. Gurobi Optimizer 8.0. www.gurobi.com/.Google Scholar
- Dongbiao He, Cedric Westphal, and J. J. Garcia-Luna-Aceves. 2018. Joint rate and FoV adaptation in immersive video streaming. In Proc. VR/AR Network’18. Budapest, Hungary, 27--32. DOI:https://doi.org/10.1145/3229625.3229630Google Scholar
- Jian He, Mubashir Adnan Qureshi, Lili Qiu, Jin Li, Feng Li, and Lei Han. 2018. Rubiks: Practical 360-degree streaming for smartphones. In MobiSys’18. Munich, Germany, 482--494.Google Scholar
- M. Hosseini and V. Swaminathan. 2016. Adaptive 360 VR video streaming: Divide and conquer! In 2016 IEEE ISM. San Jose, CA, 107--110. DOI:https://doi.org/10.1109/ISM.2016.45Google Scholar
- Chunying Huang, Chenghsin Hsu, YuChun Chang, and KuanTa Chen. 2013. GamingAnywhere: An open cloud gaming system. In ACM MMSys’13. Oslo, Norway, 36--47.Google Scholar
- Hung T. Le, Nam Pham Ngoc, Anh T. Pham, and Truong Cong Thang. 2017. A probabilistic adaptation method for HTTP low-delay live streaming over mobile networks. IEICE Trans. on Information and Systems 100, 2 (2017), 379--383.Google ScholarCross Ref
- C. Liu, N. Kan, J. Zou, Q. Yang, and H. Xiong. 2018. Server-side rate adaptation for multi-user 360-degree video streaming. In IEEE ICIP. Athens, Greece, 3264--3268.Google Scholar
- Xing Liu, Bo Han, Feng Qian, and Matteo Varvello. 2019. LIME: Understanding commercial 360 degree live video streaming services. In MMSys’19. Amherst, Massachusetts, 154--164.Google ScholarDigital Library
- W. Lo, C. Fan, S. Yen, and C. Hsu. 2017. Performance measurements of 360 video streaming to head-mounted displays over live 4G cellular networks. In Asia-Pacific Network Operations and Management Symposium. South Korea, 205--210.Google Scholar
- D. V. Nguyen, H. T. T. Tran, P. N. Nam, and T. C. Thang. 2016. A QoS-adaptive framework for screen sharing over Internet. In IEEE ICUFN. Vienna, Austria, 972--974.Google Scholar
- Duc V. Nguyen, Huyen T. T. Tran, and Truong Cong Thang. 2019. Adaptive tiling selection for viewport adaptive streaming of 360-degree video. IEICE Transactions on Information and Systems 102, 1 (2019), 48--51.Google ScholarCross Ref
- D. V. Nguyen, H. T. T. Tran, A. T. Pham, and T. C. Thang. 2017. A new adaptation approach for viewport-adaptive 360-degree video streaming. In 2017 IEEE International Symposium on Multimedia (ISM). Taichung, Taiwan, 38--44.Google Scholar
- D. V. Nguyen, H. T. T. Tran, and T. C. Thang. 2017. Impact of delays on 360-degree video communications. In 2017 TRON Symposium (TRONSHOW). Tokyo, Japan, 1--6.Google Scholar
- Anh Nguyen, Yan Zhisheng, and Nahrstedt Klara. 2018. Your attention is unique: Detecting 360-degree video saliency in head-mounted display for head movement prediction. In Proc. ACM Multimedia. Seoul, Republic of Korea, 1190--1198.Google ScholarDigital Library
- C. Ozcinar, A. De Abreu, and A. Smolic. 2017. Viewport-aware adaptive 360° video streaming using tiles for virtual reality. In 2017 IEEE International Conference on Image Processing (ICIP). Beijing, China, 2174--2178.Google Scholar
- Stefano Petrangeli, Viswanathan Swaminathan, Mohammad Hosseini, and Filip De Turck. 2017. An HTTP/2-based adaptive streaming framework for 360-degree virtual reality videos. In ACM Multimedia. 306--314.Google Scholar
- Feng Qian, Bo Han, Qingyang Xiao, and Vijay Gopalakrishnan. 2018. Flare: Practical viewport-adaptive 360-degree video streaming for mobile devices. In ACM Mobicom. New Delhi, India, 99--114.Google Scholar
- Feng Qian, Lusheng Ji, Bo Han, and Vijay Gopalakrishnan. 2016. Optimizing 360 video delivery over cellular networks. In AllThingsCellular’16. 1--6.Google Scholar
- Luigi Rizzo. 1997. Dummynet: A simple approach to the evaluation of network protocols. In SIGCOMM Computer Communications Review, Vol. 27. 31--41.Google ScholarDigital Library
- T. Stockhammer. [n.d.]. MPEG Immersive Media. https://www.itu.int/en/ITU-T/studygroups/2017-2020/16/Documents/ws/201701ILE/S2P2-1701-01-19-MPEG_Immersive_Media_Thomas_Stockhammer.pdf.Google Scholar
- Truong Cong Thang, Quang Dung Ho, Jung Won Kang, and Anh T. Pham. 2012. Adaptive streaming of audiovisual content using MPEG DASH. IEEE Trans. Consum. Electron. 58, 1 (2012), 78--85. DOI:https://doi.org/10.1109/TCE.2012.6170058Google ScholarCross Ref
- T. C. Thang, H. T. Le, A. T. Pham, and Y. M. Ro. 2014. An evaluation of bitrate adaptation methods for HTTP live streaming. IEEE Journal on Selected Areas in Communications 32, 4 (April 2014), 693--705.Google ScholarCross Ref
- H. T. T. Tran, N. P. Ngoc, C. M. Bui, M. H. Pham, and T. C. Thang. 2017. An evaluation of quality metrics for 360 videos. In International Conference on Ubiquitous and Future Networks (ICUFN). Milan, Italy, 7--11.Google Scholar
- H. T. T. Tran, N. P. Ngoc, C. T. Pham, Y. J. Jung, and T. C. Thang. 2017. A subjective study on QoE of 360 video for VR communication. In 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP). Luton, UK, 1--6.Google Scholar
- Lan Xie, Zhimin Xu, Yixuan Ban, Xinggong Zhang, and Zongming Guo. 2017. 360ProbDASH: Improving QoE of 360 video streaming using tile-based HTTP adaptive streaming. In ACM Multimedia. 315--323.Google Scholar
- J. Boyce Y. Ye, and E. Alshima. 2017. JVET-E1003: Algorithm descriptions of projection format conversion and video quality metrics in 360Lib. In JVET ITU-T SG 16 WP3 ISO/IEC JTC 1/SC 29/WG 11 5th Meet. Geneva, Switzerland.Google Scholar
- Jun Yi, Shiqing Luo, and Zhisheng Yan. 2019. A measurement study of YouTube 360° live video streaming. In NOSSDAV’19. Amherst, Massachusetts, 49--54.Google Scholar
- A. Zare, A. Aminlou, and M. M. Hannuksela. 2017. Virtual reality content streaming: Viewport-dependent projection and tile-based techniques. In IEEE ICIP. Beijing, China, 1432--1436.Google Scholar
- Chao Zhou, Zhenhua Li, and Yao Liu. 2017. A measurement study of oculus 360 degree video streaming. In ACM MMSys. Taipei, Taiwan, 27--37.Google Scholar
Index Terms
- An Evaluation of Tile Selection Methods for Viewport-Adaptive Streaming of 360-Degree Video
Recommendations
Tile-based Adaptive Streaming for Virtual Reality Video
The increasing popularity of head-mounted devices and 360° video cameras allows content providers to provide virtual reality (VR) video streaming over the Internet, using a two-dimensional representation of the immersive content combined with ...
Efficient viewport prediction and tiling schemes for 360 degree video streaming
MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference360-degree video streaming for VR visualisation is characterised by large transmission data volume and stringent interactive latency demands; hence guaranteeing suitable transmission quality, while meeting the existing constraints, is highly challenging. ...
Adaptive 360-Degree Video Streaming using Scalable Video Coding
MM '17: Proceedings of the 25th ACM international conference on MultimediaVirtual reality and 360-degree video streaming are growing rapidly, yet, streaming high-quality 360-degree video is still challenging due to high bandwidth requirements. Existing solutions reduce bandwidth consumption by streaming high-quality video ...
Comments