Ghufran Baig
ABSTRACT
The popularity of 4K videos has grown significantly in the past few years. Yet coding and streaming live 4K videos incurs prohibitive cost to the network and end system. Motivated by this observation, we explore the feasibility of supporting live 4K video streaming over wireless networks using commodity devices. Given the high data rate requirement of 4K videos, 60 GHz is appealing, but its large and unpredictable throughput fluctuation makes it hard to provide desirable user experience. In particular, to support live 4K video streaming, we should (i) adapt to highly variable and unpredictable wireless throughput, (ii) support efficient 4K video coding on commodity devices. To this end, we propose a novel system, Jigsaw. It consists of (i) easy-to-compute layered video coding to seamlessly adapt to unpredictable wireless link fluctuations, (ii) efficient GPU implementation of video coding on commodity devices, and (iii) effectively leveraging both WiFi and WiGig through delayed video adaptation and smart scheduling. Using real experiments and emulation, we demonstrate the feasibility and effectiveness of our system. Our results show that it improves PSNR by 6-15dB and improves SSIM by 0.011-0.217 over state-of-the-art approaches. Moreover, even when throughput fluctuates widely between 0.2Gbps-2Gbps, it can achieve an average PSNR of 33dB.
- ffmpeg. https://www.ffmpeg.org/.Google Scholar
- Nvidia geforce 940m. https://www.notebookcheck.net/NVIDIA-GeForce-940M.138027.0.html.Google Scholar
- Nvidia titan x specs. https://www.nvidia.com/en-us/geforce/products/10series/titan-x-pascal/.Google Scholar
- Nvidia video codec. https://developer.nvidia.com/nvidia-video-codec-sdk.Google Scholar
- Openh264. https://www.openh264.org/.Google Scholar
- Tp-link archer c5400x mu-mimo tri-band gaming router. https://venturebeat.com/2018/09/06/tp-link-launches-gaming-router-for-4k-video-stream-era/.Google Scholar
- Video dataset. url="https://media.xiph.org/video/derf/.Google Scholar
- Youtube 4k bitrates. https://support.google.com/youtube/answer/1722171?hl=en.Google Scholar
- S. Aditya and S. Katti. Flexcast: Graceful wireless video streaming. In Proceedings of the 17th annual international conference on Mobile computing and networking, pages 277--288. ACM, 2011. Google ScholarDigital Library
- J. Bankoski, J. Koleszar, L. Quillio, J. Salonen, P. Wilkins, and Y. Xu. Vp8 data format and decoding guide. RFC 6386, Google Inc., November 2011.Google Scholar
- C.-M. Chang, C.-H. Hsu, C.-F. Hsu, and K.-T. Chen. Performance measurements of virtual reality systems: Quantifying the timing and positioning accuracy. In Proceedings of the 2016 ACM on Multimedia Conference, pages 655--659. ACM, 2016. Google ScholarDigital Library
- M. Choi, G. Lee, S. Jin, J. Koo, B. Kim, and S. Choi. Link adaptation for high-quality uncompressed video streaming in 60-ghz wireless networks. IEEE Transactions on Multimedia, 18(4):627--642, 2016.Google ScholarCross Ref
- L. De Cicco, S. Mascolo, and V. Palmisano. Feedback control for adaptive live video streaming. In Proceedings of the second annual ACM conference on Multimedia systems, pages 145--156. ACM, 2011. Google ScholarDigital Library
- J. Deber, R. Jota, C. Forlines, and D. Wigdor. How much faster is fast enough?: User perception of latency & latency improvements in direct and indirect touch. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pages 1827--1836. ACM, 2015. Google ScholarDigital Library
- S. Fouladi, R. S. Wahby, B. Shacklett, K. V. Balasubramaniam, W. Zeng, R. Bhalerao, A. Sivaraman, G. Porter, and K. Winstein. Encoding, fast and slow: Low-latency video processing using thousands of tiny threads. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), pages 363--376, Boston, MA, 2017. USENIX Association. Google ScholarDigital Library
- J. He, M. A. Qureshi, L. Qiu, J. Li, F. Li, and L. Han. Rubiks: Practical 360-degree streaming for smartphones. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 2018. Google ScholarDigital Library
- Z. He and S. Mao. Multiple description coding for uncompressed video streaming over 60ghz networks. In Proceedings of the 1st ACM workshop on Cognitive radio architectures for broadband, pages 61--68. ACM, 2013. Google ScholarDigital Library
- T.-Y. Huang, R. Johari, N. McKeown, M. Trunnell, and M. Watson. A buffer-based approach to rate adaptation: Evidence from a large video streaming service. ACM SIGCOMM Computer Communication Review, 44(4):187--198, 2015. Google ScholarDigital Library
- S. Jakubczak and D. Katabi. A cross-layer design for scalable mobile video. In Proceedings of the 17th annual international conference on Mobile computing and networking, pages 289--300. ACM, 2011. Google ScholarDigital Library
- J. Jiang, V. Sekar, H. Milner, D. Shepherd, I. Stoica, and H. Zhang. Cfa: A practical prediction system for video qoe optimization. In NSDI, pages 137--150, 2016. Google ScholarDigital Library
- T. K"am"ar"ainen, M. Siekkinen, A. Yl"a-J"a"aski, W. Zhang, and P. Hui. Dissecting the end-to-end latency of interactive mobile video applications. In Proceedings of the 18th International Workshop on Mobile Computing Systems and Applications, pages 61--66. ACM, 2017. Google ScholarDigital Library
- R. Kuschnig, I. Kofler, and H. Hellwagner. An evaluation of tcp-based rate-control algorithms for adaptive internet streaming of h. 264/svc. In Proceedings of the first annual ACM SIGMM conference on Multimedia systems, pages 157--168. ACM, 2010. Google ScholarDigital Library
- Z. Lai, Y. C. Hu, Y. Cui, L. Sun, and N. Dai. Furion: Engineering high-quality immersive virtual reality on today's mobile devices. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking, pages 409--421. ACM, 2017. Google ScholarDigital Library
- Y.-Y. Li, C.-Y. Li, W.-H. Chen, C.-J. Yeh, and K. Wang. Enabling seamless wigig/wifi handovers in tri-band wireless systems. In Network Protocols (ICNP), 2017 IEEE 25th International Conference on, pages 1--2. IEEE, 2017.Google ScholarCross Ref
- L. Liu, R. Zhong, W. Zhang, Y. Liu, J. Zhang, L. Zhang, and M. Gruteser. Cutting the cord: Designing a high-quality untethered vr system with low latency remote rendering. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services, pages 68--80. ACM, 2018. Google ScholarDigital Library
- X. Liu, Q. Xiao, V. Gopalakrishnan, B. Han, F. Qian, and M. Varvello. 360° innovations for panoramic video streaming. In Proceedings of the 16th ACM Workshop on Hot Topics in Networks, HotNets-XVI, pages 50--56, New York, NY, USA, 2017. ACM. Google ScholarDigital Library
- X. L. Liu, W. Hu, Q. Pu, F. Wu, and Y. Zhang. Parcast: Soft video delivery in mimo-ofdm wlans. In Proceedings of the 18th annual international conference on Mobile computing and networking, pages 233--244. ACM, 2012. Google ScholarDigital Library
- H. Mao, R. Netravali, and M. Alizadeh. Neural adaptive video streaming with pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication, pages 197--210. ACM, 2017. Google ScholarDigital Library
- A. Moldovan and C. H. Muntean. Qoe-aware video resolution thresholds computation for adaptive multimedia. In 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pages 1--6, June 2017.Google ScholarCross Ref
- K. Pires and G. Simon. Youtube live and twitch: a tour of user-generated live streaming systems. In Proceedings of the 6th ACM Multimedia Systems Conference, pages 225--230. ACM, 2015. Google ScholarDigital Library
- T. Rappaport. Wireless Communications: Principles and Practice. Prentice Hall PTR, Upper Saddle River, NJ, USA, 2nd edition, 2001. Google ScholarDigital Library
- H. Schwarz, D. Marpe, and T. Wiegand. Overview of the scalable video coding extension of the h.264/avc standard. IEEE Transactions on Circuits and Systems for Video Technology, 17(9):1103--1120, Sept 2007. Google ScholarDigital Library
- H.-R. Shao, J. Hsu, C. Ngo, and C. Kweon. Progressive transmission of uncompressed video over mmw wireless. In Consumer Communications and Networking Conference (CCNC), 2010 7th IEEE, pages 1--5. IEEE, 2010. Google ScholarDigital Library
- H. Singh, J. Oh, C. Kweon, X. Qin, H.-R. Shao, and C. Ngo. A 60 ghz wireless network for enabling uncompressed video communication. IEEE Communications Magazine, 46(12), 2008. Google ScholarDigital Library
- H. Singh, X. Qin, H.-r. Shao, C. Ngo, C. Y. Kwon, and S. S. Kim. Support of uncompressed video streaming over 60ghz wireless networks. In Consumer Communications and Networking Conference, 2008. CCNC 2008. 5th IEEE, pages 243--248. IEEE, 2008.Google ScholarCross Ref
- T. Stockhammer. Dynamic adaptive streaming over http--: standards and design principles. In Proceedings of the second annual ACM conference on Multimedia systems, pages 133--144. ACM, 2011. Google ScholarDigital Library
- G. J. Sullivan, J.-R. Ohm, W.-J. Han, T. Wiegand, et al. Overview of the high efficiency video coding(hevc) standard. IEEE Transactions on circuits and systems for video technology, 22(12):1649--1668, 2012. Google ScholarDigital Library
- S. Sur, I. Pefkianakis, X. Zhang, and K.-H. Kim. Wifi-assisted 60 ghz wireless networks. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking, MobiCom '17, pages 28--41, New York, NY, USA, 2017. ACM. Google ScholarDigital Library
- T. Wei and X. Zhang. Pose information assisted 60 ghz networks: Towards seamless coverage and mobility support. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking, pages 42--55. ACM, 2017. Google ScholarDigital Library
- T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra. Overview of the h. 264/avc video coding standard. IEEE Transactions on circuits and systems for video technology, 13(7):560--576, 2003. Google ScholarDigital Library
- X. Xie, X. Zhang, S. Kumar, and L. E. Li. pistream: Physical layer informed adaptive video streaming over lte. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, pages 413--425. ACM, 2015. Google ScholarDigital Library
- H. Yin, X. Liu, T. Zhan, V. Sekar, F. Qiu, C. Lin, H. Zhang, and B. Li. Design and deployment of a hybrid cdn-p2p system for live video streaming: experiences with livesky. In Proceedings of the 17th ACM international conference on Multimedia, pages 25--34. ACM, 2009. Google ScholarDigital Library
- X. Yin, A. Jindal, V. Sekar, and B. Sinopoli. A control-theoretic approach for dynamic adaptive video streaming over http. In ACM SIGCOMM Computer Communication Review, volume 45(4), pages 325--338. ACM, 2015. Google ScholarDigital Library
Index Terms
- Jigsaw: Robust Live 4K Video Streaming
Recommendations
Meerkat and Periscope: I Stream, You Stream, Apps Stream for Live Streams
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsWe conducted a mixed methods study of the use of the Meerkat and Periscope apps for live streaming video and audio broadcasts from a mobile device. We crowdsourced a task to describe the content, setting, and other characteristics of 767 live streams. ...
DASH in Twitch: Adaptive Bitrate Streaming in Live Game Streaming Platforms
VideoNext '14: Proceedings of the 2014 Workshop on Design, Quality and Deployment of Adaptive Video StreamingLive game streaming platforms such as Twitch allow gamers to broadcast their gameplay over the Internet. The popularity of these platforms boosts the market of eSport but poses new delivery problems. In this paper, we focus on the implementation of ...
CatchLive: Real-time Summarization of Live Streams with Stream Content and Interaction Data
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsLive streams usually last several hours with many viewers joining in the middle. Viewers who join in the middle often want to understand what has happened in the stream. However, catching up with the earlier parts is challenging because it is difficult ...
Comments