skip to main content
10.1145/3606464.3606474acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article

Evaluating the Benefits: Quantifying the Effects of TCP Options, QUIC, and CDNs on Throughput

Published:22 July 2023Publication History

ABSTRACT

To keep up with increasing demands on quality of experience, assessing and understanding the performance of network connections is crucial for web service providers. While different measures, like TCP options, alternative transport layer protocols like QUIC, or the hosting of services in CDNs, are expected to improve connection performance, no studies are quantifying such impacts on connections on the Internet.

This paper introduces an active Internet measurement approach to assess the impacts of mentioned measures on connection performance. We conduct downloads from public web servers considering different vantage points, extract performance indicators like throughput, RTT, and retransmission rate, and survey speed-ups due to TCP option usage. Further, we compare the performance of QUIC-based downloads to TCP-based downloads considering different option configurations.

Next to significant throughput improvements due to TCP option usage, in particular TCP window scaling, and QUIC, our study shows significantly increased performance for connections to domains hosted by different giant CDNs.

References

  1. S. Bauer, B.Jaeger, F. Helfert, P. Barias, and G. Carle, "On the Evolution of Internet Flow Characteristics," in Proceedings of the Applied Networking Research Workshop, Jul. 2021.Google ScholarGoogle Scholar
  2. J. Mücke, M. Nawrocki, R. Hiesgen, P. Sattler, J. Zirngibl, G. Carle, T. C. Schmidt, and M. Wählisch, "Waiting for QUIC: On the Opportunities of Passive Measurements to Understand QUIC Deployments," arXiv e-prints, pp. arXiv--2209, 2022.Google ScholarGoogle Scholar
  3. A. Gerber and R. Doverspike, "Traffic types and growth in backbone networks," in Optical Fiber Communication Conference. Optica Publishing Group, 2011.Google ScholarGoogle Scholar
  4. I. Poese, B. Frank, B. Ager, G. Smaragdakis, and A. Feldmann, "Improving content delivery using provider-aided distance information," in Proceedings of the 10th ACM SIGCOMM conference on Internet measurement, 2010, pp. 22--34.Google ScholarGoogle Scholar
  5. P. Gigis, M. Calder, L. Manassakis, G. Nomikos, V. Kotronis, X. Dimitropoulos, E. Katz-Bassett, and G. Smaragdakis, "Seven Years in the Life of Hypergiants' off-Nets," in Proc. ACM SIGCOMM, Virtual Event, USA, 2021.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. L. Zembruzki, R. Sommese, L. Z. Granville, A. Selle Jacobs, M. Jonker, and G. C. M. Moura, "Hosting Industry Centralization and Consolidation," in 2022 IEEE/IFIP Network Operations and Management Symposium (NOMS 2022). IEEE Press, 2022, p. 1--9.Google ScholarGoogle Scholar
  7. M. Kühlewind, S. Neuner, and B. Trammell, "On the State of ECN and TCP Options on the Internet," in Passive and Active Measurement: 14th International Conference, PAM 2013, Hong Kong, China, March 18-19, 2013. Proceedings 14. Springer, 2013, pp. 135--144.Google ScholarGoogle Scholar
  8. D. Murray, T. Koziniec, S. Zander, M. Dixon, and P. Koutsakis, "An analysis of changing enterprise network traffic characteristics," in 2017 23rd Asia-Pacific Conference on Communications (APCC). IEEE, 2017, pp. 1--6.Google ScholarGoogle Scholar
  9. H. Lim, S. Kim, J. Sippe, J. Kim, G. White, C.-H. Lee, E. Wustrow, K. Lee, D. Grunwald, and S. Ha, "A Fresh Look at ECN Traversal in the Wild," arXiv preprint arXiv:2208.14523, 2022.Google ScholarGoogle Scholar
  10. K. Nepomuceno, I. N. de Oliveira, R. R. Aschoff, D. Bezerra, M. S. Ito, W. Melo, D. Sadok, and G. Szabó, "QUIC and TCP: A performance evaluation," in 2018 IEEE Symposium on Computers and Communications (ISCC). IEEE, 2018, pp. 00 045--00 051.Google ScholarGoogle Scholar
  11. P. Biswal and O. Gnawali, "Does quic make the web faster?" in 2016 IEEE Global Communications Conference (GLOBECOM). IEEE, 2016, pp. 1--6.Google ScholarGoogle Scholar
  12. K. Wolsing, J. Rüth, K. Wehrle, and O. Hohlfeld, "A performance perspective on web optimized protocol stacks: TCP+ TLS+ HTTP/2 vs. QUIC," in Proceedings of the Applied Networking Research Workshop, 2019, pp. 1--7.Google ScholarGoogle Scholar
  13. D. A. Borman, R. T. Braden, and V. Jacobson, "TCP Extensions for High Performance," RFC 1323, May 1992. [Online]. Available: https://www.rfc-editor.org/info/rfc1323Google ScholarGoogle Scholar
  14. S. Floyd, J. Mahdavi, M. Mathis, and D. A. Romanow, "TCP Selective Acknowledgment Options," RFC 2018, Oct. 1996. [Online]. Available: https://www.rfc-editor.org/info/rfc2018Google ScholarGoogle Scholar
  15. S. Floyd, D. K. K. Ramakrishnan, and D. L. Black, "The Addition of Explicit Congestion Notification (ECN) to IP," RFC 3168, Sep. 2001. [Online]. Available: https://www.rfc-editor.org/info/rfc3168Google ScholarGoogle Scholar
  16. Y. Cheng, J. Chu, S. Radhakrishnan, and A. Jain, "TCP Fast Open," RFC 7413, Dec. 2014. [Online]. Available: https://www.rfc-editor.org/info/rfc7413Google ScholarGoogle Scholar
  17. J. Iyengar and M. Thomson, "QUIC: A UDP-Based Multiplexed and Secure Transport," RFC 9000, May 2021. [Online]. Available: https://www.rfc-editor.org/info/rfc9000Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. M. Thomson and S. Turner, "Using TLS to Secure QUIC," RFC 9001, May 2021. [Online]. Available: https://www.rfc-editor.org/info/rfc9001Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. J. Iyengar and I. Swett, "QUIC Loss Detection and Congestion Control," RFC 9002, May 2021. [Online]. Available: https://www.rfc-editor.org/info/rfc9002Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. M. Allman, "A web server's view of the transport layer," ACM SIGCOMM Computer Communication Review, vol. 30, no. 5, pp. 10--20, 2000.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. K. Pentikousis and H. Badr, "Quantifying the deployment of TCP options - a comparative study," IEEE Communications Letters, vol. 8, no. 10, pp. 647--649, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  22. A. Medina, M. Allman, and S. Floyd, "Measuring interactions between transport protocols and middleboxes," in Proceedings of the 4th ACM SIGCOMM conference on Internet measurement, 2004, pp. 336--341.Google ScholarGoogle Scholar
  23. C.-X. Chen and K. Nagaoka, "Analysis of the State of ECN on the Internet," IEICE TRANSACTIONS on Information and Systems, vol. 102, no. 5, pp. 910--919, 2019.Google ScholarGoogle ScholarCross RefCross Ref
  24. M. Honda, Y. Nishida, C. Raiciu, A. Greenhalgh, M. Handley, and H. Tokuda, "Is it still possible to extend tcp?" in Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference, 2011, pp. 181--194.Google ScholarGoogle Scholar
  25. K. Edeline and B. Donnet, "Evaluating the Impact of Path Brokenness on TCP Options," in Proceedings of the Applied Networking Research Workshop, 2020, pp. 38--44.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Usage statistics of QUIC for websites. [Online]. Available: https://w3techs.com/technologies/details/ce-quicGoogle ScholarGoogle Scholar
  27. T. Shreedhar, R. Panda, S. Podanev, and V. Bajpai, "Evaluating QUIC Performance Over Web, Cloud Storage, and Video Workloads," IEEE Transactions on Network and Service Management, vol. 19, no. 2, pp. 1366--1381, 2021.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Y. Yu, M. Xu, and Y. Yang, "When QUIC meets TCP: An experimental study," in 2017 IEEE 36th International Performance Computing and Communications Conference (IPCCC). IEEE, 2017, pp. 1--8.Google ScholarGoogle Scholar
  29. T. Mangla, E. Halepovic, M. Ammar, and E. Zegura, "emimic: Estimating http-based video qoe metrics from encrypted network traffic," in 2018 Network Traffic Measurement and Analysis Conference (TMA). IEEE, 2018, pp. 1--8.Google ScholarGoogle Scholar
  30. C. López, D. Morato, E. Magana, and M. Izal, "Effective analysis of secure web response time," in 2019 Network Traffic Measurement and Analysis Conference (TMA). IEEE, 2019, pp. 145--152.Google ScholarGoogle Scholar
  31. S. C. Madanapalli, H. H. Gharakhieli, and V. Sivaraman, "Inferring netflix user experience from broadband network measurement," in 2019 Network Traffic Measurement and Analysis Conference (TMA). IEEE, 2019, pp. 41--48.Google ScholarGoogle Scholar
  32. B. Jun, M. Varvello, Y. Zaki, and F. E. Bustamante, "WebTune: A Distributed Platform for Web Performance Measurements," in 2021 Network Traffic Measurement and Analysis Conference (TMA). IFIP, 2021.Google ScholarGoogle Scholar
  33. N. Zilberman, J. Woodruff, M. Ramanujam, A. W. Moore, Y. Tokusashi, D. A. Popescu, B. Cooper, P. Bressana, and S. Galea, "NRG: A Network Perspective on Applications' Performance," 2021.Google ScholarGoogle Scholar
  34. University of Oregon Route Views Project. [Online]. Available: https://www.routeviews.org/routeviews/Google ScholarGoogle Scholar
  35. A. Arturi, E. Carisimo, and F. E. Bustamante, "As2org+: Enriching AS-to-Organization Mappings With PeeringDB," in Proc. Passive and Active Measurement (PAM), 2023, p. 400--428.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. D. Dittrich, E. Kenneally et al., "The Menlo Report: Ethical principles guiding information and communication technology research," US Department of Homeland Security, 2012.Google ScholarGoogle Scholar
  37. C. Partridge and M. Allman, "Addressing Ethical Considerations in Network Measurement Papers," Communications of the ACM, vol. 59, no. 10, Oct. 2016.Google ScholarGoogle Scholar
  38. M. Koster, G. Illyes, H. Zeller, and L. Sassman, "Robots Exclusion Protocol," RFC 9309, Sep. 2022. [Online]. Available: https://www.rfc-editor.org/info/rfc9309Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. S. Bauer, P. Sattler, J. Zirngibl, C. Schwarzenberg, and G. Carle. Tcp and quic measurement pipeline. [Online]. Available: https://github.com/tumi8/active-tcp-and-quic-measurementsGoogle ScholarGoogle Scholar
  40. R. Fielding and J. Reschke, "Rfc 7230: Hypertext transfer protocol (http/1.1): Message syntax and routing," 2014.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. D. M. (aka Roadmaster), "Forcediphttpsadapter," Website, https://github.com/Roadmaster/forcediphttpsadapter; Last accessed: 12 Mai 2023.Google ScholarGoogle Scholar
  42. J. Lainé, "aioquic." [Online]. Available: https://github.com/aiortc/aioquicGoogle ScholarGoogle Scholar
  43. Cloudflare, "quiche." [Online]. Available: https://github.com/cloudflare/quicheGoogle ScholarGoogle Scholar
  44. B. Jaeger, J. Zirngibl, M. Kempf, K. Ploch, and G. Carle, "QUIC on the Highway: Evaluating Performance on High-Rate Links," in International Federation for Information Processing (IFIP) Networking 2023 Conference (IFIP Networking 2023), Barcelona, Spain, Jun. 2023.Google ScholarGoogle Scholar
  45. Wireshark User's Guide - 7.5. TCP Analysis. [Online]. Available: https://www.wireshark.org/docs/wsug_html_chunked/ChAdvTCPAnalysis.htmlGoogle ScholarGoogle Scholar
  46. M. Prince, "Introducing: I'm under attack mode," Website, https://blog.cloudflare.com/introducing-im-under-attack-mode; Last accessed: 12 Mai 2023.Google ScholarGoogle Scholar
  47. About CrUX. [Online]. Available: https://developer.chrome.com/docs/crux/about/Google ScholarGoogle Scholar
  48. J. Zirngibl, P. Buschmann, P. Sattler, B. Jaeger, J. Aulbach, and G. Carle, "It's over 9000: Analyzing early QUIC Deployments with the Standardization on the Horizon," in Proceedings of the 2021 Internet Measurement Conference. New York, NY, USA: ACM, Nov. 2021.Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. J. Zirngibl, P. Sattler, and G. Carle, "A First Look at SVCB and HTTPS DNS Resource Records in the Wild," in International Workshop on Traffic Measurements for Cybersecurity 2023, Jul. 2023.Google ScholarGoogle Scholar

Index Terms

  1. Evaluating the Benefits: Quantifying the Effects of TCP Options, QUIC, and CDNs on Throughput

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        ANRW '23: Proceedings of the Applied Networking Research Workshop
        July 2023
        62 pages
        ISBN:9798400702747
        DOI:10.1145/3606464

        Copyright © 2023 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 22 July 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate34of58submissions,59%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader