Florian Wohlfart
ABSTRACT
Today's large content providers (CP) are busy building out their service infrastructures or "peering edges" to satisfy the insatiable demand for content created by an ever-expanding Internet edge. One component of these serving infrastructures that features prominently in this build-out is their connectivity fabric; i.e., the set of all Internet interconnections that content has to traverse en route from the CP's various "deployments" or "serving sites" to end users. However, these connectivity fabrics have received little attention in the past and remain largely ill-understood.
In this paper, we describe the results of an in-depth study of the connectivity fabric of Akamai. Our study reveals that Akamai's connectivity fabric consists of some 6,100 different "explicit" peerings (i.e., Akamai is one of the two involved peers) and about 28,500 different "implicit" peerings (i.e., Akamai is neither of the two peers). Our work contributes to a better understanding of real-world serving infrastructures by providing an original account of implicit peerings and demonstrating the performance benefits that Akamai can reap from leveraging its rich connectivity fabric for serving its customers' content to end users.
- IPv4 & IPv6 CIDR Report. http://www.cidr-report.org/as2.0. Accessed: Jan. 2017.Google Scholar
- Vijay Kumar Adhikari, Yang Guo, Fang Hao, Volker Hilt, Zhi-Li Zhang, Matteo Varvello, and Moritz Steiner. Measurement Study of Netflix, Hulu, and a Tale of Three CDNs. IEEE/ACM TON, 23(6), 2015. Google ScholarDigital Library
- Vijay Kumar Adhikari, Sourabh Jain, Yingying Chen, and Zhi-Li Zhang. Vivisecting YouTube: An Active Measurement Study. In IEEE INFOCOM, 2012.Google Scholar
- Bernhard Ager, Nikolaos Chatzis, Anja Feldmann, Nadi Sarrar, Steve Uhlig, and Walter Willinger. Anatomy of a Large European IXP. In ACM SIGCOMM, 2012. Google ScholarDigital Library
- Bernhard Ager, Wolfgang Mühlbauer, Georgios Smaragdakis, and Steve Uhlig. Web Content Cartography. In ACM IMC, 2011. Google ScholarDigital Library
- Seth Bennet. Facebook Scalable Interconnection. https://www.peering-forum.eu/system/documents/124/original/09.30_-_Facebook_-_Seth_Bennet.pdf.Google Scholar
- Timm Böttger, Félix Cuadrado, Gareth Tyson, Ignacio Castro, and Steve Uhlig. A Hypergiant's View of the Internet. ACM CCR, 2017.Google Scholar
- Samuel Henrique Bucke Brito, Mateus A. S. Santos, Ramon dos Reis Fontes, Danny Alex Lachos Perez, and Christian Esteve Rothenberg. Dissecting the Largest National Ecosystem of Public Internet eXchange Points in Brazil. In PAM, 2016.Google Scholar
- Matt Calder, Xun Fan, Zi Hu, Ethan Katz-Bassett, John S. Heidemann, and Ramesh Govindan. Mapping the Expansion of Google's Serving Infrastructure. In ACM IMC, 2013. Google ScholarDigital Library
- Matt Calder, Ashley Flavel, Ethan Katz-Bassett, Ratul Mahajan, and Jitendra Padhye. Analyzing the Performance of an Anycast CDN. In ACM IMC, 2015. Google ScholarDigital Library
- Ignacio Castro, Juan Camilo Cardona, Sergey Gorinsky, and Pierre François. Remote Peering: More Peering without Internet Flattening. In ACM CoNEXT, 2014. Google ScholarDigital Library
- H. Chang, S. Jamin, and W. Willinger. Internet Connectivity at the AS-Level: An Optimization-Driven Modeling Approach. In ACM SIGCOMM Workshop on Models, Methods, and Tools for Reproducible Network Research, 2003. Google ScholarDigital Library
- Nikolaos Chatzis, Georgios Smaragdakis, Jan Böttger, Thomas Krenc, and Anja Feldmann. On the Benefits of Using a Large IXP As an Internet Vantage Point. In ACM IMC, 2013. Google ScholarDigital Library
- Fangfei Chen, Ramesh K. Sitaraman, and Marcelo Torres. End-User Mapping: Next Generation Request Routing for Content Delivery. In ACM SIGCOMM, 2015. Google ScholarDigital Library
- Yi-Ching Chiu, Brandon Schlinker, Abhishek Balaji Radhakrishnan, Ethan Katz-Bassett, and Ramesh Govindan. Are We One Hop Away from a Better Internet? In ACM IMC, 2015. Google ScholarDigital Library
- Amogh Dhamdhere and Constantine Dovrolis. The Internet is Flat: Modeling the Transition from a Transit Hierarchy to a Peering Mesh. In ACM CoNEXT, 2010. Google ScholarDigital Library
- Amogh Dhamdhere and Constantine Dovrolis. Twelve Years in the Evolution of the Internet Ecosystem. IEEE/ACM TON, 19(5), 2011. Google ScholarDigital Library
- Hurricane Electric. Internet Statistics. https://bgp.he.net/report/netstats. Accessed: Jan. 2017.Google Scholar
- Equinix. Private Data Exchange Between Businesses Forecasted to Outpace the Public Internet by Nearly 2x in Growth and 6x in Volume by 2020. https://www.equinix.com/newsroom/press-releases/pr/123570/private-data-exchange-between-businesses-forecasted-to-outpace-the-public-internet-by-nearly-2x-in-growth-and-6x-in-volume-by-2020.Google Scholar
- Facebook. Building Express Backbone: Facebook's new long-haul network. https://code.facebook.com/posts/1782709872057497/building-express-backbone-facebook-s-new-long-haul-network.Google Scholar
- Benjamin Frank, Ingmar Poese, Yin Lin, Georgios Smaragdakis, Anja Feldmann, Bruce M. Maggs, Jannis Rake, Steve Uhlig, and Rick Weber. Pushing CDN-ISP Collaboration to the Limit. ACM CCR, 2013. Google ScholarDigital Library
- Phillipa Gill, Martin F. Arlitt, Zongpeng Li, and Anirban Mahanti. The Flattening Internet Topology: Natural Evolution, Unsightly Barnacles or Contrived Collapse? In PAM, 2008. Google ScholarDigital Library
- Google. Google Edge Network. https://peering.google.com.Google Scholar
- Packet Clearing House. Daily Routing Snapshots. https://www.pch.net/resources/Routing_Data.Google Scholar
- Cheng Huang, Angela Wang, Jin Li, and Keith W. Ross. Measuring and Evaluating Large-Scale CDNs. In ACM IMC, 2008. Google Scholar
- Wenjie Jiang, Rui Zhang-Shen, Jennifer Rexford, and Mung Chiang. Cooperative Content Distribution and Traffic Engineering in an ISP network. In ACM SIGMETRICS/Performance, 2009. Google ScholarDigital Library
- Christian Kaufmann. Akamai ICN. https://pc.nanog.org/static/published/meetings/NANOG71/1532/20171003_Kaufmann_Lightning_Talk_Akamai_v1.pdf. NANOG 71 Light. Talk, 2017.Google Scholar
- Christian Kaufmann. ICN - Akamai's Backbone. https://www.linx.net/wp-content/uploads/LINX101-Akamai-ICN-ChristianKaufmann.pdf. LINX Meeting 101, 2018.Google Scholar
- Rupa Krishnan, Harsha V. Madhyastha, Sridhar Srinivasan, Sushant Jain, Arvind Krishnamurthy, Thomas E. Anderson, and Jie Gao. Moving Beyond End-to-End Path Information to Optimize CDN Performance. In ACM IMC, 2009. Google ScholarDigital Library
- Craig Labovitz, Scott Iekel-Johnson, Danny McPherson, Jon Oberheide, and Farnam Jahanian. Internet Inter-Domain Traffic. In ACM SIGCOMM, 2010. Google ScholarDigital Library
- RIPE NCC. RIS Raw Data. https://www.ripe.net/analyse/internet-measurements/routing-information-service-ris/ris-raw-data.Google Scholar
- University of Oregon. Route Views Archive Project. http://archive.routeviews.org.Google Scholar
- Ricardo V. Oliveira, Dan Pei, Walter Willinger, Beichuan Zhang, and Lixia Zhang. In Search of the Elusive Ground Truth: the Internet's AS-level Connectivity Structure. In ACM SIGMETRICS, 2008. Google ScholarDigital Library
- Ricardo V. Oliveira, Dan Pei, Walter Willinger, Beichuan Zhang, and Lixia Zhang. The (in)Completeness of the Observed Internet AS-level Structure. IEEE/ACM TON, 18(1), 2010. Google ScholarDigital Library
- Ricardo V. Oliveira, Beichuan Zhang, and Lixia Zhang. Observing the Evolution of Internet as Topology. In ACM SIGCOMM, 2007. Google ScholarDigital Library
- John S. Otto, Mario A. Sánchez, John P. Rula, and Fabián E. Bustamante. Content Delivery and the Natural Evolution of DNS: Remote DNS Trends, Performance Issues and Alternative Solutions. In ACM IMC, 2012. Google ScholarDigital Library
- Vern Paxson. End-to-end Routing Behavior in the Internet. In ACM SIGCOMM, 1996. Google ScholarDigital Library
- Ingmar Poese, Benjamin Frank, Bernhard Ager, Georgios Smaragdakis, and Anja Feldmann. Improving Content Delivery Using Provider-aided Distance Information. In ACM IMC, 2010. Google ScholarDigital Library
- Ingmar Poese, Benjamin Frank, Bernhard Ager, Georgios Smaragdakis, Steve Uhlig, and Anja Feldmann. Improving Content Delivery with PaDIS. IEEE Internet Computing, 16(3), 2012. Google ScholarDigital Library
- Philipp Richter, Georgios Smaragdakis, Anja Feldmann, Nikolaos Chatzis, Jan Böttger, and Walter Willinger. Peering at Peerings: On the Role of IXP Route Servers. In ACM IMC, 2014. Google ScholarDigital Library
- Matthew Roughan, Walter Willinger, Olaf Maennel, Debbie Perouli, and Randy Bush. 10 Lessons from 10 Years of Measuring and Modeling the Internet's Autonomous Systems. IEEE Journal on Selected Areas in Communications, 29(9), 2011.Google ScholarCross Ref
- Brandon Schlinker, Hyojeong Kim, Timothy Cui, Ethan Katz-Bassett, Harsha V. Madhyastha, Ítalo Cunha, James Quinn, Saif Hasan, Petr Lapukhov, and Hongyi Zeng. Engineering Egress with Edge Fabric: Steering Oceans of Content to the World. In ACM SIGCOMM, 2017. Google ScholarDigital Library
- Florian Streibelt, Jan Böttger, Nikolaos Chatzis, Georgios Smaragdakis, and Anja Feldmann. Exploring EDNS-Client-Subnet Adopters in Your Free Time. In ACM IMC, 2013. Google ScholarDigital Library
- Ao-Jan Su, David R. Choffnes, Aleksandar Kuzmanovic, and Fabián E. Bustamante. Drafting Behind Akamai (Travelocity-based Detouring). In ACM SIGCOMM, 2006. Google ScholarDigital Library
- Ruben Torres, Alessandro Finamore, Jin Ryong Kim, Marco Mellia, Maurizio M. Munafò, and Sanjay G. Rao. Dissecting Video Server Selection Strategies in the YouTube CDN. In IEEE ICDCS, 2011. Google ScholarDigital Library
- Marc Anthony Warrior, Uri Klarman, Marcel Flores, and Aleksandar Kuzmanovic. Drongo: Speeding Up CDNs with Subnet Assimilation from the Client. In ACM CoNEXT, 2017.Google Scholar
- Kok-Kiong Yap, Murtaza Motiwala, Jeremy Rahe, Steve Padgett, Matthew J. Holliman, Gary Baldus, Marcus Hines, Taeeun Kim, Ashok Narayanan, Ankur Jain, Victor Lin, Colin Rice, Brian Rogan, Arjun Singh, Bert Tanaka, Manish Verma, Puneet Sood, Muhammad Mukarram Bin Tariq, Matt Tierney, Dzevad Trumic, Vytautas Valancius, Calvin Ying, Mahesh Kallahalla, Bikash Koley, and Amin Vahdat. Taking the Edge off with Espresso: Scale, Reliability and Programmability for Global Internet Peering. In ACM SIGCOMM, 2017. Google ScholarDigital Library
- Bahador Yeganeh, Reza Rejaie, and Walter Willinger. A View From The Edge: A Stub-AS Perspective of Traffic Localization and Its Implications. In IEEE TMA, 2017.Google ScholarCross Ref
- Hyunho Yeo, Sunghyun Do, and Dongsu Han. How will Deep Learning Change Internet Video Delivery? In ACM HotNets, 2017. Google ScholarDigital Library
Index Terms
- Leveraging interconnections for performance: the serving infrastructure of a large CDN
Recommendations
Architecture and performance models for QoS-driven effective peering of content delivery networks
Content management and delivery through P2P-based content networksThe proprietary nature of existing Content Delivery Networks (CDNs) means they are closed and do not naturally cooperate. A CDN is expected to provide high performance Internet content delivery through global coverage, which might be an obstacle for new ...
An architecture for virtual organization (VO)-based effective peering of content delivery networks
UPGRADE '07: Proceedings of the second workshop on Use of P2P, GRID and agents for the development of content networksThe proprietary nature of existing Content Delivery Networks (CDNs) means they are closed and do not naturally cooperate, resulting in "islands" of CDNs. Finding ways for distinct CDNs to coordinate and cooperate with other CDNs is necessary to achieve ...
Routing-policy aware peering for large content providers
We investigate the impact of routing policies and peering policies on the selection of peering connections for content providers.We formulate the policy-aware peering problem, and prove that the problem is NP-complete.We provide a heuristic algorithm to ...
Comments