skip to main content
10.1145/2619239.2626292acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article
Free Access

Millions of little minions: using packets for low latency network programming and visibility

Published:17 August 2014Publication History

ABSTRACT

This paper presents a practical approach to rapidly introducing new dataplane functionality into networks: End-hosts embed tiny programs into packets to actively query and manipulate a network's internal state. We show how this "tiny packet program" (TPP) interface gives end-hosts unprecedented visibility into network behavior, enabling them to work with the network to achieve a desired functionality. Our design leverages what each component does best: (a) switches forward and execute tiny packet programs (at most 5~instructions) in-band at line rate, and (b) end-hosts perform arbitrary (and easily updated) computation on network state. By implementing three different research proposals, we show that TPPs are useful. Using a hardware prototype on a NetFPGA, we show our design is feasible at a reasonable cost.

References

  1. Mohammad Alizadeh, Tom Essall, Sarang Dharmapurikar, Ramanan Vaidyanathan, Kevin Chu, Andy Fingerhut, Terry Lam, Francis Matus, Rong Pan, Navindra Yadav, and George Varghese. "CONGA: Distributed Congestion-Aware Load Balancing for Datacenters". In: SIGCOMM (2014). Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Mohammad Alizadeh, Shuang Yang, Milad Sharif, Sachin Katti, Nick McKeown, Balaji Prabhakar, and Scott Shenker. "pFabric: Minimal Near-Optimal Datacenter Transport". In: SIGCOMM (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Arista Networks -- 7100 Series Performance Results. http://www.aristanetworks.com/media/system/pdf/7148sx-rfc2889-broadcast-with-latency.pdf, Retrieved January 23, 2014.Google ScholarGoogle Scholar
  4. Eric A Baden, Mohan Kalkunte, John J Dull, and Venkateshwar Buduma. Field processor for a network device. US Patent 7,787,471. 2010.Google ScholarGoogle Scholar
  5. A.D. Berenbaum, Alexander Gibson Fraser, and Hubert Rae McLellan Jr. In-band device configuration protocol for ATM transmission convergence devices. US Patent 08/939,746. 2001.Google ScholarGoogle Scholar
  6. Pat Bosshart and Glen Gibb. Personal communication, 2014-01-27.Google ScholarGoogle Scholar
  7. Pat Bosshart, Glen Gibb, Hun-Seok Kim, George Varghese, Nick McKeown, Martin Izzard, Fernando Mujica, and Mark Horowitz. "Forwarding Metamorphosis: Fast Programmable Match-Action Processing in Hardware for SDN". In: SIGCOMM (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Sarang Dharmapurikar. Insieme Networks, Personal communication, 2013-07-18.Google ScholarGoogle Scholar
  9. Nandita Dukkipati and Nick McKeown. "Why Flow-Completion Time is the Right metric for Congestion Control". In: SIGCOMM CCR (2006). Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. ELAM Overview. http://www.cisco.com/c/en/us/support/docs/switches/nexus-7000-series-switches/116648-technote-product-00.html, Retrieved March 13, 2014.Google ScholarGoogle Scholar
  11. Dongsu Han, Robert Grandl, Aditya Akella, and Srinivasan Seshan. "FCP: a flexible transport framework for accommodating diversity". In: SIGCOMM (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Nikhil Handigol, Brandon Heller, Vimalkumar Jeyakumar, Bob Lantz, and Nick McKeown. "Reproducible network experiments using container-based emulation". In: CoNEXT (2012). Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Nikhil Handigol, Brandon Heller, Vimalkumar Jeyakumar, David Mazières, and Nick McKeown. "I Know What Your Packet Did Last Hop: Using Packet Histories to Troubleshoot Networks". In: NSDI (2014). Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Danny Yuxing Huang, Kenneth Yocum, and Alex C Snoeren. "High-Fidelity Switch Models for Software-Defined Network Emulation". In: HotSDN (2013).Google ScholarGoogle Scholar
  15. IEEE 802.1Qbb -- Priority-based Flow Control. http://www.ieee802.org/1/pages/802.1bb.html, Retrieved April 1 2014.Google ScholarGoogle Scholar
  16. Intel Fulcrum FM4000 ASIC. http://www.intel.com/content/dam/www/public/us/en/documents/datasheets/ethernet-switch-fm4000-datasheet.pdf, Retrieved July 1, 2013.Google ScholarGoogle Scholar
  17. Intel Fulcrum FM6000 ASIC. http://www.ethernetsummit.com/English/Collaterals/Proceedings/2013/20130404_S23_Ozdag.pdf, Retrieved July 1, 2013.Google ScholarGoogle Scholar
  18. Sushant Jain, Alok Kumar, Subhasree Mandal, Joon Ong, Leon Poutievski, Arjun Singh, Subbaiah Venkata, Jim Wanderer, Junlan Zhou, Min Zhu, et al. "B4: Experience with a globally-deployed software defined WAN". In: SIGCOMM (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Vimalkumar Jeyakumar, Mohammad Alizadeh, Changhoon Kim, and David Mazières. "Tiny Packet Programs for low-latency network control and monitoring". In: HotNets (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Dina Katabi, Mark Handley, and Charlie Rohrs. "Congestion control for high bandwidth-delay product networks". In: SIGCOMM (2002). Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Peyman Kazemian, Michael Chang, Hongyi Zeng, George Varghese, Nick McKeown, and Scott Whyte. "Real Time Network Policy Checking using Header Space Analysis". In: NSDI (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Frank Kelly, Gaurav Raina, and Thomas Voice. "Stability and fairness of explicit congestion control with small buffers". In: SIGCOMM CCR (2008). Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Ahmed Khurshid, Xuan Zou, Wenxuan Zhou, Matthew Caesar, and P Brighten Godfrey. "VeriFlow: Verifying Network-Wide Invariants in Real Time". In: NSDI (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Changhoon Kim. Windows Azure, Personal communication, 2014-01-26.Google ScholarGoogle Scholar
  25. Eddie Kohler, Robert Morris, Benjie Chen, John Jannotti, and M Frans Kaashoek. "The Click modular router". In: TOCS (2000). Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Guohan Lu, Chuanxiong Guo, Yulong Li, Zhiqiang Zhou, Tong Yuan, Haitao Wu, Yongqiang Xiong, Rui Gao, and Yongguang Zhang. "ServerSwitch: a programmable and high performance platform for data center networks". In: NSDI (2011). Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Nick McKeown, Tom Anderson, Hari Balakrishnan, Guru Parulkar, Larry Peterson, Jennifer Rexford, Scott Shenker, and Jonathan Turner. "OpenFlow: Enabling Innovation in Campus Networks". In: SIGCOMM CCR (2008). Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Millions of Little Minions: Using Packets for Low Latency Network Programming and Visibility (extended version). http://arxiv.org/abs/1405.7143. 2014.Google ScholarGoogle Scholar
  29. OpenFlow Switch Specification, version 1.4. https://www.opennetworking.org/images/stories/downloads/sdn-resources/onf-specifications/openflow/openflow-spec-v1.4.0.pdf, Retrieved April 1, 2014.Google ScholarGoogle Scholar
  30. Rong Pan, Balaji Prabhakar, and Ashvin Laxmikantha. "QCN: Quantized congestion notification". In: IEEE802 1 (2007).Google ScholarGoogle Scholar
  31. Ben Pfaff, Justin Pettit, Keith Amidon, Martin Casado, Teemu Koponen, and Scott Shenker. "Extending Networking into the Virtualization Layer." In: HotNets (2009).Google ScholarGoogle Scholar
  32. Mark Reitblatt, Nate Foster, Jennifer Rexford, Cole Schlesinger, and David Walker. "Abstractions for Network Update". In: SIGCOMM (2012). Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Beverly Schwartz, Alden W Jackson, W Timothy Strayer, Wenyi Zhou, R Dennis Rockwell, and Craig Partridge. "Smart packets for active networks". In: Open Architectures and Network Programming Proceedings (1999).Google ScholarGoogle ScholarCross RefCross Ref
  34. Anirudh Sivaraman, Keith Winstein, Suvinay Subramanian, and Hari Balakrishnan. "No silver bullet: extending SDN to the data plane". In: HotNets (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Ao Tang, Jiantao Wang, Steven H Low, and Mung Chiang. "Equilibrium of heterogeneous congestion control: Existence and uniqueness". In: IEEE TON (2007). Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. David L Tennenhouse and David J Wetherall. "Towards an Active Network Architecture". In: DARPA Active Nets. Conf. and Exposition (2002). Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Tilman Wolf and Jonathan S Turner. "Design Issues for High Performance Active Routers". In: IEEE Journal on Sel. Areas in Comm. (2001). Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. David Zats, Anand Padmanabha Iyer, Randy H Katz, Ion Stoica, and Amin Vahdat. "FastLane: An Agile Congestion Signaling Mechanism for Improving Datacenter Performance". In: Technical Report UCB/EECS-2013-113 (2013).Google ScholarGoogle Scholar

Index Terms

  1. Millions of little minions: using packets for low latency network programming and visibility

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SIGCOMM '14: Proceedings of the 2014 ACM conference on SIGCOMM
        August 2014
        662 pages
        ISBN:9781450328364
        DOI:10.1145/2619239

        Copyright © 2014 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 17 August 2014

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        SIGCOMM '14 Paper Acceptance Rate45of242submissions,19%Overall Acceptance Rate554of3,547submissions,16%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader