Theodore Faber
Abstract
This paper describes methods of optimizing a client/server network file system to advantage of high bandwidth local area networks in a conventional distributed computing environment. The environment contains hardware that removes network and disk bandwidth bottlenecks. The remaining bottlenecks at clients include excessive context switching, inefficient data translation, and cumbersome data encapsulation methods. When these are removed, the null-write performance of a current implementation of Sun's Network File System improves by 30%. A prototype system including a high speed RAM disk demonstrates an 18% improvement in overall write throughput. The prototype system fully utilizes the available peripheral bandwidth of the server.
- 1. Russel Sandberg, David Goldberg, Steve Kleiman, Dan Walsh, and Bob Lyon, "Design and Implementation of the Sun Network File System," Proceedings of the USENIX Conference, pp. 119-130, USENIX (June 1985).Google Scholar
- 2. Sun Microsystems, Inc., "Network Filesystem Specification," RFC-1094 (March 1, 1989).Google Scholar
- 3. Robert Felderman, Annette DeSchon, Danny Cohen, and Gregory Finn, "Atomic: A High Speed Local Communication Architecture," Journal of High Speed Networks, 3, pp. 1-29 (1994).Google ScholarDigital Library
- 4. R. Srinivasan, "XDR: External Data Representation Standard," RFC-1832 (August 1995).Google Scholar
- 5. Sun Microsystems, Inc., NFS: Network File System Version 3 Protocol Specification, Sun Microsystems, Inc., Mountain View, CA (February 16, 1994).Google Scholar
- 6. R. Macklem, "Lessons Learned from Tuning the 4.3BSD Reno Implementation of the NFS Protocol," Proceedings of the Winter USENIX Conference, pp. 53-64, USENIX, Dallas, TX (January 1991).Google Scholar
- 7. Gregory R. Ganger and M. Franz Kaashoek, "Embedded Inodes and Explicit Grouping: Exploiting Disk Bandwidth for Small Files," USENIX 1997 Annual Technical Conference, pp. 1-18, USENIX, Anaheim, CA (January 6-10, 1997). Google ScholarDigital Library
- 8. Myricom, Inc., Nannette J. Boden, Danny Cohen, Robert E. Felderman, Alan E Kulawik, Charles L. Seitz, Jakov N. Selovic, and Wen-King Su, "Myrinet: A Gigabit-per-second Local Area Network," IEEE Micro, pp. 29-36, IEEE (February 1995). Google ScholarDigital Library
- 9. Sun Microsystems, Inc., "Remote Procedure Call Specification," RFC-1057 (June 1, 1988).Google Scholar
- 10. Richard P. Draves, Brian N. Bershad, Richard F. Rashid, and Randall W. Dean, "Using Continuations to Implement Thread Management and Communication in Operating Systems," Proceedings of the 13th Symposium on Operating System Principles, pp. 122-136, ACM (October 1991). Google ScholarDigital Library
- 11. David A. Patterson, Garth Gibson, and Randy H. Katz, "A Case for Redundant Arrays of Inexpensive Disks (RAID)," Proceedings of the ACM SIGMOD, pp. 109-116 (June 1988). Google ScholarDigital Library
- 12. Larry McVoy, NFS/bds - NFS goes to the gym (December 1995).Google Scholar
- 13. Michael N. Nelson, Brent B. Welch, and John K. Ousterhout, "Caching in the Sprite Network File System," ACM Transactions on Operating Systems, 6, 1, pp. 134-154 (February 1988). Google ScholarDigital Library
- 14. Michael N. Nelson and Yousef A. Khalidi, "Extensible File Systems in Spring," Proceedings of the Fourteenth ACM Symposium on Operating Systems Principles, pp. 1-14, ACM, Asheville, NC (December 1993). Google ScholarDigital Library
- 15. Richard G. Guy, John S. Heidemann, Wai Mak, Thomas W. Page, Jr., Gerald J. Popek, and Dieter Rothmeier, "Implementation of the Ficus Replicated File System," USENIX Conference Proceeding, pp. 63-71, USENIX (June 1990).Google Scholar
- 16. John F. Karpovich, Andrew S. Grimshaw, and James C. French, "Extensible File Systems (ELFS): An Object-Oriented Approach to High Performance File I/O," Proceedings of the Ninth Annual Conference on Object-Oriented Programming Systems, Langauges and Applications (October 1994). Google ScholarDigital Library
- 17. J. Hartman and J. Osterhout, "The Zebra Striped Network File System," Proceedings of the Fourteenth ACM Symposium on Operating Systems Principles, pp. 29-36, ACM, Asheville, NC (December 1993). Google ScholarDigital Library
- 18. Thomas E. Anderson, Michael D. Dahlin, Jeanna M. Neefe, David A, Patterson, Drew S. Roselli, and Randolph Y. Wang, "Serverless Network File Systems," Proceedings of the 15th Symposium on Operating Systems Principles, pp. 109-126, ACM, Copper Mountain Resort, Colorado (December 1995). Google ScholarDigital Library
Index Terms
- Optimizing throughout in a workstation-based network file system over a high bandwidth local area network
Recommendations
The Zebra striped network file system
Zebra is a network file system that increases throughput by striping the file data across multiple servers. Rather than striping each file separately, Zebra forms all the new data from each client into a single stream, which it then stripes using an ...
The Zebra striped network file system
Zebra is a network file system that increases throughput by striping file data across multiple servers. Rather than striping each file separately, Zebra forms all the new data from each client into a single stream, which it then stripes using an ...
Comments