Alec Wolman
Anna Karlin
ABSTRACT
While algorithms for cooperative proxy caching have been widely studied, little is understood about cooperative-caching performance in the large-scale World Wide Web environment. This paper uses both trace-based analysis and analytic modelling to show the potential advantages and drawbacks of inter-proxy cooperation. With our traces, we evaluate quantitatively the performance-improvement potential of cooperation between 200 small-organization proxies within a university environment, and between two large-organization proxies handling 23,000 and 60,000 clients, respectively. With our model, we extend beyond these populations to project cooperative caching behavior in regions with millions of clients. Overall, we demonstrate that cooperative caching has performance benefits only within limited population bounds. We also use our model to examine the implications of future trends in Web-access behavior and traffic.
- 1.J. Almeida, V. Almeida, and D. Yates. Measuring the behavior of a World Wide Web server. Technical Report 96-025, Boston University, Oct. 1996. Google Scholar
Digital Library
- 2.V. Almeida, A. Bestavros, M. Crovella, and A. de- Oliveira. Characterizing reference locality in the WWW. Technical Report 96-011, Boston University, June 1996. Google ScholarDigital Library
- 3.T. E. Anderson, M. D. Dahlin, J. M. Neefe, D. A. Patterson, D. S. Roselli, and R. Y. Wang. Serverless network file systems. ACM Trans. on Computer Systems, 14(1):41-79, February 1996. Google ScholarDigital Library
- 4.M.F. Arlitt and C. L. Williamson. Web server workload characterization: The search for invariants. In Prec. of the ACM SIGMETRICS '96 Conf., pages 126-137, May 1996. Google ScholarDigital Library
- 5.L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web caching and Zipf-like distributions: Evidence and implications. In Prec. of IEEE INFOCOM '99, pages 126-134, March 1999.Google ScholarCross Ref
- 6.R. Caceres, F. Douglis, A. Feldmann, G. Glass, and M. Rabinovich. Web proxy caching: The devil is in the details. In Workshop on Internet Server Performance, pages 111-118, June 1998.Google ScholarDigital Library
- 7.P. Cao. Characterization of Web proxy traffic and Wisconsin proxy benchmark 2.0. http://www, cs.wisc.edu/ ~cao/w3c-webchar-position, Nov. 1998.Google Scholar
- 8.P. Cao and S. Irani. Cost-aware WWW proxy caching algorithms. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 193-206, Dec. 1997. Google ScholarDigital Library
- 9.A. Chankhunthod, P. B. Danzig, C. Neerdaels, M. F. Schwartz, and K. J. Worrell. A hierarchical Intemet object cache. In Prec. of the 1996 USENIX Technical Conf., pages 153-163, January 1996. Google ScholarDigital Library
- 10.M. E. Crovella and A. Bestavros. Self-similarity in World Wide Web traffic: Evidence and possible causes. In Prec. of the ACM SIGMETRICS '96 Conf., pages 160-169, May 1996. Google ScholarDigital Library
- 11.C. R. Cunha, A. Bestavros, and M. E. Crovella. Characteristics of WWW client-based traces. Technical Report BU-CS-95-010, Boston University, July 1995. Google ScholarDigital Library
- 12.P. Danzig. NetCache architecture and deployment. In Prec. of the 3rd Int. WWW Caching Workshop, http ://wwwc ache.j a. net/events/workshop/01/NetCache- 3_2.pdf, June 1998.Google ScholarDigital Library
- 13.F. Douglis, A. Feldmann, B. Krishnamurthy, and J. Mogul. Rate of change and other metrics: a live study of the World Wide Web. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 147-158, Dec. 1997. Google ScholarDigital Library
- 14.B. Duska, D. Marwood, and M. J. Feeley. The measured access characteristics of World Wide Web client proxy caches. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 23-36, Dec. 1997. Google ScholarDigital Library
- 15.EMC Corporation, http://www'emc'c~m/pr~ducts/enterprise-st~rage-systems/systems'htm' Symmetrix 3000 and 5000 Enterprise Storage Systems Product Description Guide, 1999.Google Scholar
- 16.L. Fan, P. Cao, J. Almeida, and A. Z. Broder. Summary cache: A scalable wide-area web cache sharing protocol. In Prec. ef ACM SIGCOMM '98, August 1998. Google ScholarDigital Library
- 17.M. J. Feeley, W. E. Morgan, F. H. Pighin, A. R. Karlin, H. M. Levy, and C. A. Thekkath. Implementing global memory management in a workstation cluster. In Prec. of the 15th ACM Syrup. on Operating Systems Principles, pages 201-212, Dec. 1995. Google ScholarDigital Library
- 18.A. Feldmann, R. Caceres, F. Douglis, G. Glass, and M. Rabinovich. Performance of web proxy caching in heterogeneous bandwidth environments. In Prec. of IEEE INFOCOM ' 99, March 1999.Google Scholar
- 19.S. Glassman. A caching relay for the World Wide Web. In Prec. First Int. World Wide Web Conf., pages 60-76, May 1994. Google ScholarDigital Library
- 20.S. D. Gribble and E. A. Brewer. System design issues for Internet middleware services: Deductions from a large client trace. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 207-218, Dec. 1997. Google ScholarDigital Library
- 21.D. Karger, T. Leighton, D. Lewin, and A. Sherman. Web caching with consistent hashing. In Prec. of the 8th Int. World Wide Web Conf., May 1999. Google ScholarDigital Library
- 22.P. Krishnan and B. Sugla. Utility of co-operating Web proxy caches. In Prec. Seventh Int. World Wide Web Conf., April 1998. Google ScholarDigital Library
- 23.T. M. Kroeger, D. D. E. Long, and J. C. Mogul. Exploring the bounds of Web latency reduction from caching and prefetching. In Prec. of the 1 st USENIX Syrup. on Internet Technologies and Systems, pages 13-22, Dec. 1997. Google ScholarDigital Library
- 24.T. M. Kroeger, J. C. Mogul, and C. Maltzahn. Digital's Web proxy traces, ftp://ftp.digital.com/pub/DEC/ traces/proxy/webtraces.html, August 1996.Google Scholar
- 25.S. R. Lawrence and C. L. Giles. Accessibility of information on the Web. Nature, 400(6740):107-109, July 1999.Google ScholarCross Ref
- 26.B. A. Mah. An empirical model of HTTP network traffic. In Prec. of IEEE INFOCOM '97, pages 592-600, April 1997. Google ScholarDigital Library
- 27.J.-M. Menaud, V. Issarny, and M. Banatre. A new protocol for efficient transversal Web caching. In Prec. ef the 12th Int. Syrup. on Distributed Computing, pages 288-302, September 1998. Google ScholarDigital Library
- 28.S. Michel, K. Nguyen, A. Rosenstein, L. Zhang, S. Floyd, and V. Jacobson. Adaptive Web Caching: Towards a New Global Caching Architecture. Computer Networks and ISDN Systems, 30(22-23):2169- 2177, Nov. 1998. Google ScholarDigital Library
- 29.J. C. Mogul. Network behavior of a busy web server and its clients. Technical Report 95/5, DEC Western Research Laboratory, Oct. 1995.Google Scholar
- 30.M. Rabinovich, J. Chase, and S. Gadde. Not all hits are created equal: Cooperative proxy caching over a wide area network. In Prec. of the 3rd Int. WWW Caching Workshop, June 1998.Google ScholarDigital Library
- 31.A. Rousskov, D. Wessels, and G. Chisholm. The first ircache web cache bake-off. Technical report, National Laboratory for Applied Network Research, April 1999.Google Scholar
- 32.Squid internet object cache, http://squid.nlanr.net.Google Scholar
- 33.R. Tewari, M. Dahlin, H. Vin, and J. Kay. Design considerations for distributed caching on the Internet. In The 19th IEEE Int. Conf. on Distributed Computing Systems, May 1999. Google ScholarDigital Library
- 34.J. Touch. The LSAM proxy cache - a multicast distributed virtual cache. In Prec. of the 3rd Int. WWW Caching Workshop, June 1998.Google ScholarDigital Library
- 35.V. Valloppillil and K. W. Ross. Cache array routing protocol v l.0. ftp://ftp.isi.edu/internet-drafts/draftvinod-carp-v 1-03.txt, Feb. 1998.Google Scholar
- 36.C. E. Wills and M. Mikhailov. Towards a better understanding of Web resources and server responses for improved caching. In Prec. of the Eighth Int. World Wide Web Conf., pages 153-165, May 1999. Google ScholarDigital Library
- 37.A. Wolman, G. Voelker, N. Sharma, N. Cardwell, M. Brown, T. Landray, D. Pinnel, A. Karlin, and H. Levy. Organization-based analysis of Web-object sharing and caching. In Prec. ef the 2nd USENIX Syrup. on Internet Technologies and Systems, Oct. 1999. Google ScholarDigital Library
Index Terms
- On the scale and performance of cooperative Web proxy caching
Recommendations
On the scale and performance of cooperative Web proxy caching
While algorithms for cooperative proxy caching have been widely studied, little is understood about cooperative-caching performance in the large-scale World Wide Web environment. This paper uses both trace-based analysis and analytic modelling to show ...
Cooperative Caching for Chip Multiprocessors
This paper presents CMP Cooperative Caching, a unified framework to manage a CMP's aggregate on-chip cache resources. Cooperative caching combines the strengths of private and shared cache organizations by forming an aggregate "shared" cache through ...
Collaborative Web caching based on proxy affinities
Special issue on proceedings of ACM SIGMETRICS 2000With the exponential growth of hosts and traffic workloads on the Internet, collaborative web caching has been recognized as an efficient solution to alleviate web page server bottlenecks and reduce traffic. However, cache discovery, i.e., locating ...
Comments