Abstract
A key issue for good performance of worldwide distributed web services is the efficiency of the load balancing mechanism used to distribute client requests among the replicated servers. The load balancing solution allows providers to make better use of their resources, soften the need for over-provision, and help tolerate abrupt load peaks. In this paper, we propose a new load balancing solution that reduces service response times by applying a protocol for the reservation of remote resources. This protocol prevents the overload of remote servers by limiting the amount of load each server can redirect to the others. We describe a middleware that supports this protocol by managing the trade of resources among a set of servers, allowing them to share their spare capacity in a transparent way. We also present the results of a large set of simulations that encompass an exhaustive set of workload scenarios based on realistic internet traffic models.
Similar content being viewed by others
Notes
Domain Name System.
Authoritative Domain Name Server.
References
Zhang, Q., Cheng, L., Boutaba, R.: Cloud computing: state-of-the-art and research challenges. J. Internet Serv. Appl. 1(1), 7–18 (2010)
Grozev, N., Buyya, R.: Inter-cloud architectures and application brokering: taxonomy and survey. Softw. Pract. Exp. (2012). doi:10.1002/spe.2168
Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A view of cloud computing. Comm. ACM 53, 50–58 (2010)
Ali-Eldin, A., Kihl, M., Tordsson, J., Elmroth, E.: Efficient provisioning of bursty scientific workloads on the cloud using adaptive elasticity control. In: Proceedings of the 3rd Workshop on Scientific Cloud Computing Date, ScienceCloud ’12, pp. 31–40 (2012)
Barroso, L.A., Dean, J., Hölzle, U.: Web search for a planet: the google cluster architecture. Micro IEEE 23(2), 22–28 (2003)
Nakai, A., Madeira, E., Buzato, L.E.: Load balancing for internet distributed services using limited redirection rates. In: Proceedings of the 5th Latin-American Symposium on Dependable Computing (LADC’2011) (2011)
PackMime-HTTP: web traffic generation in ns-2. http://www.cs.odu.edu/~mweigle/research/netsim/packmime-nsdoc.pdf
Cao, J., Cleveland, W.S.Y.G., Jeffay, K., Smith, F.D., Weigle, M.: Stochastic models for generating synthetic http source traffic. In: Proceedings of INFOCOM 2004. Twenty-third AnnualJoint Conference of the IEEE Computer and Communications Societies (2004)
Cardwell, N., Savage, S., Anderson, T.: Modeling tcp latency. In: Proceedings of the INFOCOM 2000. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies, vol. 3, pp. 1742–1751 (2000)
Cardellini, V., Colajanni, M., Yu, P.S.: Dynamic load balancing on web-server systems. Internet Comput. IEEE 3(3), 28–39 (1999)
Liu, L., Lu, Y.: Dynamic traffic controls for web-server networks. Comput. Netw. 45(4), 523–536 (2004)
Colajanni, M., Yu, P.S., Dias, D.M.: Analysis of task assignment policies in scalable distributed web-server systems. IEEE Trans. Parallel Distrib. Syst. 9(6), 585–600 (1998)
Moon, J., Kim, M.H.: Dynamic load balancing method based on DNS for distributed web systems. In: E-Commerce and Web Technologies. EC-Web, Lecture Notes in Computer Science, vol. 3590, Springer, New York, , pp. 238–247 (2005)
Yokota, H., Kimura, S., Ebihara, Y.: A proposal of DNS-based adaptive load balancing method for mirror server systems and its implementation. In: Proceedings of the 18th International Conference on Advanced Information Networking and Applications (AINA’2004), vol. 2, pp. 208–213 (2004)
Pan, J., Hou, Y.T., Li, B.: An overview of DNS-based server selections in content distribution networks. Comput. Netw. 43(6), 695–711 (2003)
Su, A., Choffnes, D.R., Kuzmanovic, A., Bustamante, F.E.: Drafting behind akamai (travelocity-based detouring). SIGCOMM Comput. Commun. Rev. 36(4), 435–446 (2006)
Shaikh, A., Tewari, R., Agrawal, M.: On the effectiveness of DNS-based server selection. In: Proceedings of the 20th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM’2001), pp. 1801–1810 (2001)
Colajanni, M., Yu, P.S.: A performance study of robust load sharing strategies for distributed heterogeneous web server systems. IEEE Trans. Knowl. Data Eng. 14(2), 398–414 (2002)
Chatterjee, D., Tari, Z., Zomaya, A.Y.: A task-based adaptive ttl approach for web server load balancing. In: Proceedings of the 10th IEEE Symposium on Computers and Communications (ISCC’2005), pp. 877–884. IEEE Computer Society (2005)
Nakai, A., Madeira, E., Buzato, L.E.: DNS-based load balancing for web services. In: Proceedings of the 6th International Conference on Web Information Systems and Technologies (Webist’2010) (2010)
Bestavros, A., Mehrotra, S.: DNS-based internet client clustering and characterization. In: Proceedings of the IEEE International Workshop on Workload Characterization, 2001 (WWC 4), pp. 159–168. IEEE Computer Society (2001)
Krishnamurthy, B., Wang, J.: On network-aware clustering of web clients. In: Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM’00), pp. 97–110. ACM (2000)
Cardellini, V., Colajanni, M., Yu, P.S.: Request redirection algorithms for distributed web systems. IEEE Trans. Parallel Distrib. Syst. 14(4), 355–368 (2003)
Hong, Y.S., No, J.K., Kim, S.Y.: DNS-based load balancing in distributed web-server systems. In: Proceedings of The Fourth IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, 2006 and the 2006 Second International Workshop on Collaborative Computing, Integration, and Assurance (SEUS 2006/WCCIA 2006) (2006)
Ranjan, S., Knightly, E.: High-performance resource allocation and request redirection algorithms for web clusters. IEEE Trans. Parallel Distrib. Syst. 19(9), 1186–1200 (2008)
Dykes, S.G., Robbins, K.A., Jeffery, C.L.: An empirical evaluation of client-side server selection algorithms. In: Proceeding of the Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM 2000), vol. 3, pp. 1361–1370 (2000)
Conti, M., Gregori, E., Panzieri, F.: QoS-based architectures for geographically replicated web servers. Clust. Comput. 4(2), 109–120 (2001)
Conti, M., Gregori, E., Lapenna, W.: Client-side content delivery policies in replicated web services: parallel access versus single server approach. Perform. Eval. 59(2+3), 137–157 (2005)
Conti, M., Gregori, E., Lapenna, W.: Content delivery policies in replicated web services: client-side vs. server-side. Clust. Comput. 8(1), 47–60 (2005)
Mendonça, N.C., Silva, J.A.F., Anido, R.O.: Client-side selection of replicated web services: an empirical assessment. J. Syst. Softw. 81(8), 1346–1363 (2008)
Canali, C., Colajanni, M., Lancellotti, R.: Algorithms for web service selection with static and dynamic requirements. Serv. Oriented Comput. Appl. 7(1), 43–57 (2013)
Garg, A., Juneja, D.: Collective intelligence based framework for load balancing of web servers. Int. J. Adv. Technol. 3(1), 64–70 (2012)
Nishant, K., Sharma, P., Krishna, V., Gupta, C., Singh, K.P., Nitin, N., Rastogi, R.: Load balancing of nodes in cloud using ant colony optimization. In: Proceedings of the 14th International Conference onComputer Modelling and Simulation (UKSim’2012), pp. 3–8 (2012)
Nakai, A., Madeira, E., Buzato, L.E.: Improving the QoS of web services via client-based load distribution. In: Proceedings of the 29th Brazilian Symposium on Computer Networksand Distributed Systems (SBRC2011) (2011)
Gilly, K., Juiz, C., Puigjaner, R.: An up-to-date survey in web load balancing. World Wide Web 14, 105–131 (2011)
Wang, R., Butnariu, D., Rexford, J.: Openflow-based server load balancing gone wild. In: Proceedings of Workshop on Hot Topics in Management of Internet, Cloud, and Enterprise Networks and Services (Hot-Ice’11) (2011)
Andreolini, M., Casolari, S., Colajanni, M.: Autonomic request management algorithms for geographically distributed internet-based systems. In: Proceedings of the Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems (SASO’08). IEEE Computer Society, pp. 171–180 (2008)
Pathan, M., Buyya, R.: Resource discovery and request-redirection for dynamic load sharing in multi-provider peering content delivery networks. J. Netw. Comput. Appl. 32(5), 976–990 (2009)
Ardagna, D., Casolari, S., Panicucci, B.: Flexible distributed capacity allocation and load redirect algorithms for cloud systems. In: L. Liu, M. Parashar (eds.) Proceedings of the 2011 IEEE International Conference on Cloud Computing (CLOUD’2011), pp. 163–170. IEEE (2011)
Ardagna, D., Casolari, S., Colajanni, M., Panicucci, B.: Dual time-scale distributed capacity allocation and load redirect algorithms for cloud systems. J. Parallel Distrib. Comput. 72(6), 796–808 (2012)
Andreolini, M., Casolari, S., Colajanni, M.: Models and framework for supporting runtime decisions in web-based systems. ACM Trans. Web 2(3), 1–43 (2008)
RFC793: Transmission Control Protocol (1981)
Jain, R.: The Art of Computer Systems Performance Analysis, chap. 13. Wiley, New York (1991)
Devore, J.L.: Probability and Statistics for Engineering and the Sciences, 7th edn. Brooks/Cole, Cengage Learning (2009)
Sasha, D., Wilson, M.: Statistics is Easy, 2nd edn. Mogan and Claypool Publishers, San Rafael, California (2010)
Tarreau, W.: HAProxy Configuration Manual Version 1.5 (2013) http://haproxy.1wt.eu/download/1.5/doc/configuration.txt
Nakai, A.M., Madeira, E., Buzato, L.E.: Lab4WS: A testbed for web services. In: Proceedings of the 2nd IEEE International Workshop on Internet and Distributed Computing Systems (IDCS’09) (2009)
Acknowledgments
The authors would like to thank FAPESP (# 07/56423-6), CAPES, and CNPq (# 473340/2009-7) for the financial support, and Schooner, Emulab, PlanetLab, and RNP (National Education and Research Network) for the infrastructure support.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nakai, A., Madeira, E. & Buzato, L.E. On the Use of Resource Reservation for Web Services Load Balancing. J Netw Syst Manage 23, 502–538 (2015). https://doi.org/10.1007/s10922-014-9303-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10922-014-9303-y