Abstract
For model based analysis of computer and telecommunication systems an appropriate representation of arrival and service processes is very important. Especially representations that can be used in analytical or numerical solution approaches like phase type (PH) distributions or Markovian arrival processes (MAPs) are useful. This paper presents an algorithm to fit the parameters of a MAP according to measured data. The proposed algorithm is of the expectation-maximization (EM-) type and extends known approaches for the parameter fitting of PH-distributions and hidden Markov chains. It is shown that the algorithm generates MAPs which approximate traces very well and especially capture the autocorrelation in the trace. Furthermore the approach can be combined with other more efficient but less accurate fitting techniques by computing initial MAPs with those techniques and improving these MAPs with the approach presented in this paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
The internet traffic archive, http://ita.ee.lbl.gov/index.html
Asmussen, S., Nerman, O., Olsson, M.: Fitting phase type distributions via the EM algorithm. Scand. J. Statist. 23, 419–441 (1996)
Feldmann, A., Whitt, W.: Fitting mixtures of exponentials to long-tail distributions to analyze network performance models. Performance Evaluation 31, 245–258 (1998)
Fischer, W., Meier-Hellstern, K.: The Markov-modulated Poisson process (MMPP) cookbook. Performance Evaluation 18, 149–171 (1992)
Fox, B.L., Glynn, P.W.: Computing Poisson probabilities. Communications of the ACM 31(4), 440–445 (1986)
Horvath, A., Telek, M.: Markovian modeling of real data traffic: Heuristic phase type and MAP fitting of heavy tailed and fractal like samples. In: Calzarossa, M.C., Tucci, S. (eds.) Performance 2002. LNCS, vol. 2459, pp. 405–434. Springer, Heidelberg (2002)
Iversen, V.B., Nielsen, F.: Some properties of Coxian distributions with applications. In: Abu el Ata, N. (ed.) Modeling Techniques and Tools for Performance Analysis, pp. 61–66. Elsevier, Amsterdam (1986)
El Abdouni Khayari, R., Sadre, R., Haverkort, B.: Fitting world-wide web request traces with the EM-algorithm. Performance Evaluation 52, 175–191 (2003)
Klemm, A., Lindemann, C., Lohmann, M.: Modeling IP traffic using the batch Markovian arrival process. Performance Evaluation (2003) (to appear)
Lang, A., Arthur, J.L.: Parameter approximation for phase-type distributions. In: Chakravarty, S.R., Alfa, A.S. (eds.) Matrix-analytic methods in stochastic models. Lecture Notes in Pure and Applied Mathematics, pp. 151–206. Marcel Dekker, New York (1996)
Leland, W.E., Taqqu, M., Willinger, W., Wilson, D.V.: On the self-similar nature of ethernet traffic. IEEE/ACM Transactions in Networking 2, 1–15 (1994)
Neuts, M.: Algorithmic Probability: A Collection of Problems. Chapman and Hall, Boca Raton (1995)
Paxson, V., Floyd, S.: Wide-area traffic: The failure of Poisson modeling. IEEE/ACM Transactions on Networking 3, 226–244 (1995)
Riska, A., Diev, V., Smirni, E.: An EM-based technique for approximating long-tailed data sets with PH distributions. Performance Evaluation (2003) (to appear)
Riska, A., Squillante, M.S., Yu, S.Z., Liu, Z., Zhang, L.: Matrix-analytic analysis of a MAP/PH/1 queue fitted to web server data. In: Latouche, G., Taylor, P. (eds.) Matrix-Analytic Methods: Theory and Applications, pp. 335–356. World Scientific, Singapore (2002)
Ryden, T.: Parameter estimation for Markov modulated Poisson processes. Stochastic Models 10(4), 795–829 (1994)
Salamatian, K., Vaton, S.: Hidden Markov modelling for network communication channels. In: Proc. ACM Sigmetrics (2001)
Stewart, W.J.: Introduction to the numerical solution of Markov chains. Princeton University Press, Princeton (1994)
Wei, W., Wang, B., Towsley, D.: Continuous-time hidden Markov models for network performance evaluation. Performance Evaluation 49(1-4), 129–146 (2002)
Yajnik, M., Moon, S., Kurose, J., Towsley, D.: Measurement and modelling of the temporal dependence in packet loss. In: Proc. IEEE Infocom. IEEE CS-Press, Los Alamitos (1999)
Yoshihara, T., Kasahara, S., Takashi, Y.: Pratical time-scale fitting of selfsimilar traffic with markov-modulated poisson process. Telecommunication Systems 17, 185–211 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Buchholz, P. (2003). An EM-Algorithm for MAP Fitting from Real Traffic Data. In: Kemper, P., Sanders, W.H. (eds) Computer Performance Evaluation. Modelling Techniques and Tools. TOOLS 2003. Lecture Notes in Computer Science, vol 2794. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45232-4_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-45232-4_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40814-7
Online ISBN: 978-3-540-45232-4
eBook Packages: Springer Book Archive