Abstract
The main contribution of this paper is to present a new sufficient condition for the subexponential asymptotics of the stationary distribution of a GI/G/1-type Markov chain with the stochastic phase transition matrix in non-boundary levels, which implies no possibility of jumps from level “infinity” to level zero. For simplicity, we call such Markov chains GI/G/1-type Markov chains without disasters because they are used to analyze semi-Markovian queues without “disasters”, which are negative customers who remove all the customers in the system (including themselves) on their arrivals. We first demonstrate the application of our main result to the stationary queue length distribution in the standard BMAP/GI/1 queue. Thereby we present new asymptotic formulas and derive the existing formulas under weaker conditions than those in the literature. We also apply our main result to the stationary queue length distributions in two queues: One is a MAP/\(\mathrm{GI}\)/1 queue with the \((a,b)\)-bulk-service rule (i.e., MAP/\(\mathrm{GI}^{(a,b)}\)/1 queue); and the other is a MAP/\(\mathrm{GI}\)/1 retrial queue with constant retrial rate.
Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.References
Aleškevičienė, A., Leipus, R., & Šiaulys, J. (2008). Tail behavior of random sums under consistent variation with applications to the compound renewal risk model. Extremes, 11(3), 261–279.
Asmussen, S. (2003). Applied probability and queues (2nd ed.). New York: Springer.
Asmussen, S., & Møller, J. R. (1999). Tail asymptotics for M/G/1 type queueing processes with subexponential increments. Queueing Systems, 33(1–3), 153–176.
Asmussen, S., Klüppelberg, C., & Sigman, K. (1999). Sampling at subexponential times, with queueing applications. Stochastic Processes and Their Applications, 79(2), 265–286.
Asmussen, S., Foss, S., & Korshunov, D. (2003). Asymptotics for sums of random variables with local subexponential behaviour. Journal of Theoretical Probability, 16(2), 489–518.
Brémaud, P. (1999). Markov chains: Gibbs fields, Monte Carlo simulation, and queues. New York: Springer.
Çinlar, E. (1975). Introduction to stochastic processes. Englewood Cliffs, NJ: Prentice-Hall.
Goldie, C. M., & Klüppelberg, C. (1998). Subexponential distributions. In R. J. Adler, R. E. Feldman, & M. S. Taqqu (Eds.), A practical guide to heavy tails: Statistical techniques and applications (pp. 435–459). Boston: Birkhäuser.
He, Q. M. (2014). Fundamentals of matrix-analytic methods. New York: Springer.
Jelenković, P. R., & Lazar, A. A. (1998). Subexponential asymptotics of a Markov-modulated random walk with queueing applications. Journal of Applied Probability, 35(2), 325–347.
Kim, B., & Kim, J. (2012). A note on the subexponential asymptotics of the stationary distribution of M/G/1 type Markov chains. European Journal of Operational Research, 220(1), 132–134.
Kimura, T., Daikoku, K., Masuyama, H., & Takahashi, Y. (2010). Light-tailed asymptotics of stationary tail probability vectors of Markov chains of M/G/1 type. Stochastic Models, 26(4), 505–548.
Kimura, T., Masuyama, H., & Takahashi, Y. (2013). Subexponential asymptotics of the stationary distributions of GI/G/1-type Markov chains. Stochastic Models, 29(2), 190–239.
Li, Q. L., & Zhao, Y. Q. (2005). Heavy-tailed asymptotics of stationary probability vectors of Markov chains of GI/G/1 type. Advances in Applied Probability, 37(2), 482–509.
Loynes, R. M. (1962). The stability of a queue with non-independent inter-arrival and service times. Mathematical Proceedings of the Cambridge Philosophical Society, 58(3), 497–520.
Lucantoni, D. M. (1991). New results on the single server queue with a batch Markovian arrival process. Stochastic Models, 7(1), 1–46.
Masuyama, H. (2011). Subexponential asymptotics of the stationary distributions of M/G/1-type Markov chains. European Journal of Operational Research, 213(3), 509–516.
Masuyama, H. (2013a). Subexponential tail equivalence of the queue length distributions of BMAP/GI/1 queues with and without retrials. Preprint, arXiv:1310.4608.
Masuyama, H. (2013b). Tail asymptotics for cumulative processes sampled at heavy-tailed random times with applications to queueing models in Markovian environments. Journal of the Operations Research Society of Japan, 56(4), 257–308.
Masuyama, H., Liu, B., & Takine, T. (2009). Subexponential asymptotics of the BMAP/GI/1 queue. Journal of the Operations Research Society of Japan, 52(4), 377–401.
Ng, K. W., Tang, Q. H., Yan, J.-A., & Yang, H. (2004). Precise large deviations for sums of random variables with consistently varying tails. Journal of Applied Probability, 41(1), 93–107.
Sigman, K. (1999). Appendix: A primer on heavy-tailed distributions. Queueing Systems, 33(1–3), 261–275.
Singh, G., Gupta, U. C., & Chaudhry, M. L. (2013). Computational analysis of bulk service queue with Markovian arrival process: MAP/R\({}^{(a, b)}\)/1 queue. Opsearch, 50(4), 582–603.
Smith, W. L. (1955). Regenerative stochastic processes. Proceedings of the Royal Society of London, Series A, 232(1188), 6–31.
Takine, T. (2000). A new recursion for the queue length distribution in the stationary BMAP/G/1 queue. Stochastic Models, 16(2), 335–341.
Takine, T. (2004). Geometric and subexponential asymptotics of Markov chains of M/G/1 type. Mathematics of Operations Research, 29(3), 624–648.
Wolff, R. W. (1989). Stochastic modeling and the theory of queues. Englewood Cliffs, NJ: Prentice Hall.
Acknowledgments
The author was supported in part by Grant-in-Aid for Scientific Research (C) of Japan Society for the Promotion of Science under Grant No. 15K00034.
Conflict of interest
The author also declares that he has no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1: Proof of Theorem 3.1
We present three lemmas for the proof of Theorem 3.1.
Lemma 8.1
Suppose that Assumption 2.1 is satisfied. If Assumption 3.1 holds for some \(Y \in {\mathcal {L}}\), then
Proof
We prove (8.1) only. As for (8.2), we can prove it in a similar way to the proof of (8.1). It follows from Lemma 3.1.3 in Kimura et al. (2013) that
where
and \(\tau \) denotes the period of an Markov additive process with kernel \(\{\varvec{A}(k);k\in {\mathbb {Z}}\}\) (see Kimura et al. 2010, Appendix B). According to (8.3), we fix \(\varepsilon >0\) arbitrarily and \(m_{*}:= m_{*} (\varepsilon )\) such that for all \(m \ge m_{*}\) and \(l = 0,1,\ldots ,\tau -1\),
Further since \(\varvec{L}(m) \le \varvec{e}\varvec{e}^{\mathrm{t}}\) for all \(m \in {\mathbb {N}}\), it follows from (3.1) and \(Y \in {\mathcal {L}}\) that
and thus
As a result, to prove (8.1) it suffices to show that for any fixed \(\varepsilon > 0\),
Indeed, letting \(\varepsilon \downarrow 0\) in (8.7) and (8.8) and using (8.4), we obtain
Substituting the above equation into (8.6), we have (8.1).
We first show that (8.7) holds. By definition, \(\{\overline{\varvec{A}}(k);k\in {\mathbb {Z}}_+\}\) is nonincreasing. We thus obtain
Substituting (8.5) into the above inequality yields
From (8.9), (3.1) and \(Y \in {\mathcal {L}}\), we have (8.7).
Next we show that (8.8) holds. Since \(\{\overline{\varvec{A}}(k)\}\) is nonincreasing, we have
Combining this with (8.5) yields
Therefore similarly to (8.7), we can obtain (8.8). \(\square \)
Lemma 8.2
Suppose that Assumption 2.1 is satisfied. If Assumption 3.1 holds for some \(Y \in {\mathcal {L}}\), then
Proof
From (2.6), we have
Further it follows from (3.1) and \(Y \in {\mathcal {L}}\) that
Thus (8.12) yields
Substituting (8.1) into (8.13), we obtain (8.10). Similarly, using (2.5), we can prove (8.11). \(\square \)
Lemma 8.3
Suppose that Assumption 2.1 is satisfied. If Assumption 3.1 holds for some \(Y \in {\mathcal {S}}\), then
Proof
It follows from (2.2) that
Applying Lemma 6 in Jelenković and Lazar (1998) to (2.2) and using (8.15) yield
From this and (8.10), we have (8.14). \(\square \)
Finally we are ready to prove Theorem 3.1. Applying Proposition 9.1 to (2.3) and using (8.11), (8.14) and (8.15), we obtain
Substituting (2.4) into the above equation yields (3.2). The proof of Theorem 3.1 is completed.
Appendix 2: Auxiliary results for the proof and applications of the main result
This section summarizes some known results, which are used for the proof and applications of the main result. We first present an asymptotic result on the convolution of matrix sequences with subexponential tails, which is utilized several times in Sects. 4–6 and Appendix 1.
Proposition 9.1
(Masuyama 2011, Proposition A.3) Let \(\{\varvec{M}(k);k\in {\mathbb {Z}}_+\}\) and \(\{\varvec{N}(k);k\in {\mathbb {Z}}_+\}\) denote finite-dimensional nonnegative matrix sequences such that their convolution \(\{\varvec{M}*\varvec{N}(k);k\in {\mathbb {Z}}_+\}\) is well-defined and \(\varvec{M}:= \sum _{k=0}^{\infty }\varvec{M}(k)\) and \(\varvec{N}:= \sum _{k=0}^{\infty }\varvec{N}(k)\) are finite. Suppose that for some random variable \(U \in {\mathcal {S}}\),
where \(\widetilde{\varvec{M}} = \widetilde{\varvec{N}} = \varvec{O}\) is allowed. We then have
Next we describe some of the asymptotic results on a (regenerative) cumulative process sampled at heavy-tailed random times (for details, see Masuyama 2013b), which are used in Sects. 4, 5 and 6.
Let \(\{B(t);t\in {\mathbb {R}}_+\}\) denote a stochastic process on \( (-\infty ,\infty )\), where \(|B(0)| < \infty \) with probability one. We assume that there exist regenerative points \(0 \le \tau _0 < \tau _1 < \tau _2 < \cdots \) such that for any \(n \in {\mathbb {Z}}_+\), \(\{B(t+\tau _n)-B(\tau _n); t \ge 0\}\) is stochastically equivalent to \(\{B(t+\tau _0)-B(\tau _0); t \ge 0\}\) and is independent of \(\{B(u);0 \le u < \tau _n\}\). The process \(\{B(t);t\in {\mathbb {R}}_+\}\) is called (regenerative) cumulative process, which is introduced by Smith (1955).
Let \(\varDelta \tau _0 = \tau _0\) and \(\varDelta \tau _n = \tau _n-\tau _{n-1}\) for \(n\in {\mathbb {N}}\). Let
It then follows that \(\varDelta B_n^{*} \ge \varDelta B_n\) for \(n\in {\mathbb {Z}}_+\) and that \(\{\varDelta \tau _n;n\in {\mathbb {N}}\}\) (resp. \(\{\varDelta B_n;n\in {\mathbb {N}}\}\) and \(\{\varDelta B_n^{*};n\in {\mathbb {N}}\}\)) is a sequence of i.i.d. random variables, which is independent of \(\varDelta \tau _0\) (resp. \(\varDelta B_0\) and \(\varDelta B_0^{*}\)).
Remark 9.1
The counting process \(\{N(t);t \in {\mathbb {R}}_+\}\) of BMAP \(\{\varvec{C},\varvec{D}(1),\varvec{D}(2),\ldots \}\) is a (regenerative) cumulative process such that regenerative points are hitting times to any fixed background state and the regenerative cycle follows a phase-type distribution (see Eqs. (3.3)–(3.5) in Masuyama 2013b).
We now assume that
We then have the following results.
Proposition 9.2
(Masuyama 2013b, Theorem 3.3) Suppose that \(T\) is a nonnegative random variable independent of \(\{B(t);t\in {\mathbb {R}}_+\}\). Further suppose that (i) \(T \in {\mathcal {L}}^{\mu }\) for some \(\mu \ge 2\); (ii) \({\mathsf {E}}[(\varDelta \tau _1)^2] < \infty \) and \({\mathsf {E}}[(\varDelta B_1)^2] < \infty \); and (iii) \({\mathsf {E}}[\exp \{Q(\varDelta B_n^{*})\}] < \infty \) (\(n=0,1\)) for some cumulative hazard function \(Q \in {\mathcal {SC}}\) such that \(x^{1/\mu } = O(Q(x))\). We then have \({\mathsf {P}}(B(T) > bx) \mathop {\sim }\limits ^{x} {\mathsf {P}}(T > x)\).
Corollary 9.1
Suppose that \(T\) is a nonnegative random variable independent of \(\{(N(t),J(t));t\in {\mathbb {R}}_+\}\), where \(\{N(t)\}\) and \(\{J(t)\}\) denote the counting process and the background Markov chain, respectively, of BMAP \(\{\varvec{C},\varvec{D}(1),\varvec{D}(2),\ldots \}\) introduced in Sect. 4.1. Suppose that (i) \(T \in {\mathcal {L}}^{\mu }\) for some \(\mu \ge 2\); and (ii) \(\sum _{k=1}^{\infty } \exp \{Q(k)\} \varvec{D}(k) < \infty \) (\(n=0,1\)) for some cumulative hazard function \(Q \in {\mathcal {SC}}\) such that \(x^{1/\mu } = O(Q(x))\). We then have \({\mathsf {P}}(N(T) > k \mid J(0) = i) \mathop {\sim }\limits ^{k} {\mathsf {P}}(T > k/\lambda )\) for \(i \in {\mathbb {M}}\).
Proof
It suffices to prove that conditions (i)–(iii) of Proposition 9.2 are satisfied. For this purpose, fix \(B(t) = N(t)\) for \(t\in {\mathbb {R}}_+\) and \(J(0) = i \in {\mathbb {M}}\). Let \(\tau _0 = 0\) and \(\tau _n\) (\(n \in {\mathbb {N}}\)) denote the \(n\)th hitting time of state \(i\). Clearly, \(\varDelta B_0^{*} = 0\) and thus \({\mathsf {E}}[\exp \{Q(\varDelta B_0^{*})\}] < \infty \).
Since the regenerative cycle follows a phase-type distribution (see Remark 9.1), we have \({\mathsf {E}}[(\varDelta \tau _1)^2] < \infty \). Further since \(\{B(t)=N(t);t\in {\mathbb {R}}_+\}\) is nondecreasing, we have \(\varDelta B_n^{*} = \varDelta B_n\) for all \(n \in {\mathbb {Z}}_+\). Therefore it follows from the renewal reward theorem (see, e.g., Wolff 1989, Chapter 2, Theorem 2) that
which lead to \({\mathsf {E}}[\exp \{Q(\varDelta B_1^{*})\}] < \infty \) and thus \({\mathsf {E}}[(\varDelta B_1)^2] < \infty \) (see Remark 2.4 in Masuyama 2013b). As a result, conditions (i)–(iii) of Proposition 9.2 are satisfied. \(\square \)
We also have a result similar to Corollary 9.1:
Proposition 9.3
(Masuyama (2013b), Corollary 3.1) Suppose that \(T\) is a nonnegative random variable independent of \(\{(N(t),J(t));t\in {\mathbb {R}}_+\}\), where \(\{N(t)\}\) and \(\{J(t)\}\) denote the counting process and the background Markov chain, respectively, of BMAP \(\{\varvec{C},\varvec{D}(1),\varvec{D}(2),\ldots \}\) introduced in Sect. 4.1. Suppose that (i) \(T \in {\mathcal {C}}\); (ii) \({\mathsf {E}}[T] < \infty \); and (iii) \(\overline{\varvec{D}}(k)= o( {\mathsf {P}}(T > k) )\). We then have \({\mathsf {P}}(N(T) > k \mid J(0) = i) \mathop {\sim }\limits ^{k} {\mathsf {P}}(T > k/\lambda )\) for \(i \in {\mathbb {M}}\).
Remark 9.2
According to the original statement of Corollary 3.1 in Masuyama (2013b), we have \({\mathsf {P}}(N(T) > k) \mathop {\sim }\limits ^{k} {\mathsf {P}}(T > k/\lambda )\). In fact, the statement of this corollary holds for any initial distribution of the background Markov chain, which follows from Theorem 3.5 in Masuyama (2013b). Thus we can obtain the asymptotic formula conditioned on the initial background state, as stated in Proposition 9.3.
Rights and permissions
About this article
Cite this article
Masuyama, H. A sufficient condition for the subexponential asymptotics of GI/G/1-type Markov chains with queueing applications. Ann Oper Res 247, 65–95 (2016). https://doi.org/10.1007/s10479-015-1893-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10479-015-1893-6
Keywords
- Subexponential asymptotics
- GI/G/1-type Markov chain
- Disaster
- BMAP/GI/1 queue
- Bulk-service queue
- Retrial queue