doi:10.1016/j.peva.2004.09.003
Copyright © 2004 Elsevier B.V. All rights reserved.
Analysis of cycle stealing with switching times and thresholds
aComputer Science Department, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA
bTepper School of Business, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA
Received 5 April 2004;
revised 6 September 2004.
Available online 7 December 2004.
Abstract
We consider two processors, each serving its own M/GI/1 queue, where one of the processors (the “donor”) can help the other processor (the “beneficiary”) with its jobs, during times when the donor processor is idle. That is the beneficiary processor “steals idle cycles” from the donor processor. There is a switching time required for the donor processor to start working on the beneficiary jobs, as well as a switching back time. We also allow for threshold constraints on both the beneficiary and donor sides, whereby the decision to help is based not only on idleness but also on satisfying threshold criteria in the number of jobs.
We analyze the mean response time for the donor and beneficiary processors. Our analysis is approximate, but can be made as accurate as desired, and is validated via simulation. Results of the analysis illuminate principles on the general benefits of cycle stealing and the design of cycle stealing policies.
Keywords: Cycle stealing; Load sharing; Distributed system; Matrix analytic; Dimensionality reduction; Markov chain; Threshold
Fig. 1. A two-phase PH distribution with Coxian representation. Notice that a PH distribution is the distribution of the absorption time in a continuous time Markov chain. The i th state has exponentially-distributed sojourn time with rate μi. With probability p0i we start in the i th state, and the next state is state j with probability pij. Each state has some probability of leading to absorption. The absorption time is the sum of the times spent in each of the states.
Fig. 2. Markov chains for cycle stealing, where
, Ksw=Kba=0, and XB is exponentially distributed with rate μB. Part (a) shows a 2D-infinite Markov chain tracking both the number of beneficiary jobs and the number of donor jobs. Part (b) shows a 1D-infinite transition diagram tracking the number of beneficiary jobs and binary information (zero or ≥ 1) on the number of donor jobs, where BD is represented by a bold transition. Part (c) shows a 1D-infinite Markov chain, where BD is represented by a two-phase PH distribution with Coxian representation.
Fig. 3. A transition diagram for cycle stealing where
, Ksw=Kba=0, and XB has a two-phase PH distribution with Coxian representation (Fig. 1). BD is represented by a bold transition, but this should be replaced by a PH distribution as in Fig. 2(c).
Fig. 4. Transition diagrams used in the analysis of beneficiary mean response time in the general case. Column (a) shows a transition diagram among regions, I0, I1+, B, Ci, and Si for
for the general case of cycle stealing. Column (b) shows a transition diagram for cycle stealing where
,
, and XB and Ksw have exponential distributions. Busy periods, BD and B2D+ba, are drawn using a single transition, but this should be replaced by PH distributions as in Fig. 2(c).
Fig. 8. (a) E[K]=0; (b) E[K]=1; (c) E[K]=0; (d) E[K]=1. The mean response time for beneficiaries and donors as a function of ρB under cycle stealing and dedicated servers. In all figures XB and XD are exponential with mean 1; switching times are exponential with mean 0 or 1 as labeled.
Fig. 9. (a) E[K]=0; (b) E[K]=0; (c) E[K]=1; (d) E[K]=1. The gain of beneficiary jobs and pain of donor jobs (columns 1 and 3), and the effect of cycle stealing on the overall mean response time relative to dedicated servers (columns 2 and 4). In columns 1 and 3, solid lines delineate high/mid/low gain regions, and dashed lines delineate high/mid/low pain regions. XB has an exponential distribution; XD has an exponential distribution in rows 1–3 and a PH distribution with
in row 4. The means of XB and XD are as labeled.
Fig. 10. The mean response time for beneficiary jobs under different donor job size variability. We fix ρD at 0.5, and ρB varies from 0 to the stability condition of 1.5. The mean donor job size and beneficiary job size is 1, and switching time is zero.
Fig. 12. (a) E[K]=1; (b) E[K]=2; (c) E[K]=1; (d) E[K]=2. Graphs showing the optimal value of
and
with respect to overall mean response time, where XB and XD are exponentially distributed with mean 1.

Corresponding author.