Dependence ordering for Markov processes on partially ordered spaces



Journal of Applied Probability

Dependence ordering for Markov processes on partially ordered spaces

Hans Daduna and Ryszard Szekli

Source: J. Appl. Probab. Volume 43, Number 3 (2006), 793-814.

Abstract

We compare dependence in stochastically monotone Markov processes with partially ordered Polish state spaces using the concordance and supermodular orders. We show necessary and sufficient conditions for the concordance order to hold both in terms of the one-step transition probabilities for discrete-time processes and in terms of the corresponding infinitesimal generators for continuous-time processes. We give examples showing that a stochastic monotonicity assumption is not necessary for such orderings. We indicate relations between dependence orderings and, variously, the asymptotic variance-reduction effect in Monte Carlo Markov chains, Cheeger constants, and positive dependence for Markov processes.

Primary Subjects: 60J25, 60K25
Keywords: Concordance order; supermodular order; stochastic monotonicity; monotone Markov process; dependence order; Cheeger constant; association; MCMC

Full-text: Access denied (no subscription detected)

We're sorry, but we are unable to provide you with the full text of this article because we are not able to identify you as a subscriber.
If you have a personal subscription to this journal, then please login. If you are already logged in, then you may need to update your profile to register your subscription. Read more about accessing full-text
Alternatively, the document is available for a cost of $6. Select the "buy article" button below to purchase this document from a secured VeriSign, Inc. site.
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.jap/1158784947
Digital Object Identifier: doi:10.1239/jap/1158784947
Mathematical Reviews number (MathSciNet): MR2274801

References

Alon, N. and Millman, V. D. (1985). $\lambda_1$, isoperimetric inequalities for graphs, and superconcentrators. J. Combinatorial Theory B 38, 73--88.
Mathematical Reviews (MathSciNet): MR782626
Digital Object Identifier: doi:10.1016/0095-8956(85)90092-9
Chen, M.-F. (2004). From Markov Chains to Non-Equilibrium Particle Systems. World Scientific, Singapore.
Mathematical Reviews (MathSciNet): MR2091955
Zentralblatt MATH: 1078.60003
Chen, M.-F. (2005). Eigenvalues, Inequalities and Ergodic Theory. Springer, London.
Mathematical Reviews (MathSciNet): MR2105651
Zentralblatt MATH: 1079.60005
Chen, M.-F. and Wang, F.-Y. (1993). On order preservation and positive correlations for multidimensional diffusion processes. Prob. Theory Relat. Fields 95, 421--428.
Mathematical Reviews (MathSciNet): MR1213199
Digital Object Identifier: doi:10.1007/BF01192172
Chen, M.-F. and Wang, F.-Y. (2000). Cheeger's inequalities for general symmetric forms and existence criteria for spectral gap. Ann. Prob. 28, 235--257.
Mathematical Reviews (MathSciNet): MR1756004
Digital Object Identifier: doi:10.1214/aop/1019160118
Project Euclid: euclid.aop/1019160118
Christofides, T. C. and Vaggelatou, E. (2004). A connection between supermodular ordering and positive/negative association. J. Multivariate Anal. 88, 138--151.
Mathematical Reviews (MathSciNet): MR2021866
Digital Object Identifier: doi:10.1016/S0047-259X(03)00064-2
Daduna, H. and Szekli, R. (1995). Dependencies in Markovian networks. Adv. Appl. Prob. 27, 226--254.
Mathematical Reviews (MathSciNet): MR1315587
Digital Object Identifier: doi:10.2307/1428105
Daley, D. J. (1968). The correlation structure of the output process of some single server queueing systems. Ann. Math. Statist. 39, 1007--1019.
Mathematical Reviews (MathSciNet): MR224179
Digital Object Identifier: doi:10.1214/aoms/1177698333
Project Euclid: euclid.aoms/1177698333
Diaconis, P. and Stroock, D. (1991). Geometric bounds for eigenvalues of Markov chains. Ann. Appl. Prob. 1, 36--61.
Mathematical Reviews (MathSciNet): MR1097463
Digital Object Identifier: doi:10.1214/aoap/1177005980
Project Euclid: euclid.aoap/1177005980
Griffeath, D. (1979). Additive and Cancellative Interacting Particle Systems (Lecture Notes Math. 724). Springer, Berlin.
Mathematical Reviews (MathSciNet): MR538077
Zentralblatt MATH: 0412.60095
Hardy, G. H., Littlewood, J. E. and Polya, G. (1952). Inequalities, 2nd edn. Cambridge University Press.
Mathematical Reviews (MathSciNet): MR46395
Zentralblatt MATH: 0047.05302
Hoeffding, W. (1940). Maßstabinvariante Korrelationstheorie. Schr. Math. Inst. Inst. Angew. Math. Univ. Berlin 5, 179--233.
Hu, T. and Pan, X. (2000). Comparisons of dependence for stationary Markov processes. Prob. Eng. Inf. Sci. 14, 299--315.
Mathematical Reviews (MathSciNet): MR1765261
Hu, T., Müller, A. and Scarsini, M. (2004). Some counterexamples in positive dependence. J. Statist. Planning Infer. 124, 153--158.
Mathematical Reviews (MathSciNet): MR2066232
Digital Object Identifier: doi:10.1016/S0378-3758(03)00201-5
Joe, H. (1990). Multivariate concordance. J. Multivariate Anal. 35, 12--30.
Mathematical Reviews (MathSciNet): MR1084939
Digital Object Identifier: doi:10.1016/0047-259X(90)90013-8
Joe, H. (1997). Multivariate Models and Dependence Concepts. Chapman and Hall, London.
Mathematical Reviews (MathSciNet): MR1462613
Zentralblatt MATH: 0990.62517
Keilson, J. and Kester, A. (1977). Monotone matrices and monotone Markov processes. Stoch. Process. Appl. 5, 231--241.
Mathematical Reviews (MathSciNet): MR458596
Digital Object Identifier: doi:10.1016/0304-4149(77)90033-3
Kulik, R. and Szekli, R. (2004). Dependence orderings for some functionals of multivariate point processes. J. Multivariate Anal. 92, 145--173.
Mathematical Reviews (MathSciNet): MR2102249
Digital Object Identifier: doi:10.1016/j.jmva.2003.09.005
Li, H. and Xu, S. H. (2000). Stochastic bounds and dependence properties of survival times in a multicomponent shock model. J. Appl. Prob. 37, 1020--1043.
Mathematical Reviews (MathSciNet): MR1808866
Digital Object Identifier: doi:10.1239/jap/1014843081
Project Euclid: euclid.jap/1014843081
Liggett, T. M. (1985). Interacting Particle Systems. Springer, New York.
Mathematical Reviews (MathSciNet): MR776231
Zentralblatt MATH: 0559.60078
Lindqvist, B. H. (1988). Association of probability measures. J. Multivariate Anal. 26, 111--132.
Mathematical Reviews (MathSciNet): MR963827
Digital Object Identifier: doi:10.1016/0047-259X(88)90076-0
Lorentz, G. G. (1953). An inequality for rearrangements. Amer. Math. Monthly 60, 176--179.
Mathematical Reviews (MathSciNet): MR52476
Digital Object Identifier: doi:10.2307/2307574
Massey, W. A. (1987). Stochastic ordering for Markov processes on partially ordered spaces. Math. Operat. Res. 12, 350--367.
Mathematical Reviews (MathSciNet): MR888982
Mira, A. (2001). Efficiency increasing and stationarity preserving probability mass transfers for MCMC. Statist. Prob. Lett. 54, 405--411.
Mathematical Reviews (MathSciNet): MR1861386
Mira, A. and Geyer, C. J. (1999). Ordering Monte Carlo Markov chains. Submitted.
Müller, A. and Stoyan, D. (2002). Comparison Methods for Stochastic Models and Risks. John Wiley, Chichester.
Mathematical Reviews (MathSciNet): MR1889865
Peskun, P. H. (1973). Optimum Monte Carlo sampling using Markov chains. Biometrika 60, 607--612.
Mathematical Reviews (MathSciNet): MR362823
Zentralblatt MATH: 0271.62041
Digital Object Identifier: doi:10.1093/biomet/60.3.607
Rüschendorf, L. (1980). Inequalities for the expectation of $\delta$ monotone functions. Z. Wahrscheinlichkeitsth. 54, 341--349.
Mathematical Reviews (MathSciNet): MR602516
Rüschendorf, L. (2004). Comparison of multivariate risks and positive dependence. Adv. Appl. Prob. 41, 391--406.
Mathematical Reviews (MathSciNet): MR2052580
Digital Object Identifier: doi:10.1239/jap/1082999074
Project Euclid: euclid.jap/1082999074
Shaked, M. and Shanthikumar, J. G. (1994). Stochastic Orders and Their Applications. Academic Press, Boston, MA.
Mathematical Reviews (MathSciNet): MR1278322
Zentralblatt MATH: 0806.62009
Szekli, R. (1995). Stochastic Ordering and Dependence in Applied Probability (Lecture Notes Statist. 97). Springer, New York.
Mathematical Reviews (MathSciNet): MR1329324
Zentralblatt MATH: 0815.60017
Szekli, R., Disney, R. L. and Hur, S. (1994). MR/GI/1 queues with positively correlated arrival streams. J. Appl. Prob. 31, 497--514.
Mathematical Reviews (MathSciNet): MR1274804
Digital Object Identifier: doi:10.2307/3215041
Tchen, A. (1980). Inequalities for distributions with given marginals. Ann. Prob. 8, 811--827.
Mathematical Reviews (MathSciNet): MR577318
Digital Object Identifier: doi:10.1214/aop/1176994668
Project Euclid: euclid.aop/1176994668
Tierney, L. (1998). A note on Metropolis--Hastings kernels for general state spaces. Ann. Appl. Prob. 8, 1--9.
Mathematical Reviews (MathSciNet): MR1620401
Digital Object Identifier: doi:10.1214/aoap/1027961031
Project Euclid: euclid.aoap/1027961031
Van Doorn, E. (1981). Stochastic Monotonicity of Birth--Death Processes (Lecture Notes Statist. 4). Springer, Berlin.
Whitt, W. (1976). Bivariate distributions with given marginals. Ann. Statist. 4, 1280--1289.
Mathematical Reviews (MathSciNet): MR426099
Digital Object Identifier: doi:10.1214/aos/1176343660
Project Euclid: euclid.aos/1176343660

2008 © Applied Probability Trust