Summary
It is shown that, for any, n x n stochastic matrix \(A{\text{ = (}}a_{ij} {\text{) }}\user1{\ddag } (\delta _{ij} )\) which can be imbedded in a continuous time Markov chain, there exist distinct indices i, j such that for all k
and likewise distinct indices i′, j′ such that, for all k,
The present proof of this does not use Kingman and Williams' characterization of the patterns of zero entries which can occur in imbeddable stochastic matrices.
In the analogous doubly stochastic situation the same result holds, even with “implies” replaced by “if and only if”. The main result is that the set ℱ of imbeddable stochastic (or doubly stochastic) matrices is a Lipschitz manifold with boundary. For any Markov chain leading to a matrix on the boundary of ℱ the associated intensity matrix in the Kolmogorov differential equation has, at almost every time, at least one zero entry.
Article PDF
Similar content being viewed by others
References
Berg, C., Christensen, J.P.R, Ressel, P.: Harmonic analysis on semigroups. New York Heidelberg Berlin: Springer 1984
Elfving, G.: Zur Theorie der Markoffschen Ketten. Acta Soc. Sci. Fennicæ, N. Ser. A2, 1–17 (1937)
Frydman, H.: The embedding problem for Markov chains with 3 states. Proc. Cambridge Philos. Soc. (Math) 87, 285–294 (1980)
Frydman, H.: A structure of the bang-bang representation for 3x3 embeddable matrices Z. Wahrscheinlichkeitstheor. Verw. Geb 53, 305–316 (1980)
Frydman, H.: A structure of doubly stochastic Markov chains. (Manuscript, 1984)
Fuglede, B.: Continuous selection in a convexity theorem of Minkowski. Expo. Math. 4, 163–178 (1986)
Fuglede, B.: A product representation of stochastic matrices with nearly equal rows. Preprint, Copenhagen (1985)
Fuglede, B.: A product representation of bistochastic matrices of nearly equal entries. Preprint, Copenhagen (1985)
Goodman, G.: An intrinsic time for non-stationary finite Markov chains. Z. Wahrscheinlichkeitstheor. Verw. Geb. 16, 165–180 (1970)
Goodman, G.: The characterization of mixtures of non-stationary Markov transition matrices. Expo. Math. 1, 283–288 (1983)
Johansen, S.: A central limit theorem for finite semigroups and its application to the imbedding problem for finite state Markov chains. Z. Wahrscheinlichkeitstheor. Verw. Geb. 26, 171–190 (1973)
Johansen S.: The bang-bang problem for stochastic matrices. Z. Wahrscheinlichkeitstheor. Verw. Geb. 26, 191–195 (1973)
Johansen, S., Ramsey, F.L.: A bang-bang representation for 3x3 embeddable stochastic matrices. Z. Wahrscheinlichkeitstheor. Verw. Geb. 47, 107–118 (1979)
Kalman, J.A.: Continuity and convexity of projections and barycentric coordinates in convex polyhedra. Pacific J. Math, 11, 1017–1022 (1961)
Kingman, J.F.C., Williams, D.: The combinatorial structure of non-homogeneous Markov chains. Z. Wahrscheinlichkeitstheor. Verw. Geb. 26, 77–86 (1973)
Laurent, P.-J.: Approximation et optimisation. Paris: Hermann 1972
Lee, E.B., Markus, L.: Foundations of optimal control theory. New York: Wiley 1968
Yemelichev, V.A., Kovalev, M.M., Kravtsov, M.K.: Polytopes, graphs and optimisation. (Translated from Russian) Cambridge University Press 1984
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Fuglede, B. On the imbedding problem for stochastic and doubly stochastic matrices. Probab. Th. Rel. Fields 80, 241–260 (1988). https://doi.org/10.1007/BF00356104
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00356104