Abstract
The estimating equations derived from minimising aL 2 distance between the empirical distribution function and the parametric distribution representing a mixture ofk normal distributions with possibly different means and/or different dispersion parameters are given explicitly. The equations are of theM estimator form in which the ψ function is smooth, bounded and has bounded partial derivatives. As a consequence it is shown that there is a solution of the equations which is robust. In particular there exists a weakly continuous, Fréchet differentiable root and hence there is a consistent root of the equations which is asymptotically normal. These estimating equations offer a robust alternative to the maximum likelihood equations, which are known to yield nonrobust estimators.
Similar content being viewed by others
References
Aitkin, M. and Rubin, D. B. (1985). Estimation and hypothesis testing in finite mixture models,J. Roy. Statist. Soc. Ser. B,47, 67–75.
Bryant, J. L. and Paulson, A. S. (1983). Estimation of mixing proportions via distance between characteristic functions,Comm. Statist. Theory Methods,12, 1009–1029.
Choi, K. and Bulgren, W. B. (1968). An estimation procedure for mixtures of distributions,J. Roy. Statist. Soc. Ser. B,30, 444–460.
Clarke, B. R. (1983). Uniqueness and Fréchet differentiability of functional solutions to maximum likelihood type equations,Ann. Statist.,11, 1196–1205.
Clarke, B. R. (1989). An unbiased minimum distance estimator of the proportion parameter in a mixture of two normal distributions,Statist. Probab. Lett.,7, 275–281.
Clarke, B. R. (1991). The selection functional,Probab. Math. Statist.,11,Fasc.,2, 149–156.
Clarke, B. R. and Heathcote, C. R. (1978). Comment on “Estimating mixtures of normal distributions and switching regressions” by Quandt and Ramsey,J. Amer. Statist. Assoc.,73, 749–750.
D'Agostino, R. B. and Stephens, M. A. (1986).Goodness-of-Fit Techniques, Marcel Dekker, New York.
Everitt, B. S. and Hand, D. J. (1981).Finite Mixture Distributions, Chapman and Hall, London.
Hampel, F. R. (1971). A general qualitative definition of robustness,Ann. Math. Statist.,42, 1887–1896.
Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J. and Stahel, W. A. (1986).Robust Statistics: The Approach Based on Influence Functions, Wiley, New York.
Heathcote, C. R. and Silvapulle, M. J. (1981). Minimum mean squared estimation of location and scale parameters under misspecification of the model,Biometrika,68, 501–514.
Huber, P. J. (1981).Robust Statistics, Wiley, New York.
Kiefer, N. M. (1978). Discrete parameter variation: efficient estimation of a switching regression model,Econometrica,46, 427–434.
Knüsel, L. F. (1969). Über Minimum-Distance-Schätzungen, Ph.D. Thesis, ETH, Zürich.
McLachlan, G. J. and Basford, K. E. (1988).Mixture Models, Inference and Applications to Clustering, Marcel Dekker, New York.
Prokhorov, Y. V. (1956). Convergence of random processes and limit theorems in probability theory,Theory Probab. Appl.,1, 157–214.
Quandt, R. E. and Ramsey, J. B. (1978). Estimating mixtures of normal distributions and switching regressions,J. Amer. Statist. Assoc.,73, 730–738.
Rabinowitz, P. (ed.) (1970).Numerical Methods for Non-Linear Algebraic Equations, Gordon and Breach, London.
Serfling, R. J. (1980).Approximation Theorems of Mathematical Statistics, Wiley, New York.
Titterington, D. M., Smith, A. F. M. and Makov, U. E. (1985).Statistical Analysis of Finite Mixture Distributions, Wiley, New York.
Varadarajan, V. S. (1958). On the convergence of probability distributions,Sankhyā,19, 23–26.
Woodward, W. A., Parr, W. C., Schucany, W. R. and Lindsey, H. (1984). A comparison of minimum distance and maximum likelihood estimation of a mixture proportion,J. Amer. Statist. Assoc.,79, 590–598.
Author information
Authors and Affiliations
About this article
Cite this article
Clarke, B.R., Heathcote, C.R. Robust estimation ofk-component univariate normal mixtures. Ann Inst Stat Math 46, 83–93 (1994). https://doi.org/10.1007/BF00773595
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00773595