Copyright © 2003 Elsevier Science Ltd. All rights reserved.
Non-parametric probability estimation for HMM-based automatic speech recognition
Received 6 June 2001;
References and further reading may be available for this article. To view references and further reading you must purchase this article.
Abstract
During the last decade, the most significant advances in the field of continuous speech recognition (CSR) have arisen from the use of hidden Markov models (HMM) for acoustic modeling. These models address one of the major issues for CSR: simultaneous modeling of temporal and frequency distortions in the speech signal. In the HMM, the temporal dimension is managed through an oriented states graph, each state accounting for the local frequency distortions through a probability density function. In this study, improvement of the HMM performance is expected from the introduction of a very effective non-parametric probability density function estimate: the k-nearest neighbors (k-nn) estimate.
First, experiments on a short-term speech spectrum identification task are performed to compare the k-nn estimate and the widespread estimate based on mixtures of Gaussian functions. Then adaptations implied by the integration of the k-nn estimate in an HMM-based recognition system are developed. An optimal training protocol is obtained based on the introduction of the membership coefficients in the HMM parameters. The membership coefficients measure the degree of association between a reference acoustic vector and a HMM state. The training procedure uses the expectation-maximization (EM) algorithm applied to the membership coefficient estimation. Its convergence is shown according to the maximum likelihood criterion. This study leads to the development of a baseline k-nn/HMM recognition system which is evaluated on the TIMIT speech database. Further improvements of the k-nn/HMM system are finally sought through the introduction of a temporal information into the representation space (delta coefficients) and the adaptation of the references (mainly, gender modeling and contextual modeling).
Article Outline
- 1. Introduction
- 2. Non-parametric discriminant probability estimates
- 3. k-nn/HMM system training
- 4. Representation space and reference adaptations
- 4.1. Integration of delta coefficients in the k-nn/HMM system
- 4.2. Gender modeling
- 4.3. Contextual modeling
- 5. Experiments
- 5.1. Local identification with the k-nn rule
- 5.1.1. Signal analysis and fast algorithm for k-nn computation
- 5.1.2. k-nn/Gaussian mixture comparison on a local identification task
- 5.1.3. Detailed analysis of the identification results
- 5.1.4. Speech/silence separation
- 5.2. Evaluation of baseline k-nn/HMM and Gauss/HMM systems
- 5.3. Integrating state-of-the-art techniques into the k-nn/HMM system
- 5.4. Discussion
- 6. Conclusion
- Appendix A. Proof of the reestimation formulae for the k-nn/HMM system parameters
- References







E-mail Article
Add to my Quick Links

Cited By in Scopus (0)





)=(35/50)=0.7 and P(×|•)=(15/50)=0.3. So according to the maximum a posteriori classification rule, the vector × will be classified as a 