Copyright © 1991 Published by Elsevier Ltd.
Original contribution
Iterative improvement of a nearest neighbor classifier
Received 19 March 1990;
Abstract
In practical pattern recognition applications, the nearest neighbor classifier (NNC) is often applied because it does not require an a priori knowledge of the joint probability density of the input feature vectors. As the number of example vectors is increased, the error probability of the NNC approaches that of the Baysian classifier. However, at the same time, the computational complexity of the NNC increases. Also, for a small number of example vectors, the NNC is not optimal with respect to the training data. In this paper, we attack these problems by mapping the NNC to a sigma-pi neural network, to which it is partially isomorphic. A modified form of back propagation (BP) learning is then developed and used to improve classifier performance. As examples, we apply our approach to the problems of handprinted numeral recognition and geometrical shape recognition. Significant improvements in classification error percentages are observed for both the training data and testing data.
Keywords: Nearest neighbor classifier; Sigma-pi network; Back propagation; Character recognition; Isomorphic classifiers; Shape recognition; Deformation-invariant features






E-mail Article
Add to my Quick Links

Cited By in Scopus (4)






