Abstract
This paper introduces a parallel combination of N > 2 one class fuzzy KNN (FKNN) classifiers. The classifier combination consists of a new optimization procedure based on a genetic algorithm applied to FKNN’s, that differ in the kind of similarity used. We tested the integration techniques in the case of N = 5 similarities that have been recently introduced to face with categorical data sets. The assessment of the method has been carried out on two public data set, the Masquerading User Data (www.schonlau.net) and the badges database on the UCI Machine Learning Repository (http://www.ics.uci.edu/~mlearn/). Preliminary results show the better performance obtained by the fuzzy integration respect to the crisp one.
“This work makes use of results produced by the PI2S2 Project managed by the Consorzio COMETA, a project co-funded by the Italian Ministry of University and Research (MIUR) within the Piano Operativo Nazionale ”Ricerca Scientifica, Sviluppo Tecnologico, Alta Formazione” (PON 2000-2006). More information is available at http://www.ii2s2.it and http://www.consorzio-cometa.it”
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Tax, D.M.J.: One-class classification, Ph.D. thesis, Delft University of Technology (June 2001), http://www.ph.tn.tudelft.nl/davidt/thesis.pdf
Wang, K., Stolfo, S.J.: One-Class Training for Masquerade Detection. In: Workshop on Data Mining for Computer Security, Melbourne, Florida, pp. 10–19 (November 19-22, 2003)
Dietterich, T.G.: Ensemble methods in machine learning. In: Kittler, J., Roli, F. (eds.) MCS 2000. LNCS, vol. 1857, pp. 1–15. Springer, Cagliari, Italy (2000)
Valentini, G., Masulli, F.: Ensembles of learning machines. In: Marinaro, M., Tagliaferri, R. (eds.) Neural Nets. LNCS, vol. 2486, pp. 3–19. Springer, Heidelberg (2002)
Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. In: Second European Conference on Computational Learning Theory (March 1995)
Shapire, R.E., Freund, Y., Barlett, P., Lee, W.: Boosting the margin. A new explanation for the effectiveness of voting methods. The annals of statistics 26(5), 1651–1686 (1998)
Kuncheva, L.I., Jain, L.C.: Designing Classifier Fusion Systems by Genetic Algorithms. IEEE Transactions on Evolutionary computation 4(4), 327–336 (2000)
Jordan, M.I., Jacobs, R.A.: Hierarchical mixture of experts and the EM algorithm. Neural Computation 6, 181–214 (1994)
Hashem, S.: Optimal linear combination of neural networks. Neural computation 10, 519–614 (1997)
Jain, A.K., Dubes, R.C.: Algorithms for clustering data. Prentice-Hall, New York (1988)
Swets, J., Pickett, R.: Evaluation of Diagnostic Systems: Methods from Signal Detection Theory. Academic Press, New York (1992)
Di Gesú, V., Friedman, J.H., Lo Bosco, G.: Similarity measures: an application to an intrusion systems problem. In: Workshop on Data Mining and decision theory, Pavia (2006)
Di Gesú, V., Friedman, J.H.: New similarity rules for mining data. In: Apolloni, B., Marinaro, M., Nicosia, G., Tagliaferri, R. (eds.) WIRN 2005 and NAIS 2005. LNCS, vol. 3931, Springer, Heidelberg (2006)
Tenenbaum, J.B.: Rules and Similarity in Concept Learning. In: Solla, S.A., Leen, T.K., Müuller, K.-R. (eds.) Advances in Neural Information Processing Systems, vol. 12, pp. 59–65. MIT Press, Cambridge (2000)
Hamming, R.W.: Error-detecting and error-correcting codes. Bell System Technical Journal 29(2), 147–160 (1950)
Di Gesú, V., Lo Bosco, G.: A Genetic Integrated Fuzzy Classifier, Pattern Recognition Letters, vol. 26, pp. 411–420. Elsevier, Amsterdam (2005)
Janikowa, C.Z., Michalewicz, Z.: An experimental comparison of binary and floating point representations in genetic algorithms. In: Belew, R.K., Booker, J.B. (eds.) Proceedings of the Fourth International Conference Genetic Algorithms, pp. 31–36 (1991)
Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Heidelberg (1999)
Maxion, R.A., Townsend, T.N.: Masquerade Detection Using Truncated Command Lines. In: Proc. International Conference on Dependable Systems and Networks (DSN-02), pp. 219–228 (2002)
Schonlau, M., Theus, M.: Detecting masquerades in intrusion detection based on unpopular commands. Information Processing Letters 76(1-2), 33–38 (2000)
Schonlau, M., DuMouchel, W., Ju, W.H., Karr, A.F., Theus, M., Vardi, Y.: Computer intrusion: Detecting masquerades. Statistical Science 16(1), 58–74 (2001)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Di Gesù, V., Lo Bosco, G. (2007). Combining One Class Fuzzy KNN’s. In: Masulli, F., Mitra, S., Pasi, G. (eds) Applications of Fuzzy Sets Theory. WILF 2007. Lecture Notes in Computer Science(), vol 4578. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73400-0_19
Download citation
DOI: https://doi.org/10.1007/978-3-540-73400-0_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73399-7
Online ISBN: 978-3-540-73400-0
eBook Packages: Computer ScienceComputer Science (R0)