Abstract
In this paper, we propose a Generalized ellipsoidal basis function based online self-constructing fuzzy neural network (GEBF-OSFNN) which extends the ellipsoidal basis function (EBF)-based fuzzy neural networks (FNNs) by permitting input variables to be modeled by dissymmetrical Gaussian functions (DGFs). Due to the flexibility and dissymmetry of left and right widths of the DGF, the partitioning made by DGFs in the input space is more flexible and more interpretable, and therefore results in a parsimonious FNN with high performance under the online learning algorithm. The geometric growing criteria and the error reduction ratio (ERR) method are used as growing and pruning strategies respectively to realize the structure learning algorithm which implements an optimal and compact network structure. The GEBF-OSFNN starts with no hidden neurons and does not need to partition the input space a priori. In addition, all free parameters in premises and consequents are adjusted online based on the ε-completeness of fuzzy rules and the linear least square (LLS) approach, respectively. The performance of the GEBF-OSFNN paradigm is compared with other well-known algorithms like RAN, RANEKF, MRAN, ANFIS, OLS, RBF-AFS, DFNN, GDFNN GGAP-RBF, OS-ELM, SOFNN and FAOS-PFNN, etc., on various benchmark problems in the areas of function approximation, nonlinear dynamic system identification, chaotic time-series prediction and real-world benchmark problems. Simulation results demonstrate that the proposed GEBF-OSFNN approach can facilitate a more powerful and more parsimonious FNN with better performance of approximation and generalization.
Similar content being viewed by others
References
Angelov P, Filev D (2004) An approach to on-line identification of evolving Takagi-Sugeno models. IEEE Trans Syst Man Cybern B Cynern 34: 484–498
Chao CT, Chen YJ, Teng CC (1996) Simplification of fuzzy-neural systems using similarity analysis. IEEE Trans Syst Man Cybern B Cybern 26: 344–354
Chen S, Cowan CFN, Grant PM (1991) Orthogonal least squares learning algorithm for radial basis function network. IEEE Trans Neural Netw 2: 1411–1423
Cho KB, Wang BH (1996) Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction. Fuzzy Sets Syst 83: 325–339
Er MJ, Wu S-Q (2002) A fast learning algorithm for parsimonious fuzzy neural systems. Fuzzy Sets Syst 126: 337–351
Gao Y, Er MJ (2003) Online adaptive fuzzy neural identification and control of a class of MIMO nonlinear systems. IEEE Trans Fuzzy Syst 11: 12–32
Gao Y, Er MJ (2005) NARMAX time series model prediction: feedforward and recurrent fuzzy neural network approaches. Fuzzy Sets Syst 150: 331–350
Gao Y, Er MJ (2005) An intelligent adaptive control scheme for postsurgical blood pressure regulation. IEEE Trans Neural Netw 16: 475–483
Huang G-B, Saratchandran P, Sundararajan N (2004) An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks. IEEE Trans Syst Man Cybern B Cybern 34: 2284–2292
Huang G-B, Saratchandran P, Sundararajan N (2005) A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation. IEEE Trans Neural Netw 16: 57–67
Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70: 489–501
Hsu C-F, Lin P-Z, Lee T-T, Wang C-H (2008) Adaptive asymmetric fuzzy neural network controller design via network structuring adaptation. Fuzzy Sets Syst 159: 2627–2649
Jang J-SR (1993) ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans Syst Man Cybern 23: 665–684
Jang J-SR, Sun CT, Mizutani E (1997) Neuro-fuzzy and soft computing. Prentice-Hall, Englewood Cliffs, NJ
Juang C-F, Lin C-T (1998) An on-line self-constructing neural fuzzy inference network and its applications. IEEE Trans Fuzzy Syst 6: 12–32
Kadirkamanathan V, Niranjan M (1993) A function estimation approach to sequential learning with neural networks. Neural Comput 5: 954–975
Kasabov N, Song Q (2002) DENFIS: dynamic evolving neuralfuzzy inference system and its application for timeseries prediction. IEEE Trans Fuzzy Syst 10: 144–154
Leng G, McGinnity TM, Prasad G (2005) An approach for online extraction of fuzzy rules using a selforganising fuzzy neural network. Fuzzy Sets Syst 150: 11–243
Leng G, McGinnity TM, Prasad G (2006) Design for self-organizing fuzzy neural networks based on genetic algorithms. IEEE Trans Fuzzy Syst 14: 755–766
Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17: 1411–1423
Lin CT (1995) A neural fuzzy control system with structure and parameter learning. Fuzzy Sets Syst 70: 183–212
Mitra S, Hayashi Y (2000) Neuro-fuzzy rule generation: survey in soft computing framework. IEEE Trans Neural Netw 11: 748–768
Platt J (1991) A resource-allocating network for function interpolation. Neural Comput 3: 213–225
Rojas I, Pomares H, Bernier JL et al (2002) Time series analysis using normalized PG-RBF network with regression weights. Neurocomputing 42: 267–285
Salmeron M, Ortega J, Puntonet CG, Prieto A (2001) Improved RAN sequential prediction using orthogonal techniques. Neurocomputing 41: 153–172
Sun ZL, Au KF, Choi TM (2007) A neuro-fuzzy inference system through integration of fuzzy logic and extreme learning machines. IEEE Trans Syst Man Cybern 37: 1321–1331
Takagi T, Hayashi I (1991) NN-driven fuzzy reasoning. Int J Approx Reason 5: 191–212
Tzafestas SG, Zikidis KC (2001) NeuroFAST: online neuro-fuzzy ART-based structure and parameter learning TSK model. IEEE Trans Syst Man Cybern B Cybern 31: 797–802
Velayutham CS, Kumar S (2005) Asymmetric subsethood-product fuzzy neural inference system (ASuPFuNIS). IEEE Trans Neural Netw 16: 160–174
Wang LX (1994) Adaptive fuzzy systems and control: design and stability analysis. Prentice-Hall, Englewood Cliffs, NJ
Wang N, Er MJ, Meng XY (2009) A fast and accurate online self-organizing scheme for parsimonious fuzzy neural networks. Neurocomputing 72: 3818–3829
Wang N, Er MJ, Meng XY, Li X (2010) An online self-organizing scheme for parsimonious and accurate fuzzy neural networks. Int J Neural Syst 20: 389–405
Wu S-Q, Er MJ (2000) Dynamic fuzzy neural networks—a novel approach to function approximation. IEEE Trans Syst Man Cybern B Cybern 30: 358–364
Wu S-Q, Er MJ, Gao Y (2001) A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks. IEEE Trans Fuzzy Syst 9: 578–594
Yingwei L, Sundararajan N, Saratchandran P (1997) A sequential learning scheme for function approximation using minimal radial basis function (RBF) neural networks. Neural Comput 9: 461–478
Yingwei L, Sundararajan N, Saratchandran P (1998) Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm. IEEE Trans Neural Netw 9: 308–318
Yu W, Li X (2004) Fuzzy identification using fuzzy neural networks with stable learning algorithms. IEEE Trans Fuzzy Syst 12: 411–420
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, N. A Generalized Ellipsoidal Basis Function Based Online Self-constructing Fuzzy Neural Network. Neural Process Lett 34, 13–37 (2011). https://doi.org/10.1007/s11063-011-9181-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-011-9181-1