Elsevier

Neural Networks

Volume 60, December 2014, Pages 53-66
Neural Networks

Continuous neural identifier for uncertain nonlinear systems with time delays in the input signal

https://doi.org/10.1016/j.neunet.2014.07.002Get rights and content

Abstract

Time-delay systems have been successfully used to represent the complexity of some dynamic systems. Time-delay is often used for modeling many real systems. Among others, biological and chemical plants have been described using time-delay terms with better results than those models that have not consider them. However, getting those models represented a challenge and sometimes the results were not so satisfactory. Non-parametric modeling offered an alternative to obtain suitable and usable models. Continuous neural networks (CNN) have been considered as a real alternative to provide models over uncertain non-parametric systems. This article introduces the design of a specific class of non-parametric model for uncertain time-delay system based on CNN considering the so-called delayed learning laws analysis. The convergence analysis as well as the learning laws were produced by means of a Lyapunov–Krasovskii functional. Three examples were developed to demonstrate the effectiveness of the modeling process forced by the identifier proposed in this study. The first example was a simple nonlinear model used as benchmark example. The second example regarded the human immunodeficiency virus dynamic behavior is used to show the performance of the suggested non-parametric identifier based on CNN for no fictitious neither academic models. Finally, a third example describing the evolution of hepatitis B virus served to test the identifier presented in this study and was also useful to provide evidence of its superior performance against a non-delayed identifier based on CNN.

Introduction

Time-delays are common in biological and chemical systems. Some processes in biological and chemical systems (Xu et al., 2009, Zhang et al., 2005), such as the gene expression (Chueh & Lu, 2012), course of an infection (Gourley, Kuang, & Nagy, 2008), biosignal response to a stimulus and feedback control in signal transduction networks involve time-delays (Jeong-Woo & Jun-Hoo, 1997).

A time delay in input signal appears in models of real systems due to different reasons. Usually its presence is forced by the physical nature of the system (Hale, 1977). Transport delays (like in chemical or pneumatic systems) or computational delay (e.g. in digital controllers or communication networks (Kruszewski, Jiang, Fridman, Richard, & Toguyeni, 2012)) are regular sources of delayed input signal. Input delay can also be introduced artificially  for including the sampling effect in mathematical models (see, for example,  Fridman, 2010, Fridman et al., 2004, Polyakov, 2012).

For a long time, mathematical modeling has been applied to the study and analysis of this class of real plants. These systems are formally represented with delayed differential equation (DDE) models (Bocharova & Rihan, 2000).

Complicated dynamical behavior arises as a consequence of time-delays in certain systems (Kaifa, Wendi, Haiyan, & Xianning, 2007). Biological and chemical systems with significant time-delays may exhibit limit cycle oscillations and chaotic behavior (Mackey & Glass, 1977). In addition, incorporating time-delays in those models is often essential to capture the whole dynamic behavior for such class of systems. Ignoring the time-delays in biological and chemical models yields to conclusions that do not contain the complete information of the system (Mier-y Terán-Romero, Silber, & Hatzimanikatis, 2010).

Today, the number of time-delay models for biological and chemical systems is growing more and more (Hethcote and Levin, 1989, Kruszewski et al., 2012). However, the complexities associated with these models did not come only by the own nature of the model but also from its uncertainties and complex interaction between the states (Sen, Dodla, Johnston, & Sethia, 2010).

Hence, some alternatives must be proposed to generate adequate representation of such time-delay systems. A feasible option has been the neural network framework to produce a non-parametric model (dynamic system whose trajectories reproduce the same behavior of the uncertain system without the knowledge of the mathematical model) of the uncertain time-delay system (Yoo & Park, 2009). This task can be done using the so-called neural network identifier (NNI) (Poznyak, Sánchez, & Yu, 2001). Nevertheless, this NNI must be designed in such a way that time-delay effect must be considered in its structure.

To obtain a better approach for the class of biological and chemical systems that contain delays, the topology of the NNI should also considered delays. The existence of time-delays on the NNI may cause oscillations and instability (Xua, Lamb, Hoc, & Zoua, 2005). For this reason, the stability of time-delay neural networks (TDNN) has long been investigated (Faydasicok and Arik, 2013, Zhao et al., 2013). Designing of TDNN demanded not only the global stability of the identifier but also the incorporation of some structural properties coming from the uncertain system to be identified. Also, it is often desirable to have a TDNN that converges fast enough to the trajectories of the uncertain system. The exponential stability analysis problem for TDNN can provide such behavior. Indeed, there is a large number of results on this topic (Arik, 2004, Liu and Liao, 2004, Marcus and Westervelt, 1989, Xu et al., 2003).

Most of the literature (Arik, 2000, Cao, 2000, Joy, 2000) made reference to two kinds of TDNN, according to how the delay affect their stability. One is referred to as delay independent stability and the other delay dependent stability (Liao, Chen, & Sanchez, 2002). For this paper, we deal with the delay dependent stability case.

Today, the available results regarding time-delay systems only consider the stability of the TDNN. However, the non-parametric identifier problem has been poorly explored (Ge, Du, Qian, & Liang, 2009). In this sense, the remarkable properties of time-delay stability analysis have been wasted for solving the problem of the non-parametric identifier based on CNN.

Since the last couple of decades, CNN have been deeply investigated for applications in identification, control and state estimation for systems without time-delay (Chairez, 2009, Poznyak et al., 2001). TDNN have been actively studied but they have not been (to the authors knowledge) proposed as identifier of continuous uncertain systems (Arik, 2004, Liao et al., 2002, Souza et al., 2007). This paper introduces a novel structure for TDNN used as identifier for uncertain time-delay nonlinear systems (UTDS). The method for adjusting the weights associated to the TDNN (the so-called learning laws) as well as the convergence regime are based on a special class of Lyapunov–Krasovskii functional. The convergence region is characterized by the same convergence analysis. Three numerical examples were developed to show the performance of the proposed NNI. All the three examples illustrated the convergence performance achieved by the non-parametric identifier introduced in this paper and its superior performance compared to a non-delayed identifier based on CNN.

The paper is organized as follows: The Section  2 presents the class of uncertain time-delay systems to be identified by the TDNN. Section  3 describes the class of TDNN used to construct the TDNN identifier. Section  4 describes all the details regarding the identifier structure including the learning laws and the characterization of the convergence region. Section  5 describes the numerical simulations to test the identifier performance. Finally, the last section of this paper gives some conclusions about the novel identifier developed in this study.

Section snippets

The class of delay systems

The class of stable UTDS considered in this paper is formally described as follows:ẋ(t)=f(x(t),u(t),u(th),,u(tph))+ξ(x(t),t)xt0(θ)=x(t0+θ)=φ(θ)θ[ph,0]pZ+. The continuous signal x(t)Rn is the state of the UTDS with x(t)<,t0. One must note that the source of delay is coming from the input signal u(t)Rm. The function f() represents the uncertain nonlinear function connecting the state of the plant with the delayed input signal u(tih),i=0,,p. The delay value h is known and

Neural network approximation for time-delay systems

The non-parametric model of the plant is proposed using a particular type of linearized approximation based on the regular topology of CNN. Consequently, let’s consider the following representation for the right hand side of (1):f(x(t),u(t),u(th),,u(tph))=f0(x(t),u(t),u(th),,u(tph))+f̃(x(t),u(t),u(th),,u(tph)) where f0(x(t),u(t),u(th),,u(tph)) is the so-called approximation for f(x(t),u(t),u(th),,u(tph)) and f˜(x(t),u(t),u(th),,u(tph)) is the unknown modeling error produced by

Identifier structure without offline training

This section describes the first identifier design for approximating the UTDS. In this first case, the approximation is given as follows f0(x(t),u(t),u(th),,u(tph))Ax(t)+W1ψ1(x(t))+W2ψ2(x(t))u(t)+i=1pW2i(t)ψ2i(x(t))u(tih). The matrix ARn×n represents an approximation of the linear section associated with the system (1). The set of matrices W1Rn×sa,W2Rn×sb and W2iRn×si are the so-called self feedback weight matrix and the delayed input feedforward weight matrices respectively. Here

Identifier structure with offline training

This section describes the second identifier design for approximating the uncertain time-delay nonlinear system. In the second case, the approximation if given as follows f0(x(t),u(t),u(th),,u(tph))Ax(t)+W1ψ1(x(t))+i=1pW2,iψ2i(x(t))u(tih)+f̃(x(t),u(t),u(th),,u(tph))+ξ(x(t),t). The matrix ARn×n represents the section of the identifier to approximate the linear section associated with the system (1). The set of matrices W1Rn×s and W2,iRn×si are the so-called self feedback weight

Simulation results

In this section three models were used to show the performance of the suggested non-parametric identifier based on CNN.

Remark 3

In all these numerical examples, the assumptions and conditions requested in this study can be verified explicitly. The class of external perturbations proposed in these examples was proposed in such way that condition (2) was fulfilled. The approximation error proposed in condition (6) was supported in the so-called Stone–Weierstrass theorem and then no further analysis is

Conclusions

This paper has discussed how to design a differential neural network identifier for a class of time-delays uncertain nonlinear systems where delays appear in the input signal. This design has included the construction of the adaptive algorithm to adjust the parameters associated with the identifier. The algorithm aforementioned produced a set of learning laws that bring the delayed input information to the current time. The quality of the identification process has been characterized using the

Acknowledgments

M. Alfaro Ponce and A. Arguelles would like to thank the Instituto Politécnico Nacional (Secretaría Académica, COFAA, SIP, and CIC - projects SIP-20130303 and SIP-20131867) for their financial contributions that led to develop this work. Isaac Chairez acknowledges the financial support provided by the Instituto Politecnico Nacional and its Secretaria de Investigacion y Posgrado.

References (42)

  • V. Kharitonov et al.

    Lyapunov–Krasovskii approach to the robust stability analysis of time-delay systems

    Automatica

    (2003)
  • X. Liao et al.

    Delay dependent exponential stability analysis of delayed neural networks: an lmi approach

    Neural Networks

    (2002)
  • Z. Liu et al.

    Existence and global exponential stability of periodic solution of cellular neural networks with time varying delays

    Journal of Mathematical Analysis and Applications

    (2004)
  • A. Polyakov

    Minimization of disturbances effects in time delay predictor-based sliding mode control systems

    Journal of The Franklin Institute

    (2012)
  • F. Souza et al.

    Asymptotic stability analysis in uncertain multi-delayed state neural networks via Lyapunov–Krasovskii theory

    Mathematical and Computer Modelling

    (2007)
  • X. Zhang et al.

    Delay dependent stabilization of linear systems with time varying state and input delays

    Automatica

    (2005)
  • Z. Zhao et al.

    Asymtotic stability of bidirectional associative memory neural networks with time varying delays via delta operator approach

    Neurocomputing

    (2013)
  • S. Arik

    Stability analysis of delayed neural networks

    IEEE Transactions on Circuits and Systems

    (2000)
  • G. Bocharova et al.

    Numerical modelling in biosciences using delay differential equations

    Journal of Computational and Applied Mathematics

    (2000)
  • I. Chairez

    Wavelet differential neural network

    IEEE Transactions on Neural Networks

    (2009)
  • T.-H. Chueh et al.

    Inference of biological pathway from gene expression profiles by time delay boolean networks

    PLoS ONE

    (2012)
  • Cited by (0)

    View full text