Abstract and Applied Analysis

Volume 2013 (2013), Article ID 289526, 9 pages

http://dx.doi.org/10.1155/2013/289526

Research Article

State Estimation for Neural Networks with Leakage Delay and Time-Varying Delays

Jing Liang,¹ Zengshun Chen,² and Qiankun Song¹

¹Department of Mathematics, Chongqing Jiaotong University, Chongqing 400074, China

²School of Civil Engineering & Architecture, Chongqing Jiaotong University, Chongqing 400074, China

Received 31 July 2013; Accepted 1 September 2013

Academic Editor: Jinde Cao

Copyright © 2013 Jing Liang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

The state estimation problem is investigated for neural networks with leakage delay and time-varying delay as well as for general activation functions. By constructing appropriate Lyapunov-Krasovskii functionals and employing matrix inequality techniques, a delay-dependent linear matrix inequalities (LMIs) condition is developed to estimate the neuron state with some observed output measurements such that the error-state system is globally asymptotically stable. An example is given to show the effectiveness of the proposed criterion.

1. Introduction

In the past few years, neural networks have been extensively studied and successfully applied in many areas such as combinatorial optimization, signal processing, associative memory, affine invariant matching, and pattern recognition [1]. In such applications, the stability analysis is a necessary step for the practical design of neural networks [2]. In hardware implementation, time delays occur due to finite switching speed of the amplifiers and communication time. The existence of time delay may lead to some complex dynamic behaviors such as oscillation, divergence, chaos, instability, or other poor performance of the neural networks [3]. Therefore, the issue of stability analysis of neural networks with time delay attracts many researchers, and a number of remarkable results have been built up in the open literature; for example, see [2–5] and references therein.

When a neural network is designed to handle complex nonlinear problems, a great number of neurons with tremendous connections are often required. In such relatively large-scale neural networks, it may be very difficult and expensive (or even impossible) to obtain the complete information of the neuron states. On the other hand, in many practical applications, one needs to know the neuron states and then use them to achieve certain objectives. For instance, a recurrent neural network was presented in [6] to model an unknown nonlinear system, and the neuron states were utilized to implement a control law. Therefore, it is of great importance to study the state estimation problem of neural networks.

Recently, some results related to the state estimation problem for neural networks have been reported; for example, see [7–38] and references therein. In [7], authors initially studied the state estimation problem of delayed neural networks, where a delay-independent condition was obtained in terms of a linear matrix inequality (LMI). In [8], authors proposed a free-weighting matrix approach to discuss the state estimation problem for neural networks with time-varying delay. By using the Newton-Leibniz formula, some slack variables were introduced to derive a less conservative condition. In [11], attention was focused on the design of a state estimator to estimate the neuron states by using the delay-fractioning technique to reduce the possible conservatism. The authors in [13] first investigated the robust state estimator problem of delayed neural networks with parameter uncertainties. Delay-dependent conditions were presented to guarantee the global asymptotical stability of the error system. In [16], a further result on design problem of state estimator for a class of neural networks of neutral type was presented. A delay-dependent LMI criterion for existence of the estimator was derived. In [20], the state estimation problem for discrete neural networks with partially unknown transition probabilities and time-varying delays was discussed. By utilizing a novel Lyapunov functional integrating both lower and upper time-delay bounds and some new techniques, some delay-range-dependent sufficient conditions under which the estimation error dynamics were stochastically stable are established. In [22], authors investigated the state estimation problem for neural networks with discrete time-varying delay and distributed time-varying delay; a delay-interval-dependent condition is developed to estimate the neuron state with some observed output measurements such that the error-state system was globally asymptotically stable. In [25], leakage delay in the leakage term was used to destabilize the neuron states. By constructing the Lyapunov-Krasovskii functional which contains a triple-integral term, an improved delay-dependent stability criterion was derived in terms of LMIs. In [27], the state estimation problem for a class of discrete-time stochastic neural networks with random delays was considered. By employing a Lyapunov-Krasovskii functional, sufficient delay distribution- dependent conditions were established in terms of LMIs that guarantee the existence of the state estimator. In [33], authors discussed the state estimation problem for Takagi-Sugeno (T-S) fuzzy Hopfield neural networks via strict output passivation of the error system. In [36–38], authors investigated the distributed state estimation problem for sensor networks and presented several new sufficient conditions to guarantee the convergence of the estimation error systems. To the best of the author’s knowledge, there are no results on the problem of state estimation for neural networks with leakage delay and time-varying delays. As pointed out in [39], neural networks with leakage delay are a class of important neural networks; time delay in the leakage term also has great impact on the dynamics of neural networks since time delay in the stabilizing negative feedback term has a tendency to destabilize a system. Therefore, it is necessary to investigate the state estimation problem for neural networks with leakage delay [25].

Motivated by the previous discussions, the objective of this paper is to study the state estimation for neural networks with leakage delay and time-varying delays by employing new Lyapunov-Krasovskii functionals and using matrix inequality techniques. The obtained sufficient condition does not require the differentiability of time-varying delays and is expressed in terms of linear matrix inequalities, which can be checked numerically using the effective LMI toolbox in Matlab. An example is given to show the effectiveness of the proposed criterion.

Notations. The notations are quite standard. Throughout this paper, and denote, respectively, the -dimensional Euclidean space and the set of all real matrices. refers to the Euclidean vector norm. represents the transpose of matrix , and the asterisk “” in a matrix is used to represent the term which is induced by symmetry. is the identity matrix with compatible dimension. means that and are symmetric matrices and that is positive definite. Matrices, if not explicitly specified, are assumed to have compatible dimensions.

2. Model Description and Preliminaries

Consider the following neural networks with leakage delay and time-varying delays:

for , where is the state vector of the network at time , and corresponds to the number of neurons; is a positive diagonal matrix, and and are the connection weight matrix and the delayed connection weight matrix, respectively; denotes the neuron activation at time ; is an external input vector; and denote the leakage delay and time-varying delay, respectively.

Throughout this paper, we make the following assumptions.

(H1) (see [40]) For any there exist constants and such that

for all .

(H2) (see [25]) The leakage delay and time-varying delays satisfy the following conditions:

where and are constants.

As is well known, information about the neuron states is often incomplete from the network measurements (outputs) in applications, and the network measurements are subject to nonlinear disturbances. Similar to [7], we assume that the network measurements satisfy

where is the measurement output, and is a known constant matrix with appropriate dimension. is the neuron-dependent nonlinear disturbances on the network outputs and satisfies the following condition.

(H3) (see [22]) For any there exist constants and such that

for and all .

Remark 1. As pointed out in [40], the constants and in assumption (H1) of this paper are allowed to be positive, negative, or zero. Hence, assumption (H1), first proposed by Liu et al. in [40], is weaker than the Lipschitz condition.

For the delay neural networks (1), we construct the full-order state estimation as follows:

where is an estimation of the state of (1), and , to be determined, is a gain matrix of the state estimator.

Let the error state be then it follows from (1), (4), (6), and (7) that

where , .

The problem to be addressed in this study is to find out the gain matrix such that the system (8) is globally asymptotically stable.

To prove our results, the following lemmas that can be found in [22] are necessary.

Lemma 2 (see [22]). For any constant matrix , , scalar , and vector function such that the integrations concerned are well defined, then

Lemma 3 (see [22]). Given constant matrices , , and , where , , then

is equivalent to the following conditions:

3. Main Results

For presentation convenience, in the following, we denote

Theorem 4. Assume that the assumptions (H1)–(H3) hold. If there exist four symmetric positive definite matrices , five positive diagonal matrices , , , , and , and seven matrices , , , , , , and , such that the following LMIs hold:

where , , , , , , , , then error-state system (8) of the delayed neural network described by (1) and (6) is globally asymptotically stable, and the estimator gain matrix can be designed as .

Proof. From assumption (H1), we know that

Let , , and consider the following Lyapunov-Krasovskii functional as

where

Calculating the time derivative of (), we obtain

In deriving inequality (21), we have made use of Lemma 2. It follows from inequalities (19)–(22) that

From model (8), we have

By Newton-Leibniz formulation and assumption (H2), we have

In addition, for positive diagonal matrices (), we can get from assumption (H1) and assumption (H3) that [15]

It follows from (23)–(26) that

where , , , , , , , , ,

with , , , .

By using Lemma 3, and noting , it is easy to verify the equivalence of and . Thus, one can derive from (14) and (27) that

which implies that the error-state system (8) of the delayed neural networks described by (1) and (6) is globally asymptotically stable. The proof is completed.

4. Numerical Example

To verify the effectiveness of the theoretical result of this paper, consider the following example.

Example 1. Consider a two-neuron neural network (1), where

Figure 1 shows that the considered neural network has a chaotic attractor, where the initial condition is , , and .

It can be verified that assumptions (H1) and (H2) are satisfied, and , , , , .

Choose network measurement (4), where

It is obvious that assumption (H3) is satisfied with and . By the Matlab LMI Control Toolbox, we find a solution to the LMIs in (13) and (14) as follows:

Subsequently, we can obtain from that

Therefore, we know from Theorem 4 that error-state system (8) of the delayed neural network described by (1) and (6) is globally asymptotically stable. The simulation results are shown in Figures 2 and 3, which demonstrate the effectiveness of the developed approach for the design of the state estimator for neural networks with leakage delay and time-varying delay.

Figure 1: Phase trajectory of model (1).

Figure 2: The responses of the true state (solid line) and its estimation (dash line).

Figure 3: The responses of the true state (solid line) and its estimation (dash line).

5. Conclusions

In this paper, the state estimation problem has been investigated for neural networks with leakage delay and time-varying delay as well as general activation functions. By employing Lyapunov functional method and the matrix inequality techniques, a delay-dependent LMIs condition has been established to estimate the neuron state with some observed output measurements such that the error-state system is globally asymptotically stable. An example has been provided to show the effectiveness of the proposed criterion.

Acknowledgments

The authors would like to thank the reviewers and the editor for their valuable suggestions and comments which have led to a much improved paper. This work was supported by the National Natural Science Foundation of China under Grants 61273021, 60974132, 11172247, and 51208538 and in part by the Natural Science Foundation Project of CQ cstc2013jjB40008.

References

X. Yang, J. Cao, and J. Lu, “Synchronization of markovian coupled neural networks with nonidentical node-delays and random coupling strengths,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 1, pp. 60–71, 2012.

T. Chen, W. Lu, and G. Chen, “Dynamical behaviors of a large class of general delayed neural networks,” Neural Computation, vol. 17, no. 4, pp. 949–968, 2005.

J. Cao and Q. Song, “Stability in Cohen-Grossberg-type bidirectional associative memory neural networks with time-varying delays,” Nonlinearity, vol. 19, no. 7, pp. 1601–1617, 2006.

Z. Zeng and W. Zheng, “Multistability of neural networks with time-varying delays and concave-convex characteristics,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 2, pp. 293–305, 2012.

H. Zhang, F. Yang, X. Liu, and Q. Zhang, “Stability analysis for neural networks with time-varying delay based on quadratic convex combination,” IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 2, pp. 513–521, 2013.

L. Jin, P. N. Nikiforuk, and M. M. Gupta, “Adaptive control of discrete-time nonlinear systems using recurrent neural networks,” IEE Proceedings, vol. 141, no. 3, pp. 169–176, 1994.

Z. Wang, D. W. C. Ho, and X. Liu, “State estimation for delayed neural networks,” IEEE Transactions on Neural Networks, vol. 16, no. 1, pp. 279–284, 2005.

Y. He, Q. Wang, M. Wu, and C. Lin, “Delay-dependent state estimation for delayed neural networks,” IEEE Transactions on Neural Networks, vol. 17, no. 4, pp. 1077–1081, 2006.

T. Li and S. Fei, “Exponential state estimation for recurrent neural networks with distributed delays,” Neurocomputing, vol. 71, no. 1–3, pp. 428–438, 2007.

Z. Wang, Y. Liu, and X. Liu, “State estimation for discrete-time Markovian jumping neural networks with mixed mode-dependent delays,” Physics Letters A, vol. 372, no. 48, pp. 7147–7155, 2008.

S. Mou, H. Gao, W. Qiang, and Z. Fei, “State estimation for discrete-time neural networks with time-varying delays,” Neurocomputing, vol. 72, no. 1–3, pp. 643–647, 2008.

J. H. Park, O. M. Kwon, and S. M. Lee, “State estimation for neural networks of neutral-type with interval time-varying delays,” Applied Mathematics and Computation, vol. 203, no. 1, pp. 217–223, 2008.

H. Huang, G. Feng, and J. Cao, “Robust state estimation for uncertain neural networks with time-varying delay,” IEEE Transactions on Neural Networks, vol. 19, no. 8, pp. 1329–1339, 2008.

M. S. Mahmoud, “New exponentially convergent state estimation method for delayed neural networks,” Neurocomputing, vol. 72, no. 16–18, pp. 3935–3942, 2009.

Y. Liu, Z. Wang, and X. Liu, “State estimation for jumping recurrent neural networks with discrete and distributed delays,” Neural Networks, vol. 22, no. 1, pp. 41–48, 2009.

J. H. Park and O. M. Kwon, “Further results on state estimation for neural networks of neutral-type with time-varying delay,” Applied Mathematics and Computation, vol. 208, no. 1, pp. 69–75, 2009.

H. Huang, G. Feng, and J. Cao, “State estimation for static neural networks with time-varying delay,” Neural Networks, vol. 23, no. 10, pp. 1202–1207, 2010.

Z. Wang, Y. Liu, X. Liu, and Y. Shi, “Robust state estimation for discrete-time stochastic neural networks with probabilistic measurement delays,” Neurocomputing, vol. 74, no. 1–3, pp. 256–264, 2010.

C. K. Ahn, “Delay-dependent state estimation of T-S fuzzy delayed Hopfield neural networks,” Nonlinear Dynamics, vol. 61, no. 3, pp. 483–489, 2010.

Z. Wu, H. Su, and J. Chu, “State estimation for discrete Markovian jumping neural networks with time delay,” Neurocomputing, vol. 73, no. 10–12, pp. 2247–2254, 2010.

P. Balasubramaniam, S. Lakshmanan, and S. J. S. Theesar, “State estimation for Markovian jumping recurrent neural networks with interval time-varying delays,” Nonlinear Dynamics, vol. 60, no. 4, pp. 661–675, 2010.

H. Wang and Q. Song, “State estimation for neural networks with mixed interval time-varying delays,” Neurocomputing, vol. 73, no. 7–9, pp. 1281–1288, 2010.

H. Huang and G. Feng, “A scaling parameter approach to delay-dependent state estimation of delayed neural networks,” IEEE Transactions on Circuits and Systems II, vol. 57, no. 1, pp. 36–40, 2010.

X. Li and R. Rakkiyappan, “Robust asymptotic state estimation of Takagi-Sugeno fuzzy Markovian jumping Hopfield neural networks with mixed interval time-varying delays,” Mathematical Methods in the Applied Sciences, vol. 34, no. 17, pp. 2197–2207, 2011.

P. Balasubramaniam, M. Kalpana, and R. Rakkiyappan, “State estimation for fuzzy cellular neural networks with time delay in the leakage term, discrete and unbounded distributed delays,” Computers & Mathematics with Applications, vol. 62, no. 10, pp. 3959–3972, 2011.

P. Balasubramaniam, V. Vembarasan, and R. Rakkiyappan, “Delay-dependent robust exponential state estimation of Markovian jumping fuzzy Hopfield neural networks with mixed random time-varying delays,” Communications in Nonlinear Science and Numerical Simulation, vol. 16, no. 4, pp. 2109–2129, 2011.

H. Bao and J. Cao, “Delay-distribution-dependent state estimation for discrete-time stochastic neural networks with random delay,” Neural Networks, vol. 24, no. 1, pp. 19–28, 2011.

D. Zhang and L. Yu, “Exponential state estimation for Markovian jumping neural networks with time-varying discrete and distributed delays,” Neural Networks, vol. 35, pp. 103–111, 2012.

S. Lakshmanan, J. H. Park, D. H. Ji, H. Y. Jung, and G. Nagamani, “State estimation of neural networks with time-varying delays and Markovian jumping parameter based on passivity theory,” Nonlinear Dynamics, vol. 70, no. 2, pp. 1421–1434, 2012.

Y. Chen and W. X. Zheng, “Stochastic state estimation for neural networks with distributed delays and Markovian jump,” Neural Networks, vol. 25, pp. 14–20, 2012.

X. Kan, Z. Wang, and H. Shu, “State estimation for discrete-time delayed neural networks with fractional uncertainties and sensor saturations,” Neurocomputing, vol. 117, pp. 64–71, 2013.

T. H. Lee, J. H. Park, O. M. Kwon, and S. M. Lee, “Stochastic sampled-data control for state estimation of time-varying delayed neural networks,” Neural Networks, vol. 46, pp. 99–108, 2013.

C. K. Ahn, “State estimation for T-S fuzzy Hopfield neural networks via strict output passivation of the error system,” International Journal of General Systems, vol. 42, no. 5, pp. 503–518, 2013.

H. Huang, T. Huang, and X. Chen, “Guaranteed performance state estimation of delayed static neural networks,” IEEE Transactions on Circuits and Systems II, vol. 60, no. 6, pp. 371–375, 2013.

S. Lakshmanan, V. Vembarasan, and P. Balasubramaniam, “Delay decomposition approach to state estimation of neural networks with mixed time-varying delays and Markovian jumping parameters,” Mathematical Methods in the Applied Sciences, vol. 36, no. 4, pp. 395–412, 2013.

J. Liang, Z. Wang, B. Shen, and X. Liu, “Distributed state estimation in sensor networks with randomly occurring nonlinearities subject to time-delays,” ACM Transactions on Sensor Networks, vol. 9, no. 1, article 4, 2012.

J. Liang, Z. Wang, and X. Liu, “Distributed state estimation for uncertain Markov-type sensor networks with mode-dependent distributed delays,” International Journal of Robust and Nonlinear Control, vol. 22, no. 3, pp. 331–346, 2012.

J. Liang, Z. Wang, and X. Liu, “Distributed state estimation for discrete-time sensor networks with randomly varying nonlinearities and missing measurements,” IEEE Transactions on Neural Networks, vol. 22, no. 3, pp. 486–496, 2011.

K. Gopalsamy, “Leakage delays in BAM,” Journal of Mathematical Analysis and Applications, vol. 325, no. 2, pp. 1117–1132, 2007.

Y. Liu, Z. Wang, and X. Liu, “Global exponential stability of generalized recurrent neural networks with discrete and distributed delays,” Neural Networks, vol. 19, no. 5, pp. 667–675, 2006.