Abstract and Applied Analysis

Volume 2013 (2013), Article ID 814692, 14 pages

http://dx.doi.org/10.1155/2013/814692

Research Article

Robust Synchronization Criterion for Coupled Stochastic Discrete-Time Neural Networks with Interval Time-Varying Delays, Leakage Delay, and Parameter Uncertainties

M. J. Park,¹ O. M. Kwon,¹ Ju H. Park,² S. M. Lee,³ and E. J. Cha⁴

¹School of Electrical Engineering, Chungbuk National University, 52 Naesudong-ro, Heungdeok-gu, Cheongju 361-763, Republic of Korea

²Department of Electrical Engineering, Yeungnam University, 214-1 Dae-Dong, Gyeongsan 712-749, Republic of Korea

³School of Electronic Engineering, Daegu University, Gyeongsan 712-714, Republic of Korea

⁴Department of Biomedical Engineering, School of Medicine, Chungbuk National University, 52 Naesudong-ro, Heungdeok-gu, Cheongju 361-763, Republic of Korea

Received 6 September 2012; Accepted 10 December 2012

Academic Editor: José J. Oliveira

Copyright © 2013 M. J. Park et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

The purpose of this paper is to investigate a delay-dependent robust synchronization analysis for coupled stochastic discrete-time neural networks with interval time-varying delays in networks coupling, a time delay in leakage term, and parameter uncertainties. Based on the Lyapunov method, a new delay-dependent criterion for the synchronization of the networks is derived in terms of linear matrix inequalities (LMIs) by constructing a suitable Lyapunov-Krasovskii’s functional and utilizing Finsler’s lemma without free-weighting matrices. Two numerical examples are given to illustrate the effectiveness of the proposed methods.

1. Introduction

In recent years, the problem of synchronization of coupled neural networks which is one of hot research fields of complex networks has been a challenging issue due to its potential applications such as physics, information sciences, biological systems, and so on. Here, complex networks, which are a set of interconnected nodes with specific dynamics, have been studied from various fields of science and engineering such as the World Wide Web, social networks, electrical power grids, global economic markets, and so on. Many mathematical models were proposed to describe various complex networks [1, 2]. Also, in the real applications of systems, there exists naturally time delay due to the finite information processing speed and the finite switching speed of amplifiers. It is well known that time delay often causes undesirable dynamic behaviors such as performance degradation and instability of the systems. So, some sufficient conditions for synchronization of coupled neural networks with time delay have been proposed in [3–5]. Moreover, the synchronization of delayed systems was applied in practical systems such as secure communication [6]. Furthermore, these days, most systems use digital computers (usually microprocessor or microcontrollers) with the necessary input/output hardware to implement the systems. The fundamental character of the digital computer is that it takes compute answers at discrete steps. Therefore, discrete-time modeling with time delay plays an important role in many fields of science and engineering applications. In this regard, various approaches to synchronization stability criterion for discrete-time complex networks with time delay have been investigated in the literature [7–9].

On the other hand, in implementation of many practical systems such as aircraft, chemical and biological systems, and electric circuits, there exist occasionally stochastic perturbations. It is not less important than the time delay as a considerable factor affecting dynamics in the fields of science and engineering applications. Therefore, the study on the problems for various forms of stochastic systems with time-delay has been addressed. For more details, see the literature [10–13] and references therein. Furthermore, on the problem of synchronization of coupled stochastic neural networks with time delay, various researches have been conducted [14–17]. Li and Yue [14] studied the synchronization stability problem for a class of complex networks with Markovian jumping parameters and mixed time delays. The model considered in [14] has stochastic coupling terms and stochastic disturbances to reflect more realistic dynamical behaviors of the complex networks that are affected by noisy environment. In [15], by utilizing novel Lyapunov-Krasovskii's functional with both lower and upper delay bounds, the synchronization criteria for coupled stochastic discrete-time neural networks with mixed delays were presented. Tang and Fang [16] derived several sufficient conditions for the synchronization of delayed stochastically coupled fuzzy cellular neural networks with mixed delays and uncertain hybrid coupling based on adaptive control technique and some stochastic analysis methods. In [17], by using Kronecker product as an effective tool, robust synchronization problem of coupled stochastic discrete-time neural networks with time-varying delay was investigated. Moreover, Song [18–20] addressed synchronization problem for the array of asymmetric, chaotic, and coupled connected neural networks with time-varying delay or nonlinear coupling. Also, in [21], robust exponential stability analysis of uncertain delayed neural networks with stochastic perturbation and impulse effects was investigated.

Very recently, a time delay in leakage term of the systems is being put to use in the problem of stability for neural networks as a considerable factor affecting dynamics for the worse in the systems [22, 23]. Li et al. [22] studied the existence and uniqueness of the equilibrium point of recurrent neural networks with time delays in the leakage term. By use of the topological degree theory, delay-dependent stability conditions of neural networks of neutral type with time delays in the leakage term were proposed in [23]. Unfortunately, to the best of authors’ knowledge, delay-dependent synchronization analysis of coupled stochastic discrete-time neural networks with time-varying delay in network coupling and leakage delay has not been investigated yet. Thus, by attempting the synchronization analysis for the model of coupled stochastic discrete-time neural networks with time delay in the leakage term, the model for coupled neural networks and its applications are closed to the practical networks. Here, delay-dependent analysis has been paid more attention than delay-independent one because the sufficient conditions for delay-dependent analysis make use of the information on the size of time delay [24]. That is, the former is generally less conservative than the latter.

Motivated by the above discussions, the problem of a new delay-dependent robust synchronization criterion for coupled stochastic discrete-time neural networks with interval time-varying delays in network coupling, the time delay in leakage term, and parameter uncertainties is considered for the first time. The coupled stochastic discrete-time neural networks are represented as a simple mathematical model by the use of Kronecker product technique. Then, by construction of a suitable Lyapunov-Krasovskii's functional and utilization of Finsler’s lemma without free-weighting matrices, a new synchronization criterion is derived in terms of LMIs. The LMIs can be formulated as convex optimization algorithms which are amenable to computer solution [25]. In order to utilize Finsler’s lemma as a tool of getting less conservative synchronization criteria on the number of decision variables, it should be noted that a new zero equality from the constructed mathematical model is devised. The concept of scaling transformation matrix will be utilized in deriving zero equality of the method. In [26], the effectiveness of Finsler’s lemma was illustrated by the improved passivity criteria of uncertain neural networks with time-varying delays. Finally, two numerical examples are included to show the effectiveness of the proposed method.

Notation. is the -dimensional Euclidean space, and denotes the set of all real matrices. For symmetric matrices and , (resp., ) means that the matrix is positive definite (resp., nonnegative). denotes a basis for the null-space of . and and denote identity matrix and and zero matrices, respectively. refers to the Euclidean vector norm or the induced matrix norm. means the maximum eigenvalue of a given square matrix. denotes the block diagonal matrix. represents the elements below the main diagonal of a symmetric matrix. Let be complete probability space with a filtration satisfying the usual conditions (i.e., it is right continuous and contains all -pull sets). stands for the mathematical expectation operator with respect to the given probability measure .

2. Problem Statements

Consider the following discrete-time delayed neural networks:

where denotes the number of neurons in a neural network, is the neuron state vector, denotes the neuron activation function vector, means a constant external input vector, is the state feedback matrix,    are the connection weight matrices, and and are the parameter uncertainties of the form

where is a real uncertain matrix function with Lebesgue measurable elements satisfying

The delays and are interval time-varying delays and leakage delay, respectively, satisfying

where and are positive integers.

The neuron activation functions, , are assumed to be nondecreasing, bounded, and globally Lipschitz; that is,

where and are constant values.

For simplicity, in stability analysis of the network (1), the equilibrium point is shifted to the origin by the utilization of the transformation , which leads the network (1) to the following form:

where is the state vector of the transformed network, and is the transformed neuron activation function vector with    satisfies, from (5), , which is equivalent to

In this paper, a model of coupled stochastic discrete-time neural networks with interval time-varying delays in network coupling, leakage delay, and parameter uncertainties is considered as

where is the number of couple nodes, is the state vector of the th node, is the constant inner-coupling matrix of nodes, which describe the individual coupling between the subnetworks, is the outer-coupling matrix representing the coupling strength and the topological structure of the network satisfies the diffusive coupling connections

and are -dimensional Wiener processes (Brownian Motion) on which satisfy

Here, and , which are mutually independent, are the coupling strength disturbance and the system noise, respectively. And the nonlinear uncertainties are the noise intensity functions satisfying the Lipschitz condition and the following assumption:

where are constant matrices with appropriate dimensions.

Remark 1. According to the graph theory [27], the outer-coupling matrix is called the negative Laplacian matrix of undirected graph. A physical meaning of the matrix is the bilateral connection between node and . If the matrix cannot satisfy symmetric, the unidirectional connection between nodes and is expressed. At this time, the matrix is called the negative Laplacian matrix of directed graph. Therefore, new numerical model and strong sufficient condition guaranteed to the stability for networks are needed. Moreover, in order to analyze the consensus problem for multiagent systems, the Laplacian matrix of directed graph was used [28].

For the convenience of stability analysis for the network (8), the following Kronecker product and its properties are used.

Lemma 2 (see [29]). Let denote the notation of Kronecker product. Then, the following properties of Kronecker product are easily established:

(i),(ii),(iii),(iv).

Let us define

Then, with Kronecker product in Lemma 2, the network (8) can be represented as

where , , and .

In addition, for stability analysis, (13) can be rewritten as follows:

where

The aim of this paper is to investigate the delay-dependent synchronization stability analysis of the network (14) with interval time-varying delays in network coupling, leakage delay, and parameter uncertainties. In order to do this, the following definition and lemmas are needed.

Definition 3 (see [7]). The network (8) is said to be asymptotically synchronized if the following condition holds:

Lemma 4 (see [3]). Let , , , and . If and each row sum of   is zero, then

Lemma 5 (see [30]). For any constant matrix , integers and satisfying , and vector function , the following inequality holds:

Lemma 6 (see [31] (Finsler's lemma)). Let , , and such that . The following statements are equivalent:

(i), , , (ii).

3. Main Results

In this section, a new synchronization criterion for the network (14) will be proposed. For the sake of simplicity on matrix representation, are defined as block entry matrices (e.g., ). The notations of several matrices are defined as follows:

Then, the main result of this paper is presented as follows.

Theorem 7. For given positive integers , and , diagonal matrices and , the network (14) is asymptotically synchronized for , if there exist positive scalars , , positive definite matrices , , , , , , , positive diagonal matrices , , and any matrix satisfying the following LMIs for :

where , ,   , and are defined in (19).

Proof. Define a matrix as

and the forward difference of and as

Let us consider the following Lyapunov-Krasovskii's functional candidate as

where

The mathematical expectation of is calculated as follows:

By Lemmas 4 and 5, the sum terms of are bounded as follows:

where , which satisfies .

Also, by Theorem 7 in [32], the following inequality for any matrix holds

which implies

then, an upper bound of the sum term (29) of can be rebounded as

Similarly, the sum term of is bounded as

Also, by properties of Kronecker product in Lemma 2 and , the terms in (27) are calculated as follows:

where is defined in (19), and, if , then, from (11), the upper bound of terms in (27) is calculated as follows:

Then, by utilizing Lemma 4, an upper bound of can be written as follows:

From (7), for any positive diagonal matrices , the following inequalities hold.

Since the relational expression between and , , holds from the second equality of the system (14), there exists a positive scalar satisfying the following inequality:

From (36)–(38), by S-procedure [25], the has a new upper bound as follows:

Also, the network (14) with the augmented matrix can be rewritten as follows:

Here, in order to illustrate the process of obtaining (40), let us define the following:

By (14), (23), and properties of Kronecker product in Lemma 2, we have the following zero equality:

By Lemma 4, the first term of (42) can be obtained as follows:

Similarly, the other terms of (42) are calculated as follows:

Then, (42) can be rewritten as follows:

Therefore, if the zero equality (40) holds, then a synchronization condition for the network (14) is

subject to

Here, if inequality (47) holds, then there exists a positive scalar such that . From (39) and (47), we have . Thus, by Lyapunov theorem and Definition 3, it can be guaranteed that the subnetworks in the coupled discrete-time neural networks (14) are asymptotically synchronized. Also, condition (47) is equivalent to the following inequality:

subject to

Finally, by the use of Lemma 6, condition (49) is equivalent to the following inequality:

and applying Schur complement [25] leads to

which can be rewritten by

From inequality (52), if the LMIs (22) are satisfied, then stability condition (47) holds. This completes our proof.

Remark 8. In order to induce a new zero equality (40), the matrix in (41) was defined. It is inspired by the concept of scaling transformation matrix. To reduce the decision variable, Finsler’s lemma (ii) without free-weighting matrices was used. At this time, a zero equality is required. If the matrix is not considered, then the following description (see only (43) as an example)

as shown in (53) does not hold. Thus, the derivation of zero equality in (40) is impossible. Here, to use Lemma 4, a suitable vector or matrix in the empty parentheses is needed. Therefore, by defining the matrix , the induction of the zero equality (40) is possible.

Remark 9. In this paper, the problem of new delay-dependent synchronization for coupled stochastic discrete-time neural networks with leakage delay and parameter uncertainties is considered. By using Finsler's lemma without free-weighting matrices, the proposed robust synchronization criterion for the network is established in terms of LMIs. Here, as mentioned in the Introduction, the leakage delay is the time delay in leakage or forgetting term of the systems and a considerable factor affecting dynamics for the worse in the network. The effect of the leakage delay which cannot be negligible is shown in Figure 2. Also, the stochastic discrete-time systems with parameter uncertainties do not formulate like as the network (14) in any other literature. To do this, the vector is added in the augmented vector . It is just like as in continuous-time systems. This form for the systems may give more less conservative results for stability analysis. As a case of stochastic continuous-time systems with parameter uncertainties, Kwon [13] derived the delay-dependent stability criteria for uncertain stochastic dynamic systems with time-varying delays via the Lyapunov-Krasovskii's functional approach with two delay fraction numbers.

4. Numerical Examples

In this section, we provide two numerical examples to illustrate the effectiveness of the proposed synchronization criterion in this paper.

Example 10. Consider the following coupled neural networks by complex model in Figure 1:

with , where

For the network above, the maximum allowable delay bounds with different and fixed by Theorem 7 are listed in Table 1. In order to confirm the obtained results with the conditions of the time delays as listed in Table 2, the simulation results for the trajectories of state responses,   , and synchronization errors, , of the network (54) are shown in Figures 2, 3, 4, and 5. These figures show that the network with the errors converge to zero for given initial values of the state by , , , , and . Specially, the simulation results in Figure 2 show state response trajectories for the values of leakage delay, , by 3, 15, and 30 with fixed values and . It is easy to illustrate that the larger value of leakage delay gives the worse dynamic behaviors of the network (54).

Table 1: Maximum allowable delay bounds, , with different and fixed (Example 10).

1
5
10
50
100

3
7
12
52
102

Table 2: The conditions of simulation in Example 10.

Number

3

C1-1
15
5
7

30

C1-2
3
50
52

Figure 1: The structure of complex networks with (Example 10).

(a)

(b)

(c)

Figure 2: State responses with C1-1 (Example 10): (a) , (b) , and (c) .

(a)

(b)

(c)

(d)

Figure 3: Synchronization errors trajectories with C1-1 () (Example 10).

Figure 4: State responses with C1-2 (Example 10).

(a)

(b)

(c)

(d)

Figure 5: Synchronization errors trajectories with C1-2 (Example 10).

Example 11. Consider the following coupled neural networks by BA scale-free model [33] in Figure 6:

with , where

The results of maximum allowable delay bounds with different and fixed by Theorem 7 are listed in Table 3. For lack of space, the outer-coupling matrix is omitted. It is easy that the matrix was expressed from Figure 6. Figures 7 and 8 show the state response trajectories,   , of the network (56) with the condition of the time delays as listed in Table 4 for random initial values of the state. These figures show that the network (56) with the state responses converge to zero. This means the synchronization stability of the network (56).

Table 3: Maximum allowable delay bounds, , with different and fixed (Example 11).

1
5
10
25
30

5
9
14
29
34

Table 4: The conditions of simulation in Example 11.

Number

C2-1
5
9
Random integer variable with

C2-2
30
34
Random integer variable with

Figure 6: The structure of BA scale-free networks with (Example 11).

(a)

(b)

Figure 7: State responses and time-delay with C2-1 (Example 11).

(a)

(b)

Figure 8: State responses and time-delay with C2-2 (Example 11).

5. Conclusions

In this paper, the delay-dependent robust synchronization criterion for the coupled stochastic discrete-time neural networks with interval time-varying delays in network coupling, leakage delay, and parameter uncertainties has been proposed. To do this, the suitable Lyapunov-Krasovskii’s functional was used to investigate the feasible region of stability criterion. By utilization of Finsler’s lemma with a new zero equality, a sufficient condition for guaranteeing asymptotic synchronization for the concerned networks has been derived in terms of LMIs. Two numerical examples have been given to show the effectiveness and usefulness of the presented criterion.

Acknowledgments

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (2012-0000479) and by a Grant of the Korea Healthcare Technology R & D Project, Ministry of Health & Welfare, Republic of Korea (A100054).

References

S. H. Strogatz, “Exploring complex networks,” Nature, vol. 410, no. 6825, pp. 268–276, 2001.

S. Boccaletti, V. Latora, Y. Moreno, M. Chavez, and D.-U. Hwang, “Complex networks: structure and dynamics,” Physics Reports A, vol. 424, no. 4-5, pp. 175–308, 2006.

J. Cao, G. Chen, and P. Li, “Global synchronization in an array of delayed neural networks with hybrid coupling,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 38, no. 2, pp. 488–498, 2008.

J. Cao and L. Li, “Cluster synchronization in an array of hybrid coupled neural networks with delay,” Neural Networks, vol. 22, no. 4, pp. 335–342, 2009.

T. Li, T. Wang, A. G. Song, and S. M. Fei, “Exponential synchronization for arrays of coupled neural networks with time-delay couplings,” International Journal of Control, Automation and Systems, vol. 9, no. 1, pp. 187–196, 2011.

O. M. Kwon, J. H. Park, and S. M. Lee, “Secure communication based on chaotic synchronization via interval time-varying delay feedback control,” Nonlinear Dynamics, vol. 63, no. 1-2, pp. 239–252, 2011.

Y. Liu, Z. Wang, J. Liang, and X. Liu, “Synchronization and state estimation for discrete-time complex networks with distributed delays,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 38, no. 5, pp. 1314–1325, 2008.

D. Yue and H. Li, “Synchronization stability of continuous/discrete complex dynamical networks with interval time-varying delays,” Neurocomputing, vol. 73, no. 4–6, pp. 809–819, 2010.

T. Li, A. Song, and S. Fei, “Synchronization control for arrays of coupled discrete-time delayed Cohen-Grossberg neural networks,” Neurocomputing, vol. 74, no. 1–3, pp. 197–204, 2010.

S. Xu, J. Lam, X. Mao, and Y. Zou, “A new LMI condition for delay-dependent robust stability of stochastic time-delay systems,” Asian Journal of Control, vol. 7, no. 4, pp. 419–423, 2005.

Z. Wu, H. Su, J. Chu, and W. Zhou, “Improved result on stability analysis of discrete stochastic neural networks with time delay,” Physics Letters A, vol. 373, no. 17, pp. 1546–1552, 2009.

R. Yang, P. Shi, and H. Gao, “New delay-dependent stability criterion for stochastic systems with time delays,” IET Control Theory & Applications, vol. 2, no. 11, pp. 966–973, 2008.

O. M. Kwon, “Stability criteria for uncertain stochastic dynamic systems with time-varying delays,” International Journal of Robust and Nonlinear Control, vol. 21, no. 3, pp. 338–350, 2011.

H. Li and D. Yue, “Synchronization of Markovian jumping stochastic complex networks with distributed time delays and probabilistic interval discrete time-varying delays,” Journal of Physics A, vol. 43, no. 10, Article ID 105101, 25 pages, 2010.

H. Wang and Q. Song, “Synchronization for an array of coupled stochastic discrete-time neural networks with mixed delays,” Neurocomputing, vol. 74, no. 10, pp. 1572–1584, 2011.

Y. Tang and J. A. Fang, “Robust synchronization in an array of fuzzy delayed cellular neural networks with stochastically hybrid coupling,” Neurocomputing, vol. 72, no. 13–15, pp. 3253–3262, 2009.

J. Liang, Z. Wang, Y. Liu, and X. Liu, “Robust synchronization of an array of coupled stochastic discrete-time delayed neural networks,” IEEE Transactions on Neural Networks, vol. 19, no. 11, pp. 1910–1921, 2008.

Q. Song, “Synchronization analysis in an array of asymmetric neural networks with time-varying delays and nonlinear coupling,” Applied Mathematics and Computation, vol. 216, no. 5, pp. 1605–1613, 2010.

Q. Song, “Design of controller on synchronization of chaotic neural networks with mixed time-varying delays,” Neurocomputing, vol. 72, no. 13–15, pp. 3288–3295, 2009.

Q. Song, “Synchronization analysis of coupled connected neural networks with mixed time delays,” Neurocomputing, vol. 72, no. 16–18, pp. 3907–3914, 2009.

T. Huang, C. Li, S. Duan, and J. Starzyk, “Robust exponential stability of uncertain delayed neural networks with stochastic perturbation and impulse effects,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, pp. 866–875, 2012.

X. Li, X. Fu, P. Balasubramaniam, and R. Rakkiyappan, “Existence, uniqueness and stability analysis of recurrent neural networks with time delay in the leakage term under impulsive perturbations,” Nonlinear Analysis: Real World Applications, vol. 11, no. 5, pp. 4092–4108, 2010.

X. Li and J. Cao, “Delay-dependent stability of neural networks of neutral type with time delay in the leakage term,” Nonlinearity, vol. 23, no. 7, pp. 1709–1726, 2010.

S. Xu and J. Lam, “A survey of linear matrix inequality techniques in stability analysis of delay systems,” International Journal of Systems Science, vol. 39, no. 12, pp. 1095–1113, 2008.

S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, vol. 15 of SIAM Studies in Applied Mathematics, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, Pa, USA, 1994.

O. M. Kwon, S. M. Lee, and J. H. Park, “On improved passivity criteria of uncertain neural networks with time-varying delays,” Nonlinear Dynamics, vol. 67, pp. 1261–1271, 2011.

C. Godsil and G. Royle, Algebraic Graph Theory, vol. 207 of Graduate Texts in Mathematics, Springer, New York, NY, USA, 2001.

M. J. Park, O. M. Kwon, J. H. Park, S. M. Lee, and E. J. Cha, “Leader following consensus criteria for multi-agent systems with time-varying delays and switching interconnection topologies,” Chinese Physics B, vol. 21, Article ID 110508, 2012.

A. Graham, Kronecker Products and Matrix Calculus: With Applications, John Wiley & Sons, New York, NY, USA, 1982.

X. L. Zhu and G. H. Yang, “Jensen inequality approach to stability analysis of discrete-time systems with time-varying delay,” in Proceedings of the American Control Conference (ACC '08), pp. 1644–1649, Seattle, Wash, USA, June 2008.

M. C. de Oliveira and R. E. Skelton, “Stability tests for constrained linear systems,” in Perspectives in Robust Control, vol. 268 of Lecture Notes in Control and Information Sciences, pp. 241–257, Springer, London, UK, 2001.

P. Park, J. W. Ko, and C. Jeong, “Reciprocally convex approach to stability of systems with time-varying delays,” Automatica, vol. 47, no. 1, pp. 235–238, 2011.

A.-L. Barabási and R. Albert, “Emergence of scaling in random networks,” American Association for the Advancement of Science, vol. 286, no. 5439, pp. 509–512, 1999.