Mathematical Problems in Engineering
Volume 2018 (2018), Article ID 5147565, 9 pages
https://doi.org/10.1155/2018/5147565

Research Article

Improved Generalized Filtering for Static Neural Networks with Time-Varying Delay via Free-Matrix-Based Integral Inequality

Hui-Jun Yu,1,2 Yong He,3,4 and Min Wu3,4

¹School of Information Science and Engineering, Central South University, Changsha, Hunan 410083, China
²School of Electrical and Information Engineering, Hunan University of Technology, Zhuzhou 412007, China
³School of Automation, China University of Geosciences, Wuhan 430074, China
⁴Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, Wuhan 430074, China

Correspondence should be addressed to Yong He; heyong08@cug.edu.cn

Received 18 July 2017; Revised 16 December 2017; Accepted 2 January 2018; Published 30 January 2018

Academic Editor: Renming Yang

Copyright © 2018 Hui-Jun Yu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This paper focuses on the generalized filtering of static neural networks with a time-varying delay. The aim of this problem is to design a full-order filter such that the filtering error system is globally asymptotically stable with guaranteed performance index. By constructing an augmented Lyapunov-Krasovskii functional and applying the free-matrix-based integral inequality to estimate its derivative, an improved delay-dependent condition for the generalized filtering problem is established in terms of LMIs. Finally, a numerical example is presented to show the effectiveness of the proposed method.

1. Introduction

During the past few decades, neural network (NN), which models the way a biological brain solving problems, has been successfully applied to various engineering fields, such as pattern recognition and vehicle control [1]. Because of its powerful features in learning ability, data processing, function approximation, and adaptiveness, it has gained increasing attention and become a hot topic for scholars [2], while, due to the finite information processing speed, time delays inevitably occur in many NNs and possibly lead to poor performances and complex dynamical behaviors [3]. Thus, extensive researches have been addressed for NNs with time-varying delays.

It is well known that, by choosing the external states of neurons or the internal states of neurons as basic variables, a neural network can be usually classified as a static neural network or a local field neural network [4]. Although these two types of neural network can be equivalent under some assumptions, in many applications, these assumptions cannot always be satisfied. A unified model which combines these two systems together has been constructed recently [5].

Since NNs usually are some highly interconnected networks with a great deal of neurons, it may be very hard or even impossible to acquire all neurons state information completely [6]. However, in some practical applications, to achieve some desired objectives, it is needed to know the neurons state information or estimate it in advance [7]. And the design of filter, which aims to estimate the states of a system via its output measurement, provides a method for the above problems. Consequently, it is of great practical interest to study the filtering problems of NNs with time-varying delays.

For NNs with time-varying delays, the filtering problem was firstly investigated in [8]; both and generalized filter were obtained by solving a set of LMIs. Since then, much effort has been made and many results have been reported on this issue. In [9], the delay-dependent filter of the Luenberger form was derived for delayed switched Hopfield NNs. Considering that there is only one gain matrix in the Luenberger-type filter to be determined, which may introduce some restrictions to certain extent, [10] further studied the filtering problem of delayed static NNs based on an Arcak-type filter. Since it contains two gain matrices, the Arcak-type filter is regarded as an extension of the Luenberger-type filter. In addition, another generalized full-order filter was designed for a class of delayed stochastic NNs in [11], in which three gain matrices were involved.

On the other hand, with the rapid development of the Lyapunov-Krasovskii functional (LKF) theory, plenty of techniques developed for delay systems have been applied to the filter design of delayed NNs, in order to reduce the conservatism of the derived conditions. The condition with less conservatism means it can provide larger feasible regions such that the filtering error system is globally asymptotically stable with an optimal performance index. It has been well recognized that constructing a suitable LKF and effectively estimating its derivative are two key points to reduce the conservatism. In early years, the simple LKFs combined with the Jensen inequality is considered to be the most popular method for the filtering problems of delayed NNs [8]. In order to consider more information about time delays, some triple integral terms were introduced into the LKF in [10]. In [12], the delay-decomposition idea was used to derive the delay-dependent condition such that the filtering error system is globally asymptotically stable with a guaranteed performance. Based on the works of [13], less conservative filtering design results were obtained via the free-weighting matrix approach [14]. And by introducing a additional zero equation into the negative-definite conditions of LKFs’ derivative, [15] derived a suitable filter for the static NNs with mixed time-varying delays. Very recently, [16] achieved the less conservative generalized performance state estimation via an augmented LKF, Wirtinger integral inequality, and the auxiliary function-based integral inequality.

Although research on the filtering problem of delayed NNs is in progress, due to its importance, approaches or results on this topic are lacking compared with the stability analysis. For instance, some new proposed techniques, which can effectively reduce the conservatism of the derived stability criteria, have not been applied to the filtering problem of delayed NNs, to mention a few, the free-matrix-based integral inequality [17], the relaxed integral inequality [18], and the generalized free-weighting-matrix approach [19].

Due to this consideration, this paper further studies the filtering problem of NNs with a time-varying delay. The main purpose of this paper is to develop a less conservative approach for the generalized filter design. To tackle this problem, a more general Arcak-type filter is adopted firstly. Then, by employing the LKF theory and using the free-matrix-based integral inequality, some other bounding inequalities and the free-weighting matrix approach, new delay-dependent condition is derived to guarantee the asymptotic stability of the filtering error system of delayed static NNs with guaranteed performance index. Finally, a numerical example is provided to illustrate the effectiveness of our proposed method.

Notations. Throughout this paper, the notations are standard. is the set of all real matrices; (≥0) means that is a real symmetric and positive-definite (semi-positive-definite) matrix; denotes a block-diagonal matrix; and represent the identity matrix and the zero-matrix, respectively; the symmetric term in a symmetric matrix is denoted by ; and .

2. Preliminaries

Consider the following delayed static NN with external disturbance:

where is the neuron state vector, is the neural activation functions, is the external disturbance belonging to , is the network output, is the linear combination of states to be estimated, is an exogenous input vector, , , , , , , and are known real matrices with appropriate dimensions, is the initial function, and is time-varying delay satisfying:

where and are known scalars.

Assumption 1. For each , there exist real scalars such that the continuous activation function satisfies

A full-order Arcak-type filter for the delayed static NN (1) is constructed as

where and matrices , are the gains of the filter to be determined.

Define the error signals as and . Then, the filtering error system is expressed as follows:

where .

This paper aims to present a less conservative approach for the filtering problem of delayed static NN (1). Toward this problem, the following definition is indispensable.

Definition 2. For given , the filtering problem is said to be solved if a suitable full-order filter (4) can be found such that

(1)the filtering error system (5) with is globally asymptotically stable;(2)the performance is guaranteed under zero initial conditions for all nonzero , where and .

Before proceeding, we present the following lemmas, which will be used in the sequel.

Lemma 3 (free-matrix-based integral inequality [17]). Let be a differentiable signal in ; for positive definite matrices , , and any matrices , satisfying

the following inequality holds:

where

Lemma 4 (Jensen’s inequality [20]). Let be a differentiable signal in ; for positive definite matric , the following inequalities hold:

3. Main Result

In this section, by employing an augmented LKF and using the free-matrix-based integral inequality to estimate its derivative, an improved delay-dependent condition is derived such that the filtering error system (5) is globally asymptotically stable with guaranteed generalized performance indexes.

Theorem 5. For given scalars and , the filtering problem of NN (1) with time-varying delay satisfying (2) is solved with if there exist positive definite matrices , , positive definite diagonal matrices , symmetric matrices , and any matrices , , , , satisfying the following LMIs:

where

and the gain matrices , of the filter of (4) can be designed as

Proof. Let us construct a new augmented LKF candidate as

where

Taking the derivative of along the filtering error system (5) yields

By the time derivative of , we get

Calculating the derivative of , we have

Then by applying Lemma 3 to estimate the above -dependent integral term, if LMIs (10) and (11) hold, one has

where

Combining (21) with (23), it is clear that

Finally, the derivative of can be obtained as

For the first double integral term in , we can do the following treatment based on Lemma 4:

Similarly, the estimation of the second integral term can be done as

And by utilizing Lemma 3, if LMI (12) holds, we obtain

From (26) to (29), we get

Then, taking assumption of the activation function (3) into account yields

where

Based on the filtering error system (5), for any appropriately dimensioned matrix , the following equation holds:

where

Combining (19), (20), (21), (22), (23), (25), (26), (27), (28), (29), (30), (32), and (34), one can easily yield

If , then . Thus, if and are satisfied, then for a sufficient small scalar , which implies the filtering error system (5) with , is asymptotically stable.
Considering the definition of performance, we define

Then, under the zero-initial conditions and for , the following inequality is given:

That is,

In addition, it follows that LMI (13) and Schur complement that

Then, the following holds:

Taking the supremum over , one has , which means . Therefore, when (10)–(14) hold, the generalized filtering problem of NN (1) with time-varying delay satisfying (2) is solved with . This completes the proof.

Remark 6. The generalized design of a type of static NN with a time-varying delay is solved in Theorem 5. Different from [8–10, 12–15], we solve the filtering problem based on an Arcak-type filter, in which there are two gain matrices to be determined. Compared with the widely used Luenberger-type filter, it contains an additional gain matrix included in the activation function. So, it can be expected to lead a better generalized performance. And if we set , the Arcak-type filter is then reduced to the Luenberger-type filter.

Remark 7. The triple integral term is introduced into the LKF in this paper. When bounding its derivative, the derived double integral term is divided into three parts, two double integral terms and a single integral term. By using the double Jensen inequality to estimate the double integral terms and using the free-matrix-based integral inequality to estimate the single integral term, the derivation of the triple term is accomplished without ignoring any terms. It should be pointed out that this technique is more effective than the ones used in [10], in which the derived double integral term is estimated in its entirety.

Remark 8. To reduce the conservatism of the derived conditions, Wirtinger integral inequality was used to estimate single integral terms in [16], while in the presented study, the free-matrix-based integral inequality is employed. The use of the free-matrix-based integral inequality brings several advantages for Theorem 5. On the one hand, by introducing some free matrices, it gives more degrees of freedom to the derived condition. On the other hand, it has been proved in [17] that the free-matrix-based integral inequality contains Wirtinger integral inequality as a special case. That means, it can provide a tighter bound than Wirtinger integral inequality. And if the same LKF is chosen, our designed filter will be better than the one designed in [16].

Remark 9. There is some room for further improvement of our proposed method:

(i)Notice that when the free-matrix-based integral inequality is employed to improve the proposed condition, the number of decision variables is increased, which further increases the computation complexity of the condition. It has been pointed out in [3] that the calculation complexity is also an important consideration during the application of the proposed LMI-based condition to physical systems. Thus, the results considering both the conservatism and the computation complexity need more investigation.(ii)Recently, some new approaches have been developed for the stability analysis of delayed neural networks, which can be applied into the generalized filtering problem of neural networks, such as the delay-decomposition approach [21] and the free-matrix-based double integral inequality [22].

Notice that, in many applications, the derivative bound of the time delay is unknown. By setting , we can easily derive the delay-dependent but delay derivative-independent condition of the generalized filtering problem of neural network (1) based on Theorem 5.

Theorem 10. For given scalars , the filtering problem of NN (1) with time-varying delay satisfying is solved with if there exist positive definite matrices , , positive definite diagonal matrices , symmetric matrices , and any matrices , , , , satisfying LMIs (10)–(14).

4. Numerical Examples

In this section, we provide a well-used numerical example to demonstrate the effectiveness of the proposed approach.

Example 1. Consider the delayed static NN (1) with the following parameters:

This example has been studied in [10, 16], and we take these literatures for comparison study. To verify the advantages of our proposed approach, we calculate the optimal performance bounds index for various , , and such that filtering error system (5) is globally asymptotically stable with generalized performance.

Firstly, let ; for given and , the optimal generalized performance index derived by Theorem 5 and the ones reported in [10, 16] are given in Table 1, where represents , and “infeasible” means that no feasible solution can be found in the corresponding criteria.

Table 1: Optimal generalized performance index for and different .

Theorem [10]
0.7981
Infeasible
Infeasible
Infeasible
Infeasible

Theorem [16]

1.2763
Infeasible
Infeasible
Infeasible

Theorem 5

0.0505
0.6639
0.9137
1.9523

It is clearly shown from Table 1 that, compared with [10, 16], much better generalized performance is achieved by Theorem 5 proposed in this paper. It should be noticed that, in this paper, we choose the same filter as [10, 16]; thus, the better performance effectively illustrates the superiority of our proposed approaches, which is mainly based on the free-matrix-based integral inequality.

Then let , , and , for , ; by solving the LMIs in Theorem 5, the gain matrices of our designed filter (4) are obtained as

with the optimal generalized performance index . Figure 1 shows the state responses of error system (5) under initial condition . The resulting responses obviously demonstrate the asymptotic stability of the simulated error system.

Figure 1: State response of the error .

In addition, the optimal generalized performance index for , and different is listed in Table 2, from which one can see that Theorem 5 in this paper outperforms the ones in [10, 16].

Table 2: Optimal generalized performance index for , , and different .

Theorem [10]
3.3728
Infeasible
Infeasible
Infeasible

Theorem [16]
0.5983
1.5563
Infeasible
Infeasible

Theorem 5
0.2765
0.4015
0.6896
4.7676

Moreover, the optimal generalized performance index derived by Theorem 10 for , unknown , and different is listed in Table 3.

Table 3: Optimal generalized performance index for , unknown , and different .

Theorem 10
0.5156
0.5868
1.0891
5.1122

5. Conclusion

In this paper, the generalized filtering problem of static NNs with a time-varying delay has been investigated. First, an Arcak-type filter has been constructed. Then, based on an augmented LKF, the free-matrix-based integral inequality, the free-weighting matrix approach, and Jensen inequality, a suitable delay-dependent condition expressed in terms of LMIs has been derived such that the filtering error system of the considered static NNs is globally asymptotically stable with guaranteed performance index. Moreover, by solving some coupled LMIs, the optimal performance index and the gain matrices of the designed filter have been obtained. The effectiveness and advantages of the proposed method have been demonstrated by an illustrative example finally.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding this paper.

References

L. O. Chua and L. Yang, “Cellular Neural Networks: Applications,” IEEE Transactions on Circuits and Systems II: Express Briefs, vol. 35, no. 10, pp. 1273–1290, 1988.

X.-M. Zhang, Q.-L. Han, and X. Yu, “Survey on Recent Advances in Networked Control Systems,” IEEE Transactions on Industrial Informatics, vol. 12, no. 5, pp. 1740–1752, 2016.

C.-K. Zhang, Y. He, L. Jiang, and M. Wu, “Stability analysis for delayed neural networks considering both conservativeness and complexity,” IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 7, pp. 1486–1501, 2016.

H.-B. Zeng, Y. He, P. Shi, M. Wu, and S.-P. Xiao, “Dissipativity analysis of neural networks with time-varying delays,” Neurocomputing, vol. 168, pp. 741–746, 2015.

C.-K. Zhang, Y. He, L. Jiang, Q. H. Wu, and M. Wu, “Delay-dependent stability criteria for generalized neural networks with two delay components,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 7, pp. 1263–1276, 2014.

Y. He, Q. G. Wang, and C. Lin, “An improved H8 filter design for systems with time-varying interval delay,” IEEE Trans. Circuits Syst. II, vol. 53, p. 1235, 2006.

Y. He, G. P. Liu, D. Rees, and M. Wu, “Improved H∞ filtering for systems with a time-varying delay,” Circuits, Systems and Signal Processing, vol. 29, no. 3, pp. 377–389, 2010.

H. Huang and G. Feng, “Delay-dependent H∞ and generalized H2 filtering for delayed neural networks,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 56, no. 4, pp. 846–857, 2009.

C. K. Ahn and M. K. Song, “L2-L∞ filtering for time-delayed switched hopfield neural networks,” International Journal of Innovative Computing, Information and Control, vol. 7, no. 4, pp. 1831–1844, 2011.

D. Hu, H. Huang, and T. Huang, “Design of Arcak-type generalized H2 filter for delayed static neural networks,” Circuits, Systems and Signal Processing, vol. 33, no. 11, pp. 3635–3648, 2014.

M. Hua, H. Tan, and J. Chen, “Delay-dependent H∞ and generalized H² filtering for stochastic neural networks with time-varying delay and noise disturbance,” Neural Computing and Applications, vol. 25, no. 3-4, pp. 613–624, 2014.

Y. J. Li and Y. N. Liang, “Delay-dependent H∞ filtering for neural networks with time delay,” Applied Mechanics and Materials, vol. 511-512, pp. 875–879, 2014.

Y. He, G. P. Liu, D. Rees, and M. Wu, “Stability analysis for neural networks with time-varying interval delay,” IEEE Transactions on Neural Networks and Learning Systems, vol. 18, no. 6, pp. 1850–1854, 2007.

Y. Li, J. Li, and M. Hua, “New results of H8 filtering for neural network with time-varying delay,” Int. J. Innov. Comput. Inf. Control, vol. 10, pp. 2309–2323, 2014.

G. Liu, S. Zhou, X. Luo, and K. Zhang, “New filter design for static neural networks with mixed time-varying delays,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics): Preface, vol. 9772, pp. 117–129, 2016.

Y. Shu, X.-G. Liu, Y. Liu, and J. H. Park, “Improved Results on Guaranteed Generalized H2 Performance State Estimation for Delayed Static Neural Networks,” Circuits, Systems and Signal Processing, vol. 36, no. 8, pp. 3114–3142, 2017.

H.-B. Zeng, Y. He, M. Wu, and J. She, “Free-matrix-based integral inequality for stability analysis of systems with time-varying delay,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 60, no. 10, pp. 2768–2772, 2015.

C.-K. Zhang, Y. He, L. Jiang, M. Wu, and H.-B. Zeng, “Stability analysis of systems with time-varying delay via relaxed integral inequalities,” Systems & Control Letters, vol. 92, pp. 52–61, 2016.

C.-K. Zhang, Y. He, L. Jiang, W.-J. Lin, and M. Wu, “Delay-dependent stability analysis of neural networks with time-varying delay: a generalized free-weighting-matrix approach,” Applied Mathematics and Computation, vol. 294, pp. 102–120, 2017.

J. Sun, G. P. Liu, J. Chen, and D. Rees, “Improved delay-range-dependent stability criteria for linear systems with time-varying delays,” Automatica, vol. 46, no. 2, pp. 466–470, 2010.

C. Ge, C. Hua, and X. Guan, “New delay-dependent stability criteria for neural networks with time-varying delay using delay-decomposition approach,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 7, pp. 1378–1383, 2014.

C. Hua, S. Wu, X. Yang, and X. Guan, “Stability analysis of time-delay systems via free-matrix-based double integral inequality,” International Journal of Systems Science, vol. 48, no. 2, pp. 257–263, 2017.