Discrete Dynamics in Nature and Society
Volume 2018 (2018), Article ID 6360782, 7 pages
https://doi.org/10.1155/2018/6360782

Research Article

Distributed Consensus of Semi-Markovian Jumping Multiagent Systems with Mode-Dependent Topologies

Yidao Ji

School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China

Correspondence should be addressed to Yidao Ji; jiyidao@gmail.com

Received 3 May 2018; Revised 4 August 2018; Accepted 7 August 2018; Published 2 September 2018

Academic Editor: Xiaohua Ding

Copyright © 2018 Yidao Ji. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This paper investigates the distributed consensus problem of multiagent systems with semi-Markovian jumping dynamics in the mean-square sense. Moreover, the mode-dependent communication topologies and sampled-data consensus protocol over the networks are considered. By semi-Markov jump theory, the consensus problem is first transformed into a mean-square stability problem. Then, sufficient conditions are established with the designed mode-dependent consensus protocol. Finally, a numerical example is provided for verifying the effectiveness of our theoretical results.

1. Introduction

Owing to the rapid development of computer science and network technology, the multiagent systems (MASs) have become a hot research topic with significant applications including mobile robots [1, 2], sensor networks [3, 4], unmanned aerial vehicles (UAVs) [5, 6], and autonomous underwater vehicles (AUVs) [7, 8]. As one key concerned issue, the consensus of MASs has gained great research attention and fruitful results have been reported [9–11]. Generally speaking, certain agreement can be converged with collecting behaviors of the MASs when consensus is reached. Specifically, two significant issues worthy of consideration are the local information exchanges and the agent dynamics in the MASs, respectively. Since it is impractical to apply the continuous communication in the real-world network, various discrete-time communication strategies have been proposed, such as sample-data strategies [12], impulsive strategies [13], and intermittent strategies [14]. In comparison with continuous communication, these discrete-time schemes can obtain effective benefits in saving network resources and energy consumption. However, it is worth mentioning that the hybrid structure of discrete-time communication with continuous-time agent dynamics in MASs would increase the difficulty and complexity in analysis and synthesis. Encouragingly, some remarkable results have been presented in the literature [15–17].

On the other hand, it is noticed that dynamical systems may display mode switching features by abrupt phenomena, which gives rise to researches on switched systems [18, 19]. In particular, some mode switching (or jumping) can be modeled by Markovian jumping systems with finite transition rates. Therefore, it is meaningful and significant to investigate the Markovian jumping MASs. Some recent attempts have been made to tackle these problems [20, 21]. Furthermore, it should be pointed out that the transition rates could be time-varying and the sojourn time cannot be exponentially distributed. As a result, significant efforts have been put into the so-called semi-Markovian jumping systems with some analysis and synthesis methods [22–24]. However, so far, the consensus problem of semi-Markovian jumping MASs still remains open and challenging, which is the first motivation of our study. Another motivation lies in the fact that, for the MASs with switching characteristics, the communication topology and the communication strategy would switch accordingly, such that the consideration of mode-dependent topologies for switched MASs is reasonable. Unfortunately, there have been few results despite its practical importance, let alone those with semi-Markovian jumping MASs.

In response to the above discussions, this paper solves the distributed consensus problem of semi-Markovian jumping MASs with mode-dependent topologies and information exchanges by employing the key idea from semi-Markovian jumping systems. The main contributions of our paper can be summarized as follows. Firstly, a novel model of semi-Markovian jumping MASs with mode-dependent topologies is proposed for better describing the agent dynamics. Secondly, the distributed mode-dependent consensus protocol with sampled-data information exchanges is designed for guaranteeing the mean-square consensus, which is more applicable for the network environment. Finally, based on model transformation, sufficient consensus criteria are established by applying the mode-dependent Lyapunov-Krasovskii method in the form of linear matrix inequalities (LMIs).

The rest of our paper is outlined as follows. In Section 2, necessary preliminaries on graph theory are introduced and the consensus problem of semi-Markovian jumping MASs is formulated. Section 3 gives the main theoretical results with the developed networked consensus protocol. Section 4 is devoted to numerical simulations for demonstrating the validity of our obtained results. Finally, the concluding remarks are drawn in Section 5.

Notation. The notations are standard throughout this paper. and denote the dimensional Euclidean space and the space of real matrices, respectively. means that is positive definite. denotes the Kronecker product. denotes mathematical expectation; represents the probability of an event . represents the ellipsis symmetry terms in symmetric block matrices. stands for the block-diagonal matrix. Finally, all matrices are compatible for algebraic operations.

2. Preliminaries and Problem Formulation

Fix a probability space and let , denote a continuous-time discrete-state semi-Markov process on taking values in a finite set . The transition probability matrices , , and are defined by

where

is the transition rate from mode at time to mode at time , satisfying

2.1. Algebraic Graph Basics

The directed graph is adopted for describing the information exchange topology of the MASs with a fixed mode , where is the sets of nodes, is the sets of edges, and is the weighted adjacency matrix with if and otherwise. In addition, define the Laplacian as and . If has a directed spanning tree, then has a simple zero eigenvalue and all the other eigenvalues are real.

2.2. Semi-Markovian Jumping MASs

Consider the semi-Markovian jumping MASs consisting of agents, which are described as follows:

where and denote the system state and the control input of the th agent, respectively. and are constant matrices for a fixed mode .

Remark 1. It is worth mentioning that the communication topologies could dynamically switch according to the different modes of multiagent systems, which leads to the semi-Markovian jumping mode-dependent topologies. Without loss of generality, it is assumed that all the switching modes can be detected to the agent dynamics and the communication topologies.

The consensus is said to be achieved in the mean-square sense if and only if it holds that

The following lemma is given for the subsequent analysis.

Lemma 2 (see [24]). For matrix , parameters , satisfying , and such that the concerned integrations are well defined; then

where

3. Main Results

3.1. Distributed Consensus Protocol Design

In this paper, the sampled-data communication strategy with different modes is adopted. Suppose that the MASs communicate with their local neighbors over the communication network according to a global discrete-time sequence: with , such that the transmitted information of the th agent at instance is .

The following mode-dependent consensus protocol is designed:

where is the mode-dependent control gains to be determined.

Remark 3. It is assumed that the semi-Markovian jumping modes can be detected at the sampling instances, such that the system modes can be obtained by the agents and the communication topologies based on sampled-data communication strategy.

Consequently, the closed-loop dynamics of the MASs can be obtained as follows:

which can be further rewritten as

where and

It can be verified that when has a directed spanning tree, it follows that

where the last column of is .

By defining , it can be obtained that

which yields

Thus, it can be obtained that the consensus can be achieved when is asymptotically stable in the mean square.

To this end, denote by indices for simplicity and use the input-delay approach. Then, (13) can be rewritten by

where denotes the virtual delay satisfying

3.2. Sufficient Consensus Criteria

Based on the above consensus protocol, the following theorems are derived for the consensus analysis and synthesis of semi-Markovian jumping MASs.

Theorem 4. For given scalar , the distributed consensus of semi-Markovian jumping MASs (4) can be achieved with the given mode-dependent consensus protocol (8), if there exist mode-dependent real matrix and matrices and , such that for each and , where

Proof. For each mode , choose the following Lyapunov-Krasovskii functional:

where

The weak infinitesimal operator of is defined by

Then, it can be derived that

By Lemma 2, it holds that

Thus, one has

where

and
It follows by Schur complement that holds if , such that (15) is asymptotically stable in the mean square, where

Noticing the fact that , , and for time-varying dwell time, it can be obtained that , which completes the proof.

Theorem 5. For given scalar , the distributed consensus of semi-Markovian jumping MASs (4) can be achieved, if there exist mode-dependent real matrix and matrices and , such that for each and , where

and the mode-dependent consensus protocol gain can be obtained by .

Proof. Based on Theorem 4, it can be verified that if then , where

Letting , , , and and performing congruent transformation to , the results can follow directly from the proof of Theorem 4.

Remark 6. It can be found that the dimensions of LMIs are related to the and , which means that when the numbers of system modes and agents are increased, the dimension of LMIs will be increased accordingly. Although this would increase the computational complexity to some extent, the established LMIs are strict LMIs which can be easily solved by MATLAB.

4. Illustrative Example

In this section, an illustrative example with simulation results is provided for showing our proposed consensus design.

Consider the semi-Markovian jumping MASs with four agents and two jumping modes.

The transition rates are assumed to be and , which implies that , , , and with . The sampled-data communication period of the control inputs is given by s, such that one has .

The agent dynamics are described by the following parameters:

The communication topologies with directed spanning trees are depicted in Figures 1 and 2, respectively. As a result, the Laplacian matrices of the communication topologies can be obtained as follows:

Figure 1: The communication topology with mode 1.

Figure 2: The communication topology with mode 2.

With the above parameters, the mode-dependent consensus control input gains of the MASs can be calculated by solving the LMIs in Theorem 5 in the MATLAB, which are given by

As a result, the consensus state responses of the semi-Markovian jumping MASs by our designed consensus control input gains can be seen in Figure 3. It can be seen that all the states of semi-Markovian jumping MASs would reach the agreement, which confirms the effectiveness of our theoretical results.

Figure 3: The state responses of the semi-Markovian jumping MASs.

5. Conclusions

This paper focuses on the distributed consensus of semi-Markovian jumping MASs with mode-dependent communication topologies. The mode-dependent consensus protocol with sampled-data information is proposed. On the basis of model transformation and Lyapunov-Krasovskii method, sufficient consensus criteria are derived in the mean-square sense and the mode-dependent consensus gains are designed with LMIs. In the end, a simulation example is given for validating the effectiveness of our theoretical results. Our future work would encompass investigating the consensus of semi-Markovian jumping MASs under constrained network environments.

Data Availability

The data used to support the findings of this study are included within the article.

Conflicts of Interest

The author declares that he has no conflicts of interest.

References

R. Olfati-Saber, “Flocking for multi-agent dynamic systems: algorithms and theory,” IEEE Transactions on Automatic Control, vol. 51, no. 3, pp. 401–420, 2006.

A. Jadbabaie, J. Lin, and A. S. Morse, “Coordination of groups of mobile autonomous agents using nearest neighbor rules,” IEEE Transactions on Automatic Control, vol. 48, no. 6, pp. 988–1001, 2003.

Y. Hong, G. Chen, and L. Bushnell, “Distributed observers design for leader-following control of multi-agent networks,” Automatica, vol. 44, no. 3, pp. 846–850, 2008.

M. Vinyals, J. A. Rodriguez-Aguilar, and J. Cerquides, “A survey on sensor networks from a multiagent perspective,” The Computer Journal, vol. 54, no. 3, pp. 455–470, 2011.

W. Lin, “Distributed UAV formation control using differential game approach,” Aerospace Science and Technology, vol. 35, no. 1, pp. 54–62, 2014.

X. Dong, Y. Zhou, Z. Ren, and Y. Zhong, “Time-Varying Formation Tracking for Second-Order Multi-Agent Systems Subjected to Switching Topologies With Application to Quadrotor Formation Flying,” IEEE Transactions on Industrial Electronics, vol. 64, no. 6, pp. 5014–5024, 2017.

R. Cui, S. S. Ge, B. Voon Ee How, and Y. Sang Choo, “Leader-follower formation control of underactuated autonomous underwater vehicles,” Ocean Engineering, vol. 37, no. 17-18, pp. 1491–1502, 2010.

E. Yang and D. Gu, “Nonlinear formation-keeping and mooring control of multiple autonomous underwater vehicles,” IEEE/ASME Transactions on Mechatronics, vol. 12, no. 2, pp. 164–178, 2007.

W. Ni and D. Cheng, “Leader-following consensus of multi-agent systems under fixed and switching topologies,” Systems & Control Letters, vol. 59, no. 3-4, pp. 209–217, 2010.

W. Ren and R. W. Beard, “Consensus seeking in multiagent systems under dynamically changing interaction topologies,” IEEE Transactions on Automatic Control, vol. 50, no. 5, pp. 655–661, 2005.

Y.-P. Tian and C.-L. Liu, “Consensus of multi-agent systems with diverse input and communication delays,” IEEE Transactions on Automatic Control, vol. 53, no. 9, pp. 2122–2128, 2008.

G. Guo, L. Ding, and Q.-L. Han, “A distributed event-triggered transmission strategy for sampled-data consensus of multi-agent systems,” Automatica, vol. 50, no. 5, pp. 1489–1496, 2014.

Z.-H. Guan, Z.-W. Liu, G. Feng, and M. Jian, “Impulsive consensus algorithms for second-order multi-agent networks with sampled information,” Automatica, vol. 48, no. 7, pp. 1397–1404, 2012.

G. Wen, Z. Duan, W. Ren, and G. Chen, “Distributed consensus of multi-agent systems with general linear node dynamics and intermittent communications,” International Journal of Robust and Nonlinear Control, vol. 24, no. 16, pp. 2438–2457, 2014.

C. Ma, P. Shi, X. Zhao, and Q. Zeng, “Consensus of Euler-lagrange systems networked by sampled-data information with probabilistic time delays,” IEEE Transactions on Cybernetics, vol. 45, no. 6, pp. 1126–1133, 2015.

J. Qin and H. Gao, “A sufficient condition for convergence of sampled-data consensus for double-integrator dynamics with nonuniform and time-varying communication delays,” IEEE Transactions on Automatic Control, vol. 57, no. 9, pp. 2417–2422, 2012.

Z.-W. Liu, Z.-H. Guan, X. Shen, and G. Feng, “Consensus of multi-agent networks with aperiodic sampled communication via impulsive algorithms using position-only measurements,” The Institute of Electrical and Electronics Engineers, vol. 57, no. 10, pp. 2639–2643, 2012.

X.-M. Sun, J. Zhao, and D. J. Hill, “Stability and l2-gain analysis for switched delay systems: a delay-dependent method,” Automatica, vol. 42, no. 10, pp. 1769–1774, 2006.

X. Zhao, L. Zhang, P. Shi, and M. Liu, “Stability and stabilization of switched linear systems with mode-dependent average dwell time,” IEEE Transactions on Automatic Control, vol. 57, no. 7, pp. 1809–1815, 2012.

J.-W. Yi, Y.-W. Wang, J.-W. Xiao, and Y. Huang, “Exponential synchronization of complex dynamical networks with Markovian jump parameters and stochastic delays and its application to multi-agent systems,” Communications in Nonlinear Science and Numerical Simulation, vol. 18, no. 5, pp. 1175–1192, 2013.

A. Hu, J. Cao, M. Hu, and L. Guo, “Event-triggered consensus of Markovian jumping multi-agent systems via stochastic sampling,” IET Control Theory & Applications, vol. 9, no. 13, pp. 1964–1972, 2015.

H. Shen, Z. Wu, and J. H. Park, “Reliable mixed passive and H∞ filtering for semi-Markov jump systems with randomly occurring uncertainties and sensor failures,” International Journal of Robust and Nonlinear Control, 2014.

F. Li, L. Wu, P. Shi, and C. C. Lim, “State estimation and sliding mode control for semi-Markovian jump systems with mismatched uncertainties,” Automatica, vol. 51, pp. 385–393, 2015.

Y. Wei, J. Qiu, and S. Fu, “Mode-dependent nonrational output feedback control for continuous-time semi-Markovian jump systems with time-varying delay,” Nonlinear Analysis: Hybrid Systems, vol. 16, pp. 52–71, 2015.