Consensus Control of Second-Order Multiagent Systems with Particle Swarm Optimization Algorithm

This paper considers the consensus problem of second-order multiagent systems. Firstly, an improved consensus control protocol is proposed. Then, the convergence of the proposed control protocol is analyzed by applying Lyapunov stability theory. In order to improve the control effect of a given system, the particle swarm optimization (PSO) algorithm is introduced and an improved PSO algorithm is proposed. Additionally, a mapping relationship with agents and the individuals of PSO algorithm is designed. Finally, two simulation examples are provided to illustrate the effectiveness of proposed control protocol and the control effect of PSO algorithm.


Introduction
The cooperative control problem of multiagent systems has been attracting outstanding attention in the past few years.The main reason is its widespread application in various fields, such as robot systems [1], sensor networks [2], and unmanned aerial vehicle (UAV) systems [3].The basic problem of the cooperative control of multiagent systems is consensus, which is to design a suitable control law such that the output of all agents can achieve synchronization.
In existing literature, the consensus problem of multiagent systems has been widely researched.In [4], an observerbased distributed output feedback was considered to solve the consensus tracking problem of multiagent systems.In [5,6], the iterative learning control was applied to deal with the consensus problem of multiagent systems, while the same problem was studied by using linear quadratic regulator (LQR) in [7,8].Moreover, the cooperative tracking problem of nonlinear multiagent systems was analyzed in [9,10], and the consensus control problem of a class of third-order nonlinear multiagent was studied in [11].Furthermore, distributed control method [12], impulsive control method [13], and adaptive fuzzy output feedback control approach [14] were also applied to solve the consensus problem of multiagent systems.
To improve the control effect, some optimization algorithms, such as genetic algorithm [15], differential evolution algorithm [16], and PSO algorithm [17], have been considered by researchers.As an optimization method, PSO algorithm has the advantages of good search performance, simple implementation, and few adjustment parameters [18].Due to these advantages, PSO algorithm has gained increasing interest since it was first presented.Currently, there are many results on the applications of the PSO algorithm.For example, to analyze how different algorithmic parameters in a distributed implementation affect the total evaluation and resulting fitness, a distributed PSO algorithm for a class of multirobot systems with the obstacle surroundings was researched in [19].The nondeterministic navigation problem of UAVs was solved by using the PSO algorithm in [20], where a neighborhood control scheme was designed to eliminate the inherent weakness of PSO algorithm.In [21], the PSO algorithm was applied to deal with the three-dimensional path planning problem of UAVs.
Different from the above research results, a clustering routing algorithm with nonlinear dynamic adaptive PSO algorithm for wireless sensor networks was proposed in [22], where the whole sensor field was positioned via the improved nonlinear dynamic adaptive inertia weight and evaluation of fitness function.In [23], the PSO algorithm was applied to deal with the space trajectory optimization problem.Additionally, the result that the PSO algorithm was an efficient, reliable, and accurate method for determining optimal space trajectory was demonstrated.Furthermore, the relevant parameters of PSO algorithm are still prespecified with fixed value in some papers [19][20][21].
Motivated by these facts, we divert our attention to the consensus problem of a class of second-order multiagent systems in this work.The main contributions are outlined in two aspects.On the one hand, an improved control protocol for the given multiagent systems is proposed, and then the convergence is analyzed by the designed Lyapunov function.On the other hand, the PSO algorithm is introduced to improve control effect, where two adaptive laws are designed to adjust the updating laws of PSO algorithm.Also, a new mapping method is applied to solve the mapping problem of the agents' states and the individuals of PSO algorithm.Finally, some simulation examples are provided to illustrate the validity of our results.
The remainder of this paper is organized as follows.In Section 2, some preliminaries are briefly given.In Section 3, the consensus control problem of multiagent systems is analyzed.The fundamental theory of PSO algorithm and the mapping relationship with agents are introduced in Section 4, and simulation examples are provided in Section 5. Finally, some conclusions are drawn in Section 6.

Preliminaries
Let G = {V, E, A} denote an undirected graph which consists of  nodes, where V = {V 1 , ⋅ ⋅ ⋅ , V  } is the set of vertices and E = {(V  , V  ) : V  , V  ∈ V} ⊆ V×V is the set of edges.The weighted adjacency matrix is denoted by A = [  ] ∈  × , where   > 0 if and only if  ̸ =  and   = 0 otherwise.A path between V  and V  is a sequence of distinct vertices V  , V  1 , ⋅ ⋅ ⋅ , V  , where (V  , V  1 ) ∈ E.An undirected graph is connected if there exists a path from any node  to any other node .Multiagent systems consist of  agents.Each agent can be described as a node and the exchange information among agents can be expressed as an edge with definite weight in a generalized graph.Therefore, the problem of multiagent systems can be solved through the graph theory.
For the sake of disscusion below, some difinitions and lemmas are given as follows.

Consensus Analysis of Multiagent Systems
Considering a general second-order multiagent systems with undirected graph, the dynamics of the th agent are described as where   () ∈ , V  () ∈  and   () ∈  are the position, velocity, and control input of agent , respectively;  ∈ {1, ⋅ ⋅ ⋅ , } and  is the number of agents.
In this paper, a suitable control protocol   () needs to be chosen for the multiagent systems (2) to achieve consensus.Inspired by the results of [25,26], an improved control protocol is given as and the general form of ( 3) is described as where  and  are positive constants;   is the (, ) element of A and (⋅) is an odd function.
For the convenience of analysis, the time variable  will be ignored from here on.
According to (4), ( 2) is rewritten as Hence, we have the following Theorem.
Proof.Let   =   −   , and then have Design the Lyapunov function candidate with From ( 8) and ( 9), it is obvious that  1 ≥ 0 and  2 ≥ 0; then  ≥ 0 can be obtained.Taking the derivative of function   ( = 1, 2), we get Considering Lemma 2, we have From ( 12) and ( 13), one gets Due to the assumption that G is undirected and connected and (⋅) is an odd function, it is obtained that () > 0. Hence, the following result is held: and (⋅) represents the vector space of V.
Combining V  = V  ( ̸ = ) and ( 7), then we have Position and velocity of particles Position and velocity of multi-agent systems In addition, In view of the exchange information topology graph G is undirected, and there exists (  ) = −(  ); we have From ( 16) and ( 18), (1 × ) T V = 0 can be obtained, indicating that V is orthogonal to 1 × .Hence, V = 0 is deduced, and then we have and which hints that From ( 21), we have   (  −   )(  ) = 0, ∀ ̸ = ; then   =   , ∀ ̸ =  is obtained.Thereby, the results that   =   and V  = V  for ,  ∈ 1, ⋅ ⋅ ⋅ ,  and  ̸ =  are obtained.The proof is completed.
In order to improve the control effect, the PSO algorithm will be introduced in the following disscusion.particle include position, velocity, and fitness value.The fitness value is calculated by the fitness function, where the merit of the particle is described by the fitness valule.In the solution space, each paritcle's position and velocity are updated by the individual extremum   and the population extremum   , where   and   are updated by comparing the fitness value of the new particle.Considering a  dimension search space, let  = ( 1 , ⋅ ⋅ ⋅ ,   ) be a population with  particles.The position and velocity of the th particle are defined as   = ( 1 , ⋅ ⋅ ⋅ ,   ) T and   = (V 1 , ⋅ ⋅ ⋅ , V  ) T , respectively.The extremum of individual and population are defined as  , = ( ,1 , ⋅ ⋅ ⋅ ,  , ) T and   = ( ,1 , ⋅ ⋅ ⋅ ,  , ) T , respectively.The velocity and position updating laws of the th particle at the ( + 1)th iteration are given as

PSO Algorithm and the Mapping Relationship with Agents
where    and    are the th position and velocity component of the th individual, respectively;  ∈ (0, 1] is inertia weight;   ( = 1, 2) ≥ 0 are acceleration factors;   ( = 1, 2) ∈ [0, 1] are random numbers between 0 and 1;  , is the th best position component of the th individual and  , is the th best position of the entire population.
In this paper, the updating laws ( 22) and ( 23) are improved and the results are given as where Remark 4. From ( 26) and ( 27), note that the attributes of   1 and   2 are the same as those of  1 and  2 .However, compared with  1 and  2 ,   1 and   2 not only overcome the uncertainty of random variation but also have the capacity of adaptive adjustment.In addition, due to Δ being introduced in the updating law (25), the smoothness of the convergence result can be guaranteed in the end of the algorithm.
As an important part of PSO algorithm, the fitness function in this paper is designed as where  =  is the dimension of each particle;    is the fitness value of the th particle in the th iteration;  0  and V 0  are the initial states of agents and  ∈ (1, ⋅ ⋅ ⋅ , ) represents the th iteration.Velocity consensus (m) Ｒ 1 (scheme 1) Ｒ 1 (scheme 2) Ｒ 2 (scheme 1) Ｒ 2 (scheme 2) Ｒ 3 (scheme 1) Ｒ 3 (scheme 2) Ｒ 4 (scheme 1) Ｒ 4 (scheme 2)  Let  max and Δ be the simulation time and simulation step, respectively.Hence, the maximum number of iterations  is defined as 4.2.Mapping Relationship Design.For a multiagent systems with  agents, each agent is considered as a particle.Let   and V  be the position and velocity of the th agent, respectively.Then the sets of position and velocity are expressed as In the PSO algorithm, let  , = ( 1 , ⋅ ⋅ ⋅ ,   ) and  , = (V 1 , ⋅ ⋅ ⋅ , V  ) be the position and velocity of the th particle, respectively.Consequently, the mapping relationship between particles and agents is shown in Figure 1.
The operation process of PSO algorithm is given as follows: Step 1. Initialize the population and the position and velocity of all agents.
Step 2. Assign the position and velocity   and V  to each particle.
Step 3. Run system model and calculate the fitness function (29).
Step 4. Judge the termination codmitions and update    and    according to (24) and (25).
The flowchart is shown in Figure 2.
In addition, the updating laws ( 26), (27), and (28) are used for (24) and (25), respectively.According to the number of agents, it can be deducted that the dimension  = 8.To illustrate the validity of proposed control protocol (3) and the control effect of PSO algorithm, the following simulation examples are provided.
Example 5 (comparison the control protocol (3) and the standard PSO algorithm).In this example, we consider the consensus of multiagent systems (2) with control protocol (3) (scheme 1) and the standard PSO algorithm ( 22) and ( 23) (scheme 2); the simualtion results are shown in Figures 4-6.
The consensus of position and velocity with the control protocol (3) are shown in Figure 4.It can be found that the control effects are not good from Figure 4. Applying the standard PSO algorithm, the comparison results are drawn in Figures 5 and 6.Compared with control protocol (3), the consensus achieving time and the overshoot have been greatly improved by using the PSO algorithm.
Example 6 (comparison the standard PSO algorithm and the improved PSO algorithm).In this example, the consensus of the multiagent systems (2) with the standard PSO algorithm (22) and (23) (scheme 2) and the improved PSO algorithm (24) and (25) (scheme 3) is considered; the simualtion results are shown in Figures 7 and 8.
From Figures 7 and 8, it can be seen that the output of all agents have been further improved.Compared with the srtandard PSO alorithm, the improved PSO algorithm not only reduces the consensus achieving time and overshoot but also makes the curves smoother.In general, in the ability to improve the control effect of the multiagent systems, the Ｐ 1 (scheme 2) Ｐ 1 (scheme 3) Ｐ 2 (scheme 2) Ｐ 2 (scheme 3) Ｐ 3 (scheme 2) Ｐ 3 (scheme 3) Ｐ 4 (scheme 2) Ｐ 4 (scheme 3) improved PSO algorithm proposed in this paper is superior to the other two proposed approaches.

Conclusion
In this paper, we discussed the consensus problem of a class of second-order multiagent systems with the PSO algorithm.An improved consensus protocol was designed, and then the convergence was analyzed by the Lyapunov stability theory.The PSO algorithm was introduced to improve the control effect of the multiagent systems.And then an improved PSO algorithm was proposed.In addition, we designed a mapping relationship with the agents and the individuals of PSO algorithm.Finally, the simulation results showed that the consensus with the proposed control protocol can be achieved.Also, the control effect can be improved by using PSO algorithm; and the better control effect can be obtained by utilizing the improved PSO algorithm.

Figure 5 :
Figure 5: Position comparison results with standard PSO algorithm and control protocol (3).

Figure 7 :
Figure 7: Position comparison results with standard PSO algorithm and improved PSO algorithm.

Figure 8 :
Figure 8: Velocity comparison results with standard PSO algorithm and improved PSO algorithm.