We study some nonlinear gossip algorithms for wireless sensor networks. Firstly, two types of nonlinear single gossip algorithms are proposed. By using Lyapunov theory, Lagrange mean value theorem, and stochastic Lasalle’s invariance principle, we prove that the nonlinear single gossip algorithms can converge to the average of initial states with probability one. Secondly, two types of nonlinear multigossip algorithms are also presented and the convergence is proved by the same methods. Finally, computer simulation is also given to show the validity of the theoretical results.
1. Introduction
Wireless sensor networks that are composed of a large number of unreliable cheap sensors have drawn much attention from academia to industry in the past decade [1]. The sensors are deployed for the purpose of monitoring and sensing their environment over time, communicating with each other over a wireless network, and processing information that they have exchanged with each other [2]. Clearly, the primary purpose of such networks is to collect and process the sensed information by sensors rather than provide efficient communication [3]. Robustness, scalability, power consumption, memory resources, and computation ability are the main constraints of such networks. These constraints naturally lead to gossip algorithms. Gossiping is a distributed computation, where a node exchanges and updates information at each time at most with one of its neighbors according to some rules [4]. Gossip algorithms are canonical algorithmic architectural solutions to wireless sensor networks [2], whose purposes are to make all the sensors achieve agreement [5–7] or synchronization [8–11].
Recently, there emerge lots of studies on gossip algorithms in the field of wireless communication [10, 12–14] and of control systems [15–18]. In wireless sensor networks, gossip algorithms are used to solve many practical problems including distributed average, distributed estimation, source localization, and data compression [10]. These traditional gossip algorithms reach agreement by exchanging information with neighbor and averaging the exchanged information. Averaging the exchanged information can be seen as a case of liner process. However, under many practical conditions, the processing ability of sensor is nonlinear. Gossip algorithm can be viewed as a form of consensus protocol, but it differs from generic consensus protocol greatly [19–22]. The goal of consensus is to agree on the value of some quantity whereas the goal of gossiping is to compute the average of the initial values of net nodes [4]. Though nonlinear consensus algorithms have been widely investigated [23, 24], to the best of our knowledge, few studies focus on nonlinear gossip algorithm. The present study tries to address this question and proposes some novel nonlinear gossip algorithms to do the exchanged information. Two types of nonlinear single gossip algorithms and nonlinear multigossip algorithms are presented for wireless sensor networks. By using Lyapunov theory, Lagrange mean value theorem, and stochastic Lasalle’s invariance principle, we prove that the proposed algorithms converge to the average of the initial states with probability one.
The remainder of this paper is organized as follows. In Section 2, we review some concepts on graph theory and introduce the linear gossip algorithm. Nonlinear gossip algorithm is presented in Section 3. We propose two types of nonlinear single gossip algorithm and nonlinear multigossip algorithm and prove their convergence properties. Section 4 gives the computer simulation to show the validity of the theoretical results. Section 5 offers our concluding remarks and the possible research line in the future.
Notation. Let 1N be the N dimension column vector of all ones, IN={1,2,…,N}T, x(n)={x1(n),x2(n),…,xN(n)}T. The superscript “T” stands for matrix transposition. E(·) denotes the expectation of stochastic variable. IN/Im={m+1,…,N}. w.p.1 is the shortened form of with probability one.
2. Preliminaries
Suppose there is a connected wireless sensor network which consists of N sensors distributed randomly in an area. We describe this wireless sensor network by a unidirectional graph G=(V,E,A), where V={1,2,…,N} is the vertex set with each element denoting a sensor. Let E⊂V×V denote the set of links along which node pairs can communicate. A=[aij] is the adjacency matrix. If sensor i can communicate with sensor j, aij=1; otherwise, aij=0. For the purpose of simplicity, we assume that the network graph is connected and unchanged over time in terms of V and E.
The gossip algorithm can be described as the following: without loss of generality, we assume in discrete time slot (n,n+1] that node i can gossip with one of its neighbors j. First, node i sends its current information xi(n), called gossip variable, to node j. After it received this information, node j sends its own current gossip variable xj(n) to node i. Then node i and node j set their gossip variables by some rules at discrete time n+1, respectively. The gossip variables of the rest nodes remain unchanged, as showed by
(1)xi(n+1)=xi(n)+f(xj(n),xi(n)),xj(n+1)=xj(n)+f(xi(n),xj(n)),xk(n+1)=xk(n),k∈IN{i,j},
where f(xj(n),xi(n)) is a function on gossip variables xi(n) and (or) xj(n). We call f(xj(n),xi(n)) gossip function, which indicates the change introduced by the cooperation of node j to node i. When the gossip function is a linear function, for instance, f(xj(n),xi(n))=βxj(n)-αxi(n), where α,β∈(0,1) are constant, (1) becomes
(2)xi(n+1)=(1-α)xi(n)+βxj(n),xj(n+1)=(1-α)xj(n)+βxi(n),xk(n+1)=xk(n),k∈IN{i,j}.
This is the traditional gossip algorithm, which is called linear gossip algorithm. Specially, if α=β=1/2, this linear gossip algorithm is average gossip algorithm [4]. The gossip process repeats between each pair of nodes; then finally all the sensors will have the same value as the average of their initial information, which is showed as
(3)limn→∞x1(n)=limn→∞x2(n)=⋯=limn→∞xN(n)=1N∑m=1Nxm(0).
The proof of conclusion (3) can be found in [22].
3. Nonlinear Gossip Algorithms
In gossip algorithms, different gossip functions denote different gossip rules. If f(·) is a nonlinear function, then the gossip algorithm is nonlinear. We call this algorithm nonlinear gossip algorithm. Two types of nonlinear gossip algorithms are presented for single gossip algorithm and multigossip algorithm, respectively. We will give a brief statement on these two types of nonlinear gossip algorithms and deliberate their convergence properties.
3.1. Nonlinear Gossip Algorithms Type-1
In this subsection, we consider the following nonlinear gossip algorithm:
(4)xi(n+1)=xi(n)+f(xj(n)-xi(n)),xj(n+1)=xj(n)+f(xi(n)-xj(n)),xk(n+1)=xk(n),k∈IN{i,j}.
In (4), we think of the nonlinear function on the increment of gossip variables xj(n) and xi(n) as the change introduced by the cooperation of node j to node i.
Theorem 1.
Suppose the gossip function f(·) in gossip rule (4) can be any C1 continuous function which satisfies (i) f(·) is odd; (ii) 0<f′(·)<1; then all the gossip variables converge to the average of their initial values w.p.1.
Proof.
First we will prove nonlinear gossip algorithm (4) can converge w.p.1.
Without loss of generality, in (n,n+1], we randomly choose node i and node j for gossiping. Define a Lyapunov function V(n)=∑m=1Nxm2(n), and we have
(5)E[ΔV∣x(n)]=E[V(n+1)-V(n)∣x(n)]=E[∑m=1,m≠i,jNxj2(n+1)+xi2(n+1)-xj2(n)-xi2(n)+∑m=1,m≠i,jNxm2(n+1)-∑m=1,m≠i,jNxm2(n)∣x(n)]=E[2xi(n)f(xj(n)-xi(n))+f2(xj(n)-xi(n))+2xj(n)f(xi(n)-xj(n))+f2(xi(n)-xj(n))].
Since f(·) is odd, that is, f(-x)=-f(x), hence f(0)=0 and (5) can be simplified as
(6)E[ΔV∣x(n)]=E[2f(xj(n)-xi(n))×[f(xj(n)-xi(n))-(xj(n)-xi(n))]].
According to Lagrange mean value theorem
(7)f(xi(n)-xj(n))-f(0)=f′(ξ)[xi(n)-xj(n)],
and due to 0<f′(·)<1, we can forward our proof by considering all three possible cases in terms of the difference between xj(n) and xi(n):
if xj(n)-xi(n)<0, we have f(xj(n)-xi(n))<0 and f(xj(n)-xi(n))>xj(n)-xi(n); thus,
(8)E[ΔV∣x(n)]=E[V(n+1)-V(n)∣x(n)]<0;
if xj(n)-xi(n)>0, then f(xj(n)-xi(n))>0 and f(xj(n)-xi(n))<(xj(n)-xi(n)); therefore, we can also obtain E[ΔV∣x(n)]<0;
if xj(n)-xi(n)=0, then E[ΔV∣x(n)]=E[V(n+1)-V(n)∣x(n)]=0.
Hence, from (i), (ii), and (iii), we have
(9)E[ΔV∣x(n)]=E[V(n+1)-V(n)∣x(n)]≤0.
Invoking the stochastic version of LaSalle’s Theorem [25, 26], we conclude that
(10)limn→∞x(n)=c1N,w.p.1,
where c is a constant. Equation (10) indicates that the nonlinear gossip algorithms (4) can converge w.p.1.
Now we will prove that all the gossip variables converge to the average of their initial values. Consider
(11)1N∑m=1Nxm(n+1)=1N∑m=1,m≠i,jN[xm(n+1)+xi(n+1)+xj(n+1)]=1N∑m=1,m≠i,jN[xm(n)+xi(n)+f(xj(n)-xi(n))=1N∑m=1,m≠i,jN+xj(n)+f(xi(n)-xj(n))].
The gossip function f(·) is an odd function; thus f(xj(n)-xi(n))+f(xi(n)-xj(n))=0. Then, (11) can be simplified as
(12)1N∑m=1Nxm(n+1)=1N∑m=1Nxm(n).
Therefore, we have
(13)limn→∞1N∑m=1Nxm(n+1)=limn→∞1N∑m=1Nxm(n)=⋯=1N∑m=1Nxm(0).
Equation (13) implies that c=(1/N)∑m=1Nxm(0), which in turn implies that all gossip variables converge to the average of their initial values w.p.1 under nonlinear gossip rule (4).
3.2. Nonlinear Gossip Algorithms Type-2
We consider the following nonlinear gossip algorithm:
(14)xi(n+1)=xi(n)+f(xj(n))-f(xi(n)),xj(n+1)=xj(n)+f(xi(n))-f(xj(n)),xk(n+1)=xk(n),k∈IN{i,j}.
In (14), we think of the increment of the nonlinear function on gossip variables xj(n) and on gossip variables xi(n) as the change introduced by the cooperation of node j to node i.
Theorem 2.
Suppose the gossip function f(·) in gossip rule (14) can be any C1 continuous function and satisfies 0<f′(·)<1; then all the gossip variables converge to the average of their initial values w.p.1.
Proof.
Similar to the proof of Theorem 1, in (n,n+1], we randomly choose node i and node j for gossiping. We define a Lyapunov function V(n)=∑m=1Nxm2(n). From (14),
(15)E[ΔV∣x(n)]=E[V(n+1)-V(n)∣x(n)]=E[∑m=1,m≠i,jNxj2(n+1)+xi2(n+1)-xj2(n)-xi2(n)+∑m=1,m≠i,jNxm2(n+1)-∑m=1,m≠i,jNxm2(n)∣x(n)]=E[[f(xi(n))-f(xj(n))]22xi(n)[f(xj(n))-f(xi(n))]+2xj(n)[f(xi(n))-f(xj(n))]+2[f(xi(n))-f(xj(n))]2]=E[2[f(xi(n))-f(xj(n))]×[f(xi(n))-f(xj(n))-(xi(n)-xj(n))]].
According to Lagrange mean value theorem
(16)f(xi(n))-f(xj(n))-f(0)=f′(ξ)[xi(n)-xj(n)],
and due to 0<f′(·)<1, we have that
if xj(n)-xi(n)<0, we have f(xj(n))-f(xi(n))<0 and f(xj(n))-f(xi(n))>xj(n)-xi(n); thus,
(17)E[ΔV∣x(n)]=E[(V(n+1)-V(n))∣x(n)]<0;
if xj(n)-xi(n)>0, then f(xj(n))-f(xi(n))>0 and f(xj(n))-f(xi(n))<xj(n)-xi(n); therefore, we can also obtain E[ΔV∣x(n)]<0;
if xj(n)-xi(n)=0 then E[ΔV∣x(n)]=0.
Hence from (i), (ii), and (iii), we have
(18)E[ΔV∣x(n)]=E[V(n+1)-V(n)∣x(n)]≤0.
By using the stochastic version of LaSalle’s Theorem, we have
(19)limn→∞x(n)=c1N,w.p.1,
where c is a constant. Equation (19) indicates that the nonlinear gossip algorithms (14) can converge w.p.1.
Consider
(20)1N∑m=1Nxm(n+1)=1N∑m=1,m≠i,jN[xm(n)+xi(n+1)+xj(n+1)]=1N∑m=1,m≠i,jN[xm(n)+xi(n)+f(xj(n))=1N∑m=1,m≠i,jN-f(xi(n))+xj(n)=1N∑m=1,m≠i,jN+f(xi(n))-f(xj(n))]=1N∑m=1Nxm(n).
Hence we have
(21)limn→∞1N∑m=1Nxm(n+1)=limn→∞1N∑m=1Nxm(n)=⋯=1N∑m=1Nxm(0).
Equation (21) implies that c=(1/N)∑m=1Nxm(0), which in turn implies that all gossip variables converge to the average of their initial values w.p.1 under nonlinear gossip rule (14).
3.3. Nonlinear Multigossip Algorithms
In aforementioned gossip algorithms, each sensor is allowed to gossip with at most one of its neighbors in a fixed time slot, which leads to a low average convergence rate. For example when sensor i and sensor j are gossiping, another sensor k≠i,j cannot gossip with others. This gossip algorithm is single gossip algorithm. In fact, multiple pairs of sensors can gossip at the same time slot, provided each of two pairs has no common sensor, which are multigossip algorithms [4]. For example, when sensor p and sensor q are gossiping, sensor i and sensor j are also gossiping; then (i,j) and (p,q) should satisfy i≠p,q and j≠p,q. Obviously, the convergence rate of multigossip algorithms is faster than one of single gossip algorithms.
It is similar to nonlinear single gossip algorithm that we present two types of nonlinear multigossip algorithms.
Assume in discrete time slot (n,n+1] that there are r pairs of sensors, 1<r<N, (p1,q1),(p2,q2),…,(pr,qr) that can gossip, and if the gossip rules conform to type-1, then we have
(22)xpi(n+1)=xpi(n)+f(xqi(n)-xpi(n)),xqi(n+1)=xqi(n)+f(xpi(n)-xqi(n)),xk(n+1)=xk(n),k∈IN{p1,…,pr,q1,…,qr}.
Theorem 3.
In multigossip algorithm, if nonlinear function f(·) in gossip rule (22) can be any C1 continuous function which satisfies that (i) f(·) is odd; (ii) 0<f′(·)<1, then all gossip variables converge to the average of their initial values w.p.1.
Proof.
In (n,n+1], we randomly choose r pairwise nodes (p1,q1),(p2,q2),…,(pr,qr) for gossiping. By defining a Lyapunov function V(n)=∑m=1Nxm2(n), we have
(23)E[ΔV∣x(n)]=E[V(n+1)-V(n)∣x(n)]=E[∑i=1r[xpi2(n+1)+xqi2(n+1)-xpi2(n)-xqi2(n)]∣x(n)∑i=1r]=E[∑i=1r[2xpi(n)f(xqi(n)-xpi(n))+f2(xqi(n)-xpi(n))+2xqi(n)f(xpi(n)-xqi(n))+f2(xpi(n)-xqi(n))]∑i=1r].
Similar to the proof of Theorem 1, if xqi(n)-xpi(n)≠0, then E[ΔV∣x(n)]=E[V(n+1)-V(n)∣x(n)]<0; if xqi(n)-xpi(n)=0, then E[ΔV∣x(n)]=0.
Therefore we have
(24)E[ΔV∣x(n)]=E[V(n+1)-V(n)∣x(n)]≤0.
Hence, we get
(25)limn→∞x(n)=c1N,w.p.1,
where c is a constant. Equation (25) indicates that the nonlinear gossip algorithms (14) can converge w.p.1.
Consider
(26)1N∑m=1Nxm(n+1)=1r∑i=1r[xpi(n+1)+xqj(n+1)]+1N∑m=r+1Nxm(n)=1r∑i=1r[xqj(n)+f(xpi(n)-xqj(n))xpi(n)+f(xqi(n)-xpi(n))+xqj(n)+f(xpi(n)-xqj(n))]+1N-r∑m=r+1Nxm(n).
Because the gossip function f(·) is an odd function, (26) is simplified as
(27)1N∑m=1Nxm(n+1)=1N-r∑m=r+1Nxm(n)+1r∑i=1r[xpi(n)+xqj(n)]=1N∑m=1Nxm(n).
Therefore we have
(28)limn→∞1N∑m=1Nxm(n+1)=limn→∞1N∑m=1Nxm(n)=⋯=1N∑m=1Nxm(0).
Equation (28) implies that c=(1/N)∑m=1Nxm(0), which in turn implies that all gossip variables converge to the average of their initial values w.p.1 under nonlinear multigossip rule (22).
Assume in discrete time slot (n,n+1], r pairs of sensors, 1<r<N, (p1,q1),(p2,q2),…,(pr,qr) that are gossiping, and if the gossip rules conform to type-2, then we have
(29)xpi(n+1)=xpi(n)+f(xqi(n))-f(xpi(n)),xqi(n+1)=xqi(n)+f(xpi(n))-f(xqi(n)),xk(n+1)=xk(n),k∈IN{p1,…,pr,q1,…,qr}.
Theorem 4.
In multigossip algorithm, if nonlinear function f(·) in gossip rule (29) can be any C1 continuous function and satisfies 0<f′(·)<1, then all gossip variables converge to the average of their initial values w.p.1.
Proof.
The analysis is similar to the proofs of Theorems 2 and 3, and it is thus omitted here.
4. Numerical Simulation
In this section, we give several computer simulation examples for the presented nonlinear gossip algorithms. A connected wireless sensor network is considered which is composed of N=5 sensors and whose network is showed as in Figure 1. No matter what the distribution of the sensors’ gossip variables is, the proposed nonlinear algorithms can converge w.p.1. We assume the initial gossip variables of these five sensors are 0.9, 0.1, 0.5, 0.3, and 0.7, respectively. In the proposed nonlinear gossip algorithms, we require that the gossip function in type-1 satisfy two conditions: (i) f(·) is odd and (ii) 0<f′(·)<1; the gossip function in type-2 should only satisfy 0<f′(·)<1. We give a function f(x)=(1/2)arctan(x) which satisfies the above conditions. We simulate two different gossip types of nonlinear single gossip algorithms and nonlinear multigossip algorithms. The simulation results are showed in Figures 2 and 3.
The topology of wireless sensor networks.
Simulations of the single gossip algorithm for type-1 and type-2.
Simulations of the multigossip algorithm for type-1 and type-2.
Figure 2 is the simulations of nonlinear single gossip algorithms for type-1 and type-2. Figure 3 is the simulations of nonlinear multigossip algorithms for type-1 and type-2. It can be seen from Figures 2 and 3 that the proposed nonlinear gossip algorithms can converge and the convergent value is the sensors’ average of their initial values. Figures 2 and 3 also illustrate that different gossip rules have different convergence rates of nonlinear gossip algorithms.
5. Conclusion
Nonlinear gossip algorithms for wireless sensor networks are considered. It is proved that the proposed algorithms can converge to the average of the initial values with probability one. The proposed algorithm is a general approach to the gossip algorithm, while the traditional linear gossip algorithm can be viewed as a special case of the nonlinear gossip algorithm. In the simulation, we find that different gossip functions bring about different convergence rates. How to determine and accelerate the convergence rate of nonlinear gossip algorithms may worth further study.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
This work was supported by the National Natural Science Foundation of China (nos. 61371107, 61261017, and 61304160), by the Fundamental Research Funds for the Central Universities (Grant no. JB140406), and by Guangxi Natural Science Foundation (2013GXNSFAA019334).
AkyildizI. F.SuW.SankarasubramaniamY.CayirciE.Wireless sensor networks: a survey200238439342210.1016/S1389-1286(01)00302-42-s2.0-0037086890ShahD.Network gossip algorithmsProceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '09)April 20093673367610.1109/ICASSP.2009.49604232-s2.0-70349203893ShahD.2009Now PublishersLiuJ.MouS.MorseA. S.AndersonB. D. O.YuC.Deterministic gossiping20119991505152410.1109/JPROC.2011.21596892-s2.0-80051979514JiZ.LinH.YuH.Leaders in multi-agent controllability under consensus algorithm and tree topology201261991892510.1016/j.sysconle.2012.06.003ZBL1270.930172-s2.0-84864151918ZhengY.WangL.Finite-time consensus of heterogeneous multi-agent systems with and without velocity measurements201261887187810.1016/j.sysconle.2012.05.009ZBL1252.930092-s2.0-84863496064JiZ.WangZ.LinH.WangZ.Interconnection topologies for multi-agent coordination under leader-follower framework200945122857286310.1016/j.automatica.2009.09.002MR28893962-s2.0-70449658852SchenatoL.FiorentinF.Average TimeSynch: a consensus-based protocol for clock synchronization in wireless sensor networks20114791878188610.1016/j.automatica.2011.06.012MaggsM. K.O'KeefeS. G.ThielD. V.Consensus clock synchronization for wireless sensor networks20121262269227710.1109/JSEN.2011.21820452-s2.0-84860500653BoydS.GhoshA.PrabhakarB.Randomized gossip algorithms20065262508253010.1109/TIT.2006.874516MR22385562-s2.0-33745136409SuH.RongZ.ChenM. Z. Q.WangX.ChenG.WangH.Decentralized adaptive pinning control for cluster synchronization of complex dynamical networks201343139439910.1109/TSMCB.2012.22026472-s2.0-84862987036FranceschelliM.GiuaA.SeatzuC.Distributed averaging in sensor networks based on broadcast gossip algorithms201111380881710.1109/JSEN.2010.20642952-s2.0-79551619365SarwateA. D.DimakisA. G.The impact of mobility on gossip algorithms20125831731174210.1109/TIT.2011.2177753MR29328602-s2.0-84857713234DimakisA. G.KarS.MouraJ. M. F.RabbatM. G.ScaglioneA.Gossip algorithms for distributed signal processing201098111847186410.1109/JPROC.2010.20525312-s2.0-77958154089MouS.YuC.AndersonB. D. O.MorseA. S.Determinstic gossiping with a periodic protocolProceedings of the 49th IEEE Conference on Decision and Control (CDC '10)December 2010Atlanta, Ga, USA5787579110.1109/CDC.2010.57180662-s2.0-79953130078ZhengY.ZhuY.WangL.Consensus of heterogeneous multi-agent systems20115161881188810.1049/iet-cta.2011.0033MR29067432-s2.0-81255193942GaoZ.KongD.GaoC.Modeling and control of complex dynamic systems: applied mathematical aspects201220125869792MR300523110.1155/2012/869792GaoZ.KongD.GaoC.ChenM.Modeling and control of complex dynamic systems20132013315137210.1155/2013/151372Olfati-SaberR.MurrayR. M.Consensus problems in networks of agents with switching topology and time-delays20044991520153310.1109/TAC.2004.834113MR20869162-s2.0-4644244041SuH.ChenM. Z. Q.WangX.LamJ.Semiglobal observer-based Leader-following consensus with input saturation201461628422850SuH.ChenM. Z. Q.WangX.LamJ.LinZ.Semi-global leader-following consensus of linear multi-agent systems with input saturation via low gain feedback20136071881188910.1109/TCSI.2012.2226490MR30724582-s2.0-84880073411RenW.BeardR. W.Consensus seeking in multiagent systems under dynamically changing interaction topologies200550565566110.1109/TAC.2005.846556MR21415682-s2.0-20344399896NosratiS.ShafieeM.MenhajM. B.Dynamic average consensus via nonlinear protocols20124892262227010.1016/j.automatica.2012.06.031MR29569062-s2.0-84865018141SuH.ZhangN.ChenM. Z. Q.WangX.Adaptive flocking with a virtual leader of multiple agents governed by locally Lipschitz nonlinearity201314179880610.1016/j.nonrwa.2012.06.010MR29698742-s2.0-84866398950KushnerH.1971New York, NY, USAHolt, Rinehart and WinstonMR0280248HatanoY.MesbahiM.Agreement over random networks200550111867187210.1109/TAC.2005.858670MR21827422-s2.0-28644435773