Synchronization of Hybrid Microgrids with Communication Latency

A distributed cooperative control scheme is proposed in order to implement a distributed secondary control for hybrid lossy microgrids. The designed distributed control is able to synchronize the frequency of inverse-based distributed generators (DGs) and minisynchronous generators (MSGs/SGs) to the desired state with a virtual leader DG/SG (reference value) in a distribution switching network under the existence of time-varying communication delays. The secondary control stage selects suitable frequencies of each DG/SG such that they can be synchronized at the desired set point. Using the proposed algorithm, each DG/SG only needs to communicate with its neighboring DGs/SGs intermittently even if the communication networks are local, the topology is time-varying, and the communication delays may exist. Therefore, the failure of a single DG/SG will not produce the failing down of the whole system. Sufficient conditions on the requirements for the network connectivity and the delays boundedness which guarantees the stability and synchronization of the controlled hybrid lossy microgrid power systems are presented. The feasibility of the proposed control methodology is verified by the simulation of a given lossy microgrid test system.


Introduction
The recent changes in the structure of power generation towards a distributed generation have motivated the increasing interest in the control of so-called microgrids.As the main building blocks of smart grids, microgrids are small-scale power systems that facilitate the effective integration of highly hybrid and heterogeneous DGs and storage devices including solar (photovoltaic array), wind, microturbines, supercapacitor, and batteries [1,2].The structure of hybrid microgrid is as shown in Figure 1.Many of these energy sources and storage devices generate or reserve variable frequency AC/DC power and are interfaced with a synchronous AC grid via power electronic DC/AC inverters [3].Meanwhile, with the rapid growth of power electronics techniques on MSGs or virtual SGs, the increasing application of clear energy sources, including diesel plants, wind plants, and geothermal plants, also makes them possible to be integrated into microgrids.Therefore, new control strategies on how to preserve the synchronization and proportional power sharing in the connected or isolated manner are demanded for the network [4].
Recently, hierarchical control for microgrids has been proposed in order to standardize their operation and functionalities, that is, primary control [5] (droop control maintaining voltage and frequency stability of the microgrid subsequent to the islanding process), secondary control [6] (compensating the voltage and frequency derivations caused by primary control), and tertiary control [7] (optimal operation in both operating modes and power flow control in grid-connected mode).
However, the conventional secondary control of microgrids assumes a centralized control structure which requires a complex communication network and a central controller.A central controller reduces the system reliability [8].Additionally, some literatures point that physical and communication structures of microgrid can be time-varying because of the desired plug-and-play capability of microgrids [9].From this perspective, the distributed control structure provides a robust secondary control framework [10,11].It could largely reduce the system reliability [12,13].In contrast, decentralised control structures are adopted in [14,15] to avoid the above drawbacks.Nevertheless, for the large-scale microgrids, it is impossible to determine and maintain a feasible operating condition if all of the DGs are running independently.Alternatively, affected by the idea of cooperation control for multiagent systems [16][17][18][19][20][21], there are increasing researchers who begin to focus on the distributed control structures which allow all the DGs to communicate with their neighbors and share information among neighboring units via local sparse communication networks [22][23][24][25][26].
Particularly, in paper [27], the authors proposed a secondary voltage and frequency control scheme based on the distributed cooperative control of multiagent systems and thus improved the system reliability.In order to regulate the power output of a microgrid dynamics consisting of a large amount of photovoltaic generators, [28] presented a selforganizing strategy in a distributed time-varying network.
The main common features of the above literatures lie in that a distributed communication network has been taken as a basis for the control strategies designed.In this case, the network variability and communication delays are usually unavoidable.They cannot be neglected for the system stability analysis [29,30].In fact, in normal circumstances, the microgrids frequency fluctuation and the amplitudes of each DG unit response to primary frequency control are very small.For the purpose of efficient signal transmission, it is inevitable to induce some disturbance and time-delays during the signal processing.Hence, in [29], decentralized inverter control algorithms for power sharing with nonnegligible constant communication delays are investigated.Also, by using the small-signal analysis method, a distributed secondary voltage and frequency control for reactive power sharing are discussed in [30], in which the constant communication delays are analyzed only in an experimental simulation way.
In view of the above analysis, most research on synchronization and power sharing of microgrids has focused on purely inverter-based systems.However, from a practical consideration, most present and near-future applications involve networks of mixed generation mode including SGs and inverter-based DGs and/or storage devices [31].This paper aims to develop a distributed cooperative control scheme for hybrid microgrids that is able to synchronize the frequency of DGs/SGs to the desired state with a virtual leader DG/SG (reference value) in a distribution switching network under the existence of time-varying communication delays.Combining with the conventional droop control technique, the distributed cooperative control algorithm is designed and deployed into the secondary control stage, in which manner the control derivation produced during the primary control stage can be well restored.And the secondary control stage selects suitable frequencies of each DG/SG such that they can synchronize to the desired state.With the proposed algorithms, each DG/SG only needs to communicate with its neighboring DGs/SGs intermittently even if the communication networks are local, the topology is time-varying, and the communication delays may exist.Sufficient conditions on the requirements for the network connectivity and the delays boundedness that guarantees the stability and reliability of the controlled microgrid power systems are presented.The effectiveness of the proposed control methodology is verified by the simulation of a lossy microgrid test system.
The main contributions of this paper lie in the following aspects.Firstly, in order to restore the frequency in hybrid lossy microgrids, one first designs a distributed secondary control algorithm to synchronize the frequency of each DG/SG to the desired state (reference value 50 Hz).Secondly, the considered distributed communication network is local and time-varying and with time-varying communication delays.By Lyapunov-Krasovskii stable analysis technique, sufficient conditions on the requirements for the network connectivity and the delays boundedness that guarantees the stability and synchronization of the controlled microgrid power systems are presented.
The rest of this paper is organized as follows.In Section 2, the droop-based distributed cooperative control for microgrids problem is formulated and several necessary lemmas are then given.The distributed cooperative algorithm is designed for realizing the frequency restoration in Section 3. Section 4 gives some typical examples to verify the effectiveness of the proposed algorithm.Finally, some concluding remarks are drawn in Section 5.

Problem Formulation
In normal situation, the microgrid is operating with the nominal frequency and voltage magnitudes.The objective of primary control is to maintain the frequency and/or voltage magnitudes near around its nominal value once user demands and/or power supply changes.Herein our attentions are restricted to the frequency regulation, so the inverters are considered as voltage source with constant voltage amplitude.And we adopt the physically reasonable and widely adopted assumption of an inductive microgrid [26].
The procedure of primary and secondary control is as shown in Figure 2. In the steady state, the load power curve   (after linearization processing) and the generator power curve   (after linearization processing) have a balance point at , whose coordinate is ( nom ,  nom ).The frequency  will decrease by Δ in order to make the output power of the DG/SG increase to the point .Due to the inherent defects of primary control, the increase of the generator power Δ  in the above case is smaller than the actual increase in the load power Δ.In order to compensate the frequency deviation produced by the primary control, secondary frequency control (the green lines in Figure 2) is deployed to regulate the frequency Δ such that the intersection point  moves to .

Droop Characters of SGs in Electrical Networks.
For the dynamics of SGs, we consider the conventional expression of a regulated SG by a constant voltage behind transient reactance [24].The so-called regulated machine is always equipped with a speed governor connected to a governing system.The speed governor is controlled to adjust the output of turbine mechanical power    and its speed.Droop control is the intrinsic characteristic to maintain system stability.Here, we assume that there is an approximate linear relationship between the valve position and the mechanical power.It is worth noting that the mechanical speed   is different from the electrical speed , but their relationship is  = (/2)  , where  is the number of machine poles [31].Droop control eventually can be expressed as follows: where  is an input signal,   is an output signal, and 1/ k denotes the droop coefficient.The  ,nom is a constant and the nominal set point for the mechanical power.

Droop Control for Inverter-Based DGs Networks.
From the above theoretical analysis, the droop technique deployed in primary controller for DGs during the multiple loop control process can be given by where  nom is chosen from the nominal set point of frequency of the DG unit,  is the measured active powers at the DG terminal,   is the associated droop coefficient that is usually selected based on the active power rating, and  nom is chosen from the nominal set point of active power of the DG unit.
The control process of each DG generally consists of three control loops (as shown in Figure 3), that is, the power controller, voltage magnitudes controller, and current controller.
The active power   and reactive power   of the th DG are calculated based on the low-pass filter (with cutoff frequency    ), measured output voltage magnitude, and output current.They can be described by the following equations, respectively: The nominal value of output frequency  nom  of the power controller is used by the sinusoidal pulse width modulation (SPWM) inverter as frequency reference, while the voltage reference of the SPWM inverter needs to be regulated by the following voltage and current controllers.Based on the references provided by the power controller,  od,nom  and

𝑉 oq,nom 𝑖
, the output of the voltage magnitude controller is given by where    and    are the proportional and integral gains of the voltage magnitudes controller of th DG, respectively, while   and  are the capacitance of the LC filter and feedforward gain, respectively.On the other hand, based on the references provided by the voltage magnitudes controller,  od,nom  and  oq,nom  , the output of the current controller is given by The dynamics of a frequency droop-controlled inverter (2) and a regulated SG (1) are equivalent (see [9] for details on relevant proof).Therefore, next on the analysis of the droop control, DGs and SGs will be considered to be of the same features and deploy the same dynamic model.
Since inverters may connect pure storage devices, for example, batteries, to the network,  nom,stor  can also take negative values.In that case, the storage device is charged in dependency of the excess power available in the network and thus functions as a frequency dependent load.

Secondary Control for Hybrid Microgrid.
The conventional secondary control is a kind of centralized control methods, the nominal value  nom is used in the primary control stage, and it will be regulated gradually in each cycle of secondary control process.Note that the final desired frequency value can be measured from the main grid in the connected mode or obtained by command generator or many forms of DG/SG such as fuel-cells and microturbines in the islanded mode.
Different from the conventional secondary control with centralized mode, this paper in the secondary frequency control stage proposes one distributed cooperative control algorithm for each DG/SG.The basic idea of the proposed distributed control is by incorporating local communication networks that share information among neighboring units.
From this perspective, a microgrid can be considered as a multiagent system, where each DG/SG is an agent.The secondary control design for frequency resembles a tracking synchronization problem while that design for proportional power sharing is carried out.For this purpose, the important network digraph theory is introduced in the following.

Graph Theory.
In this paper, the required communication network for microgrids can be modeled by a digraph G(V, , A), where the node set V = {V 1 , V 2 , . . ., V  } denotes the set of DGs/SGs, the set of edges  ⊆ V × V denotes the communication links among DGs/SGs, and A = (  ) × is a weighted adjacency matrix defined as   = 0 and   ≥ 0.   > 0 if and only if the edge (V  , V  ) ∈ .The set of neighbors of the th DG/SG V  is given by The degree matrix is defined as  = diag{ 1 , . . .,   } with   = ∑ ∈    , and then  =  −  is the Laplacian matrix, which has all row sums equal to zero; that is, 1  = 0, with 1  = (1, . . ., 1)  ∈   .
In the following, the digraph G is used to describe the interconnection topology of a microgrid consisting of one virtual leader DG/SG, denoted by 0, and followers DGs/SGs, denoted by 1, . . ., .Diagonal matrix  = diag{ 10 , . . .,  0 } is called the leader adjacency matrix, where  0 > 0 if follower DG/SG V  is connected to the leader across the communication link (V 0 , V  ); otherwise  0 = 0.The following lemma plays an important role in the proof of our main results.

Main Results
In this section, one will discuss the distributed cooperative control schemes for frequency and power sharing in Sections 3.1 and 3.2, respectively.It should be noted that the dynamics of the voltage and current control loops are much faster than the dynamics of the power control loop [30].Therefore, it is necessary and intentional to design a typical inverter system by applying the time separation operation [6].In order to facilitate our analysis, this paper will focus on the stability of power control loop, while the investigation of current controllers follows traditional proportional-integral (PI) controllers.

Distributed Cooperative Control for Frequency.
In this paper, the - reference frame transformation is considered, where the -axis and -axis of the reference frame of each inverter are rotating at the common reference frequency.Based on the traditional droop control strategy, the reference of frequency of the th inverter-based DG or SG is determined by the power control loop and can be abstracted as where  nom  is the nominal set point of output frequency and  nom  is the nominal set point of output active, respectively, while    is the frequency droop coefficient.In the following, a distributed pinning control algorithm is designed to pin the frequency   of DGs/SGs to synchronize the reference frequency  ref , respectively.
Then the nominal control input  nom  used in the droop control procedure can be computed by the following integrator: Since it is assumed that each DG/SG only needs to communicate with its neighboring DGs/SGs through a communication network, the pinning controllers    are designed based on the own information of each DG/SG and the information of its neighbors: for  = 1, . . ., , where the time-varying delay () ≥ 0 is a continuously differentiable function and the factors of adjacency matrix   () are also allowed to be dynamically changing.
Theorem 2. Suppose that the digraph G  is always strongly connected and there exists at least one  ∈ {1, . . ., } such that  0 > 0 for any switching signal  = ().If the time-varying delays () satisfy () <  and τ () <  1 < 1, then the distributed controllers ( 9) can pin the DG/SG output frequency   to the reference states  ref asymptotically.
Along the trajectory of system (10), we have ⋅   ( −  ()) . ( By Newton-Leibniz formula, ė  () d (13) and noting that 2   ≤    −1  +    hold for any appropriate positive definite matrix , we have Consequently, Then, a sufficient condition for V() < 0 is which leads to Then, one can deduce that for given  1 < 1.This completes the proof.
Remark 3. As we all know, the communication latency is a key factor that cannot be ignored in the smart microgrid control problem since many cases have proven that neglect of the communication latency will lead to serious and unpredictable consequences.When analyzing the nonlinear systems containing time-varying communication latency, most existing literatures presented some delay independent stability conditions or just require that the delay is sufficiently small.However, in order to investigate the upper bound of the amount of time-varying delay, this paper constructs a Lyapunov-Krasovskii functional (i.e., ()) with delayrelated parameters.It is worthy pointing out that, for the presented nonlinear system with directed and switching topology, the asymmetry of the adjacency matrix and the nonlinearity of the controlled systems will increase the difficulty to construct () and analyze its stability.By using the special matrix theory, inequality theory, and theory of delay differential equations, this paper solves the above problems.

Active Power Sharing.
It is [26] that has proposed a method on how to choose the frequency droop coefficients and nominal setpoints to keep DGs/SGs realizing the active power sharing according to their power ratings.This control goal is analyzed in many literatures and spread to actual applications [5].The proposed proportional power sharing method also can guarantee that storage devices in charging mode, that is,  nom,stor  for some  ∈ , are charged proportionally.
In the following, the DGs/SGs proportionally share their power in terms of their power ratings  max  if the gains    and setpoints  nom  are chosen such that, for all  = 1, . . ., , the condition      =      is standard in the microgrid research: where  max  and  max  are the instantaneous maximum capacity of   and   and all the  max  and  max  are assumed to have the same sign.The active powers of DGs/SGs are able to be controlled according to condition (19) and droop control (2) the active power sharing proportionally.Condition (19) that also has a guiding significance achieves the reactive power sharing.

Simulation Results and Discussion
In this section, the effectiveness of the proposed distributed control algorithms will be verified by simulating an islanded lossy microgrid in MATLAB.Based on the above analysis for the identity property on dynamics of DGs and SGs, without loss of generality, five DGs have been chosen to the test system.Figure 4 shows the basic diagram of the test system which consists of five DGs.The specifications of the DGs, lines, and loads are summarized in Table 1.Note that its communication topology can be abstracted as digraph G 1 shown in Figure 5.The associated Laplacian matrix of G 1 is ) ,  and the corresponding leader adjacency matrix can be chosen as  1 = diag{0.005,0, 0.005, 0, 0}.
(1) Case 1 (fixed topology).Consider a directed communication network with five DGs as shown in G 1 .Figures 6 and 7 show the state evolution processes of frequency, corresponding to active power with and without delay, respectively.It is assumed that the demands of loads increase suddenly the islanded operation microgrid at  = 0.4 s.As seen in Figure 6(a), after islanding, each DG's frequency  goes to different values less than reference value  ref = 2 = 314 rad/s.Then the primary control and secondary control are applied at  = 0.5 s and  = 1 s, respectively.Due to the droop control technique, each DG's frequency  converges to stability value still less than reference value.However, the secondary control restores the operating frequency to synchronize their reference value after 1.6 s.
Comparing Figures 6 and 7, respectively, one finds that the existence of communication delay postpones the convergence speed of frequency.
Figures 8 and 9 show the state evolution processes of frequency, corresponding to active power with and without delay, respectively.Comparing Figures 6-7 and Figures 8-9, it is not difficult to find that the evolution curves in Figures 8-9 contain some slight oscillation phases.It is because that the controlled system in this case contains frequent switching signals.Similarly, the communication delay also postpones the convergence speed of the whole switching system.However, if we take the large delay () = (2 + sin())/32 which does not satisfy the constraint conditions in Theorem 2, the proposed distributed control algorithms may be ineffective.As shown in Figure 10, the state evolution curves do not converge to the desired values in switching case.

Conclusion
In this paper, a distributed cooperative control scheme for hybrid lossy microgrids has been proposed.In this method, a distributed secondary control encompasses each DG/SG local controller and the communication system; that is, each DG/SG only needs to communicate with its neighboring DGs/SGs intermittently even though the communication delays may be time-varying.The designed distributed control is able to synchronize the frequency of hybrid lossy microgrids to the desired state (50 Hz) in a distribution switching network under the existence of time-varying communication delays.All the frequency of DGs/SGs can be synchronized to the desired value in both fixed and switching distributed networks.Meanwhile, numerical simulations show higher robustness in front large communication latency.

Figure 2 :
Figure 2: Primary and secondary frequency regulation.

Figure 3 :
Figure 3: The multiple loop control schematic of the inverter in microgrids.

Figure 4 :
Figure 4: The fixed communication network of DGs.

Figure 10 :
Figure 10: The state evolution processes of frequency, active power with large delay under Γ.

Table 1 :
Parameter values for test system.
The state evolution processes of frequency, active power with delay under G 1 .The state evolution processes of frequency, active power with delay under Γ.
Figure 7: The state evolution processes of frequency, active power without delay under G 1 .Figure 9: The state evolution processes of frequency, active power without delay under Γ.