Multiobjective Optimal Control for Hydraulic Turbine Governing System Based on an Improved MOGWO Algorithm

Hydraulic turbine governing system (HTGS) is essential equipment which regulates frequency and power of the power grids. In previous studies, optimal control of HTGS is always aiming at one single operation condition.The variation of operation conditions of HTGS is seldom considered. In this paper, multiobjective optimal function is proposed for HTGS under multiple operation conditions. In order to optimize the solution to the multiobjective problems, a novel multiobjective grey wolf optimizer algorithm with searching factor (sMOGWO) is also proposed with two improvements: adding searching step to search more no-domain solutions nearby the wolves and adjusting control parameters to keep exploration ability in later period. At first, the searching ability of the sMOGWO has been verified on several UF test problems by statistical analysis. And then, the sMOGWO is applied to optimize the solutions of the multiobjective problems of HTGS, while different algorithms are employed for comparison. The experimental results indicate that the sMOGWO is more effective algorithm and improves the control quality of the HTGS under multiple operation conditions.


Introduction
With the increase of people's consciousness of environmental protection, more and more renewable energy has been applied to replace the traditional energy, such as wind power [1,2] and solar power [3]. As wind power and solar power are connected with the large-scale power grid, people want to maximally utilize renewable energy on the premise that power balance is maintained [4][5][6]. However, the output of wind power and solar power is not steady due to the intermittent and fluctuating nature. Therefore the power grid needs regulating equipment to keep power balance. As the hydroelectric unit is easier for changing the output power, it has been widely used as power and frequency regulating equipment in power grid [7,8].
Hydraulic turbine governing system (HTGS) which mostly contains PID controller is important automatic control equipment of hydroelectric unit [9]. The HTGS can adjust the output power of hydroelectric unit by changing the opening of guide. Therefore the control quality of HTGS influences the regulation quality of hydroelectric unit directly.
Many research works have been done to improve the control quality; these works can be mainly divided into two categories: proposed new control models instead of PID controller and optimized control parameters of HTGS. In [10], a fractional order PID controller, whose order of derivative portion and integral portion is not integer, is proposed for HTGS. The fractional order PID controller provides more flexibility in achieving control objective. In [11], a fuzzy-PID controller is designed to improve control quality of HTGS. In [12], the sliding mode variable structure control strategy led to HTGS which has better robustness and adaptability than PID controller. In [13], a new adaptive inverse control method based on the learning characteristic of neural network was proposed for HTGS to improve the dynamic and stationary performance. All the above control models are useful, but they ignore that it is hard to change the control device to reach the control models for most operating hydroelectric units. Thus control parameter optimization seems more suitable to improve control quality for actual situation. To optimize PID controller, some popular optimization algorithms, including genetic algorithm (GA) [14], particle swarm optimization 2 Complexity (PSO) [15], gravitational search algorithm (GSA) [16,17], and ant lion optimization (ALO) [18], have been successfully applied in parameter optimization of HTGS. All these algorithms optimize the PID parameters by optimizing one objective function which means the optimal parameters are under one single operating condition; few of the researches have taken multiple operation conditions into consideration. The optimal results may not be suitable for variation of operation conditions of HTGS. Therefore, the study on parameter optimal control of HTGS under multiple operation conditions is meaningful and challengeable.
Parameter optimal control of HTGS under multiple operation conditions actually refers to the multiobjective optimization problems. Some multiobjective optimization algorithms have been proposed and successfully applied in various applications in decades [19][20][21][22][23][24][25], such as nondominated sorting genetic algorithm II (NSGA-II) [19], multiobjective evolutionary algorithm based on decomposition (MOEA/D) [21], the strength Pareto evolutionary algorithm (PESA-II) [22], multiobjective particle swarm optimization (MOPSO) [23], and the multiobjective grey wolf optimizer (MOGWO) [25]. Among these multiobjective optimization algorithms, MOGWO algorithm has proved to be effective in multiobjective optimization problems than other algorithms [25]. However, as the guidance of lead wolves is much greater than the random factor, this algorithm is easy to fall into local optimum and has poor stability. Therefore it is necessary to enhance the searching ability of MOGWO.
The main contribution of this paper is the design and optimization of HTGS under multiple operation conditions by using an improved MOGWO algorithm. Firstly, the problem in optimal control of HTGS is explained and multiobjective optimal function is proposed. Secondly, a novel MOGWO algorithm based on searching factor (sMOGWO) is proposed to optimize the multiobjective problem. The sMOGWO is expected to improve the searching ability of MOGWO from two aspects: adding searching step to search more no-domain solutions nearby the wolves and adjusting control parameters to keep exploration ability in later period.
The remaining part of this paper is organized as follows: the HTGS model and its control problem are discussed in Section 2. In Section 3, the weakness of MOGWO algorithm is analyzed and an improved MOGWO algorithm is proposed. In Section 4, simulation verification is present to demonstrate the advantage of the proposed sMOGWO algorithm compared with MOGWO, MOPSO, and other popular multiobjective evolutionary algorithms. Section 5 illustrates the case study and results along with a few discussions. Finally, conclusions from this research as well as the advantages and limitations of the proposed algorithm are discussed in Section 6.

HTGS Model and Its Control Problems
2.1. The HTGS Model. The HTGS is essential equipment of the hydropower station. The HTGS contains PID controller, electrohydraulic servo system, hydroturbine, and hydrogenerator.
The PID controller has been widely used in HTGS. In this paper, the structure of the PID controller model and electrohydraulic servo system is set as in Figure 1. Many nonlinear factors have been considered in the electrohydraulic servo system, such as the dead zone and the relay device limiting, where x r is the frequency giving; x u is the disturbance frequency; x is the frequency of the hydrogenerator unit; k p , k d , k i are the proportionality coefficient, differential coefficient, and integration coefficient, respectively; 1V is the differential filtering time constant; b p is the permanent difference coefficient; T y is the response time constant of main control valve; and y represents the gate opening.
The hydroturbine is a complex system with strong nonlinear and time-varying character. Generally, the hydroturbine model can be descripted as follows: where m t is the hydraulic machinery power, q is discharge of hydraulic turbine, y represents the gate opening, represents speed of hydraulic turbine, and h represents the water head.
In this paper, the little fluctuation in transient of hydraulic power station is researched; the model of hydraulic turbine can be described as liner model, as follows: where e h is the transfer coefficient of turbine torque on the water head, e y is the transfer coefficient of turbine torque on the guide leaf opening, e x is the transfer coefficient of turbine torque on the speed, is the transfer coefficient of turbine flow on the speed, the transfer coefficient of turbine flow on guide leaf opening, and ℎ is the transfer coefficient of turbine flow on the water head. In water diversion system, the water hammer and pipe wall can be considered as rigid under small fluctuations. The transfer function of rigid water diversion system can be expressed as where is the water inertia time constant. In this paper, the core problem is the dynamic response of the HTGS. Hence, the dynamic speed of the generator is considered. The model of the generator can be described as the following transfer function: where x represents the frequency of the hydrogenerator unit, T a represents the inertia time constant, and is the adaptive control coefficient. As in the above description of the mathematical model, the hydrogenerator unit model can be described as the block diagram in Figure 2.

Optimal Control of HTGS and Problems Analysis.
The performance indexes of the optimal control of the HTGS are the most direct measure to evaluate the control quality. Therefore, the optimal control of the HTGS is the optimal control of performance indexes. The objective functions of optimal control are formed by a certain performance index or several performance indexes in most researches. The performance indexes in HTGS can be mainly divided into the following two categories [26]: (i) Performance indexes for the transition process mainly include adjusting time, rising time, steady state error, and overshoot.
(ii) Performance indexes of error functional integral mainly include integral time absolute error (ITAE), integral absolute error (IAE), integral square time absolute error (ISTAE), integral square time square error (ISTSE), integral time square error (ITSE), and integral square error (ISE).
The performance indexes of error functional integral are comprehensive indexes which make optimal control easier to meet the control requirements. The ITAE is one of the most widely used which has the characteristics of steady adjustment and small overshoot.
Many researches have been done for optimal control of HTGS by optimizing ITAE. However most of the researches are for one single operation condition. As the hydrogenerator usually plays the roles of generating electricity, peak modulation, frequency modulation, and voltage modulation, there is a variety of operation conditions and frequent changes. The optimal control parameters may not be suitable for all the operation conditions.
Here, we will give an example to explain this problem. Parameters of two classical operation conditions of the above HGTS model are given as follows: 34, e y =0.926, e x =-1.184, =0.371, =0.974, ℎ =0.308. 5% step disturbance is set for HGTS. The optimal control parameters of HTGS under no-load condition are acquired by optimizing ITAE. The parameters are K p =14.665, K i =3.026, and K d =0. The control transient process is shown in Figure 3. The control effect is well. However, if the parameters are used for the on-load condition, it is an ineffective control strategy.
The result indicates that the optimal control parameters of one single operation condition cannot be suitable for all the operation conditions. Accordingly, the optimal control of HTGS is a multiobjective optimization problem in fact. In this paper, we have proposed a novel control parameters optimization objective function. Different operation conditions are considered for optimal control. Because the no-load and on-load are the extreme operating conditions, the ITAE of both conditions are the objective functions. The objective function can be described as follows: where f 1 and f 2 represent the relationship between the parameters and the ITAE. Equation (6) represents the range of parameters.

An Improved MOGWO Algorithm
MOGWO algorithm as a new intelligent optimization algorithm has a better convergence rate than other intelligent optimization algorithms. Therefore, it has received great attention and wide application since it has been proposed.  [27]. In GWO, each grey wolf is treated as a potential solution. The grey wolves at the best solution, the second best solution, and the third best solution are treated as , , and wolves. The rest of the grey wolves are treated as wolves. The wolves are approaching the food position (global optimal solution) according to the guidance of , , and wolf. The equations that simulate the guidance of hunting are as follows: where X represents the position vector of a grey wolf, X p represents the position vector of the prey, and t represents the current iteration. A and C are coefficient vectors subject to the following equations: where r 1 and r 2 are random vectors from 0 to 1. a is control parameter from 2 to 0 and it will linearly decrease as the number of iterations increases. In 2016, Mirjalili proposed a multiobjective GWO algorithm named 'MOGWO algorithm' for multiobjective problems. There are two major changes in MOGWO: using the external population Archive to store the current nondominated solutions and proposing a selection strategy for multiobjective optimization.

sMOGWO Algorithm.
Although the MOGWO algorithm has a better convergence rate, it is easy to fall into local optimum and has poor stability. The main reasons are summarized as follows: (i) The algorithm has great randomness only when initializing the position of wolves. Even though there is random factor in algorithm, when the position of wolves is updated, the effect of the guidance of lead wolves is much greater than the random factor. Thus the algorithm is highly dependent on the initial value, and self-regulation ability is weak.
(ii) The MOGWO algorithms select , , and wolves from Archive. However, if Archive set falls into local optimum, the algorithms can hardly skip the local optimum. Therefore, the exploration ability of the algorithm needs to be improved at later period of the optimization.
As the guidance of lead wolves has too much influence, the grey wolves always blindly follow the lead wolves and the nondominated solutions around the lead wolves. The grey wolves always ignore the nondominated solutions beside them. Actually, the grey wolves often pass nearby other nondominant solutions when following the lead wolves. If the grey wolves have the ability of independent searching, the global optimization ability of the algorithm will be greatly improved.
Consequently, in this paper, we proposed to add the searching factor in MOGWO named 'sMOGWO algorithm' . After the position updating of wolves, the wolves will have the searching step. Each wolf will search the nearby position randomly; if the nearby position is better than the current position, the wolf will move to the new position. The step can be described as the following mathematical expressions: where Δ is the searching step of the wolf, r is a random number between -0.5 and 0.5, ub k and lb k are the upper and lower boundary of x k , dim is the dimension of wolf, X is the position of the wolf, X new is the new position after searching, and ≻ represents the dominance relationship.
In the original algorithm, the control parameter a linearly decreases as the number of iterations increases to keep high exploration ability at early period and high exploitation ability at later period. However, there is higher demands for exploration ability in multiobjective optimization. Therefore, in this paper, the control parameter a is also modified. The adjustment strategy of control parameter a must be subject to the following: where Maxit is the maximum number of iterations and f (x) is a monotone increasing function, in original algorithm f (x)=x. The higher the value of a, the stronger the exploration ability of the algorithm, so the f (x) should be a concave function among [0, 1]. Here, we proposed to use the following equation for control parameter a.
The flow chart of the sMOGWO algorithm is shown in Figure 4. The steps of the sMOGWO algorithm are as follows.
Step 1. Archive size is N A , population size of grey wolves is N, number of grids per dimension is dim, inflation rate is a, and maximum number of iterations is Maxit. Leader selection pressure and deletion selection pressure are also set. The grey wolves and running parameters are initialized.
Step 2. The objective function values of each individual wolf are calculated. The Archive set is established, and the Archive population is grouped into iterative process.
Step 4. The position of wolves is updated according to (7) and (8).
Step 5. The wolves get into the searching step according to (11), (12), and (13) Step 6. The objective function values of each individual in wolves are calculated. The nondominant solutions of wolves are compared to the individuals in the Archive population one by one, and the Archive set is updated.
Step 7. The updated Archive set is regrouped and the number of individuals in the Archive population is checked. If the number of individuals exceeds the maximum of population, the extra solutions will be deleted.
Step 8. The algorithm ends when the maximum number of iterations is reached. All individuals in the Archive population are the optimization results of the algorithm. Otherwise, the algorithm returns back to Step 3.

Computational Complexity Analysis. The computational complexity of MOGWO and sMOGWO is analyzed in this part.
The computational complexity of each iteration (Step 3 to Step 7) of the iterative process is analyzed one by one. The number of individuals in the current Archive set is A, the number of individuals in the grey wolf population is N, and the dimension of each individual is dim.
In Step 3, lead wolves are selected by calculating the roulette probability for each individual in the Archive set. The computational complexity can be expressed as O(A).
In Step 4, the computational complexity of position updating can be expressed as O(N * dim). In Step 5, the objective function values need be calculated by searching step, and the computational complexity can be expressed as O(N * dim).
In Step 6, the nondominant solutions of wolves are compared to the individuals in the Archive set one by one to update the Archive set. The computational complexity is O(A * N * dim).
In Step 7, the Archive sets are grouped and sorted, and the computational complexity is O(A 2 ).
The computational complexity of sMOGWO in each iteration is O(A 2 )+ O(A * N * dim). The MOGWO includes all the above steps expect Step 5, and the computational complexity of MOGWO is also O(A 2 )+ O(A * N * dim). The proposed modified method has the same computational complexity as the original method. In addition, although an additional Step 5 is added to the sMOGWO algorithm, it can effectively reduce Archive set with a large number of similar nondominant solutions, which has great influence on the computational complexity. In fact, the proposed method can reduce the optimization time.

Simulation Verification
In this section, simulation verification is present to demonstrate the advantage of the proposed sMOGWO algorithm. The proposed algorithm is compared to the MOGWO algorithm [25] and some other popular multiobjective

Test Problems. UF series test problems in CEC 2009
are multimode test functions [29], and there are a lot of locally optimal solutions, so it is suitable for test of multiobjective optimal algorithms. Three typical test problems are chosen as Complexity 7  follows: UF3 whose Pareto boundary is concave shape, UF4 whose Pareto boundary is convex shape, UF7 whose Pareto boundary is line. The three UF problems are as follows: UF3 problem, n=30, the search space is [0, 1] : cos ( 20 √ )

Parameters
Setting. The principles and the operation modes of the algorithms are different. In order to make the algorithm contrast, the same maximum number of iterations, population size, and Archive size are set up. The parameters of different multiobjective optimization algorithms are shown in Table 1.

Performance Evaluation Indexes.
The Generational Distance (GD) and the Spacing (SP) [30] have been used to evaluation the performance of each algorithm.
where D i is the Euclidean distance between the ith nondominant solution in Pareto solution set and the closest nondominant solution on the real Pareto front. N is the number of Pareto optimal solutions. The smaller value of GD indicates that the Pareto optimal solution is closer to the real Pareto front.
where d i is the Euclidean distance between the adjacent points of Pareto optimal solution. d f and d l are the Euclidean distances between the endpoint of Pareto optimal solution and real Pareto front. N is the number of Pareto optimal solutions. The smaller value of SP indicates that Pareto optimal solution distribution is more homogenized.

Result Analysis.
In order to eliminate the contingency, each algorithm is run 30 times independently. The statistical results of the evaluation indexes are shown in Tables 2 and  3. In order to reflect the advantages and disadvantages of the optimization results more directly, the boxplots of GD value and SP value of each algorithm are given as in Figures 5 and 6. The best optimal results of the algorithms in repeated experiments are shown in Figures 7, 8, and 9. The comparison is more intuitive.
For UF3 test problem, the sMOGWO, NSGA-III, and SPEA2 are the first class in GD value which means the solutions of these methods are closer to the real Pareto front. The GD values of MOPSO, MOGWO, and MOEA/D are high and fluctuating. The sMOGWO method has a better SP value which means the solutions are well distributed. Although the NSGA-III and SPEA2 are closer to the real Pareto front, the SP values are high, which means the solutions of these methods tend to fall into local optimum. We can discover that the NSGA-III and SPEA2 methods fall into local optimum on UF3 test problem intuitively according to Figure 7. The solutions of the sMOGWO method are the best.
For UF4 test problem, the sMOGWO has the best GD value. The MOPSO, MOGWO, and MOEA/D are in the second class in GD value. The sMOGWO, MOGWO, and MOPSO are in the first class in SP value. From Figure 8, the best optimal results of sMOGWO, MOPSO, MOGWO, and MOEA/D are all close to the real Pareto front and are well distributed.
For UF7 test problem, the GD values of sMOGWO, MOGWO, NSGA-III, and SPEA2 are in the first class, but the SP value of sMOGWO is better than those of other methods. From Figure 9, the best optimal result of all the

Case Study
In this section, a case study is presented to show the effect of the proposed algorithm on optimal control of HTGS under multiple operation conditions. The no-load and on-load operation conditions are considered. The model of HTGS and its parameters are provided in Section 2. The multiobjective functions refer to (5) and (6). The simulation time is 20 seconds. The sMOGWO, MOGWO, MOPSO, MOEA/D, NSGA-III, and SPEA2 algorithms are utilized for optimal control. The maximum number of iterations is 100. The other parameters of the three algorithms are set as in Table 1. Each algorithm is run 30 times independently. The best optimal results of each algorithms in repeated experiments are shown in Figure 10. In order to analyze the detailed control transient process of the optimization results, some representative control strategies are chosen from the Pareto optimal solution set as shown in Table 4. It can be seen that the optimization of ITAE under no-load and ITAE under on-load are opposites. Transient process of some of the control strategies is shown in Figure 11 to exhibit control effects more intuitively.
All the three control strategies have good control stability under multiple operation conditions. Strategy 1 is most stable  under on-load operation condition, but it has bigger overshoot than the other two strategies under no-load operation condition. Strategy 3 has the smallest overshoot among the three strategies under no-load operation condition, but its stability is the worst among the control strategies under onload operation condition. Strategy 2 is a compromise control strategy.
Thus, a Pareto solution set can be got after one optimization which can be suitable for multiple operation conditions. And the solutions have different emphasis on objective functions. According to the specific requirements of the HTGS, the decision maker can select one or some satisfactory solutions from this solution set as the final solution, so that the HTGS can obtain better control quality.

Conclusion
The control strategies of hydraulic turbine governing system need to consider the multiple operation conditions. A multiobjective optimal function under different operation conditions is proposed in this paper to solve this control problems.
In order to optimize the multiobjective problems more effectively, a novel MOGWO algorithm based on searching factor (sMOGWO) is proposed. The sMOGWO method is verified with several UF test problems compared to MOGWO, MOPSO, MOEA/D, NSGA-III, and SPEA2. The sMOGWO provided better solution compared with its competitors. And the proposed algorithm has good stability under all test functions, and the proposed algorithm performs well in repeated experiments with few poor results.
A case study has been designed to test the control quality of the control strategies which are got by the proposed method. The experimental results have confirmed that the control strategies perform well under multiple operation conditions.

Data Availability
The simulation data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest
We declare that we have no conflicts of interest regarding the publication of this manuscript.