Wind Turbine Anomaly Identification Based on Improved Deep Belief Network with SCADA Data

. This article presents a novel fault diagnosis algorithm based on the whale optimization algorithm (WOA)-deep belief networks (DBN) for wind turbines (WTs) using the data collected from the supervisory control and data acquisition (SCADA) system. Through the domain knowledge and Pearson correlation, the input parameters of the prediction models are selected. Three diﬀerent types of prediction models, namely, the wind turbine, the wind power gearbox, and the wind power generator, are used to predict the health condition of the WTequipment. In this article, the prediction accuracy of the models built with these SCADA sample data is discussed. In order to implement fault monitoring and abnormal state determination of the wind power equipment, the exponential weighted moving average (EWMA) threshold is used to monitor the trend of reconstruction errors. The proposed method is used for 2MW wind turbines with doubly fed induction generators in a real-world wind farm, and experimental results show that the proposed method is eﬀective in the fault diagnosis of wind turbines.


Introduction
Wind power is considered one of the most promising forms of renewable energy sources, which has been widely used in the world [1][2][3]. However, it results in a higher failure rate than expected because the wind turbine (WT) is exposed to adverse environmental conditions. e operation and maintenance (O&M) costs account for approximately 15-20% of the gross income of onshore wind farms and 30-35% of offshore wind farms [4]. erefore, condition monitoring (CM) and fault diagnosis technology can achieve preventive maintenance before the malfunction happens. Many kinds of condition monitoring and fault diagnosis techniques, such as acoustic emission [5][6][7][8], vibration analysis [9][10][11][12], strain measurement [13], electrical effects analysis [14], and ultrasonic testing techniques [15], have been developed to minimize downtime as well as the O&M costs. e recent review in [16] included a comprehensive survey of the existing fault diagnosis technologies for wind turbines with qualitative and quantitative methods, and the fault diagnosis system is also described in this paper. However, most of these methods have not been universally used in wind farms because they are mostly based on the analysis of mechanical signals emitted during the operation process and require a large number of extra sensors, thus resulting in high-deployment costs.
As an important part of wind power equipment, the supervisory control and data acquisition (SCADA) can remotely collect equipment operating data [17]. It has the advantages of providing complete information, improving efficiency, and correctly mastering the operating status of the system. Moreover, it can also help to monitor the health condition of wind turbines. However, currently, there is no effective state evaluation algorithm in most SCADA systems. Only when the sampled data exceed the given threshold can the alarm signal of the wind turbine components be given. At this point, the fault may have deteriorated to a certain level. In order to further improve the fault diagnosis rate and reduce the high-deployment costs, it is of significant academic value and application prospect to establish an evaluation algorithm and model using SCADA data.
In recent years, the measurement data that come from the SCADA system of a wind farm is used for condition monitoring and fault diagnosis [18][19][20][21]. On the one hand, it has achieved remarkable results in reducing the wind turbines downtimes and improving the reliability of wind power. On the other hand, it has become profitable to integrate multisource data signals including mechanical and electrical signals in the wind turbines for analysis. A large number of data mining and abnormal identification methods have been applied to improve diagnostic accuracy upon integrating different condition parameters of the SCADA system. In [22][23][24], the prediction models composed of conditional parameters of the wind turbine are established by the neural networks. In [22], the historical SCADA data, its current SCADA data, and some wind turbines' current SCADA data from other wind farms are used to train and test these models. e study in [23] proposes an online wind turbine fault detection system through the multilayer neural network technology using SCADA data. e study cases show the effectiveness of this method. However, in these researches, the input parameters of the model are selected based on domain knowledge, without considering the correlation between the parameters which are associated with other signals that are measured simultaneously. In [24], a method for cointegration analysis of wind turbine fault diagnosis is presented based on the SCADA data. In this current research, six condition parameters are selected for cointegration verification, and abnormal problems can be detected through this method. It is worth pointing out that the proposed approach in [24] assumes that the cointegration relationship is unique; however, in actual situation, the cointegration relationship may be diverse. In [25], an AutoRegressive with eXogenous input model for wind turbine generator bearing fault is established using SCADA data. However, the choice of manual intervention parameters in this method noticeably affects the accuracy of the model. A deep learning method of a layerwise encoder network for the CM of wind turbine main bearing through SCADA data is proposed in [26]. However, the selection of the number of neurons in the hidden layer and the learning rate parameters have a significant impact on the prediction accuracy.
For different target condition parameters, the different sample data selected from the WT SCADA system will have a significant impact on diagnostic accuracy. However, to the best of our knowledge, little research has been carried out on the effects of the selected condition parameters for WT fault diagnosis model. Aiming to these problems, in this article, a novel fault diagnosis algorithm for WTs based on the whale optimization algorithm (WOA)-deep belief networks (DBN) using SCADA data is proposed. e proposed novel fault diagnosis algorithm can automatically analyze a large number of SCADA data with a low sampling rate. Furthermore, the input condition parameters of this fault diagnosis model are selected based on domain knowledge and the correlation between conditional parameters. is method effectively solves the problem of difficult fault diagnosis of the wind turbine, reduces the installation cost of fault diagnosis equipment, and improves the economic benefit of the wind farm. e structure of the article is presented in the following manner. e wind turbine and the SCADA system are introduced in Section 2. Section 3 describes the condition parameter selection, the model performance analysis, and the exponentially weighted moving average (EWMA) thresholds method. e whale optimization algorithm, deep belief networks technology, and the WOA-DBN approach are presented in detail in Section 4. In Section 5, a framework of the WT condition monitoring using SCADA data is discussed. In Section 6, the field example is investigated to prove the effectiveness of the proposed method. e conclusions are summarized in Section 7. Figure 1, the wind turbine studied in this article is mainly composed of the rotor system, main shaft, gearbox, generator, converter, and so on. And the capacity of the system is 2 MW. e wind energy captured by the rotor system blades is converted into mechanical energy, and then, the main bearings transmit mechanical energy to the generator through the gearbox, while increasing lower rotor speed of the wind turbine to a higher speed. Finally, the generator converts mechanical energy into electrical energy. e simulation and the wind turbine operational principle are discussed [27,28].

Description of Wind Turbine. As illustrated in
Wind turbines work in complex and varied environments consistently, resulting in frequent failures and high O&M costs, and it should be noted that the longest mean time to repair corresponds to the blade failure, followed by the gearbox and the generator [29].

Wind Turbine SCADA System.
e SCADA system is a data acquisition and monitoring control system, which plays a vital role in the collection, management, and transmission of wind turbine real-time data. e data acquisition of each WT is then transmitted to the data information to the monitoring control system through equipment such as optical fiber and switches. As shown in Figure 2, the monitoring control system provides the interface, picture, and service operation for the wind farm operators to understand all kinds of information of the wind field. e monitoring software provides users with online monitoring, alarm reception, remote control, and operational data charts, using a friendly and flexible user graphical interface, which can real-time monitor the relevant data of wind turbine operation.
However, relying solely on the SCADA alarm system does not accurately grasp the operation status of the wind turbine. Due to the wide setting of the alarm threshold, when the system issues an alarm, the fault may have deteriorated to a serious degree, which cannot prevent the failure. In order to improve the fault diagnosis rate and prevent faults in advance, the SCADA data used in this study were derived from the 2 MW onshore wind turbines of a wind farm in Central China. e continuous monitoring data from March 2018 to September 2018 were collected.

Parameter Description and Processing.
Up to 97 different types of condition parameters are measured and provided in the SCADA system of a wind farm, including wind speed, wind power, and temperature of different components. However, not every parameter plays a decisive role. For various fault classifications, the choice of parameters will be different, which will lead to different diagnostic models. In order to improve accuracy rates and reduce the diagnostic time, the input condition parameters for each model are selected based on domain knowledge and the correlation between parameters. For example, the relationship between wind speed and the wind power, and the relationship between the oil sump temperature of the wind gearbox and wind power are shown in

Mathematical Problems in Engineering
are the i th sample point corresponding to different parameters, x and y denote the average of the condition parameters, and different parameters are selected as shown in equation (1). Finally, the selected conditional parameters are modeled to assess the health of the wind turbine. In this step, according to the expert domain knowledge and the size of correlation between the condition parameters, the type and number of parameters selected are different for different prediction models, which is beneficial to the increase in prediction accuracy and the decrease in prediction time.
(1) (2)-(4), the root mean square error (RMSE), the mean absolute percentage error (MAPE), and the mean absolute error (MAE) are used to evaluate the performance of the predictive model.

Performance Analysis. As shown in equations
where x(l) and x(l) represent the actual and predicted values of the l th sample and m is the number of the test samples.

e Reconstruction Errors and Exponentially Weighted
Moving Average resholds. e reconstruction error between the actual value and the predicted value of the dataset is used as the detection quantity of the wind turbine state trend. e EWMA [26] threshold is used to monitor the trend of the reconstruction error to realize the fault monitoring and abnormal state determination of the wind power equipment because the trend of reconstruction error will change significantly under normal operating conditions and fault conditions. e reconstruction error ρ e is given by Based on the above analysis, the threshold control chart is sensitive to detect a small drift of the mean value in the process, and the exponential weighted moving average is used to set the control line to monitor the fluctuation of reconstruction error. e statistics (κ t ) of the EWMA control chart are where λ represents the weight of history κ t on the current EWMA statistic, λ ∈ (0, 1], andt denotes the time. e mean and variance of the statistics are obtained by equation (7), where μ κ t and σ 2 κ t denote the mean and variance of the statistics, respectively, μ ρ e is the mean of the κ t of the wind power equipment, and ℓ s represents the sampling length.
erefore, the upper and lower bound functions of EWMA control charts for wind power equipment based on time t are expressed as  Mathematical Problems in Engineering where Κ is a value of 2 and 3, in which 2 is taken as the fault warning limit and 3 is taken as the fault detection warning limit, ς is a value of 3, and the equipment is in the safe zone when L U < L U (t). e principle is shown in Figure 4.

Deep Belief Network
Approach. Deep belief network, which was first proposed by Hinton [30], is a kind of generative depth model, and it has become a widely used deep structure in the field of research and applied science [31][32][33]. As shown in Figure 5, the structure of DBN consists of a number of restricted Boltzmann machines (RBM) stacked layer by layer [31,34], while extracting important information and critical features through deep data mining. Based on the RBM learning rule, the data conversion process from the visible layer to the hidden layer is completed by a sigmoid activation function [35]. e hidden layer of the first RBM is considered a visible layer of the second RBM and so on. e training process continues until the final RBM is completed. Trained RBMs are stacked to form DBN; for the DBN classification model with n hidden layers, the joint probability (p(c, h 1 , h 2 , . . . , h n )) of the whole DBN is given as where p(h n− 1 |h n ) is the conditional distribution between the (n − 1) th hidden layer and then th hidden layer. Figure 5 shows the RBM as the development of Boltzmann machine (BM) proposed by Ackley in [36], which was further introduced in [37]. From Figure 5, it can be seen that RBM consists of a visual layer c containing m visible units (c 1 , c 2 , . . .c m ) and a hidden layer h containing l hidden units (h 1 , h 2 , . . ., h l ). Typically, the visible units follow the Bernoulli or Gaussian distribution, whereas the hidden units usually follow the Bernoulli distribution. e state of the RBM is generally evaluated using an energy function: where θ � ω ij , c i , b j denotes network parameters, ω ij is the weight between hidden unit h i and visible unit c j , and c i and b j are the bias of the i th hidden variable and the j th visual variable, respectively. e negative and positive phases of the RBM learning can be mathematically expressed as where the function is sigmoid σ(x) � 1/(+exp(− x)). Based on the contrast divergence algorithm, the update parameters of the RBM can be obtained as where η is the learning rate and t represents the number of the RBMs.

e Whale Optimization
Algorithm. e WOA, which mimics the social behavior of humpback whales, is known as a nature-inspired metaheuristic optimization algorithm, proposed by Mirjalili and Lewis [38]. As shown in Figure 6, this social feeding behavior of humpback whales is called the bubble-net predation strategy. is optimization algorithm is becoming more and more popular in engineering applications because it does not require gradient information, relies on relatively simple concepts, is easy to implement, and can bypass local optimization to find global optimality [39]. As can be seen from Figure 6, whales attack their prey by spiraling upward and contracting their encirclement.
A mathematical model of the WOA algorithm can be obtained by combining the three aspects of encircling prey, bubble-net attacking predation strategy, and hunting prey. e encircling prey behavior can be represented by where t is the current iteration, C → and A → denote coefficient vectors, Y → represents the position vector, and Y * indicates the position vector of the best solution currently obtained, and it should be updated in each iteration if there is a better solution. e C → and A → are obtained as where r → denotes a random vector in [0, 1] and a → linearly drops from 2 to 0 throughout the process. According to the behavior of the humpback whale, the mathematical model of the bubble-net attacking predation strategy is as Mathematical Problems in Engineering where b is a constant that defines the logarithmic spiral shape and l is a random number between − 1 and 1. It is worth noting that the whale swims in the spiral shape to the prey while shrinking the encirclement. To model this synchronous behavior, it is assumed that there is a probability of P i to choose the contraction enclosing mechanism and a probability selection spiral model of 1 − P i to update the position of the On hunting prey stage, the mathematical model is given as where Y → ran d denotes a random position vector (a random whale) selected from the current population. e WOA algorithm begins with a set of random solutions. In each iteration, the search agent updates its location based on a randomly selected search agent or the best solution obtained so far. e random search agent is selected when A → > 1, and the best solution is chosen when A → < 1 for updating the search agent location. According to the P i value, the WOA algorithm can switch between either spiral motion or circular motion. Finally, the WOA algorithm is terminated according to the satisfaction of termination criteria.

Deep Belief Networks Optimized by Whale Optimization
Algorithm.
e random initialization of DBN's network parameters is easy to cause local optimization. For this reason, this article uses the WOA to globally optimize the DBN network parameters and provide the DBN reliable initialization parameters, and the global optimal solution is terminated based on the maximum number of iterations. In order to reduce the fluctuation of prediction accuracy caused by the artificial selection of the DBN network parameters, the WOA is used to optimize the learning rate of the DBN network (η) and the number of the hidden neurons in each layer of the RBM (m i ) to obtain the highest accuracy in the global sample space.
s.t. η ∈ η best , m i ∈ m 1best , · · · , m ibest . (22) In this article, the WOA algorithm is used to optimize the parameter combination of the DBN model, and the fitness function is selected as equation (22), where x(l) and x(l) represent the actual and predicted values of the l th sample and m i denotes the number of hidden neurons in i th layer of the RBM, respectively. e flowchart of the WOA-DBN algorithm is shown in Figure 7, and it can be summarized and described as follows:

The Framework of the WT Condition
Monitoring Using SCADA Data

Implementation of the Proposed Method.
In this work, the WOA-DBN approach is employed for WT fault diagnosis using SCADA data. Figure 8 shows the application of the present proposed method, and it can be summarized as follows: (i) Step 1. Collect the SCADA data. As the research object, the same type of wind turbine was selected, and the original operation data of the WTs were extracted from the wind farm SCADA system. (ii) Step 2. Process the SCADA data. Firstly, the condition parameters are selected from the original operational data based on expert domain knowledge. en, the SCADA data are further processed according to the wind farm accident operation record. Finally, the accident operation data and the error data in the SCADA system are deleted.

The Example Verification
e WT example verification units, which are located in the hills at an altitude of about 1,700 meters originate from a wind farm in Central China. As shown in Figure 9, a total of 25 wind turbines (2-MW) are sent to 110 kV step-up substation through three collector lines in this wind farm. e SCADA analysis data, collected from March 2018 to September 2018, derived from 4 WTs (#3, #11, #12, and #19) with the same type in this article.

Data Acquisition and Preprocessing.
e wind speed of the SCADA data used for modeling is between 3.5 m/s and 25 m/s by statistically sorting the operational data and accident records of the wind farm, and the sampling interval of these data is 10 minutes. In this way, a data matrix with 8209 lines and 97 columns is obtained. Based on domain knowledge, the data can be further processed to obtain a data matrix, which contains 8209 rows and 49 columns.
In order to improve the accuracy of the prediction, the data matrix is further processed by the Pearson correlation coefficient, and the health prediction model of the whole WT is taken as an example to illustrate. Firstly, the wind power is taken as the output, the correlation coefficients of 49 selected conditional parameters are calculated, and those with correlation larger than 0.896 (shown in Figure 10) are selected as input parameters. Secondly, according to the previous step, the condition parameters of three different types of health prediction models can be obtained, as shown in Table 1, where GNT. denotes the generator and T. denotes the temperature. e third row represents the output condition parameters of the three prediction models, and the remaining rows represent the input condition parameters of the prediction models. Figure 11 shows the boxplot of the 12 condition parameters in the whole WT prediction model, where ST.W. represents the stator winding. Finally, the corresponding two columns of parameter values in Table 1 are modeled separately for the WT generator and the WT gearbox, and the performance analysis values of various models are obtained.

Experimental Results.
e WOA-DBN-based method is used to recognize the fault classification of WTs. e programs are run in the MATLAB R2017a environment, where 80% of the samples are randomly exploited for training, and the remaining are used for the test of the fault diagnosis performance. e WOA parameters are set as follows: the maximum number of iterations is set as 10, the population size of whales is set to as 40, the variable dimensions are set as 2, and their ranges are set to as [100 100 1] and [1 1 0.01], respectively. e DBN parameters are set to as follows: the number of train iterations is determined to be 10, the set batch size is selected to be 2, and a network with an output unit is set up. On the basis of these parameters, the performance of the trained WOA-DBN prediction model is shown in Table 2. e predicted results produced by the proposed method are shown in Figures 12(a), 12(b), and 12(c).
After the model training is completed, according to the historical data of the wind farm, the SCADA fault data of the three sets of the wind turbine, gearbox, and generator are searched separately, and the validity of the model for fault detection is verified according to the content proposed in Section 3.3. According to the on-site accident record book, some data of wind turbine, wind power gearbox, and the whole machine before failure are collected, and then, the EWMA method is used to verify whether the WOA-DBN model can judge the health status of wind power equipment in advance. As shown in Figures 12(d), 12(e), and 12(f ), the simulation results show that the proposed method can accurately judge the fault types of wind power equipment.
From Figure 12(d), it can be concluded that the fault data samples of the wind turbine generator are predicted by the model, and only the EWMA value of one data sample does not exceed the upper limit of the alarm value. Considering the influence of singularity point, it can be judged that the wind turbine generator has been faulted. According to the fault records of the wind farm, three days after the operation of the unit, the "generator temperature alarm" message issued by the SCADA system indicates that the generator has failed. Similarly, from Figure 12(e), it can be seen that all EWMA of the fault data samples corresponding to the wind power gearbox exceeds its alarm upper limit value, and it can be judged that the gearbox has been faulted and needs to be checked and further processed. e fault alarm results of the whole machine show that 15% of the EWMA value of the fault data sample does not exceed its upper limit of the alarm Mathematical Problems in Engineering value as seen in Figure 12(f ). Although it is judged by the WOA-DBN method that the probability of failure of the unit is large, in order to avoid the occurrence of fault misjudgment, it should be further judged according to the experience of the field staff whether the unit should be shut down for inspection.

Economic Analysis.
Checking the on-site operation record found that the #12 wind turbine was out of operation for 42 days due to gearbox damage failure at 14 : 05 on August 5, 2018, and the gearbox needed to be replaced. Five days before the failure of the gearbox, the field data are collected, and the method proposed in this article is used for condition monitoring and analysis. It is found that this method can accurately judge the alarm value of the wind power gearbox exceeding the upper limit. If the machine was stopped and checked in time, the whole damage accident of the gearbox could be avoided and only the high-speed axle of the gearbox would need to be replaced. According to the analysis of the wind field, it usually takes about 15 days to replace the high-speed bearing of the gearbox. Taking Nangao Gear as an example, the direct cost of hoisting and purchasing the gearbox is about 116,427 $, while the Step-up station  maximum cost of replacing a high-speed shaft of the gearbox is not more than 36,383 $. e detailed statistics are shown in Table 3, where it can be concluded that the fault prediction method proposed in this article could have reduced the direct economic loss about 115,949 $. In addition, according to the on-site operation records of #47 wind turbine, at 18 : 20 on January 7, 2019, the #47 wind turbine was shut down for 54 days due to generator failure, and the generator needs to be replaced. 10 days before the generator failure, the field data are collected, and the method proposed in this article to carry out condition monitoring and fault diagnosis analysis. e results show that 80% of the alarm value of the wind turbine is over the upper limit. According to the auxiliary analysis of the onsite operators, if the wind turbine is shut down for inspection in time, the occurrence of the cleaning accident of the generator can be avoided, and only the rear bearing of the generator needs to be replaced. Using the data of wind field for analysis, it usually takes only 3 days to replace the generator rear bearing. Take the wind turbine as an example, the replacement cost of the generator is about 90,154 $, while the maximum cost of replacing the rear bearing is not more than 1600 $. e specific statistical results are shown in Table 4. It can be seen that the fault prediction method proposed in this article can reduce the direct economic loss about 175,498 $.    All in all, the method can effectively monitor the condition of the wind turbine and reduce the operation and maintenance cost of the wind farm.

Conclusions
A novel method for the fault diagnosis of a wind turbine based on the WOA-DBN approach using the SCADA data is presented in this article. e SCADA data are preprocessed based on domain knowledge and the Pearson correlation coefficient. ree prediction models, namely, the whole wind turbine, the wind power gearbox, and the wind power generator, are established in this article. e simulation results show that the proposed method has high prediction accuracy. Field examples further show that this method can realize the condition monitoring of wind turbines and reduce the operation and maintenance costs of wind farms. is method can effectively detect the fault of a wind turbine based on SCADA data and can provide a new idea for the health management of wind turbine in the data center of wind farm. It is a supplement to the deficiency of current fault detection methods. However, in this study, the SCADA data can only be used to judge the failure of the wind turbine equipment. Specifically, some types of failure need to be further verified by relevant technical means, which is a problem to be solved in the follow-up study.   Data Availability e data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest
e authors declare that there are no conflicts of interest regarding the publication of this article.