Data-Driven Learning-Based Fault Tolerant Stability Analysis

In this paper, a new data-driven learning method is investigated based on the dynamical data of the system. A regularized regression wavelet (RRW) approach is proposed to optimize the learning result for the system fault. Based on the optimizing results, a fault tolerant stability scheme is given.&en, the efficiency of the proposed technique is verified by a vertical take-off and landing (VTOL) aircraft stability example.


Introduction
e analysis of the data-driven learning method in this paper aims at developing a reliable learning algorithm and applying the method to practical engineering systems. Specifically, we will show how the proposed data-driven learning technique is applied to the dynamical system.
Stability is a fundamental property in modern engineering systems. How to stabilize a system is well studied in the past decades. Plenty of stability controllers are proposed, for example, variable structure control [1], fuzzy control [2], sliding mode control [3], and adaptive neural control [4]. Various undesirable effects are always existed in many engineering applications, such as time-delay [4], fault [5,6], and uncertainty [7]. In most cases, plenty of these effects can be observed by available measurement data; however in some cases, they are not easily described by existing mathematical models. In particular, these data contain meaningful features of the engineering applications. It is highly desirable to develop new techniques to learn the system data and generate a reliable algorithm based on the real data to cope with those fast changes in the complex systems directly. In this paper, we developed a learning model to address the issue of stabilizing dynamical systems from a different prospective.
During the last decade, data-driven innovation has become a hot topic across different research sectors and provides new challenges associated with various network design, such as sensor networks and telecommunication networks.
e network data constitute infrastructural information that could be used in many ways to produce different products and services. It provides additional information over the limitation of traditional system models and also enables creation of knowledge that is crucial for a new design. Recently, there are some data-driven control research studies available in the literature. For example, sampled data stabilization techniques for the T-S fuzzy system were proposed in [8]. A recurrent neural networkbased data-driven control was constructed for the steadystate analysis in [9]. In addition, a lot of research studies have been undertaken to study the data-driven methods in industrial processes, see [10] for a survey. As one may know, the engineering systems are generally operated under different industrial environments. e classic model-based approach could be difficult to stabilize a real system in these types of applications. Hence, one may consider the datadriven approach to analyze the stability of the engineering system.
In particular, faulty issues in highly complexity dynamical systems always exist and are strongly reflected in the collected data. It has certainly a great effect on the safety requirement, and thus the fault reconstruction problem is one of the main concerns in the distributed network control design. e fault reconstruction problem was studied for sensor networks in [11], and the results were used for the room temperature monitoring application. Recently, the fault tolerant consensus issue was researched in multiagent systems considering uncertainty in [12]. Data-driven methods for monitoring and fault diagnosis on the benchmark Tennessee Eastman process were investigated in [13].
In this paper, we propose a constructive data learning approach to analyze the effect of the fault. In addition, based on the learning result, the fault tolerant stability of the dynamical system is well studied. e method used in this paper is based on the RRW technique. It should be pointed out that the wavelet functions are used for nonlinear transformation function. Incorporating the time-frequency localization properties of wavelets, it has a strong learning ability for complex nonlinear system modelling. Especially, the wavelet approach has the advantage of dealing with rapid changes of data [14][15][16]. Inspired by the approach of multiresolution analysis, this paper provides a new datadriven approach for studying fault tolerant stability by applying this powerful wavelet tool. A detailed mathematical approach is constructed to deal with the effect of faults. In this paper, we aim to use the collected data from the dynamical system to stabilize the system. e novelties and advanced features of this paper are as follows: (1) Compared with the existing stability problem, this paper addresses the fault effect in the dynamical system. In addition, the designed technique used in this paper is a data-driven learning method which is based on a regularized regression wavelet neural network. (2) It is worth noting that most of the aforementioned literature is about data-driven stability analysis without considering to use a wavelet neural network.
In this paper, we use the wavelet neural networkbased learning control to stabilize the dynamical system which has the advantage of dealing with rapid changes of the sensor data and fault. (3) A detailed mathematical calculation for the reconstruction of the fault in this paper has been given, which potentially contributes to the real-world application of this paper. e remainder of this paper is organized as follows: in Section 2, some preliminaries are proposed. In Section 3, data-driven fault tolerant stability is analyzed. In Section 4, a VTOL aircraft stability problem is analyzed to illustrate the effectiveness of the theoretical results. e final section concludes this paper.

Preliminaries
We consider a dynamical system described by the state equation: where x(t) ∈ R n is the state of the system, g(x(t)) ∈ R q is the fault, u(t) ∈ R q is the actuator control input, and A ∈ R n×n and B ∈ R n×q are the known system parameters.
e sensor output of this system is taken to be the same as the state vector.
As is well known, for the fault g(x(t)), the common assumption is that the uncertainty is norm bounded by a constant [12,17]. In classical fault tolerant analysis for a dynamical system, one may use adaptive control to stabilize those faulty systems, see [12,17]. In addition, the aforementioned fault assumptions in literature mostly require the fault to be differential, see [11] and the reference therein. However, due to the unpredictability of the fault, one cannot estimate the bound of the fault g(x(t)), not to mention the differential requirement of the fault. In this paper, we released these assumptions by using a data-driven learning method based on the least-square regularized regression approach.
Before we propose the main results, we first focus on the initial data collecting procedure. Firstly, the system is assumed to be normal, i.e., this system is without fault. It is known that, to stabilize system (1) without fault, that is, to stabilize the following system: (2) One can define the feedback control as en, based on this construction, we initially collected the data with the feedback control u(k) � −Kx(k). However, it should be pointed out that while the fault is considered, system (1) may be unstable. Next, based on the data generated by the faulty system, we will identify the fault by using the following results.
We let z(t) be the regression vector in the regression model, z(t) � x(t). For the state sensor output x(t), we calculate the derivative of state x(t) numerically, i.e., _ where h is the numerically sampling period. en, we can obtain y(t) as _ x(t) − Ax(t) − Bu(t) which is assumed to be the data output. We use this relation to evaluate data samples as z(t), y(t) T t�0 .

Main Results
e data-driven learning problem is formulated as where g � [g 1 , g 2 , . . . , g q ] T , ‖g i ‖ 2 � 〈g i , g i 〉 H T , and the regularization constant ] is used to make a trade-off between the empirical approximation error and the complexity of the model. e solution of the above optimization problem is expressed as Next, we shall consider the nonlinear function approximation method in this paper. e reproducing kernel Hilbert space (RKHS) is defined to be the closure of linear span of a set of functions, with the kernel functions used for approximation be nonlinear functions. In this paper, we use Morlet WNN kernel: 2 Complexity e Morlet wavelet is a wavelet composed of a complex exponential (carrier) multiplied by a Gaussian window (envelope). e parameter ω 0 > 0 represents the dilation, and the parameter a i > 0 represents translation. ese two parameters can be adjusted by users. One can find the theoretical analysis for optimal dilation and translation parameters selection in [15]. en, the RKHS is a space of nonlinear functions and has good approximation performance. We solve the above optimization problem which is given by the following theorem. (3), the solution is obtained by the following formula:

Theorem 1. For the optimization problem
where l jt is the solution of the following equation: where and G and L satisfy g T � Gg T and l � Ll, respectively, with g jT � g j (x(1)), g j (x(2)), . . . , g j (x(T)) T ∈ R T , g T � g 1T , g 2T , . . . , g qT T ∈ R Tq , g tT � g 1 (x(t)), g 2 (x(t)), . . . , g q (x(t)) T ∈ R q , g T � g 1T , g 2T , . . . , g TT T ∈ R Tq , l j � l j1 , l j2 , . . . , l jT T ∈ R T , l � l 1 , l 2 , . . . , l q T ∈ R Tq , Proof. Introduce an orthonormal wavelet ϕ p,q in L 2 ρ (X). eir corresponding eigenvalues are λ p,q . en, we have g i � ∞ p,q�−∞ c g i p,q ϕ p,q for any g i ∈ H WNN . e parameters c g i p,q are to be chosen to minimize the objective function (3). Let Then, one can obtain Considering the minimum optimization problem, we have Using the fact that we can get Complexity From (9), we have e theorem is obtained. e above optimization problem leads to the following approximation results: en, by using the cross-validation method, we can estimate the approximation error e in (17) which is not exactly known. In practice, define ς as the upper bound of the approximation error which can be computed by the data learning algorithm. In fact, one can find that a good approximation error at O(10 − 3 ) or even a smaller value can be obtained in simulations by using sufficiently large data samples for the learning. To ensure the control design to be robust under faulty data, the upper bound of the approximation error ς is set to be 10e in our data learning algorithm.

at is, ‖Bg(x(t)) − Bg(x(t))‖ ≤ ς.
is construction is explained based on the following facts: as one may know that the design of the control is based on future system process which is fully unknown. is makes the learning of future fault very difficult. Although the cross-validation method can estimate the error very well, there will still be some differences between the estimated fault and the true fault.
at is to say, the learned fault obtained by approximating the trained data can reflect most of the parts of the fault function, but not the exactly true fault. Nevertheless, the parameter ς produced from training data can provide a good result and is used to estimate the approximate error.
In the following, we will give a theorem to design the fault tolerant control based on the approximation result. □ Theorem 2. Considering the system with the fault given in (1), the system will be stabilized under the following control: where P > 0 is the unique solution to the algebraic Riccati equation (ARE): Proof. Introduce the following Lyapunov candidate: en, the derivative of V(t) satisfies

(21)
From (19), the theorem is obtained. □ Remark 1. In this paper, the data-driven learning method is proposed to identify the system fault. It should be pointed out that there exist some problems which remain to be solved: (i) since the data are collected for learning, it is well known that identification efficiency can be improved as more data samples are collected. e amount of data to be collected to improve the efficiency of the algorithm is still an open problem; (ii) from (3), one can find that there exists a regularization constant, ] in (3), to reduce the model complexity and the learning error. e constant is always case dependent; (iii) the choice of the dilation ω 0 and violation a i in the Morlet WNN kernel is also case dependent. One can refer to WNN for learning function in [14,15].

Remark 2.
In this paper, the data-driven learning method is given to analyze the system fault. is is different from the classic fault tolerant analysis in the networked system. Classically, the fault analysis used the model-based approach, see [17][18][19] and the reference therein, in which they solved the fault tolerant problem in a system basis. However, in this paper, we analyze the fault fully based on the historical data, and some useful data-based results are obtained.
is makes a new insight in applying data learning strategies in the fault research area.

Remark 3.
e results obtained in this paper aim to solve the stability problem in a dynamical system considering fault by using the WNN-based method. rough eorem 1, we can obtain the detailed formula for the approximation of the system fault effect in (1). One can refer to (17) for details. In addition, with the given equations (6)-(9), one can easily calculate the mathematical form of the control in (18). All these procedures contribute to the application of the obtained results in real-world engineering problems.

Application
In this section, the VTOL aircraft stability problem is proposed to verify the method in eorem 2. One typical VTOL aircraft model can be found in Yakovlev Yak-38 which is a Soviet Navy VTOL aircraft intended for their light carriers, cargo ships, and capital ships. e dynamical system is described by e parameter matrices A and B are given as follows: e fault considered in the first 10 seconds is given by en, we can learn the fault effect Bg(x(t)) numerically through the optimization (3) approach result in (7), see Figure 1. In Figure 1, it can be found that the dashed lines and solid lines are very close which means that the optimization problem in (3) is well solved by using the proposed eorem 1. e fault considered in the system is given in (25). For illustration purpose, the parameter ] in (3) is 0.8. e dilation and violation constants in (5) are set to be ω 0 � 0.5 and a 1 � a 2 � a 3 � a 4 � 2. e control proposed in (18) is applied at t � 10 s with the ς equal to 0.3. e trajectory of the system is shown in Figure 2. In Figure 2, we aim to show the effectiveness of the proposed controller in (18). From the trajectory of x(t) in Figure 2, one can find that the system is stabilized since the value of x(t) goes to zero. One can see that the chattering phenomena is shown in this figure. is is due to the fact that the control (18) is based on the function sign. One may use other functions to replace the sign, which may lead to a bounded domain of the trajectory, see [12].
Next, we will consider different fault effects in [0 s, 50 s]. e fault of the aircraft in [0 s, 20 s] is e fault of this system in [20 s, 50 s] is Trajectory of learn We analyze the whole process in the following sessions: During the first 5 seconds, the operation system data are collected. One may observe that the system is not stable from the collected data. en, we make the judgement that the system is faulty. In the next 5 seconds, we collect the data and use the proposed learning technique in eorem 1 to identify the fault. From the data learned results, one may use the control in (18) to stabilize the system. From Figure 3, one can see that, after the controller is applied, the system is stabilized.
Considering the changing fault at 20 s, it can be observed that the previous control is failed to stabilize the system in the time interval [20 s, 30 s]. is makes us to remove the aforementioned controller and repeat the observation-collection learning progress. e details are given as following steps: (1) collect data in [35 s, 40 s]; (2) use the proposed learning technique to identify the fault; (3) apply the newly identified results into the controller (18).
From Figure 3, one can see that, after the controller is applied at 40 s, the system goes to the stability state during [40 s 50 s]. In Figure 3, we consider different fault effects in different time intervals during the system operating. One can find that if two faults are observed at different time, we can always apply the proposed controller in (18) by using the collected data to stabilize the system in the time intervals [10 s, 20 s] and [40 s, 50 s].

Conclusion
In this paper, fault tolerant stability is given based on datadriven learning techniques. A regularized regression wavelet approach is proposed for the data-based fault identification. e data-driven scheme is investigated under the consideration to minimize the error between the fault effect and data samples. Based on the learning result, data-driven control is proposed to stabilize the system. Finally, a simulation example is exploited to show the effectiveness of the main result.

Data Availability
e data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest
e authors declare that they have no conflicts of interest.  (18)). 6 Complexity