Fault Tolerance Automotive Air-Ratio Control Using Extreme Learning Machine Model Predictive Controller

Effective air-ratio control is desirable to maintain the best engine performance. However, traditional air-ratio control assumes the lambda sensor located at the tail pipe works properly and relies strongly on the air-ratio feedback signal measured by the lambda sensor. When the sensor is warming up during cold start or under failure, the traditional air-ratio control no longer works. To address this issue, this paper utilizes an advanced modelling technique, kernel extreme learning machine (ELM), to build a backup air-ratio model. With the prediction from the model, a limited air-ratio control performance can be maintained even when the lambda sensor does not work. Such strategy is realized as fault tolerance control. In order to verify the effectiveness of the proposed fault tolerance air-ratio control strategy, a model predictive control scheme is constructed based on the kernel ELM backup airratio model and implemented on a real engine. Experimental results show that the proposed controller can regulate the air-ratio to specific target values within a satisfactory tolerance under external disturbance and the absence of air-ratio feedback signal from the lambda sensor. This implies that the proposed fault tolerance air-ratio control is a promising scheme to maintain air-ratio control performance when the lambda sensor is under failure or warming up.


Introduction
Vehicular emissions are the major source of gaseous pollutants that contribute to the harmful and negative effects on environment and human health.It has been reported in [1][2][3][4] that the increasing amount of vehicular emissions has led to hundred thousands of mortalities and billions of economic loss every year.To reduce the amount of toxic elements in vehicular emissions, three-way catalytic converter is currently the most effective after-treatment device.This device reduces the unburned hydrocarbons and carbon monoxide by oxidization and nitrogen oxides by reduction [5].The conversion efficiency of the catalytic converter, however, depends highly on the air-ratio (also known as lambda).When the airratio is at the stoichiometric value (i.e., air-ratio = 1.0), the conversion efficiency can reach as high as 98%, but derivation of only 1% from stoichiometry can already result in 50% degradation on the converter.Therefore, for environmental purpose, the air-ratio is usually regulated to 1.Meanwhile, as an important engine parameter, the air-ratio should also be controlled to different values for other situations [6].For instance, if emissions are not concerned, the air-ratio can be regulated to around 0.95 to achieve the best engine power performance, whilst it is 1.05 to achieve the best brake-specific fuel consumption.Consequently, an effective air-ratio control system is necessary for engine system to maintain its best performance under various operating conditions.
Over the past decades, car manufacturers and researchers have developed many air-ratio control strategies [7][8][9][10][11][12].Examples include the sliding mode control [7,8], proportional-integral-derivative (PID) control [9], and neuralnetwork-based model predictive control (MPC) [10][11][12].Sliding mode control requires a very accurate mathematical definition of the engine model, but in general it is impossible to derive an exact engine dynamics model due to its highly nonlinear nature [13].In most sliding mode air-ratio control studies, many assumptions have been made in the model derivation, and many coefficients are difficult to determine for a real engine, so this strategy may not be suitable for practical use.Although PID control is the most widely used approach in practice, the calibration and tuning of the control parameters are very time-consuming and engine dependent.The tuned PID controller cannot deal with steady disturbance or any change in the engine conditions either.Thus, among these researches, the most appropriate and promising technique for air-ratio control is the neural-network-based MPC, due to its robustness to multivariable, time-varying, and delay systems like modern engine systems [12].It is wellknown that a reliable prediction model is the core component of the MPC, but the engine models developed in [10,11] were only surrogate models.That is, the models were trained from the data generated by empirical equations rather than a real engine.Therefore, similar to the deficiency of sliding mode control approach, the neural-network prediction models in [10,11] derived from data generated by empirical equations cannot effectively reflect the actual performance of real engines.In the most recent study of MPC aircontrol strategy [12], the prediction model for the controller was constructed based on experimental data rather than numerical data.Experimental results in [12] showed that the controller performance is superior to those of [10,11] in real application.Nevertheless, one major concern for the control strategy in [12] is that the prediction model must rely on the real-time air-ratio signal measured from the lambda sensor located at the exhaust pipe of the engine.When the sensor is under failure or warming up during cold start, the controller becomes ineffective, resulting in poor control performance.
In fact, for most of the current available air-ratio control approaches, the air-ratio measurement must be acquired as the feedback to the controllers.Hence, the problem of lambda sensor failure must be addressed.Although on-board diagnostics for the lambda sensor has been a requirement for more than two decades [14] and any fault of the lambda sensor must be reflected through the "check engine" light on the instrument panel, the driver may not be aware of such fault and may not be willing to replace the lambda sensor when the car can still be driven without significant defect.In that case, the emissions and fuel consumption of that car are already significantly deteriorated.Therefore, maintaining a satisfactory air-ratio control performance when the lambda sensor is under failure or warming up during cold start is of great significance.This paper proposes to build a supplementary air-ratio model to compensate the lambda sensor, in which the measured air-ratio signal is not required as the model input.
From the open literature [15,16], it is possible to predict the air-ratio without using the previous air-ratio signal.For instance, Gassenfeit and Powell [15] compared two algorithms that can predict the air-ratio from either the cylinder pressure time history patterns or the ratio of the cylinder pressure before and after combustion.Another example is the method described by Asik et al. [16], in which the airratio can be roughly estimated from induced crankshaft speed fluctuations.However, the quantities used in these algorithms, say, the in-cylinder pressure and delicate crankshaft speed fluctuation, are usually unavailable in normal vehicle engines because expensive sensors are required.Moreover, as mentioned, empirical equations may not be suitable for real applications.Thus, by following the framework in [12], this study attempts to construct the air-ratio model from experimental data.Extreme learning machine (ELM) [17] is currently a popular and effective algorithm for training model from sample data.Many recent studies [18,19] already showed that ELM is superior to other famous methods, such as neural-networks, least squares support vector machines, and relevance vector machine, in terms of generalization performance and computational load.ELM has been employed for various practical applications too [20,21].Thus, ELM is selected in this study to develop the supplementary air-ratio model.
Among so many variants of ELM, kernel-based ELM is adopted in this study to build the model.It is because, in kernel ELM, the random feature mapping is replaced with a kernel function, so randomness does not occur and the chance of result variations could be reduced [22].In fact, the model built in [12] was based on an online variant of ELM, whose backbone is simply a basic ELM (i.e., the model is still an ELM with random feature mapping but can be updated when online data is provided).The reason why offline version of ELM is used in this paper instead of the online one is that the real-time data of air-ratio will not be available when the lambda sensor is malfunctioning.As both the air-ratio model from [12] and the proposed air-ratio model are made from the same basis (kernel ELM), a fair comparison can be made to evaluate their performances.
In order to verify the effectiveness of the ELM supplementary air-ratio model, this paper also proposes a nonlinear MPC algorithm for air-ratio control, which utilizes a switch to toggle between the lambda sensor signals and the ELM supplementary air-ratio model predictions.When the lambda sensor works well, the air-ratio measurement will be used; when the lambda sensor is under failure, the backup air-ratio model will be used.The MPC under such strategy is called fault tolerance controller (FTC), which is a novel nontrivial application of ELM.Based on the multiplestep-ahead air-ratio predictions, a control signal is obtained to regulate the air-ratio to trace the desired values.The proposed FTC is also compared with the typical air-ratio control techniques, including online sequential extreme learning machine model predictive controller (OEMPC) [12], diagonal recurrent neural-network model predictive controller (DNMPC) [10], and traditional open-loop air-ratio control system, to evaluate its performance.The concept of kernelbased ELM is provided in Section 2. The construction and evaluation of the ELM supplementary air-ratio model are given in Section 3. The detail of the FTC design is presented in Section 4. Experimental implementation and evaluation of the proposed FTC and OEMPC are provided in Section 5.

Kernel-Based Extreme Learning Machine
Kernel-based ELM is a learning scheme for single-hiddenlayer feedforward network, with the use of kernel [17].Considering a set of  training samples D = {(x  ,   ),  = 1, . . ., }, with each x  being a  dimensional input vector and   as the target scalar output, a single-hidden-layer feedforward network with  hidden nodes can be written as where h(x  ) = [ℎ 1 (x  ), . . .,ℎ  (x  )] is the feature mapping output with respect to x  and  = [ 1 , . . .,  ]  is the output weight vector.In kernel-based ELM, this weight vector is determined by minimizing both the norm of the weight vector and the training error.The corresponding optimization problem is Minimize: where  is a user-specified penalty term for regularization purpose.
Then, based on the Karush-Kuhn-Tucker theorem, optimizing ( 2) is equal to solving the following dual optimization problem: where   is the Lagrange multiplier.By taking derivatives on (3), the following conditions are obtained: where By combining the conditions in (4) and eliminating the Lagrange multipliers   , the optimal weight vector could be calculated as where T = [ 1 , . . .,   ]  and I is the identity matrix.
With (6), the output function of the network for an unknown input X becomes Finally, by defining a kernel matrix satisfying Mercer's conditions as ] In this study, the function (X) is the supplementary airratio model.

Supplementary Air-Ratio Model
3.1.Model Construction.The objective of the ELM supplementary air-ratio model is to predict the future air-ratio   when the lambda sensor is under failure or during cold start.Previous air-ratio measurement must not be used as the inputs to the model.Three engine parameters related closely to the air-ratio performance were carefully selected as the model inputs: fuel injection time (FI), engine speed (ES), and throttle position (TP).The order of the system dynamics was chosen to be 2 (i.e., second-order system with 2 past time steps), which gives the minimum prediction error [12].The structure of the supplementary air-ratio model is shown in Figure 1.
To build the supplementary air-ratio model, experimental engine data was used rather than empirical equation data.A Honda DC5 Type-R test car with K20A i-VTEC engine was employed to perform the experiment.A MoTeC M800 programmable electronic control unit (ECU) with factory calibration data was used as a base controller to control the engine.The car was run over a dyno test, and totally 5800 data samples were acquired using a wide-band lambda sensor subject to random throttle positions.The first 3000 data samples were used as the training dataset, D, to build the supplementary air-ratio model.The last 2800 data samples were used as the test dataset, D t , to evaluate the generalization of the built supplementary air-ratio model.After training, the output function of the ELM supplementary model for an unseen case can be written in the following form: where x,T ∈ D are the training data,   is the prediction output vector, X is the unseen input vector, (x  , kernel, I is the identity matrix, and  is the user-specified penalty term.The hyperparameters of  2 and  in the kernel-based ELM were tuned by using the hybrid inference introduced in [18], which combined leave-one-out cross validation and Bayesian inference.The details can be found in [18].

Evaluation of Engine Air-Ratio Model.
To evaluate the proposed ELM supplementary air-ratio model, its prediction result was compared with the air-ratio model obtained from [12], which is a time-series model with the air-ratio histories as the input.The performance of the models is evaluated in terms of prediction accuracy for unseen case from D t .The prediction results of the two air-ratio models over D t are shown in Figure 2.
From Figure 2, it can be seen that both models achieve comparative performance.To further evaluate the prediction accuracy, the logarithmic mean absolute error (LMAE) for the prediction of each model is determined using the following equation: where   is the model prediction value corresponding to X  ,   is the actual experimental value corresponding to X  , and  is total number of predictions from D t , which is 2800 in this case study.The larger the LMAE is, the higher the model accuracy is.The evaluation results are provided in Table 1.
The prediction results from Table 1 show that the prediction accuracy of the proposed ELM supplementary air-ratio model is lower than that of the air-ratio model obtained from [12].It has to be noted that the dynamics of previous airratio measurement (i.e.,   ( − 1),   ( − 2)) are not included in the construction of the supplementary air-ratio model.It is reasonable that the prediction accuracy is not as good as the one using these previous air-ratio histories.However, the accuracy is still acceptable, so ELM was confidently selected to implement the FTC in this study.

MPC Based Fault Tolerance Controller (FTC)
The proposed FTC can be viewed as an improved version of the OEMPC from [12].Its aim is to maintain the engine airratio control performance when the lambda sensor is under failure.The design of the proposed FTC is shown in Figure 3.
The FTC consists of two air-ratio models, including the one from [12] and the supplementary air-ratio model from Section 3, a switch toggling between these two models, and an optimizer based on Brent's method [12,23].The engine response over a specified time horizon is predicted by either the air-ratio model from [12] or the supplementary air-ratio model, depending on the condition of the lambda sensor.As far as the lambda sensor works well, the engine response is predicted by the air-ratio model from [12].Normally, the lambda value for a combustible mixture is in the range of 0.4 to 3 [24].When the lambda measured is out of this range for a firing engine, it means that the lambda sensor is under failure or during cold start.In this situation, the engine response is predicted by the supplementary air-ratio model.The predictions are used by the optimizer to determine the tentative fuel injection time   that minimizes the following performance criterion over the specified time horizon, and then the optimal fuel injection time signal  is sent to the engine: where  1 and  2 define the prediction horizon,  and   are the time step and the control horizon, respectively,   ( + ) is the target air-ratio at the time step  + ,   is the predicted air-ratio by either of the two air-ratio models at the time step  + , and  is a user-defined weight which penalizes excessive movement of the control signal (i.e., the fuel injection time).The variables   ( +  − 1) and   ( +  − 2) in the second part of ( 12) are the tentative fuel injection time at the time steps  +  − 1 and  +  − 2, respectively.The second part of ( 12) can ensure the stability of the controller output [12].Moreover, the stability of MPC strategy has also been proved in [25,26], so the stability of the proposed control scheme could be guaranteed.In short, the proposed control scheme in Figure 3 can provide both regular and fault tolerance control of engine air-ratio.

Single Dimension Optimization Approach.
The original optimization problem involved in this paper is multidimensional and constrained with the tentative control signals,   (),   ( + 1), . . .,   ( +   − 1), over the control horizon   which can minimize the objective function (  ) of (12).Then the predicted air-ratios,   ( +  1 ),   ( +  1 + 1), . . .,   ( +  2 ), can trace the target air-ratios,   ( +  1 ),   ( +  1 + 1), . . .,   ( +  2 ), by using the optimized fuel injection time-series.Each fuel injection time is normally bounded within the range from 2 ms to 15 ms.However, the multidimensional optimization always requires heavy computation, especially when constraints exist.Real-time control applications often put emphasis on computational speed.The research of [10] showed that the one-dimensional approach is efficient for real-time air-ratio control and the overall tracking error is similar to that using multidimensional optimization approach.Therefore, the optimization problem to be solved is reduced to one dimension.In this paper, the control signal  is assumed to remain constant over the control horizon.Therefore, the tentative control signal in the objective function is also constant over the control horizon; that is,   () =   ( + 1), . . ., =   ( +   − 1).In this way, only one parameter   () is needed to be determined, and the final fuel injection time at each time step  is set to be the optimal value of   ().

Brent's Method. There are many optimization techniques available for MPC and each technique has its pros and cons.
A well-known technique-Brent's method-was selected as the MPC optimizer in this study for illustrative purpose.Brent's method is a robust and efficient optimization method.It combines the typical parabolic interpolation and goldensection search.The objective function in each iteration is approximated by interpolating a parabola through three existing points.The minimum point of the parabola is taken as a guess for the minimum point if certain criteria are met.Otherwise, golden-section search is carried out.The advantage of this method is that the high convergence rate of parabolic interpolation can be maintained without losing the robustness of golden-section search [23].The general working principle of Brent's method is shown in Figure 4.The detail optimization procedure of Brent's method was presented in [23] and is not presented herein.There are three parameters of Brent's method, including the initial interval of the input variable, [, ] (i.e., the limit of the fuel injection time), the tolerance, tol, and the maximum iteration for stopping the optimization procedure.The three variables were set to be [2,15], 0.05, and 50, respectively, because the fuel injection time varies within 2 to 15 ms from 0% to 100% throttle.car used for sample data collection in Section 3 (Honda DC5 Type-R with K20A i-VTEC engine and MoTeC M800 programmable ECU).The algorithm of FTC was first implemented using MATLAB.A National Instrument (NI) Com-pactDAQ chassis DAQ-9178 was then employed for signal processing between the MATLAB program and the MoTeC ECU, via NI LabVIEW program.In other words, NI DAQ-9178 serves as an interface between the MATLAB program and the MoTeC ECU.Apart from fuel injector control, the MoTeC ECU also contains many basic control maps, such as ignition map and valve timing map, to maintain the engine operation.The experimental setup and the signal flow between the test car and FTC are shown in Figure 5.

Pilot Test-Tracking Ability.
To evaluate the tracking performance of the proposed FTC, a pilot test was carried out.
The test was done under the condition that the lambda sensor is already malfunctioning (i.e., the supplementary air-ratio model in the FTC is used).The test cycle for the pilot test is shown in Figure 6, where the throttle position gradually changes from 15% to 75% throttle (the throttle position increases by 15% every 5 s).Such test cycle is designed by referring to [10] which almost covers the whole operating condition.In this test, the air-ratio is required to track the target air-ratios from the stoichiometric value (1.00) for minimum emissions to a value for the best brake-specific fuel consumption (1.05) and then to a value for maximum engine power (0.95) as the throttle position is gradually changed from 15% to 75% throttle.Such tracking of air-ratio changes is essential for automobiles to satisfy the emission, fuel consumption, and power requirements under different operating conditions [6].
After choosing the sampling time to be 0.01 s, the tracking ability of the FTC was examined.By trial-and-error, the parameters of the optimizer were chosen as  1 = 1,  2 = 8,  = 0.75, and   = 5.With the test cycle shown in Figure 6 and the parameters chosen, the air-ratio control result and the corresponding fuel injection time of the FTC are shown in Figure 7.It can be seen from Figure 7 that the FTC can regulate the air-ratio to follow the target air-ratios with acceptable deviation, even when the lambda sensor is under failure.
To further verify the result, three tests were done.The first one was conducted under the condition that the lambda sensor did not work, and traditional air-ratio controller (i.e., factory lookup table) was employed.The other two were carried out under the condition that the lambda sensor could work well, and a diagonal recurrent neural-network model predictive controller (DNMPC), which is a recent air-ratio control algorithm applicable when the lambda sensor works normally [10], was employed along with the proposed FTC for comparison purpose.The air-ratio control results and the corresponding fuel injection time of the three tests are shown in Figures 8, 9, and 10, respectively.
When comparing Figure 8 to Figure 7, it is obvious that the proposed FTC outperforms traditional air-ratio control system when the lambda sensor does not work.Furthermore, by comparing Figures 9 and 10, it can be seen that the proposed FTC can perform slightly better than the DNMPC when the lambda sensor works properly.Finally, comparing Figure 10 to Figure 7, it can be learnt that the proposed FTC can achieve better performance when the lambda sensor is under normal condition.This is not surprising because when the lambda sensor works well, the air-ratio model from [12], which has better prediction capability, is utilized, resulting in better control performance.For comparison purpose, LMAE is again chosen as the tracking index (TI) to evaluate the tracking ability of the controllers, defined by where  is time step,   is the total number of time step in the test,   is the actual air-ratio at each time step, and   () is the corresponding target air-ratio at each time step.The target air-ratio varies according to the aforesaid practical operating conditions.The corresponding results under different lambda sensor conditions are shown in Table 2.
The results in Table 2 show that, even when the lambda sensor is under failure, the control performance of the FTC can still maintain about 90% of that under normal lambda sensor condition.Table 2 also shows that the performance of the proposed FTC under sensor failure is similar to that of DNMPC.The reason may be that the accuracy of the ELM supplementary model is similar to that of the timeseries diagonal neural-network model in [10].Moreover, as compared to traditional air-ratio control system (i.e., factory lookup table), the proposed FTC can improve the air-ratio control performance at about 30% when the lambda sensor is under failure, indicating that the overall air-ratio control performance of the FTC is satisfactory.
Air-ratio model prediction accuracy is one of the most important factors affecting the control performance of the model predictive controllers.Therefore, as the air-ratio measurement cannot be provided for model prediction when the sensor is under failure, degrading of the air-ratio control performance is unavoidable.Thankfully, with the proposed ELM supplementary air-ratio model, the control performance can still be maintained at an acceptable range.This implies that the proposed model and control strategy is feasible.

Conclusions
In this study, a supplementary air-ratio model was constructed using kernel-based ELM, in which the air-ratio time histories were not included in the model input.The purpose of the model is to predict the future air-ratio dynamics when the previous air-ratio measurement is unavailable.With the supplementary air-ratio model, a FTC for engine air-ratio control was developed as the first attempt in the literature.In traditional case, the lambda sensor is assumed to work properly, so traditional air-ratio control system may not perform well when the lambda sensor is malfunctioning.The purpose of the proposed FTC is to maintain the air-ratio control performance even when the lambda sensor is under failure or during cold start.
To evaluate its performance, the proposed FTC was successfully implemented and tested on a real automotive engine.Experimental results show that when the lambda sensor does not work well, the air-ratio control performance of the FTC can be effectively maintained over 90% of that under normal lambda sensor condition.Therefore, the FTC is a promising backup engine air-ratio control strategy.In other words, the proposed control scheme in Figure 3 is very suitable to implement in the automotive ECU to provide both regular and fault tolerance control of engine air-ratio.

Figure 2 :
Figure 2: Comparison between predicted air-ratios and the corresponding actual air-ratios.

uFigure 3 :
Figure 3: Structure of FTC for engine air-ratio control.

Figure 4 :
Figure 4: General working principle of Brent's method.

Figure 5 :Figure 6 :
Figure 5: Experimental setup and signal flow between test car and FTC.

Figure 7 :Figure 8 :Figure 9 :
Figure 7: (a) Air-ratio control results and (b) corresponding fuel injection time of FTC under lambda sensor failure.

Figure 10 :
Figure 10: (a) Air-ratio control results and (b) corresponding fuel injection time of FTC under normal lambda sensor condition.

Table 1 :
Accuracy of different air-ratio models.
2) is the selected radial basis function

Table 2 :
Performance of different controllers for the pilot test.