An ELM Based Online Soft Sensing Approach for Alumina Concentration Detection

The concentration of alumina in the electrolyte is of great significance during the production of aluminum; it may affect the stability of aluminum reduction cell and the current efficiency. However, the concentration of alumina is hard to be detected online because of the special circumstance in the aluminum reduction cell. At present, there is lack of fast and accurate soft sensing methods for alumina concentration and existing methods can not meet the needs for online measurement. In this paper, a novel soft sensing method based on a modified extreme learning machine (MELM) for online measurement of the alumina concentration is proposed. The modified ELM algorithm is based on the enhanced random search which is called incremental extreme learning machine in some references. It randomly chooses the input weights and analytically determines the output weights without manual intervention. The simulation results show that the approach can give more accurate estimations of alumina concentration with faster learning speed compared with other methods such as BP and SVM.


Introduction
In the industrial aluminum reduction cells, the stability of the alumina concentration is the key issue to maintain high efficiency during the production of aluminum.It is easy to lead to the occurrence of the so-called "anode effect" if the alumina content in the electrolyte becomes too low (e.g., 1%-1.5%).When it occurs, cell voltage rises abruptly to 30v-50v, which directly affects the energy balance of aluminum reduction cells.It is important to avoid the high alumina concentration because alumina-rich sludge will accumulate at the base of the cell and the cell operation can be seriously disrupted [1].Therefore, how to detect the distribution of alumina concentration in the cell in real time is the key problem to control the production of aluminum.The site environment of aluminum reduction cell, which has the characteristics of large current, strong magnetic field, high temperature, high humidity, and a lot of dust, is very severe and complex.Aluminum reduction cell is a severe nonlinear, multi-input multioutput, slow timevariety, long time-delay, and coupled process.Therefore, it is a challenge to seek an online soft sensing method for alumina concentration.Numerous investigations have been carried out on the soft measurement method for alumina concentration by the researchers.A prediction model based on wavelet neural network was proposed by Li et al. [2].The prediction method based on linear regression and orthogonal transform is applied to improve the accuracy of the alumina concentration forecast by Lin et al. [3].Yan and Liang proposed a predictive model of aluminum reduction cell based on LS-SVM [4].Li et al. [5] proposed a new fuzzy expert control method based on smart identification, multicontrol mode, and decision-making mechanism to achieve the alumina concentration prediction and real time control.The GM(1, 1) model is introduced into the aluminum concentration estimate by Zhang et al. [6].However, the computational burden of the above nonlinear predictive models is still large when the dimension of input variable increases; the learning speed and accuracy of networks are in general far slower and can not meet the requirement of real time detection.
Figure 1 shows the experimental environment in the ZunYi aluminium electrolysis factory in China.In industries, there often exist some crucial variables that can not be directly measured online due to the fact that no sensor is available in the certain complex environment or due to its high cost.Soft sensing technology is a way to solve the problems.The soft sensing technology is widely used and becomes one of the important developing directions of surveying and processing control area.In practice, the application and research of this technology have gotten more extensions and many related technologies based on it have emerged [7][8][9][10].
The main thought of the soft sensing technology is to build one model which uses variables that could be directly online measured as input and thus the variables to be estimated as output, to use many kinds of complex calculating and evaluation and to get the values of detecting variables by computer software [11][12][13][14].So the main problem of soft sensing technology is how to build the relation model between detecting variables and other easy getting variables.By now, there are many methods to build the models, and many methods are in the trend of intersecting and mixing together.In all the methods, the artificial intelligence method is used often, such as the method based on model identification, the method based on artificial neural network, or the method based on fuzzy set theory.Some professors and scholars have done some research about the technology, such as global asymptotic stability of neural networks with multiple time-varying delays and fuzzy model-based robust networked control for a class of nonlinear systems proposed by Zhang et al. [15,16], weighted least squares support vector machines, robustness and sparse approximation, proposed by Suykens et al. [17], Artificial Neural Network in process engineering proposed by Willis et al. [18], and the modified extreme learning machine method by Cao et al. [19].Soft sensing technology is applied to various fields; Wang and Ren proposed soft sensing method for wastewater treatment based on BP neural network [20].Rolling bearing fault detection based on the Teager Energy Operator and Elman Neural Network was proposed by Liu et al. [21].
So far, the widely used method of determining alumina concentration in the industrial factory is to use the spectrometer to analyze the sampled electrolyte.It is an offline method.The improved ELM method is applied to build up the soft sensing online detection approach of alumina concentration in this paper.This ELM algorithm tends to provide the best generalization performance at extremely fast learning speed.The experimental result shows that the new method can produce the best generalization performance and learn much faster than the traditional prediction models.
The following sections are organized as follows.Section 2 shows the theory of the extreme learning machine.Section 3 proposes the modified ELM algorithm.Data selection and data preprocessing are shown in Section 4. Section 5 gives the simulation results.Section 6 summarizes the conclusions.

The Theory of Extreme Learning Machine
Huang proposed extreme learning machine (ELM) algorithm; ELM was originally proposed for the single-hiddenlayer feedforward neural networks (SLFNs) and then it extends to the generalized SLFNs.ELM can randomly generate the input weights and the bias of hidden nodes.It uses the theory of least squares to get the output weights.The learning speed of ELM can be thousands of times faster than traditional feedforward network learning algorithms like backpropagation (BP) algorithm while obtaining better generalization performance and smaller training error [22,23].Figure 2 shows the single-hidden-layer feedforward network (SLFN) architecture.
The fact that standard SLFNs with  hidden neurons with activation function ℎ() can approximate these  samples with zero error means that ∑  =1 ‖  −   ‖ = 0; there exist   ,   , and   such that The above  equations can be written compactly as where is called the hidden layer output matrix of the neural network.ELM is to minimize the training error as well as the norm of the output weight.Minimize ‖ − ‖ 2 and ‖‖.The minimal norm least squares method instead of the standard optimization method was used in the original implementation of ELM: where  Γ is the Moore-Penrose generalized inverse of .
Several methods can be used to calculate the  Γ ; these methods may include orthogonal projection, orthogonalization method, iterative method, and singular value decomposition (SVD), and ELM algorithm makes use of SVD, where  Γ = (  ) −1   , so The algorithm ELM can be summarized as Three-Step Learning Model.Given a training set ℵ = {(  ,   ) |   ∈   ,   ∈   ,  = 1, 2, . . ., }, an activation function ℎ(), and the hidden neuron number , we have the following steps.
Step 2. Calculate the hidden layer output matrix .

The Modified ELM Algorithm
where  is the ridge parameter.Superficially, it is possible to get the inversion of design matrix   .The following is the new results of ( 8) and ( 9): which denotes that Ridge Regression is biased.Consider which denotes that Ridge Regression makes the estimation more stable.Consider Hoerl and Kennard had proved that Ridge Regression has less mean square error than the ordinary regression under the proper ridge parameter.It is as follows: Mathematical Problems in Engineering So, when  → 0 + , lim From the above equations, MSE( β * ) is an increasing function of  when  ∈ (0, ), where ( 1 ()/)| = = ( 2 ()/)| = .Therefore, the selection of parameter  is essential to the performance of Ridge Regression.In our ER-ELM algorithm, a method to determine the ridge parameter proposed by Huang [24] is used: where β is the ordinary ELM algorithm estimation and σ2 = ∑  =1 (  − β  ) 2 /V, V =  − 1.

To Select the Number of Hidden Nodes Based on the Improved ELM. The Error Minimized Extreme Learning
Machine algorithm starts from a small size of ELM hidden layer and adds random hidden node (nodes) to the hidden layer, while the output weights are updated incrementally.Suppose a SLFN,  1 = ( 1 , . . .,   0 ,  1 , . . .,   0 ,  1 ), denotes the hidden layer output matrix with  0 hidden nodes and ridge parameter  1 calculated by (19).Considering the poor performance due to lower number of hidden nodes, additional  hidden nodes are added to the SLFN.A new hidden layer output matrix  2 is composed of  1 and other  extra hidden nodes as where  = ( ) ,  1 −  0 = , and  2 is ridge parameter of   .
In order to facilitate the calculation, the inversion is substituted as follows: where So where  =  −  1  + 1 .Similarly, we get  =  + 1 −  + 1 .Now, a new hidden layer output matrix is obtained which has less output error.Then, we can update the output weight matrix based on the new hidden layer output matrix.

Data Selection and Preprocessing
In the aluminum production, through referring to relative documents and soliciting experts opinion, there are many factors that affect the alumina concentration, such as alumina feeding speed, cell voltage, series current, current of anode rod, voltage between anode rod and cathode bar, and bath temperature [25].Existing predictive method of alumina concentration is to get an average alumina content in the aluminum reduction cell; the distribution of alumina concentration in the cell is not known yet.At present, people want to know the distribution situation of alumina content in the cell in order to know the process of production better and control the production of aluminum more accurately.Our experimental aluminum reduction cell has 24 anode rods; we can get the current signal of 24 anode rods, voltage signal between anode rods and cathode bars, and alumina concentration signal below the 24 anode rods.Through experiment and analysis, we find that the voltage signal between anode rod and cathode bar can reflect the alumina concentration below the anode rod more accurately.So we can use the voltage signal between anode rod and cathode bar in the aluminum reduction cell to reflect the distribution of alumina concentration.To use the ELM algorithm, we decide to select voltage between anode rod and cathode bar variable as model input according to experiments, and output variable is alumina concentration in the electrolyte below the anode rod.
It is necessary to do the data denoising preprocessing before using the algorithm, because the process of data collection may introduce noise, where data collection is affected by interference and influence of all kinds of noise signal.At present, there are two denoising methods, the traditional filtering method and the wavelet denoising method.Traditional denoising method is based on Fourier analysis and can always be used in the environment where signal and noise are very small.While wavelet analysis is known as the "microscope" of mathematical analysis, it is a time-frequency analysis method of signal, with the characteristics of multiresolution analysis [26].Different signals may choose the different denoising methods.Through experiment and comparision, we decide to use the wavelet denoising method in view of the voltage signal between anode rod and cathode bar.

Simulative Results of Alumina Concentration
In this paper, we select voltage between anode rod and cathode bar as model input and alumina concentration in the electrolyte below the anode rod as model output.
First, ELM algorithm is applied to build soft sensing method model of alumina concentration.In general, active functions play an important role in computing of neural networks.Widely used active functions in the ELM algorithm are , , ℎ, and .Through comparison, we find that the  function has more outstanding performance than , ℎ, and .So we apply  function as active function in the ELM algorithm.In order to make comparison, we also use the BP and SVM algorithm to build soft sensing models of alumina concentration [27,28].The BP parameters are chosen as 17 hidden layer neurons and 1 output layer neuron and transfer function of hidden layer is tan-sigmoid and transfer function of output layer is .
Data in this paper came from a 350 kA prebaked aluminum reduction cell in the ZunYi aluminium electrolysis factory; Figure 3 shows experimental aluminum reduction cell and anode rod.We got the data of voltage between anode rod and cathode bar through the voltage measurement instruments.At the same time, we obtained the electrolyte below the experimental anode rod in the experimental aluminum reduction cell, and then we used the  fluorescence spectrometer in the laboratory to analyze the alumina concentration.Figure 4 shows the sampled electrolyte.We got the experimental data through this method.We select 100 pairs as samples to construct sample set (  ,   ), where   ∈  denotes voltage between anode rod and cathode bar and   ∈  denotes alumina concentration obtained at the same time with the voltage siginal.
The ELM, BP, and SVM soft sensing models are trained by the same sample set.All the data are preprocessed before training and simulating in the algorithm.For the purpose of comparing the three models quantitatively, we substitute ten   of new sample (out of the sample set) into ELM, BP, and SVM models, respectively, to calculate corresponding T ; simulation results of ELM model are shown in Figure 5; the alumina concentration results of three models are shown in Table 1.To see the results more clearly, the actual alumina concentration values and simulation results are displayed under the same axis which is shown in Figure 6 The simulation results of five performance indicators are shown in Table 2. From Figure 7, the horizontal axis denotes the values of voltage between anode rod and cathode bar and the vertical axis denotes the alumina concentration below the experimental anode rode.The simulation results of ELM approach the sample data in a certain range.As is shown in Table 1 and Figure 8, the values of output of ELM model are closer to the actual values of alumina concentration.From Table 2, Training Time of ELM model is 0 s whose

Conclusions
Alumina concentration is very important in the aluminum electrolysis, which may affect the performance of aluminum reduction cell.It is difficult to measure the alumina content due to the complicated environment of aluminum reduction cell.This paper proposes a novel soft sensing method of alumina concentration in the electrolyte based on extreme learning machine (ELM) and builds the relationship between  alumina concentration and voltage between anode rod and cathode bar.Through the simulation results and comparison of BP model and SVM model, we can see the validity and advantage of the proposed method.This method is able to effectively achieve rapid and reliable estimation of alumina concentration in a relatively short time.

Figure 3 :
Figure 3: The voltage between number 20 anode rod and cathode bar and the alumina concentration in the electrolyte below the anode rod.
. There are five performance indicators to measure the quality of algorithm: Training Time, Testing Time, Training RMSE (root mean square error), Testing RMSE, and Average Relative Error (    − T        × 100%.

Figure 4 :
Figure 4: The voltage between number 21 anode rod and cathode bar and the alumina concentration in the electrolyte below the anode rod.

Figure 5 :
Figure 5: Experimental aluminum reduction cell and anode rod.

Figure 7 :
Figure 7: Simulation result of ELM model.

Figure 8 :
Figure 8: Actual alumina concentration values and simulation results.

Table 1 :
Simulation alumina concentration results of three models.

Table 2 :
The comparison of performance indicators.