A Clustering and SVM Regression Learning-Based Spatiotemporal Fuzzy Logic Controller with Interpretable Structure for Spatially Distributed Systems

Many industrial processes and physical systems are spatially distributed systems. Recently, a novel 3-D FLC was developed for such systems. The previous study on the 3-D FLC was concentrated on an expert knowledge-based approach. However, in most of situations, we may lack the expert knowledge, while input-output data sets hidden with effective control laws are usually available. Under such circumstance, a data-driven approach could be a very effective way to design the 3-D FLC. In this study, we aim at developing a new 3-D FLC design methodology based on clustering and support vector machine SVM regression. The design consists of three parts: initial rule generation, rule-base simplification, and parameter learning. Firstly, the initial rules are extracted by a nearest neighborhood clustering algorithm with Frobenius norm as a distance. Secondly, the initial rule-base is simplified by merging similar 3-D fuzzy sets and similar 3-D fuzzy rules based on similarity measure technique. Thirdly, the consequent parameters are learned by a linear SVM regression algorithm. Additionally, the universal approximation capability of the proposed 3-D fuzzy system is discussed. Finally, the control of a catalytic packed-bed reactor is taken as an application to demonstrate the effectiveness of the proposed 3-D FLC design.


Introduction
Many industrial processes and physical systems such as industrial chemical reactor 1, 2 , semiconductor manufacturing 3 , and thermal processing 4 are "distributed" in space.They are usually called spatially distributed systems, or distributed parameter systems 1 .The states, controls, and outputs of such systems depend on the space position as well as on the time 2 .Traditionally, model-based methods are used to control such systems, where a good mathematical model is definitely required.However, the process model may not be easily obtained in many complex situations, and then, a model-free control method has to be used.This leads to the recent development of the novel three-dimensional fuzzy-logic control 3-D FLC 5-8 , which has the inherent capability to process spatiotemporal dynamic systems.The 3-D FLC uses one kind of three-dimensional 3-D fuzzy set shown in Figure 1 , which is composed of the traditional fuzzy set and a third dimension for the spatial information, and executes a 3-D rule inference engine.It is actually a kind of spatiotemporal fuzzy-control system with the traditional model-free advantage.
To date, the 3-D FLC design has been focused on an expert-knowledge-based approach 5 , that is, the fuzzy-rule design is from human experts' knowledge.In this approach, human knowledge to the control solution must exist, and be structured.Practically, experts may have problems structuring the knowledge 9 .Sometimes, although experts have the structured knowledge, they may sway between extreme cases: offering too much knowledge in the field of expertise, or tending to hide their knowledge 9 .Thus, we often lack expert knowledge for control that is usually hidden in an input-output data set.Under this circumstance, a data-driven design becomes a good choice for the 3-D FLC, that is, extraction of fuzzy rules from a spatiotemporal input-output data set.Since the research on the 3-D FLC is just at the beginning stage, extracting 3-D fuzzy control rules from a spatiotemporal data set is still a challenging and open problem for spatially distributed systems.
Traditional data-driven FLC design methods have been developed in the past three decades.They are usually composed of three parts: rule generation, structure optimization, and parameter optimization 10 .For instance, grid partitioning of multidimensional space 11 and clustering technique 12 can be used to generate rules automatically; reducing redundancy variable 12 , fusing similar clusters 13 , and fusing similar fuzzy set 14 can be applied to reduce the rule number and realize the structure optimization; genetic algorithm 15 and gradient decent approach 16 can be adopted for fine tuning of membership function and realize the parameter optimization.For a complete review of data-driven fuzzy system design, one can further refer to 10 .These methods provide useful solutions to a traditional FLC design.
In this study, we aim at developing a new data-driven 3-D FLC design method based on clustering and SVM-regression learning.The initial 3-D rule base is first generated by a nearest-neighborhood-clustering method from a spatiotemporal data set via defining Frobenius norm as a distance.Then, the initial 3-D rule base is simplified based on similarity measure technique defined for 3-D fuzzy sets and 3-D fuzzy rules.Subsequently, an SVMregression learning algorithm is used to learn the parameters of the rule consequent parts.In addition, the universal approximation capability of the proposed 3-D fuzzy system is discussed.
The paper is organized as follows.Preliminaries about 3-D FLC and SVM regression are addressed in Section 2. In Section 3, a clustering and SVM-regression learning-based 3-D fuzzy control design methodology is presented in detail.In Section 4, the universal approximation capability of the proposed 3-D fuzzy system is presented.In Section 5, a catalytic packed-bed reactor is presented as an example to illustrate the proposed design scheme of a 3-D FLC and validate its effectiveness.Finally, conclusions are given in Section 6.

3-D FLC
The 3-D FLC is designed to have the inherent capability to deal with spatial information and its basic structure is shown in Figure 2. It has a similar functional structure similar to the traditional FLC, which consists of three basic blocks: fuzzification, rule inference, and defuzzification.However, it will differ in the detailed operations because of the spatial processing requirement.Generally, the 3-D FLC will be involved with the following basic designs: 3-D membership function MF , 3-D fuzzification, 3-D rule base, 3-D rule inference, and defuzzification.One can refer to 5 for detailed description.Once each component of a 3-D FLC is set, a precise mathematical formula of the 3-D FLC can be derived.
Assumed that we have 3-D fuzzy rules represented by the following expression: is the input of x i z from the sensing location z z j 1 ≤ j ≤ p ; z denotes one-dimensional space in a discrete space domain Z {z 1 , z 2 , . . ., z p }; C l i denotes a 3-D fuzzy set, l 1, . . ., N; u denotes output variable the control action ; B l denotes a traditional fuzzy set.
If Gaussian type 3-D membership functions MF are used to describe 3-D fuzzy sets in 2.1 , then we have where μ l Gi denotes the Gaussian type 3-D MF of the ith spatial input x i z in the lth rule; T are the center and width of μ l Gi , respectively; c l i z j and σ l i z j denote center and width of the Gaussian type 2D MF of the ith spatial input x i z at the sensing location z z j .The Gaussian type 3-D MF μ l Gi can be regarded as an assembly of multiple Gaussian type 2-D MFs over the space domain Z.Then, the Gaussian type 2-D MF of the ith spatial input x i z at the sensing location z z j is given as where c l ij c l i z j and σ l ij σ l i z j .Furthermore, if we employ singleton fuzzification, "product" t-norm and "weighted aggregation" dimension reduction 6 in the 3-D rule inference, singleton fuzzy sets for the output variable, and "center of sets" defuzzification 17 , the 3-D FLC can be mathematically expressed as where is a spatial input vector with Ω as the input domain, p as the number of sensors, and s as the number of spatial inputs; N is the number of rules; a j is the spatial weight from the jth spatial point 6 ; ζ l ∈ U is the nonzero value in the singleton fuzzy set of the output variable for the lth rule.
In 2.4 , let then 2.4 can be rewritten as Similar to a traditional FLC 16 , we define φ l x z as a spatial fuzzy basis function SFBF .
Each SFBF corresponds to a 3-D fuzzy rule, and all the SFBFs correspond to a 3-D rule base.Mathematically, a 3-D FLC is a linear combination of all the SFBFs.Equation 2.6 shows that the 3-D FLC is a nonlinear mapping from the input space x z ∈ Ω ⊂ R p×s to the output space u x z ∈ U ⊂ R. It provides us a way to understand and analyze the 3-D FLC from the point of view of function approximation.In Section 4, we will prove that the 3-D FLC has a universal approximation property based on the nonlinear mapping in 2.6 .

Linear SVM Regression
An SVM is a learning algorithm that originated from theoretical foundations of the statistical learning theory 18 and has been widely used in many practical applications, such as bioinformatics, machine vision, text categorization, handwritten character recognition, time series analysis, and so on.The distinct advantage of the SVM over other machine learning algorithms is that it has a good generalization ability and can simultaneously minimize the empirical risk and the expected risk 19 .The SVM algorithms can be categorized into two categories: SVM classification and SVM regression.In this study, we are concerned with the SVM regression with ε-insensitive loss function 20 .
Suppose we have a training set D { x i , y i ∈ R s × R, i 1, . . ., q} consisting of q pairs x 1 , y 1 , x 2 , y 2 , . . ., x q , y q , where the inputs are s-dimensional vectors, and the labels are continuous values.In ε-SVM regression, the goal is to find a function f x, w so that for all training patterns x has a maximum deviation ε from the target values y i and has a maximum margin.The ε-insensitive loss function is defined as follows: The ε-insensitive loss function defines an ε tube 9 .
The regression problem can be formulated as a convex optimization problem as follows: Journal of Applied Mathematics subject to where ξ i and ξ * i are slack variables, and the constant C is a design parameter chosen by the user, which determines the trade off between the complexity of f x, w and the approximate error.
The above optimization problem can be solved in a dual space.By introducing the Lagrange multipliers, the primal optimization problem can be formulated in its dual form as follows:

2.11
Solving the dual quadratic programming problem, we can find an optimal weight vector w and an optimal bias b of the regression hypersurface given as follows:

2.12
Then, the best regression hypersurface is given by The training pattern x i with nonzero α * i − α i is called support vector SV .

Clustering and SVM-Regression Learning-Based 3-D FLC Design
Clustering and SVM-regression learning-based 3-D FLC design is a novel design of a 3-D FLC by integrating a nearest-neighborhood-clustering and an SVM-regression.The design  methodology can be depicted by Figure 3. Firstly, a nearest-neighborhood-clustering method with Frobenius norm defined as a distance is employed to mine the underlying knowledge of the spatiotemporal data set S and yield the initial structure, that is, antecedent part of 3-D fuzzy rules.Because the obtained input space partition may have redundancy in terms of highly overlapping MFs, it is necessary to optimize the obtained initial fuzzy partition.Then, a similarity measure technique is utilized to merge similar 3-D fuzzy sets and to merge similar 3-D fuzzy rules, and then to simplify the initial rule structure.Finally, a linear SVM-regression algorithm is used to learn the parameters of the consequent parts based on an equivalence relationship between a linear SVM regression and a 3-D FLC.

Nearest
The spatiotemporal data set S from a spatially distributed system is composed of n spatiotemporal input-output data pairs given as follows:

Nearest Neighborhood Clustering Method
Clustering method is one of the data-driven learning tools for unlabeled data.It can mine underlying knowledge or data structure from a dataset that is difficult for humans to manually identify.One of the simplest clustering algorithms is the nearest-neighborhood clustering algorithm 16 .However, the existing nearest-neighborhood clustering algorithm has not the capability to deal with spatiotemporal data.In this study, we expand its capability to deal with spatiotemporal data set S, which is of matrix form.The key point is that the Frobenius norm given in 3.2 is used for defining a distance in a nearest neighborhood clustering algorithm.
The nearest neighborhood clustering algorithm is summarized as follows. i Step 1: Begin from the first spatiotemporal data x 1 z .Let the first cluster center c 1 z be x 1 z , the number of data pairs m 1 be 1, and the threshold be ρ 0 for generating new fuzzy rules.
ii Step 2: Suppose that the kth spatiotemporal data x k z k 2, . . ., n is considered, when N clusters have been generated and their centers are c 1 z , c 2 z , . .., and c N z respectively.Firstly, compute the distance between x k z and each center of N clusters using x k z − c l z F l 1, . . ., N .Then, compute the threshold ρ using Hence, the corresponding cluster center c l k z is taken as the nearest neighborhood cluster of x k z .iii Step 3: a If ρ < ρ 0 , then x k z is taken as a new cluster center, and let N N 1, m N 1, and c N z x k z .b If ρ ≥ ρ 0 , x k z belongs to the cluster with the center c l k z .The center of l k th cluster is tuned by introducing a learning rate η η 0 / m l k 1 η 0 ∈ 0, 1 as follows:

Rule Extraction and 3-D MF Construction
After clustering learning, we obtain an input space partition with N cluster centers c 1 z , c 2 z , . . ., c N z .Then, we will produce antecedent part of rule base and construct 3-D MFs in terms of the partition.Each cluster corresponds to a 3-D fuzzy rule.Assumed that we employ Gaussian type 3-D MF.Then, the cluster center corresponds to the center of Gaussian type 3-D MFs in the antecedent part.Thus, the number of fuzzy rules is equal to the number of clusters N. In addition, we determine the width of the Gaussian MFs in terms of the domain of variables.For instance, the width of the Gaussian type 3-D MFs from the same sensing location are defined as where x max i z j and x min i z j are the maximum and the minimum bound values of the ith spatial input variable, respectively.

Structure Simplication
After the initial structure learning, the obtained fuzzy partition of the input space and fuzzy rules may have redundancy in terms of highly overlapping MFs.In this step, we will simplify the fuzzy partition and fuzzy rules.The crucial technique for simpification is similarity measure.The previous similarity measure techniques 14, 21, 22 developed for traditional fuzzy sets and traditional fuzzy rules are not suitable to 3-D fuzzy sets and 3-D fuzzy rules.In this study, we will define a new similarity measure technique.

Similarity Measure
Firstly, we define the similarity of two 3-D fuzzy sets A and B as below.
where d A, B is a distance between A and B. Since Gaussian type 3-D MFs are chosen, the following simple expression can be used to approximate the distance: where c A z j c B z j and σ A z j σ B z j are center and width of the Gaussian type 3-D MF A B at sensing location z z j j 1, . . ., p , respectively.Based on the similarity measure, we can merge similar 3-D fuzzy sets, or merge similar 3-D fuzzy rules.

(i) Merge of Two Similar 3-D Fuzzy Sets A and B
Firstly, the similarity between A and B is computed according to 3.6 .If S A, B is higher than a threshold, we can conclude that A and B are similar, and then merge them into a new 3-D fuzzy set C. The center and width of C are viewed as the average values of A and B, and are given as the following: 3.8 (ii) Merge of Two Similar 3-D Fuzzy Rules R l 1 and R l 2 The similarity R l 1 and R l 2 is inferred by measuring their similarity in the antecedent part.For instance, the similarity computation between R l 1 and R l 2 is given by where R l 1 and R l 2 have the same rule form as in 2.1 , denotes the 3-D fuzzy set for the ith spatial input variable x i z in the l 1 th l 2 th rule.If S rule R l 1 , R l 2 is higher than a threshold, we can conclude that R l 1 and R l 2 are similar, and then merge them into a new 3-D fuzzy rule R l 1 l 2 .The merging of two 3-D fuzzy rules is realized by merging the two fuzzy sets of each spatial input variable in the two 3-D fuzzy rules, respectively.

Similarity Measure-Based Structure Simplification
Based on the similarity measure, the simplification task includes removing 3-D fuzzy sets similar to the universal set, merging similar 3-D fuzzy sets, and merging similar rules.The detailed procedure of structure simplification is summarized as follows. i Step 1: Given a 3-D fuzzy rule base Firstly, set proper thresholds: λ u ∈ 0, 1 for removing 3-D fuzzy sets that are similar to the universal set, λ set ∈ 0, 1 for merging similar 3-D fuzzy sets, and λ rule ∈ 0, 1 for merging 3-D fuzzy rules with similar antecedents.Generally speaking, the threshold λ u is higher than the threshold λ set , while the choice of a suitable threshold λ rule depends on the application.The lower λ set is set, the less fuzzy sets and less fuzzy rules are yielded in the resulting rule base.In this study, we set λ u 0.95, λ set 0.75, and λ rule 1.

Parameter Learning
After the structure simplification, we obtain a rule base with optimized antecedent parts.For a complete rule base, the rest task is to determine the consequent part parameters.In this study, we employ an SVM regression algorithm to learn the consequent part parameter ξ l l 1, . . ., N in the 3-D FLC.
Firstly, the original input samples are transformed into new samples.Utilizing the spatial fuzzy basis functions φ l x k z l 1, . . ., N in 2.5 , we can transform each spatial input sample Then, the original data set S in 3.1 can be transformed into a new data set S as follows:

3.10
Secondly, an equivalence relationship of an SVM regression and a 3-D FLC can be derived based on the new data set S .From 2.13 , the final decision function f φ x k z of an SVM can be described with the following form: where α * k and α k are associated learning parameters in a SVM, The training pattern φ x k z with nonzero α * k − α k is called support vector SV .Furthermore, 3.11 can further be expressed by In 3.12 , the bias term b in a 3-D FLC can be realized by adding a fuzzy rule as follows: where C 0 i is a universal 3-D fuzzy set, whose fuzzy degree is 1 over the space domain for any spatial input x i z , i 1, . . ., s. From 3.12 , we can see that an SVM will be equivalent to a 3-D FLC if 3.14 holds.
Finally, a linear SVM regression is employed to learn the consequent part parameters.Using 3.14 , the parameters ξ l l 1, . . ., N in consequent parts are obtained in terms of the SVM learning, that is,

Universal Approximation of Clustering and SVM-Regression Learning-Based 3-D FLC
In essence, the clustering and SVM-regression learning-based 3-D FLC design is a fuzzy modeling that extracts fuzzy control rules and constructs a 3-D FLC from spatiotemporal data hidden with effective control laws.In other words, the proposed 3-D FLC aims at approximating an unknown nonlinear control function.Thus, in this subsection, we are concerned with its universal approximation capability.The universal approximation capability of the SVM learning-based 3-D FLC can be described by the following theorem.
Theorem 4.1.Suppose that the input universe of discourse Ω is a compact set in R p×s .Then, for any given real continuous function g x z on Ω and arbitrary ε > 0, there exists a 3-D FLC u x z as described in 2.4 satisfying the following inequality: The proof of the theorem is given in the appendix by using Stone-Weierstrass theorem 23 .Theorem 4.1 indicates that the clustering and SVM-regression learning-based 3-D FLC is a universal approximator, that is, it can approximate continuous control functions to arbitrary accuracy.

A Catalytic Packed-Bed Reactor
We take a catalytic packed-bed reactor 1, 5 as an example.The reactor is long and thin as shown in Figure 4.It is fed with gaseous reactant C from the right side, and the zero-order gas phase reaction C → D is carried out on the catalyst.The reaction is endothermic, and a jacket is used to heat the reactor.A dimensionless model that describes this nonlinear tubular chemical reactor is provided as follows: subject to the boundary conditions z 0, T g 0, ∂T s ∂z 0; z 1, ∂T s ∂z 0, 5.2 where T g , T s , and u denote the dimensionless temperature of the gas, the catalyst, and jacket, respectively.The values of the process parameters are given as follows: ε p 0.01, γ 21.14, β c 1.0, β p 15.62, 5.3 B 0 −0.003, α c 0.5, α g 0.5.

5.4
The concerned control problem is to control the catalyst temperature T s z, t throughout the reactor to track a spatial reference profile T sd z 0.42 − 0.2 cos πz in order to maintain a desired degree of reaction rate using the measurements of catalyst temperature from five sensing locations z 0 0.25 0.5 0.75 1 and manipulating one spatially distributed heating source b z 1 − cos πz .The mathematical model 5.1 -5.2 is only for the process simulation for evaluation of the control scheme.The method of lines 24 is used to simulate the model.
In this application, we aim at extracting 3-D fuzzy rules from a spatiotemporal data set using clustering and SVM regression learning algorithm and constructing a complete 3-D FLC without any prior knowledge.

Spatiotemporal Data Collection
The spatiotemporal input-output data set is collected from the catalytic packed-bed reactor controlled by expert-knowledge-based 3-D FLC 5 , where pseudorandom quinary signal PRQS 25 with maximum length of 124 as perturbed signal is added to the control input.Each spatiotemporal input-output data pair consists of a spatial error input e * z e * 1 , . . ., e *

5
T , and an incremental output Δu * , where e * i T s z i , q − T sd z i r * i e * i q − e * i q − 1 ; q and q − 1 denotes the qth and q-1th sampling time, respectively.The detailed design of the expert-knowledge-based 3-D FLC, including fuzzification, 3-D rule inference, and defuzzification, can refer to 5 .The scaling factors for the spatial error, the spatial error in change, and the incremental output are set as 2.0, 0.001, and 0.8716, respectively.The parameters of PRQS are chosen with the following settings: the number of the levels is 5, the length of the period is 124, the sampling time is 0.2 s, and the minimum switching time i.e., clock period is 0.2 s.
Two groups of data sets are obtained by adding PRQS signal with different scaling factor i.e., 0.447 and 0.1 to the control input.The first group with 150 data pairs is generated for training by adding PRQS perturbation signal with a scaling factor 0.447, and the other group with 150 data pairs is generated for test by adding PRQS perturbation signal with a scaling factor 0.1.To evaluate the performance, we employ the following root-mean-squared error RMSE as the criteria: where n denotes the number of samples, Δu * k denotes actual output, and Δu k denotes expected output.

Design of a Clustering and SVM-Regression Learning-Based 3-D FLC
The design procedure of the proposed 3-D FLC is given as follows: i Employ the nearest neighborhood clustering algorithm to deal with the spatiotemporal data set for the input space partition with ρ 0 0.7 and η 0 0, and then generate 16 3-D fuzzy rules with 32 3-D fuzzy sets, where the width of Gaussian type 3-D fuzzy sets is σ z 0.0620, 0.0902, 0.1518, 0.2008, 0.2175 T from 3.5 .
ii Simplify the 3-D fuzzy sets and 3-D fuzzy rules based on similarity measure as described in Section 3.2 with λ u 0.95, λ set 0.75, and λ rule 1, and then obtain

Control-Performance Validation
The designed clustering and SVM regression learning-based 3-D FLC is applied to the control of the catalytic packed-bed reactor, where simulation time is 10 s.We select the same quantitative performance criteria as in 5 : steady-state error SSE , integral of the absolute error IAE , and integral of time multiplied by absolute error ITAE .The control performance is given in Table 2, and the control profile is given in Figures 7 and 8, where a , b , and c represent catalyst temperature evolution profile, manipulated input, and catalyst temperature profiles in steady state, respectively.We can find that the proposed 3-D FLC has comparable control performance to the expert-knowledge-based 3-D FLC in 5 both in ideal condition and in disturbed condition.
In addition, we do more control experiments when the SVM-learning algorithm adopts different C and ε.According to the experimental results see the last three columns in Table 1 , we can find that the proposed 3-D FLC shows good control performance when a smaller ε is chosen.The above simulation results demonstrate that the proposed design method of a clustering and SVM-regression learning-based 3-D FLC is effective.It provides a beneficial complementary design method to 3-D FLCs.

Conclusions
In this paper, we have proposed a new 3-D FLC design methodology based on clustering and SVM regression learning from a spatiotemporal data set.The 3-D FLC design is divided into three steps.Firstly, an initial rule structure is extracted by a nearest neighborhood clustering method, which is modified to be suitable for spatio-temporal data.Secondly, the initial structure is simplified via using similarity measure technique, which is defined for 3-D fuzzy (i) Addition 2 .Equation A.3 has the same form as 3.12 , then u 1 x z u 2 x z ∈ Θ.
(ii) Multiplication 2 .In terms of algebraic operation, the product of functions in Gaussian form is also a function in Gaussian form.Thus, A.4 has the same form as 3.12 , and u 1 x z u 2 x z ∈ Θ.

(iii) Scalar Multiplication
For arbitrary c ∈ R, we have A.5 Equation A.5 has the same form as 3.12 , and cu 1 x z ∈ Θ.
Finally, by combining A.3 ∼ A.5 together, we can conclude that Θ, d ∞ is an algebra.
2 Secondly, we will prove that Θ, d ∞ separates point on Ω by constructing a simple 3-D FLC u x z as in 3.12 , namely, u x 0 z / u y 0 z holds for arbitrarily given x 0 z , y 0 z ∈ Ω with x 0 z / y 0 z .We choose two fuzzy rules, that is, N 2. Let A.7 Since x 0 z / y 0 z , there must be some i and j such that x 0 i z j / y 0 i z j .Thus, we have s i 1 exp − x 0 i z j − y 0 i z j 2 / 1.For arbitrary j, s i 1 exp − x 0 i z j − y 0 i z j 2 ≤ 1 holds, therefore, we have 3 Finally, we prove Θ, d ∞ vanishes at no point of Ω.
For any 3-D FLC u x z expressed as in 3.12 , if we choose ζ l ≥ 0 l 1, . . ., N and b > 0, then for any x z ∈ Ω, we have u x z > 0.
Therefore, Θ, d ∞ vanishes at no point of Ω.By combining the results from 1 to 3 together, Theorem 4.1 is proven.

Figure 3 :
Figure 3: Conceptual configuration of a clustering and SVM-regression learning-based 3-D FLC.

ii Step 2 : 1 ,
Calculate s jki S . . ., K, k 1, . . ., K, and i 1, . . ., s.Let s rmq max j / k {s jki } and select C r q and C m q .iii Step 3: If s rmq ≥ λ set , merge C back to step 2. If no more two 3-D fuzzy sets have the similarity with s rmq ≥ λ set j / k , then go to step 4. iv Step 4: Remove the 3-D fuzzy set similar to the universal set and the rule with membership function that is always near zero over the space domain.

Figure 4 :
Figure 4: Sketch of a catalytic packed-bed reactor.

Figure 5 :
Figure 5: Distributions of Gaussian type 3-D fuzzy sets in the simplified fuzzy-rule base.

Figure 7 :Figure 8 :
Figure 7: Controlled by a clustering and SVM-regression learning-based 3-D FLC under ideal situation dotted line: reference profile .

p j 1 s i 1 exp − x 0 i z j − y 0 i z j 2 / p. If we choose u 1 0 and u 2 1, then u x 0 z 1 −
ξ b / ξ b u y 0 z .A.8Therefore, Θ, d ∞ separates point on Ω.
v Step 5: Calculate the similarity of two rules s l 1 l 2 S rule R l 1 , R l 2 with l 1 / l 2 , l 1 1, . . ., N, l 2 1, . . ., N. Let s rm max l 1 / l 2 {s l 1 l 2 }. vi Step 6: If s rm ≥ λ rule , merge the rth and the mth rules into a new rule R new and substitute them.Let N N − 1, and back to step 5.If no more rules have similarity with s rm ≥ λ rule r / m , then quit.

Table 1 :
Learning results of an SVM regression with different values of C and ε.

Table 2 :
Performance comparisons.SVM algorithm described in Section 3.2 is used to learn the consequent part parameters with C {1, 10, 100, 1000} and ε {0.00001, 0.0001, 0.001, 0.01, 0.1, 0.2}.The RMSE in 5.5 for training and test are listed in Table1.From Table 1, we can find that: 1 smaller ε yielded more support vectors and led to reasonable training and test performance; while larger ε yielded less support vectors and led to worse training and test performance.2 C almost had no influence on the training and test performance, once ε was fixed.In this study, we choose C 100 and ε 0.0001.z is less than POSITIVE SMALL and r * z is more than POSITIVE SMALL, THEN Δu * is sort of POSITIVE MEDIUM.z is very ZERO and r * z is very NEGATIVE SMALL, THEN Δu * is very ZERO.z is sort of POSITIVE SMALL and r * z is more than POSITIVE MEDIUM, THEN Δu * is more than POSITIVE MEDIUM.