Mathematical Problems in Engineering

Volume 2013 (2013), Article ID 873430, 14 pages

http://dx.doi.org/10.1155/2013/873430

Research Article

Tuning of a TS Fuzzy Output Regulator Using the Steepest Descent Approach and ANFIS

Ricardo Tapia-Herrera, Jesús Alberto Meda-Campaña, Samuel Alcántara-Montes, Tonatiuh Hernández-Cortés, and Lizbeth Salgado-Conrado

Instituto Politécnico Nacional, SEPI-ESIME Zacatenco, Avenue IPN S/N, 07738 México, DF, Mexico

Received 15 March 2013; Accepted 27 May 2013

Academic Editor: Qingsong Xu

Copyright © 2013 Ricardo Tapia-Herrera et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

The exact output regulation problem for Takagi-Sugeno (TS) fuzzy models, designed from linear local subsystems, may have a solution if input matrices are the same for every local linear subsystem. Unfortunately, such a condition is difficult to accomplish in general. Therefore, in this work, an adaptive network-based fuzzy inference system (ANFIS) is integrated into the fuzzy controller in order to obtain the optimal fuzzy membership functions yielding adequate combination of the local regulators such that the output regulation error in steady-state is reduced, avoiding in this way the aforementioned condition. In comparison with the steepest descent method employed for tuning fuzzy controllers, ANFIS approximates the mappings between local regulators with membership functions which are not necessary known functions as Gaussian bell (gbell), sigmoidal, and triangular membership functions. Due to the structure of the fuzzy controller, Levenberg-Marquardt method is employed during the training of ANFIS.

1. Introduction

A fundamental problem in dynamic systems is to control a plant in order to have its outputs tracking some reference signals produced by an exosystem (external generator), while the stability property of the closed-loop system is guaranteed. In this regard, the output regulation problem [1] consists of finding the control law capable of

(a)stabilizing the closed-loop system when the plant is not influenced by the exosystem,(b)taking the tracking error asymptotically to zero when the plant is under the action of the exosystem.

One of the first works on output regulation theory presented in the literature was developed by Francis and Wonham in 1975 [2]. This paper obtains structural criteria necessary to synthesize multivariable linear regulators with structural stability to small perturbations. The main contribution of this work is that structural stability requires feedback from the regulate variable, and these structural features are called “internal model principle.” Later in 1977 [3], the linear regulation theory for tracking a reference is proposed by Francis, by finding that the solution for the output regulation of an autonomous linear system subject to perturbations and reference signals can be obtained from a system of linear matrix equations.

Isidori and Byrnes [1] extend the results obtained by Francis to the general case in which the plant and/or the exosystem are nonlinear. They also show that Francis equations are a particular case of nonlinear output regulation equations. In addition, they also show, as in linear case, that if the plant is exponentially stabilizable via output feedback, the solution for the nonlinear case requires an error feedback regulator. Unfortunately, the so-called Francis-Isidori-Byrnes (FIB) equations used to solve the nonlinear output regulation problem involve a set of nonlinear partial differential equations which in many cases are too difficult, or even impossible to solve in a practical way (see Figure 1).

(a)

(b)

Figure 1: Output regulation scheme for (a) linear systems and (b) nonlinear systems [4].

On the other hand, in the real world, there exists a wide range of problems that involve the analysis of uncertain and inaccurate information, and that is the main reason for the “soft computing.” The term soft computing, according to Zadeh, is “A collection of methodologies that aim to exploit the tolerance for imprecision and uncertainty to achieve tractability, robustness, and low solution cost.” Its principal constituents are fuzzy logic, neurocomputing, and probabilistic reasoning [5]. Each of these approaches has features that make them suitable to solve different problems. Fuzzy systems are characterized by their ability to handle and use inaccurate approximate reasoning, while neural networks have the property of learning. Many of these tools have been used with efficiency to solve complex real world problems as diagnosis, estimation, control, and autonomy of systems.

In that sense, some techniques have been developed to characterize nonlinear systems by means of linear local subsystems [5]. One of these approaches is the well-known Takagi Sugeno (TS) fuzzy modeling. This technique allows describing the nonlinear dynamics by means of a suitable “blending” of linear subsystems, each of them corresponding to different operation points. Basically, the “combination” is performed by a weighted summation of linear local subsystems. Thus, local controllers can be designed for each subsystem, obtaining the aggregate controller by using the same membership functions of the TS fuzzy plant.

As mentioned previously, the set of differential equations derived by Isidori and Byrnes in nonlinear regulation is difficult to solve, representing an interesting opportunity to apply soft computing: in particular neural networks and fuzzy logic.

For instance, in [6], an iterative algorithm with the structure of a recurrent neural network is presented. The network is introduced with the purpose of dealing with model errors caused by the estimation of parameters of an off-line training and the possible dynamic changes; an online learning approach providing the necessary parameters for the network is also used. In this sense, the network can capture the uncertainties of the system, and the regulator adjusts the control action in order to guarantee the regulation condition. That is an attempt to combine the identification capability of neural networks and the stability properties of the control theory. As a result, the control structure learns the system dynamics and ensures the asymptotic convergence of the error. Subsequently, this method was applied at the control scheme of a solar plant [7]. Zhang and Wang [8] propose an approximation in power series form, wherein a neural network carries out the synthesis and self-tuning of controller in real time. This method ensures regulation properties, namely, stability and asymptotic tracking.

Later in [9], the fuzzy output regulation is formulated, in which a nonlinear system described by a Takagi-Sugeno fuzzy model follows a reference signal generated by a fuzzy exosystem. It was also shown that the fuzzy regulation problem can be solved by means of local linear regulator only if the following conditions are satisfied.

(i)The zero error manifold is equal for every local linear subsystem (see Figure 1).(ii)Input matrices are equal for every local linear subsystem, that is, .

Unfortunately, the aforementioned conditions are not satisfied in a great number of systems. A proposal to overcome this problem is presented in [5, 10], wherein the fuzzy regulator is designed on the overall fuzzy model instead of local linear subsystems. The advantage of this approach is the global convergence of the tracking error in the interest region, in contrast to local properties of classical method of nonlinear control. Moreover, the solution of the fuzzy regulation problem is given in terms of the “dynamical Francis equations,” and a very practical way to solve such a dynamical equation is also given. However, a disadvantage of this approach is that exact fuzzy controller is far more complex than the regulator designed from the fuzzy summation of local linear regulators, in general. For that reason, in the present work, an approach based on the local design of linear regulators is proposed, but considering that the nonlinearity of the controller may be different from the nonlinearity of the plant. In other words, it will be assumed that the membership functions of the fuzzy plant and the membership functions of fuzzy regulator are different. Therefore, the appropriate membership functions for the fuzzy regulators will be obtained by means of an adaptive network-based fuzzy inference system (ANFIS) and the steepest descent approach.

A hybrid intelligent system combines two or more soft computing techniques [10]. Such combination allows taking advantage of each tool, improving the behavior of the overall system. According to [11, 12], the following combinations can be found in the literature:

(i)fuzzy controllers tuned by neural networks,(ii)fuzzy controller tuned by evolutionary computation,(iii)neural networks synthesized by evolutionary computation, (iv)neural networks controlled by fuzzy logic,(v)evolutionary computation controlled by fuzzy logic.

The Artificial Neural Networks (ANN) have shown great efficiency in different fields as identification, classification, or recognition patterns. On the other hand, a system based on fuzzy logic has the capability of working with uncertain information and taking decisions based on rules previously established by an expert system. A neurofuzzy system takes the inference under cognitive uncertainty from fuzzy logic and from ANNs their learning capability, adaption, parallelism, and generalization [13, 14].

The performance of a fuzzy controller is extensively linked to the shape of membership functions that represent linguistic variables [15], so as the binary operators [16]. These parameters conform the structure of fuzzy controller and generally are defined by an expert to trial and error [17]. ANN brings the possibility of avoiding the trial and error procedure [18–20]. Therefore, ANN gives to fuzzy controller the capability of learning, which means that fuzzy system can be tuned by itself [21]. Besides, the neural approach can not only be used to adjust the parameters of the fuzzy controller but also an ANN can be used as a fuzzy controller, in the sense that the fuzzy controller will have the structure of a neural network [22]. For instance, Moreno-Velo develops Xfuzzy which is a program where several proposed approaches are applied to learning process on neurofuzzy systems. Xfuzzy integrates a wide variety of supervised learning algorithms [23].

In [24, 25], the authors present methodologies that reduce the time of training for neurofuzzy systems with the aim of using them on real-time applications.

(Adaptive Neural-Fuzzy Network Inference System) (ANFIS) proposed by Jang [26] builds a mapping between input-output pairs, using IF-THEN rules. ANFIS employs hybrid training, combining backpropagation and the least-squares estimator, and it has been used for modeling nonlinear functions, identification of nonlinear components in control systems, and for prediction of chaotic series.

So, the main contribution of the present work is to develop an approach based on ANFIS that is capable of approximating the appropriate membership functions, such that tracking error for the overall fuzzy system is reduced when the fuzzy controller is obtained from the fuzzy summation of local linear regulators, while avoiding the restriction of proposing a priori form of the membership functions, which is the main disadvantage of the steepest descent approach.

The rest of the paper is organized as follows. In Section 2, a review of basic concepts of fuzzy output regulation is presented. In Section 3, an overview of ANFIS and an introductory example using the steepest descent in fuzzy regulation are given. In Section 4, some cases of study are solved and their respective simulation results are depicted. Finally, in Section 5, some conclusions are drawn.

2. The Output Regulation Problem

From a given linear system

and an exosystem

it is desired to design a controller that stabilizes asymptotically the system (1) when the exosystem (2) is disconnected, that is, (), and achieving as when (1) is under the influence of (2). According to [26], the controller is and the tracking error is , where

By substituting the previous equations in (1), one gets

But has to be designed such that () is asymptotically stable. Therefore, as if and only if

The set of (5) is called Francis equations. Dimensions of each matrix are

According to Isidori and Byrnes, the extension of the regulation problem to the nonlinear case is

Thus, the control signal becomes . Then, similar to the linear case, the error in steady-state is with :

The set (11) is called Francis-Isidori-Byrnes (FIB) equations [1], subjected to

2.1. Exact Fuzzy Output Fuzzy Regulation

The fuzzy model proposed by Takagi and Sugeno is a fuzzy system described by the rules of the type IF-THEN, where the consequent parts include the local dynamics represented by linear subsystems [27], that is.

Local linear subsystems:

Therefore, the nonlinear dynamics can be approximated by the following TS model:

In a similar way, the exosystem can be approximated by a TS fuzzy system of rules as follows:

Note that the membership functions of the plant are not necessarily the same as the exosystem functions. Fuzzy plant (14) and fuzzy exosystem (15) can be rewritten as

And the desired fuzzy controller is

With this representation, the steady-state manifold is , while the steady-state input is [9, 28]. and can be obtained by differentiating the steady-state error:

In steady-state, one gets

Solving (19) in an analytical way may be very difficult. But its numerical solution is given in [4] through a very practical way. However, the resulting controller is very complex, in general.

3. Overview of Adaptive-Network-Bases Fuzzy Inference System (ANFIS)

In Figure 2, an Adaptive-Network-Based Fuzzy Inference System network is shown. ANFIS is a system that employs the structure of fuzzy Takagi-Sugeno-Kang systems (TSK) and learning algorithms of neural networks with the purpose of adjusting the consequent and antecedent parameters of the fuzzy system.

Figure 2: ANFIS architecture for 2 input variables.

Basically, ANFIS architecture is formed by five layers, each of them is described in the following.

Layer  1. Fuzzification process, variables and are the inputs to membership functions . Generally, gbell functions are used in this stage, for example.

Rule 1. If is and is , then .

Rule 2. If is and is , then .

Consider

or

Parameters , , are called premise parameters, where these premise parameters can be modified (Figure 3).

(a) Modifying parameter “a” 

(b) Modifying parameter “b”

(c) Modifying parameter “c”

(d) Modifying parameter “a” and “b”

Figure 3: Shapes of gbell function with modified parameters.

Layer  2. Nodes denoted with . In these nodes, the inferences between fuzzy sets are performed. The -norm is used for firing strengths:

Layer  3. Normalization of firing strengths

Layer  4. The consequent part of fuzzy system is in nodes , and it is given by a set of functions , and they are activated according to the normalize firing strengths:

Layer  5. Summation of input signals is obtained as

3.1. Case of Study

Consider the following TS fuzzy system:

where

with the control

It is important to remark that the fuzzy regulator included in (28) is obtained by using the same membership functions of the plant.

Observe that in this example, should track . This can be easily deduced from matrices , , and . and are obtained from the solution of (5) for each of the two rules. Thus, a fuzzy regulator is designed on the basis of two local linear systems. The membership functions are proposed as triangular ones satisfying .

The fuzzy steady-state manifold is

while the steady-state input is

And the gains are obtained from LMI approach [29] in order to ensure global stability:

From the matrices considered in the system (26), it is clear that and are different from each other. Therefore, an asymptotical error cannot be expected when the fuzzy regulator is constructed by the fuzzy summation of the local linear regulators using the same membership functions of the plant [28]. So, Figure 4 shows the behavior of state variable of fuzzy plant and state of exosystem, while the tracking error is given in Figure 5.

Figure 4: versus when membership functions of the plant are used to fuzzily combine the local regulators.

Figure 5: Tracking error when the membership functions of the plant are used to fuzzily combine the local regulators.

In order to overcome the problem of controller (28), a decoupling between the membership functions of fuzzy stabilizer and fuzzy regulator is proposed, that is,

Observe that in this new controller, the membership functions of the regulation part are not the same as that considered in the fuzzy plant. In the following, these membership functions will be estimated by means of the Steepest Descent approach and ANFIS.

According to [5], a fuzzy system with membership functions of type gbell is a universal approximator and consequently gbell functions are used to approximate fuzzy mapping in local regulators, subjected to condition , where

The parameters , , and determine the shape of gbell function. As a consequence, the main goal is to estimate , , and such that the resulting membership functions and improve the performance of the fuzzy controller (32). One of the most useful methods for tuning task found in the literature is the “steepest descent” method:

It can be readily observed that expressions (34) depend on error , where and represent the th training input-output pair for the fuzzy plant and the exosystem, respectively.

The “steepest descent” approach must reduce the error on the direction of the parameters of the controller. Therefore, (34) need to be adapted such that they consider the evolution of the states of the plant and exosystem (see Figure 6).

Figure 6: Scheme of the iterative regulation.

In order to obtain the training pairs, the plant is discretized using the approximation . Therefore, the following discrete plant can be readily obtained:

And the mean squared error is

The current value of state is an explicit function of and , and this implies that depends on parameters , , and . Therefore, the steepest descent method should minimize the error function with respect to independent variables [30–33] (see Figure 7), that is,

Recalling that partial derivatives for a generalized bell (gbell) membership function are [34]

The parameters that adjust the membership functions are updated by the steepest descent method according to the following training law in the antecedent part:

Figure 7: Training of the fuzzy controller.

The simulation results are shown in Figure 8, where state tracks to . From Figure 9, it is observed that the error is minimized considerably in comparison with the linear controller (28) (Figure 5). When the regulator is fully trained, the reference tracking is achieved in a very acceptable way, which is depicted in Figures 10 and 11.

Figure 8: versus during the learning scheme.

Figure 9: Tracking error during the learning scheme.

Figure 10: versus when the controller has been fully trained.

Figure 11: Tracking error when the controller has been fully trained.

But according to [1], if the regulation problem has a solution, then it is unique. In fuzzy regulation, this means that the membership functions of the fuzzy regulator cannot have arbitrary shapes, and in many cases, their shape is unknown. Obviously, the steepest descent approach is not applicable if the shape of the membership functions is not given a priori. In the following, this disadvantage will be overcome by considering ANFIS.

3.2. ANFIS in Output Fuzzy Regulation

Considering (26), when is equal to 1, the dynamics of the overall fuzzy system are described by the first local linear subsystem and the exact output regulator is obtained from . In the same way, if is equal to 1, the exact output regulator is obtained directly from . With this in mind, the next fuzzy implications are obtained:

 IF is 1, THEN , IF is 1, THEN .

A set of fuzzy rules can be established, taking into account that the regulation problem is exactly solved by local linear regulator, that is,

 If is 1 then , If is 1 then .

In the fuzzy rules given previously, it is supposed that is a function of , while can be obtained from . Then, is chosen as the input variable in ANFIS. Figure 12 shows the ANFIS architecture with one input.

Figure 12: ANFIS architecture for one input variable.

Layer  1. For this example, gbell membership functions are chosen, and 8 nodes are distributed uniformly (see Figure 13) according to [35]

Figure 13: Distribution of the membership functions for input layer.

Layer  2. The weight of each function corresponds to its own membership function because only one input variable is considered:

Layer  3. Weight normalizing:

Layer  4. Takagi-Sugeno coefficients:

Layer  5.

3.3. Adjustment of Input Layer Parameters

Thus, the goal is to generate the adequate membership functions for the fuzzy regulator by means of ANFIS regulators, but these values depend on the reference signal. The proposed scheme is depicted in Figure 14.

Figure 14: Rule tuning including ANFIS.

As discussed in Section 3.1, the steepest descent method adjusts parameters , , . Then, the chain rule used for the error function depends on parameters , that is,

The terms , , and are calculated from (38), while

Each one of the functions that are proposed in the input layer of ANFIS is fitted by using the previous expressions.

3.4. ANFIS Learning Using Levenberg-Marquardt Approach

The Levenberg-Marquardt (L-M) method is an effective nonlinear least-squares approach to nonlinear regression problems [36]:

where ; is a nonnegative number.

It has been proved that the L-M method reduces the root mean squared error further than hybrid learning method. In this work, the mean square error is used, and the gradient takes into account - parameters of the fourth layer. Therefore, the following training rules can be obtained:

4. Numerical Results after Applying ANFIS

From Figures 15 and 16, it can be observed that the fuzzy tracking is improved and that the tracking error is smaller than the one obtained through the steepest descent approach.

Figure 15: versus when ANFIS is included in the fuzzy controller.

Figure 16: Tracking error when ANFIS is included in the fuzzy controller.

Figure 17 shows membership function obtained from different methods: analytically computed, membership functions for fuzzy regulator are the same than ones of fuzzy plant (), and ANFIS estimation. Note that the membership function generated by ANFIS tends to the real one (analytically computed). It is important to recall that the , and therefore the missing membership function, , can be easily obtained.

Figure 17: Membership function obtained from different methods.

The control signal appears in Figure 18.

Figure 18: Control signal when ANFIS is included in the fuzzy controller.

Case 1. In some applications, it is desired that external reference signal has variable frequency, and thus a new exosystem is proposed:

The local steady-state manifolds can be obtained from

Figure 19 shows the system behavior during the training stage. As expected, the fuzzy plant tracks asymptotically the exosystem.

Figure 19: versus for Case 1.

Case 2. A practical example is the inverted pendulum (Figure 20), whose nonlinear model is given by [29]

where the mass of the cart is  kg, the mass of the pendulum is  kg, the length of the pendulum is  m, the gravity is  m/s², and .

Figure 20: Inverted pendulum on a cart.

This nonlinear model can be approximated by a TS fuzzy model of two rules with

and membership functions as those depicted in Figure 21.

Figure 21: Membership functions for the two-rule model [29].

The regulation condition is not satisfied when the membership functions of the plant are used to combine the local regulators because matrices and are different (Figure 22).

Figure 22: versus when the regulator uses the same membership functions of the plant.

On the other hand, from Figures 23 and 24, it can be observed that the tracking is improved, that is, the tracking error is considerably reduced when ANFIS is used to obtain the adequate membership.

Figure 23: versus when ANFIS is included in the fuzzy controller.

Figure 24: Tracking error when ANFIS is included in the fuzzy controller.

5. Conclusions

In this paper, it has been shown that the nonlinearity of the plant is not necessarily the same nonlinearity needed by the regulator to ensure reference tracking. In other words, the membership functions for fuzzy regulator and for the fuzzy plant are not the same, in general. In that sense, the steepest descent and ANFIS approaches have been used to estimate the adequate membership functions of fuzzy regulator in order to reduce the tracking error when the overall fuzzy controller is obtained from the fuzzy summation of local controllers.

It is also important to mention that although the Steepest Descent can be used to approximate the fuzzy membership functions, the approach can be trapped in a local minimum or local maximum. On the other hand, ANFIS due the hybrid training avoids this problem.

On the other hand, the use of ANFIS avoids the restriction of proposing a priori form of the membership functions, which is another disadvantage of the Steepest Descent approach.

Finally, it can be concluded that a suitable approximation of the nonlinearity of the fuzzy regulator is obtained when ANFIS is used as a tuning tool during the designing of fuzzy regulators.

Acknowledgments

This work was supported by CONACYT through scholarship SNI, by IPN through scholarships PIFI, COFAA, and EDI, and research Project 20130760.

References

A. Isidori and C. I. Byrnes, “Output regulation of nonlinear systems,” IEEE Transactions on Automatic Control, vol. 35, no. 2, pp. 131–140, 1990.

B. A. Francis and W. M. Wonham, “The internal model principle for linear multivariable regulators,” Applied Mathematics & Optimization, vol. 2, no. 2, pp. 170–194, 1975.

B. A. Francis, “The linear multivariable regulator problem,” SIAM Journal on Control and Optimization, vol. 15, no. 3, pp. 486–505, 1977.

J. A. Meda-Campaña, J. C. Gómez-Mancilla, and B. Castillo-Toledo, “Exact output regulation for nonlinear systems described by Takagi-Sugeno fuzzy models,” IEEE Transactions on Fuzzy Systems, vol. 20, no. 2, pp. 235–247, 2012.

L. A. Zadeh, “Soft computing and fuzzy logic,” IEEE Software, vol. 11, no. 6, pp. 48–56, 1994.

J. Henriques, B. Castillo, A. Titli, P. Gil, and A. Dourado, “Learning and output regulation with recurrent neural network,” in Proceedings of the 4th Portuguese Conference on Automatic Control, pp. 324–329, 2000.

J. Henriques, P. Gil, A. Cardoso, P. Carvalho, and A. Dourado, “Adaptive neural output regulation control of a solar power plant,” Control Engineering Practice, vol. 18, no. 10, pp. 1183–1196, 2010.

Y. Zhang and J. Wang, “Recurrent neural networks for nonlinear output regulation,” Automatica, vol. 37, no. 8, pp. 1161–1173, 2001.

B. Castillo-Toledo, J. A. Meda-Campaña, and A. Titli, “A fuzzy output regulator for Takagi-Sugeno fuzzy models,” in Proceedings of the IEEE International Symposium on Intelligent Control, pp. 310–315, Houston, Tex, USA, October 2003.

R. Fullér, Introduction to Neuro-Fuzzy Systems, Advances in Soft Computing, Springer, New York, NY, USA, 2000.

P. P. Bonissone, Y. U. O. Chen, K. Goebel, and P. S. Khedkar, “Hybrid soft computing systems: industrial and commercial applications,” Proceedings of the IEEE, vol. 87, no. 9, pp. 1641–1667, 1999.

A. Saad, “An overview of hybrid soft computing techniques for classifier design and feature selection,” in Proceedings of the 8th International Conference on Hybrid Intelligent Systems (HIS '08), pp. 579–583, Barcelona, Spain, September 2008.

H. Nomura, I. Hayashi, and N. Wakami, “A learning method of fuzzy inference rules by descent method,” in Proceedings of the IEEE International Conference on Fuzzy Systems, pp. 203–210, March 1992.

D. Nauck and R. Kruse, “A fuzzy neural network learning fuzzy control rules and membership functions by fuzzy error backpropagation,” in Proceedings of the IEEE International Conference on Neural Networks, vol. 1, pp. 1022–1027, 1993.

W. Textor, S. Wessel, and K. U. Hffgen, “Learning fuzzy rules from artificial neural nets,” in Proceedings of the Computer Systems and Software Engineering, pp. 121–126, 1992.

T. Miyoshi, S. Tano, Y. Kato, and T. Arnouuld, “Operator tuning in fuzzy production rules using neural networks,” in Proceedings of the 2nd IEEE International Conference on Fuzzy Systems, vol. 1, pp. 641–646, San Francisco, Calif, USA, 1993.

K. Nishimori, S. Hirakawa, K. Fujimura et al., “Automatic tuning method of membership functions in simulation of driving control of a model car,” in Proceedings of the International Joint Conference on Neural Networks, vol. 3, pp. 2937–2940, October 1993.

W. Li, “Optimization of a fuzzy controller using neural network,” in IEEE World Congress on Computational Intelligence, Proceedings of the 3rd IEEE Conference on Fuzzy Systems, vol. 1, pp. 223–227, Orlando, Fla, USA, June 1994.

S. K. Halgamuge and M. Glesner, “Neural networks in designing fuzzy systems for real world applications,” Fuzzy Sets and Systems, vol. 65, no. 1, pp. 1–12, 1994.

J. Sitte and S. Geva, “Design of fuzzy controllers with local response neurons,” in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, pp. 2021–2026, October 1994.

D. van Cleave and K. S. Rattan, “Tuning of fuzzy logic controller using neural network,” in Proceedings of the IEEE National Aerospace and Electronics Conference (NAECON '00), pp. 305–312, October 2000.

C. K. Lin and S. D. Wang, “Robust self-tuning rotated fuzzy basis function controller for robot arms,” IEEE Proceedings on Control Theory and Applications, vol. 144, no. 4, pp. 293–298, 1997.

F. J. Moreno-Velo, I. Baturone, R. Senhadji, and S. Sánchez-Solano, “Tuning complex fuzzy systems by supervised learning algorithms,” in Proceedings of the 12th IEEE International Conference on Fuzzy Systems (FUZZ '03), vol. 1, pp. 226–231, May 2003.

S. Chopra, R. Mitra, and V. Kumar, “Neural network tuned fuzzy controller for MIMO system,” International Journal of Electrical and Computer Engineering, vol. 2, no. 5, pp. 371–378, 2007.

R. Jain, N. Sivakumaran, and T. K. Radhakrishnan, “Design of self tuning fuzzy controllers for nonlinear systems,” Expert Systems with Applications, vol. 38, no. 4, pp. 4466–4476, 2011.

J. R. Jang, “ANFIS: adaptive-network-based fuzzy inference system,” IEEE Transactions on Systems, Man and Cybernetics, vol. 23, no. 3, pp. 665–685, 1993.

T. Takagi and M. Sugeno, “Fuzzy identification of systems and its applications to modeling and control,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 15, no. 1, pp. 116–132, 1985.

J. A. Meda-Campaña, J. C. Gómez-Mancilla, and B. Castillo-Toledo, “On the exact output regulation for Takagi-Sugeno fuzzy systems,” in Proceedings of the 8th IEEE International Conference on Control and Automation (ICCA '10), pp. 417–422, Xiamen, China, June 2010.

K. Tanaka and H. Wang, Fuzzy Control Systems Design and Analysis: A Linear Matrix Inequality Approach, John Wiley & Sons, New York, NY, USA, 2001.

E. J. Haug, J. S. Arora, and K. Matsui, “A steepest-descent method for optimization of mechanical systems,” Journal of Optimization Theory and Applications, vol. 19, no. 3, pp. 401–424, 1976.

X. Wang, “Method of steepest descent and its applications,” IEEE Microwave and Wireless Components Letters, vol. 12, pp. 24–26, 2008.

M. Bartholomew-Biggs, “The steepest descent method,” in Nonlinear Optimization With Engineering Applications, vol. 19, pp. 75–82, Springer, Boston, Mass, USA, 2008.

G. Teschke and C. Borries, “Accelerated projected steepest descent method for nonlinear inverse problems with sparsity constraints,” Inverse Problems, vol. 26, no. 2, Article ID 025007, 2010.

R. Jang, Neuro-Fuzzy and Soft Computing, Prentice Hall, New York, NY, USA, 1997.

M. A. Denaï, F. Palis, and A. Zeghbib, “ANFIS based modelling and control of non-linear systems: a tutorial,” in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (SMC '04), pp. 3433–3438, October 2004.

J. R. Jang and E. Mizutani, “Levenberg-Marquardt method for ANFIS learning,” in Proceedings of the Biennial Conference of the North American Fuzzy Information Processing Society—NAFIPS, vol. 1, pp. 87–91, June 1996.