Quadratic Optimal Regulator Design of a Pneumatic Control Valve

Pneumatic control valves are still the most used devices in the process industries, due to their low cost and simplicity. This paper presents a regulator for pneumatic control valves using pole-placement method, optimal control, full-order state observer, and minimum-order state observer and their responses will be compared with each other. Bondgraph method has been used to model the control valve. Simulation results have been made for four models of regulator. The results show that minimum overshoot and settling time are achieved using optimal regulator of pneumatic valve.


Introduction
Process plants consist of hundreds, or even thousands, of control loops all networked together to produce a product to be offered for sale.Each of these control loops is designed to keep some important process variables such as pressure, flow, level, and temperature.within a required operating range to ensure the quality of the end product.Each of these loops receives and internally creates disturbances that detrimentally affect the process variable, and interaction from other loops in the network provides disturbances that influence the process variable.To reduce the effect of these load disturbances, sensors and transmitters collect information about the process variable and its relationship to some desired set point.A controller then processes this information and decides what must be done to get the process variable back to where it should be after a load disturbance occurs.When all the measuring, comparing, and calculating are done, some type of final control element must implement the strategy selected by the controller.The most common final control element in the process control industries is the control valve.The control valve manipulates a flowing fluid, such as gas, steam, water, or chemical compounds, to compensate for the load disturbance and keep the regulated process variable as close as possible to the desired set point.Control valves adjust the temperature, pressure, flow rate, and so forth by changing the flow rate.Figure 1 shows a sliding-stem pneumatic control valve.Pneumatic control valves are still the most used valves in the process industries, due to their low cost and simplicity.Pneumatic valves are used extensively in various industries today.Industry standard has been established that details the vibration, humidity, thermal, salt spray, and temperature extremes that these valves must operate within.This makes the design of valve control systems a very challenging task.Control valves have two major components, valve body housing and the actuation unit.One factor in the quality of the final end product is the improvement of the control loop performance.A critical component in the loop is the final control element, the control valve package.Optimized actuator parameters play a vital role in the dynamic performance of the pneumatic control valve.Champagne and Boyle [1] reviewed the pneumatic actuator and positioner parameters that affect the control package performance.This is done through the use of a control valve package computer model to assess the dynamic performance.The attributes of spring return versus double acting actuators are illustrated.The effects of supply pressure, step size, load margin, flow, actuator volume, and design style are investigated through the use of mathematical simulations of pneumatic control valve dynamic performance.Hagglund presented a procedure that compensates for static friction (stiction) in pneumatic control valves [2].The compensation is obtained by adding pulses to the control signal.The characteristics of the pulses are determined from the control action.
The compensator is implemented in industrial controllers and control systems, and the industrial experiences show that the procedure reduces the control error during stickslip motion significantly compared to standard control without stiction compensation.The oscillations caused by static friction (stiction) in pneumatic control valves cause losses in quality and expense of raw materials.The input-output behavior of a pneumatic control valve affected by stiction in valve.De Souza et al. [3] presented a well-known stiction compensation method that reduces variability both at process variable and pneumatic valve stem movement.The two-move method is revisited in this paper and it was shown that assumptions on the knowledge of steady-state stem position of control valve that assures equality of set point and the controlled variable were not easily achievable.Bondgraph is a graphical representation of a physical dynamics system.It is similar to the better known block diagram and signal flow, with the major difference that the arcs in bondgraphs represent bidirectional exchange of physical energy, while those in block diagrams and signal-flow graphs represent unidirectional flow of information.Also, bondgraphs are multidomain and domain neutral.This means that a bondgraph can incorporate multiple domains simultaneously.Bondgraphs were devised by Paynter [4] at MIT in April 1959 and subsequently developed into a methodology together with Karnopp et al. [5].Early prominent promoters of bondgraph modeling techniques among others were Thoma [6], Dixhoorn, and Dransfield.Athanasatos and Costopoulos [7] used the bondgraph method for finding the proactive fault in 4/3 way direction control valve of a high pressure hydraulic system.The accuracy of the bondgraph model was verified by comparing its response to the response of an actual hydraulic system.Díaz-Zuccarini et al. [8] utilized the bondgraph as boundary condition for a detailed model of an idealized In this study a pneumatic control valve is modeled by bondgraph method.A regulator has been designed using pole-placement method, optimum regulator, full-order state observer, and minimum-order state observer for this system.In continuing, their responses have been compared with each other.
This research is organized as follows.Section 2 recalls the bondgraph model of valve and proposes equations of motion of valve.Section 3 develops quadratic optimal regulator of pneumatic valve.Sections 4 and 5 present designing a regulator by pole-placement technique; full and minimum order observers, respectively.Section 6 shows the results of full and minimum order regulator observers and quadratic optimal regulator of valve and finally some conclusions are given in Section 7.

Bondgraph Model of Valve and Transfer Function
The bondgraph model of the valve is shown in Figure 2. In this model, SE is the inlet pressure of the system.The pressure changes to force by multiplying in effect area of the diaphragm.In bondgraph, this transformer is modeled by T.F.Element  is the friction of the system.Element  is the movable mass of valve and diaphragm.
Element  represents the spring of the valve actuator.Also 1-junction is a common flow junction.1-junctions have equality of flows and the efforts sum up to zero with the same power orientation.In fact, junctions can connect two or more bonds.The direction of the half arrows (⇀) denotes the direction of power flow given by the product of the effort and flow variables associated with the power bond.The bonds in a bondgraph may be numbered sequentially using integers starting with 1.The two 1-junctions in the bondgraph shown can be uniquely identified as (S 1 2) and (S 4 5 6); similarly, symbols like  1 and  6 can be used to identify a particular element.This system has two state variables  4 and  5 ⋅  5 is the displacement of valve stem and the variation of the spring length.Also V 4 =  4 / 4 is the velocity of the valve stem.The equations of motion are derived using bondgraph method as follows: Now, if the velocity and position of stem are zero in the initial condition, (0), then we have By derivation of relation ( 2) with respect to time, we have By substitution of Ṗ 4 from ( 1) into (4), we have By substitution of  4 from ( 2) into (5), we have Using laplace transformation of ( 6), we have Equation ( 7) is the transfer function of the valve.The results of bondgargh model of valve show that the response of the system is identical with the result in [9,10].

Quadratic Optimal Regulator of Pneumatic Valve
Let us consider the system that is defined as form of a statespace representation as follows: where  is called the state vector, ẋ the derivative of the state vector with respect to time,  the output vector, and () the input or control vector.Also  is the system matrix,  the input matrix,  the output matrix, and  direct transmission matrix.We will now consider the optimal control problem that, given the system (8), the matrix  should be determined, so that It means that the control signal is determined by the state of that moment.The dimension of the state feedback gain matrix is 1 ×  and  is the number of the states.This minimizes the performance index () as where  is a positive-definite (or positive semidefinite) Hermitian or real symmetric matrix and  is a positivedefinite Hermitian or real symmetric matrix [11].
Note that the second term on the right side of (11) accounts for the expenditure of the energy of the signal control.In this problem, we assume that the control vector () is unconstrained.The linear control law given by ( 11) is the optimal control law.Therefore, if the unknown elements of the matrix  are determined so as to minimize the performance index, then () = −() is optimal for any initial state (0).Hence, Equation ( 12) gives the optimal matrix.Thus the optimal control law to the quadratic optimal control problem where the performance index is given by ( 11) is linear and given by The matrix  in (12) must satisfy the following reduced equation: Equation ( 14) is called the Riccati reduced-matrix equation.

Designing a Regulator by Pole-Placement Technique
Suppose that the system is defined by (8) and the control signal is given by (10).The feed back gain matrix K that forces the eigenvalues of  −  to be  1 and  2 (desired values) can be determined by the following steps.Firstly, the controllability of the system is checked.The controllability matrix is defined as follows: For this system, the rank of the controllability matrix is two.
In the next step, the characteristic polynomial of matrix , determines the values of  1 and  2 .Now the desired closedloop poles  1 and  2 are determined based on the transient response or frequency response requirements, such as speed, damping ratio, and steady state requirements.The desired characteristic equation becomes The values of  1 and  2 are determined from (17).The required state feedback gain matrix  can be determined from (18): where Matrix  is given by

Full-and Minimum-Order State Observer
If not all state variables are available for feedback, unavailable state variables should be estimated by observer.Suppose that observer observes all state variables of the system, regardless of whether some state variables are available for direct measurement.For this situation we must use full-order state observer and observe all state variables.State observers can be designed if and only if the observability condition is satisfied.Necessary and sufficient condition for observability condition is that the dual of the original system must be completely state controllable [9].The complete state observability for this system is that the rank of is 2 because the system is a two-degree-of-freedom system.Characteristic equation can be obtained from (16).We should determine two groups of desired poles as each one has two poles.The first group relates to system state variables and the other one relates to observer variables.Therefore, state observer gain matrix can be obtained for both situations.We choose two dominant poles based on the transient response requirements and remained poles assignment so enough far from two dominant poles.State observer gain matrix can be determined from ( 19)-( 23).Also matrix  can be obtained by using ( 16)-(20) after specifying observer desired poles.Subsequently, we have The transfer function of the full-order controller observer is For designing of minimum-order state observer, we should traverse the following stages.By selecting eigenvalues for observer matrix, the characteristic equation is where α1 is the desired eigenvalue for the minimum-order observer.The minimum observer gain   can be determined by choosing the desired eigenvalue for the minimum-order observer and then the procedure developed for the full-order observer with appropriate modifications.We have The minimum observer gain is defined as follows: where Note that â1 is the coefficient in the characteristic equation for the state equation The transfer function for minimum-order state observer is given by the following formula: where where (31)

Results and Discussion
Table 1 shows the parameters of a sliding-stem pneumatic control valve.By substitution of Table 1 into (7), we have Matrices of the state space equations of the valve are as follows: In this section, we consider the design of regulator system with full-and minimum-order observers and then quadratic optimal regulator of pneumatic valve.The detail of designing a full and minimum order observer is given in the previous section.Let us design a regulator which achieves a 10% maximum overshoot and settle time less than 0.5 second for output when the initial condition is (0) = [0 0.1]  .A 10% overshoot and a settling time of 0.5 second yield  = 0.591 and   = 13.53;thus, the characteristic equation for dominant poles is  2 +16+183.1 = 0, where the dominant poles are located at −8 ± 10.91 [12].Hence, choose the desired closed-loop poles at  =   ( = 1, 2), where In the pole placement method, we must first check the rank of the controllability matrix from (15): Since the rank of matrix  is 2, arbitrary pole placement is possible.In this case for determining the state feedback gain matrix  = [ 1  2 ], the characteristic polynomial for the desired system is The characteristic polynomial must be equal to By equating the coefficients of the terms of the like powers of , we obtain or Response to initial condition with pole placement method is shown in Figure 3.Note that the maximum overshoot of valve is about 0.4% for output, and settling time is about 0.5 second.The design is thus acceptable.The input, () = −(), can be calculated from the previously calculated matrices,  and .The control input, (), which is a force is applied to the valve stem.The larger the control input magnitude, the bigger the energy spent by  the actuator in generating the control input, and the higher the cost of control.As shown in Figure 6, the maximum value of input control signal is about 0.9.Observability matrix can be obtained from (21) as Since the rank of observability matrix is 2, the given system is completely state observable.Hence, full-order observer is applicable.Assume that the desired eigenvalues for full-order observer are  1 = −116 and  2 = −116.The state feedback gain matrix  for this case is obtained as follows: The full observer gain matrix   is calculated as follows: The transfer function of the full-order observer controller (  ) is obtained as follows: Figure 4 shows results of the initial response of stem valve with full-order observer controller.Note that the maximum overshoot of valve is about 0.15% for output, and settling time is 0.5 second.The design is thus acceptable.In this case, the maximum value of input control signal is about 0.4.The minimum order observer is of first order.Assume that the desired eigenvalue for minimum order observer is  1 = −40.
The state feedback gain matrix  is obtained as  And the minimum observer gain   can be obtained as The transfer function of the minimum-order observer controller (  ) is obtained as follows: Figure 5 shows results of the initial response of valve stem with minimum-order observer controller.The initial condition is assumed as (0) = [0 0.1]  .Note from Figure 5 that the maximum overshoot of valve is about 0.25% for output, and settling time is about 0.5 second.The design is thus acceptable.In this case, control input, (), is shown in Figure 6, and the maximum value is about 0.6.Figure 6 shows the comparison of control input signal of the valve with pole placement method (pole), full-order observer (full), and minimum-order observer (mini).
We will now consider the optimal control problem of valve.For this purpose we choose by trial and error  = 1 and  = [ Substituting  into (12), the optimum gain matrix will be as follows: The initial condition is assumed as (0) = [0 0.1]  .The results of the overshoot and settling time to step input for closed loop system are shown in Figure 7.As shown in Figure 7, the overshoot is very small and less than 0.018%.Also the settling time is 0.1 sec.The input, () = −(), can be calculated from the previously calculated matrices,  and .The control input for the value of the optimal regulator gain matrix is shown in Figure 8.Note that the maximum input value is about 0.005.
Transient response parameters are given in Table 2 for comparing four methods of regulator design with each other.All designing of regulators of the valve are under the same initial condition.

Conclusion
The aim of this study was the development of design some regulators to meet transient response specifications of a pneumatic control valve.The mathematical model of   system and subsequently state equations were derived using bondgraph method.Regulator has been using pole-placement method, optimal control, full-order state observer and minimum-order state observer for this system.Also, their responses and then important transient response parameters were derived and a comparison between the four designed regulators was made.It was observed that responses of the pole-placement technique and minimumorder observer are near to each other.The full order observer regulator has the most high overshoot percentage among the other regulators.The results show that the minimum overshoot and settling time are achieved in quadratic optimal regulator of pneumatic valve.

Figure 4 :Figure 5 :
Figure 4: Response to initial condition with full-order observer.

Figure 6 :
Figure6: The control input, (), of the system with three methods.

Figure 7 :Figure 8 :
Figure 7: Closed-loop initial response of valve for optimal regulator designed with  and  = 1.

Table 2 :
Settling time, overshoot, and maximum control input of the response to initial condition of the valve.