A robust H∞ control method and switched control algorithm for hydraulic actuator presents in human-machine coordinated motion to solve the motion delay of lower extremity exoskeleton. After the characteristic parameters synthesis of human limb and exoskeleton linkage, the human-machine coupled motion model is constructed to estimate the appropriate hydraulic pressure, which is considered as a structural uncertainty in hydraulic model. Then the robust controller is designed to improve the robust stability and performance under the structural and parametric uncertainty disturbances. Simulation results show that, in walking mode, this robust controller can achieve a better dynamic response and aid-force efficiency than PID controller. Then, according to gait divisions of person’s limb motion, the switched control algorithm is designed to reduce the delay of exoskeleton tracking person. Finally, the experimental results show that the human-machine coordinated walk with bearing 60 kg load and squat action with no external load are realized effectively by this proposed method.
1. Introduction
Lower extremity exoskeleton is a humanoid mechanical equipment. Since the exoskeleton can help a person bear many loads and track a person’s motion, the soldier’s load capacity and flexibility can be significantly improved. The exoskeleton is a complex system including 4 subsystems: mechanical structure, gait sensing, hydraulic control, and power supply. Recently lower extremity exoskeleton can bear the maximum load 200 lbs and realize typical action such as walk, running, up and down hill or stairs, squatting, and trotting [1]. Since 2000, DARPA and U. C. Berkeley have done many researches on exoskeleton and developed the prototypes called “XOS” and “BLEEX” [2–4], respectively. Lockheed has simplified the hydraulic actuator amount of BLEEX and renamed “Human Universal Load Carrier” (HULC) [1]. Other countries like Japan and France have developed commercial or military exoskeleton called “HAL” or “Hercule” [5]. In 2000, Atkeson et al. [6] made conclusions on the characteristics of humanoid robot: sometimes the motion of machine is guided by person, sometimes just the opposite, especially sometimes the boundary is not clearly divided between the two. Due to the person’s participation, the traditional robotic program control method will cause the motional delay of exoskeleton tracking person [7].
Since 2004, the exoskeleton technology is developed in China [8]. A motor-driven exoskeleton with no external load is designed by Naval Aeronautical Engineering Institute [9]. In addition, the aid-force exoskeleton with hydraulic-driven actuator is designed to realize walk, up and down stairs [10]. However, the human-machine coordinated motion is not presented in aforementioned references; if person’s gait characteristic is ignored in exoskeleton control, person’s comfort and the aid-force effect are reduced. In this paper, a human-machine coupled model is constructed to analyze the dynamic external load. This external load describes the aid-force efficiency of exoskeleton in the case of person’s safety and should be compensated by exoskeleton controller.
Due to the demands of high load efficiency and fast response, lower extremity exoskeleton is driven by the electrohydraulic servo system (EHSS). However, EHSS has some model uncertainties such as parametric disturbances, structural uncertainties, which are consequences of hydraulic physical characteristics, oil leakage, oil temperature variations, and characteristics of valves near null [11]. The classical control method of EHSS is PID [12]. Due to lower order and constant gains, PID control is easy to be realized in engineering. So the variable parameters of PID controller are presented to suit the hydraulic dynamic characteristic [13, 14]. Some advanced control methods such as adaptive sliding mode [15–17] and backstepping controllers [18, 19] are used in EHSS and get some good performance. In addition, the robust controllers [20–22] of EHSS are presented with parameter uncertainty disturbance, which are converted to H∞ control problem solved by conventional robust analysis or linear matrix inequality. The mixed sensitivity H∞ control method [23] of EHSS is presented to balance to the robust stability and response performance. But the external load of hydraulic control model is only considered as a disturbance, not to be quantitatively analyzed and described in robust uncertainty model. In this paper, by referring to H∞ control method aforementioned references, a robust H∞ controller is designed to suppress structural uncertainty and parametric uncertainties, which are caused by the external load and parametric disturbances. Furthermore, combined with the switched control algorithm of hydraulic actuator, this H∞ controller can reduce the delay of exoskeleton tracking person. Simulation and experimental results validate this proposed controller.
2. Human-Machine Coupled Model Construction
Since human fast conscious is ahead of exoskeleton, the only mechanical motion model is not insufficient to analyze the systematic dynamics. So the coupled motion model needs to be constructed to estimate the dynamic loads and the supply power.
2.1. Characteristic Parameters Synthesis
Some characteristic parameters like mass and moment of inertia are different between human limb and exoskeleton linkage. So the characteristic parameters need be synthetic to balance 2 motion responses activated by person and exoskeleton. It means that human-constraint is relieved but not vanished through equivalent multibody motion. The human-constraint is a small value in the thigh bandage, which can not exceed the human tolerance.
If the sagittal motion is considered only, the rotational motion around the knee is shown in Figure 1. Here components B1, B2, B3, B4, and B5 represent, respectively, human calf, mechanical calf, sensing shoes, human thigh, and mechanical thigh.
The rotational motion around the knee of human-machine synthetic model.
The centers of synthetic calf and thigh for human-machine coordinated motion [24] are shown as(1a)lsc=m1l1c+m2l2c+m3l3cm1+m2+m3=m1l1c+m2l2c+m3l3cms,(1b)ltc=m4l4c+m5l5cm4+m5=m4l4c+m5l5cmt.
According to the moment of inertia of the parallel axis theorem, the moment of inertia of synthetic calf and thigh around respective center of mass is shown as(2a)Isc=I1c+m1lsc-l1c2+I2c+m2lsc-l2c2+I3c+m3lsc-l3c2,(2b)Itc=I4c+m4ltc-l4c2+I5c+m5ltc-l5c2,where mi is the ith component mass. ms and mt are the total masses of equivalent calf and thigh, l1c, l2c, and l3c are the distances from center of mass to knee, respectively, l4c, l5c are the distances from center of mass to hip, respectively, and Iic is the ith moment of inertia around respective center of mass.
2.2. Human-Machine Coupled Motion Model
In human-machine coordinated motion, the exoskeleton linkages should compensate the load when human foot contacts the ground. So in the stance phase of walk or squat, the hydraulic actuator not only realizes the exoskeleton knee rotation tracking human limb rotation but also balances the variable load. In order to estimate the dynamic load on the hydraulic actuator, the human-machine coupled motion model needs to be constructed in Figure 2. The link point “O5” between mechanical back frame and thigh is the hip joint. The ankle joint “O1” is equivalent to a hinge when human foot contacts the ground. The external load “Fl” including the exoskeleton mass and effective load hung at the back frame. The force “Fp” provided by hydraulic actuator compensates the load on the exoskeleton.
The synthetic model of human-machine coupled motion (linkages 1 and 2 represented the synthetic calf and thigh).
The force and moment equilibrium equations of 1^{#} linkage (synthetic calf) are shown as (3a)FO1x-FO2x+FO3x=mscaGsx,(3b)FO1y+FO2y-FO3y-mscg=msaGsy,(3c)TO1+FO2xlsccosθ1+FO2ylscsinθ1-FO3xlsc-l1cosθ1-FO3ylsc-l1sinθ1-mscglgssinθ1=-IscαO1,(3d)aGsx=aO1x-ans·cosθ1+aτs·sinθ1,aGsy=aO1y-ans·sinθ1-aτs·cosθ1,where ans=lgs·ωO12, aτs=lgs·αO1, aO1x=aO1y=0.
Similarly, the 2^{#} linkage (synthetic thigh), 3^{#} linkage (piston), and 4^{#} linkage (cylinder) can also be analyzed as follows:(4a)FO2x+FO4x=mtaGtx,(4b)FO4y-FO2y-mtcg-Fload=mtaGty,(4c)-Flltccosθk+θ1+FO4xl2cosθk+θ1-FO4yl2sinθk+θ1+mtglgtsinθk=ItcαO2,(5a)Fpsinθ2-FAcosθ2+FO3x=mpaGpx,(5b)-Fpcosθ2-FAsinθ2+FO3y=mpaGpy,(5c)-FAlr+TA=Ipαp,(6a)-Fpsinθ2+FAcosθ2-FO4x=mcaGcx,(6b)Fpcosθ2+FAsinθ2-FO4y=mcaGcy,(6c)-FAlh-lr-TA=Icαc.
Some angle and angular velocity relations in Figure 2 are as follows:(7a)sinθ1=l2sinθkl12+l22-2l1l2cosθk,(7b)sinθ3=l2-ltcsinθklsc2+l2-ltc2-2lscl2-ltccosθk,(7c)θ2=θ3-θ1,(8a)ωp=ωO1-l2cosθkωk+l2sinθkl1l2sinθkωk/l12+l22-2l1l2cosθkcosθ3l12+l22-2l1l2cosθk,(8b)ωc=ωO2-l1cosθkωk+l1sinθkl1l2sinθkωk/l12+l22-2l1l2cosθkcosπ-θk-θ3l12+l22-2l1l2cosθk,(8c)ωO2=ωk+ωO1.
In above equations, some parameters are defined as follows.
Description of Some Motion and Geometry Parameter. Consider the following:
FO1x, FO1y: force from hinge O1 to linkage 1,
FO2x, FO2y: force from linkage 1 to linkage 2,
FO3x, FO3y: force from linkage 1 to linkage 3,
FO4x, FO4y: force from linkage 2 to linkage 4,
aGsx, aGsy: calf acceleration at the center of gravity,
aGtx, aGty: thigh acceleration at the center of gravity,
aτs, ans: tangential and normal acceleration of calf acceleration,
aτt, ant: tangential and normal acceleration of thigh,
aτp, anp: tangential and normal acceleration of piston,
aτc, anc: tangential and normal acceleration of cylinder,
lgs: length between the center of gravity calf and the ankle,
lgt: length between the center of gravity thigh and the knee,
l1, l2: distance between hydraulic cylinder calf, thigh connections, and knee,
ωO1, αO1: angular velocity and angular acceleration of calf around the ankle,
ωO2, αO2: angular velocity and angular acceleration of thigh around the knee,
ωk: knee angular velocity,
Ip: moment of inertia of piston around the leg connection point,
TO1: torque from point O1,
ωp, αp: angular velocity and angular acceleration of piston,
ωc, αc: angular velocity and angular acceleration of cylinder,
Fp: radial force along the piston,
FA: normal force perpendicular to cylinder,
TA: torque from point O3,
θ1: angle between linkage 1 and vertical line,
θ2: angle between piston and vertical line,
θ3: angle between piston and linkage 1,
θk: knee angle,
mp, mc: piston and cylinder mass,
lh: total length of hydraulic actuator,
lr: length of piston.
If knee angle θk and angular velocity ωk are given, (1a)–(8c) can get the analytical solution “Fp.” So load pressure “Pl” of the hydraulic actuator can be computed by(9)Pl=Fpπrp2,where “rp” is hydraulic cylinder diameter.
Now the person can realize 2 typical actions: walk and squat after wearing the exoskeleton. The motional range of knee angle is from 85° to 155° in the gait duration of these actions. In addition, the maximum external load on the back frame of exoskeleton is 60 kg. Substituting some known parameters into (3a)–(9), the load pressure Pl can be computed digital simulation method shown in Figure 3. So if the external Load “Fl” does not exceed 90 kg, the load pressure Pl will not be more than 8 MPa. It means that the hydraulic supply pressure “Ps” can be set as 8 MPa to appropriately compensate the external load 60 kg. If the person wears the exoskeleton with no effective load, the supply pressure is chosen as 4 MPa to balance the exoskeleton mass.
The load pressure Pl in the gait duration of walk and squat varying load and knee angle.
2.3. Hydraulic Model
The electrohydraulic servo control system is also fixed on the exoskeleton. It has 2 different characteristics: the asymmetric hydraulic cylinder and the single-rod actuator. The dynamics of servo valve can be described as follows:(10)xvu=Ksvωsv2s2+2ζsvωsvs+ωsv2,where ζsv is the damping ratio, ωsv is natural frequency, and Ksv is the servo valve gain.
The flow equations can be linearized as follows [25]:(11a)Qa=Kq1xv-Kc1pa,(11b)Qb=Kq2xv+Kc2pb,(12a)Kq1=Cdw2Δppρ,Kq2=Cdw2ΔpRρ,(12b)Kc1=Cdwxv2ρΔpp,Kc2=Cdwxv2ρΔpR,(13a)Δpp=ps-paxv≥0pa-prxv<0,(13b)ΔpR=pb-prxv≥0ps-pbxv<0,where Qa, Qb are 2 sides of cylinder flow, pa, pb are the cylinder chamber pressures, ps, pr are supply and return pressures, Cd is the valve coefficient of discharge, w is the valve orifice area gradient, ρ is the oil density, and xv is the spool valve position. Kq1(Kq2) and Kc1(Kc2) are flow gains of the servo valve and flow-pressure coefficient.
If the internal and external leakages are neglected, the flow-pressure continuous equation of cylinder is shown as follows:(14a)p˙a=βeV01+AayQa-Aay˙,(14b)p˙b=βeV02-Aby-Qb+Aby˙,(15)V01=V02=Vt2=Aalh2,where βe is the fluid bulk modulus, Aa and Ab are the annulus areas of 2 sides of the cylinder, V01, V02 are half-volume of the cylinder, and y is the cylinder position.
The mechanical dynamic equation is shown as follows:(16)my¨=paAa-pbAb-Ff-Fp,where Ff is the stick-slip friction caused by the viscous damp of oil and Fp is the variable load on the hydraulic actuator.
If the knee angle is known, the linear position of cylinder y can be correspondingly computed by geometric relationship as follows:(17)yθk=l12+l22-2×l1×l2×cosθk.
According to the analytical computation method of the load pressure Pl by (9), the linear expression between Fp and y can be constructed as follows:(18)Fpθk,FL=KFpθkyθk,where KFp represents a variable bounded scale with load and knee angle.
The stick-slip friction often includes 2 items: a stick phase Ffstatic which occurs when velocity is within a small critical velocity range and a slip friction Ffslip which is the same as Coulomb friction model [26]. Here the slip friction can be estimated by simplified parameter identification method. Here the stick item is neglected, so the stick-slip friction Ff can be approximately described as follows:(19)Ff≈by˙,where b is the viscous damping coefficient of oil.
The slip friction Ffslip should be constructed in the simulation model to identify the parameters b. The maximum stroke of cylinder is controlled by one best PID control parameters to track the square demand. The comparison results are shown in Figure 4. The simulation result of hydraulic position is similar to the experiment when parameters b are 100, especially the dynamic response is better than other conditions. So the nominal value of b can be approximately identified to be used in the parametric uncertainty model in Section 3.
The square response of experiment and simulation varying the viscous damping coefficient b.
3. Robust Controller Design
Lower extremity exoskeleton provides two features: high load bearing and fast motion. So exoskeleton should have fast responses but should not hinder the wearer. In this section, a robust controller is designed to improve the dynamic response. The knee angle will be servo controlled to realize the human-machine coordinated motion. Because this EHSS has parametric disturbances and structural uncertainties, the robust H∞ control method is presented to satisfy the requirement of close-loop stability and robust performance. After the uncertainty model of the EHSS is constructed, the robust controller is designed to find the H∞ suboptimal controller.
3.1. Uncertainty Model Construction
This EHSS has some parametric uncertainties: the flow gains of servo valve Kqi (i=1,2), the viscous damping coefficient b, the effective bulk modulus β and variable volume of 2 sides cylinder (V01+Aay,V02-Aby), and a structural uncertainty KFp from external load. These uncertainties parameters Kq, E, b, and KFp are described by upper Linear Fractional Transformation [27, 28] as follows:(20)MKq=0K-qpKqK-q,ME=-pE1E--pE1E-,Mb=0b-pbb-,MKFp=01pKFpK-Fp,(21a)Kq=K-q1+pKqδKq,-1≤δKq≤1,(21b)E=E-1+pEδE,-1≤δE≤1,(21c)b=b-1+pbδb,-1≤δb≤1,(21d)KFp=K-Fp+pKFpδKFp,where E=Vt/2β, K-q, E-, and b- are the nominal values, δKq, δE, and δb are relative variation, respectively, and the maximum relative uncertainties pKq, pE, and pb can be estimated varying some hydraulic parameters [20].
If these vectors are defined, the state vector X=[x1,x2,x3,x4,x5,x6]T=[xv,x˙v,pa,pb,y,y˙]T, the control input u(t), which is the current of servo valve, the vector of exogenous inputs w(t)=[w1,w2,w3,w4,w5]T, the output cylinder position y(t) measured by encoder, and the regulated output vector z(t)=[z1,z2,z3,z4,z5,z6]T, then the uncertain state-space model is constructed as follows:(22a)X˙t=AXt+B1Wt+B2ut,(22b)Zt=C1Xt+D11Wt,(22c)Yt=C2Xt,where(23a)A=010000-ωv2-2ζvωv0000K-qE-0-KcE-00-AaE--K-qE-00-KcE-0A2E-00000100Aam-Abm-K-Fpmb-m,(23b)B1=0000000000pKqE--pE000-pKqE-0-pE0000000000-pbm-pKFpm,(23c)B2=0Ksvωv20000T,(23d)C1=K-q00000K-qE-0-KcE-00-AaE--K-qE-00-KcE-0AbE-00000b-000010,(23e)D11=00000pKqE--pE000-pKqE-0-pE000000000000,(23f)C2=000010.
The robust stability and performance requirements of the closed-loop system are shown in Figure 5.
The block diagram of the closed-loop system with robust stability and performance requirements.
In Figure 5, the weighting functions Wp and Wu are used to reflect the relative significance of the performance requirement. The robust controller K needs to be designed to optimize the robust performance ep and eu. The nominal model Ghyd and the interconnection model Gic represent the robust uncertainty model shown in (22a), (22b), and (22c). The demand and actual cylinder position r, y are the input and output of this EHSS.
3.2. Robust Controller Design
The frequency response of the open-loop system with model uncertainties is shown in Figure 6. The phase margins are obviously different between perturbed model and nominal model, which is caused by the uncertainty parameter KFp. Due to the presence of KFp, the stable phase of open-loop system will lead or lag approximately 50 degrees in middle frequency stage (1~6.28 rad/s).
The frequency response of the open-loop system with varying uncertainty parameters Kq, E, b, and KFp.
The weight functions Wp and Wu are iteratively designed according to robust performance requirement and control constraint shown as follows [29]:(24a)Wp=0.95×s2+1.8s+5s2+8s+0.01,(24b)Wu=5×10-4.
The singular values of the weight function Wp and the sensitivity function of close-loop Gsn should satisfy WpGsn∞≤μWpμGsn<1, which has guaranteed the basic control performance.
The robust controller will guarantee robust stability and robust performance requirement which can be described in Figure 5 [30, 31].
H∞ suboptimal control problem: to design a controller K satisfying the following condition:(25)FlGic,K∞=FlFuGhyd,Δ,K∞<γ,
where γ>γ0, γ0 is the minimum value of FlGic,K∞ under K is a stable controller.
Robust performance requirement: the close-loop system composed of Gic and K should satisfy(26)WpI+GicK-1WuKI+GicK-1∞<1.
If the relative uncertainty Δ is from -I to Δ=I, the singular value of close-loop perturbed is 0.28, which is less than 1 shown in Figure 7. The close-loop system Gc is stable and its relative uncertainties Δ can be extended to 1/0.28.
The maximum robust stability bound with varying uncertainty parameters Kq, E, b, and KFp.
In Figure 8, the maximum singular value μ of close-loop shows that the robust performance requirement is 1.4, which means that the steady tracking accuracy may not be excellent. But in middle and high frequency stage from 4 to 100 rad/s, the dynamic tracking performance and robustness margin meet the requirement [32].
The maximum robust performance bound with varying uncertainty parameters Kq, E, b, and KFp.
After iterative design, the robust controller is 7 orders. Taking the actual project into account, the controller should be reduced into lower order by Balanced Truncation Method [33]. So the controller is simplified to 4 orders as follows: (27)uextension=Ksy~-y=n4s4+n3s3+n2s2+n1s+n0d4s4+d3s3+d2s2+d1s+d0y~-y,where ni (i=0,…,4), di (i=0,…,4) are numerator and denominator constant, y~ is demand input, and y is output.
4. Gait Divisions of Coordinated Motion
In this section, the gait phase divisions of 2 typical action modes are analyzed and designed. According to the gait identification, the switched control is realized to reduce the delay of exoskeleton tracking person and improve the human-machine coupling effect.
4.1. Walk Mode
The walking gait law of human-machine coordinate motion can be divided into 5 subphases shown in Figure 9. These subphases are (1) double standing; (2) right leg swing, left leg stance; (3) double stance with right leg front and left leg back; (4) right leg stance and left leg swing; and (5) double stance with left leg front and right leg back.
The gait subphases division of walk and squat action in human-machine coordinated motion.
In order to improve the exoskeleton tracking person’s motion, 2 subphases (3) and (4) are merged. That means if the subphases (3) are identified, make the hydraulic cylinder of left leg retract in advance. This operation realizes the exoskeleton ahead of person, which helps person regulate the center of system gravity easily in overload carrying condition. After the subphase (4) is identified by exoskeleton, the center of system gravity is steadily regulated by person. Simultaneously, the exoskeleton continuously realizes the right stance leg and the left swing leg. The subphases (5) and (2) are similar to subphases (3) and (4). So the switched control algorithm is described in Table 1.
The duty of exoskeleton and person in walking gait subphases by different switched controller form.
Gait
Controller
Exoskeleton
Person
(1)
ul=uextensionur=uextension
Control double knee angle
Adapt to exoskeleton
(2)
ul=uextensionur=-umax
Control left knee angle and retract right leg
Adapt to exoskeleton
(3)
ul=-umaxur=uextension
Adapt to person and retract left leg in advance
Regulate the center of gravity
(4)
ul=-umaxur=uextension
Control right knee angle and retract left leg
Adapt to exoskeleton
(5)
ul=uextensionur=-umax
Adapt to person and retract right leg in advance
Regulate the center of gravity
In Table 1, ul and ur are control current of the of left and right servo valve, umax=±40mA, which is the maximum current of servo.
4.2. Squat Mode
The squat gait law is divided into 6 subphases: (1) double standing; (6) left leg stance and right leg uplift for preparation; (7) left leg retraction gradually and right leg swing; (8) left leg reached the minimum position of cylinder and right knee contacting the ground, which means the single leg squat action ends; (9) left leg extension gradually and right leg swing; and (2) left leg stance and right leg swing, which means the up-squat action ends and switch to the walking mode. So the switched control algorithm is described in Table 2.
The duty of exoskeleton and person in squat gait subphases by different switched controller form.
Gait
Controller
Exoskeleton
Person
(6)
ul=uextensionur=-umax
Control left knee angle and retract right leg
Squat preparation
(7)
ul=umax1-e-ktur=-umax
Retract left knee angle gradually
Adapt to exoskeleton
(8)
ul=-umaxur=-umax
Adapt to person and hold in the prescript posture
Regulate the center of gravity
(9)
ul=uextensionur=uextension
Control 2 knee angles and extend 2 legs
Adapt to exoskeleton
In gait (7), the left knee angle is retracted by fader control. The symbol k=2 and t is fader time.
To ensure the safety of person, the squat preparation time need to be set as 2 or 3 sec. The subphase (8) is identified by a pressure force sensor on the right knee. The transition from subphase (8) to subphase (9) needs a mode switch button and gait identification algorithm which is not described in this section.
5. Simulation Results
The hydraulic model is simulated with the external load 60 kg. The hydraulic parameters for simulation are shown in Table 3. In order to verify the effectiveness of the proposed method, the natural walking gait law is considered as the command input with 0.5 Hz frequency. The fore-half duration is stance phase for one leg with the range of knee angle from 15° to 30°. The afterwards duration is swing phase with range of knee angle from 15° to 73°.
The hydraulic parameters for simulation.
Name
Value
Unit
Damping ratio ξsv
0.7
—
Natural frequency ωn
628
rad/s
Servo valve gain Ksv
0.0125
m/A
Fluid bulk modulus βe
7000
bar
Mass of hydraulic actuator m
2.5
kg
Annulus areas of no-rod cylinder Aa
1.77×10-4
m^{2}
Annulus areas of rod cylinder Ab
1.13×10-4
m^{2}
Distance between hydraulic cylinder calf connections and knee l1
0.322
m
Distance between hydraulic cylinder thigh connections and knee l2
0.065
m
Return pressures pr
1
bar
Piston stroke Lr
0.16
m
Flow-pressure coefficient Kc1≈Kc2
5.18e-12
m^{3}/s/Pa
Nominal value of K-q
0.188
m^{2}/s
Nominal value of b-
100
Ns/m
Nominal value of E-
1.98e-14
m^{3}/pa
Nominal value of K-Fp
1200
N/m
According to the above analysis of the load pressure Pl, the hydraulic supply pressure Ps is 8 MPa and the external load is 60 kg in simulation. Some hydraulic parameters are shown in Table 3. The maximum relative uncertainties pKq=0.25, pE=0.7, pb=1, and pKFp=300. Here 2 control methods are used to make the exoskeleton track the person in the walking mode simulation. The PID control parameters are designed as the best group, which satisfy the frequency domain margin. The robust H∞ control method is realized by (27).
The left knee angle response of exoskeleton is shown in Figure 10. In swing phase, the dynamic characteristic of PID control is same as the robust H∞ control because there is no external load on the hydraulic actuator. But, in stance phase, the dynamic performance of robust control is better than PID control due to the variable compensation force Fp provided by hydraulic actuator on the exoskeleton. This external force disturbance results in the parametric uncertainty of Kq, E, which reduce the stabile margin of PID control. Importantly, the control current needs to balance the compensation force Fp and stick-slip friction Ff in the case of positional error suppression. In addition, the asymmetric cylinder affects the dynamic characteristic of hydraulic model when cylinder extension switches into retraction, especially in stance phase. The parametric uncertainty of Kq, E, and b and structural uncertainty Fp are considered in the system model construction, so the robust controller can guarantee the dynamic performance in the whole duration of walking mode.
The left knee angle response of walking gait.
The dynamic cylinder position of left hydraulic actuator on exoskeleton is shown in Figure 11. It is computed by (17) after the knee angle is measured by encoder. The available displacement of cylinder is 0.07 m in waking mode, which is less than the maximal stroke 0.16 m of cylinder. It means that only half stroke is useful in human-machine coordinated walk. But the maximal stroke of cylinder needs to satisfy the squat mode, which requires enough length of cylinder.
The position response of left hydraulic cylinder of walking gait.
The control current of left servo valve is shown in Figure 12. The general trend of control current is same using 2 control methods. But the robust controller uextension is more intense than PID control, especially in stance phase. Because the controller involves the high order item, the robust controller can reduce the tracking error quickly in the case of model uncertainty. The maximal amplitude of control current is 30 mA, which does not exceed the maximal servo valve control current ±umax.
The left servo valve control current of walking gait.
The aid-force effect of exoskeleton by left hydraulic actuator is shown in Figure 13. Here the demand compensation force Fpres is constructed by(28)Fpres=FpTαs+12stance phase1-1Tαs+12Fpswing phase,where Tα=0.05s is defined as the transition response time of external load Fl.
The aid-force effect of exoskeleton by left hydraulic actuator.
In Figure 13, the compensation force error means the error between Fpres and the hydraulic output actual force Fact. In stance phase of left leg, the compensation force error does not exceed 500 N by the robust controller. The demand compensation force Fpres is 1300 N approximately. It means that the load bearing efficiency is great than 60% in stance phase of left leg. Because 2 legs are alternative in walking gait, the left hydraulic actuator needs not to compensate Fpres in its swing phase, while the hydraulic actuator on right leg of exoskeleton is in charge of this load bearing task. Therefore, the aid-force effect of simulation result can not include the hydraulic output actual force in swing phase in this figure.
6. Experimental Results
The human-machine coordinated motion is realized by a tester wearing the exoskeleton prototype. The gait can be identified by 4 force sensors in the sensor shoes. The 2 knee angles of exoskeleton are measured by 2 encoders. The hydraulic control system includes a motor, a fixed pump, 2 servo valves, 2 cylinders, and an embedded controller on the mechanical brace. The net weight of prototype is 30 kg. In walking mode, the tester can bear no more than 60 kg external load. In squat mode, the tester can realize the basic gait with no external load due to the safety of tester. The hydraulic actuators are controlled by the robust control method and the control algorithm will be switched in different gait.
6.1. Walking Mode with Overloading
In walking mode, the extension and retraction of 2 legs are alternatively realized by hydraulic actuator. The walking frequency is 0.5 Hz bearing with 60 kg load.
The dynamic characteristics of 2 knee angles are shown in Figure 14, which includes 5 subphases of walking gait. In gait (4), described by time slice a~b (0.8 s~1.5 s), the left leg is retracted by the tester himself and the control current of left leg is -umax shown in Figure 20. In gait (5), described by time slice b~c (1.5 s~1.7 s), the left leg is extended by feedback control and the right leg begins to retract in advance to help the tester regulate the center of gravity. This ahead of control can make the tester move easily. In gait (2), described by time slice c~d (1.7 s~2.4 s), the right leg is retracted by the tester himself like as gait (4). In gait (3), described by time slice d~e (2.4 s~2.6 s), the right leg is extended by feedback control like gait (5). These 4 subphases are switched frequently in walking mode. If the walking mode ends, the double stance phase gait (1) will arise, described by time slice f~g (14 s~15.6 s). In gait (1), 2 legs are controlled by feedback control. The external load is compensated by 2 hydraulic actuators on the exoskeleton only in stance phase. In swing phase, the exoskeleton should help the tester switch the center of gravity from one leg to the other leg. Otherwise, the human-machine coupled effect is reduced significantly and the tester may be at loss of balance.
The knee angles of 2 legs in walking mode.
The cylinder positions of 2 hydraulic actuators in one cycle of walking mode are shown in Figure 15. Here the extended position commands are designed as a rising step. The servo feedback control phase of left leg is described as time slice b~e (1.5 s~2.6 s). But, in time slice b1~b2 (1.55 s~1.65 s), the cylinder position is still retracted after the positive control current output. This response delay is caused by the bandwidth limitation of the whole hydraulic control system. The pressure of cylinder is constructed with time-consuming 0.8 s from 0 to stable value 8 MPa. So the available position response of left cylinder is time slice b2~e (1.65 s~2.6 s), where the actual position of cylinder tracks the extended position commands. In time slice a~b, the retracted position commands of left leg is designed as a fall step. It is not a servo control phase for left leg. So the control current of servo valve is minus maximal value -umax directly in order to help the tester retract the cylinder quickly. The dynamic characteristic of right cylinder positions is similar to the left cylinder.
The cylinder positions of 2 hydraulic actuators in one cycle of walking mode.
The switched control currents correspond to 5 subphases shown in Figure 16. The servo control phase of left leg is time slice b1~e (1.55 s~2.6 s) in one cycle. Similarly, the servo control phase of right leg is starting at time d1. In double stance phase, described by time slice f~g, the servo control value is near 0 after 2 knee angles reach the tester’s stance posture. The dynamic pressures of 2 hydraulic actuators are shown in Figure 17. In stance phase, the pressure is constructed from 0 to 8 MPa with approximately 0.8 s time consumed due to bearing heavy load. In swing phase, the fast time-consuming is 0.4 s for pressure from 8 MPa to 0. It reveals that person’s active control can be faster than the control response of exoskeleton if the walking speed is possible. So the switched control algorithm shown in Table 1 is suitable for human-machine coordinated walk.
The control current of 2 servo valves in walking mode.
The pressures of 2 hydraulic actuators in walking mode.
6.2. Squat Mode Test
According to Figure 9, 6 gait subphases of squat mode are realized by switched control algorithm shown in Table 2. The dynamic characteristics of 2 knee angles in squat mode are shown in Figure 18. The gait subphases are described by time slice h~i (0 s~2 s), i~j (2 s~4 s), j~k (4 s~7 s), k~l (7 s~29 s), l~m (29 s~32 s), and m~n (32 s~35 s), respectively. In gait (5), described as time slice h~i, the double stance phase should be passed before the squat mode begins. The cylinder positions are controlled to reach the tester’s stance posture shown in Figure 19. In gait (6), described as time slice i~j, the right leg swings to prepare the squat action and the tester regulates the center of gravity at this moment. In gait (7), described as time slice j~k, the left cylinder is retracted gradually by exponential fader control shown in Table 2. So the left leg bends gradually before the right knee contacts the ground. The control current is reduced from 0 to -umax in 3 sec shown in Figure 20. In gait (8), described as time slice k~l, 2 control currents are minus maximal value. The exoskeleton can not compensate its mass by 2 hydraulic actuators at this phase. The tester can bear the load himself through regulating the center of gravity to reduce the backward torque caused by exoskeleton mass and hold in the prescript posture. In gait (9), described as time slice l~m, 2 cylinders are extended to realize the up-squat action in 3 sec (Figure 21). The cylinder positions of 2 legs are controlled by robust control algorithm to reach the suitable positions where gait (9) is switched into gait (2). After up-squat phase ends, the squat mode will return to the walking mode.
The knee angles of 2 legs in squat mode.
The cylinder position of 2 hydraulic actuators in squat mode.
The control current of 2 servo valves in squat mode.
The pressures of 2 hydraulic actuators in squat mode.
6.3. Experimental Scene
The experimental scenes of human-machine coordinated motion are shown in Figures 22 and 23. In walking mode, the tester can bear the external load 60 kg hung on the back frame of exoskeleton. When the waking gait is switched, the tester will bear a little more load himself due to the regulation of center of gravity. In the stable stance phases, such as double standing or single leg stance, the exoskeleton can guarantee the aid-force effect by the proposed robust controller. Also, the comfortable effect of tester is improved by the switched control algorithm.
The walking gait subphases experiment.
Gait (1)
Gait (2)
Gait (3)
Gait 4
Gait (5)
The squat gait subphases experiment.
Gait (6)
Gait 7
Gait (8)
Gait (9)
In squat mode, the tester only bears the exoskeleton mass because of the safety of system at the present stage. The tester can realize the basic gait of squat action under the help of another person’s arm, especially in gait (7) and gait (9).
7. Conclusion
In this paper, a human-machined coordinated motion control method is presented to realize the aid-force of lower extremity exoskeleton. This proposed method improves the robust performance under the structural and parametric uncertainty disturbance. The positions of 2 hydraulic actuators are controlled to make exoskeleton track person’s motion by output feedback control. Compared with conventional PID control method in simulation, the proposed method can achieve a better dynamic response performance and aid-force effect in stance phase of walking gait. According to the gait divisions of human-machined coordinated motion, the switched control algorithm is designed to reduce the delay of exoskeleton tracking person. The experimental results of 2 motion modes validate the effectiveness of this proposed method and gait switched control algorithm.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
This research was supported by project of National Natural Science Foundation of China (no. 61305092 and no. 51205045) and project of China Postdoctoral Science Foundation (no. 2013M542487). The authors would like to thank anonymous reviewers for their valuable comments and suggestions.
AckermanS.WangZ. X.Raytheon launched XOS2 second-generation exoskeleton deviceStegerJ. R.VenemanJ. F.EkkelenkampR.KruidhofR.van der HelmF. C. T.van der KooijH.Design of a series elastic- and Bowden cable-based actuation system for use as torque-actuator in exoskeleton-type trainingProceedings of the IEEE 9th International Conference on Rehabilitation Robotics (ICORR '05)July 2005Chicago, Ill, USA49649910.1109/icorr.2005.15011502-s2.0-33745793648VergeThe report of ‘Hercule exoskeleton can help a regular human carry up to 220 pounds’2012, http://www.theverge.com/2012/2/22/2815704/hercule-exoskeleton-human-carry-220-poundsAtkesonC. G.HaleJ. G.PollickF.RileyM.KotosakaS.SchaalS.ShibataT.TevatiaG.UdeA.VijayakumarS.KawatoM.Using humanoid robots to study human behaviorGuoQ.ZhouH.JiangD.Coordinated control method of the lower extremity exoskeleton based on human electromechanical couplingLiQ.KongM.DuZ.SunL.WangD.Interactive rehabilitation exercise control strategy for 5-DOF upper limb rehabilitation armYangZ. Y.ZhangY. S.GuW. J.Bone clothing sensitivity amplification controlCaoH.MengX. W.LingZ. Y.Two-legged robot exoskeleton plantar pressure measurement systemFalesR.KelkarA.Robust control design for a wheel loader using H∞ and feedback linearization based methodsLiuG. P.DaleyS.Optimal-tuning PID controller design in the frequency domain with application to a rotary hydraulic systemBoikoI.Variable-structure PID controller for level processMoradiM.Self-tuning PID controller to three-axis stabilization of a satellite with unknown parametersCermanO.HušekP.Adaptive fuzzy sliding mode control for electro-hydraulic servo mechanismGuanC.PanS. X.Adaptive sliding mode control of electro-hydraulic system with nonlinear unknown parametersShaD. H.BajicV. B.YangH. Y.New model and sliding mode control of hydraulic elevator velocity tracking systemWangC. W.JiaoZ. X.WuS.ShangY. X.Nonlinear adaptive torque control of electro-hydraulic load system with external active motion disturbanceUrsuI.ToaderA.HalanayA.BaleaS.New stabilization and tracking control laws for electrohydraulic servomechanismsMilićV.ŜitumŽ.EssertM.Robust H∞ position control synthesis of an electro-hydraulic servo systemWengF. L.DingY. C.TangM. K.LPV model-based robust controller design of electro-hydraulic servo systemsSongX.WangY.SunZ.Robust stabilizer design for linear time-varying internal model based output regulation and its application to an electrohydraulic systemFalesR.KelkarA.Robust control design for a wheel loader using mixed sensitivity H-infinity and feedback linearization based methodsProceedings of the American Control Conference (ACC '05)June 2005Portland, Ore, USA438143862-s2.0-23944485542KawamuraS.SvininM.AkersA.GassmanM.SmithR.AlleyneA.LiuR.A simplified approach to force control for electro-hydraulic systemsLuW.-M.ZhouK. M.DoyleJ. C.Stabilization of uncertain linear systems: an LFT approachFanM. K. H.TitsA. L.DoyleJ. C.Robustness in the presence of mixed parametric uncertainty and unmodeled dynamicsGuD. W.PetkovP. H.KonstantinovM. M.DoyleJ. C.GloverK.KhargonekarP. P.FrancisB. A.State-space solutions to standard H2 and H∞ control problemsBalasG. J.DoyleJ. C.Robustness and performance trade-offs in control design for flexible structuresPackardA.FanM. K. H.DoyleJ. C.A power method for the structured singular valueProceedings of the 27th IEEE Conference on Decision and ControlDecember 1988Chicago, Ill, USA213221372-s2.0-0024178165GawronskiW.Balanced systems and structures: reduction, assignment, and perturbations