Asynchronous Intermittent Regulation of Human Arm Movement with Markovian Jumping Parameters

In this paper, the regulation stability problem of the human arm continuous movement is investigated based on Markovian jumping parameters. In particular, the intermittent control mechanism is adopted in the arm movement regulation procedure to model the human intermittent motor control strategy. Furthermore, by taking into account the Markovian jumping parameters with different modes, the asynchronous regulation issue is proposed to model mode mismatch between the motor control and arm movement. On the basis of model transformation, sufficient stability conditions are established during the arm movements, and the desired regulation gain can be obtained by the convex optimization method. In the end, an illustrative example is presented to show the applicability and effectiveness of our developed model and optimized regulation approach.


Introduction
As a fundamental yet signifcant issue, the human arm movement regulation has been extensively studied over the last years with high interest. Especially, various computational theories with mathematical models have been developed to describe the human arm movements with corresponding motor control [1][2][3]. From the system point of view, the human motor system can be considered as a closed-loop control system that has complex dynamics and time-varying parameters. In fact, a simple arm movement is a complicated control procedure consisting of joint torques, external forces, and motor commands [4][5][6]. As a result, these dynamical models would lead to system analytical and synthetical complexities. Fortunately, diferent models of human arm movement control have been reported in the literature, where stability and trajectory tracking problems of movement regulation are efectively studied with theoretical results [7][8][9]. Furthermore, it is noted that most common computational methods of human arm movements are always embedded with constant parameters. As such, the optimal solution can be obtained by the computational method, which is dependent on precise model parameters. However, it should be pointed out that human arm control systems might have diferent control modes to achieve more adaptive abilities, and then, the activated muscles would change the shapes during the arm movements according to motion modes [10][11][12]. Hence, these jumping features can be further extended by the hybrid system models. In the meantime, Markovian jumping systems, as a special kind of hybrid system, have distinguishing modeling ability to depict the complex dynamic systems under structure or parameter changes [13][14][15]. Te Markov chain has played a signifcant role in Markovian jumping systems to govern the mode jumpings. In fact, Markovian jumping systems have been widely studied to model robotic systems, neural network systems, and other control systems in numerous practical areas [16][17][18][19][20]. However, the control design difculties would increase due to multiple subsystems under system mode information. More precisely, it is more applicable to the intrinsic variables within human arm movement control procedures. It is noticed that most simplifed models have a common assumption on constant variable parameters, which have neglected the stochastic behaviors of intrinsic variables and then have certain model limitations. Terefore, employing many merits of theoretical analysis on Markovian jumping systems to the human arm dynamics can considerably help to improve the computational models and analysis methods. Moreover, it is worth mentioning that in practical applications, true system modes are always difcult to acquire, which gives rise to the so-called asynchronous control problems. Furthermore, the controller modes might be diferent from true system modes due to detection delays or external disturbances. Under this context, without considering the matching modes would lead to control performance degradation or even system unstable. As such, another interesting research topic lies in the fact of true mode information acquirement for synchronous mode-dependent control in practical implementations. By considering the observed modes and true modes, more robust mode-dependent controllers can be synthesized accordingly. As a result, it is natural and reasonable to further address the asynchronous regulation of human arm movements.
On the other hand, there are substantial evidences that have proven the intermittent strategies during human motor control [21][22][23]. More specifcally, it can be found that human controls body movements in an intermittent way rather than continuous neural mechanisms [24,25]. On the basis of this interesting feature, much efort has been devoted to the intermittent issues of human movements, and several mathematical models have been developed to exhibit the details. Generally speaking, by applying intermittent control, high efciency and low cost can be achieved while the body operates movements [26,27]. Under this context, intermittent control strategies can be employed for the human arm regulation problem from a system perspective. Moreover, the asynchronous intermittent control is more signifcant to deal with the multiple movement modes, which can further reveal the intrinsic dynamical characteristics. Very recently, intermittent control is also becoming a hot research topic in dynamical systems, and burgeoning investigations have been made towards the intermittent state estimation and stability control solutions, especially for the neural network systems [28][29][30]. From the control system perspective, minimal control cost is also an important issue for high-performance systems. As such, many in-continuous control strategies have been proposed, which include impulsive control, intermittent control, sampled-data control, event-triggered control [31][32][33]. Compared with continuous feedback control approaches, the intermittent control, as one of the notable discontinuous control strategies, can not only improve the control efciency but also save the control cost. More precisely, by utilizing the nonzero control width, the intermittent control is more applicable for practical implementations. Furthermore, the intermittent control could be more conveniently formulated without eventtriggering thresholds. However, to the best of the authors' knowledge, there are still few results on the asynchronous intermittent regulation of human arm movement with Markovian jumping parameters, which motivates us for this current study.
For the above discussions on the challenging and open areas, in this paper, the asynchronous regulation issue of human arm movement with Markovian jumping parameters is discussed, where the key idea is to mimic the motor intermittent control. Firstly, the mathematical model of human arm movement with Markovian jumping parameters is proposed. Secondly, the exponential regulation stability is analyzed with asynchronous intermittent control. Tirdly, sufcient stabilization criterion is derived, and the regulation synthesis is achieved via convex optimization. Finally, simulation results are provided to validate the usefulness and superiority of our theoretical results. Tis paper focuses on the theoretical investigations under the mean-square framework. Compared with major existing results, the main novelties of our paper can be summarized as follows: (1) A novel intermittent regulation model of human arm movement with Markovian jumping parameters is frst proposed to mimic the dynamical human motor control mechanisms, which is presented in the state-space states with jumping modes for further regulation analysis and synthesis. Te proposed hybrid model with jumping parameters is more applicable for practical implementations. It is noted that intermittent control for Markovian jumping control systems is also signifcant with exponential stability under the mean-square sense.
(2) The asynchronous intermittent control scheme is presented to deal with the regulation stability under human motor and arm movement mode mismatch. In particular, the intermittent control strategy is proposed along with the practical asynchronous mode-dependent control scheme for the formulated Markovian jumping system. By utilizing the observed mode information instead of true modes, the mode-dependent regulation controllers can have more robustness for mode information acquirement. Tis can potentially improve the model's ability in describing the Markovian jumping regulation model.
(3) A convex optimization approach is developed with sufcient linear matrix inequality conditions to ensure the mode-dependent regulation gain synthesis, and the corresponding illustrative simulation is performed to demonstrate the design adaptability. By solving the established conditions, the feasible solutions of desired modedependent regulation gains can be calculated accordingly.
Notations are as follows: N dimensional Euclidean space matrices are denoted by R N . Matrix P > 0 implies that P is positive symmetric defnite. (Ω, F, P) denotes a complete probability space. E · { } stands for mathematics expectation.

Computational Intelligence and Neuroscience
Finally, let * denote the ellipsis terms in symmetry matrices and all matrices be algebraically compatible.

Human Arm Movement Regulation Model.
As depicted in Figure 1, consider the following two-link human arm model with rigid motions: where (2) More precisely, q denotes the joint displacement, M(q) denotes the inertia matrix, C(q, _ q) denotes the Coriolis and centripetal forces matrix, G(q) denotes the gravitational force vector, τ denotes the forces acting on the arm. Without loss of generality, it is assumed that the rotating cuboid feature is kept for the rotational links. Based on Lagrange's equation of motion in robotics, the two-link nonlinear dynamical model of the human arm is formulated to effectively describe the operating motions with multiple modes.
Consequently, in light of the fact that the muscles would change their shapes during arm motions, the Markovian jumping human arm model is then established to depict the jumping features of corresponding variations of the arm angular mass. Ten, denote a continuous-time discrete-state Markov process r(t) in (Ω, F , P) to describe the jumping modes, where the transition probability matrix As a result, the linear Markovian jumping model can be obtained by the linearization method that , B r(t) are known weight matrices for certain system mode r(t).
Remark 1. Te hybrid system models have been widely studied for human motion systems since the moment of inertia is infuenced by human arm motions. In particular, as one kind of the important hybrid system, the Markov jump system can efectively model the complex dynamics under multiple operating modes. By introducing the Markov chain, diferent motion modes of the human arm can be depicted accordingly.

Asynchronous Intermittent Regulation Control.
In order to mimic the concept of intermittent control strategy for human arm motions, the following mode-dependent intermittent regulation controller is synthesized with asynchronous features: where K σ(t) denotes the asynchronous feedback regulation gain matrix to be determined, k is the nonnegative integer, T represents the regulation control period, δ corresponds to the regulation control width with 0 < δ < T. Without loss of generality, δ and T are supposed to be prescribed setting parameters during the regulation design. Moreover, σ(t) ∈ 5 � 1, . . . , M { } is the observable process of modedependent controllers, which has the same efect as r(t) and is related to r(t) with the following conditional probability representation Λ [34]: Remark 2. It is worth mentioning that the biological evidences have been reported to show the fact that the efective intermittent motor control is adopted by human muscle activations for energy-saving reasons. From the Markovian jumping system point of view, if the asynchronous mode mismatch is not fully taken into account, it would lead to certain control performance degradation or even system unstability. Furthermore, the asynchronous intermittent regulation control model is more applicable for Markovian jumping human arm systems by taking into account the possible neural-induced mode delays. Tis integrated scheme could improve the generality and applicability of the human arm control model to some extent. Computational Intelligence and Neuroscience Ten, the resultant closed-loop human arm system can be obtained by Hence, the following mean-square exponential stability defnition is presented to illustrate the equilibrium points: Defnition 1. [35,36] Te resultant closed-loop human arm system is said to be exponentially stable in the mean-square sense for any initial conditions x(0) if it holds that where λ > 0 and c > 0 are called the decay rate and decay coefcient, respectively. Without loss of generality, it is denoted that r(t) � i and σ(t) � ρ for simplicity, respectively. To this end, the following matrix lemma is given for later use. Lemma 1. [37] Given real matrices A, B, C, X, W 1 , W 2 with appropriate dimensions, if there exists a positive symmetric P satisfes that Ten, there exist a positive symmetric matrix Z and a positive scalar μ > 0 such that

Main Results
In this section, the theoretical, analytical, and synthetical results for closed-loop Markovian jumping human arm system regulation are derived with detailed mathematical proofs.

Theorem 1.
Given constants α > 0, β > 0, T > 0, the closedloop Markovian jumping human arm system can achieve the mean-square exponential stability with given mode-dependent regulation gains K ρ , ρ ∈ F, if there exists a mode-dependent matrix P i > 0, i ∈ S, such that the following linear matrix inequality convex optimization conditions are feasible, where Proof. Construct the following mode-dependent Lyapunov function as And defne the infnitesimal operator L for V(x(t), i, t) by 4 Computational Intelligence and Neuroscience Consequently, for t ∈ k [ )T, kT + δ), it can be derived with respect to time that Such that where α > 0 is a constant scalar.
Ten, it can be deduced by integrating the above inequality that If it holds that Similarly, for t ∈ [kT + δ, kT + T], one has that If it holds that where β > 0 is another constant scalar. Hence, it follows that Computational Intelligence and Neuroscience 5 Consequently, it can be verifed that and which implies that with c 0 � e 2αδ− 2β(T− δ)/Tδ . Furthermore, by Lyapunov function V(x(t), i, t), it yields that and Such that Tis means that the mean-square exponential stability can be satisfed according to Defnition 1 and therefore completes the proof.
□ Remark 3. It should be pointed out that although multiple operation modes would afect the human arm motions, the mean-square exponential stability could ensure the fast convergence to the equilibrium points under the modedependent regulation control inputs. Especially, the conditional probability method for asynchronous feedback control is more applicable and efcient to deal with the parameter jumpings.
Theorem . Given constants α > 0, β > 0, T > 0, the closedloop Markovian jumping human arm system can achieve the mean-square exponential stability if there exist mode-dependent matrices P i > 0, i ∈ S, K ρ , ρ ∈ F, and matrix Z, such that the following linear matrix inequality convex optimization conditions are feasible, where With 6 Computational Intelligence and Neuroscience Furthermore, when the above convex optimization conditions have feasible solutions, the desired asynchronous mode-dependent regulation gains can be determined by Proof. Denote P i � P − 1 i and K ρ � K ρ Z and perform matrix transformation manipulation to convex optimization conditions in Teorem 1. As a result, by applying Lemma 1, the rest of the proof can be straightforwardly obtained. □ Remark 4. Te established convex optimization conditions in Teorem 1 and Teorem 2 are in the form of strict linear matrix inequality, whose feasible solutions can be easily solved by Matlab or Yalmip software. Moreover, it should be addressed that the computational complexity is related to the matrix dimensions and mode information, which implies that the control design should efectively consider the model modes and model dynamical descriptions.

Illustrative Example
In this section, a simulation example is provided to validate the applicableness and efectiveness of the obtained results.
Consider the human arm model with two motion modes modifcation of operating equilibrium points as [π/2, 0, π/2, 0] T and [0, 0, π/2, 0] T , respectively, and the following model parameters are chosen [38]:  Ten, the corresponding Markovian jumping model matrices can be obtained as follows: where the transition rate for Markov chain of motion modes r(t) is assumed to be And σ(t) denoting asynchronous features is supposed to be with By solving the convex optimization conditions in Teorem 2, the desired asynchronous mode-dependent control gains are obtained as follows: In the simulation, the simulation computer is with Intel Core i7 5 GHz processor, and the MATLAB software is utilized with variable-step confgurations. Te numerical Computational Intelligence and Neuroscience parameters for the simulation model are based on the Monte Carlo method. For the intermittent control confguration, it is assumed that the regulation control period is T � 0.3s, and the regulation control width is δ � 0.1s. As a result, by setting zero initial conditions in the simulation, the jumping modes for the human arm model with asynchronous Markovian jumping mode features are depicted in Figure 2. With the prescribed simulation parameters, Figures 3 and 4 can show the closed-loop regulation arm motion trajectories and control inputs, respectively, where it can be found that our obtained asynchronous mode-dependent synthesized results can be well adapted to regulate the human arm movement under the intermittent stability control strategy. Figure 5 shows the comparison results between asynchronous continuous control and our proposed asynchronous intermittent control strategies. It can be seen that the     Computational Intelligence and Neuroscience intermittent control can achieve the stable motion regulation with desired performance and less control cost, which also supports our established theoretical fndings.

Conclusions
Tis paper is concerned with the human arm regulation control problem based on the established hybrid Markovian jumping system model. More specifcally, the signifcant intermittent control strategy is explored by considering the fact of motor control mechanism. Furthermore, the asynchronous modedependent control features are employed to deal with the mode information mismatch by mode-induced delays. By means of convex optimization method, sufcient analysis and synthesis results are established. In the end, the applicability and efectiveness of our theoretical results are demonstrated via relevant simulation results. In future research, an important research is focusing on extending the current model to cases with more realistic motion constraints.

Data Availability
All data supporting the fndings of this study are available within the article.

Conflicts of Interest
Te authors declare that there are no conficts of interest.  Computational Intelligence and Neuroscience 9