Research on Construction Method of Operational Reliability Control Model for Space Manipulator Based on Particle Filter

The operational reliability of the space manipulator is closely related to the control method. However the existing control methods seldom consider the operational reliability from the system level. A method to construct the operational reliability system control model based on particle filter for the spacemanipulator is presented in this paper. Firstly, the definition of operational reliability and the degree of operational reliability are given and the state space equations of the control system are established as well. Secondly, based on the particle filter algorithm, a method to estimate the distribution of the end position error and calculate the degree of operational reliability with any form of noise distribution in real time is established. Furthermore, a performance model based on quality loss theory is built and a performance function is obtained to evaluate the quality of the control process. The adjustment value of the end position of the space manipulator can be calculated by using the performance function. Finally, a large number of simulation results show that the control method proposed in this paper can improve the task success rate effectively compared to the simulation results using traditional control methods and control methods based on Bayesian estimation.


Introduction
Space manipulators can assist or replace astronauts to finish complex and dangerous space tasks [1,2].With the development of space technologies, space application tasks are becoming increasingly diverse, and the structure of space manipulators is also becoming more and more complicated [3][4][5].Meanwhile, due to its harsh working environment and difficulty to repair and maintain, how to maintain a high reliability of space manipulator is a research hotspot and difficult point of space technology [6,7].
The reliability of space manipulator includes the inherent reliability and the operational reliability [8], and the inherent reliability is given during its process of design and manufacture, relevant to various structural parameters of the manipulator and performance parameters of components [9]; the operational reliability is a character to maintain the performance ability shown in the actual use process of a product, which considers not only the influence factors of inherent reliability but also those which impacts product installation, operation, and repair support, and so forth [10,11].
Currently, researches on reliability of space manipulator mainly focus on the inherent reliability, and related research achievements mainly include evaluating the reliability of a manipulator with a certain method, reliability design of manipulators, and fault-tolerant techniques of manipulators [12][13][14][15][16][17][18].Because the space manipulator is a kind of controllable space mechanism, its operational reliability is closely related to its control method.Currently, the mainstream control methods for space manipulator, such as task planning method, path planning method, robust control method, and neural network method, take into account many factors, but the operational reliability of a manipulator is not considered from the system level [19][20][21][22][23][24][25][26][27].This may cause a low reliability of the system and cannot guarantee a manipulator to complete the task sustainably and reliably.Therefore, in order to further improve the operational reliability of space manipulator, system control method comprehensive multiple factors of operational reliability should be considered, building control methods and adjustment strategies to maintain its operational reliability from the system level.When the space manipulator performs specified tasks, through the adjustment of control strategies and self-adaptive changes, the ability of completing a task successfully with specified control method is maintained to improve the operational reliability of the system under the condition of constant inherent reliability.
A method to construct the operational reliability system control model for space manipulator based on the particle filter is proposed in this paper.Combining reliability theory with control characteristics of space manipulator, based on the given definition of the operational reliability and the degree of operational reliability for space manipulator, the state space equations of the control system are established.Combined with the principle of particle filter algorithm and features of the control system, the estimation of the terminal position error distribution and real time calculation of the operational reliability for space manipulator under any distribution of observed noise are realized.Control process performance model based on the principle of quality loss is constructed, and the control performance function is obtained, according to which the calculation of the terminal position adjustment amount for space manipulator is achieved.In this method, the operational reliability of space manipulator is calculated at the same time as the execution of specified tasks, and the control of manipulator is adjusted according to the degree of operational reliability; thus operational reliability and working efficiency of space manipulator are improved.Simulation results show that, compared with traditional control method and that based on Bayesian estimation, successful rate of tasks is increased significantly and the operational reliability of manipulator is improved effectively by the proposed control method.

Construction of Operational Reliability
Control Model for Space Manipulator

Description of Operational Reliability for Space Manipulator.
The operational reliability of space manipulator is the reliability shown in the process of its actual use, and it depends on its control method because it is a kind of controllable device.In this paper, the operational reliability of space manipulator is defined as the ability to complete the task successfully with specified control method when it performs the specified task, which is quantified by the degree of the operational reliability, and specifically reflected as the probability of completing the task for space manipulator according to specified requirements [28].
According to the control characteristics of space manipulator, its work consists of a series of tasks, which is denoted by ,  = {  |  = 1, 2, . . ., } . ( For any given task   ,  factors which determine the success or failure of the task are denoted by   ,   = {  |  = 1, 2, . . ., } . ( For each   of any given task   , it has a prescribed accuracy requirement, which is denoted by the following interval: where   is the expectation of   and   ∈ [0, +∞) presents the error allowance of   .So if   ∈   ( = 1, 2, . . ., ,  = 1, 2, . . ., ) when   is finished, task   is considered executed successfully.
After the task   is completed using a specified control method, a nonnegative random variable   is used to describe the value of   , the distribution function of which is described as On this basis, the probability of   meeting accuracy requirements of task   can be obtained as follows: where (  ) is the operational reliability degree of space manipulator.From formula (5), the operational reliability degree of a manipulator is the probability that each factor meets specified accuracy requirement when it performs a task.Therefore, the operational reliability of a space manipulator can also be defined as the probability of successful completing of specified task when using specified control method to control the manipulator.So   can also be called the reliability influence factor, and it can have different definitions such as terminal position and terminal force, according to different tasks.

Basic Components of the Operational Reliability Control
System for the Manipulator.As is shown in Figure 1, the operational reliability control system for the space manipulator is constructed based on its general control system, and the real time calculation of the operational reliability degree is a feedback unit of the control system.The basic working principle of the control system is as follows: the error value between the terminal position and the specified position of the space manipulator is measured after the movement control unit by the System Condition Detection Module, according to which the operational reliability degree of the space manipulator system is estimated and then the adjustment amount of its control variables is calculated.So the control variables can be fine-tuned to reduce the error and improve the system reliability.
The control system schematic diagram of the space manipulator adding the operational reliability control loop is shown in Figure 1.The overall working process of the control system is as follows: first, the task planning module divides the specified task into a series of subtasks and trajectory waypoints consistent with the constraints, and subtasks will be input to the path planning module to obtain the optimal path.Thus, various control parameters of the manipulator are given, such as position, velocity, and force, which are input to motion control module to solve the optimal control strategy and then to drive the actuator to complete the task.
There are three feedback loops in the control system.The first one is used within the motion control module to monitor movements of the manipulator in real time; the second one is applied to detect and process faults of space manipulator in real time and adjust the control strategy according to the faults; the last one is the control circuit of the operational reliability, which is used to detect the operational reliability of the space manipulator and amend the control parameters of space manipulator according to the operational reliability.
A less detailed representation for the operational reliability control system in Figure 1 is shown in Figure 2.
The working process of the operational reliability system for space manipulator described in Figure 2 is as follows: observed values of influence factors of operational reliability are first obtained by system state monitoring module, and the particle filter algorithm is used to analyse the real distribution of the influence factors to calculate the operational reliability degree, which is compared with the specified reliability to solve the optimal adjustment strategy and adjust the control amount of space manipulator accordingly.Among them, the real time calculation of the operational reliability degree and the solution of optimal adjustment strategy are two key aspects of the system.

State Space Model of the Operational Reliability Control
System for Manipulator.General operating mode of space manipulator in orbit mainly includes no-load operation, load operation, and a mixed one.In this paper, the proposed operational reliability control system for space manipulator is assumed that it is working under no-load running state.Under this state, whether the implementation results meet requirement only depends on its terminal position.Assume the error of terminal position is  and the following discrete state space equations are established to describe the control process based on the control system model: where   is the actual error of terminal position for the th control cycle;   presents terminal position error for the th control cycle obtained by forward kinematics solution with noise;   is the adjustment amount of control variable for the th control cycle and V  is the observed noise error, which can obey any distribution.
The above state space model requires that a control task of the control system for the space manipulator has two or more control cycles.The initial distribution of terminal position error for space manipulator is obtained in the first control cycle, and then it is amended according to observations of terminal position error in later control cycles.In each control cycle, operational reliability of space manipulator is calculated based on the obtained distribution of terminal position error, which is used to calculate adjustment amount of the control variable for adjusting, so the error is gradually reduced and operational reliability of space manipulator is gradually improved.
Expression of the operational reliability for space manipulator in this paper can be obtained by the general formula of the operational reliability in formula (5) and can be written as

Real Time Control of the Operational Reliability Control System for Manipulator
When performing a given task, the space manipulator needs to arrive at the preset space position at the preset time.However, due to the impact of the internal joints gear clearance and sensor noise and, and so forth, after performing a certain task within a number of control cycles, there is a certain error between the actual spatial position and the expected spatial position.If not corrected, it is possible to lead to a bigger and bigger error between the actual execution results with the expected implementation results and finally reduce the operational reliability of the space manipulator.
Because there may be difference on the internal structure or the environment, the real position error distribution of the space manipulator may not be considered as the simple Gaussian distribution [28], and it may obey all sorts of distribution which is difficult to be described in some analytical methods.At this moment it may lead to great deviation calculation results compared to the actual problem when using the classical Bayesian estimation method.So the estimation of the terminal position error distribution and real time calculation of the operational reliability degree for space manipulator under any distribution of observed noise are realized using the particle filter algorithm in this paper.

Using Particle Filter Algorithm to Calculate the Operational
Reliability Degree.The basic idea of particle filter algorithm is that two sets of particles and particle weights are used to describe the target states, where particles represent some samples of target states and particle weights represent the degree of similarity between particles and target states [29].In the changing process of the target parameters, the target states can be tracked and predicted through continuous revision of particles and their weights.
Combined with state space model and the principle of particle filter algorithm, two sets of { In addition, the following normal distribution model is used as a priori probability distribution of   : where  0 is the initial value of the terminal position actual error for space manipulator, with  0 and Λ 0 being the expectation and variance of a priori probability distribution for  0 , respectively.Then the particle filter is conducted based on state space equation of the system and a priori distribution, and the main steps are as follows.
(1) Initialization: for the first control cycle of task, the number of   random quantities is generated as the initial particle set {  0 ,  = 1, . . .,   } based on a priori probability distribution of  0 , with their corresponding weights set as {  0 = 1/  ,  = 1, . . .,   }.For the second or later control cycles, the particle set is obtained by resampling according to the particle {  −1 ,  = 1, . . .,   } and its weight {  −1 ,  = 1, . . .,   } of the previous control cycle and can be described as where  is an integer greater than or equal to 1,   −1 is the particle for the ( − 1)th control period,  −1 is the adjustment amount of the end position error of the space manipulator for the ( − 1)th control period, and    is a random number satisfying the uniform distribution between 0 and 1.
(2) The value of weight is updated according to the importance function using a priori distribution model, which is given as follows: Due to using of the method of resampling, the weight value of the particle is   −1 = 1/  , so there is

𝑝(𝑦 𝑖 | 𝑧
) is related to the noise distribution, and the noise V  is set to obey the distribution B with a probability density function of ℎ(), where  is a variable.So the calculation function of That is to say, where the formula of () with  as its variable is as follows: Then, according to (  |   ), the operational reliability degree of space manipulator is obtained by using the following formula: where  1 ≤   ≤  2 is the range of the preset precision, with  1 and  2 being lower and upper limit value of precision range, respectively, and satisfying  2 ≥  1 .

Real Time Adjustment Strategy of Control Variables for the Operational Reliability Control System.
For the th control cycle of control link, the following performance function is established to evaluate the control strategy [30], where  +1 is the observed value of the terminal position error of space manipulator for the ( + 1)th control cycle and   is adjustment amount of control variable.The above formula can be considered as the function of   when   value is constant.Therefore, the best adjustment strategy in the control process is to calculate the optimal value of   , making the value of the above performance function as small as possible. *  (  ) and   (  ) are set as the minimal expectation loss for the ( + 1)th control cycle when the estimation value of the terminal position error for space manipulator is   under the condition of adjustment and no adjustment, respectively.Adjustment amount   is set as   =     to simplify the calculation, where   is a one-dimensional variable.
From the definition of   , it can be obtained that According to the definition of  *  (  ), it can be obtained that Based on the state equations in formula ( 6), it can be obtained that That is to say, Under the condition of   = 0, it is known that At this time,  *  (  ) =   (  ) is obtained.Under the condition of   ̸ = 0, there is the following formula which is equal to solve the minimum value of a quadratic function about   : Due to the fact that ‖  ‖ 2 > 0, the minimum value is obtained at the symmetry axis; that is, where   is the expectation of the probability distribution for the end position error of the space manipulator after the completion of the th control cycle and  is the noise expectation of control system, which can be obtained by the statistics of the noise samples and is a known amount.So, the formula  *  (  ) =   ((1 +   )  ) +  is obtained at this time, where  is the normalized adjustment costs; that is to say, Therefore, Meanwhile, the adjustment amount of the terminal position for space manipulator can be obtained as where the formula of   is obtained by particle filter algorithm and can be described as

Simulation and Verification
Based on the proposed control system model of the operational reliability and the corresponding control method, MATLAB software is used to establish a simulation system to verify its control effect.The object manipulator of study in this paper has 8 degrees of freedom.The manipulator's D-H coordinate system is shown in Figure 3.The D-H parameters are shown in Table 1.
The basic workflow of the simulation system is as follows: (1) initializing relevant parameters, such as the establishment of a collection of particles and their weights, the determination of the initial value of error, and so on, (2) estimating the distribution of the terminal position error for space manipulator by particle filter algorithm and calculating the degree of the operational reliability, and (3) determining the value of adjustment amount by the performance function, and so forth.A flowchart of the simulation system for a control cycle is shown in Figure 4.

The Basic Simulation.
Based on the model structure of the operational reliability control system for space manipulator, a simulation system is established to verify its control effect, where the initial value of the terminal position error is 7 mm with an initial particle distribution  0 ∼ (7, 1) selected for particles, and assume the total number of the task control cycles is 9 with a specified upper and lower limit accuracy of ±1 mm and a threshold reliability of 0.9.The distribution curve of the observed noise used in this paper is shown in the solid blue line of Figure 5.
The result shown in Figure 6 is obtained by a single simulation.As can be seen from Figure 6, the real value of the terminal position error for space manipulator in the control process gradually approaches 0 with no fluctuation, but the observed value has a large fluctuation due to the presence of noise.Compared with the observed value, the predicted value is relatively stable and gradually close to the real value.The degree of the operational reliability of space manipulator has a trend of continuous improving and gradual converging to 1 in the control process, which is shown by the change curve of that in Figure 7.
The 1000 times' simulation results are shown in Figure 8, where the horizontal axis is precision value and the vertical axis is times of execution result precision falling in the corresponding precision of the horizontal axis.A successful  rate of 87% is obtained on condition that a task is identified successfully when the final value of terminal position error for space manipulator in a control task is located within the stipulated range of ±1 mm, and the total loss of task calculated by performance function is 64855 in the control process.  = −  .Single and multiple simulation results, respectively, are as shown in Figures 9 and 10.
From the single simulation result shown in Figure 9, under the conditions without estimating the error of the terminal position and calculating the operational reliability, it can be seen that the real error of the terminal position for space manipulator decreases gradually and constantly fluctuates near 0 but cannot converge.The precision distribution curve for 1000 times is shown in Figure 10, where a calculated successful rate of task for the traditional control method is 60% and the total loss of task is 75336.By contrast, the control effect of the presented method is better than that of the traditional method.

Simulation of Bayesian Estimation Method.
Bayesian estimation theory is an estimation method based on the probability distribution [31], whose basic principle is that an unknown parameter  is made as a random variable and its prior distribution () is introduced, which is amended according to the measured data and Bayesian theorem so as to obtain posterior probability density function of the parameter .The distribution of the observed noise used in this paper needs to be treated approximately when Bayesian method is used to estimate that of the terminal position error.The approximate distribution curve of observed noise is shown as the dotted red line of normal distribution curve in Figure 11 with an expectation of 0 and a variance of 1.
The principle of Bayesian estimation method is as follows [28].
First, a normal prior model is used as the prior probability distribution of   ; that is,  0 ∼ ( 0 , Λ 0 ) and observed noise is set to obey normal distribution (namely, V  ∼ (0, Σ)), where Σ is an approximate variance.
Then, recursive posterior probability distribution of   based on state space equations and Bayesian formula is as follows: where Posterior probability distribution function of   can be described as The operational reliability of space manipulator is calculated by the following formula: The single and multiple simulation results based on the above method are as shown in Figures 12, 13, and 14.As can be seen from the single simulation result in Figure 12, the real value of the terminal error for space manipulator decreases steadily with no fluctuation during the control process and predicted value of error gradually converges to the real error but converges near −1 mm with a certain error contrast with the ideal case converging near 0 mm.In addition, it can be seen in Figure 13 that although the degree of the operational reliability estimated by Bayesian method gradually improves, there is a larger fluctuation in the process from the curve compared with the results using the proposed method.Meanwhile, the degree of the operational reliability estimated may be inaccurate due to the approximate distribution of observed noise.
The successful rate of task obtained by Bayesian estimation method is 66% and the total loss of task is 83531 for 1000 times in Figure 14, which are both inferior compared with those of particle filter algorithm.Therefore, under the described basic conditions, the method proposed in this paper has a more superior performance than that of Bayesian Mathematical Problems in Engineering estimation method, which can improve operational reliability of manipulator more effectively.

Conclusion
In this paper, the control model and method based on the degree of the operational reliability for space manipulator are presented and studied, and the following work is mainly completed.First, the control system model of space manipulator based on the degree of the operational reliability is established.Second, the real time control methods for space manipulator based on the degree of the operational reliability are studied, and the estimated distribution of the terminal position error under any observed noise distribution and online calculation of the operational reliability degree are realized using the particle filter algorithm.Then the control performance model is established to realize the real time solution to the adjustment amount of the terminal position.Finally, a control simulation system is established to carry out a large number of simulation verifications, which proves that operational reliability of manipulator and successful rate of task can be improved more effectively by the proposed control method compared with other ones.

FaultFigure 1 :Figure 2 :
Figure 1: The structure diagram of the operational reliability control system for space manipulator.
,  = 1, . . .,   } and {   ,  = 1, . . .,   } are used to describe the distribution of terminal position error   , where {   ,  = 1, . . .,   } is a group of sample data (namely, particles) in the same form of   and   represents the number of particles; {   ,  = 1, . . .,   } is the corresponding weights of particles, representing the relevance degree of particles    and   and ∑ = ℎ(  −    ).(3) The weight value    is normalized; namely, it is set that, Based on the above methods, the probability distribution function (  |   ) of the terminal position error for space manipulator is obtained as  (  |   ) ≈

Figure 4 :Figure 5 :
Figure 4: Flowchart of the simulation control system.

Figure 13 :
Figure 13: Reliability curve of Bayesian estimation method for a single simulation.

Figure 14 :
Figure 14: Precision distribution curve of Bayesian estimation method for multiple simulation.

Table 1 :
The D-H parameters of the manipulator.