Path Planning for a Space-Based Manipulator System Based on Quantum Genetic Algorithm

In this study, by considering a space-based, n-joint manipulator system as research object, a kinematic and a dynamic model are constructed and the system’s nonholonomic property is discussed. In light of the nonholonomic property unique to space-based systems, a path planning method is introduced to ensure that when an end-effector moves to the desired position, a floating base achieves the expected pose. The trajectories of the joints are first parameterized using sinusoidal polynomial functions, and cost functions are defined by the pose deviation of the base and the positional error of the end-effector. At this stage, the path planning problem is converted into a target optimization problem, where the target is a function of the joints. We then adopt a quantum genetic algorithm (QGA) to solve this objective optimization problem to attain the optimized trajectories of the joints and then execute nonholonomic path planning. To test the proposedmethod, we carried out a simulation on a six-degree-of-freedom (DOF) space-based manipulator system (SBMS). The results showed that, compared to traditional genetic optimization algorithms, the QGA converges more rapidly and has a more accurate output.


Introduction
During space missions, astronauts face a harsh and lifethreatening environment in space, especially in the course of extravehicular activities.A growing number of researchers think it inevitable that space manipulators will be used, autonomously or semiautonomously, in future missions to perform tasks either completely or incompletely [1][2][3].With the rapid development of space technologies, a number of tasks can be implemented by space manipulator systems.At present, some manipulators are installed on a base whose position or attitude is controlled by reaction wheels or thrusters, taking a satellite-manipulator system, for instance.This kind of system has the following disadvantages: (1) the position and pose control system (PACS) consumes fuel, which shortens the lifespan of the entire space mission.(2) Gas emitted by the thruster might negatively impact the surrounding objects.(3) When the PACS is used, a transient response appears that may impact the dynamic performance of the system.(4) The pose control system can easily attain a saturated state.
In order to solve this problem, many researchers use space-based systems to replace the ones whose base is installed with PACS.However, there exists a highly dynamic coupling phenomenon between a floating base and a manipulator in a space-based system, especially when both have a similar mass.This affects the control precision of the end-effector of the manipulator because the space-based manipulator system (SBMS) is nonholonomic.This study focuses on using the nonholonomic property to plan the path of joints such that the end-effector and the floating base simultaneously arrive at the desired state.
Unlike fixed systems, the position and pose of the endeffector of a manipulator in space-based systems are dependent not only on the given joint angles, but also on the joint paths.In other words, for the same joint configuration, different joint paths correspond to different poses.The authors of [4,5] studied the course of the development and the status of nonholonomic systems as well as their principles of dynamics and control methods.Rathee and Pathak [6] present path planning of dual arm free flying space robot using smooth functions of time.Results of their works demonstrate that if the base mass and inertia are increased to a certain limit keeping in mind the singularities, then base disturbance can be decreased and the end effectors follow the required circular path.Zeng et al. [7] present a subsection algorithm for obstacle avoidance path planning of free-floating space manipulator for orbit observation.The approach could guarantee that the end-effector reaches the desired point and realize the obstacle avoidance.Kaigom et al. [8] propose a Constrained Particle Swarm Optimization algorithm to steer the end-effector to a target pose with minimized base disturbance.This approach is based on Reaction Null-Space concept.And its simulation results demonstrate the effectiveness of the planning method.Liu et al. [9] analyze the path planning of redundant, free-floating space manipulators with revolute joints, and 7 degrees of freedom.They provide a tractable planning method to avoid the pseudoinverse of the Jacobian matrix.Nenchev [10] summarizes results based on the application of Reaction Null-Space approach.Via the null-space and pseudo-inverse mapping of the coupling inertia, the joint space is decomposed into two complementary orthogonal subspaces which is useful for motion analysis and control of various unfixed-base systems.Jia et al. [11] present a novel path planning method to avoid obstacle based on A * algorithm for space manipulators.In this article, a concept of "collision-free workspace" of a space manipulator is provided.Shi et al. [12] propose a nonholonomic motion planning methodology for free-floating space robot (FFSR) using swarm optimization algorithm.Also, an optimal control technique is applied for FFSR trajectory planning.Zhang [13] proposed a path planning method for a free-floating space robot in Cartesian space.Shi [14] proposed a quantum particle swarm optimization method to plan path for space robots, and Jia et al. [15] developed a straight-line trajectory optimization method for a redundant robot with nine degrees of freedom (DOF).
In this study, based on an analysis of nonholonomic properties, we first determine the coupling relationship between a base and a manipulator.We consider the pose of the base and the position of the end-effector as the optimized targets.We then parameterize the joint trajectories using sinusoidal polynomial functions, set ranges of value for the joint angles, rate, and acceleration, and convert the path planning problem into a target optimization problem.Finally, we make use of a QGA to resolve and obtain the optimal parameters as well as an expression of the joint trajectory.To test the effectiveness of the proposed method, we conducted a forward simulation to solve for the optimal target.

Kinematic Model of a Space-Based Manipulator System
According to the modeling theory of unrooted multibody systems, with respect to coordinate transformation, a new modeling approach is proposed.

Description of SBMS.
An SBMS consists of an -joints manipulator and a floating base.Its simplified schematic diagram is shown in Figure 1:  (1) Each component of the system is rigid and numbered from 0 to  starting from the base.
(2) For simplicity, each joint between link  and link  + 1 has one DOF.
(3) The entire system is in microgravity without an external force exerting on it.
(4) The system has a tree topology.
(5) Σ  and Σ  are, respectively, the body-fixed reference frame and the inertial reference frame.In general, the origin of the inertial reference frame and the center of mass of the SBMS overlap to some extent in the initial state, and the direction of Σ 0 coincides with that of Σ  .
(6) a  represents the position vector relating joint i to the CM of link , and b  represents that relating the CM of link i to the next joint.
The selection of coordinate systems is a precondition of modeling.A mixed coordinate system consisting of related and reference coordinates is chosen in this study.In particular, x 0 ∈  3 and  ∈  3 represent the position and pose of the base, and  ∈   represents the joint angles here.

The constraint equation of an 𝑛-joint open-loop serial rigid body system is written as
where and m represents the number of constraint equations.The velocity screw is not just a differential of positional screw.It is When a different reference frame is selected, the expression of U also differs: see [16].
Since the DOF of a system is equal to the difference between the number of dependent coordinates and that of the constraint equations-that is,  = (6+6)−-the kernel of Φ  is spanned by  linearly independent column vectors.The basic solutions of this vector space are defined as {S 1 , . . ., S  }.Hence, the dependent velocity screw can be expressed as where  = [S 1 , . . ., S  ] ∈  (6+6)×(+6) is called the basic solution matrix.Let ẏ = t = [ 1 , . . .,  +6 ]  , which is an independent velocity vector.The velocity screw of the th link can be written as Since the system is in free-floating state, momentum is conserved and is assumed to be zero: Connecting ( 5) and ( 6), the velocity-level differential equation is written as where J * represents the generalized Jacobian matrix, the concrete representation of which is During nonholonomic path planning, the integral and iterative processes based on ( 6) and ( 7) can implement path following a floating base.

Analysis of Nonholonomic Properties.
In order to better understand the coupling phenomenon between a floating base and a manipulator installed on it, an SBMS is here demonstrated as being nonholonomic [17].Definition 1.A linear subspace spanned by one or more dimensional unsteady vectors is called a distribution.Definition 2. If the result of a Lee bracket operation between two random vectors belonging to a distribution also belongs to it, the distribution is deemed involutive.
Frobenius' Theorem.The necessary and sufficient condition for the integrality of the Pfaffian constraint equations is that their solution space is an involutive distribution.
The state variables are defined as the angle velocity of the base and the joint angle velocity of the manipulator; that is, The input value is defined as u = φ .From (2) and (6), where the coefficient matrix K can be written as ] and  0 represents the pose angle.A generalized velocity distribution Δ consists of n columns of K; that is, Δ = span(K 1 , . . ., K  ), where K  = ( 1 ,  2 ,  3 , e   )  and e   represents the standard unit vector.The result of the Lee bracket between K  and K  is Hence, Δ is not involutive.According to the Frobenius theorem, SBMS has been shown to be a nonholonomic system.

Transformation of Path Planning Problem to Objective Optimization Problem
3.1.Solving the Objective Function.As we know, the whole system is composed of a floating base, a macroarm, and a dexterous robotic hand.During objective capturing process, the macroarm and dexterous hand are fixed together.The main topic of this text is to make the dexterous hand (or a special point of the macroarm) arrive a desired position by planning the joint path of the macroarm.As for how and with what attitude to capture an objective by the dexterous hand, it is not included in the topics.Also, attitude of the floating base has an important influence on communication quality and solar conversion efficiency.So, the focus of this study is to plan joint trajectory in order to enable the posture of the base and the position of the end-effector arrive at their desirable states simultaneously.The relevant variables include the quaternion of the base and the position vector of the end link, which are written as X = [Q   , P   ]  ∈ R 6 .X 0 , X  , and X  are, respectively, the initial state, the desired state, and the final state.
Steps of path planning are as follows: (1) Transformation of state variables (X → X  = [Q   ,   ]  ).End-effector positional vector with respect to the base-linked reference frame is only dependent on joint angles vector ; that is, 0 P   =  1 (), while the homogenous transformation matrix from inertial reference frame to base-linked one is related to attitude of the base and the base's positional vector r  ; that is,   0 =  2 (Q   , r  ).Assume that r  = r 0 (a constant) at  = 0.According to momentum conservation law, vector r  is related to history of joint angles; that is, r  = r  ().So state variable is transformed by Parameterized joint trajectory using sinusoidal polynomial functions.
(3) Design of objective function based on the deviation between the final state and the desire state.
The destination of path planning is as follows: the planned joint trajectory () can render true the condition whereby the final state variables can infinitely approach the desired variables; that is, ‖X   − X   ‖ → 0.

Parameterization of Joint Angles.
Using the sinusoidal function to parameterize the joint angles can better constrain their scope.To ensure that the velocity and acceleration curves are smooth, we define There are six constraint conditions: So,   = ( max −  min )/2 and   = ( max +  min )/2.Then, joint angle velocity and acceleration can be written as Then, the objective function is defined as At this time, the path planning problem in SBMS has been transformed into an optimization problem of nonlinear function (b).We choose the QGA to solve it.

Using QGA to Solve Optimization Problem
The quantum genetic algorithm [18] is a method that combines quantum computation and a genetic algorithm, which is a probabilistic evolutionary algorithm.

Theory of QGA.
The genetic algorithm is a common method to solve complicated optimization problems.In 1998, Dr. Bagley proposed the concept of the "genetic algorithm" in his doctoral dissertation and developed a self-adaptation genetic algorithm [19].The basic idea underlying this algorithm is to learn the jungle law in biological evolution and selection, as well as the crossover or mutation of chromosomes.It is robust and has a wide range of applicability.However, its iterations is much, its convergent rate is low, and it is easily caught in a local optimum.
On the contrary, quantum computation involves solving an NP problem in classical computation using superposition, entanglement, and the interference of quantum-state information units.In 1994, Shor first proposed the quantum algorithm [20].
The QGA is a genetic algorithm based on the expression of a quantum-state vector.The probability amplitude expression of the quantum bit is applied to a chromosome's encoding process, because of which the chromosome can be expressed through the superposition of quantum states whose update process is conducted by means of a quantum rotate gate.Target optimization is thus completed.
The QGA is updated through the quantum rotate gate, which is expressed as Thus, the key differences between the quantum genetic algorithm and traditional genetic algorithm are that the former has more abundant population diversity and better parallel calculating abilities with larger search range and convergence rate.This is why its adaptation and efficiency is much higher.

Brief Introduction to QGA Performance
(1) Compared to the genetic algorithm, QGA has several new features.
(2) It uses the global searching method, which enlarges the search scope and increases search efficiency.
(3) It effectively resists premature phenomena and has better convergence and precision.
(4) With increase in the number of iterations, the global search capability decreases and local search ability increases, which can cause the system to converge to the global optimum.
(5) The quantum system is a complex nonlinear system that can adapt to practical issues.

Path Planning
Based on QGA.The path planning process of an SBMS based on the QGA is as follows: (1) Set known parameters, such as mass, inertia, length, and the bound range of the joint angles.Input the initial state variable, the desired state variable, and the planning time.
(2) Parameterize the joint trajectory, and determine the type and number of parameters.
(3) Solve the final state variable.Compute the difference between the final state and the desired state.
(4) Define parameters mentioned in (2) as chromosomes, and initialize them randomly to obtain a population composed of  quantum bits.
(5) Measure the population and encode it.(8) Judge whether the iterative process has end.The basis is the fitness constraint condition and the maximum number of iterations.
(9) Update individuals by quantum rotate gate, and perform the circuit operation along (5)∼( 8) until it jumps from the loop.
The corresponding flowchart is shown in Figure 2.

Simulation Test
In this section, we consider a 6-DOF SBMS as an example, the 3D model of which is shown in Figure 3, for a simulation test to test the proposed path planning method.We also compared it with the traditional genetic algorithm.
The geometrical and inertial parameters of the system are shown in Figure 3 and Table 1.The D-H model is shown in Figure 4: it depicts the deployable state, also called the zero state.The D-H parameters are shown in Table 2.The initial and desired poses of the base are represented by the quaternion as follows: According to the two preconditions above, we transformed them into another form that incorporated joint configuration.Based on the requests (positional error of endeffector  pe ≤ 0.05 m and attitude error of the base   ≤ 5 ∘ ) of positional precision of the floating base and the attitude precision of the end-effector, we then defined the positional coefficient  1 = 0.4,  pe = 0.02, and attitude coefficient  2 = 0.0175.According to formula (12) and the boundary values of it, the value ranges for each parameter were set as The optimization of the objective functions was executed by the QGA and the genetic algorithm.The results, including the objective values and optimal parameters, are given below.
Figure 5 shows that the simulation process converged after 152 iterations.Figure 6 shows that the simulation converged after 80 iterations.Compared to the GA, the QGA converged much more rapidly with higher precision.Moreover, step width of ladder-shaped curve shown in Figure 5 is larger than that shown in Figure 6.This implies that the genetic algorithm can easily fall into a local optimum.Hence, the QGA is superior to the genetic algorithm.

Results
We then solved the optimized joint trajectory according to the parameters obtained from the QGA, as shown in Figure 7. Finally, we used the joint trajectories in Figure 7 as inputs to the motion of the control joint and observed whether the base and the end-effector arrived at the desired state simultaneously.Figure 8 shows the RPY angle curves of the floating base.Positional curves of the floating base and the end-effector are, respectively, described in Figures 9 and 10. Figure 11 shows the distance between the actual and desired positions of the end-effector.The deviation as 2.78 × 10 −2 , which was acceptable.From Figure 7, we see that the curves are smooth, and this is satisfactory for the control of the joints.

Conclusion
In this study, we built a kinematical model for a SBMS and analyzed its nonholonomic properties.Moreover, we also parameterized the joint trajectory and the design objective function and hence transformed the path planning problem into a nonlinear objective optimization problem.We used the genetic algorithm and the QGA to solve above problem.The results showed that the proposed method can obtain a superior solution compared to prevalent systems and converges much more rapidly.We also obtained joint trajectories based on the optimized parameters and drew pose curves of the base and the position curve of the end-effector.The results indicated that the proposed method can arrive at the desired state.Our method can efficiently reduce the energy consumption and time in a coordinated control process between a floating base and a manipulator.

Figure 1 :
Figure 1: Structure diagram of a space-based manipulator system.

( 6 )( 7 )
Design the objective function based on state difference.Solve the fitness of each individual and record the results.

Figure 4 :
Figure 4: D-H frames of space-based systems.

Figure 5 :Figure 6 :
Figure 5: Fitness curve of global optimal points for GA.

Figure 8 :
Figure 8: Pose error curves of the floating base.

Figure 9 :
Figure 9: Positional curves of the floating base.

Figure 10 :Figure 11 :
Figure 10: Positional curves of the end-effector in inertial reference frame.
], where [  ,   ]  and [  ,   ]  update represent probability amplitudes before and after the update, respectively, and   represents the spin angle.

Table 1 :
Geometrical and inertial parameters of a system.

Table 2 :
D-H parameters of a space-based manipulator system.