Investigation into the Dynamics and Control of an Underwater Vehicle-Manipulator System

This study addresses the detailedmodeling and simulation of the dynamic coupling between an underwater vehicle andmanipulator system. The dynamic coupling effects due to damping, restoring, and inertial effects of an underwater manipulator mounted on an autonomous underwater vehicle (AUV) are analyzed by considering the actuator and sensor characteristics. A model reference control (MRC) scheme is proposed for the underwater vehicle-manipulator system (UVMS). The effectiveness of the proposed control scheme is demonstrated using numerical simulations along with comparative study between conventional proportionalintegral-derivative (PID) control. The robustness of the proposed control scheme is also illustrated in the presence of external disturbances and parameter uncertainties.


Introduction
The underwater manipulator has turned into a critical part/tool of underwater vehicles for performing interactive tasks such as opening and closing of valves, cutting, drilling, sampling, and laying in the fields of scientific research and ocean systems engineering.Due to unstructured properties of interactive work, a good understanding of the dynamics of a robotic manipulator mounted on a moving underwater vehicle is required for autonomous manipulation tasks [1,2].
The increasing in demand for more efficient, precise, and accurate underwater autonomous manipulation has induced many researches in this field, which includes the dynamic model and effective simulation of an underwater manipulator mounted on an underwater vehicle.The first attempt towards modeling of an underwater vehicle-manipulator system (UVMS) started with the development of a dynamic simulation algorithm using the Newton-Euler formulation scheme [3,4].Similarly, using the Kane's method, a simplified dynamic model of UVMS was developed and verified using numerical simulations [5].A coordinated control scheme for the UVMS using a discrete-time approximation dynamic model was developed to compensate for the tracking errors of the manipulator during vehicle motion [6].The UVMS dynamic model was formulated using the quasi-Lagrange method [4,7].A nonlinear model-based control scheme that controlled the vehicle and manipulator simultaneously was developed and investigated [8].In addition to these studies, some of the researches were focused on estimating hydrodynamic parameters of these systems [8], the reduction of the interaction effects (dynamic coupling) between the manipulator and the vehicle [9], and the manipulability and workspace analysis of the underwater manipulator on remotely operated vehicle (ROV) [10].Also, there have been many studies on manipulator control for enhancing efficiency of underwater manipulation, such as the force feedback control of manipulators mounted on ROVs [11], motion planning, and control of UVMS [7], computer-based control, and real-time motion compensation of UVMS [12].The workspace-control system for the teleoperated ROV was proposed by combining the ROV master-slave systems and verified through experiments [13].Despite of these significant researches, most intervention tasks conducted in the field still depend on operator's skills.Therefore, much demand and developments are needed in autonomous manipulation, which gives much attention to and interest in this research field.Although there have been some research attempts to overcome the parameter uncertainties on underwater robots, very few attempts considered the problem of uncertainties associated with time varying parameters on UVMS with manipulator motion causing dynamic coupling.In addition to the coupling effects, most of the real-time AUVs are underactuated in nature (i.e., the vehicle has fewer number of control inputs than the total number of independent states which makes the control scheme complex) which complicates the problem.
Therefore, by considering the above-mentioned issues, this paper presents the closed-form dynamic equations of an UVMS, and the interaction effects between the manipulator and the vehicle are investigated numerically based on prototype vehicle-manipulator parameters.This paper also proposes a model reference control scheme for the UVMS.This scheme enables overcoming the difficulty due to parameter uncertainties, external variations (e.g., buoyancy and payload variations), and disturbances (e.g., underwater current).In this study, the actuator and sensor characteristics such as time constant, efficiency, saturation limits, update rate, and sensor noises are considered for numerical simulations.In the vehicle dynamic modeling, off diagonal elements of the system matrices are considered as well.The effectiveness of the proposed control scheme is confirmed with specified UVMS tasks.
The remainder of this paper is organized as follows.The dynamic modeling of a general UVMS is derived in Section 2. In Section 3, a nonlinear controller for the UVMS based on the model reference control scheme is discussed and detailed performance analysis of the UVMS with different operating conditions is presented in Section 4. Finally, Section 5 holds the conclusions.

Dynamic Model of the Underwater
Vehicle.The dynamic model of an underwater vehicle is developed through the Newton-Euler formulation using laws of conservation of linear and angular momentum.The equations of motion of such vehicles are highly nonlinear [4] mainly due to hydrodynamic forces which act on the vehicle.Generally, the vehicle model can be written with respect to either a bodyfixed or an earth-fixed frame of reference (refer to Figure 1).
The equations of motion of an underwater vehicle having six degrees of freedom with respect to a body-fixed frame of reference can be written as [4] where The relationship between linear and angular velocities in the vehicle frame and those in the absolute frame (refer to Figure 1) is given by where J() is the kinematic transformation matrix and this transformation is undefined for  = ±90 ∘ .However, most of the underwater vehicles are designed to operate at pitch angles well below ±90 ∘ , and hence this limitation has no major significance here.

Kinematic Model of the Underwater
Manipulator.The mathematical model of the underwater manipulator kinematics is derived in this section.

Forward Kinematics of the Underwater Manipulator.
The mathematical relations of the end-effector position/tool center point (TCP) or manipulator tip position with the known joint angles are derived here.The mathematical (kinematic) descriptions of the underwater manipulator are developed based on the Denavit-Hartenberg (D-H) parameter notation [14].The establishment of the link coordinate system as shown in Figure 2 yields the D-H parameters shown in Table 1.Based on the underwater link parameters in Table 1, the homogeneous transformation matrix [14] which is derived, that specifies the location of the end effector or TCP with respect to the base coordinate system, is expressed as The matrix R 0 4 and the vector P 0 4 = [      ]  are the rotational matrix and the position vector from the base coordinates to the end effector, respectively.From the above homogeneous transformation matrix, we can obtain the end effector's position for feedback control and the elements for solving the Jacobian matrix.Based on the experimental underwater manipulator parameters (refer to Table 1), the forward kinematic solutions are obtained as follows: (5)

Inverse Kinematics of the Underwater Manipulator.
In the workspace-control system, each joint of the underwater manipulator is controlled by the joint angle command calculated from the differential inverse kinematic solutions based on the known Cartesian coordinates.The closed-form inverse kinematic solutions of the 3-DOF underwater manipulator are described as where

Dynamic Model of the Underwater
Manipulator.The dynamic model of an underwater manipulator is developed through the recursive Newton-Euler algorithm.In this work, it is assumed that the underwater manipulator links are the buildup of cylindrical elements.The effects of the hydrodynamic forces on circular cylindrical elements are described in the section, which mainly consist of added mass effects, hydrodynamic drag forces and moments, and buoyancy effects [4].The force and moment interactions between two adjacent links are as follows: ] , where  denotes the corresponding joint axis is the rotation matrix, f  is the resultant force vector, t  is the resultant moment vector, p  is the linear and quadratic hydrodynamic friction forces, and F  , F  , and F  are vectors of linear skin friction, quadratic drag, and quadratic lift effects, respectively.D   is the linear skin friction matrix, D   is the diagonal matrix which contains lift coefficients, D   is the diagonal matrix which contains drag coefficients, g  is the gravity force vector, b  is the buoyancy force vector, n  is the hydrodynamic moment vector, d / is the vector from the center of buoyancy of the link, d / is the vector from the center of gravity of the link, d /+1 is the vector from joint  to  + 1, F  is the vector of total forces acting at the center of mass of link, T  is the vector of total moments acting at the center of mass of link, a  is the linear acceleration vector,   is the angular acceleration vector, k  is the linear velocity vector,   is the angular velocity vector, m  is the mass of the link, M  is the mass and added mass matrix of the link (located at the center of mass), I  is the moment of inertia and added moment of matrix of the link (located at the center of mass), and z  is the unit vector along the -axis.
The joint torques of each link are represented as The recursive Newton-Euler dynamics algorithm for all links, symbolically, yields the equations of motion for the underwater manipulator.The result can be written as follows: where q is the vector of joint variables and q = [ 1  2  3 ]  ,  1 ,  2 ,  3 are the joint angles of the corresponding underwater manipulator links, M  () q is the vector of inertial forces and moments of the manipulator, C  (, q ) q is the vector of Coriolis and centripetal effects of the manipulator, D  (, q ) q is the vector of damping effects of the manipulator, g  () is the restoring vector of the manipulator, and   = [ 1  2  3 ]  is the vector of control inputs.

Dynamic Model of Vehicle-Manipulator System.
The manipulator has an initial velocity equal to the velocity of the vehicle.This initial velocity should be accounted in the manipulator dynamics.Similarly, the weight and movement of the manipulator links will affect the vehicle dynamics (these effects are considered as disturbances) and vice versa.By considering the above issues, the vehicle and manipulator equations of motions can be written as follows: where H  2 () ̇is the vector of reaction forces and moments between the vehicle and the manipulator, C   (, q , ])^is the vector of Coriolis and centripetal effects due to coupling between the vehicle and the manipulator, and D   (, q , ])î s the vector of quadratic drag effects due to the interaction between the vehicle and the manipulator. = [      ]  is the vector which contains forces and moments disturbances due to weight and movement of the manipulator links.Consider where R  0 and d vehicle/manipulator are the rotation matrix and position vector from the vehicle-fixed frame to the manipulator base frame, respectively. 0f 1 and 0 t 1 are the vectors of force and moments of the base frame, respectively.These vectors are derived using (8), and these effects are function of the manipulator joint coordinates (i.e., q , q , and q) and the vehicle states.After evaluating the interaction forces and moments between the manipulator and the vehicle based on these vectors, the equations of motion of the vehicle can be written as where H 1 () ̇and H 2 () q are the added inertia effects due to the manipulator, D 1 (, q ) q is the damping effects due to the manipulator, C 1 (, q ) q is the Coriolis and centripetal effects due to the manipulator, and g 1 () is the restoring vector due to the manipulator on the vehicle, respectively.

Model Reference Control
This section discusses the model reference control (MRC) design in terms of feedback linearization.This control scheme transforms the nonlinear system dynamics into a linear system; it compensates for all the nonlinearities in the system by introducing nonlinear elements in the input side, thus making the controller design more flexible [15][16][17].Unlike traditional control, it can be thought of as "instantaneous learning" of the vehicle dynamics.The individual control laws of the underwater vehicle and the manipulator are chosen such that the tracking errors are converging to zero.The tracking errors are defined as η =   − and q = q  −q, where  denotes the desired (or reference) values.The equations of motion of the UVMS can be expressed in the form given below [15]: where M  = M + H 1 (), F 1 (, q , ]), F 2 (, q , ]), G 2 (), and G 1 (, ) are the vectors of the Coriolis, centripetal and damping/frictional, and restoring effects of the vehicle and the manipulator, respectively.

Modelling and Simulation in Engineering
The proposed control input vectors given by (18) will cancel out or compensates for the nonlinearities in the system as where K  , K  , and K  are the proportional, integral, and derivative gain matrices of the vehicle controller, respectively, and K  , K  , and K  are the proportional, integral, and derivative gain matrices of the manipulator controller, respectively.Block diagram representation of the proposed UVMS controller is presented in Figure 3.
The above-mentioned control vectors lead to exponential stable error dynamics of the vehicle and manipulator which are given as which implies that tracking errors are converging to zero (i.e., η → 0 and q → 0) and the UVMS follows the given desired trajectory [18].
However, the above-proposed control scheme assumed that there are no disturbances and no uncertainties associated with the system.If the system uncertainties and external disturbances are considered for the analysis, the system error dynamics become where   and   are the disturbance vector (which combines the internal disturbances such as effect of parameter uncertainties and external disturbances, namely, underwater current, etc.) of the vehicle and manipulator controller, respectively.
The closed-loop characteristic equation or polynomial is given as The control gain matrices are chosen as diagonal and positive definite matrices, such as Therefore, the closed-loop characteristic polynomial becomes and the system error is asymptotically stable as long as the controller gain values are all positive.Therefore, as long as the disturbance vectors are bounded, the system tracking errors are converged to zero.In other words, the system follows the given desired trajectory.Moreover, the controller gain matrices have been chosen in such a way that Hence, η = 0 and q = 0 for all  ≥ 0 are its unique solution, and it can be observed that the system tracking errors are converging to zero asymptotically.The proposed controller analysis does not contain explicit treatment of the parametric uncertainties and external disturbance while taking temporal derivative along the closed-loop system trajectories, and it is left for further research and analysis.

Performance Analysis of the UVMS
4.1.Description of the Simulated System.We have accomplished widespread computer-based numerical simulations to explore the total performance of the proposed UVMS and the model reference (direct adaptive) control scheme.The UVMS used for this study consists of six degrees of freedom (DOF) vehicle and a 3-DOF spatial manipulator; the UVMS arrangement in conceptual design is presented in Figure 4.
The vehicle is a cylindrical shape (torpedo fish shaped) cruising type with the length of 1.1 m and the diameter of 0.25 m.The mass of the vehicle is 39 kg.The vehicle has five thrusters in total, two propulsion thrusters (in the stern side), two vertical thrusters, and one lateral thruster.Therefore, surge, sway, and heave motions are controlled through these thrusters actuation directly, and, however, yaw and pitch motions are controlled by differential actuation of propulsion and vertical thrusters.Although roll motion is unactuated, it can be controlled itself due to restoring effects [19][20][21].It is known that a necessary condition for a submersible body to be stable is that the centre of gravity (CG) should lie below the centre of buoyancy (CB).For this, the vehicle is trimmed (using a float) to have the CB almost vertically above the CG and made to be nearly neutral buoyant.Here the roll motion has nonzero components of restoring moments that represent self-restoring torque for the roll direction.With nonzero restoring terms, it may be possible to find continuous state feedback laws to stabilize the system as a whole.In addition to this, without loss of generality, we can assume that the damping terms of nonactuated states are sufficiently larger than their inertia terms which means that the hydrodynamic restoring forces and torques are large enough to stabilize the nonactuated (roll) states (zero dynamics), which is a common property for AUVs [19].This means that the underwater robot can be exponentially stabilized by the actuated state controls alone.
The manipulator links are cylindrical in shape, and the radii of links 1, 2, and 3 are 0.1 m, 0.05 m, and 0.05 m, respectively.The lengths of links 1, 2, and 3 are 0.1 m, 0.2 m, and 0.2 m, respectively.The link masses (along with oil conserved motors) are 0.39 kg, 1.57 kg, and 1.57 kg, respectively.Here, the links are considered as cylindrical shape because such shape provides uniform hydrodynamic reactions and is one of the primary candidates for possible link geometry for underwater manipulators.Although it is cylindrical, our mathematical framework does not depend on any particular shapes; it can be easily accommodated by any other shapes.Indeed, cylindrical underwater manipulators are available in the present market [22].Hydrodynamic parameters of the UVMS are estimated using empirical relations based on strip theory.This method is verified using the available literature; therefore, these values are reliable and can be used for further developments.Some parameters like inertia, centre of gravity, and centre of buoyancy are calculated from the geometrical design of the UVMS.The total parameter list of the UVMS is given in Tables 2 and 3.
We have compared our results with those of traditional PID controller; the following control vectors were considered for the vehicle and the manipulator and are given by where K  , K  , K  , K  , K  , and K  are the proportional, integral, and derivative gain matrices of the vehicle and the manipulator, respectively.

Description of the Tasks.
Three different tasks with four different cases have been considered for the simulations.The first task is that the vehicle is commanded to track a given 3D trajectory without and with the manipulator (at rest or its home position), and in this condition the vehicle accelerates for the initial 20 s and attains the vehicle forward speed of 1 m/s (≈2 knots) and for the final 20 s the vehicle decelerates to zero speed.The particular desired 3D trajectory (refer to Figure 5) has been chosen for this performance analysis, because this trajectory consists of all four main motions such  the underwater manipulator effects during vehicle tracking control.In the second task, the vehicle is free to move (no control action involved) and the manipulator has a certain repeated desired trajectory.This task is mainly performed to identify the vehicle behavior during manipulator motion.In all the above tasks, the initial velocities and positions of the vehicle and the manipulator are chosen to be zero, and the initial desired and actual positions and orientations are the same.In the third task, two basic trajectories for the manipulator have been chosen for simulations, a circular trajectory (in 3D space) and a rectangular trajectory (in  plane) along with a straight line in 3D space.This is for the reason that most of the underwater intervention tasks involve these types of trajectories and also we can arrange any spatial trajectory by combining these trajectories.For the rectangular trajectory, we have selected a cubic polynomial function as the trajectory function, which imposes that the trajectory is continuous and smooth.
In the performance analysis, the sensory noises in position and orientation measurements are introduced and we have considered Gaussian noise of 0.01 m mean and 0.01 m standard deviation for the position measurements and 0.2 ∘ mean and 0.2 ∘ standard deviation for the orientation measurements.The thruster dynamic characteristics are also incorporated in the simulations.All the vehicle thrusters are considered as an identical one, and the following thruster characteristics are considered for the analysis: the thruster response delay time is 200 ms, efficiency is 95% and saturation limits are ±20 N. The vehicle surge thrusters are located at 0.5 m from the body centre along the -axis and offset each side 0.3 m from -axis.The lateral thruster is exactly located on the body centre, and vertical thrusters are placed on the axis 0.4 m apart from the centre at each side.The controller update rate and sensor response time are considered as 100 ms each.

Results and Discussions.
Here, numerical simulation results are shown and discussed to investigate the dynamic coupling effects and the effectiveness of the proposed modelbased control scheme, which is expected to provide an intuitive, promising prospective of the proposed approach.

Underwater Vehicle Tracking a Given 3D Trajectory
with the Underwater Manipulator.In this case, as mentioned earlier, the vehicle is commanded to follow a given 3D desired trajectory.The desired 3D trajectory is given in Figure 5.
The controller gain values are tuned based on the genetic algorithms (GA) for minimizing the integral squared error (ISE) as the cost/objective function [23].Here, we have considered both the model reference control and the PID control performance to be almost equal in the ideal situation, which makes the controller performance comparison quite reasonable and gives much better way of understanding.
Based on the GA tuning method, the controller parameters are obtained and given in Table 4.The same set of controller parameters are used throughout the entire performance analysis.
Initially, the performance analysis is carried out for the vehicle trajectory tracking without manipulator inclusion.The actual simulated trajectories based on MRC and PID are presented in Figure 5.These results show that both controllers are good enough to track the given trajectory, and the tracking errors are within the design limits (error limits for the vehicle during trajectory tracking are ±0.2 m and ±0.2 ∘ in positions and orientations, resp.) as well.The tracking errors are presented in Figures 6,7,8,9,10,and 11.In the second set of simulations, the manipulator is included and the inclusion effects during trajectory tracking of the vehicle are considered.Here, the manipulator links are folded and arranged in such a way that the influences on the vehicle dynamics are small (i.e., manipulator joint angles are  1 = 180 ∘ ,  2 = 0 ∘ , and  3 = 180 ∘ ).The manipulator inclusion shows that there are significant performance changes in the vehicle trajectory tracking, especially during the heave and sway motion tracking.The heave, roll, and pitch motions of the vehicle are greatly influenced by the underwater manipulator inclusion, which are replicated in the results  (refer to Figures 6 to 11).However, the manipulator inclusion effects are better adapted in the model reference control than in the PID control.As can be observed from Figures 8 and 10, the manipulator inclusion causes an initial pitch angle variation drifts the vehicle in the heave direction during the straight line motion (during acceleration stage).However, these unwanted effects are compensated successfully in the model reference control and therefore tracking errors do not exceed their design limits.with the manipulator oscillation frequency and their joint angle magnitudes.In addition, the direction of the vehicle's movement varies depending on the manipulator positions and its direction of movements.These results can be extended to the work towards swimming robots and their dynamic modeling aspects.it is observed that the manipulator tip tracks the given desired task space trajectories quite satisfactorily, in both PID and MRC schemes in the ideal conditions (no disturbances, no uncertainties, etc.).Then, in order to demonstrate the adaptability and robustness of the proposed controller, an uncertain condition is considered for the simulations.The following conditions are considered for the uncertain condition analysis: (i) the UVMS parameters are assumed to be inaccurate (about 10% for each parameters); (ii) the manipulator carries a payload of 1 kg at its tip; (iii) an unknown ocean current is added in the simulation by properly considering the relative velocity of the in the dynamic model.It is assumed to have an irrotational current, constant in the inertial frame, and the value of the current is considered as ^ = [0.20.2 0.1 0 0 0]  m/s.
The results are presented in Figures 15-18, and from these results it is observed that the proposed controller is good in adapting the uncertainties and disturbances (refer to Figure 15).Figures 16 and 17 show that tracking errors of  and  in both PID and MRC methods are almost the same and results satisfactorily; however, the tracking error in  substantiates that the proposed controller is comparatively good in the presence of uncertainties and disturbances.0.2 m in height in the  plane and an average speed of 0.05 m/s.As mentioned in the last case, the trajectory has been chosen with the consideration of the manipulator characteristics.Two conditions have been considered for the analysis: ideal condition (no disturbances, no uncertainties, etc.) and an uncertain condition (the same as the previous case Section 4.3.3).The results from computer simulations are plotted in Figure 19.In the ideal condition both controllers show quite satisfactory performance, and in the uncertain condition the proposed controller shows better performance.In both trajectory tracking cases, the thruster forces do not exceed ±5 N, and the manipulator actuator torques stay within ±0.15 Nm, which are well within the range of actuators.

Conclusions
In this study, the interaction effects due to the dynamic coupling between the vehicle and the manipulator were investigated using closed-form equations which provide a generalized scheme for formulating the equations of motion of the UVMS.The proposed scheme makes it possible to identify the structure, nature, and properties of the system, and it simplifies the control design.This study also proposed a model reference control approach for an underactuated UVMS to perform underwater intervention tasks incorporating desired trajectory information.Extensive simulations were carried out to verify and demonstrate the effectiveness of the proposed scheme.In particular, the performance of the model reference controller is compared with that of the conventional PID controller for the given UVMS operation scenarios.The obtained results confirm the effectiveness and robustness of the proposed scheme in terms of tracking errors and control effort in the presence of external disturbances and parameter uncertainties.This research provides a generalized framework for modeling and controlling of an UVMS considering the dynamic coupling between the vehicle and the manipulator, which is crucial for achieving underwater manipulation tasks for a variety of scientific, industrial, and military missions using unmanned underwater vehicles.

Figure 2 :
Figure 2: Establishing link coordinate systems of the manipulator.

Figure 3 :Figure 4 :
Figure 3: Block diagram of model reference control.

Figure 6 :
Figure 6: Tracking errors in  position for a given 3D trajectory.

Figure 7 :
Figure 7: Tracking errors in  position for a given 3D trajectory.

Figure 8 :
Figure 8: Tracking errors in  position for a given 3D trajectory.

Figure 10 :Figure 11 :
Figure 10: Tracking errors in pitch for a given 3D trajectory.

Figure 12 :Figure 13 :
Figure 12: Tracking errors in the vehicle positions (when manipulator has motion).

Figure 14 :Figure 15 :
Figure 14: Manipulator tip position in 3D space (when the vehicle has no control).

Figure 17 :
Figure 17: Time histories of the manipulator tip position tracking error in  (circular trajectory).

Figure 18 :Figure 19 :
Figure 18: Time histories of the manipulator tip position tracking error in  (circular trajectory).

Table 1 :
D-H parameters of the 3-DOF underwater manipulator.

Table 2 :
The parameter list of the UVMS.

Table 3 :
The values of hydrodynamic coefficients calculated using empirical relations based on strip theory.
as sway in and out and heave up and down.The average value of sway velocity is 0.25 m/s (≈0.5 knots) (same value for heave as well).This task is performed to identify the influences of Modelling and Simulation in Engineering

Table 4 :
Controller parameter settings for simulations.