Applied Bionics and Biomechanics
Volume 2018 (2018), Article ID 9737418, 10 pages
https://doi.org/10.1155/2018/9737418

Research Article

Muscle Coordination Control for an Asymmetrically Antagonistic-Driven Musculoskeletal Robot Using Attractor Selection

Shoichiro Ide¹ and Atsushi Nishikawa2,3

¹Interdisciplinary Graduate School of Science and Technology, Shinshu University, Ueda 386-8567, Japan
²Faculty of Textile Science and Technology, Shinshu University, Ueda 386-8567, Japan
³Division of Biological and Medical Fibers, Institute for Fiber Engineering (IFES), Interdisciplinary Cluster for Cutting Edge Research (ICCER), Shinshu University, Ueda 386-8567, Japan

Correspondence should be addressed to Atsushi Nishikawa; nishikawa@shinshu-u.ac.jp

Received 31 March 2018; Revised 21 June 2018; Accepted 5 July 2018; Published 12 September 2018

Academic Editor: Dongming Gan

Copyright © 2018 Shoichiro Ide and Atsushi Nishikawa. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Recently, numerous musculoskeletal robots have been developed to realize the flexibility and dexterity analogous to human beings and animals. However, because the arrangement of many actuators is complex, the design of the control system for the robot is difficult and challenging. We believe that control methods inspired by living things are important in the development of the control systems for musculoskeletal robots. In this study, we propose a muscle coordination control method using attractor selection, a biologically inspired search method, for an antagonistic-driven musculoskeletal robot in which various muscles (monoarticular muscles and a polyarticular muscle) are arranged asymmetrically. First, muscle coordination control models for the musculoskeletal robot are built using virtual antagonistic muscle structures with a virtually symmetric muscle arrangement. Next, the attractor selection is applied to the control model and subsequently applied to the previous control model without muscle coordination to compare the control model’s performance. Finally, position control experiments are conducted, and the effectiveness of the proposed muscle coordination control and the virtual antagonistic muscle structure is evaluated.

1. Introduction

Human beings and animals move flexibly and dexterously by controlling their musculoskeletal system with the brain. To understand and imitate the flexible and dexterous motion of human beings and animals, several musculoskeletal robots have recently been developed. The primary driving mechanism in musculoskeletal robots is a tendon-driven assembly using motors [1, 2] or pneumatic artificial muscles (PAMs). In particular, using PAMs as actuators enables flexible movement of the musculoskeletal robot compared with conventional robots that use motors because the compressibility and low viscosity of air provide compliance and rapid contraction. The extremely high power-to-weight ratio of the PAM is also good for flexible and dynamic motion.

The musculoskeletal robot comprises antagonistic-driven systems. An antagonistic-driven system includes two or more actuators for joint movement. The actuators are antagonistically arranged around one link, and their output characteristics and arrangements are, for the most part, symmetrical.

Many studies have proposed the musculoskeletal robots comprising this simple antagonistic system, and various control methods (e.g., PID control, neural network, and fuzzy logic) have also been proposed for musculoskeletal robots [3–8]. However, the drive system of our musculoskeletal robot [9] differs from a simple antagonistic-driven system because the output characteristics and the arrangements of the actuators of the robot are not symmetrical.

This robot has two kinds of PAM actuators, a monoarticular muscle that drives one joint and a polyarticular muscle that drives multiple joints consecutively. Therefore, the mechanism that drives each joint is not symmetrical. Furthermore, the actuators are not arranged symmetrically, although each actuator is antagonistically arranged around each link. Since each actuator is not arranged symmetrically and the sensors for measuring each joint angle are not arranged, design of the control system for the robot is more difficult and challenging.

Honda et al. [9, 10] proposed a biologically inspired control method using muscle coordination for the robot. They hypothesized that human beings use the synergies between antagonistic muscle pairs when joints move, and they defined two parameters, the antagonistic muscle ratio and the antagonistic muscle activity, as the key parameters in human muscle coordination. The parameters are computed by a PID controller [10] and are implemented to control the angle of the robot’s joints.

Although good control performance was obtained for one joint, the controller did not work well for multiple joints of the robot [9]. An adaptive method that dynamically and adaptively searches the parameters for muscle coordination was required because PAMs have time variance, compliance, high hysteresis, and nonlinearity. In general, this search problem can be formulated as a combinatorial optimization problem of minimizing an object function subject to the search variables, which requires a precise model (object function) in advance, but system identification against an asymmetrically antagonistic-driven PAM system having nonlinear dynamics is difficult.

As an alternative to such a model-based theoretical approach, we believe that heuristic control methods inspired from living things are important for the control of the musculoskeletal robot. The musculoskeletal structures of human beings and animals are antagonistic-driven systems. They are also asymmetrically antagonistic-driven systems because monoarticular muscles and polyarticular muscles are arranged around various joints. Human beings and animals move flexibly by controlling their various muscles dexterously.

Recent research about the mechanisms of living things indicates that a biological system behaves flexibly using noise [11]. Escherichia coli (E. coli) cells usually prefer to switch to an adaptive attractor using noise to survive better in a new external environment after the environmental conditions have been changed. This adaptive behavior of the E. coli cells is known as attractor selection [12]. The novel control method based on the attractor selection has been proposed and applied to a signal-control method for traffic networks [13], network management [14, 15], android motion generation [16], robot navigation and locomotion [17–19], robotic arm control [20–22], and endoscopic surgery [23].

The control method was described by a stochastic differential equation, input variables for the network systems or robots were computed by solving the equation, and the systems accomplished the tasks without the dynamics and model of the systems and environments. Since the attractor selection is conducted adaptively using noise in the systems or environments, the control method is robust for changes of tasks and environments. Attractor selection was applied to an asymmetrically antagonistic-driven musculoskeletal robot (Figure 1) with muscles arranged asymmetrically [24]. From the control experiment, the position of the tip of the robot was moved to the desired position by searching pressure for four PAMs individually using the attractor selection. The control time had to be more than 100 s to accomplish tasks. Therefore, modification of the control method is required to accomplish tasks quickly.

(a)

(b)

Figure 1: Control target and purpose. (a) Our five-fingered robot hand (right photograph) and pneumatic artificial muscles (PAMs) (left photographs) used as the actuator of the robot hand. These muscles are the McKibben actuator made in SQUSE Inc. and are driven by supplied compressed air (bottom-left pictures). (b) The structure of the index finger of the robot hand (the image and the closed photograph in the inset). The position of the tip of the index finger is controlled as a musculoskeletal robot. Various muscle lengths shown in (a) are arranged on the links of the index finger (they are also arranged for other fingers). The muscles A and B are of the same length. The muscle C is shorter than muscle A or B, and the muscle D is the shortest of all muscles on the finger. Each joint is driven from 0 deg (maximum extended state) to 90 deg (maximum flexed state).

In this study, we propose a novel muscle coordination control method for the asymmetrically antagonistic-driven musculoskeletal robot using the attractor selection. The primary difference between the previous method [24] and the proposed one is that the proposed method introduced a virtual antagonistic muscle structure as a muscle coordination control model. Instead of individually and directly searching the PAM pressure in the actual asymmetric antagonistic muscle structure, the new method indirectly searches pressure for actual PAMs via a virtual symmetric antagonistic muscle structure.

First, muscle coordination control models of the musculoskeletal robot were built using virtual antagonistic muscle structures with a virtually symmetric arrangement of muscles. Next, the attractor selection was applied to the control model and also applied to the previous control model without the muscle coordination to compare control performance. Finally, position control experiments were conducted, and the effectiveness of the proposed muscle coordination control applied attractor selection and the virtual antagonistic muscle structure was evaluated.

2. Materials and Methods

2.1. Purpose: Control of the Position of an Asymmetrically Antagonistic-Driven Musculoskeletal Robot

In this study, a five-fingered robot hand (Figure 1(a)) inspired by the right hand of a human being was used, and the position of the tip of the index finger of the robot hand was controlled as a musculoskeletal robot. Figure 1(b) shows the structure of the index finger. It has a three-degrees-of-freedom mechanism that is formed by four links (a distal phalange, an intermediate phalange, a proximal phalange, and a metacarpal) and three joints (distal interphalangeal (DIP), proximal interphalangeal (PIP), and metacarpophalangeal (MP)). Four PAMs are used: one actuator on the intermediate phalange, one on the proximal phalange, and two on the metacarpal for flexion and extension. The actuator for extension (referred to as the “extensor”) is a polyarticular muscle in which wire covers all joints. Therefore, the number of actuators for flexion and extension is not symmetrical.

Let , , , and be the pressure supplied to the muscles A, B, C, and D, respectively, in Figure 1. The subscript “e” indicates the extensor, “MPf” indicates the flexor (the actuator for flexion) for driving the MP joint, “PIPf” indicates the flexor for driving the PIP joint, and “DIPf” indicates the flexor for driving the DIP joint, and they are calculated as follows:

where , , , and are the normalized search variables and is the maximum pressure supplied to the actuator. Since the actuators of the robot hand break if a pressure of more than 0.2 MPa is supplied, the value of is set to 0.19 MPa.

2.2. Muscle Coordination Hypothesis

Honda et al. suggested the hypothesis that muscle coordination of human beings is a coordination of antagonistic muscles (the extensor and flexor) [9, 10]. They express the ratio of the coordination using two parameters, the antagonistic muscle ratio () and antagonistic muscle activity (). The is the value that regulates the ratio of pressure ( and ) between the antagonistic muscle (the extensor) and (the flexor). is calculated between 0 and 1 and is defined as follows:

is the sum of pressure for the extensor and the flexor and is calculated by

In this study, is always set to the maximum pressure for driving joints sufficiently. That is,

Pressures and are calculated from (5), (6), and (7).

Equations (8) and (9) show that the pressures of the extensor and the flexor are determined by searching for the normalized variable . Figure 2(a) shows the principle of muscle coordination using the antagonistic muscle ratio and antagonistic muscle activity .

Figure 2: Muscle coordination and two types of virtual antagonistic muscle structures. (a) Principle of the muscle coordination using the antagonistic muscle ratio and the antagonistic muscle activity . When is 0 (left picture), the pressure for the flexor is high () and the extensor is low (). When is 0.5 (middle picture), the pressure for the flexor and the extensor is identical (). When is 1 (right picture), the pressure for the flexor is low () and the extensor is high (). Therefore, the pressures of the extensor and the flexor are determined by searching for the normalized variable . (b) One of the virtual antagonistic structures. Two muscles are added virtually to the musculoskeletal system (shown in (d)) to form a symmetrically antagonistic arrangement on the intermediate phalange and the proximal phalange. Therefore, the virtual antagonistic structure has three simple antagonistic muscle structures (inset picture in (b)). (c) The other virtual antagonistic muscle structure. Two muscles on the intermediate phalange and the proximal phalange are decreased virtually from the musculoskeletal robot (shown in (d)), and the muscles are symmetrically arranged on the metacarpal. Therefore, the virtual antagonistic structure has one simple antagonistic muscle structure (inset picture in (c)). (d) The real form of the musculoskeletal robot that is controlled. The value of (shown in (a)) is applied to the virtual antagonistic structure (shown in (b) or (c)) virtually transformed from the musculoskeletal robot (shown in (d)).

2.3. Two Types of Virtual Antagonistic Muscle Structures

Four actuators were used in the musculoskeletal robot: the polyarticular muscle was used as the extensor and three monoarticular muscles were used as the flexor (Figure 1(b)). To calculate the pressure for each actuator based on the muscle coordination hypothesis, two methods that make the total number of extensors and flexors match virtually are proposed.

The first method is composed as follows. The virtual antagonistic muscle structure (Figure 2(b)) is composed so that the number of extensors is increased from one to three extensors. Next, is applied to each antagonistic muscle to drive each joint. Hence, is described as , , and , and the pressures for the extensor and the flexor at each antagonistic muscle for driving each joint are denoted as , , , , , and . The pressures are calculated as follows:

Finally, that applies to the real extensor on the real form (Figure 2(d)) is calculated using

The second method is distinguishable in the following ways. First, the other virtual antagonistic muscle structure (Figure 2(c)) reduces the number of flexors to one. Next, is applied to the virtual antagonistic muscle structure, and the pressures for the virtual extensor and for the virtual flexor are calculated using (8) and (9). Here, is the total pressure for the three real flexors (, , and ) and is defined as . Finally, is distributed to the three real flexors on the real form (Figure 2(d)). Two distribution ratios ( and ) are used, and the pressure for the three real flexors is calculated by

Pressure for the real extensor is the same as that for the virtual extensor and is calculated using (8).

2.4. Attractor Selection Model

Let us consider the combinatorial optimization problem of minimizing an object function subject to the search variable where is a feasible solution (an attractor) and means the number of attractors. Rather than seek an optimal solution, we try to quickly find good approximate solutions. To accomplish this, our study uses the revised attractor selection model, which has been generalized as a stochastic differential equation [24]:

where is time, is the search variable or state ( for our case), the value is the degree of accomplishment of the task, is assumed as noise, and is the function that makes converge to a suitable attractor. Typically, the function can be represented as if the objective function is known precisely in advance.

This model searches for a solution (the attractor) that successfully accomplishes the task using noise, and the makes the behavior of the total system change. Notice that as increases, the term becomes more dominant in (20) and the state transition becomes more deterministic. Consequently, state tends to be entrained into a suitable attractor, where it remains despite the persistent noise. By contrast, decreasing the increases the dominance of the noise , thereby flattening the potential landscape. In this scenario, the transition becomes more probabilistic, like a random walk, and is driven away from the attractor.

The function can be designed freely, even if the objective function is unknown or not precisely described. Two elements are required. The value of must converge to the attractors, and the must remain at a suitable attractor. To satisfy these elements, is defined as follows:

where is the th attractor, is the number of attractors, is the power that attracts , and is the range in which the attractor’s power is effective.

2.5. Employing the Attractor Selection to Determine the Pressure Supplied to Each Actuator

The selection of the attractor is employed to determine the pressure supplied to each actuator. The three methods used to determine the pressure using attractor selection are presented as follows.

The first method uses the real musculoskeletal structure (Figure 2(d)) and directly calculates the four pressures by searching for the four variables (, , , and ) using the attractor selection. We refer to this as a pressure search-type controller. The pressure supplied to each actuator is calculated by (1), (2), (3), and (4). This method is the same as reported in our previous method in [24].

The second method uses the first virtual antagonistic muscle structure (Figure 2(b)). It searches for the three ratios (, , and ) using the attractor selection and supplies the pressure to each actuator using (10), (11), (12), (13), (14), (15), and (16). We refer to this as an search-type controller.

The third method uses the second virtual antagonistic muscle structure (Figure 2(c)). It searches for the value and the two distribution ratios ( and ) using the attractor selection and then supplies the pressure to each actuator using (8), (9), (17), (18), and (19). This is referred to as an and search-type controller.

Notice that the search space for all the variables (, , , and ; , , and ; and , , and ) ranges from 0 to 1.

3. Experimental Procedures

A control experiment that makes the tip of the index finger of the musculoskeletal robot (see the bottom-right inset in Figure 3) move to the desired position was conducted using the above three controllers. Figure 3 depicts the experiment setup, which comprises the musculoskeletal robot (SQUSE hand G type, SQUSE Inc.), the control PC (MDV ADVANCE ST 6300B (MouseComputer Co. Ltd.), Windows XP, and an Intel Core i7 920 (2.67 GHz)), an A/D converter (AI-1664L-LPE, CONTEC Co. Ltd.), two D/A converters (AO-1616L-LPE, CONTEC Co. Ltd.), a digital output board (RRY-32-PE, CONTEC Co. Ltd.), a motion capture system (Nobby Tech. Ltd.), regulators (ITV0030, SMC Corporation), solenoid valves (S070-5DCO-32, SMC Corporation), and an air compressor (DPP-AYAD, Koganei Corporation). The sampling frequency was set at 100 Hz. The input signals were voltages generated by the control PC and were converted to pressures by the regulators. The output signals were the coordinates of the tip position [, , ] sensed by the motion capture system. The Euclidean norm (the distance between the desired position [, , ] and the tip position) was used as the evaluation index of the controller. The Euclidean norm is described by and computed using

Figure 3: System overview. Two insets show the system flow (top-left) and the position of the marker captured by the cameras in an enlarged view of the robot hand (bottom-right). The marker is set to the tip of the musculoskeletal robot (the index finger). The input voltage from the control PC is converted to the controlled pressures by the regulators, and the musculoskeletal robot is driven by the pressures supplied to each muscle of the robot. The position of the tip is measured using the marker captured by the cameras and is saved to the PC.

And of the attractor selection model is calculated from 0 to 1 using

Here, is the maximum value of a norm computed from the desired position and the tip position on either the maximum flexion, which is a steady state in which maximum pressure (0.19 MPa) is supplied to all flexors, or the maximum extension, which is a steady state in which maximum pressure is supplied to only the extensor of the robot.

Each norm was obtained in advance, and the larger norm was selected as . Two tasks were conducted in the experiment. The flexion task involved making the robot flex to a desired position from an extended state, the extension task involved extending the robot to a desired position from a flexed state, and the tasks were changed after a constant time. First, the flexion task was conducted. After a constant time, the desired position was changed and the extension task was conducted. The control time was set at 60 s, and the task was changed 30 s after the control was started. The first position and the desired position were defined when the robot was in a steady state after constant pressure was applied to each actuator. Each position was captured in advance.

In this experiment, the pressure value, represented by , , , and (0.05, 0.15, 0.05, and 0.05, resp.), was applied to each actuator to determine the desired position for the flexion task, and 0.15, 0.05, 0.05, and 0.05, respectively, were applied to each actuator to determine the desired position for the extension task. The initial values of , , , and ; , , and ; and , , and were set to 0.9, 0.1, 0.1, and 0.1; 0.9, 1.0, and 0.0; and 0.9, 1.0, and 0.0, respectively, and the noise was generated between and 10. The parameter values in (21) were set as follows: and .

4. Results and Discussion

Figures 4–6 show the results using the pressure search-type controller, the search-type controller, and the and search-type controller, respectively. The transition of the search variables, the pressures supplied to each actuator, the tip position captured by the motion capture, and of the attractor selection model were then plotted. In Figure 4, increased from 3 s and became constant at 0.96. Therefore, the flexion task was almost accomplished, and the search variables converged to an attractor. However, the extension task was not completed. increased from 33 s to 35 s and remained at nearly 0.8, but it decreased from 39 s and did not reach a high value. The difference in the accomplishment ratio of the task is caused by the relationship of pressure between the extensor and the flexor. When increased and became constant in the flexion task, the pressure on the extensor () decreased and the pressure on the flexor responsible for driving the MP joint () increased. Therefore, the power for the flexion became large, and the robot flexed toward the desired position. In the extension task, pressures for the extensor () and pressure for the flexor for driving the MP joint () increased from 33 s to 35 s. Therefore, the power for the extension did not increase dramatically, and the robot did not accomplish the extension task. The difference between the pressure for the extensor and the flexor is important for achieving the task efficiently.

(a)

(b)

(c)

Figure 4: Results using the pressure search-type controller. (a) Plots of the transition of the search variables (, , , and ) and the attractors (dashed lines). (b) Plots of the transition of the input pressures (, , , and ). (c) Plots of the trajectory of the tip of the robot for the flexion task (top-left) and the extension task (top-right) and the transition of the (bottom). Cyan arrows, green arrows, and black arrows show the direction of the movement, the MP joint position, and the value of , respectively.

(a)

(b)

(c)

Figure 5: Results using the search-type controller. (a) Plots of the transition of the search variable (, , and ) and the attractors (dashed lines). (b) Plots of the transition of the input pressures (, , , and ). (c) Plots of the trajectory of the tip of the robot on the flexion task (top-left) and the extension task (top-right) and the transition of the (bottom). Cyan arrows, green arrows, and black arrows show the direction of the movement, the MP joint position, and the value of , respectively.

(a)

(b)

(c)

Figure 6: Results using the and search-type controller. (a) Plots of the transition of the search variable (, , and ) and the attractors (dashed lines). (b) Plots of the transition of the input pressures (, , , and ). (c) Plots of the trajectory of the tip of the robot on the flexion task (top-left) and the extension task (top-right) and the transition of the (bottom). Cyan arrows, green arrows, and black arrows show the direction of the movement, the MP joint position, and the value of , respectively.

In Figure 5, increased after 10 s and reached a constant value of 0.91 at 17 s. The flexion task was close to being accomplished, but compared with the pressure search-type controller, the accomplishment ratio was 5% lower and the control time for accomplishment of the task was 13 s longer. Therefore, the control was not as good as that of the pressure search-type controller. In the extension task, did not attain a high value. Therefore, the extension task was not accomplished. As a result, the controller did not work well for the extension task. To efficiently accomplish the task, it was necessary that the differences between the pressures for the extensor and the flexors be easily calculated by the controller because the differences can decrease power which prevents accomplishment of tasks and can make the tip position of the robot move quickly to the desired position, but this controller cannot calculate the differences between the pressures as well as the pressure search-type controller. This controller searches for three values independently. Therefore, each takes on a different value, and the pressure for the flexor does not decrease satisfactorily. Thus, the power for flexion does not decrease sufficiently, and the extension task is not accomplished.

In Figure 6, increased greatly and became constant at 0.95 for the flexion task. On the extension task, increased gradually right after the change of the task and became constant at 0.97. Therefore, the flexion task and the extension task were accomplished. The and search-type controller is, thus, more highly adaptive for tasks than the pressure search-type controller and the search-type controller. Especially, the effectiveness of the and search-type controller for the extension task was shown. The robot has four actuators arranged asymmetrically on the extension side and the flexion side. One actuator is installed on the extension side, and three actuators are installed on the flexion side. Therefore, the power for flexion easily becomes large compared with the power for extension. To make this robot extend sufficiently, the power for flexion must become small.

In the and search-type controller, the difference between the power in the flexion and in the extension is determined easily because the difference between the pressures for the flexor and the extensor is calculated by searching only one . Therefore, the power for flexion becomes small, and the robot can sufficiently extend. We also conducted the different task for the and search-type controller to show the adaptability of the controller. Figure 7 shows the results of the experiment. We set four tasks, two flexion tasks and two extension tasks, which were conducted alternately. The desired position for each flexion task was different, and each desired position for each extension task was different. Each task was changed at the following constant times: 30 s, 60 s, and 90 s after the control is started. Experimental results show that became the high value for each task. Therefore, the and search-type controller displayed good adaptability for the tasks in the experiments. Thus, it was shown that the proposed muscle coordination control of the and search-type controller using the attractor selection facilitated easy control of an asymmetrically antagonistic-driven musculoskeletal robot with a polyarticular muscle.

(a)

(b)

(c)

Figure 7: Results using the and search-type controller at four desired positions. (a) Plots of the transition of the search variable (, , and ). (b) Plots of the transition of the input pressures (, , , and ). In (c), the top images plot the trajectory of the tip of the robot: the first flexion task, the first extension task, the second flexion task, and the second extension task from the left image, whereas the bottom image plots the transition of the . Cyan arrows and black arrows show the direction of the movement and the value of , respectively.

5. Conclusions

This work demonstrated a muscle coordination control of an asymmetrically antagonistic-driven musculoskeletal robot using attractor selection which is a biologically inspired search method.

First, muscle coordination control models of the musculoskeletal robot were built using virtual antagonistic muscle structures with a virtually symmetric arrangement of muscles, and the calculation methods of the input pressure for PAMs of the musculoskeletal robot with and without muscle coordination were shown. Next, the attractor selection was applied to both the muscle coordination control model and to another control model without the muscle coordination to compare the control performance. Finally, position control experiments were conducted, the effectiveness of the proposed muscle coordination control applied to the attractor selection was demonstrated, and it was also shown to be faster and more robust to accomplish the task by generating control commands virtually assuming a symmetrical and simpler metastructure rather than providing a control command according to the actual complex (asymmetric) antagonistic muscle structure.

Based on the virtual antagonistic muscle structure proposed in this research, we may be able to build a musculoskeletal robot that achieves a more complicated task faster by devising how to give noise [25] and adaptively updating the attractor structure [21]. In future work, the muscle coordination control method, using the attractor selection, will be applied to the multifingered robot hand formed by increasing the number of musculoskeletal robots (i.e., robot fingers). Furthermore, the effectiveness of the control method will be investigated for asymmetrically antagonistic-driven musculoskeletal robots, which have entirely different arrangements of muscles compared with our musculoskeletal robot.

The muscle coordination control method using attractor selection can be applied not only to musculoskeletal robots but also to human hands. Therefore, the control method will be applied to rehabilitation using functional electrical stimulations (FESs) [26, 27] as a novel approach to controlling human hands.

Data Availability

The raw data for Figures 4–7 are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there is no conflict of interest regarding the publication of this paper.

Acknowledgments

This work was supported by JSPS KAKENHI Grant nos. JP23560524, JP26420196, and JP17K06259.

References

I. Mizuuchi, T. Yoshikai, Y. Sodeyama et al., “Development of musculoskeletal humanoid Kotaro,” in Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006, pp. 82–87, Orlando, FL, USA, May 2006.

H. G. Marques, M. Jantsch, S. Wittmeier et al., “ECCE1: the first of a series of anthropomimetic musculoskeletal upper torsos,” in 2010 10th IEEE-RAS International Conference on Humanoid Robots, vol. 6-8, pp. 391–396, Nashville, TN, USA, December 2010.

N. C. Park and H. S. Yang, “Control of a flexible manipulator with artificial muscle-type pneumatic actuators, using -synthesis,” Journal of Vibration and Control, vol. 4, no. 4, pp. 481–502, 1998.

T. V. Minh, B. Kamers, T. Tjahjowidodo, H. Ramon, and H. Van Brussel, “Modeling torque-angle hysteresis in a pneumatic muscle manipulator,” in 2010 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, pp. 1122–1127, Montreal, ON, Canada, July 2010.

T. D. C. Th;anh and K. K. Ahn, “Nonlinear PID control to improve the control performance of 2 axes pneumatic artificial muscle manipulator using neural network,” Mechatronics, vol. 16, no. 9, pp. 577–587, 2005.

B. Verrelst, R. V. Ham, B. Vanderborght, F. Daerden, D. Lefeber, and J. Vermeulen, “The pneumatic biped “Lucy” actuated with pleated pneumatic artificial muscles,” Autonomous Robots, vol. 18, no. 2, pp. 201–213, 2005.

A. Rezoug, S. Boudoua, and F. Hamerlain, “Fuzzy logic control for manipulator robot actuated by pneumatic artificial muscles,” Journal of Electrical Systems, vol. 1, pp. 1–6, 2009.

K. K. Ahn and H. T. C. Nguyen, “Intelligent switching control of a pneumatic muscle robot arm using learning vector quantization neural network,” Mechatronics, vol. 17, no. 4-5, pp. 255–262, 2007.

Y. Honda, F. Miyazaki, and A. Nishikawa, “Control of pneumatic five-fingered robot hand using antagonistic muscle ratio and antagonistic muscle activity,” in 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics, pp. 337–342, Tokyo, Japan, September 2010.

Y. Honda, F. Miyazaki, and A. Nishikawa, “Angle control of pneumatically-driven musculoskeletal model using antagonistic muscle ratio and antagonistic muscle activity,” in 2010 IEEE International Conference on Robotics and Biomimetics, pp. 1722–1727, Tianjin, China, December 2010.

T. Yanagida, M. Ueda, T. Murata, S. Esaki, and Y. Ishii, “Brownian motion, fluctuation and life,” Biosystems, vol. 88, no. 3, pp. 228–242, 2007.

A. Kashiwagi, I. Urabe, K. Kaneko, and T. Yomo, “Adaptive response of a gene network to environmental changes by fitness-induced attractor selection,” PLoS One, vol. 1, no. 1, article e49, 2006.

D. Tian, J. Zhou, Z. Sheng, Y. Wang, and J. Ma, “From cellular attractor selection to adaptive signal control for traffic networks,” Scientific Reports, vol. 6, no. 1, article 23048, 2016.

G. Motoyoshi, K. Leibnitz, and M. Murata, “Proposal and evaluation of a future mobile network management mechanism with attractor selection,” EURASIP Journal on Wireless Communications and Networking, vol. 2012, no. 1, 2012.

D. Tian, J. Zhou, H. Qi et al., “A bio-inspired QoS-oriented handover model in heterogeneous wireless networks,” Journal of Applied Mathematics, vol. 2014, Article ID 920123, 13 pages, 2014.

T. Chikaraishi, T. Minato, and H. Ishiguro, “Development of an android system integrated with sensor networks,” Journal of Information Processing Society of Japan, vol. 49, no. 12, pp. 3821–3834, 2008.

S. G. Nurzaman, Y. Matsumoto, Y. Nakamura, S. Koizumi, and H. Ishiguro, “Attractor selection based biologically inspired navigation system,” in In Proceedings of the 39nd ISR(International Symposium on Robotics), pp. 837–842, Seoul, Korea, October 2008.

S. G. Nurzaman, X. Yu, Y. Kim, and F. Iida, “Guided self-organization in a dynamic embodied system based on attractor selection mechanism,” Entropy, vol. 16, no. 5, pp. 2592–2610, 2014.

Y. Kim, S. G. Nurzaman, F. Iida, and E. F. Fukushima, “A self organization approach to goal-directed multimodal locomotion based on attractor selection mechanism,” in 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 5061–5066, Seattle, WA, USA, May 2015.

I. Fukuyori, Y. Nakamura, Y. Matsumoto, and H. Ishiguro, “Flexible control mechanism for multi-DOF robotic arm based on biological fluctuation,” in SAB '08 Proceedings of the 10th international conference on Simulation of Adaptive Behavior: From Animals to Animats, pp. 22–31, Osaka, Japan, July 2008.

A. Sugahara, Y. Nakamura, I. Fukuyori, Y. Matsumoto, and H. Ishiguro, “Generating circular motion of a human-like robotic arm using attractor selection model,” Journal of Robotics and Mechatronics, vol. 22, no. 3, pp. 315–321, 2010.

A. De Rengerve, S. Boucenna, P. Andry, and P. Gaussier, “Emergent imitative behavior on a robotic arm based on visuo-motor associative memories,” in 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1754–1759, Taipei, Taiwan, October 2010.

A. Nishikawa, K. Taniguchi, M. Sekimoto et al., “Design and control of a compact laparoscope manipulator: a biologically inspired approach,” in Advanced Strategies for Robot Manipulators, S. Ehsan Shafiei, Ed., pp. 365–380, Intech Open, 2010.

S. Ide and A. Nishikawa, “Bio-inspired control of a multi-fingered robot hand with musculoskeletal system,” in Smart Textiles and Their Applications, V. Koncar, Ed., pp. 185–195, Elsevier, 1st edition, 2016.

S. G. Nurzaman, Y. Matsumoto, Y. Nakamura, K. Shirai, S. Koizumi, and H. Ishiguro, “From Lévy to Brownian: a computational model based on biological fluctuation,” PLoS One, vol. 6, no. 2, article e16168, 2011.

K. Matsui, Y. Hishii, K. Maegaki et al., “Equilibrium-point control of human elbow-joint movement under isometric environment by using multichannel functional electrical stimulation,” Frontiers in Neuroscience, vol. 8, p. 164, 2014.

K. Takemura, M. Kurosawa, K. Atsuumi, K. Matsui, F. Miyazaki, and A. Nishikawa, “Frequency domain system identification of human finger dynamics using functional electrical stimulation based on an agonist-antagonist concept,” in Proceedings of the 2017 Annual Conference of the International Functional Electrical Stimulation Society, p. 114, London, UK, July 2017.