The application of memetic algorithms for forearm crutch design: A case study

Product design has normally been performed by teams, each with expertise in a specific discipline such as material, structural, and electrical systems. Traditionally, each team would use its member's experience and knowledge to develop the design sequentially. Collaborative design decisions explore the use of optimization methods to solve the design problem incorporating a number of disciplines simultaneously. It is known that such optimized product design is superior to the design found by optimizing each discipline sequentially due to the fact that it enables the exploitation of the interactions between the disciplines. In this paper, a bi-level decentralized framework based on Memetic Algorithm (MA) is proposed for collaborative design decision making using forearm crutch as the case. Two major decisions are considered: the weight and the strength. We introduce two design agents for each of the decisions. At the system level, one additional agent termed facilitator agent is created. Its main function is to locate the optimal solution for the system objective function which is derived from the Pareto concept. Thus to Pareto optimum for both weight and strength is obtained. It is demonstrated that the proposed model can converge to Pareto solutions.


Introduction
Under collaborative design paradigm, the first common topic is Multidisciplinary Design Optimization MDO which is defined as "an area of research concerned with developing systematic approaches to the design of complex engineering artifacts and systems governed by interacting physical phenomena" 1 .Researchers agree that interdisciplinary coupling in the engineering systems presents challenges in formulating and solving the MDO problems.on local variables and facilitator agent decisions on the whole design space launches.It is demonstrated that a converged Pareto optimum is achieved after a number of iterations for the forearm crutch design which has nonlinear form decision functions.
This paper is organized as follows: the related literature is briefly reviewed in Section 2, followed by the detailed explanation on the proposed bi-level decentralized framework in Section 3. The forearm crutch case is explained in Section 4 with the conclusions being drawn in Section 5.

Literature Review
Collaborative Optimization CO , introduced by Braun and Kroo 2 , is a bi-level optimization approach where a complex problem is hierarchically decomposed along disciplinary boundaries into a number of subproblems which are brought into multidisciplinary agreement by a system level coordination process.With the use of local subspace optimizers each discipline is given complete control over its local design variables subject to its own disciplinary constraints.The system level problem sets up target values for variables from each discipline.Each discipline sets the objectives to minimize the discrepancy between the disciplinary variable values and the target values.The system-level optimization problem is formulated as minimizing a global objective subject to interdisciplinary consistency constraints.The interdisciplinary consistency constraints are equality constraints that match the system-level variables with the disciplinary variables.In Optimization by Linear Decomposition OLD 20-22 , the disciplines are given the autonomous task of minimizing disciplinary design infeasibility while maintaining system-level consistency.The system-level problem is to drive design infeasibility to zero.At the local-level problem the disciplines use their local degrees of freedom to minimize the violation of the disciplinary design constraints, subject to matching the target value for the disciplinary output that is fed into the discipline.Balling et al. 23 introduce a combination of CO and OLD where the disciplinary subproblems minimize the discrepancy in the system-level targets as well as the disciplinary design infeasibility given the disciplinary design constraints.
Both CO and OLD depend on a design problem's amenability to hierarchical decomposition with the system objective explicitly defined.On the other hand, concurrent Subspace optimization CSSO 21 is a nonhierarchic system optimization algorithm that optimizes decomposed subspaces concurrently, followed by a coordination procedure for directing system problem convergence and resolving subspace conflicts.In CSSO, each subspace optimization is a system level problem with respect to the subset of the total system design variables.Within the subspace optimization, the nonlocal variables that are required to evaluate the objective and the constraint functions are approximated using global sensitivity equations GSE .Interested readers please refer to 21 , for detailed description of GSEs.
The bi-level integrated synthesis BLISS 24 method uses a gradient-guided path to reach the improved system design, alternating between the set of modular design spaces the disciplinary problems and the system level design space.BLISS is an all-in-one-like method in that the complete system analysis is performed to maintain multidisciplinary feasibility at the beginning of each cycle of the path.The overall problem is decomposed such that a set of local optimization problems deal with the detailed local variables which are large in number and one system level optimization problem deals with a small number of global variables.
Decision-based design 9-11, 25 is a paradigm focusing on distributed and collaborative design efforts.For the cases where continuous variables are used, adaptive linear programming 17 is employed; in case of mixed discrete and continuous variables, Foraging-directed adaptive linear programming has been used 17 .In a noncooperative environment, game theoretic principles are used to arrive at the best overall design 16, 17 .Recently, Design-for-Market system grows out of the decision-based Design and emerges as an area focusing on establishing a solid basis in decision theory, by taking microeconomics into account, to support engineering design.Kumar et al. 26 propose a hierarchical choice model based on discrete choice analysis to manage and analyze customer preference data in setting design targets.Azarm's group studies new product designs that are robust from two perspectives-from the engineering perspective in terms of accounting for uncertain parameters and from the market perspective in terms of accounting for variability in customer preferences measurement 27 .They conclude incorporating consumer heterogeneity in considering the variability in customer preferences may have significant impact on the ultimate design.Research led by Michalek explores the use of gametheoretic approach to finding market equilibrium under various regulation scenarios 28 .A metric for agility measurement is introduced by Seiger et al. 29 to explore the product development for mass customization.
In general, some common criticisms and/or challenges facing collaborative design decisions are the convergence and information sharing issues: i Will the decision model converge?If yes, under what condition (assumptions on the function form and design spaces) will it converge?How fast will it converge?
ii Most models (CO, OLD, BLISS, etc.) take a top-down approach with the full knowledge of the design space (e.g., the form of utility functions, constraints) being available.

For the cases when the design information is partially known, what decision model is appropriate?
To address these challenges, we propose a general decision framework based on MA that allows distributed design teams to arrive at Pareto solutions which is in detail explained in the next section.

Memetic Algorithm and Its Application to Collaborative Design
Memetic algorithm MA is one of the emerging areas in evolutionary computation.It integrates genetic algorithm GA with local search LS to improve the efficiency of searching complex spaces.In MA, GA is used for global exploration while LS is employed for local exploitation.The complementary nature of GA and LS makes MA an attractive approach for large-scale, complex problems, for example, collaborative design.

Proposed Framework for Collaborative Design
Let us consider a general collaborative design with N design teams.The problem can be represented as x is the set of n 1 local variables, y is the set of n 2 coupled variables, g is the set of m 1 local constraints, and h is the set of m 2 coupled constraints.
Figure 1 illustrates the iterative decision process between system facilitator agent and disciplinary design agents.First, the facilitator initializes the global solution space over both local and coupled variables.For any solution, for example, x * , y * , each design agent will execute local optimizer over the subdesign space which consists of x only, that is Min J x, y * given y y * .The results fed back to the facilitator are the values of objective function and the gradient of objective function over coupled variables.The facilitator will employ local search for the recent results updated by each designer using the related gradient information for the improved design; next, traditional GA operators, crossover, and mutation are applied to introduce new candidates to the solution space.

Pseudocode
Parameters N: no. of disciplinary design agents; w i : weight for the objective function of ith disciplinary design agent, where i 1, . . ., N; 1/W: weight step size; P : population size; As shown in Pseudocode, there exist three loops, from outer to inner in the proposed method: weight enumeration lines 11-37 , GA loop lines 13-37 , and local search loop lines 24-28 .That is, given a weights combination e.g., w 1 0.3, w 2 0.7 for two agents , GA is triggered which applies crossover and mutation operators and selection mechanism in this case study, elitism selection is employed for the population update.In addition, for the updated population, local search is further employed to identify improved solutions within the neighborhood.This is achieved by having subgradient information from each designer on the coupled variables fed back to the facilitator.Specifically, given any chromosome from the population, each design agent assumes the coupled variables are set and thus conducts optimization on the local variables only.Each design agents would also study the gradients on the coupled variables.Thus, given the values of the coupled variables, both the optimal design on local variables and the subgradient on the coupled variables are sent back to the facilitator.Since the priorities of the objective functions reflected by the weight assignments are enumerated exhaustively, all the possible Pareto solutions are located forming the Pareto frontier.In some cases where the priority is known, the weight loop can be removed.Please note that the Pareto filter operation lines 29-36 is triggered by the facilitator within each weight combination.That is, it is possible that some Pareto solutions given a specific weight may be dominated by the Pareto solutions obtained with other weights.One distinguishable feature of this proposed approach from other existing methods is that the information exchanged iteratively between the facilitator and the design agent is point values instead of function forms.For example, passing from the facilitator to the design agent top-down is the values of the coupled variable; passing from the design agent back to the facilitator bottom-up is the values of the objective function and associated gradient values.Thus, one main advantage of this approach is that a "black box" disciplinary optimizer can be easily plugged in.Secondly, the facilitator explores the solution space based on the solution candidates x * , y * and the performance candidates J * only without knowing the function formulation.This enables a truly decentralized decision to be reached in that no full knowledge of the design space is required.
In the next section, an industry case is explored to demonstrate the applicability of the proposed framework.

Forearm Crutch Design
Crutches are mobility aids used to counter mobility impairment or an injury that limits walking ability.Forearm crutches are used by slipping the arm into a cuff and holding the grip Figure 2 .It has been increasingly used for patients with shorter-term needs.Earlier study conducted by National Medical Expenditure Survey NMHS in 1987 indicates that an estimated 9.5 million 4% noninstitutionalized US civilians experience difficulty in performing basic life activities; some need crutches for leg support for walking.This number increases due to the baby boomer effect.

Mathematical Problems in Engineering
Typical forearm crutches are made of aluminum and are criticized by customers for being heavy, noisy, and less durable.Customers suggest that a small reduction in the weight of forearm crutches would significantly reduce the fatigue experienced by crutch users.However, the reduction in weight should not be accompanied by a strength reduction.Most crutches on the market are designed for temporary use and wear out quickly.Crutch users commonly have to replace their crutches two to three times a year.This drives the need to redesign forearm crutches which are robust, appropriate for a wide range of users from lighter weight adults to users weighing up to 250 pounds with considerable upper body strength and who may use them aggressively on a continuous basis.
One solution is to use composite material for crutch which is light weight with good performance in strength.However, it comes with relatively expensive cost.After indepth marketing survey, the design team decides to outsource the aluminum union fitting component no. 4 in Figure 2 , use appropriate composite tube and apply adhesive from Hysol to bond the tubes with union fitting.

Aluminum Union
The design team first develops a computer model based on finite element method to determine the necessary wall thickness and to calculate the load on the handle necessary to produce yielding.An aluminum union which costs $150 and stands ≥630 lbs is used.The use of Hysol adhesive to bond the union with the tube needs to be tested to ensure that the strength requirement is satisfied.

Composite Tube
A typical composite tube is 39" in length.The tube can be cut into smaller pieces for the forearm crutch assembly.Approximately 2.5 tubes are needed to make a pair of crutches.Here, three smaller tubes are used as: handle component no. 5 in Figure 2 which is fixed as 4.75 inch, arm support tube component no. 8 in Figure 2 which usually ranges from 6.5 to 7.8 inch, and main tube component no. 3 in Figure 2 which ranges from 30.6875 to 34.25 inch.The inner diameter of the tube is critical to maintain the proper bondline thickness for each adhesive joint.It ranges from 0.7605 to 0.7735 inch.The outer diameter is determined by the number of plies, and it ranges from 0.922 to 0.935 inch.Usually, the arm support tube is less concerned with strength, the main tube needs to be tested for the strength consideration.
Thus, we have two decision problems constructed: weight and strength.

Design Agent for Weight Decision
In this research, we focus on the weights of the tubes arm support tube-component no. 8 and main tube-component no. 3 and a minimization problem is introduced as: where W u lb is the weight of arm support tube, W L lb is the weight of main tube, ρ Lb/inch 3 is the density of the composite tube, which is 0.08 in this paper, L u inch is the length of the arm support tube, L L inch is the length of the main tube, D o inch is the outer diameter, D i inch is the inner diameter and T mils, 1 mils 0.001 inch is the bondline adhesive material thickness.

Design Agent for Strength Decision
Since the strength from aluminum fitting is satisfactory from finite element analysis FEM , the strength model will consider two potential failures: the adhesive applied joint, and the strength of the main tube.Thus, the problem is constructed as: Max: S Min S L , S A , where S L lbs is the strength of the bottom of the lower tube, E msi, 1 msi 10 6 psi is the modulus of elasticity, I inch 4 is the area moment of inertia and S A lbs is the strength of the joint after applying adhesive.

Implementation
For the decision problems explained above, optimization code written in Matlab is executed.
Here, we provide detailed explanation how the system problem is constructed and how the facilitator agent guides the design agents to converge to the solution using MA.
Step 1 initialization .Given w 1 , w 2 , construct system search space as w 1 W * − w 2 S * W * and S * are the values of the objectives from each design agent, w 1 w 2 1 .
Step 2 real code genetic algorithm .The chromosome is represented with real numbers, that is , T are coupled variables, L u is the local variable for weight agent and E is the local variable for strength agent.
Substep 2.1 initial population .For L u , L L , D o , D i , T , E , without losing of generalization, let assume that a and b represent the lower bound and upper bound of one of the variables and let r be a random number r ∈ 0, 1 , we get b − a r a.Thus, a new chromosome is generated as for the initial population.A pool of 40 chromosomes is created.

Substep 2.2 selection of parents .
To ensure all chromosomes have the chances to be selected, solutions are classified into three groups according to their fitness: high fitness level, medium fitness level and low fitness level.The fitness is assessed based on w 1 W * − w 2 S * , the lower, the better. 2 , the offspring are generated as: where θ ∈ 0, 1 .
Substep 2.4 mutation .Mutation is applied by simply generating a new feasible solution to replace the infeasible one.
Step 3 local search .The facilitator agent applies subgradient method-based LS over coupled variables to improve the solutions.First, each design agent evaluates the gradients of the design decision problems disciplinary w.r.t the coupled variables.For example, given the coupled variables , each decision problem is solved independently for W * and S * .The gradients are obtained as Mathematical Problems in Engineering 11 The gradients of the system problem are then calculated as where step size α k satisfies:

4.7
The coupled variables are updated based on the above subgradient method until no further improvement of the weighted system problem is required.

Results and Analysis
The Pareto frontier obtained by the proposed decentralized framework is shown in Figure 3. Please note the problem has Min-Max structure.Since this project focuses on the composite tube design arm support tube-component no. 8 and main tube-component no. 3 , the weight for the handle tube component no. 5 is computed as Other components in Figure 2 are outsourced with the weights summarized in Table 1.
We choose two Pareto solutions A and B to compare with the composite crutch from Ergonomics and the Invacare crutch which are two commercial products in Table 2. Apparently, most composite crutches outperform Ergonomics and Invacare for both weight and strength except Design B which outweighs Ergonomics by 0.0945 lb.However, Design B is much durable with strength being 1107 lbs comparing to 715 lbs of Ergonomics.Furthermore, game theoretical approaches including Nash equilibrium, Leader/ Follower games and Complete Control games are applied to the same problem for comparison study.In the game approaches, the weight design agent will control design variables L u , L L , D o and D i , and design variables T and E are controlled by strength design agent.All the game theoretical solutions are demonstrated in Figure 3.As shown in Figure 3, solutions generally obtained from game theoretical approaches are not Pareto optimal only the Nash equilibrium solution C and one solution D from the Leader/Follower game are on the frontier .
It is expected that the cost of the composite crutch will be high.In this case, it is around $460 in total tube and other components shown in Figure 2 .The crutch produced by Invacare and Ergonomics price range is $60 to $250.Although the composite crutch is several times expensive, it lasts much longer.Instead of having replacement two to three times a year, it can be used for a number of years since the lighter composite crutch could sustain greater than 1100 pounds load.

Conclusion
Collaborative design decisions involve designers from different discipline with different specific domain knowledge.The decision process is a sequence of phases or activities where mathematical modeling can employ.In this paper, a bi-level distributed framework based on Memetic Algorithm MA is proposed.Since the information communicated is neither the form of the decision function nor the decision space, private information is protected.In addition, in the cases where the information is not complete, the proposed framework can still guarantee the convergence to Pareto solutions.To demonstrate the applicability of the framework, a forearm crutch design is studied in details.The results confirm that converged Pareto set can be obtained for any form of decision function.While promising, the decision problem constructed is deterministic, our next step is to explore the use of this framework for design decisions under uncertainty.Computational efficient approach in the area of reliability-based design optimization would be explored.

Figure 2 :
Figure 2: Exploded view of a forearm crutch.

Figure 3 :
Figure 3: Pareto frontier in performance space for the crutch design.
Let eachw i i 1, . .., N − 1 increases 1/W, w N 1 − w 1 − • • • w N−1 ,and add w 1 , w 2 , . . ., w N to WS; //Weights Loop For each weights combination w 1 , w 2 , . . ., w N in WS, N For each chromosome p j in the set PS; If p j is not dominated by all the solutions in the set FP ; Add p j to the set FP ; Else If there are solutions in the set FP are dominated by p j ; Remove those solutions in the set FP; Generate random population of P solutions and add them to PS; For n 1 to maximum # of generations for GA loop; //Crossover and Mutation Random select two parents p a and p b from PS; Generate two offspring p a and p b by crossover operator; if p a and/or p b are not feasible, generate new feasible offspring p a and/or p b using mutation operator; //Selection Using fitness function N i 1 w i J i x i , y to evaluate the solution, update PS with improved solutions; //Local Search Loop For each chromosome p j in PS; Call each Design Agent for local optimization on x note different optimization engines can be employed based on the design disciplines ; Given updates from Design Agent on x, Facilitator agent employs sub-gradient algorithm 19 as local search algorithm to iteratively locate improved solution p j with respect to y; Next p j ; //Pareto Filter: , λ D i , λ T the facilitator agent employs nonsummable diminishing method to update the coupled variables.That is, at iteration k 1, o

Table 1 :
Weights for each component of the crutch.

Table 2 :
Comparison of crutch weight and strength.