The Bidirectional Optimization of Carbon Fiber Production by Neural Network with a GA-IPSO Hybrid Algorithm

A hybrid approach of genetic algorithm (GA) and improved particle swarm optimization (IPSO) is proposed to construct the radial basis function neural network (RNN) for real-time optimizing of the carbon fiber manufacture process. For the three-layer RNN, we adopt the nearest neighbor-clustering algorithm to determine the neurons number of the hidden layer. When the appropriate network structure is fixed, we present the GA-IPSO algorithm to tune the parameters of the network, which means the center and the width of the node in the hidden layer and the weight of output layer. We introduce a penalty factor to adjust the velocity and position of the particles to expedite convergence of the PSO.TheGA is used tomutate the particles to escape local optimum.Thenwe employ this network to develop the bidirectional optimizationmodel: in one direction, we take production parameters as input and properties indices as output; in this case, the model is a carbon fiber product performance prediction system; in the other direction, we take properties indices as input and production parameters as output, and at this situation, the model is a production scheme design tool for novel style carbon fiber. Based on the experimental data, the proposed model is compared to the conventional RBF network and basic PSO method; the research results show its validity and the advantages in dealing with optimization problems.


Introduction
Carbon fiber is a novel breed of ideal engineering materials which has high strength and modulus; hence, it has great influence on aspects of military, industry, economy, and so on.Due to its high strength, high break strength, high modulus, small diameter, low density, maximum crystallinity, and low comonomer contents, polyacrylonitrile-(PAN-) based carbon fiber dominates the market and the optimization of its manufacture process receives increasing attention from scholars and researchers in recent years [1].Most research groups have been working on the post spinning process, which means improving the properties of carbon fiber by gas adsorption application or water treatments [2].Liu et al. [3] investigated electrochemical oxidation treatment of PANbased carbon fibers by some instruments such as scanning electron microscopy (SEM) and X-ray diffraction (XRD), gave out the guidance when properties interfacial bonding strength and tensile strength were improved simultaneously.
Wang and Yin [4] discussed how the chemical element potassium permanganate (KMnO 4 ) modified properties of PAN fibers during heat treatment process by lab instruments.Rahman et al. [5] investigated the effects of residence time in the solvent-free coagulation bath on the formation and mechanical properties of PAN fibers.Liang et al. [6] proposed a bioinspired multilayered intelligent cooperative controller for stretching process of fiber production.From the above, we know that they always analyze properties by drawing support from physical or chemical instruments [7][8][9], consider relationship between production parameters and fiber properties rarely.On one hand, researchers in materials science are based on different entry point with engineering scholars, which leads to this situation.On the other hand, the production process of carbon fiber is a complex system, it contains the following steps: dissolution, computation, off single deaeration, filtration, spinneret, coagulating bath, washing, apply oil, drying, high temperature draft, heat setting, drying, and winding.These procedures can be viewed as  subsystems, every of which has its own control factors.These factors affect and restrict the whole system's development and evolution, whereas they are not only influenced by external environment but also by the internal coupling phenomenon between subsystems.Consequently, it is difficult to build a mathematical model to describe the relationship between production parameters and properties indices linearly, or just connect the relational expressions of every subsystem simply.With spring up of computational intelligent methods, they have provided a powerful tool to approximate the functional form of an unknown complex nonlinear system.Among them, since its extremely strong adaptive capabilities in response to nonlinear behaviors, artificial neural network (ANN) have been presented to deal with modeling dynamic process for product and process design, monitoring, and control.Kadi [10] adopted the ANN to estimate the performance of the fiber-reinforced composites.Yu et al. [11] introduced a novel ANN to conduct the fabric selection among different fabric specimen with a reasonable rule set.However, topology of ANN is not compact enough which leads to more training time for learning.Then radial basis function (RBF) neural network (RNN) rises in artificial intelligence filed.Some researchers investigated RNN from aspects of center selection, learning theory, boundary value  constrains, and function approximation [12][13][14][15].Because of its robustness and fast training rate, RNN becomes the most suitable choice for real-time signal processing of an unknown nonlinear dynamical system.Qiao and Han [16] proposed a self-organizing RNN to model and identify nonlinear dynamical systems.Wang and Liu [17] presented a self-correcting RNN-based forecasting method for adapting changing conditions.
As we all known, every single algorithm has its own shortcomings which are difficult to overcome by improving itself.In that case, combining several artificial intelligence (AI) approaches is a new study trend in recent years.They can fully promote their respective superiorities while avoid their respective defects to enhance their optimizing effects.In the literatures, particle swarm optimization (PSO) is a popular algorithm because of its easy implementation procedure and high performance.Hu et al. [18] proposed an immune cooperative PSO algorithm for fault-tolerant routing optimization in heterogeneous wireless sensor networks.Alfi [19] introduced an adaptive mutation mechanism and a dynamic inertia weight to the PSO to estimate the unknown parameters in nonlinear systems.Behrang et al. [20] used the PSO to predict monthly average daily global solar radiation on horizontal surface for different regions of Iran.Mahor and Rangnekar [21] presented a PSO with self-adaptive inertia weight to determine the optimal short-term generation schedule of real operated cascaded hydroelectric system located at Narmada river in Madhya Pradesh, India.Tang et al. [22] proposed a novel PSO combined with a modified simulated binary crossover (MSBX).Luitel and Venayagamoorthy [23] combined quantum principles to the PSO and neural networks to optimize multiple-input-multiple-output learning systems.Vasumathi and Moorthi [24] added the PSO to adaptive neural network for harmonic isolation and reduction.Oh et al. [25] designed a polynomial RNN which optimized by the PSO for handling high-dimensional pattern classification problems.Huang and Wang [26] combined orthogonal least squares and enhanced PSO to RNN for realtime power dispatch of practical Taiwan Power Company systems.Li and Liu [27] proposed a hybrid algorithm with modified PSO, simulated annealing, and RNN to predict the product specifications melt index.
In this paper, we propose a neural network model with a GA-IPSO hybrid algorithm for bidirectional optimization of PAN-based carbon fiber.We use the nearest neighborclustering algorithm (NNCA) to decide the hidden layer nodes number of neural network, the GA-IPSO hybrid algorithm is used to tune the parameters in the network.By this model, for one direction, we predict the carbon fiber properties; for the other direction, we obtain produce scheme for new type carbon fiber.
The main contributions of this paper are as follows: (1) we propose a novel GA-IPSO hybrid algorithm to neural network, which pushes forward the development of AI; (2) by the proposed model, we can online monitor and control manufacture process of carbon fiber, forecast the product properties in real time, adjust produce parameters in time; (3) also, we can give out a reference produce scheme for new type carbon fiber which meets expect product properties, guides practical manufacture process, and prevents wasting time and money for putting into production directly.
The rest of this paper is organized as follows.In Section 2, the meaning and means of bidirectional optimization of PAN-based carbon fiber production is briefly reviewed.Section 3 describes the proposed optimization algorithm.In Section 4, practical test results of the proposed method by employing actual production and experiment data are illustrated.Comparisons with the other methods are also included.Conclusions are given in Section 5.

The Carbon Fiber Production and Its Bidirectional Optimization
As described in introduction, the production process of PANbased carbon fiber is a typical unknown nonlinear dynamical complex system.It is a key investigation field to keep the properties of carbon fiber stable and improve the properties as possible as we can.For this reason, we should monitor the production process of carbon fiber, observe producing parameters in real-time, accurately predict product properties online, then we can find out defects of carbon fiber ahead of time, adjust produce parameters in time, avoid generating carbon fiber of poor quality, and prevent wasting of production materials.Designing new types carbon fiber with superior properties is another urgent task for engineers and scholars.In the past, we always make a production scheme of new type carbon fiber through former experiences, then we produce this kind of carbon fiber according to the proposed experiential scheme by testing production line.After obtaining carbon fiber from the practical experiment, we put the carbon fiber to physical and chemical instruments to test its property indices, compare these indices to expect value, get the disparity, adjust several produce parameters in proposed scheme, produce carbon fiber according to adjusted scheme by testing production line again, repeat executing produce, test, and adjust process until we gain the carbon fiber which is satisfactory to us.This method wastes time, energy, and cost.The most terrible thing is that, if we do not choose the appropriate parameters of control devices, it will result in oscillation and unstability of the whole system, which brings in severe loss.Therefore, it is a better choice to carry out computer simulation, analyze and synthesize all the antecedent produce schemes, avoid one-sided decision made by workers from their personal experience and interests, and give out a more scientific and proper control parameters from an optimal production scheme.
In this paper, we propose a bidirectional optimization model of carbon fiber production process based on RNN.We adopt the nearest neighbor-clustering algorithm to select a suitable set of centers of the network and introduce a GA-IPSO hybrid algorithm to tune the parameters of the network.When we take production parameters as input and properties indices as output, this model can monitor production parameters in real time and predict properties indices online.When we take properties indices as input and production parameters as output, this model can be viewed as a designer of developing new type carbon fiber.All these bidirectional optimization functions are as shown in Figure 1.

The GA-IPSO Hybrid Algorithm for
Neural Network

RBF Neural Network.
The RNN is a typical supervised learning feed-forward neural network which is put forward by Moody and Darken in 1989 [28].It is a three-layer network composed of input layer, hidden layer, and output layer.The input layer just receives and transforms input signal to hidden layer; the hidden layer adapts radial basis functions as activation function; the output layer always gives the final responses through simple linear functions.
The common radial basis functions are listed as follows: As Gaussian function is the outstanding representative among them, we use it as activation function of hidden layer in this paper: where   is the output of node  in hidden layer,   = ( 1 ,  2 , . . .,    )  is the input vector,   is the number of input nodes,   is the th center node in the hidden layer,   is the width of the th center node,  ℎ is the number of hidden nodes, and ‖ ⋅ ‖ denotes Euclidean distance.The output is formed by a linear combination of the hidden layer responses where   = ( 1 ,  2 , . . .,   ℎ − )  represents the linking weight of the node in hidden layer and the node in output layer,  = ( 1 ,  2 , . . .,   ℎ , 1)  ,   is the number of output nodes.
First of all, we should confirm the structure of RNN, the number of input nodes   , and the number of output nodes   are decided by production parameters and product properties indices, respectively, according to their optimization directions.The crux is fixing the number of hidden nodes  ℎ . ℎ influences the capability of network directly.If the network structure is redundant, it will occupy mass software and hardware while training and testing, even leads to the network over fit, obtains excellent performance when it is training while shows horrible results during testing.If the network structure is too small, the network cannot stand for global information.At present, there is not a uniform method to determine  ℎ .Generally,  ℎ is selected by trail and error referring to experience expression given by In this work, we adopt the nearest neighbor-clustering algorithm to acquire  ℎ .The NNCA is firstly presented in 1973 [29].This algorithm is an online self-adaption cluster algorithm, and it does not need to fix  ℎ first.It collects data, constructs structure, and trains network at the same time, which is called online learning.It displays as a gradual increase method, which starts from a simple network and gradually increases the number of hidden nodes until it fulfills the purpose.While clustering is finished, the optimal network is formed.The nearest neighbor-clustering algorithm can be shown in Figure 2.
The specific procedures of the nearest neighborclustering algorithm are shown below.
Step 1. Choose a proper width  of Gaussian function, here it means , define a vector A() to store the sum of output vectors of each class, and also define a counter B() to calculate the numbers of samples belong to each class, in which  means how many classes there exist.
Step 2. Begin from the first sample ( 1 ,  1 ), set up  1 as the first cluster center, sign it as follows:  1 =  1 , (1) =  1 , (1) = 1.At this time, an original RNN is formed.So far, this RNN includes only one node in hidden layer,  1 is the center of this node, the weight vector from this node to output layer is  1 = (1)/(1).
Step 5. Do Step 4 again and again until the last sample has been regarded, finish it.
After executing the nearest neighbor-clustering algorithm, we obtain the number of centers and the parameters of RNN which means the position and width of centers, weights from hidden nodes to output nodes at the same time.However, in this paper, we just use the nearest neighborclustering algorithm to determine the number of hidden nodes, which is the number of centers.We will tune the position and width of centers, weights from hidden nodes to output nodes by proposed GA-IPSO which is described in Section 3.2.But the parameters of RNN we gained from the nearest neighbor-clustering algorithm will be taken as initial particle swarm range.

GA-IPSO Hybrid Algorithm
3.2.1.Basic PSO Algorithm.PSO algorithm is an efficient population-based stochastic optimization technique inspired by social behavior of bird flocks or fish schools which is originally developed by Kennedy and Eberhart in 1995 [30].Since PSO requires short computer time and less memory, it has been successfully applied to a wide range of optimization applications.
The principle of PSO: for a -dimension problem, it maintains a population of particles distribute uniformly around a -dimension search space at first.Suppose the size of the swarm is , the population is represented as  = ( 1 ,  2 , . . .,   )  .Each particle in this population indicates a potential solution to the problem.A particle is recorded from two aspects of its position and velocity: the position is represented as   = ( 1 ,  2 , . . .,   ), and the velocity is represented as V  = (V 1 , V 2 , . . ., V  ).The position is associated with the fitness.The best fitness the particle has achieved is considered as its current best position, marked it as   = ( 1 ,  2 , . . .,   ).The best position in the whole population is recorded as   = ( 1 ,  2 , . . .,   ).In every generation, each particle updates its status in light of three criterion: (1) its own inertia; (2) the cognitive information   ; (3) the social information   .These particles in the population tend to cluster together by updating their status until the optimum solution is obtained at last.
For the  iteration, the velocity and position of each particle are updated in the following manner: where  is the inertia weight, which decides influence on the next generation of the particle current velocity. 1 and  2 are acceleration constants, called the cognitive and social parameter, respectively. 1 and  2 are uniform random numbers between 0 and 1.  Commonly,  1 =  2 = 2.05,  max = 0.9,  min = 0.4, for  is the maximal number of iterations,  of every iteration is calculated according to: 3.2.2.GA-IPSO Hybrid Algorithm.Furthermore, although PSO has good convergent property, if the initial population of particles cannot effectively cover the whole region, the population diversity will be greatly reduced after some iterations, as such the particles will converge easily to a local optimum.Aim to avoid the limitations and enhance the superiorities, due to the fact that PSO utilizes ,   and   , to modify the current search point to prevent the particles flying in the same direction; in this paper, we employ dynamic-adjust  and introduce a penalty factor ( 1 ,  2 ) for coordinating the guides of   , and   .In that case, the formulas ( 7) can be rewritten as (1) Particle and Its Fitness.The parameters of RNN needed to be tuned are positions and widths of hidden centers, weights between hidden layer and output layer.A group of parameters is a particle.Since numbers of input, hidden, output layer are   ,  ℎ ,   , the dimension of a particle is given by Mark the output of RNN as , the expect output as ŷ.The goal is to minimize the error between  and ŷ.So the fitness function of particles is given by (2) Dynamic-Adjust Inertia Weight .Inertia weight  expresses the search length of the PSO.When  is a large value, it is good for global optimum search owing to the fact that it can easily get out of local optimum; when  is a small value, it is good for local optimum search and accelerate convergence.Although  in formula ( 9) is not a constant, it cannot be called dynamic-adjust, it is just a kind of linear decrease.The linear decrease method has weak inspire ability of search direction though it is convenient to realize.Here, we dynamically adjust  based on the change of the smoothness [31] of the object function.The definition of smoothness is shown below: where (   ) is the fitness value of the th particle on iteration , (  min  ) is the fitness value of the best particle on iteration , and these are expressed below: On every iteration,  changes with   like: When   −  −1 > 0, it indicates this iteration is emanative, the search step length should be decreased for precisely search in range around extremum; when   −  −1 < 0, it indicates this iteration is convergent, the search step length should be increased for accelerating search for extremum.
(3) Cognitive Parameter  1 and Social Parameter  2 .In GA-IPSO, we also change cognitive parameter  1 and social parameter  2 linearly as follows: (4) Penalty Factor ( 1 ,  2 ).After calculating recent fitness of a particle on each iteration, we change the position of the particle a little, then calculate the fitness of the new position.
If the new fitness is smaller than the resent fitness, it means the currents   and   cannot give out direction guidance precisely, then we compare the new fitness to the best fitness of this particle and the best fitness of the best particle in the population, respectively, to check out which one shows a bad answer.When the new fitness is smaller than the best fitness of this particle, it means the best position of this particle does not affect search direction correctly, then its influence should be decreased as a penalty, on the contrast, the cognitive influence should be increase.The mechanism is the same to the social influence expressed by the best position of the best particle in the population.The mathematical expression is showed below: Viscosity average molecular weight ( 10 12 Mathematical Problems in Engineering (5) The GA-IPSO.With the iteration increasing, the population diversity will be reduced.Sometimes stagnation happens, it displays that V is almost zero.For GA is famous for its cross and mutation operations, it can produce new particles, rebirth the whole population, and escape from the above terrible situation.So, we combine GA to the IPSO, and adopt   and   to execute cross and mutation operations, which means the new particles keeping the advantage of being guided by currents   and   .The mechanism is showed below: cross mutation where  is a cross-coefficient between 0 and 1, formula (20) is used to select which dimension will be mutation, ⌊⌋ indicates getting an integer downward.The flowchart of GA-IPSO is indicated in Figure 3.
The specific procedures of the GA-IPSO are shown below.
Step 2. Initiate the particle swarm according to the range given by the nearest neighbor-clustering algorithm.
Step 3. Calculate the fitness of each particle in the population.
Step 4. Set up   and   of the first iteration.
Step 5. Set up   and V  of each particle for next iteration.
Step 7. Calculate the fitness of each particle in the new population.
Step 9. Change the position of each particle in this population a little, calculate the new fitness, and update  1 1 and  1 2 according to formula (18).
Step 12. Do Step 6∼Step 12 until fitness satisfies the error goal or  reaches .

Data Preparation.
Aiming to test and demonstrate the performance of the model we proposed, we used these data collected and organized from experiments in Table 1.In these data, viscosity average molecular weight, conversion ratio, solid content, spinning jet drawing ratio, coagulating bath temperature and total drawing ratio are production parameters, strength, and structure parameters are property indices.These specific production parameters and property indices can relatively fully represent the whole manufacture process and product performance of PAN-based carbon fiber.In the bidirectional optimization process, we take the first 45 groups of samples as training dataset and the last 5 groups of samples as test dataset.We also make comparison between conventional RNN, basic PSO-RNN, and the proposed method, observe their performance in different ways which are defined as the following, respectively: mean absolute error: mean relative error: root mean square error: Theil's Inequality Coefficient:  2, an initial RNN model is developed.We consider the range of initial swarm for both proposed method and basic PSO-RNN by referencing Table 2.We set  1 =  1 1 =  1 2 = 0.5,  1 min =  2 min = 0.4,  1 max =  2 max = 0.9,  = 0.3, error goal = 0.01, maximum iteration  is 5000, swarm size is 20 for proposed method in this paper, set  min = 0.4,  max = 0.9 for basic PSO-RNN, and the other parameters of the basic PSO-RNN are agreed with the proposed method.
By employing the proposed GA-IPSO algorithm to optimize the parameters of RNN, we gain the best parameters for the RNN.The training accuracy and the agreement level of the proposed method are shown in Figure 4.
From Figure 4, the prediction values of training dataset have a high level of agreement with the actual data, it can be seen directly that the proposed model has an accuracy and good tracking performance which reflects the model's outstanding universality.The model's prediction accuracy also can be reflected from its performance on the test dataset.We show the prediction results of the test dataset of the proposed method, basic PSO-RNN and conventional RNN in Figure 5 to compare their performance.It can be seen obviously that the curve of the proposed GA-IPSO-RNN model is most closed to the actual data curve, which reveals it has the best prediction accuracy and reliability among the three models.The basic PSO-RNN displays worse performance, and the conventional RNN is the worst one with big errors.The detailed numeral comparison of MAE, MRE, RMSE, and TIC is also listed in Table 3.
From data in Table 3, we can see that in terms of MAE, the proposed GA-IPSO-RNN achieves with a decrease of approximately 50.61% and 3.95% compared to the other two models, respectively.The same information can be obtained from the other items such as MRE with a decrease of 58.66% and 7.36%, RMSE with a decrease of 54.33% and 6.77%, and TIC with a decrease of 51.16% and 5.65%.Similar results are observed in terms of strength and structure parameter.For strength, MAE with a decrease of 64.37% and 11.62%, MRE with a decrease of 67.20% and 11.83%, RMSE with a decrease of 65.26% and 11.71%, and TIC with a decrease of 63.64% and 11.74%.For structure parameter, MAE with a decrease of 46.15% and 2.12%, MRE with a decrease of 49.89% and 4.11%, RMSE with a decrease of 53.32% and 6.45%, and TIC with a decrease of 49.93% and 5.09%.The MAE, MRE, and RMSE of both total and items confirm the prediction accuracy of the proposed method.TIC of both total and items indicates a good level of agreement between the proposed method and the studied process.And the proposed method costs the shortest run time, demonstrates its excellent convergence speed.

Production Scheme Designer of New Type Carbon Fiber.
For production scheme designer, the properties indices are  4, an initial RNN model is developed.We consider the range of initial swarm for both proposed method and basic PSO-RNN by referencing Table 4.We set  1 =  1 1 =  1 2 = 0.5,  1 min =  2 min = 0.4,  1 max =  2 max = 0.9,  = 0.3, error goal = 0.01, maximum iteration  is 5000, swarm size is 20 for proposed method, set  min = 0.4,  max = 0.9 for basic PSO-RNN, and the other parameters of the basic PSO-RNN are agreed with the proposed method.
By employing the proposed GA-IPSO algorithm to optimize the parameters of the RNN and gain the best parameters.The training accuracy and the agreement level of the proposed method are shown in Figure 6.From Figure 6, the prediction values of training dataset have a high level of agreement with the actual data, it can be seen directly that the proposed model has an accuracy and good tracking performance which reflect the model's outstanding universality.
The model's prediction accuracy can also be reflected from its performance on the test dataset.We show the prediction results of the test dataset of the proposed method, basic PSO-RNN and conventional RNN in Figure 7 to compare their performance.It can be seen obviously that the curve of the proposed GA-IPSO-RNN model is most closed to the actual data curve, which reveals it has the best prediction accuracy and reliability among the three models.The conventional RNN displays the worst performance, and we just compare the proposed method and the basic PSO-RNN as shown in Figure 8.The detailed comparison of MAE, MRE, RMSE, and TIC is also listed in Table 5.
From data in Table 5, we can see that in terms of MAE, the proposed GA-IPSO-RNN achieve, with a decrease of approximately 98.59% and 13.71% compared to the other two models, respectively.The same information can be obtained from the other items such as MRE with a decrease of 98.61% and 19.75%, RMSE with a decrease of 99.34% and 11.20%, and TIC with a decrease of 93.41% and 10.79%.Similar results are observed in terms of viscosity average molecular weight, conversion ratio, solid content, spinning jet drawing ratio, coagulating bath temperature, and total drawing ratio.The MAE, MRE, and RMSE of both total and items confirm the prediction accuracy of the proposed method.TIC of both total and items indicates a good level of agreement between the proposed method and the studied process.As the curves shown in Figure 7, the data list in Table 5 also indicates quite unacceptable errors of conventional RNN, and it verifies the proposed method's effective optimization of RNN's parameters indirectly.And the proposed model costs the shortest run time and demonstrates its excellent convergence.

Conclusions
In this paper, we present a model for using an enhanced RNN to bidirectionally optimize the production process of PAN-based carbon fiber, which can be viewed as properties prediction and new type fiber designer.We adopt the nearest neighbor-clustering algorithm to simplify the structure of RNN and investigate the learning method of the RNN based on the PSO, introduce penalty factor to improve the PSO, then combine GA with the improved PSO to train the RNN.Meanwhile, we compare the GA-IPSO-RNN model to the existing basic PSO-RNN and conventional RNN.The superiority of the proposed model is summarized as below.
(1) Compare with the conventional RNN, the proposed method adopts the nearest neighbor-clustering algorithm to determine the number of hidden notes and provides an effective approach to simplify the network structure.For carbon fiber production process optimization, it can add new samples online, composite all the information, and improve the accuracy.
(2) Based on the same network structure, the proposed GA-IPSO algorithm provides a more efficient search scheme to determine the related parameters of the RNN than the basic PSO.
(3) Testing on the bidirectional optimization of the carbon fiber production process has shown that the proposed method is superior to the basic PSO-RNN and conventional RNN in constructing the network and estimating the outputs.
(4) After the network is constructed, the proposed model can accelerate the convergence speed, decrease iteration time, benefit the ability of getting out of local optimum, increase the capability of the network, then make a quick response, and yield accurate solution during the bidirectional optimization of the carbon fiber production process.
However, the accuracy of the proposed model is still needed to be improved because the training data should be enriched.When the accuracy meets practical production demands, for properties prediction, because production schemes with little difference may lead to the same product properties, so if control parameters changes tiny, we do not need to tune all the parameters or keep them as constants.For production scheme design, after we obtain the scheme by the proposed model, we can alternately use the properties prediction function of the model, prevent cost wasting in practical production directly.This problem should be studied in future work.

Figure 1 :
Figure 1: The bidirectional optimization model of carbon fiber production process.

Figure 4 :
Figure 4: Training results of the proposed GA-IPSO-RNN model.

Figure 5 :
Figure 5: Performance of the proposed method, basic PSO-RNN, and conventional RNN.

Figure 6 :
Figure 6: Training results of the proposed GA-IPSO-RNN model.

Figure 7 :
Figure 7: Performance of the proposed method, basic PSO-RNN, and conventional RNN.

Figure 8 :
Figure 8: Performance comparison of the proposed method and basic PSO-RNN.

Table 1 :
Experiment data of carbon fiber production process.

Table 2 :
Parameters list of RNN obtained from NNCA.

Table 3 :
Errors of the proposed method, basic PSO-RNN, and conventional RNN (1: strength, 2: structure parameter).  is 6, and   is 2. Set  = 1, we obtain  ℎ = 6 by applying the nearest neighbor-clustering algorithm (NNCA), all the parameters information are list in Table2.Based on Table

Table 4 :
The parameters value of the RNN obtained from the NNCA.

Table 5 :
(6)ors of the proposed method, basic PSO-RNN, and conventional RNN.  is 2, and   is 6.Set  = 1, we obtain  ℎ = 1 by applying the NNCA.Compared to the properties prediction model, a visual impression of the NNCA can be obtained.For experience formula(6), since the properties prediction model and production scheme design model have the same sum of   and   , they should almost have the same hidden nodes number; however, they have quite different  ℎ by the NNCA, which indicates its good performance of simplify the RNN structure.And once there adds a new sample, it can be treated online as a training sample for RNN at once, which will improve the prediction accuracy of the model.All the parameters are listed in Table4.Based on Table input, the production parameters are output,