Prediction of Compressive Strength of Concrete Using Artificial Neural Network and Genetic Programming

An effort has been made to develop concrete compressive strength prediction models with the help of two emerging data mining techniques, namely, Artificial Neural Networks (ANNs) and Genetic Programming (GP). The data for analysis and model development was collected at 28-, 56-, and 91-day curing periods through experiments conducted in the laboratory under standard controlled conditions. The developed models have also been tested on in situ concrete data taken from literature. A comparison of the prediction results obtained using both the models is presented and it can be inferred that the ANN model with the training function Levenberg-Marquardt (LM) for the prediction of concrete compressive strength is the best prediction tool.


Introduction
Conventional concrete is a mixture of cement, water, and coarse and fine aggregates.Supplementary components such as chemical and mineral admixtures may be added to the basic concrete ingredients to enhance its properties in fresh or hardened state.The procedure of selecting appropriate ingredients for concrete and its relative amount with the aim of producing concrete of obligatory strength, workability, and durability as cost-spinning as possible is termed mix design.The development of tools to find the optimized mix proportions has been the subject of research during the last more than four decades.The aim of any proportioning process is to determine an ample and cost-effective material to make up the concrete, which can be used in its fabrication, as near as possible to the chosen properties.The engineering properties of cement-based materials and special concretes depend on various parameters including the nonhomogeneous nature of their components and the intrinsically different properties of various elements and sometimes on the twin and/or contradictory effects of some ingredients on the overall concrete performance.Therefore, a clear understanding of such complex behavior is needed in order to successfully use these materials in various engineered structures.In recent years, many researchers have been working on developing accurate concrete compressive strength prediction models [1][2][3][4][5][6][7][8][9][10][11].The prediction of compressive strength of concrete has great connotation, if it is brisk and consistent because it offers an option to do the essential modification on the mix proportion used to avoid circumstances where concrete does not attain the mandatory design strength or by avoiding concrete that is gratuitously sturdy and also for more economic use of raw material and fewer construction failures, hence reducing construction cost.So prediction of compressive strength of concrete has been an active area of research.The aim of the present study is to compare two emerging soft computing techniques, that is, Artificial Neural Network and Genetic Programming (GP), used for concrete compressive strength prediction, by using the experimental data.

Materials
The experimental data used for the prediction of concrete compressive strength in the present study have been taken from the research work conducted by Kumar [12].For generating a trustworthy information bank on concrete compressive strength, variation in five parameters, namely, 2 Advances in Materials Science and Engineering water-cementitious material ratio (W/CM), water content, workability, cementitious content (which includes either cement or both cement and fly ash), and curing ages, has been considered.The range for the water-cementitious ratio is between 0.42 and 0.55, for cement content (C); it is 350-475 at 25 kg/m 3 , for water content; it is 180-230 at 10 kg/m 3 , with both medium and high workability, and cured at the ages of 28, 56, and 91 days.The experiments were performed under controlled laboratory conditions.As per IS: 8112-1989, the Ordinary Portland Cement (OPC) is of grade 43 having specific gravity of 3.12.The specific gravity of the aggregate (sand) is 2.54 with a fineness modulus of 2.09.The sand conforms to zone III as per IS: 383-1970.Coarse aggregate (CA), used herein, consists of two sizes, 20 mm and 10 mm, having specific gravity of 2.61 and 2.63, respectively, mixed in varying proportion.The details of the proportions for concrete mixes without fly ash (FA) are shown in Table 1 and the compressive strength data at varying curing ages for these mixes is presented in Table 2. Table 3 shows proportions of ingredients of mixes containing 0.15 FA as substitution of cement and Table 4 gives the compressive strength data at the above ages for the FA concrete mixes.

Artificial Neural
Network.An Artificial Neural Network is a network of artificial neurons, which can reveal intricate global performance, determined by the associations between the processing elements and element parameters.In a neural network model, simple nodes, which are called "neurons" or "neurodes" or "processing elements" (PEs) or "units," are linked jointly to form a network of units, hence called "Artificial Neural Network." ANNs consist of the following three major essentials [13]: Topology: organization and interconnection of a neural network into layers.
Learning: related with the information storage in the network.
Recall: retrieval of information from the network.
The architecture of an ANN consists of synthetic or artificial neurons.These are analogous to natural neurons in the brain of a human, which are clumped into layers.Atypical neural network architecture consists of an input layer, one hidden layer, and an output layer [14].

Construction of Model 1 (ANN Model).
A successful application of an ANN for the prediction of compressive strength of concrete needs a good conception of the impact of different internal parameters.For ANN architectures and training of the same, the significant internal parameters include learning rate, initial weights, number of training epochs, number of hidden layers, and number of neurons in every hidden layer and transfer functions for hidden layers and output layers [15].In this work, an ANN model is developed through experimental exploration of various internal parameters to predict the compressive strength of concrete.
The initial trialing is commenced with certain randomly selected parameters on the basis of the technical literature available.The "trial and error" method is used to reach at best possible parameter values that would generate the true predictions.
In the starting, most of the variants are examined for the network performance optimization.Levenberg-Marquardt training (LM) was found to be most suitable for the data patterns for the prediction of concrete compressive strength during trail approach.In the present study, two types of datasets have been taken: dataset 1 has 49 tuples and this dataset is without the substitution of cement with FA and dataset 2 has 27 tuples and this dataset is with 0.15 substitution of cement with FA.Further each dataset is categorized according to the curing time, that is, 28 days, 56 days, and 91 days.The four numbers of input parameters have been engaged, that is, water, cement, coarse aggregate, and fine aggregate, when the output parameter is 28-day compressive strength.The five numbers of input parameters have been taken including the 28-day compressive strength as input parameter, that is, water, cement, coarse aggregate, fine aggregate, and 28-day compressive strength, when the output parameter is 56-day compressive strength.The six numbers of input parameters have been used including the 28-day compressive strength and 56-day compressive strength as input parameters, that is, water, cement, coarse aggregate, fine aggregate, 28-day compressive strength, and 56-day compressive strength, when the output parameter is 91-day compressive strength.For all the experiments in model 1, tansig() function is selected for the hidden layer and purelin() function is selected for output layer due to their ability to learn complex nonlinear relation between the input parameter and output parameter [16].50 numbers of neurons are used at hidden layer and 01 neuron is used at output layer.The values of other parameters, that is, performance function, learning rate, performance goal, and epochs, are "mse," "0.01," "0.000001," and "10000" which have been taken for the construction of ANN model.The architecture selected for ANN model is given in Table 5.

Genetic
Programming.Genetic Programming (GP) is a group of instructions and a fitness process to determine how well a machine has performed a particular task.It is a specialization of genetic algorithm (GA) where each node is a computer program.It is a technique used to optimize residents of computer program in line with a suitable site determined by a program's capability to carry out a prearranged computational condition.The three genetic operations are as follows: (1) Crossover operates on two programs that are chosen as per their fitness and produces two subprograms.The two random nodes are chosen from each program and then the resultant subtrees are swapped, producing two new programs.These new programs turned into a part of the new generation of programs to be participated further.Population here is increased by 2.
(2) Reproduction: the next important operation is accomplished by copying an elected member from the present generation to the subsequent generation as per the fitness norm.Population here is increased by 1.
(3) Mutation: in GP, mutation becomes a significant operator that provides assortment to the population.One individual is chosen as per the fitness.A subprogram is substituted by another one randomly.The mutant is popped into the new population.Population is then increased by 1.
Saridemir [10] has explained the whole genetic approach proposed by Koza [17] and Ghodratnamaa et al. [18] have also published the pseudocode for the same.The role of GP in future computing has been seen as the most potential way to automatically write computer programs.Nowadays, some commercial Genetic Programming kernels are also available that will help to apply the technique and to use the GP kernels the user needs to take some decisions before the GP system to begin.Firstly, the available genes need to be selected and created.Secondly, the user has to specify a number of control parameters.

Construction of Model 2 (GP Model)
. Koza [17] has listed some of the important control parameters.For the construction of GP, the initial population size is 49 for dataset 1 without substitution of cement with FA and 27 with 0.15 substitution of cement with FA for dataset 2. As in model 1, each dataset is further categorized according to the curing time; the same has been taken for model 2. The four numbers of input parameters have been taken, that is, water, cement, coarse aggregate, and fine aggregate, when the output parameter is 28-day compressive strength.The five numbers of input parameters have been engaged including the 28-day compressive strength as input parameter, that is, water, cement, coarse aggregate, fine aggregate, and 28-day compressive strength, when the output parameter is 56-day compressive strength.The six numbers of input parameters have been used including the 28-day compressive strength and 56-day compressive strength as input parameters, that is, water, cement, fine aggregate, coarse aggregate, 28-day compressive strength, and 56-day compressive strength, when the output parameter is 91-day compressive strength.The population size (Mu) and the number of children produced (Lamda) have been taken 100 and 150, respectively.The greater the number of generations, the greater the chance of evolving a solution, so the number of generations is taken as 100000 for this model.The values for the parameters crossover rate and mutation rate have been selected as 0.70 and 5. − 002, respectively, on the trial and error basis.The values of other parameters, that is, function set, training percentage, selection method, and tournament size of substitution, are "+, −, * , /, sqrt," "75," "tournament," and "03" which have been selected for the construction of GP model.The parameters settings for model 2 are lodged in Table 6.

Testing of Model 1 and Model 2.
Namyong et al. [19] have offered the regression equations for prediction of in situ concrete compressive strength and for this purpose they have used the information of mixture proportions of ready-mixed concrete and test results of compressive strength from construction sites.In their study, they have used 1442 compressive strength test results obtained from the specimens having 68 different kinds of mixtures with specified compressive strength of 18∼27 MPa, water-cement ratio of 0.39∼0.62,and maximum aggregate size of 25 mm.In this study, Namyong et al. [19] in situ data has been used for the testing of the suggested model for the prediction of concrete compressive strength.

Results and Discussion
The objective of the present study was to explore the applicability of the suggested models, that is, model 1 and model 2, for the prediction of concrete compressive strength.This section presents the comparative investigation of results obtained from these approaches and quantitative assessment of the models' predictive abilities.For model 1, the LM algorithm is used for training, whereas tan-sigmoid is used as an activation function for evaluating the prediction accuracy parameters.The results, as presented in Table 7, give the values of  2 and RMSE for prediction of concrete compressive strength for both types of mixtures, namely, R1 (dataset with no substitution of cement with FA) and R2 (dataset with substitution of cement with 0.15 FA).From the results in Table 7, it can be observed that, for all the curing days, in both the cases, either R1 or R2,  2 is above 0.90 except for R1 at a curing age of 28 days wherein it is 0.898.The low values of RMSE for all the mixes at different curing ages also indicate that the model can predict compressive strength of the mixes with high reliability.Also it can be seen that model 1, with LM as the training function, retrieves the result in just a few epochs.The maximum number of epochs taken by the model is just five, which clearly indicates that the time taken for the prediction is also very much less.
In model 2, the addition is chosen as the linking utility.The values of  2 and RMSE for prediction of concrete compressive strength for both types of mixtures, namely, R3 (dataset with no substitution of cement with FA) and R4 (dataset with substitution of cement with 0.15 FA), obtainedusing model 2 are provided in Table 7. Prediction 28 = ( √ CA (W + ((((FA * √(((((FA + CA) √(√((√CA * ((√((√(((W/  28 ) * (  28 ± 6.78 − 002))) + √ FA))/√(√(√CA))) +   28 )))) ) ) ) ) Advances in Materials Science and Engineering 7   with an RMSE value of 0.0029 in case of 56 days and 0.05 in case of 91 days, indicating a reasonably good fit of the model.However, in case of 28-day curing,  2 obtained is 0.77, which is approximately 0.30 less than the suggested good model fit ( 2 more than or equal to 0.80).In case of prediction of compressive strength for R4 mixtures, with 0.15 FA,  2 obtained is above or equal to 0.92 for all the cases with the highest value of 0.97 with an RMSE value of 0.009 at curing age of 91 days.This indicates that model 2 provides the best prediction at 91-day curing for mixes with FA.Figures 1-6 provide comparison of the predicted results obtained using model 1, model 2, and experimental laboratory results.
It can be clearly observed from these figures that model 1 predicts compressive strength values very near to the experimentally obtained values as compared to model 2 results.To further test the efficacy and reliability of the models, the in situ compressive strength data at curing age of 28 days (as provided in Namyong et al. [19]) has been used in the study.Figure 7 shows the results of the testing of models for the in situ dataset of compressive strength.It has been clearly observed that model 1 is more reliable and provides more accurate prediction for the in situ dataset as well.

Conclusions
On the comparative analysis of GP and ANN techniques, used for the prediction of concrete compressive strength without and with FA, it can be concluded that ANN model is the most reliable technique for the purpose.The RMSE Advances in Materials Science and Engineering   values, so obtained, are small enough to indicate that the estimates are most precise and the trained networks supply superior results.According to statistics, if a proposed model gives  2 > 0.8, there is a well-built correlation between predicted and measured values for the data available in the dataset.As has been observed, for both the models,  2 is greater than 0.8 for all cases, except R3 mixture (in Table 7) strength at 28 days, which proves that either of the models can be used for prediction purposes.However, the prediction model using model 1, that is, ANN model, confirms a high degree of steadiness with experimentally evaluated concrete compressive strength specimens used.As an outcome, ANN may serve as a strong predictive tool, for prediction of both experimental and in situ data and it may provide perfect and valuable explicit formulation for many civil engineering applications, wherein predictive pronouncements are required.

Figure 1 :
Figure 1: Comparison between actual and predicted values of 28 d compressive strength of concrete.

Figure 2 :
Figure 2: Comparison between actual and predicted values of 56 d compressive strength of concrete.

Figure 3 :
Figure 3: Comparison between actual and predicted values of 91 d compressive strength of concrete.

Figure 4 :
Figure 4: Comparison between actual and predicted values of 28 d compressive strength of concrete with FA.

Figure 5 :
Figure 5: Comparison between actual and predicted values of 56 d compressive strength of concrete with FA.
in the dataset 91 d compressive strength of concrete (×500) MPa Pre.GP 91 d CS Pre.ANN 91 d CS Exp.91 d CS

Figure 6 :
Figure 6: Comparison between actual and predicted values of 91 d compressive strength of concrete with FA.

Figure 7 :
Figure 7: Validation of the proposed model of 28 d compressive strength of concrete with in situ dataset as per [19].

Table 1 :
Details of proportions for concrete mixes without fly ash.

Table 2 :
Details of compressive strength of concrete mixes without fly ash after curing for 28, 56, and 91 days.

Table 3 :
Details of proportions for concrete mixes with 0.15 fly ash replacement.

Table 4 :
Details of compressive strength of concrete mixes with fly ash after curing of 28, 56, and 91 days.

Table 7 :
Results of model 1 (ANN) and model 2 (GP).56 , and  91 are the concrete compressive strengths at curing ages of 28, 56, and 91 days, respectively, when no substitution has been done.28,56, and   91 are the concrete compressive strengths at curing ages of 28, 56, and 91 days, respectively, when 0.15 FA is used as substitution of cement.W is the W/CM ratio, FA is the FA/CM, and CA is the CA/CM.From the results, tabulated in Table7, it can be observed that for R3 mixtures, at curing ages of 56 and 91 days, the values of  2 are of the order of 0.90 and 0.87, respectively,