BioMed Research International
Volume 2015 (2015), Article ID 454765, 21 pages
http://dx.doi.org/10.1155/2015/454765

Research Article

Simultaneous Parameters Identifiability and Estimation of an E. coli Metabolic Network Model

Kese Pontes Freitas Alberton,¹ André Luís Alberton,² Jimena Andrea Di Maggio,³ Vanina Gisela Estrada,³ María Soledad Díaz,³ and Argimiro Resende Secchi¹

¹Programa de Engenharia Química-COPPE, Universidade Federal do Rio de Janeiro, Cidade Universitária, 21941-972 Rio de Janeiro, BR, Brazil
²Instituto de Química, Universidade do Estado do Rio de Janeiro, São Francisco Xavier 524, 20550-900 Rio de Janeiro, BR, Brazil
³Planta Piloto de Ingeniería Química-CONICET, Universidad Nacional del Sur, Camino La Carrindanga, Km 7, 8000 Bahía Blanca, Argentina

Received 31 May 2014; Revised 29 August 2014; Accepted 5 September 2014

Academic Editor: Eugénio Ferreira

Copyright © 2015 Kese Pontes Freitas Alberton et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

This work proposes a procedure for simultaneous parameters identifiability and estimation in metabolic networks in order to overcome difficulties associated with lack of experimental data and large number of parameters, a common scenario in the modeling of such systems. As case study, the complex real problem of parameters identifiability of the Escherichia coli K-12 W3110 dynamic model was investigated, composed by 18 differential ordinary equations and 35 kinetic rates, containing 125 parameters. With the procedure, model fit was improved for most of the measured metabolites, achieving 58 parameters estimated, including 5 unknown initial conditions. The results indicate that simultaneous parameters identifiability and estimation approach in metabolic networks is appealing, since model fit to the most of measured metabolites was possible even when important measures of intracellular metabolites and good initial estimates of parameters are not available.

1. Introduction

The development of mathematical model for metabolic networks has been severely hampered by the lack of kinetic information [1–4]. Usually, available experimental data are obtained under different conditions using heterogeneous techniques, whose choice must be done according to the observation of a specific phenomenon of interest on the pathways [2, 4–6]. In such systems, the type of experiment, sampling method, and the mathematical interpretation of the data depend on the desired experimental information [5]. However, as pointed out by Costa et al. [4], kinetic information presented in the literature about metabolic network models is scarce and often confuse; thus, other strategies are adopted in detriment to the dynamic simulation of such systems.

Mathematically, metabolic networks are described by complex dynamics models, whose structure is composed by ordinary differential equations that represent mass balance of the substrate, biomass, products and intracellular metabolites crucial on the pathways, and numerous reaction rates regarding to the pathways. Such mathematical structure presents a large number of parameters, for which the estimation procedure demands a considerable number of experimental data. Since experimentally metabolic networks are only partially observed, only a fraction of the intracellular metabolites considered in the mathematical model can be directly measured and thus initial conditions should also be estimated. Unfortunately, in metabolic network systems, lack of experimental data is almost unavoidable, which compromises the reliability of reactions rates proposition and makes the estimation of all parameters unfeasible. Thus, such problems often require the use of parameters identifiability procedures.

Parameters identifiability procedures deal with ill-posed parameters estimation problems, selecting a subset of parameters that can be estimated when the estimation of all parameters is not possible [7]. In most procedures, parameters are ranked from most estimable to least estimable based on the structure of the model, the experimental measurements and their uncertainties, and the uncertainties of the initial estimates [8].

Several studies reported in the literature addressing the parameters identifiability in metabolic networks are exclusively concentrated in the model structure, called structural identifiability (e.g., Davidescu and Jørgensen [9]; Roper et al. [10]; Nikerel et al. [11]), and do not take into account the available experimental data. On other side, the practical identifiability (e.g., Srinath and Gunawan [12]) investigates if the available experimental data are appropriate and sufficient for achieving a reliably estimation of the model parameters.

Although the structural identifiability is a necessary condition, the practical identifiability must overcome additional difficulties, including the selection of parameters with low sensitivity on the model predictions and correlation among parameters [13]. Unfortunately, such analyses in complex models depend on the values of parameters [13], generally unavailable [8].

Since sensitivity analysis is a key tool of identifiability procedures, procedures that evaluate the identifiability only based on initial parameters values can lead to a subset of selected parameters whose estimation may lead to an ill-posed problem [7]. A strategy to soften this problem is to perform simultaneous parameters selection and estimation, which ensures the estimation of the selected parameters (e.g., Secchi et al. [14], Wu et al. [15]; Wu et al. [16]; McLean et al. [17]; Alberton et al. [18]).

Several procedures adopt as stop criterion the singularity of FIM (Fisher Information Matrix) (e.g., Weijers and Vanrolleghem [19]; Sandink et al. [20]; Li et al. [21]; Secchi et al. [14]; Lund and Foss [22]; Thompson et al. [8]; Alberton et al. [18]). The singularity of the FIM matrix, calculated only with the selected parameters, indicates the point in which estimation problem becomes ill-posed. When such point is reached, the parameters selection is stopped and the remaining parameters are admitted as nonidentifiable parameters. Particularly when identifiability performs simultaneous parameters selection and estimation (e.g., Secchi et al. [14]; Wu et al. [15]; Wu et al. [16]; McLean et al. [17]; Alberton et al. [18]), it is not desirable to keep the remaining parameters as nonidentifiable without evaluation of their estimation potential, because the estimation problem is modified at each selected parameter.

A great challenge to be overcame in identifiability procedures, even those which include simultaneous estimation, is that the nonselected parameters are evaluated based on their initial estimates, which are probably inadequate. The literature addresses Monte Carlo techniques [23] and simultaneous parameters reestimation for assuring well posed estimation of the selected parameters (e.g., Secchi et al. [14], Wu et al. [15]; Wu et al. [16]; McLean et al. [17]; Alberton et al. [18]). As more proper, the evaluation of subsequent parameters to be selected should be done based on the reestimated selected parameters values [17, 18], reducing the dependence on the initial parameters estimates. In an interesting work, McLean et al. [17] developed an algorithm which allows evaluating the identifiability of all parameters of the model; such procedure reestimate selected parameters and use these reestimated values in the selection of subsequent parameters to be evaluated, with an intensive computational efforts. Also, in the work of Alberton et al. [18], the reestimated values are used in the selection of subsequent parameters to be evaluated, but in such procedure the numerical efforts are significantly reduced using a binary search based algorithm.

Another challenge is that, even when good initial estimates of parameters values are available, in complex models the verification for identifiability problems (e.g., nonsignificant parameters or parameters correlation derived from experimental design) is a conceptual and numerical arduous task.

In such scenario, an important question to be answered is how to reduce the dependence of identifiability procedure with the initial estimates of parameters values and the selection criteria adopted? In this context, this work presents a numerical procedure for treating estimation problems present in metabolic networks based on intensive parameters evaluation that includes simultaneous parameters selection and estimation. As the main characteristic, the numerical procedure is able to investigate the identifiability of all parameters of the mathematical model, even in ill-posed estimation problem. As in Alberton et al. [18], the numerical procedure could be adapted to procedures proposed in literature for ranking parameters according to their estimability (e.g., Weijers and Vanrolleghem [19]; Sandink et al. [20]; Brun et al. [24]; Yao et al. [25]; Li et al. [21]; Secchi et al. [14]; Chu and Hahn [23]; Sun and Hahn [26]; Lund and Foss [22]; Chu et al. [27]). A complex dynamic model of the microorganism Escherichia coli K-12 W3110 metabolic pathways [2] illustrates the performance of the proposed numerical procedure in applications of interest. Such microorganisms are very important in bioengineering and industrial microbiology, being widely employed in processes of recombinant proteins production.

2. Theoretical Backgrounds

A brief description of parameters estimation and identifiability procedures is given below.

2.1. Parameters Estimation

Parameters estimation is achieved by minimizing an objective function, which is a measure between the difference of the predicted model outputs and experimental measurements. Parameters values can be obtained according to maximum likelihood principle, as extensively described in literature [28, 29]. Assuming that the model is perfect, experiments are well done, experimental errors follow normal distribution, and independent variables are known with high accuracy, then the parameters can be estimated, according to the maximum likelihood principle, by minimizing the following objective function [28, 29]:

in which represents the experimental error covariance matrix, is the vector of experimental data, and is the vector of model predicted values. Generally, only the terms of the diagonal of the matrix are considered, due to the difficulties to characterize experimental errors; thus, the objective function becomes the weighted least square function.

Once the parameters have been obtained, one can determine the uncertainties in the parameters and prediction. Usually the parameters uncertainty is based on the parameters covariance matrix , which under some simplifying assumptions contains geometrics characteristics of the confidence region of the parameters. The terms along the diagonal of the parameters covariance matrix represent the variability of the parameters estimates, and off-diagonal terms indicate the interactions among the parameters. In the parameters estimation procedure, first the Fisher information matrix (FIM) is computed and, subsequently, as follows [28, 29]:

in which represents the local sensitivity matrix [28, 29].

2.2. Parameters Identifiability

Estimation of all parameters values may not be possible when unsatisfactory quantity and/or quality of experimental data are available or when bad model structure and/or inadequate design of experiments were built, leading to nonsignificant or high-correlated parameters with influence on model prediction.

A common approach to overcome this problem is the use of parameters identifiability, also known as parameters estimability [7, 8]. Based on structural model and available experimental data, parameters identifiability procedures partition the original set of parameters into two subsets: (i) the parameters that can be estimated, called identifiable parameters, and (ii) the parameters that cannot be estimated, called nonidentifiable parameters. In most procedures, the identifiable parameters are ranked from most estimable to least estimable and such parameters are estimated, while the nonidentifiable parameters are kept at their initial estimates. Thus, the comparison with the model fit before and after applying the identifiability procedure is verified by the improvement achieved with the selected parameters reestimation.

A classical scheme employed by parameters identifiability procedures is showed in Figure 1. Note that in the classical scheme, the parameters estimation is carried out after the procedure; thus the quality of the initial estimates of parameters values is fundamental for a suitable selection [18].

Figure 1: Classical scheme of parameters identifiability procedures.

3. Numerical Procedure: Intensive Parameters Evaluation

An important aspect of the classical identifiability procedures is to keep the nonidentifiable parameters in their initial estimates while the identifiable parameters are estimated. Since estimation of all parameters is not possible, the estimation of the most identifiable parameters can both regularize an ill-posed estimation problem and simplify the associated optimization problem [7]. Nonetheless, when parameters selection in the classical procedure reached the stop criteria, the remaining parameters are admitted as nonidentifiable. However, it should be important to verify if the inclusion of any other parameter is possible, in order to give the chance of all parameters to be tested. It is especially important because the parameters reestimation of the selected subset may change all parameters values. Thus, changing parameters values may allow the inclusion of other parameters, even those that has already been tested, without success. Thus, identifiability procedures with simultaneous parameters reestimation will require a high computational cost. For example, in the procedure proposed by McLean et al. [17] evaluations are necessary.

The proposed numerical procedure performs intensive parameters evaluation regarding the identifiability and performs the simultaneous estimation approach, based on the one-by-one selection, as presented in Figure 2. The intensive parameters evaluation presents the following basics steps: (i) rank all parameters of the model, (ii) select the most identifiable parameter, and (iii) reestimate the set of selected parameters. If step (iii) is not successfully performed, an additional step is introduced: (iv) remove the last evaluated parameter and repeat steps (ii) and (iii) taking the next most identifiable parameter, until step (iii) is successfully performed; such evaluation is stopped only when all parameters have been evaluated.

Figure 2: Numerical procedure proposed for parameter identifiability in metabolic networks.

From of description in Figure 2, essentially three sets are created: selected parameters , nonselected parameters , and evaluated parameters . Initially, all the parameters are included in the set of nonselected parameters . Thus, this set of parameters is ranked according to their apparent identifiability; in this paper, according to Yao et al. [25], the apparent most estimable parameter is included in the set of selected parameters and removed from the set of nonselected parameters. A reestimation step for the selected parameters is then performed. If the estimation is successfully performed, then the nonselected parameters are ranked again and the procedure is repeated. Otherwise, if the estimation failed, or some numerical problem occurs, the last included parameter must be removed from the set of selected parameters and transferred to the set of evaluated parameters . The set of evaluated parameters contains the parameters that were not successfully performed in the set of selected parameters. The procedure seeks to include the next apparent most estimable parameter from . If some parameter is successfully included, then after the reestimation step, with changed values of the selected parameters, the parameters may now become estimable; therefore, in case of succeed reestimation, all parameters in the set are transferred to the set to be reevaluated in next iterations. The procedure stops when is empty; that is, there is no more parameter to be included in the set of selected parameters. All the parameters have also been included in the set of or . Seeking to ensure evaluation of all parameters of the model, the proposed procedure is based on the one-by-one parameters selection that has a computational effort in the worst case given as .

The proposed numerical procedure for parameters identifiability is implemented in computational code Fortran 95. In this numerical procedure, two powerful packages of literature are employed: Dassl [30], used for solving algebraic-differential equations, and Estima and Planeja [31], used for estimate the parameters of the model; this last one adapted by Alberton et al. [18] to deal complex models with scarce experimental data.

In order to clarify the proposed procedure, Figure 3 illustrates a case with three parameters. The parameters are ranked according to the adopted identifiability criteria (e.g., Weijers and Vanrolleghem [19]; Sandink et al. [20]; Brun et al. [24]; Yao et al. [25]; Li et al. [21]; Secchi et al. [14]; Chu and Hahn [23]; Sun and Hahn [26]; Lund and Foss [22]; Chu et al. [27]). According to the proposed procedure, the first of the most relevant parameter of the rank is included in the set of selected parameters, represented by the filled squares in Figure 3. When adding such parameter to the set of selected parameters two cases can arise: (i) the set of selected parameters can be estimated, the selected parameter was included with success; thus, the nonselected parameters are reranked and the most relevant parameter of the rank should be included in the set of selected parameters or (ii) the set of selected parameters cannot be estimated simultaneously, the last selected parameter is removed from the set of selected parameters and added to the set of evaluated parameters, represented by plaid squares in Figure 3; thus the next parameter in the identifiability rank should be selected. Since the total number of parameters is equal to 3, in the worst case the number of required evaluations is 6.

Figure 3: Possibilities of numerical procedure for 3 parameters investigated; nP and nPSS represent, respectively, the number of parameters and the number of succeeded selected parameters.

Although the proposed procedure may still be affected by the initial estimates, this dependency is strongly reduced due to the steps of parameters reestimation [18, 23]. According to Alberton et al. [18], a possible and natural alternative would be the use of nondeterministic optimization methods before or even during the identifiability procedures, such as Particle Swarm Optimization (PSO) [32] or Genetic Algorithm (GA) [33], to improve the initial parameters estimates. However, the use of nondeterministic methods may not be advantageous for complex metabolic network models, because the range of parameters values must be carefully chosen, otherwise, numerical problems associated with parameters values very often do not allow the numerical simulation of the model. Thus, for many random parameters values generated by PSO or GA, parameters estimation could not be successfully evaluated. For example, in this work, the PSO as a previous step of parameters identifiability of the E. coli K-12 W3110 metabolic network model was investigated, but the numerical problems associated with the model simulation did not lead to any further significant improvement regarding the initial estimates. Besides, such methods require too many function evaluations of the metabolic network, since the number of parameters to be estimated is high (131 parameters in the case study).

The Yao et al. [25] methodology was adopted as criteria for ranking the parameters according to their identifiability potential; however, it is important to emphasize that other ranking methodologies can be adopted. The Yao et al. [25] identifiability is based on the sensitivity matrix and two criteria for parameters selection: (i) parameters influence on model prediction, length of sensitivity vector by Euclidian norm, and (ii) parameters correlations, linear dependence among sensitivity vectors by Gram-Schmidt orthogonalization method. Each column of matrix can be understood as a sensitivity vector regarding each parameter. Generally, normalized sensitivity matrix as shown in (3) is employed to avoid the influence of different magnitudes of variables and parameters on the sensitivity analysis.

According to Yao et al. [25], the most identifiable parameter is the one with the highest Euclidian norm of the sensitivity vector, that is, . Thus, this procedure proposes to include, in the set of selected parameters, one parameter each time, according to the decreasing rank of the sensitivity vectors norms. Moreover, since the vectors can be linearly dependent, for every parameter included in the set of selected parameters, an orthogonalization procedure (Gram-Schmidt method) was performed over the matrix , in order to discount the influence of linear dependence with the selected parameters

As a previous analysis, the collinearity angle was evaluated among sensitivity vectors and , for all parameters of the model, that is, , as presented in the following equation [33]:

As well-known from linear algebra, collinearity angles values near 90° indicate linear independence between sensitivity vectors while values near 0° or 180° indicate the opposite. It is important to emphasize that is not a rigorous analysis; correlation among parameters is only verified in parameters pars. However, this analysis can be used in a simple way to verify if correlation among pairs of parameters is expected to occur.

4. Application: Metabolic Networks in Large Scale Modeling

Metabolic networks models are employed for describing enzymatic activity of microorganisms. In such processes, series of sequential and parallel reactions take place, producing metabolites. Palsson [3] and Steuer and Junker [1] present detailed descriptions about the development of metabolic networks models.

Despite the great variety of computational tools available for assisting the development of such models, significant challenges are encountered in modeling living organisms and their mechanisms [34]. The development of metabolic networks models includes several steps which must interconnect with each other, related to biological knowledge, experimental data acquirement, mathematical modeling, parameters estimation, and model evaluation. A simplified scheme for construction of metabolic networks models is presented in Box 1.

(1) Obtain all possible reactions

How? From database sources, a set of all possible reactions must be obtained.

Difficulties: Databases may not contain all the possible reactions involved. Biological knowledge is required.

(2) Collect experimental data

How? Experimental data can be obtained from the literature for similar systems or from laboratory experiments.

Difficulties: Hard to found literature data, or reported data very scarce. Laboratory experiments are

time and money consuming.

(3) Obtain the reactions that seems to occur

How? From experimental data, apply topological Analysis (TA) and Flux Balance Analysis (FBA), which demands

optimization but no parameters estimation.

Difficulties: The obtained results from the techniques TA and FBA above are not unique. Specific biological knowledge about

the system is required.

(4) Propose kinectic models

How? Typically, it is proposed expressions similar to Michaellis Menten kinetics or law of mass actions. Databases with typical

kinetic expressions can be useful.

Difficulties: Databases can not contain reactions involved. The modfications on Michalis Menten expressions can lead to

combinatorial explosion of possible models.

(5) Obtain initial parameters estimates

How? In the same databases from the previous step or from literature review for similar systems, an initial parameters

estimation can be obtained.

Difficulties: Here is one of the most difficult steps. In some cases, one can have no idea of possible parameters values.

(6) Employ parameters identification technique

Objective? Verify the most influence parameters.

Difficulties: Implement such methodologies. Also, different techniques can result in non unique results. Many can be very

influenced by the initial parameters estimation.

(7) Evaluate the results

If the results are satisfactory, then stop the procedure. Otherwise, perform Optimal Experimental Design.

Difficulties: It is very difficult to estabilish when is desirable to stop. Specially because the satisfactory parameters

uncerainties evaluation will demand an unfeasible number of experiments.

(8) Employ optimal experimental design

Objective? Obtain experimental regions for better parameters estimation or models discrimination. Return to Step  (2).

Difficulties: Implement a methodology described in the literature.

Box 1: Sequence proposed for modeling metabolic systems, based on Wiechert and Graaf [35] and Steuer and Junker [1].

Regarding step , Steuer and Junker [1] present several databases that can be consulted for selecting all the reactions that will be considered. Moreover, Copeland et al. [34] present computational tools employed for this step.

In step , there are difficulties in collecting experimental data from the literature. Besides, the experiments are time and money consuming. In fact, in many metabolic reactions, especially in the catabolic reactions and the reactions for cells energy production, turnover rates are in the range of 1.5–2.0 s⁻¹. Such fast reactions make experiments with manual operation unreliable to study the dynamics of intracellular metabolite concentrations [5, 6]. This characteristic of the microsystem seriously impairs the availability of experimental data, since the choice of sampling times is crucial to the quality of information that can be obtained from experimental data.

In step , it is necessary to propose the set of possible reactions that may occur. The application of Topological Analysis (TA) and Flux Balance Analysis (FBA), together with experimental data [35], will lead to a stoichiometric matrix for the most relevant reactions that seems to occur. Although computational tools are available for this step [34], there are some arbitrary choices, which leads to a non-unique results.

Regarding steps and , it is important to emphasize the possible use of databases, containing both models and initial parameters values. Databases sources are presented by Steuer and Junker [1] and Copeland et al. [34]. Nevertheless, such steps are the most difficult parts of the work, since, when not found, initial estimates of parameters may become completely arbitrary. Gerdtzen et al. [36] address the complexity at the pathway level and alert for the use of default models for biochemical processes such as the Monod/Michaelis-Menten rates with their generalization toward several substrates, reversibility, and different mechanisms of inhibition. Three major problems affect the parameters estimation of metabolic networks: (i) when experimental data do not present measures for all metabolites of interest, (ii) when measurements of some metabolites are not synchronized with other metabolic measures over the sampling time, and (iii) uncertain initial estimates of the parameters values; in many cases, good initial estimates of parameters values (or even possible ranges) are not known; thus, such values are usually arbitrarily adopted [5].

Step indicates the use of parameters identifiability techniques. Since generally the experimental evidence is insufficient, the estimation of all parameters seldom will be possible [37]. Nevertheless, if parameters are set initially in reasonable values, one can identify the most influent set of parameters. It is important to emphasize that techniques allowing parameters reestimation should be preferable, as discussed in this work.

Steps and can be performed together. Since estimation of all parameters will generally not be possible, one interesting stop criterion is the experimental demand for obtaining additional information. Using just simulated results, one can verify if, for the optimal experimental design conditions, the expected information to be obtained will justify performing additional experiments. If it seems reasonable to perform more experiments, one should return to step , performing experiments at the condition indicated by the optimal experimental design techniques [38, 39].

From the uncertainties sources described above, discrepancies are expected to occur between model predictions and experimental results. Even so, the use of models can help to choose experimental regions for performing experimental tests where one can expect to achieve more information, thus, saving experimental efforts which are time and money consuming. As shown in this paper, it can be well performed for large scale metabolic networks.

4.1. Case Study: Mathematical Model of Metabolic Networks in Large Scale—Escherichia coli K-12 W3110

Possibly, Escherichia coli is the most studied microorganism in the literature. Even so, its metabolic networks are not completely observable. For different experimental conditions, there are several infrequent or absent measures of intracellular metabolites. Thus, some studies have focused on the development of kinetic model for metabolic network for this microorganism (e.g., Chassagnole et al. [2]; di Maggio et al. [40]; Degenring [41]; Usuda et al. [42]).

Particularly, E. coli K-12 W3110 to be wild type (wt) corresponds to standard strain that can be genetically manipulated allowing a large range of applications, such as: (i) pharmaceutical, recombinants proteins, vaccines, and serums, (ii) genetic medicine, (iii) environmental, biomarkers and pollution-fighting, and (v) energetic, biodiesel, oils, and others. E. coli is able to metabolize a large variety of components (e.g., carbohydrates, proteins, amino acids, lipids, and organics acids), produce catalase, and also utilize a variety of sources (e.g., glucose, ammonia, and nitrogen). Besides, E. coli grows in large concentrations allowing fermentative processes of high yield [43].

Regarding parameters identifiability in E. coli, di Maggio et al. [40] used global sensitivity analysis proposed by Sobol’ [44] to determine the most influential parameters on the dynamics of the central carbon metabolism of this bacterium, based on the model proposed by Chassagnole et al. [2]. di Maggio et al. [40] concluded that twelve kinetic parameters were the most influential for the model predictions. These parameters represent maximum reaction rates, inhibition, and half-saturation constants. Their identification and later estimation provide the starting points for the manipulation of certain enzyme properties [40].

Large scale metabolic network of the glycolysis, the pentose-phosphate-pathway, and the phosphotransferase system of E. coli K-12 W3110 (Figure 4) [40] consists of a complex mathematical structure with 18 dynamic mass balance equations, (5) to (22) presented below, 7 additional algebraic equations, (A.1) to (A.7), and 30 kinetic rate expressions, (A.8) to (A.37) [2]. Some enzyme kinetics modifications were introduced by di Maggio et al. [40] as the kinetic expression for the activity of phosphofructokinase was taken from Ricci [45] (see (A.12)) and the activity of glucose-6-phosphate dehydrogenase was modeled by the expression proposed by Ratushny et al. [46] (see (A.13)).

Figure 4: Escherichia coli central carbon metabolism [2].

Mass Balances to the Substrate (See (5)) and Intracellular Metabolites (See (6)–(22))

 glucose: glc

 glucose-6-phosfato: g6p

 fructose-6-phosphate: f6p

 fructose-1,6-biphosphate: fdp

 glyceraldehyde-3-phosphate: gap

 dihydroxyacetonephosphate: dhap

 1,3-diphosphoglycerate: pgp

 3-phosphoglycerate: 3pg

 2-phosphoglycerate: 2pg

 phosphoenolpyruvate: pep

 pyruvate: pyr

 6-phosphogluconate: 6pg

 ribulose-5-phosphate: ribu5p

 xylulose-5-phosphate: xyl5p

 sedoheptulose-7-phosphate: sed7p

 ribose-5-phosphate: rib5p

 erythrose-4-phosphate: e4p

 glucose-1-phosphate: g1p

As usual, the values of initial estimates used here were found in the literature [40]. Experimental data employed in this work were obtained in Hoque et al. [43] throughout a time horizon of 300 seconds. Temporal profiles for glucose (glc), dihydroxyacetonephosphate (dhap), erythrose-4-phosphate (e4p), pyruvate (pyr), fructose-1,6-diphosphate (fdp), ribose-5-phosphate (rib5p), ribulose-5-phosphate (ribu5p), 2-phosphoglycerate (2pg), phosphoenolpyruvate (pep), glyceraldehyde-3-phosphate (gap), glucose-6-phosphate (g6p), fructose-6-phosphate (f6p), and 6-phosphogluconate (6pg) were used for parameters identifiability.

As a previous analysis, the collinearity angle among sensitivity vectors for all parameters of the model were calculated, and the frequency of each angle interval is shown in Figure 5. The results indicate high frequency of parameters pars linearly independents (collinearity angles values approximately 90°), in this way Table 1 presents few parameters pars with critical collinearity angles values that do not expect to be selected until a first successfully performed selection.

Table 1: Parameters pars of the E. coli K-12 W3110 metabolic networks with critical collinearity angles values.

Parameters par
Collinearity angle (°)

0.5

175.3

176.5

179.5

176.5

179.3

2.5

0.0

179.3

2.5

177.4

2.4

1.6

177.5

2.3

1.5

0.7

175.2

177.6

Figure 5: Collinearity angles among sensitivity vectors and for all parameters of the E. coli K-12 W3110 metabolic networks.

Fifty eight parameters have been identified, together with five initial conditions of metabolites concentrations which were not known from experimental data (, , , , and ). In metabolic networks, the initial conditions of intracellular metabolites are very important. It is not recommended to keep initial conditions of unknown metabolites at zero, because numerical problems in model integration can occur or predicted values can become unreliable. In such situations, the initial concentrations of unknown metabolites must be estimated together with the parameters. In order to obtain a first initial estimates of nonmeasured intracellular metabolites, the following procedures were employed in this paper: (i) initially, keep the initial concentrations of nonmeasured intracellular metabolites at zero and simulate the model until next integration point (first numerical integration step must be small), and (ii) take the calculated values for the nonmeasured intracellular metabolites concentrations as initial conditions; the information obtained in (ii) is given as initial estimates of concentrations of nonmeasured intracellular metabolites in the identifiability procedure.

Numerical results for the proposed procedure are presented in Figure 6 and Table 2, comparing the model simulation with initial parameters estimates from the literature [40] and reestimated parameters according to the intensive parameters evaluation.

Table 2: Identifiable parameters of the E. coli K-12 W3110 metabolic networks obtained using the numerical procedure for intensive parameters evaluation.

Parameter
Initial estimate
Estimated value
Normalized standard deviation

3082.300
3683.300
0.060

4.010
0.529
0.015

30.423
1.593
0.081

12.873
8.476
0.041

750.000
0.541
0.051

500.000
0.381
0.021

0.700
0.469
0.028

1.400
0.647
0.064

4.000
8.795
0.041

0.567
0.140
0.069

1.000
7.237
0.028

0.200
1.271
0.037

1.000
4.152
0.075

1.000
19.076
0.110

8.461
4.051
0.051

0.100
0.099
0.038

0.400
0.060
0.101

0.266

0.115

0.120
6.289
0.050

0.369
1.105
0.039

4.000
4.182
0.052

7.372
1.461
0.069

5.182
0.100
0.054

3.733
1.366
0.019

1.967
0.382
0.057

0.200
0.272
0.193

1.000
785.758
0.070

1.000
0.361
0.053

4.070
5.731
0.038

2.600
3.501
0.022

2.200
3.455
0.032

0.999
1.057
0.054

0.750
0.630
0.122

1.090
4.752
0.027

0.473
2.326
0.077

4.000
1.582
0.030

4.000
0.584
0.136

0.300
0.567
0.050

2.000
9.169
0.057

2.000
5.993
0.084

0.990
0.114
0.078

1.050
2.583
0.054

0.200
0.084
0.035

1.000
1.506
0.065

1.300
1.145
0.123

2.800
7.830
0.057

82107.310
1.876
0.070

0.187
0.626
0.066

4.000
0.443
0.037

0.393
0.366
0.080

0.260
0.208
0.063

0.400
0.455
0.056

0.252
0.093
0.070

1.200
0.240
0.125

22.500
1.483
0.062

5.449
3.597
0.051

96.972
0.749
0.063

5.221
0.597
0.036

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

(i)

(j)

Figure 6: Experimental and predicted metabolites concentrations as function of the time: (○) experimental value, (-▲-) predicted value using initial estimates, and (-●-) predicted value after parameter identifiability using model of E. coli K-12 W3110 metabolic networks.

Figure 6 demonstrates the improvement of the model prediction by using the proposed procedure of parameters identifiability. Unfortunately, model limitations and few experimental data impose some insurmountable barriers to identifiability procedures. Thus, some metabolites did not change after applying the identifiability procedure. In this way, the 10 metabolites profiles that were significantly improved after the identifiability procedure are presented. Since the model fits reasonably the experimental data, it can be concluded that the parameters selection was performed with relatively good success. A special attention should be given to Figures 6(b), 6(d), and 6(f) for which the mathematical model behavior using initial estimates of parameters values is not able to follow the tendency of the experimental data. For these cases, the initial estimates of parameters values showed to be inadequate.

Table 2 presents the estimated parameters together with the initial estimates and their normalized standard deviations, calculated as the ratio between the standard deviation of the parameter and its estimated value . As important information of the identifiable parameters, the low normalized relative deviations obtained after the numerical procedure indicates a good quality of the estimated values. Analyzing the parameters estimated values, it is found that initial estimates of the parameters were significantly improved. It is important to emphasize that the estimates of the selected parameters can be significantly influenced by the initial estimates of the nonselected parameters. Thus, more adequate parameters values can be obtained when a large experimental dataset is available, allowing estimating all parameters of the mathematical model. Using the proposed numerical procedure, the objective function was also improved in two orders of magnitude relative to the initial estimates. The results are also dependent on the assumed behavior of experimental uncertainties. It is usual to assume the standard deviation of the dependent variable () to be proportional to its value () in the form

where and are generally arbitrarily chosen. For example, for and , the initial value of the objective function was and reduced to after reestimation. For and , the initial value of the objective function was and reduced to after parameters reestimation. The set of selected parameters was not the same in both cases; nevertheless, the prediction was similar. The dependence of parameters estimation performance on the assumed experimental uncertainties is expected even for well posed problems. It is important information, but generally it is neglected and arbitrarily chosen due to the difficulties involved in characterizing the experimental errors.

Even with so much uncertainties, associated to experimental data, modeling development and some unknown initial conditions, it has been shown that it is possible to fit and/or improve model predictions with parameters identifiability procedures. The model can now be used for predicting the experimental behavior of the system. Besides its uncertainties, it can help to give us an idea about what we should expect in experimental regions, delimiting experimental design for further investigations, among other purposes. Naturally, for more accurate results, some predictions should be confirmed by additional experiments in the experimental regions of greater interest.

Comparing the performance of the proposed numerical procedure with similar procedure but stopping the selection when the last selected parameter was not successfully included, only 63 parameters have been selected, and the objective function was around 5 times greater compared with the results obtained with the algorithm presented in Figure 2. It emphasizes the necessity to investigate all parameters in order to improve final results and not to stop the procedure when the first parameter have failed to be included.

In the procedure proposed in previous work [18], subsets of parameters were included at once, and if the estimation of such subset was possible, this subset could not leave the set of selected parameters. Thus, if a set of parameters has been successfully estimated, the orthogonalization step (for discount parameters influence one each other) was not performed between such parameters. In the procedure presented in this work, one parameter is selected each time, and orthogonalization step between the selected parameters and yet unselected parameters is performed much more times than in previous work [18]. Although not assured by the model nonlinearities, one can expect that the present procedure should lead to better results, despite being more time consuming, since it performs a more thorough investigation regarding the parameters correlation. In fact, the objective function obtained in this work divided by the objective function of previous work [18] was 0.15, indicating a good improvement in prediction performance.

It is important to emphasize that, for this application, the improvement in the prediction quality was observed with estimation of only half of the model parameters, being the numerical procedure performed using unknown values for some initial conditions of the dependent variables. Thus, in similar scenarios, a great merit of the parameters identifiability procedure is to select only the most influential parameters on the mathematical model that can be estimated with the available experimental data.

5. Conclusion

In this work, a large scale ill-posed problem of parameters estimation in metabolic networks was investigated, where experimental data are scarce and concentrations of intracellular metabolites are not completely known. A proposed procedure of intensive parameters evaluation that presents simultaneous parameters selection and estimation was successfully applied to solve this problem. Compared in pairs, few parameters seem to be correlated, as revealed by collinearity angles. From the initial scenario, containing 131 parameters and 5 unknown initial conditions of intracellular metabolites concentrations, the procedure was able to identify 58 parameters, together with the 5 initial conditions of intracellular metabolites concentrations. The simultaneous reestimation step reduced the dependence on the initial parameters estimates, allowing a good fit of the model. The robustness of the applied procedure is certainly an appealing feature for metabolic networks problems.

Appendix

Time Correlations for Cometabolites Concentrations [2]

 Adenosintriphosphate: atp

 adenosindiphosphate: adp

 adenosin monophosphate: amp

 diphosphopyridine nucleotide phosphate, reduced: nadph

 diphosphopyridine nucleotide, reduced: nadp

 diphosphopyridine nucleotide, reduced: nadh

 diphosphopyridine nucleotide, oxized: nad

Kinetics Rates for Enzymes [2, 40]. Consider

Kinetics Parameters. See Table 3.

Table 3: Kinetics parameters.

Enzyme
Parameter
Description

Phosphotransferase system: PTS

M–M half-saturation constant (mM)

Constant (mM)

Constant

Inhibition constant (mM)

Constant

Maximum reaction rate (mM s⁻¹)

Phosphoglucoisomerase: PGI

M–M half-saturation constant (mM)

Inhibition constant (mM)

Equilibrium constant

Inhibition constant (mM)

Inhibition constant (mM)

Maximum reaction rate (mM s⁻¹)

Phosphofructokinase: PFK

M–M half-saturation constant (mM)

M–M half-saturation constant (mM)

Activation constant (mM)

Activation constant (mM)

Activation constant (mM)

Activation constant (mM)

Activation constant (mM)

Inhibition constant (mM)

Allosteric constant

Number of binding sites

Maximum reaction rate (mM s⁻¹)

Aldolase: ALDO

M–M half-saturation constant (mM)

M–M half-saturation constant (mM)

M–M half-saturation constant (mM)

Inhibition constant (mM)

Back-forward reaction rate relation

Equilibrium constant (mM)

Maximum reaction rate (mM s⁻¹)

Triosephosphate isomerase: TIS

M–M half-saturation constant (mM)

M–M half-saturation constant (mM)

Equilibrium constant

Maximum reaction rate (mM s⁻¹)

Glyceraldehyde-3-phosphate  
dehydrogenase: GAPDH

M–M half-saturation constant (mM)

Inhibition constant (mM)

M–M half-saturation constant (mM)

Inhibition constant (mM)

Equilibrium constant

Maximum reaction rate (mM s⁻¹)

Phosphoglycerate kinase: PGK

M–M half-saturation constant (mM)

Inhibition constant (mM)

M–M half-saturation constant (mM)

Inhibition constant (mM)

Equilibrium constant

Maximum reaction rate (mM s⁻¹)

Phosphoglycerate mutase: PGluMu

M–M half-saturation constant (mM)

Inhibition constant (mM)

Equilibrium constant

Maximum reaction rate (mM s⁻¹)

Enolase: ENO

M–M half-saturation constant (mM)

Inhibition constant (mM)

Equilibrium constant

Maximum reaction rate (mM s⁻¹)

Pyruvate kinase: PK

M–M half-saturation constant (mM)

M–M half-saturation constant (mM)

Inhibition constant (mM)

Activation constant (mM)

Activation constant (mM)

Allosteric constant

Number of binding sites

Maximum reaction rate (mM s⁻¹)

Pyruvate dehydrogenase: PDH

M–M half-saturation constant (mM)

Number of binding sites

Maximum reaction rate (mM s⁻¹)

Phoenolpyruvate carboxylase: PEPCxylase

M–M half-saturation constant (Mm)

Activation constant (mM)

Number of binding sites

Maximum reaction rate (mM s⁻¹)

Phosphoglucomutase: PGM

M–M half-saturation constant (mM)

Inhibition constant (mM)

Equilibrium constant

Maximum reaction rate (mM s⁻¹)

Glucose-1-phosphate  
adenyltransferase: G1PAT

M–M half-saturation constant (mM)

M–M half-saturation constant (mM)

Activation constant (mM)

Number of binding sites

Maximum reaction rate (mM s⁻¹)

Ribose phosphate  
pyrophosphokinase: RPPK

M–M half-saturation constant (mM)

Maximum reaction rate (mM s⁻¹)

Glycerol-3-phosphate  
dehydrogenase: G3PDH

M–M half-saturation constant (mM)

Maximum reaction rate (mM s⁻¹)

Serine synthesis: SerSynth

M–M half-saturation constant (mM)

Maximum reaction rate (mM s⁻¹)

DAHP synthase: DAHPS

M–M half-saturation constant (mM)

M–M half-saturation constant (mM)

Number of binding sites

Number of binding sites

Maximum reaction rate (mM s⁻¹)

Glucose-6-phosphate  
dehydrogenase: G6PDH

M–M half-saturation constant (mM)

M–M half-saturation constant (mM)

Inhibition constant (mM)

Inhibition constant (mM)

Maximum reaction rate (mM s⁻¹)

6-Phosphogluconate  
dehydrogenase: PGDH

M–M half-saturation constant (mM)

M–M half-saturation constant (mM)

Inhibition constant (mM)

Inhibition constant (mM)

Maximum reaction rate (mM s⁻¹)

Ribulose phosphate epimerase: RU5P

Equilibrium constant (mM)

Maximum reaction rate (mM s⁻¹)

Ribose phosphate isomerase: R5PI

Equilibrium constant (mM)

Maximum reaction rate (mM s⁻¹)

Transketolase a: TKa

Equilibrium constant (mM)

Maximum reaction rate (mM s⁻¹)

Transketolase b: TKb

Equilibrium constant (mM)

Maximum reaction rate (mM s⁻¹)

Transaldolase: TA

Equilibrium constant (mM)

Maximum reaction rate (mM s⁻¹)

Synthesis 1: Synth1

M–M half-saturation constant (mM)

Maximum reaction rate (mM s⁻¹)

Synthesis 2: Synth2

M–M half-saturation constant (mM)

Maximum reaction rate (mM s⁻¹)

Mureine synthesis: MurSynth

Maximum reaction rate (mM s⁻¹)

Tryptophan synthesis: TrpSynth

Maximum reaction rate (mM s⁻¹)

Methionine synthesis: MetSynth

Maximum reaction rate (mM s⁻¹)

Nomenclature

: | Specific growth rate or intracellular dilution rate
: | Dilution rate.

Metabolite

Glc: | Glucose
g6p: | Glucose-6-phosphate
f6p: | Fructose-6-phosphate
Fdp: | Fructose-1,6-biphosphate
Gap: | Glyceraldehyde-3-phosphate
Dhap: | Dihydroxyacetonephosphate
Pgp: | 1,3-Diphosphoglycerate
3pg: | 3-Phosphoglicerate
2pg: | 2-Phosphoglicerate
Pep: | Phosphoenolpyruvate
pyr: | Pyruvate
6pg: | 6-Phosphogluconate
ribu5p: | Ribulose-5-phosphate
xyl5p: | Xylulose-5-phosphate
sed7p: | Sedoheptulose-7-phosphate
xyl5p: | Xylulose-5-phosphate
sed7p: | Sedoheptulose-7-phosphate
rib5p: | Ribose-5-phosphate
e4p: | Erythrose-4-phosphate
Glp: | Glucose-1-phosphate.

Cometabolite

Atp: | Adenosintriphosphate
Adp: | Adenosindiphosphate
Nad: | Diphosphopyridindinucleotide, oxized
Nadh: | Diphosphopyridindinucleotide, reduced
Nadp: | Diphosphopyridindinucleotide-phosphate, oxized
Nadph: | Diphosphopyridindinucleotide-phosphate, reduced
Amp: | Adenosinmonophosphate.

Enzyme

ALDO: | Aldolase
DAHPS: | DAHPS synthase
ENO: | Enolase
G1PAT: | Glucose-1-phosphate adenyltransferase
G3PDH: | Glycerol-3-phosphate dehydrogenase
G6PDH: | Glucose-6-phosphate dehydrogenase
GAPDH: | Glyceraldehyde 3-phosphate dehydrogenase
MetSynth: | Methionine synthesis
MurSynth: | Mureine synthesis
PDH: | Pyruvate dehydrogenase
PEPCxylase: | PEP carboxylase
PFK: | Phosphofructokinase
PGDH: | 6-Phosphogluconate dehydrogenase
PGI: | Phosphoglucoisomerase
PGK: | Phosphoglycerate kinase
PGM: | Phosphoglucomutase
PGluMu: | Phosphoglycerate mutase
PK: | Pyruvate kinase
PTS: | Phosphotransferase system
R5PI: | Ribose phosphate isomerase
RPPK: | Ribose phosphate pyrophosphokinase
RU5P: | Ribulose phosphate epimerase
SerSynth: | Serine synthesis
Synth1: | Synthesis 1
Synth2: | Synthesis 2
TA: | Transaldolase
TIS: | Triosephosphate isomerase
TKa: | Transketolase a
TKb: | Transketolase b
TrpSynth: | Tryptophan synthesis.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

The authors thank CNPq (Conselho Nacional de Desenvolvimento Científico e Tecnológico), CAPES (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior), CONICET (National Research Council), and ANPCYT (Agencia Nacional de Promoción Científica y Tecnológica) for providing scholarships and for supporting this work.

References

R. Steuer and B. H. Junker, “Computational models of metabolism: stability and regulation in metabolic networks,” in Advances in Chemical Physics, S. A. Rice, Ed., pp. 6970–6992, John Wiley & Sons, New York, NY, USA, 2008.

C. Chassagnole, N. Noisommit-Rizzi, J. W. Schmid, K. Mauch, and M. Reuss, “Dynamic modeling of the central carbon metabolism of Escherichia coli,” Biotechnology and Bioengineering, vol. 79, no. 1, pp. 53–73, 2002.

B. Ø. Palsson, Systems Biology—Properties of Reconstructed Networks, Cambridge University Press, New York, NY, USA, 2006.

R. S. Costa, D. Machado, I. Rocha, and E. C. Ferreira, “Critical perspective on the consequences of the limited availability of kinetic data in metabolic dynamic modelling,” IET Systems Biology, vol. 5, no. 3, pp. 157–163, 2011.

A. Buchholz, J. Hurlebaus, C. Wandrey, and R. Takors, “Metabolomics: quantification of intracellular metabolite dynamics,” Biomolecular Engineering, vol. 19, no. 1, pp. 5–15, 2002.

U. Schaefer, W. Boos, R. Takors, and D. Weuster-Botz, “Automated sampling device for monitoring intracellular metabolite dynamics,” Analytical Biochemistry, vol. 270, no. 1, pp. 88–96, 1999.

C. Kravaris, J. Hahn, and Y. Chu, “Advances and selected recent developments in state and parameter estimation,” Computers and Chemical Engineering, vol. 51, pp. 111–123, 2013.

D. E. Thompson, K. B. McAuley, and P. J. McLellan, “Parameter estimation in a simplified MWD model for HDPE produced by a ziegler-natta catalyst,” Macromolecular Reaction Engineering, vol. 3, no. 4, pp. 160–177, 2009.

F. P. Davidescu and S. B. Jørgensen, “Structural parameter identifiability analysis for dynamic reaction networks,” Chemical Engineering Science, vol. 63, no. 19, pp. 4754–4762, 2008.

R. T. Roper, M. P. Saccomani, and P. Vicini, “Cellular signaling identifiability analysis: a case study,” Journal of Theoretical Biology, vol. 264, no. 2, pp. 528–537, 2010.

I. E. Nikerel, W. A. van Winden, P. J. T. Verheijen, and J. J. Heijnen, “Model reduction and a priori kinetic parameter identifiability analysis using metabolome time series for metabolic reaction networks with linlog kinetics,” Metabolic Engineering, vol. 11, no. 1, pp. 20–30, 2009.

S. Srinath and R. Gunawan, “Parameter identifiability of power-law biochemical system models,” Journal of Biotechnology, vol. 149, no. 3, pp. 132–140, 2010.

H. Yue, M. Brown, J. Knowles, H. Wang, D. S. Broomhead, and D. B. Kell, “Insights into the behaviour of systems biology models from dynamic sensitivity and identifiability analysis: a case study of an NF-κB signalling pathway,” Molecular BioSystems, vol. 2, no. 12, pp. 640–649, 2006.

A. R. Secchi, N. S. M. Cardozo, E. Almeida Neto, and T. F. Finkler, “An algorithm for automatic selection and estimation of model parameters,” in Proceedings of International Symposium on Advanced Control of Chemical Processes (ADCHEM '06), pp. 789–794, Gramado, Brazil, 2006.

S. Wu, T. J. Harris, and K. B. McAuley, “The use of simplified or misspecified models: linear case,” Canadian Journal of Chemical Engineering, vol. 85, no. 4, pp. 386–398, 2007.

S. Wu, K. A. P. McLean, T. J. Harris, and K. B. McAuley, “Selection of optimal parameter set using estimability analysis and MSE-based model-selection criterion,” International Journal of Advanced Mechatronic Systems, vol. 3, no. 3, pp. 188–197, 2011.

K. A. P. McLean, S. Wu, and K. B. McAuley, “Mean-squared-error methods for selecting optimal parameter subsets for estimation,” Industrial and Engineering Chemistry Research, vol. 51, no. 17, pp. 6105–6115, 2012.

K. P. F. Alberton, A. L. Alberton, J. A. Di Maggio, M. S. Díaz, and A. R. Secchi, “Accelerating the parameters identifiability procedure: set by set selection,” Computers and Chemical Engineering, vol. 55, pp. 181–197, 2013.

S. R. Weijers and P. A. Vanrolleghem, “A procedure for selecting best identifiable parameters in calibrating activated sludge model no 1 to full-scale plant data,” Water Science and Technology, vol. 36, no. 5, pp. 69–79, 1997.

C. A. Sandink, K. B. McAuley, and P. J. McLellan, “Selection of parameters for updating in on-line models,” Industrial and Engineering Chemistry Research, vol. 40, no. 18, pp. 3936–3950, 2001.

R. J. Li, M. A. Henson, and M. J. Kurtz, “Selection of model parameters for off-line parameter estimation,” IEEE Transactions on Control Systems Technology, vol. 12, no. 3, pp. 402–412, 2004.

B. F. Lund and B. A. Foss, “Parameter ranking by orthogonalization: applied to nonlinear mechanistic models,” Automatica, vol. 44, no. 1, pp. 278–281, 2008.

Y. Chu and J. Hahn, “Parameter set selection for estimation of nonlinear dynamic systems,” AIChE Journal, vol. 53, no. 11, pp. 2858–2870, 2007.

R. Brun, P. Reichert, and H. R. Künsch, “Practical identifiability analysis of large environmental simulation models,” Water Resources Research, vol. 37, no. 4, pp. 1015–1030, 2001.

K. Z. Yao, B. M. Shaw, B. Kou, K. B. McAuley, and D. W. Bacon, “Modeling ethylene/butene copolymerization with multi-site catalysts: parameter estimability and experimental design,” Polymer Reaction Engineering, vol. 11, no. 3, pp. 563–588, 2003.

C. Sun and J. Hahn, “Parameter reduction for stable dynamical systems based on Hankel singular values and sensitivity analysis,” Chemical Engineering Science, vol. 61, no. 16, pp. 5393–5403, 2006.

Y. Chu, Z. Huang, and J. Hahn, “Global sensitivity analysis procedure accounting for effect of available experimental data,” Industrial and Engineering Chemistry Research, vol. 50, no. 3, pp. 1294–1304, 2011.

Y. Bard, Nonlinear Parameter Estimation, Academic Press, New York, NY, USA, 1974.

A. L. Alberton, M. Schwaab, M. W. N. Lobão, and J. C. Pinto, “Experimental design for the joint model discrimination and precise parameter estimation through information measures,” Chemical Engineering Science, vol. 66, no. 9, pp. 1940–1952, 2011.

L. R. Petzold, “A description of DASSL: a differential/algebraic systems solve,” in Scientific Computing, R. S. Stepleman et al., Ed., pp. 65–68, North Holland Publishing, Amsterdam, The Netherlands, 1989.

M. Schwaab, A. L. Alberton, and J. C. Pinto, “ESTIMA&PLANEJA: Pacote computacional para estimação de parâmetros de planejamento de experimentos,” Internal Technical Report, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil, 2010.

J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of the IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948, Perth, Wash, USA, November-December 1995.

D. E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning, Addison Wesley Longman, Boston, Mass, USA, 1989.

W. B. Copeland, B. A. Bartley, D. Chandran et al., “Computational tools for metabolic engineering,” Metabolic Engineering, vol. 14, no. 3, pp. 270–280, 2012.

W. Wiechert and A. A. Graaf, “Bidirectional reaction steps in metabolic networks: I. modeling and simulation of carbon isotope labeling experiments,” Biotechnology and Bioengineering, vol. 55, pp. 101–117, 1997.

Z. P. Gerdtzen, P. Daoutidis, and W.-S. Hu, “Non-linear reduction for kinetic models of metabolic reaction networks,” Metabolic Engineering, vol. 6, no. 2, pp. 140–154, 2004.

W. Wiechert, C. Siefke, A. A. de Graaf, and A. Marx, “Bidirectional reaction steps in metabolic networks: II. Flux estimation and statistical analysis,” Biotechnology and Bioengineering, vol. 55, pp. 118–135, 1997.

M. Möllney, W. Wiechert, D. Kownatzki, and A. A. Graaf, “Bidirectional reaction steps in metabolic networks: IV. Optimal design of isotopomer labeling experiments,” Biotechnology and Bioengineering, vol. 66, no. 2, pp. 86–103, 1999.

K. Nöh and W. Wiechert, “Experimental design principles for isotopically instationary 13C labeling experiments,” Biotechnology and Bioengineering, vol. 94, no. 2, pp. 234–251, 2006.

J. di Maggio, J. C. Diaz Ricci, and M. S. Diaz, “Global sensitivity analysis in dynamic metabolic networks,” Computers and Chemical Engineering, vol. 34, no. 5, pp. 770–781, 2010.

D. Degenring, Erstellung und validierung mechanistischer modelle für den mikrobiellen stoffwechsel zur auswertung von substrat-puls-experimenten [M.S. thesis], University of Rostock, Rostock, Germany, 2004.

Y. Usuda, Y. Nishio, S. Iwatani et al., “Dynamic modeling of Escherichia coli metabolic and regulatory systems for amino-acid production,” Journal of Biotechnology, vol. 147, no. 1, pp. 17–30, 2010.

M. A. Hoque, H. Ushiyama, M. Tomita, and K. Shimizu, “Dynamic responses of the intracellular metabolite concentrations of the wild type and pykA mutant Escherichia coli against pulse addition of glucose or NH₃ under those limiting continuous cultures,” Biochemical Engineering Journal, vol. 26, no. 1, pp. 38–49, 2005.

I. M. Soboľ, “Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates,” Mathematics and Computers in Simulation, vol. 55, no. 1–3, pp. 271–280, 2001.

J. C. D. Ricci, “Influence of phosphoenolpyruvate on the dynamic behavior of phosphofructokinase of Escherichia coli,” Journal of Theoretical Biology, vol. 178, no. 2, pp. 145–150, 1996.

A. Ratushny, O. Smirnova, Y. Usuda, and K. Matsui, “Regulation of the pentose phosphate pathway in Escherichia coli: gene network reconstruction and mathematical modeling of metabolic reactions,” in Proceedings of the International Conference on Bioinformatics of Genome Regulation and Structure (BGRS '06), pp. 40–44, Novosibirsk, Russia, 2006.