ISRN BiomathematicsVolume 2013 (2013), Article ID 897658, 53 pageshttp://dx.doi.org/10.1155/2013/897658

Review Article

Biochemical Systems Theory: A Review

Eberhard O. Voit

Department of Biomedical Engineering, Georgia Tech and Emory University, 313 Ferst Drive, Suite 4103, Atlanta, GA 30332-0535, USA

Received 24 September 2012; Accepted 19 October 2012

Academic Editors: R. Pérez-Correa and W. Raffelsberger

Copyright © 2013 Eberhard O. Voit. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Biochemical systems theory (BST) is the foundation for a set of analytical andmodeling tools that facilitate the analysis of dynamic biological systems. This paper depicts major developments in BST up to the current state of the art in 2012. It discusses its rationale, describes the typical strategies and methods of designing, diagnosing, analyzing, and utilizing BST models, and reviews areas of application. The paper is intended as a guide for investigators entering the fascinating field of biological systems analysis and as a resource for practitioners and experts.

1. Preamble

Biochemical systems theory (BST) is a mathematical and computational framework for analyzing and simulating systems. It was originally developed for biochemical pathways but by now has become much more widely applied to systems throughout biology and beyond. BST is called “canonical,” which means that model construction, diagnosis, and analysis follow stringent rules, which will be discussed throughout this paper. The key ingredient of BST is the power-law representation of all processes in a system.

BST has been the focus of a number of books [1–6], including some in Chinese and Japanese [7–9]. The most detailed modern text dedicated specifically to BST is [3]. Moreover, since its inception, numerous reviews have portrayed the evolving state of the art in BST. Most of these reviews summarized methodological advances for the analysis of biochemical pathway systems [10–50]. Others compared BST models with alternative modeling frameworks [32, 51–63]; some of these comparisons will be discussed later. Yet other reviews focused on specialty areas, such as customized methods for optimizing BST models (e.g., [64–67]) or estimating their parameters (e.g., [68–72]), strategies for discovering design and operating principles in natural system (e.g., [73–78]), and even the use of BST models in statistics [79–81]. A historical account of the first twenty years of BST was presented in [82].

Supporting the methodological developments in the field, several software packages were developed for different aspects of BST analysis. The earliest was ESSYNS [83–85], which supported all standard steady-state analyses and also contained a numerical solver that, at the time, was many times faster than any off-the-shelf software [86, 87]; see also [88]. Utilizing advances in computing and an extension of the solver from ESSYNS, Ferreira created the very user-friendly package PLAS, which is openly available and still very widely used [89] (see also [3]). Yamada and colleagues developed software to translate E-cell models into BST models in PLAS format [90]. Okamoto’s group created the software BestKit, which permits the graphical design and translation of models, along with their analysis [91–93]. Vera and colleagues developed the software tool PLMaddon for analyzing BST models within SBML [94]; see also [95]. It expands the Matlab SBToolbox with specific functionalities for power-law representations, which are fundamental to BST. A similar goal had the program SBML squeezer, whose scope includes BST, but is more general [96]. Another software package is Cadlive, which offers comprehensive computational tools for constructing, analyzing, and simulating large-scale biological network models [97]. Vera and Torres [98] composed software specifically for the optimization of BST-based models, and Savageau’s group developed a specific toolbox for the analysis of design spaces; it can be found at [99]. Goel et al. proposed an automated method for constructing BST equations from information on the connectivity and regulation of a system [45].

The purpose of this paper is to portray the present state of the art in BST. Considering that BST was conceived over forty years ago, a lot has happened and more is percolating. This paper is quite comprehensive, but by no means complete, and it is likely that some important contributions are missing, for which I apologize. Furthermore, due to its wide scope, the paper can only superficially discuss many of the pertinent topics, and many interesting subtleties will not become apparent and instead “disappear” in clusters of references. Examples are detailed studies of the design principles of gene regulatory networks and of the inference of their topology and regulation. Nonetheless, the paper is hoped to offer the newcomer easy access to BST and to provide the more experienced researcher with a valuable resource.

2. History and Rationale

BST was proposed by M. Savageau in 1969 [100–102]. Several interesting trends motivated him to devise this new formalism. First, biochemistry was in the process of advancing from the traditional studies of isolated reactions to analyses of pathways and, in particular, to investigations of the role of feedback inhibition in their regulation and control. As Savageau [101] noted, “we are now able to attempt the description of behavior of biochemical systems in terms of the component reactions. However, as yet, no method of systems analysis has been proposed which takes into account the particular nonlinear nature of biochemical systems.”

Concurrent with this important development in biochemistry was the rise of computing, and early pioneers of biochemical systems analysis like David Garfinkel envisioned large-scale computer-simulation systems for elucidating metabolic pathways (e.g., [103–105]). Exuberant about the power of the new computers, the sky seemed to be the limit, and it appeared to be only a matter of time that any large reaction system could be analyzed through simulations. Alas, Savageau, and other contemporaries, immediately realized that computing power was only one aspect among many in biological systems analysis: even if one could write algorithms for simulating large reaction networks, it was not at all clear what functions should be used. Arguably, one could resort to default functions like Michaelis-Menten or Hill rate laws and their generalizations [106–108], but then it would become overwhelmingly difficult to determine all kinetic constants and coefficients. Indeed, Schulz [109] showed convincingly that accurate representations of enzyme-catalyzed reactions become surprisingly complicated even for apparently simple bisubstrate biproduct reactions, if one attempts to account correctly for the dynamics of all intermediate complexes. Cautioning against large ad hoc models from a different angle, Heinrich and Rapoport [110, 111] remarked that complicated simulation models of reaction networks render it very difficult to discern between important and unimportant effects that enzymes and metabolites have on the system. Expressed differently, it becomes a significant challenge to infer from simulations alone which components of a system are responsible for certain systemic responses. By contrast, it was argued, if a truly effective mathematical approach could be identified, it would permit relatively straightforward computations of eigenvalues, sensitivities, gains, and other key characteristics of a model. Interestingly, these key characteristics are often governed by a vastly reduced number of essential parameters, which further enhances the appeal of models that facilitate the characterization of a model’s key drivers.

The emerging complications with pure simulation approaches suggested a search for alternative representations, which was to be guided by the much-envied paradigms of physics and engineering. Physics is solidly anchored in theory, and the representations of two coupled pendulums or of an electrical circuit are prescribed by this theory and therefore essentially unambiguous. Furthermore, the governing parameters, such as the resistance and conductance in the electrical circuit, are usually measurable. Not so in biology. Imagine a situation where a hormone triggers a change in gene expression. On the surface, one is faced with a simple cause-effect relationship. However, in detail, this process is exceedingly complicated. The hormone, released from a sender, such as a gland, needs to find its target cells. There it must dock to a receptor. The receptor is usually a transmembrane protein which, upon hormone docking, undergoes some very specific change in its three-dimensional structure. This change secondarily serves as a stimulus for a signaling cascade, which in itself involves several proteins. A protein at the last layer of the cascade directly or indirectly signals the relocalization or activation of a transcription factor, which binds to a corresponding regulator region of the gene whose expression is to be up- or downregulated. Formulating this chain of events mechanistically and in biophysical or molecular detail is presently not feasible.

The second role model for potential representations in biology was engineering. Here, the overwhelming choice is the linear model. No formalism is as well understood as linear mathematics, and in particular, linear algebra, and the repertoire of analytical and computational methods is without equal. Furthermore, engineers have managed to design devices in such a fashion that their characteristic responses indeed are linear, at least approximately. The success of engineering and its utilization of linear mathematics is evident everywhere. One might only think of the exploration of Mars, where rockets have exactly been following computer predictions to deliver a car-size Rover that drives around in a self-guided manner and sends back pictures of formerly unimaginable quality.

Unfortunately, engineering principles can seldom be applied directly to biological systems, because biology is intrinsically different from engineering. We humans are not the ones creating the components and merging them into functioning machines with approximately linear characteristics. Instead, nature has evolved very many known and yet unknown components, and these components cooperate in ill-characterized ways, which almost always contain genuine nonlinearities that can hardly be designed away for easy systems analysis. In the original set of articles on BST, Savageau already described this fundamental difference, stating that ““small-signal’’ linearization is entirely inadequate, because the dynamic range of the variables is known to result in the nonlinear operation of biochemical systems” [102]. At the same time, he recognized that general nonlinear theory was too complicated for any streamlined analysis [100]. The only realistic, feasible strategy had to be a compromise between generality and tractability, and this compromise had to be an approximation.

Merging ideas from Bode analysis in electrical engineering [112] and Taylor’s approximation theory, Savageau thus proposed the power-law representation as a valid local description of processes in biochemistry. This representation combined generality with simplicity, turned out to be rich enough to capture typical nonlinearities, such as stable oscillations [102], limited the amount of experimental data necessary for the description of general rate laws, and generally seemed ideal for “the ultimate purpose … to provide an explanation for the behavior of large-scale biochemical systems rather than individual reactions” [100]. Indeed, it became clear later that all nonlinearities that can be formulated as ordinary differential equations can also be represented, with complete exactness, in BST [113].

It is over forty years that the core ideas of BST were proposed, which raises the question of whether the original goal of “providing an explanation for the behavior of large-scale … systems” [100] is still unchanged. Expanding the scope beyond biochemistry and metabolism, one might address this question by looking at the nascent field of systems biology. And indeed, the often declared goals and purposes of systems biology are not fundamentally different from those of early BST. Under the common heading of “understanding” a biological system, one might place them into two categories, which at first appear to be rather different but in fact have quite a bit of overlap [44]. The first goal is the creation of large-scale models of an entire cell or organism. Such models would clearly be very useful in a vast array of applications, from metabolic engineering to drug targeting and the development of personalized disease simulators. The second type of understanding is the discovery of design and operating principles, which rationalize why a particular structure or process in nature outcompeted alternatives during evolution [34, 35, 78]. For instance, why does end product inhibition almost always target the first step in a linear chain of processes? Why are some genes controlled by inducers and others by repressors? Attaining the first goal of realistic simulators clearly requires very large models with many processes and parameters, while the second goal suggests the peeling away of any extraneous information, until the essence of a structure or process is revealed in a relatively small model. Nonetheless, at a deep organizational level, the goals are two sides of the same issue, because most large systems in biology are modular and exhibit possibly generic design features at different levels. They are organized and controlled in a hierarchical manner so that a true understanding of ever smaller functional modules greatly enhances the understanding of the system as a whole.

Thus, the core goals and aspirations of BST are still valid, with an extension in scope toward biological systems in general. The methods of analysis have of course evolved, and it is now possible, for instance, to assesS-systems with Monte-Carlo simulations of millions of runs, a feat that, a few decades ago, could only be accomplished on a few computers worldwide. Of equal importance is the rapidly expanding availability of biological technologies, along with the enormous amounts of useful quantitative data they bring forth. Combined with a much enhanced appreciation for computational approaches among experimental biologists, there is an unprecedented exuberance that we might indeed be able to formulate and parameterize very large models of biological systems in the foreseeable future and use these models for the betterment of humankind.

The true holy grail of systems biology will be a theory of biology. It is easy to see what such a theory could do, when we study the transition of physics from an experimental to a theory-based science. Instead of studying one application at a time, we could make (and prove) general statements about entire classes of biological phenomena. Some biological laws and partial theories have already been proposed, but they are scarce and isolated in certain niches. For instance, the almost universal law of correspondence between amino acids and codons has had tremendous ramifications for the interpretation of genomic information, and the theory of evolution has helped us explain the relatedness and differences among species. Demand theory [114, 115] explains different modes of gene regulation, and the theory of multiple equilibria and of concordance [116, 117] addresses certain phenomena in metabolism. Nonetheless, while some inroads have been made, general theories of larger biological domains seem out of reach at this point.

3. BST and Other Canonical Modeling Approaches

The key to understanding large-scale systems in biology through modeling is an effective compromise between applicability, accuracy of representation, mathematical tractability, and efficient computational tools. As the term “compromise” suggests, no perfect modeling strategy is known that satisfies all four criteria in all relevant situations. It is not difficult to realize though that models consisting of vastly heterogeneous mixtures of functions and submodels, while possibly quite accurate, are not likely to permit streamlined formulations and analyses or crisp interpretations. By contrast, homogeneous model structures provide a high potential level of tractability and elegance, especially if powerful tools like linear algebra can be brought to bear on these structures. In recognition of this fact, several approaches for biological systems analysis have made use of “canonical representations” [2, 6, 11, 17, 81, 118]. These consist of mathematically homogeneous structures that are the result of strict construction rules which, in turn, are rigorously derived from mathematical theory.

The best-understood canonical model is the linear representation. When setting up a linear model, it is clear from the beginning that every process in the model is to be represented with a linear function and that the ultimate result will consist entirely of such linear functions. The reward of this severe constraint to model choice and construction is that a vast repertoire of effective methods is available for analysis. It is this wealth of methods that, for instance, has propelled engineering to the enormous level of sophistication we discussed before. As soon as one component of the model is made nonlinear, the homogeneity is lost, and streamlined analyses are hampered, if not precluded.

While linear models are rightfully the first choice for modeling, they obviously do not account for nonlinearities, and because biological phenomena are predominantly nonlinear, linear models are not directly applicable to biological systems. We will see, however, that some nonlinear canonical models possess linear features that allow analyses of certain aspects of nonlinear systems. Two questions thus arise: can we identify effective nonlinear canonical models, and if so, are the results worth the trouble? Let us begin with the second question of why is it beneficial to accept the constraints of canonical models. Several complementary answers may be given.

First, canonical models directly address the fundamental question of how to get started with the design of a model. As indicated above, we usually do not know the biophysical processes and mathematical functions that are optimal for describing complex processes in biology. One response of the modeling community has been the use of default models or ad hoc formulations that for some reason appear beneficial, even though they might not have a biophysical or chemical foundation and even if the necessary assumptions are not really valid. For instance, the standard representation of enzyme-catalyzed reactions is the Michaelis-Menten function [106–108], although the biochemical assumptions underlying the use of this function are typically not satisfied for metabolic pathways in vivo [4, 12, 13]. At the same time, this function has been used to study processes that have little to do with enzymes or biochemistry, such as the uptake of nutrients from soil through roots [119]. In canonical approaches, the representation of such a process is formally prescribed and even guaranteed to be correct within some limits.

Second, the result of a canonical model design is by definition a homogeneously structured model that permits analyses that are almost independent of the size of the model. Similar to the case of linear models, for instance, canonical Lotka-Volterra models and S-system models within BST permit straightforward analyses of steady states and their features, no matter how many variables are involved; we will discuss this feature later in detail. As a very practical aspect, a homogeneous model structure facilitates the development of customized software. Such software can be tailored specifically for the canonical structure and optimized in unique ways, because it does not have to be prepared for eventualities that often emerge in ad hoc models. As an example, a numerical solver for systems of power-law differential equations does not have to anticipate the occurrence of poles or other ill-defined situations and can therefore be optimized in unique ways [85–87]. Similarly, different efficient solvers for sensitivity computations and boundary value problems made use of the homogeneous structure of BST models [88, 120–127].

Third, well-chosen canonical models come with some guarantees regarding their accuracy. Because they are essentially always the result of specific approximations, they are known to be exact at some operating point of choice and very accurate close to this point. At the same time, it is clear that their accuracy is of unknown quality if one moves away from this point. This issue, however, is a genuine feature of all models in biology and will be discussed later in more detail within the context of BST.

Fourth, canonical models possess an interesting property that has been called telescopic [128]. Because these models are always constructed according to the same principles, the specific organizational level for which the model is designed is immaterial. Thus, whether a model represents the dynamics of genes, metabolites, organisms, or populations, the model structure is always the same. If an additional, more detailed module is created at a lower level than a model, its structure is guaranteed to be the same, and the result can be seamlessly incorporated into the model at the higher level. As a consequence, canonical models are natural starting points for multiscale modeling approaches.

Finally, canonical models permit objective comparisons, because they only differ in parameter values, but not in structure. By contrast, if two ad hoc models are to be compared, it is not even clear how many parameters are to be considered. For instance, the typical Hill function apparently has two parameters ( and ). However, one could count the Hill coefficient as a third parameter, which happens to be equal to 2 in this formulation, but could be changed to a different value. More generally, it is all but trivial to compare different functional forms in an objective manner. As a specific example, consider a Hill model and a generalized logistic model, which have very similar graphs but different formats and different numbers of parameters (see Figure 1). Two canonical models of the same kind are always much more similar, because they have the same structure and types of parameters, thus allowing direct, fair comparisons of models of the same size and even of nested models that include more and more parameters [129].

Figure 1: Similar shapes do not imply similar functions. Although the shapes of the two graphs are very similar, the models generating them are structurally distinctly different. The blue line is the plot of a three-parameter Hill function, namely, with , , and , while the red line is the plot of a generalized logistic function with the four parameters , , , and . Other sigmoidal models are compared in [4].

All canonical models have a certain appeal from a conceptual point of view, but different choices of models have their genuine advantages and drawbacks, and, as always, they all constitute different compromises with respect to structural suitability, accuracy, mathematical and computational tractability, complexity, their numbers of parameters, and a host of other features. While this paper focuses primarily on BST, alternative canonical approaches, using ordinary differential equations (ODEs), should be mentioned.

Before we discuss alternative canonical models in detail, it is useful to introduce generic nomenclature. We distinguish two types of variables. Dependent variables are possibly affected by the action of the system and may change over time. In a system of differential equations, each dependent variable has its own equation. Independent variables are either constant or follow a dynamic that is controlled from outside the system. They typically do not have their own equations. Examples are the brightness and temperature during the day-night cycle, an externally managed feeding regimen, or an enzyme activity that is believed not to change during a numerical experiment. Parameters are placeholders for numerical values that make the model specific. Their values are constant throughout any given (computational) experiment, but may be changed from one experiment to the next. Fundamental constants such as and are sometimes used but not as explicit model components.

The generic format of ODE models for biochemical, and various other biological, systems is Here is the vector of dependent variables, is the stoichiometric matrix, and is a vector or reactions. The stoichiometric matrix describes which variables are involved in which reaction [130].

As an example, consider the model of a branched pathway system, as shown in Figure 2. The system contains three dependent variables (, , and ) and five reactions . Thus, the stoichiometric matrix has three rows and five columns and reads Positive entries correspond to influxes, while negative entries signify effluxes from a metabolite pool. Most entries are 0’s and 1’s, but other quantities may account for the stoichiometry of splitting or merging reactions. The vector of reactions directly shows the format of the canonical (or noncanonical) model. For instance, each could be a linear function, a Michaelis-Menten or Hill rate function, a power-law function, or some other representation.

Figure 2: Generic pathway with one feedback signal. The pathway is fed by a precursor , which could be a dependent variable, but here is modeled as an independent variable with a constant value. is used as a substrate for the production of and . exerts feedback inhibition on the production of . Each process may be modeled in a variety of ways, for instance with a Michaelis-Menten or Hill function, or with a power-law representation.

3.1. Types of Nonlinear Canonical Models

3.1.1. Lotka-Volterra Models

The oldest and best-known nonlinear canonical modeling structure is the Lotka-Volterra (LV) model, which typically describes interactions among populations [131–136]. Specifically, the dynamics of a population is described as a sum of one linear term and some or all binary interactions between any two populations, which leads to the formulation This formulation contains a quadratic term for variable in its own equation, which is often interpreted as a crowding term that becomes important when a population grows too large. Any of the parameters or may be positive, negative, or have values of 0. If all variables are strictly positive, one may divide both sides of each equation by , and the result is a system in the format: where the change in the logarithm of a variable is given as a linear function of all variables. This formulation is quite intriguing, because it turns out that many nonlinear canonical forms contain three ingredients: differentiation, summation, and the logarithm of variables.

The intriguing aspect is that every LV model has this same format and that the only differences between two models are the number of variables (equations) and the numerical values of the parameter values. One might obtain the impression that the format severely limits the repertoire of possible model responses. However, this impression is wrong, and LV models can represent the most complicated nonlinearities [21, 134], including deterministic chaos. For instance, the graph in Figure 3 is the output of an LV system with just four variables [71, 137, 138].

Figure 3: Chaotic oscillator. The Lotka-Volterra format looks deceiving restrictive, but even an LV system with only four variables is capable of exhibiting deterministic chaos. See [71, 137, 138] for further details.

Although LV models have a long history in ecology and are very rich in their possible responses, they are not well suited to describe biochemical systems. The reason is that this specific canonical format is incompatible with basic functionalities of pathways of enzymatic reactions. As a simple, generic example, consider a pathway containing a bimolecular reaction and one feedback signal, as depicted in Figure 4.

Figure 4: Generic pathway for which an LV model is not suited. Like many biochemical systems, the pathway contains inputs, a bimolecular reaction, and a feedback signal. Some of these features are not congruent with the binomial features of an LV system.

This system is generically modeled as with some functions that we need not specify for this illustration. The LV format has problems with several of the processes in this simple example. A constant input to the system is incongruent with the LV format; it would have to be formulated in LV as a linear function of or , respectively. The reaction from to is a problem in the equation of , because the corresponding term describing the production of should include as a substrate, as well as the inhibitor , but not itself, because does not contribute to its own generation. The generation of should be modeled with a term containing and , but not , which, again, is problematic. Thus, while LV models have been extremely successful for systems of pair-wise interaction and simple growth processes, they are not suitable for systems of biochemical reactions. Their previously mentioned generality and flexibility are the result of defining auxiliary variables that artificially increase the size of the system (see the later section on Recasting for parallels to BST).

3.1.2. BST Models

BST prescribes canonical models in which every process is formulated as a product of power-law functions. BST permits several variants, as we will discuss later, but once a variant is chosen, the resulting model always has the same homogeneous structure. Similar to the cases of linear and LV models, the only differences are manifest in the number of equations and the parameter values.

BST has two roots: first, Hendrik Wade Bode (1905–1982) showed that a ratio of polynomials can be represented in small pieces by straight lines, once a logarithmic transformation has been applied to the dependent variable and the function [1, 101, 112]. Second, Brook Taylor (1685–1731) had shown much earlier that any sufficiently smooth function (with sufficiently many continuous derivatives) can be approximated with a polynomial of order . For , the approximation becomes equivalent with the approximated function, but, even for small , the approximation is exact at one point of choice, called the operating point, and very accurate close to this point. Further away, the two typically diverge, but general statements characterizing the rate of divergence and the accuracy of the approximation are seldom practically helpful, even though they can be formulated. Specifically, the sufficiently smooth function with at least continuous derivatives is represented at the operating point as The quantities , , , and denote the first, second, third, and th derivative of , respectively. The higher derivatives contribute less and less to the representation, because they are divided by factorials , which rapidly become large. Arguably the most useful variant is linearization, where , and the result is The slope is given by the derivative , and the intersect is . Figure 5 illustrates this linearization with the function at the operating point (for details, see [6]).

Figure 5: Taylor linearization of a nonlinear function. In this illustration, (red) is the linearization of a vertically shifted exponential function (blue), developed at the operating point .

Figure 5 immediately indicates that the range of accurate representation may be small. However, in many practical cases it is sufficient. For instance, consider the clearly nonlinear function in Figure 6. If the dependent variable always operates within a range such as [2, 5], the linearization may be sufficient and is certainly much simpler.

Figure 6: The quality of an approximation may be sufficient throughout certain ranges of a dependent variable. In this illustration, (blue) is the linearization of the more complicated nonlinear function (red). If only operates within a range between about 2 and 5, is sufficiently accurate and easier to analyze.

BST uses this linearization strategy, but because the goal is a nonlinear canonical form, the approximation is executed in logarithmic coordinates. Specifically, one linearizes   as a function of  , and the results are always of the form . The kinetic order, that is, the exponent , is computed first. Executing the Taylor approximation in logarithmic space leads to the result that is equal to the derivative of with respect to , multiplied by , divided by , and evaluated at an operating value of that we may choose. For instance, consider the task of computing the power-law representation of the function at the operating point . We obtain directly For specific values such as , , and , at the operating point is 1.036.

At the operating point, and its power-law approximation must, by definition, have the same value. This fact allows us to compute the rate constant as follows: The value of at the operating point () is 0.619, and we have already determined as 1.036. Therefore, . It is clear that the choice of a different operating point leads to a different power-law representation. Two examples are illustrated in Figure 7.

Figure 7: The function (blue) is approximated with two power-law approximations at (red) and (green). At the two operating points and , the approximations have exactly the same values and slopes as . The ranges of suitable representation are about (3, 14) and (12, 20).

Studying the steps of the Taylor approximation in more detail, one finds that a positive effect of a variable on a function results in a positive kinetic order, that a negative effect, such as inhibition, results in a negative kinetic order, and that a kinetic order of 0 corresponds to the situation where the function is not affected by the variable at all. These correspondences are of tremendous value for designing BST model, as we will discuss later.

The derivation of the power-law terms also indicates that nothing is really limited to biochemistry. As long as variables and functions are positive-valued, BST equations can be developed whether the application is biochemical, biological, or comes from some other field.

One intriguing feature of Taylor’s method is that it applies in an analogous fashion to functions of several dependent variables. The only true difference is that the derivatives in this case are partial derivatives. Specifically, if one wants to approximate the function as a power-law function, the results are already known to have the format . The kinetic order is computed as and the analogous is true for . As before, the rate constant is computed by equating and the power-law term at an operating point of choice.

As an example, consider a generalized Monod model, which describes the growth of a microbial population in a fermenter. It depends in this example on the substrate and is also affected by the alcohol that is generated in the fermentation process (cf. [139–141]). A suitable formulation is where , , and are parameters that characterize the growth and product inhibition characteristics. We already know the format of the corresponding power-law representation, which is The kinetic orders and the rate constant are calculated as described above, and the result is see [4]. All three quantities are to be evaluated at some operating points of our choice. Because it represents the effect of the substrate on the process, is positive. By contrast, is negative, because it represents product inhibition. As in the one-variable case, any multivariate power-law model is a local representation that is exact at the operating point, very accurate close by, and of ill-characterized accuracy everywhere else. A detailed example of how these representations enter a complete systems model is given in a later section.

3.1.3. Other Canonical Models

A generalization of BST models, as well as the LV format, is the Generalized Lotka-Volterra model. In this format, any power-law term that appears in any equation is included in every equation, if necessary with a multiplier of 0 [142–148]. As a result, all equations formally contain a sum of the same terms. This structural homogeneity, although somewhat artificial, permits higher-level algebraic manipulations that can be used for elegant classification purposes. However, as first-line models for the practical analysis of pathways, this format is overly complicated.

Other canonical forms have been proposed more recently. The first is the lin-log model, which is linear in logarithmically transformed variables, which are all expressed in relation to their normal reference values [62, 149–151]. As a result, a process description in a lin-log model always has the form: where the are metabolites and modulators, are enzymes, and variables with index 0 are the corresponding reference values. Furthermore, is the flux rate, and is the reference steady-state flux through the pathway. The parameters are reference “elasticities,” which play the same role as kinetic orders in BST. Lin-log models are directly related to the analytical framework of Metabolic Control Analysis (MCA), which targets the effects of parameter changes on the steady state of a pathway system. Many comparisons between BST and alternative approaches, including MCA and lin-log models, have been presented throughout the history of BST [32, 42, 52–55, 58, 59, 62, 63, 152–166]. In terms of accuracy, power-law models are better suited for small substrate concentrations, and lin-log models for large concentrations, and combinations of models often turn out to be most accurate over wide ranges of variations in variables [167] although these combinations lose the key advantage of structural homogeneity of canonical models. The collective experience with the theory and applications of lin-log systems is so far much smaller than for LV systems and the variant formats within BST.

Another more recent canonical modeling format is the representation of metabolic processes with sigmoidal modules of Hill-type, rather than power-law functions [42, 168, 169]. Thus, a process involving two variables is represented as where , , and , , are parameters. As one might expect, this formulation permits greater flexibility than the corresponding power-law representation but requires more parameter values.

Vinga and colleagues compared BST with the concepts of dynamic energy budget theory and proposed a combined approach that used aspects of both [170]. Her group also presented a comprehensive comparison of several modeling frameworks, including BST, flux balance analysis (FBA), and Petri nets [171]. Wu and Voit embedded BST into hybrid functional Petri nets, which expanded the range of phenomena that could be modeled [172–174] (see also [175]). They also considered stochastic analogues to GMA systems [176]; see also [177].

4. Model Design, Parameter Estimation, and Diagnostics in BST

A great advantage of BST models is the simplicity with which the modeling process can be initiated [3, 16, 30]. This simplicity is directly related to the theory behind the power-law representation, which assigns a direct and unique interpretation to each parameter.

4.1. Setting Up Equations

The typical starting point of model design is a pathway diagram, as we saw it in Figure 2, but which in real applications is usually much larger and more complicated. Even for large systems, a diagram of pools and processes immediately dictates how a model is to be set up. Two basic decisions have to be made. First, which of the variables should be declared as dependent and which should be independent? And second, which modeling format should be chosen? The first question requires biological insight and good judgment that balance realism and practical feasibility, because a dependent variable ultimately requires much more input information than an independent variable. In response to the second question, we focus primarily on BST, which permits a choice among a few alternatives.

The main ingredient of BST is the power-law approximation of all processes in the system, as it was discussed before. While this core concept is immutable, it leaves a residual degree of freedom, which leads to different variants within BST. This variability stems from differences in the order in which the processes in the system are formulated and approximated. Coarsely speaking, one may approximate every process in the system separately, which leads to the Generalized Mass Action (GMA) form, or one may aggregate some processes first and then approximate the result, which leads to S-systems and Half-systems. The differences are most clearly illustrated with an example, and we consider for this purpose again the branched pathway that was shown before in Figure 2.

The construction of equations is facilitated by the interpretation of kinetic orders, as discussed earlier: positive and negative effects correspond to positive and negative kinetic orders, respectively, and, importantly, if there is no effect, the kinetic order is zero. For instance, considering the process in Figure 2, we know immediately that it will exclusively contain as a variable. Process contains variable with a positive kinetic order and with a negative kinetic order, because it is an inhibitor. Applying these rules, we obtain the symbolic BST equations This format models every flux independently of others, but inspection of the diagram mandates some equivalences between terms, because the same processes sometimes appear twice; namely, we need to require and , as well as and . This format, which focuses on processes, is called the Generalized Mass Action (or GMA) format.

An alternative is the S-system format. This terminology first emerged in the mid-1980s [11, 18] and refers to the fact that this system representation, in a minimal fashion, is capable of representing “synergistic and saturable” phenomena. The S-system form focuses on the pools (dependent variables) and collectively formulates all incoming processes and all outgoing processes in one term each. If there are no branches, there is no difference to the GMA format. However, there is a notable difference where two processes diverge from . In the GMA format, the loss of is represented with the two terms . In the S-system format, one argues that the loss of only depends on , thus leading to the single, aggregate term . At the operating point, the two formulations are exactly equivalent, but for other values of they are generally different, unless and happen to have the same value. Thus, the S-system model with typical parameter names is If and have different values, is a weighted average of the two, and the weights are the flux rates toward and . Thus, the following constraints have to be satisfied for the S-system and the GMA system to be equivalent at the operating point of choice: Although the functional representations at branch points are different in the GMA and S-system forms, the dynamics of the resulting models is often rather similar. For instance, if the branched pathway system in Figure 2 is initiated away from the steady-state operating point, the two transients are essentially the same (Figure 8).

Figure 8: Although GMA and S-system models are mathematically different, their responses are often similar. Shown here are responses of the branched pathway model in (18) and (19) (see Figure 2). Parameter values are ; ; ; ; ; ; ; ; ; ; ; ; ; . Initial values are ; ; . Dots and subscripts S indicate S-system responses, while lines and subscripts G refer to the corresponding GMA system.

In the Half-system format [113], all processes contributing to the dynamics of a variable are collectively represented in a single power-law term, and the corresponding representation for the branched pathway is

The three representations are mathematically different and have their genuine advantages and disadvantages. The greatest advantage of the GMA format is that it is the most intuitive: it focuses on fluxes, and every flux is mapped directly onto one power-law term. The S-system representation focuses on pools (variables). Its greatest appeal is its simpler two-term format, which leads to unusual mathematical opportunities, which we will discuss later. In particular, the steady state of an S-system can be computed with methods of linear algebra, whereas other formats, including GMA, require more complicated methods [178–180]. Maybe surprisingly, the S-system format is also the more accurate representation for functions with a hyperbolic shape, that is, functions that start at a small value and monotonically grow toward saturation, such as a Michaelis-Menten rate function. The Half-system form has the simplest mathematical structure, which permits, for instance, very simple means of parameter estimation from time series data [181]. However, it can only capture steady states in which at least one variable is zero; otherwise the dynamics continues to increase or decrease. In the section on recasting, we will introduce the even simpler format of Binary Systems, which are still surprisingly rich in their repertoire of responses [113].

All these formats possess the telescopic property [128]: the overall response of a model at a lower level may be approximated as a power-law term, which can replace a dependent variable at a different level, and since any power-law term, raised to a power, is again a power-law term, the format is preserved at the new focus level.

Summarizing the main variants within BST, the different orders of flux aggregation and power-law approximation always result in the following formats.(1) If every process is modeled with its own power-law representation, the result is a GMA system. Each equation in a GMA system with dependent, independent variables, and terms has the format (2) If, for each (metabolite) pool, all incoming processes and all outgoing processes are first aggregated and then collectively modeled with one power-law representation each, the result is an S-system. Each equation in an S-system with dependent and independent variables has the format (3) If all processes affecting a (metabolite) pool are aggregated and then collectively modeled with a single power-law representation, the result is a Half-system. Each equation in a Half-system with dependent and independent variables has the format

No matter which representation is chosen, the procedure of setting up symbolic equations is fully prescribed and easily learned by novices [182].

4.2. Parameter Estimation/Inverse Problems

Once one has decided which variables should be dependent or independent, the construction of model equations in BST is straightforward. Indeed, it is possible to write computer programs that automatically set up correct equations [45, 91–93] (see also [30]). The equations thus established are initially symbolic, which means that numerical values have not yet been assigned to the parameters. Nonetheless, a big step forward has been made, and this step would have been much more difficult without a canonical modeling structure. The next step is usually parameter estimation, that is, the assignment of numerical values to all parameters in the symbolic equations, including the initial values, for all differential equations in the system. Uncounted methods have been developed for this difficult step, but none of them is ideal in all situations. Interestingly, the history of models has iteratively experienced phases of relatively high and low data availability, which had a direct effect on parameter estimation methods [19].

Parameter estimation and structure identification are arguably the most difficult steps of a biological systems analysis. In pure parameter estimation tasks, the model structure is assumed to be fully known, whereas structure identification refers to the situation where the topology and regulation of a system are uncertain, as well as the parameter values [70]. Clearly, the latter is more difficult than the former.

Until recently, almost all parameters of biological systems were estimated in a bottom-up fashion [49]. In the case of biochemical systems, one searched for kinetic information pertaining to individual enzymes, modeled each reaction step in isolation, and then merged all models of these steps into comprehensive systems models. In most cases, the pieces did not truly fit together, with the result that the integrated model exhibited unrealistic responses. These prompted a revisiting of the model and the kinetic information and often resulted in a long drawn-out process of refinements and parameter tuning. Good examples of such extensive model construction efforts are [37, 183–189].

Different approaches were proposed by Sorribas’ group, who proposed using receiver-operating characteristic curves [190], or nonlinear regression methods [191–193]. An advantage of BST models for all these estimation tasks is the fact that every parameter has a clear and direct meaning, which often permits the definition of relatively small search ranges, especially for kinetic orders [3].

Somewhat of a transition from the local estimation of process descriptions to global data was an approach that uses dynamic data, but only close to an operating point. Namely, it was proposed to use linearized equations for studying system responses to small perturbations around the steady state and to estimate the Jacobian by simple multilinear regression [194, 195]. Similarly, Sorribas proposed the numerical characterization of BST systems from transient response of systems to perturbations [191, 196–199]. Savageau noted that models can be identified, in principle, from sensitivity profiles [200].

As early as 1982, Voit and Savageau proposed a drastically different estimation method for situations where metabolite concentrations had been measured at successive time points [16, 201]; similar ideas were presented in the same year by Varah [202]. The basic idea is to replace the differentials on the left-hand sides of a system of differential equations with slopes that are to be estimated from the time series data at sufficiently many time points. The result of this procedure is a system of algebraic equations. This system consists of sets, where is the number of dependent variables and is the number of time points at which slopes are estimated. This conversion of differential into algebraic equations avoids all numerical integrations, which in typical cases consume more than 95%, if not 99%, of the overall time to estimate parameter values [203]. The slope-substitution method is not without problems though, because the variable time becomes implicit, which can lead to misinterpretations of the data [203] or a “time-warping” of the solution [6]. Nonetheless, the slope estimation strategy is statistically valid [204] and can, at the very least, be used to develop coarse solutions from which to start regular parameter optimization approaches. Reviews of this subfield include [68, 69, 205–214].

The early articles did not receive much attention, presumably because biologists very rarely generating time series data. However, when the same ideas were reviewed in a textbook [3] and declared as a bottleneck in model analyses, a flurry of algorithms was proposed to deal with time series data. In almost all cases, these algorithms worked fairly well for some applications, but failed for others, and the estimation community is still awaiting a truly exceptional solution.

The vast majority of estimation strategies from time series data made use of evolutionary algorithms and, in particular, genetic algorithms. Very many of these approaches were proposed by the groups of Okamoto, Kimura, and Tomita and applied to gene regulatory networks of different sizes. Each strategy presented a new variation or combination of techniques that improved performance, at least with respect to the presented applications. As the goal of many of these studies was the identification of interactions between pairs of genes, the parameter estimation became almost identical with structure identification, where corresponding kinetic orders were either zero (no interaction) or nonzero (interaction). Because numerical estimations seldom return 0 as the optimal value, different pruning strategies were implemented to replace small optimal value with 0, thereby simplifying the inferred network structure. Representative examples of this line of research in microbial systems are [195, 215–276]. Wu and collaborators applied similar approaches to the analysis of a eukaryotic cell-cycle gene network [277, 278].

Genetic algorithms were not the only proposals for the estimation task. Also using evolutionary methods, Mendoza’s group developed a method for estimating parameters in GMA systems, based on particle-swarm optimization [279–281]; see also [282, 283]. The group also tested ant colony optimization [284, 285] and simulated annealing [286, 287] (see also [288, 289]) and provided a benchmark system for comparing different approaches [290]. McKinney and Tian proposed an artificial immune system for the same estimation purposes and compared various underlying models [291]. Lee and Yang used a clustering approach [292].

Alternatives to evolutionary algorithms included least-squares regression [170, 293, 294], Kalman filter methods [295], and neural networks [203, 296, 297]. Yet other approaches to the same problem employed interval and Newton-flow analysis [298–302]. Chou and colleagues devised a method specifically for the estimation of S-systems, which alternates between the estimation of alpha- and beta terms [303, 304]; see also [305]. Tian and collaborators proposed a different type of alternating estimation, where linear and nonlinear parameters are estimated separately [306]. Lall et al. made use of precursor-product relationships in a metabolic pathway to estimate parameters [307, 308]. Chen et al. proposed a network component analysis for deducing the dynamic features of regulatory signaling systems [309].

Wang’s group suggested collocation methods that convert ODEs into algebraic systems and combined them with a hybrid differential evolution strategy that was able to find a global solution [310–314]. The group also proposed a multiobjective optimization approach of model inference [315, 316]. Others used fuzzy multiobjective optimization [317, 318]. Different groups used global optimization methods, based on branch-and-reduce techniques, to estimate parameter values in a metabolic system [319, 320].

Several authors used hybrid methods that combined evolutionary algorithms or genetic programming with statistical analysis or Monte-Carlo techniques [249, 321–323]. Others proposed various decomposition schemes for different types of parameters [255, 324–326].

Numerous groups utilized biological or numerical constraints to ameliorate the estimation challenge. Hecker et al. [327] and Mao et al. [328] demonstrated that the incorporation of information from different data sources, such as sequence and protein-DNA interaction data, benefits the network inference process. Hatzimanikatis’ group inferred gene regulatory networks by using an S-system method that was constrained with additional data on protein kinetics [329, 330]. Lecca and colleagues presented an estimation strategy for BST models based on a probabilistic model of the noise in experimentally measured metabolite concentrations [331]. Daisuke and Horton argued that gene expression networks are typically scale-free and that this property could be used to constrain the S-system-based network inference process [260]. Ko et al. constrained the estimation problem for GMA systems by using connectivity information of the pathway system, which is fundamental to metabolic control analysis (MCA) [332]. Indeed, since elasticity coefficients in MCA are equivalent with kinetic orders, the estimation techniques for these coefficients are applicable to BST models as well (e.g., see [333]). In contrast to these successes, Calçada and coworkers did not find benefits from restricting the inference task with topological constraints [334].

An important prerequisite of all methods that substitute derivatives with slopes and thereby decouple the system of differential equations is the adequate estimation of slopes directly from the time series data. Seatzu proposed B-splines [335, 336], and Vilela et al. composed a smoother that accounted for the noise structure in the data [337, 338]. Wang et al. compared various alternatives, including B-splines [339]. Nounou and coworkers used a multiscale filtering approach to denoise the data [340]. In addition to smoothing, it was also seen as useful to identify details of the system topology in order to prime the estimation process [341].

4.3. Network Reconstruction and System Identification

While essentially all estimation methods described above had as the ultimate target “the one optimal solution,” several groups in recent years emphasized that biological systems models are not necessarily completely identifiable from the available data [342], but “sloppy” [343], and that one might be better advised to look for entire domains within the parameter space that correspond to similarly good solutions; for BST related studies see [322, 323, 344].

For canonical models, the transition between parameter estimation and structure identification or network reconstruction is fluid, because the structure of the inferred system changes if a rate constant or kinetic order parameter value becomes 0. Therefore, many of the estimation studies described before are to some degree structure identification or network reconstruction analyses. In addition, several approaches were proposed specifically for structure identification, and they are briefly discussed here.

As already mentioned, Sorribas’ group proposed the numerical characterization of BST systems from transient responses of systems to perturbations about the steady state [191, 194, 195, 197, 199].

Specifically addressing the direct relationship between parameter estimates and the structure of S-system models, mixed integer linear programs (MILP) and multiobjective optimization approaches were proposed to estimate both, structure and parameter values [345, 346]. Marino and Voit devised a semiautomated model-finding approach for identifying the minimal connectivity of a system as well as its parameters [129]. Khoury and colleagues developed a symbolic method for learning dynamic models of compartmental systems, which combined genetic programming with a fuzzy representation environment [347].

Spieth and collaborators developed novel optimization methods to evolve the topology of a gene regulatory network as well as its parameter values, based on microarray data [348–353]; see also [354]. Liao’s group combined S-system concepts with the method of network component analysis (NCA) for the estimation of transcription factor activity [355]. Given that most genes are regulated by only a few transcription factors, the authors developed criteria for the identifiability of transcriptome networks that are effective even if the input information consists of sparse microarray data. Alves and colleagues used a combination of bioinformatics and structural biology, along with genomic, proteomic, and metabolic time series data, to reconstruct pathways and generate novel hypotheses [39]. Liu and colleagues devised a structure identification method that combines parameter estimation with a pruning strategy that adds a regularization term to the objective function and prunes the solution according to a user-specified threshold value [356]. Džeroski and Todorovski proposed machine-learning methods [212].

Schnell’s group reconstructed a system model for glycolysis in the bacterium L. lactis from time series data (see [357]), using a global nonlinear modeling technique that identifies the elementary reaction steps constituting the pathway [358].

Searson and colleagues developed a hybrid S-system approach for the inference of chemical reaction networks, based on time series data from fed-batch experiments, where essentially no a priori information regarding products and reactants was available [359, 360].

Kattas et al. [361] compared network identification strategies using GMA, S-system, or linear models. They tested the methods against three benchmark problems (with and without noise) that were designed to highlight specific features of biochemical pathways. They implemented the methods into algorithms and were able to obtain better results than competing methods.

Voit’s group proposed methods for identifying the functional shapes of fluxes in a metabolic pathway system, based on metabolic time series data [362–366].

Ndukum and colleagues addressed a different type of inference from time series data. Namely, they asked whether the difference between two dynamic substrate uptake profiles in yeast cultures were statistically significant [367]. A similar task was addressed by Kawagoe et al. [368].

Ferreira and collaborators designed kinetic essays for optimal model selection, under the assumption that two models were already parameterized and provided equivalent solutions [369].

Veflingstad and colleagues demonstrated that it is beneficial to obtain as much qualitative information about a system as possible before the system structure is identified [341].

As noted earlier, the structures of systems have also been assessed with large-scale simulations and post hoc filtering processes that distinguish acceptable from undesired structures [322, 323, 370–374].

Němcová [375, 376] developed a rigorous theory to characterize the identifiability problem for deterministic classes of polynomial and rational systems and noise-free data. She used an algebraic approach to realization theory and demonstrated that the biological systems in question, including BST systems, are smooth nonlinear Nash systems [377]. Němcová applied her results to a number of systems, including a glycolytic pathway model for the bacterium L. lactis [357]. Papachristodoulou and Recht addressed the interconnections in chemical networks by minimizing the one-norm of all possible reaction rates [378]. While they demonstrated the method with mass action kinetics, this method also applies to power-law systems.

4.4. Steady-State Diagnostics

With BST equations formulated and parameter values assigned, the initial model design is complete. However, before the model is utilized for its intended purposes, it should be diagnosed for internal and external consistency and robustness. This diagnostic phase of the model analysis typically begins with the identification of steady states. These states are characterized by the fact that none of the variables changes although material may flow among the variables. For S-systems, this step is surprisingly simple [100], while it is much harder for GMA systems.

4.4.1. Steady-State Computations

Suppose that none of the variables is zero and that every equation in the S-system has both terms. At the steady state, all differentials on the left-hand side of the equations must be zero, because none of the variables changes. Thus, we obtain Moving the -term to the right-hand side, we can take logarithms of both sides, which yields Recalling basic properties of logarithmic, exponential, and power-law functions, these terms can be simplified. In particular, if we rename the variables = and rearrange the equation, we obtain the result Further renaming for all and and defining = leads to steady-state equations of the S-system model that are linear: see [100]. This system has equations and variables, which include dependent and independent variables. In typical modeling situations, the values of the independent variables are assumed to be known, so that the linear system can be solved. For many purposes, it is useful to formulate these equations in matrix format, which reads see [200]. In this formulation, the dependent variables, collected in vector , are separated from the independent variables, which are collected in vector . The matrices and refer to the system in (28), with the former corresponding exclusively to dependent variables and the latter to the effects of independent on the dependent variables. The matrices and contain sensitivity and logarithmic gain values, which in a different manner describe the effects of parameters and independent variables on the steady state of an S-system.

The matrix formulation in (29) is very interesting, because it says that linear algebra may be used to compute steady states of arbitrarily large S-systems, as long as no variables or rate constants are zero. If indeed one or more of the variables are zero, or if terms in the S-system are zero, one must consider these special cases one by one [1]. For later biological interpretations, one must remember to translate the results back from ’s to ’s with an exponential transformation. While the formulation in (29) reflects most situations, the steady-state equations have also been used “in reverse” to compute which values of the independent variables would move the system to a desired steady state [379, 380].

Although S-systems and GMA systems are very similar, the computation of steady states in GMA systems is incomparably more complicated. In fact, there is no algebraic method that generally solves this problem. Complicating matters, and in contrast to regular S-systems, GMA systems can have multiple nontrivial steady states. These are to be determined with search algorithms which, however, are not guaranteed to find all solutions [178, 179]; see also [381–383]. One may also solve the GMA system dynamically, but this strategy only leads to the one stable steady state in whose neighborhood one initiates the solution.

4.4.2. Local Stability

The next diagnostics is the characterization of the model at the steady state(s). The first feature to be tested is local stability. The question is: If the model is slightly perturbed away from the steady state, will it return to this steady state on its own accord? If so, the steady state is locally stable; otherwise it is not. Most, but not all, biological systems are locally stable, and one typically observes that they tend to maintain the same steady state, which is sometimes called homeostasis.

Local stability could be assessed with perturbation studies that move the system slightly away from a steady state and test whether the system returns. A potential issue with this strategy is that one would have to select directions for the perturbations, thereby making the method vulnerable to bias and possible omissions of interesting cases. A more elegant and general method is the computation of eigenvalues. These are complex numbers, each consisting of a real and an imaginary part. A system possesses one eigenvalue for each dependent variable. If and only if all real parts are negative, the system is stable. For S-systems, the determination of eigenvalues is relatively simple. For small systems, the eigenvalues can be determined with a Routh-Hurwitz analysis [1]. For larger systems, it is achieved essentially immediately with software programs like PLAS [89], PLMaddon [94], or any other software that supports eigenvalue analysis. If the imaginary parts are not zero, the system has the potential of exhibiting oscillations [1, 102]. A useful representation of the stability of a small system is the root-locus plot [30]. Lin and colleagues used Lyapunov theory to determine the stability of a cascaded S-system [384].

In relatively rarer cases, biological systems may also have two (or more) stable steady states, and it is possible that external or internal controls cause these systems to “toggle” between the two states (e.g., see [36, 385, 386]). In such a case, the system may also exhibit hysteresis, which means that its approach toward either one of the states depends on its recent “history.” A BST example of a bistable system with or without hysteresis is a two-component system, with which microorganisms sense and respond to their environment [387–390]; see also [6]. Depending on the regulatory structure of this type of system, one observes hysteresis or not.

4.4.3. Sensitivity and Robustness

A second feature that is easy to compute for S-systems, due to their linear steady-state equations, is the profile of sensitivities. Each sensitivity measures how much a steady-state feature changes if one of the parameters in the system is varied by a very small amount [10, 200, 391]. Specifically, a metabolite sensitivity of +5.4 means that a one percent change in the parameter in question leads approximately to a 5.4 percent increase in the given metabolite at the steady state. A sensitivity of −3.2 corresponds to a 3.2 percent decrease. Sensitivities can also be computed with respect to fluxes. Strictly speaking, sensitivities are infinitesimal quantities, but they are excellent predictors for the effects of small, or even moderate, changes. Changes in steady-state features in response to small variations in independent variables are called logarithmic gains. Similar to sensitivities, these quantities are easily computed for S-systems [163, 200, 391]. These features can also be computed for GMA systems, but the computation is more complicated [3, 392].

Local stability and sensitivity analyses are the main diagnostic tools for assessing the internal consistency of a model. As an extension, Salvador [393–396] explored the effects of simultaneous changes in two parameters on the steady state, using methods of advanced linear algebra. Guebel computed sensitivities for BST-like models that included the second-order term of the Taylor approximation [397]. Additional diagnostic tools include criteria of robustness and noise attenuation [398–405]. Shi and colleagues studied the balance between robustness and fragility in biochemical networks [406]. Several articles expanded the concepts of gains and sensitivities to questions of dynamics [124–127, 407–412]. These analyses assess how changes in initial values affect the transient responses of a system. Horner analyzed sensitivity profiles with Monte-Carlo simulations rather than analytically [413]. Drengstig and coworkers noted that sensitivity coefficients of reaction networks are closely related to transfer functions that are used widely in control engineering [414].

Due to the regular structure of BST models, it is even possible to use computer algebra to characterize steady-state features of S-systems in symbolic, nonparameterized models [415].

4.4.4. Structural Stability

Local stability analysis addresses the response of a system close to a steady-state point. A different type of diagnosis, called structural stability analysis, addresses situations where the behavior of a system changes in a qualitative manner, which means that not only the numerical value of some feature changes, but that the feature changes from one class of behaviors to another. The best-studied situation consists of a slight persistent change in a parameter value that causes the system to lose (local) stability. The steady state thus becomes unstable, and the system may exhibit a stable oscillation surrounding the now unstable point. The specific value of the altered parameter where this change happens is called a (Hopf) bifurcation point, and the stable oscillation is called a limit cycle [416]. An example is the following small S-system, which could represent two genes that affect each other’s expression (Figure 9): The system has a unique nontrivial steady state at , which is easily checked by computing the eigenvalues, for instance in PLAS. They are . In the time domain, both variables oscillate with decreasing amplitude toward the steady state (Figure 10), which they strictly only reach for .

Figure 9: A small system capable of exhibiting stable limit cycle oscillations. The variables and could represent genes or metabolites that mutually activate each other’s expression or production. furthermore inhibits its own degradation.

Figure 10: Oscillations in the small system of Figure 9. With the parameterization of (30), the system exhibits damped oscillations.

Now, we slightly change the rate parameter with value 0.9 in the first equation. For instance, for 0.95, the oscillations have a similar appearance, but the amplitude decreases more slowly (results not shown). The speed is even slower for 0.99 and 0.999. In the latter case, the eigenvalues are . A Hopf bifurcation occurs if the parameter crosses the value of 1, where the real parts of the eigenvalues switch from negative to positive. For a rate parameter with value 1.01, the amplitude initially decreases but then stabilizes (Figure 11). The result is seen more clearly in the phase plane, where is plotted against . Here, the expression limit cycle becomes evident, because the system is first spiraling but ultimately cycling along the same quasielliptic trajectory or orbit. To generate the blue inward spiral, the system is initiated outside the limit cycle, here at . The same system, initiated inside the limit cycle , generates a green outward spiral, which in the illustration so tight that it appears as a solid ring. The two spirals both approach the same limit cycle.

(a)

(b)

Figure 11: Limit cycle oscillations in the small system of Figure 9. When the parameterization of (30) is slightly changed, with the rate parameter value crossing the Hopf bifurcation threshold, the formerly stable steady state becomes unstable, and the system exhibits stable oscillations. (a) shows the time courses, whereas (b) shows the results in a phase-plane plot of versus . Here the blue trajectory spirals inward toward the limit cycle (a), while the apparent ring area in green actually consists of a very tight outward spiral toward the limit cycle.

The characterization of Hopf bifurcations is usually very laborious [417], but Lewis showed that it becomes an amazingly straightforward task for the special structure of S-systems, especially if the system consists of only two variables [418]. In fact, Lewis derived a criterion for bifurcations in S-systems that consists of the evaluation of a simple algebraic formula. This criterion was subsequently “inverted” and thus made into a tool for constructing limit cycles of different shapes from scratch, which otherwise is a rather cumbersome challenge [419]. A famous example of a limit cycle system is the Brusselator, which is actually a GMA system [420, 421].

Nikolov and colleagues analyzed a signaling system with a generic strategy that sequentially integrated sensitivity analysis, bifurcation analysis and predictive simulations. The strategy demonstrated how information from one step can feed into other analyses and thereby help refine the structure of a model [422].

4.5. Diagnostics of Dynamic Features

In addition to these types of algebraic analyses, which for reasons of practicality are typically executed with computational software such as PLAS [89], PLMaddon [94], BestKit [93], or in Matlab, system models are typically tested and diagnosed with simulations that help explore ranges of possible system behaviors. These simulations require the integration of the differential equations, which almost always has to be numerical. It is only possible to a very limited degree to solve small S-system differential equations analytically [423].

System simulations fall into different categories. The first may be called ‘‘what-if’’ simulations. Here initial values of the system variables are changed and the resulting time trajectories are compared with data or the investigator’s expectations. Similarly, parameters or independent variables may be altered, to model mutations or altered environmental conditions, and a numerical solution of the system reveals whether the system might be appropriate or is evidently wrong in some aspects. Essentially all of the applied BST models described in a later section have used this strategy of exploration extensively. Simple, didactic examples are given in [3].

A different type of simulation, which lately has been garnering increased interest, is Monte Carlo (MC) simulation. This type of simulation is not targeted on a specific goal, as the previously described simulations, but much more exploratory. Specifically, one accounts for the possibility that not every parameter is 100% certain but in reality comes from some range. It could be that all values within this range are equally likely or that they have certain probability distributions. For instance, the probability of a particular value could be highest in the center of the range and decrease to zero toward the upper and lower limits. For each run of an MC simulation, one randomly selects one value for each parameter from its range and according to the corresponding probability profile and solves the system. Repeating this step thousands of times results in a distribution of outputs (e.g., see [4]).

Let us illustrate the results with the same S-system example of a branched pathway that we used for a comparison with the corresponding GMA systems ((18) and (19); Figure 2). For ease of demonstration we assume that all parameter values are fixed, except for the value of the input , which, instead of being fixed at 4, could be any number between 3 and 5, and the inhibition parameter , which we allow to have any value between 0 and −1, instead of the fixed –0.75. Figure 12 shows the system responses in from two runs of randomly drawing 20 combinations of and . Several observations can be made. First, every Monte-Carlo simulation is different, which is easy to explain, because random numbers are sampled. Second, the iterations typically fall on both sides of the original, deterministic case (dotted lines), because the fixed parameter values are within the sampling ranges. Third, for small sets of MC simulations, the extreme results and their variation can be different. For instance, in one panel of Figure 12 the highest value is higher than in the other panel, but the spread of steady-state solutions is smaller. Running thousands of MC simulations, one obtains a more complete picture of all possibilities and their likelihoods.

(a)

(b)

Figure 12: Results of Monte Carlo simulations with the S-system model equation (19) of the branched pathway in Figure 2. Every simulation returns a different set of output trajectories, due to the randomness of the method.

Applying an MC method, Horner analyzed the sensitivity of the uric acid concentration in blood serum in a model of impaired purine synthesis to initial conditions [413]. Expanding on the traditional MC concept, Balthis developed a hierarchical MC method to analyze mercury exposure in a human population that was stratified by features such as age and fish consumption [424].

MC simulations render it possible to distinguish ensembles of feasible from infeasible models. The goal of this approach is not to identify the one best model parameterization, but an entire cluster of models that all satisfy certain criteria of quality. Logistically, one launches a large-scale MC simulation where every uncertain parameter is given a generous range of possible values. After every run, one checks if the solution satisfies the set output criteria. If so, the solution is retained; otherwise it is discarded. As an example, Lee et al. [323] used an MC sampling with filtering to obtain feasible models for a metabolic model in plants, and Yin and Voit [322] applied the method to explaining the functionality of the enzyme NADPH oxidase, which is involved with the control of reactive oxygen species.

Ni and Savageau used a somewhat similar “sample-and-retain-or-discard” strategy for screening many alternative instantiations of human red-blood-cell models for putative errors, such as instability or unreasonably high sensitivities, and for proposing candidate regulatory mechanisms that were able to alleviate these problems [370, 371]. Alves et al. applied a large-scale model screening strategy to characterizing details of the biogenesis of iron-sulfur clusters in yeast [373, 374].

4.6. Model Validation

Once the repertoire of possible behaviors has been sufficiently explored, the model should be validated against data that had not been used for model construction. These data may be quantitative or qualitative, and model evaluations may be in the form of comprehensive sensitivity and robustness analyses, simulations, or mixtures of diagnostic assessments [425]. Essentially all published models have undergone some degree of validation. Relatively comprehensive examples for BST models are [188, 426].

An entirely different type of validation uses methods of an automated, algebraic model checking [427–436]. A good example in the context of BST is a Simpatica software system that explores the time-trajectories of models with an automaton-based semantic language. This language permits the asking and answering of questions about the logical properties of the temporal evolution of a system, such as “is the system able to reach a steady state?” or “what are the possible bounds for the trajectories of a particular dependent variable in the system?” The model checking language also contains qualifiers such as “eventually” and “always,” as well as their negation, which leads to the qualifiers “never” and “sometimes.” As a specific example, the software may check the truth of the expression “Eventually(Always(zero-derivatives)),” which corresponds to the situation that the system will certainly approach a steady state for going toward infinity. In this manner, the system can qualitatively reason about features of the system by using propositional temporal logic that succinctly and unambiguously addresses ordered sequences of events. The authors of this software illustrated the power of this type of automatic checking with the model of a limit cycle [437] and a quite complex S-system of purine metabolism [186, 438, 439]. Somewhat similar in concept, Gentili proposed a combination of S-systems with stochastic -calculus, which is essentially a programming language, to analyze gene regulation networks in an automated fashion [440]. Campagna and Piazza studied the topic of reachability in dynamic systems, including S-systems, with semialgebraic hybrid automata [441].

5. Application of BST Models to Specific Biological Systems

BST has been used for rather different purposes throughout biology and beyond. Within the realm of biology, and using very broad categories, one may distinguish model analyses whose purpose was to gain novel insights in a specific biological system from analyses whose prime target was the development of methods, along with a better understanding of an entire class of biological systems, such as “all linear pathways with feedback.” We begin this section with the latter, and discuss specific applications subsequently.

5.1. Design and Operation and the Method of Controlled Mathematical Comparisons

From the very beginning, many BST studies addressed entire classes of systems of high biological relevance, without focusing exclusively on specific applications. A long line of such investigations targeted the different observed modes of gene regulation, especially in microbes. Spearheading this effort, Savageau early on presented detailed analyses of classical and autogenous control of inducible operons and the interplay between gene regulation and the demands imposed on organisms by their environments [442–449]. These analyses revealed that different regulatory schemes are indeed optimal, depending on environmental circumstances. Many later articles similarly addressed the design features of gene regulatory networks [36, 114, 115, 161, 385, 450–461]. The overarching goal of these studies was the discovery of general rules and mechanisms that were able to explain in an unbiased manner why different genes and operons are regulated in distinct ways.

The envisioned generality of these studies made it apparent that new methods of objective, comparative analysis were needed and led to the development of an unbiased approach for comparing alternative modes of operation or, more generally, alternative systems. The ultimate result was the method of controlled mathematical comparisons (MCMCs), which aims to explain why certain system features are observed in a certain situation, rather than others [11, 73, 462–464]. A typical question within MCMC is: What is the advantage of a feedback inhibition signal in some specific, observed, or hypothesized system and what would happen without this signal? The basic concept of MCMC consists of comparing two (or more) systems that differ in just one feature, such as the inhibition signal in the previous example. In addition to setting up these models in parallel, one defines objective biological criteria that render one structure advantageous over the other. Typical examples of such criteria of functional effectiveness are the minimal accumulation of unneeded intermediate metabolites or the amount of time the systems require to respond to external stimuli. The alternative systems are assessed against a list of such criteria, and the system scoring highest against these criteria is declared best. Moreover, the advantages of the winning system can be attributed directly to the one feature that distinguishes this system form the other(s).

MCMC has been used to analyze the design principles governing various gene regulatory systems and metabolic pathway systems. With respect to gene regulation, MCMC ultimately led to the Demand Theory of Gene Regulation [36, 114, 115, 385, 453, 465]. This theory connects environmental demands, as well as the cycle time, which is defined as the average time for a gene to complete an on-off cycle, to the mode of gene regulation and the coupling of gene expression in the form of elementary circuits. Based on these concepts, Atkinson et al. demonstrated that a deep understanding of the design of such gene circuits and their regulation is a prerequisite for creating new systems, as it is the goal in synthetic biology [466]. Specifically, these authors predicted, and subsequently validated experimentally, the function of a sophisticated genetic circuitry exhibiting a toggle switch, as well as oscillations in gene expression that were sustained in a bacterial population for several generations.

MCMC was also applied to different classes of metabolic pathways [467–476], the evolutionary development of different designs of enzyme systems and moiety-transfer cycles [477–484], bacterial growth phenomena [485], two-component sensing systems with and without bistable switches and hysteresis [387–390, 475], a stress response system in yeast [486], higher plant systems [487], and even control systems for lymphocytes and their responses to antigens [462, 463]. Puigjaner and colleagues compared MCMC for BST and metabolic control analysis (MCA; [488]). Zhang and collaborators emphasized the value of understanding design principles in the context of toxicity testing [489].

A representative example for the discovery of design principles is the comparison of all possible patterns of feedback inhibition in a linear, unbranched pathway (some possibilities are shown in Figure 13), which reveals that the very common pattern of the final product inhibiting the first step of the pathway has distinct advantages over all other imaginable designs [1, 10, 467, 468, 471, 472].

Figure 13: Different modes of regulating a linear, unbranched pathway through feedback inhibition. In nature, one essentially always observes the mode at the top. The method of controlled mathematical comparisons explains why this is so (adapted from [1, 10]).

While the original MCMC mostly relied on algebraic analyses of S-systems, it was later augmented with simulations and graphical and statistical assessments [464, 471–474, 490].

Recent advances have expanded the concept of design principles to design spaces [480, 481, 491–494]. A design space is a dimensional compression of the parameter space of a system that reveals and characterizes generic relationships between system parameters, environmental variables, and qualitatively different system behaviors. Specifically, the entire space of possible responses of a system is partitioned into regions of the parameter space that corresponds to distinct phenotypes of qualitative system behavior [492]. Using local S-system approximations, these regions can be investigated in terms of their fitness and tolerance to external perturbations, and it is possible to compute the boundaries between these phenotypic regions. An application of this concept was an analysis of the role and regulation of the O₂ sensor FNR in E. coli [495, 496]. Software has been proposed to automate the key steps of such an analysis [99].

A different extension of methods for the discovery of design principles was the corresponding analysis of operating principles, where the focus is not so much on the structural design of systems, but on their operation in response to stimuli [76, 77, 380, 484]. A recent review of design and operating principles can be found in [78].

Chen and colleagues developed adaptive design rules for biochemical systems, based on the criterion of sufficient robustness toward mutations and environmental changes during evolution [402, 497]. They found that systems satisfying these criteria exhibit increased diversity in phenotypes.

Wu et al. formulated complex genetic trait formation as a dynamic system [498]. They used a simple S-system to quantify how alterations in different system constituents can lead to global changes in traits and provide a quantitative tool for testing the interplay between genes and development. The authors found that the genetic mapping of complex traits may be improved through an increased understanding of biological design principles.

5.2. Case Studies

In contrast to the general design studies described in an earlier section, many BST analyses have focused on specific applications and often used actual experimental data in the form of kinetic properties or measurements of metabolite concentrations, fluxes, or other quantitative features. In line with the original purpose of BST, many of the earlier analyses addressed biochemical pathway systems, but over time the scope widened within and even beyond biology. Representative studies are briefly summarized in the following vignettes. They start with microorganisms and progress toward higher organisms, including plants and humans. In many cases, this sequence roughly corresponds to the time of publication. Additional studies will be discussed in the context of system optimization.

5.2.1. Microbial Studies

Early on, Savageau and colleagues analyzed intriguing mechanisms that ensure the correct translation of RNA into proteins [499–507]. Based on experimental in vitro and in vivo data from E. coli, these authors used power-law models within BST to investigate in detail the kinetic proofreading mechanisms for the aminoacylation of tRNAs, which typically occurs with a high degree of accuracy.

Arguably the first numerical data analysis with BST was yeast fermentation of glucose into ethanol [201]. Based on experimental data, alternative models were constructed and parameterized. One conclusion from comparing the models was that high ethanol concentrations in these cultures led to cell death by lysis. A much more detailed model of yeast fermentation was later introduced by Curto and coworkers [185, 508, 509]. This series of papers was interesting for a number of reasons. In particular, it showed how traditional enzyme kinetic information can be validly converted into power-law models that offer additional modes of analysis and novel insights. This more complex model was later used as a test bed for various optimization and estimation [3, 4, 255, 319, 409, 510–520].

Conceptually similar modeling studies addressed the production of amino acids, enzymes, proteins, and other valuable organics in E. coli [58, 521–523]. Lall and Mitchell used an S-system model to characterize the reduction of metal in the bacterium Shewanella oneidensis [524]. Sheridan and colleagues successfully engineered and validated the meta-cleavage pathway of Pseudomonas putida, based on BST simulations and logarithmic gain analysis [525]. Sun and collaborators modeled glycerol fermentation by Klebsiella pneumonia [526].

Lactococcus lactis is a bacterium of great relevance in the dairy industry, where it is used in the production of yoghurts, cheeses, and other food products. Its appeal for modeling derives from the fact that the organism has been used for in vivo NMR studies that characterized the temporal dynamics of glycolytic metabolites in response to a glucose bolus after a period of starvation. These time series data opened new avenues of parameter estimation and model construction in general [342, 357, 358, 362, 363, 527].

Different groups analyzed cultures of the alga Chlamydomonas reinhardtii for the purpose of producing hydrogen. Horner and Wolinsky [528] used an S-system model to investigate the sensitivity of H₂ production to photosynthetic activity and the production of protons by photolysis [528]. Jorquera and colleagues [529] studied sulfur deprivation, while Zhang suggested S-system equations for the reactions in a space-dependent advective-diffusive representation of the system [530, 531]; see also [532].

Torres developed the first BST models that comprehensively captured the dynamics of citric acid generation in the fungus Aspergillus niger [183, 184]. This mold is industrially very important, as it produces the lion share of a worldwide annual citric acid production of almost 2 million tons [533, 534]. The initial model, as well as several more sophisticated successors, was used later for testing various optimization methods [66, 535–539]. De Jongh explained formerly puzzling experimental findings based on the models [540].

Alves developed a model for iron metabolism in yeast [373, 374, 541]. Particularly interesting in this study is the combination of dynamic modeling with the use of information regarding the molecular structure of key enzymes. Huang and Wang studied the growth dynamics of Saccharomyces diastaticus in mixed sugar culture designed to produce ethanol and glycerol [165].

Alvarez-Vasquez spearheaded the development of a series of models describing sphingolipid biosynthesis in yeast [187, 426, 542]. Sphingolipids are specialized lipids that not only contribute to rafts in lipid membranes, but also exert distinct signaling functions. Interestingly, the general structure of their biosynthesis has been conserved from yeast to humans. In a recent expansion, the pathway was merged with a second pathway, describing the de novo synthesis of ergosterol [188].

Stress responses in microbes have been studied for a long time, because they offer insights into the cellular machinery that mounts appropriate responses to adverse environmental conditions. Several BST models have addressed heat stress responses in yeast. Voit and Radivoyevitch demonstrated that the glycolytic gene expression profile following heat stress is all but intuitive, yet appropriate for the required metabolic response [543]. Sorribas’ group analyzed the same phenomenon and showed that the cellular response is essentially optimal, given the constraints within which it has to be mounted [484, 544–546].

One hallmark of the heat stress response in yeast is a dramatic increase in the intracellular concentration of trehalose. This disaccharide is a stress response metabolite that is found in a variety of microorganisms, plants, and invertebrates. Its synthesis normally occurs at a low rate, but increases enormously and within minutes of severe stresses. Due to the strong metabolic and genomic responses, various aspects of trehalose dynamics, and other heat stress responses have been modeled in recent years. They included an analysis of the design and operating principles of the trehalose pathway itself [486], as well as detailed assessments of the multiscale processes that lead to the appropriate stress response [6, 547]. In addition to trehalose, yeast sphingolipids respond to heat stress within minutes in a coordinated fashion [548, 549]. The interactions between the trehalose and sphingolipid responses at different organizational levels constitute a very intriguing regulatory system [550].

A different stress response in yeast is starvation, to which the organism reacts by reversing the direction of glycolysis, a phenomenon called the diauxic shift. Alvarez and collaborators showed that this response is coordinated with a global small-magnitude up- or downregulation of very many metabolic steps, rather than more pronounced changes in a few steps [542] (see also [380]).

Shiraishi and Savageau [37, 551–555] presented what one might call the first complete standard BST analysis of a complex pathway system. Addressing the TCA cycle in the slime mold Dictyostelium discoideum, they discussed the advantages, disadvantages, and relationships between different model structures, set-up equations, based on the pathway diagram, executed steady-state and dynamic analyses, and discovered and remedied problems in earlier non-BST models.

All organisms rely on robust signal transduction systems, which possess some aspects of metabolic and proteomic systems, but also their own genuine features. BST has been employed for a rich variety of analyses of signaling systems. In particular, the group of Vera and Wolkenhauer has contributed much to our understanding of such systems. Working at the interface between experimentation and theoretical biology, they demonstrated how modeling can complement data collection and interpretation in the context of the JAK2/STAT5 pathway [556–558]. In [41], the group compared detailed and simplified power-law models [559]. Not surprisingly, the preference for one or the other model choice depends critically on the amount and quality of the data used and the specific questions asked. For example, the article [560] successfully used simple power-law models to analyze the dynamics of feedback loops in the ERK signal transduction system. In a different, yet related line of work, Nikolov and colleagues developed a multiscale model that accounted for the effect of erythropoietin mediated JAK2-STAT5 signaling in erythropoiesis [422, 561]. The group also assessed oscillations in the NFκB pathway with a model that had BST components, as well as Michaelis-Menten-type functions [562].

Lin and colleagues studied options for controlling cascaded systems, including signal transduction systems, which were formulated as S-systems [384, 563]. Boykin and Ogle investigated the sonic hedgehog-signaling pathway [564]. Ray and Kirschner analyzed signaling processes associated with the primary role of macrophages to use chemicals like nitric oxide and the iron regulatory apparatus to kill pathogens [565].

Schwacke and Voit analyzed the generic features of MAP kinase cascades and rationalized with computational means why the parameter values in different layers of the cascade must fall into distinct domains of the parameter space [566]. They also demonstrated that cross-talk between two cascades is sufficient to create all genuine information responses, including negation and the exclusive-or function [567].

While higher organisms tend to use multilayer protein cascades for signaling purposes, bacteria often use two-component systems for sensing their environment and responding adequately. From an analytical point of view, these systems are very intriguing in that they are bistable and can exhibit hysteresis [387–390, 475]. Other articles on signal transduction included [568, 569].

5.2.2. Studies on Higher Plant and Animal Systems

Shortly after the introduction of BST, Smith used power-law models to study the functional interactions between the components of an ecosystem [570–572]. Specifically, he studied pathways of nutrient flux with tracer experiments. The rationale for using BST was that earlier studies had proposed ratios of polynomials for the description of ecological processes, and that these were adequately approximated with power-law models, as Savageau had demonstrated [1, 101]. Thus, Smith converted an earlier model into an S-system and used this model to characterize steady states, stability, and species extinction. In a similar vein, Torres developed a model of magnesium flow in a tropical forest, where the variable pools represented plants, animals, litter, and soil [573].

Voit and Sands developed a model describing nutrient allocation in trees within planted forests and studied the effects of different fertilization regimens [119, 574–576]; see also [577]. Interestingly, the allocation patterns changed with the age of the trees and their fertilization regimens. Martin used BST to condense a complex forest simulation model into an S-system model that was much easier to analyze [578]. Renton and colleagues combined power-law modeling with the structural modeling framework of L-systems to generate functional-structural plant models that permitted a spectrum of granularity in detail ranging from accurate and descriptive to mechanistic and explanatory models [579–581].

In a more theoretical study, Voit showed that a widely observed rule of forest growth, the so-called 3/2 rule, is a direct consequence of an appropriate S-system model formulation [582, 583]. The rule posits that growing forests approach a power-law relationship between tree density and average tree size that has a slope of about 1.5. He also proposed a statistical method, using an S-distribution (see later), to characterize the changes in tree size distributions during the aging of a forest [575, 584]. Torsella showed how simplified S-systems with only one nonzero term per equation permitted linear regression methods for the estimation of tree growth in planted stands [181]. Johnson modeled the growth of pine trees [293, 585] and studied economic aspects of dynamic agricultural systems [586].

Lee was the first to develop comprehensive models of lignin synthesis in poplar trees and alfalfa [323, 487, 587]. Lignin is a biopolymer in secondary plant cell walls which hardens them and also makes them resistant to foraging by animals and the attempt to extract ethanol for biofuels from inedible plant parts.

Chaudhuri and colleagues developed an S-system model to analyze bioeconomic features of fisheries, using a realistic catch-rate function, as well as costs, taxes, and regulatory controls [588, 589]. Methods of variational calculus and control theory led to an optimal harvesting policy. Brown used an S-system model to optimize the feed and slaughter age of turkey [590, 591]. Torres’ group used BST methods to optimize a feeding regimen for economically valuable octopus populations kept in captivity [592].

Torres presented a BST model of the glycolytic and glycogenolytic pathways in rat liver, whose predicted responses correlated well with experimentally determined results [593]. This model was later made into a detailed case study for analyzing BST models [3] and used as a benchmark for the application of control theoretical methods to steering systems toward a desired goal [406, 594–597].

Although not addressing a living organism, one might add that Streichert and colleagues used an S-system representation in a reaction-diffusion approach to investigate the endogenous evolution of a head-tail pattern in an artificial embryo without the prior definition of spatial gradients [532].

5.2.3. Human Physiology and Disease

Human metabolism and its failure have received increasing attention with the availability of more comprehensive data and the corresponding development of analytical techniques. As an early example of a BST analysis, Ni and Savageau developed models of the metabolic dynamics of red blood cells [370, 371]. Reilly and colleagues studied renal hemodynamics [598], and Vera’s group studied with a multiscale model the signaling role of erythropoietin on erythropoiesis [422, 561].

Salvador et al. modeled the NADPH redox cycle in human erythrocytes and used these models to connect the molecular properties of glucose 6-phosphate dehydrogenase mutants to clinical phenotypes [478–481]. Interestingly, the design space of this system partitioned cleanly into three regions of qualitatively distinct performance. Within this design space, the distances between mutants and normalcy correlated negatively with the severity of the phenotypes.

Also related to the blood system in humans, Yin and collaborators showed with a BST model how different mechanical shear stresses affect the metabolic and signaling responses of endothelial cells in vasculature [599]. Also in vasculature, they analyzed the role of the enzyme NADPH oxidase, which controls the dynamics of reactive oxygen species, and whose malfunction can contribute to diseases like atherosclerosis [322].

Sorribas and González developed a BST model for the hypothalamus-anterior pituitary-thyroid network. They translated this complex physiological system into a relatively simple S-system model, which qualitatively captured the responses of healthy subjects to an injection of thyrotropin-releasing hormone. The authors also studied the dynamics of the system’s regulatory signals under physiological and pathological conditions [600].

Curto and colleagues developed a series of models of purine metabolism in humans and demonstrated that an S-system model was able to serve as a novel classification tool of purine-related mental diseases [3, 186, 438, 439]. Thomas adopted Curto’s model with some adjustments to clarify confusing effects of the drug mizoribine on guanine and adenosine nucleotide synthesis [601]. Horner used a variant of the model to study the effects of parameter variations in the case of one of the most devastating purine-related diseases, namely, hypoxanthine-guanine phosphoribosyltransferase (HGPRT) deficiency, which in severe cases is known as Lesh-Nyhan syndrome [413].

Qi and collaborators developed several models describing the dynamics of dopamine metabolism. Dopamine is a crucial neurotransmitter in the reward system of mammals, including humans, and changes in dopamine concentrations can lead to Parkinson’s disease, schizophrenia, sleep disorder, and attention deficit/hyperactivity disorder [44, 174, 602–609], (see also [175, 610–612]). The work of Qi’s group contains models for the presynapse, which is a nerve ending in the midbrain where dopamine is produced, as well as the postsynapse in the forebrain, where dopamine signals are interpreted. Sass and colleagues used a complementary BST model to investigate the dynamics of the protein -synuclein, which is the second hallmark of Parkinson’s disease, outside changes in dopamine levels [613].

Liu and colleagues proposed an S-system model to characterize the dynamic regulatory characteristics of the p53 signaling pathway, which is crucial in tumor suppression and apoptosis [614]. Simulations with the model assisted the identification of key molecules in this signaling pathway. Vera and colleagues [615] showed with a model containing power-law and ratio terms that the dynamics of p53 expression and its role as a transcription factor are affected by epigenetic silencing of 14-3-3 proteins, which can bind to various signaling proteins.

Broome and Coleman developed a model of cell death in multiple sclerosis, which they used to identify possible triggers of the disease as well as potential drug therapies, particularly with respect to reactive oxygen and nitrogen species [616].

Ferreira and colleagues modeled a biochemical system that has a typical time scale seconds, but can cause disease due to the accumulation of metabolites during a human’s lifetime [617]. Namely, they studied the glyoxalase system and its role in the very slow formation of advanced glycation end products, due to the Maillard reaction, which in the long run can lead to Alzheimer’s disease and to alterations in the proteins in the lens of the eye.

Several groups used BST models to analyze infectious diseases. Garcia and her collaborators developed a detailed model of the parasite Cryptococcus neoformans, which is a common cause of fungal meningitis [618, 619]. This organism can grow in the respiratory tract or within the phagolysosome of phagocytic cells and therefore must adapt readily to strikingly different acidity milieus within the human body. Berg and collaborators demonstrated how S-system models can be used to study the antimicrobial efficacy of drugs in humans [620]. Vera and colleagues analyzed model-based strategies for identifying potential drug targets in cases of known enzymatic dysfunction [621]. Torres’ group proposed a model for the dynamics of Leishmaniasis and explored possible applications of the model to the design of effective therapies [622]. Magombedze and Mulder developed an S-system model of tuberculosis [623].

Rather than focusing on specific diseases, several authors developed and analyzed generic disease models, using BST. Some of these focused on risk groups, risk factors, and epidemics [25, 28, 424, 598, 624–627], while others studied the trajectories from health to disease in general and in a personalized setting [379, 628]. They also described generic modeling approaches for understanding inflammation [629], which were specifically applied to a simple cystic fibrosis model [182]. Faratian and colleagues suggested S-system modeling as a very promising approach for integrating data in cancer research [630, 631].

A few investigations pointed out the use of BST models for drug development [43, 620]. Torres’ group proposed a generic strategy of data integration through modeling for disease caused by malfunctioning enzymes [621]. Some additional studies are discussed as applications of optimization methods.

Boege and colleagues studied the intracellular dynamics and localization of the enzyme topoisomerase IIβ [632].

6. Optimization

The specific application models discussed before had various purposes. Some were developed to test whether the scientific community understood a pathway correctly, some were constructed to explore what-if scenarios, and others were the starting point for various kinds of manipulations, such as the remediation of a disease. A prominent role for some models was the optimization of some beneficial model feature. In particular, several microbial models were designed with the goal of engineering and optimizing microbes to make, in a cost effective manner, desirable high-volume products, such as ethanol or citric acid, or low-volume, valuable organic compounds, such as feed additives and pharmaceutical precursor compounds. Hand in hand with these goals, general and BST specific methods were developed to make such optimization tasks feasible and effective. Thus, over the years, metabolic engineering became a prime area of optimization within the realm of BST. The generic task of this endeavor is to alter the metabolic flux distribution within a microorganism such that this organism produces and excretes a desired end product in much larger quantities than the wild type.

As in other areas of mathematics, there is huge difference between linear and nonlinear optimization tasks. While it is fairly easy to solve linear optimization problems with hundreds of variables, nonlinear problems become computationally expensive even if only a few dozen variables are involved. As a consequence, it is desirable to explore to what degree application problems can be assessed with linear optimization methods.

6.1. Stoichiometric and Flux Balance Analysis

Although metabolic systems are intrinsically nonlinear, they do have fundamental linear features, and these have been exploited in metabolic engineering (e.g., [130, 633]). The first is distribution of fluxes at the steady state of a system. Consider as an example the illustration diagram in Figure 14. Here, every flux is typically nonlinear, but the overall structure of the flux network is linear.

Figure 14: Generic network of fluxes in a metabolic system. The structure of the network is linear, but the fluxes themselves are typically nonlinear. They may also be affected by some of the metabolites, which are here shown as “nodes” of the network.

Suppose that the system receives input through the flux , which subsequently distributes throughout the system. The change in any of the nodes (i.e., metabolite pools) can be expressed as a function of all contributing fluxes. For instance, the dynamics of is governed by the following equation: which directly expresses that and contribute to the growth in , while moves material away from . The fluxes , , and are typically nonlinear functions of metabolites, enzymes, and modulators. They could be Michaelis-Menten or power-law processes or take any structural format from among an unlimited repertoire. As in many other cases, the steady state is of particular interest. In order for all nodes to remain constant, the fluxes at each node must balance. This balance requires, for instance, for : In general, the flux balance of a metabolic pathway system at a steady state is characterized by a system of linear algebraic equations. These derive directly from the generic system representation in (2), which are expressed for no change in the variables and can be expressed in matrix format as Here is the vector of metabolite concentrations, is the stoichiometric matrix, and is the vector of all reactions steps in the system.

As an example, let us revisit the GMA model of the branched pathway system in Figure 2 and (18). The stoichiometric matrix has three rows, one for each dependent variable, and five columns for the five reaction steps in the system. Thus, Typical optimization tasks in these systems consist of optimizing a flux that represents the production of a desired metabolite. In many cases, the optimized system should operate at the steady state, and the stoichiometric equation serves as a set of linear algebraic constraints. Thus, the solution maximizes the desired flux, while ensuring that the system operates under steady-state conditions. In most practical cases, the number of fluxes is quite a bit larger than the number of metabolites, with the consequence that (infinitely) many solutions are possible. Since the equations refer to a biological system, it is reasonable to constrain metabolites and fluxes in magnitude so that they cannot be smaller or larger than some limits. These constraints can ensure that the system does not deviate too much from its normal operation in most of its components, that thermodynamic constraints are satisfied, and that the system is not metabolically overburdened with the need to produce and maintain too many enzymes at significantly elevated levels. The subspecialty of metabolic engineering pursuing optimization with these types of concepts and strategies is stoichiometric and flux balance analysis (FBA) (e.g., [130, 633]).

FBA is mathematically elegant and has been very successful in practical applications. Its enormous advantages are the linearity of the optimization task and the associated fact that very large and even genome-wide systems can be optimized with reasonable effort. However, FBA also has intrinsic disadvantages. First, by its nature, it predicts new steady-state levels of fluxes but does not allow inferences on metabolite levels. Second, it largely ignores regulatory features at the metabolic level, which in reality tend to keep systems from deviating too far from their wild type steady state. Thus, FBA runs the risk of predicting a steady-state flux distribution that the actual cell would avoid, due to regulatory controls. Attempts have been made to account for regulatory processes, but these have been rather coarse. Finally, FBA requires the specification of an objective function, which typically reduces the infinite number of solutions to a single optimal solution. In microbial systems, this objective function usually formalizes that microbes tend to maximize their growth rate. In other cases, a valid objective is not always easy to pose. For instance, cells in higher organisms have different objectives. Nonetheless, the concepts and simplicity of FBA are very appealing, and recent attempts have been made to begin with FBA and then to convert the results into nonlinear dynamical systems.

6.2. Steady-State Optimization of BST Models

As a genuine alternative to stoichiometric and flux balance analysis, attempts were made to optimize fully regulated metabolic pathway systems. However, these immediately involve nonlinearities that seem unavoidable. Intriguingly, a compromise was found in S-systems [634, 635]. As discussed before, S-system models within BST do capture the nonlinearities of metabolic systems, but, at the same time, possess steady states that are characterized by systems of linear equations in logarithmic coordinates (see (28)-(29)). Furthermore, fluxes become linear in logarithmic coordinates as well, and it is mathematically equivalent for optimization purposes whether typical constraints on fluxes or metabolites are formulated in Cartesian or logarithmic coordinates. As a consequence, the entire optimization task becomes linear in a logarithmic space, and one obtains the following linear program:(1) maximize ln(flux)

subject to(2) steady  state  equations,   expressed in  logarithms  of variables,(3)ln(dependent  or  independent  variable) ≤ constant,(4) ln(dependent  or  independent  variable) ≥ constant,(5) ln(dependent  or  independent  variable) = constant,(6) ln(dependent  or  independent  variable)  unrestricted,(7) ln(flux) ≤ constant,(8) ln(flux) ≥ constant,(9) ln(flux)  unrestricted,(10) ln((flux  1)/(flux  2)) ≤ constant.Here, (1) is the objective function, (2) ensures operation of the system at steady state, and (3)–(10) are biologically motivated constraints on various metabolites and fluxes in the system [4, 634]. Thus, arbitrarily complex S-system models can be optimized under steady-state operation with linear optimization methods.

Of course, the simplicity of this strategy does not come for free. An important argument against this approach is that S-system models are local approximations, so that the ranges around the operating points, where metabolites are validly represented, are limited. Thus, this strategy has to address questions regarding the accuracy of the power-law approximation (see later), which are difficult to answer in the abstract, but which have been addressed in comparative optimization studies (e.g., [4, 511, 512, 519]). Furthermore, it is possible to pursue an iteration of optimization steps, where each individual step is likely to remain within its range of validity [634]. A related question is to what degree imprecise implementations of the optimized enzyme profile would compromise the results [636].

The second argument against S-systems is their nonintuitive aggregation of fluxes at branch points, as was discussed before. This issue is seen as a particular problem if one of several branches has to be altered for optimizing the declared objective. Over the years, three compromises between the simplicity of S-system optimization and the more intuitive GMA representation were suggested. The group of Torres proposed the Indirect Optimization Method (IOM), which iteratively formulates a GMA model, converts it locally into an S-system, optimizes this S-system with strict constraints, and converts the predicted optimal solution back to the GMA form [4, 511, 637]. The results of this mixed strategy were compared with direct nonlinear optimizations and found sufficiently accurate and, at the same time, computationally much cheaper to implement and solve.

The IOM method was later extended to take static as well as dynamic features into account and to facilitate the optimization of bioprocesses with efficient methods of linear programming [638]. Xu corrected the approximation error by proposing a “modified IOM” with a Lagrangian analysis, where the objective function includes an extra term that compares the derivatives of the metabolite concentrations with respect to the enzyme activities in the original and the S-system model [639]. Subsequently, the group analyzed how uncertainties affect the results of the modified IOM approach [640]. The same investigators proposed two variations of a biobjective optimization approach based on S-system representations and a weighted-sum or iterative minimax procedure [518, 520]. Chang and Sahinidis used a complex bilevel optimization scheme to optimize S-system models of metabolic pathways, while ensuring their stability [517]. Xu’s group, as well as Sun et al. compared alternative optimization methods for biological systems, including those based on S-systems and IOM methods [209, 641].

A second strategy for avoiding accuracy problems with S-systems, which at first sounds reasonable but is more complex than one might expect, is the separation of GMA optimization tasks into two linear models, one using the stoichiometric structure as linear steady-state constraints, and a second set of constraints that formulates every flux term as a linear equation in logarithmic coordinates [4]. So far, this simultaneous optimization in a Cartesian and a logarithmic space has not been implemented efficiently.

The third proposal for optimizing GMA system was the use of linear or geometric programming [637, 642]. The latter optimization method is designed for tasks where both the objective function and the constraints consist of positive power-law terms, called posynomials. The only, but unfortunately crucial, issue for a direct application to GMA systems is the fact that the GMA models almost always contain terms with negative signs. Approximation methods for condensing positive and negative power-law terms into strictly positive terms may be used to remedy this issue and accomplish the optimization task. This process of “condensing” is equivalent to the aggregation process that governs the conversion of GMA into S-system models, which we discussed with the example of a branched pathway.

The group of Gatzke approached the GMA optimization task without capitalizing on similarities to the S-system structure. Instead, this group proposed a branch-and-reduce (BR) method, which guarantees the identification of the global optimum, and not just some local optimum [513–515]. In the BR approach, the entire solution space is subdivided into subspaces, and the clever construction of so-called underestimating functions permits the elimination of subspaces based on the fact that no solution within this subspace can possibly be better than some solutions in other subspaces. In the case of GMA systems, the construction of underestimating functions is facilitated by the fact that the only possible functions encountered are power-law functions, whose mathematical structure is well known. In a variation on this global approach, Sorribas’ group recently used a global optimization method that makes direct use of the structure of GMA systems [546, 643–645]. These authors also showed that the nonlinear global optimization method is compatible with certain types of recasting (see later), which makes the approach available for larger classes of nonlinear systems [646], including an extension of BST toward Hill-type processes, which constitute the so-called Saturable and Cooperative Formalism (SC formalism; [168, 169]).

As another alternative, Rodríguez-Acosta and collaborators proposed a stochastic optimization algorithm [510]. Similarly, Zheng and colleagues devised a stochastic optimization approach, based on information theory and clustering analysis, that assisted in the identification of local optima, while permitting the exploration of regulatory signals [647].

Shiraishi’s group proposed means for identifying bottlenecks in S-system models that prevent optimization toward higher yields [409–411, 648, 649]. Torres’ group compared different optimization approaches based on BST and lin-log models [160] and developed a software tool for optimizing metabolic system models in BST format [98].

An important extension of all strategies discussed so far is the simultaneous optimization of multiple objectives. For instance, one might want to optimize the production of a valuable organic compound, while simultaneously minimizing cost. In most cases, such multiobjective optimizations cannot optimize all criteria but have to arrive at a compromise where some objectives are addressed in an inferior way in order to allow better performance in other criteria. Within the realm of BST, multiobjective optimization has been discussed several times (e.g., [4, 318, 512, 650, 651]). As an example, Vera and colleagues simultaneously maximized ethanol production and minimized each of the internal metabolite concentrations [512]. For this task, they used an S-system representation, which they found well suited. These authors also considered investment costs and “paracosts,” which included stability, flexibility, and controllability [652]. Link et al. proposed a hybrid genetic algorithm-based method to solve constrained multiobjective optimization problems and applied it to the fermentation reaction network in yeast [651]. The simultaneous goals were to maximize ethanol production and reduce metabolic burden. Other multiobjective optimization methods were already discussed in the context of parameter estimation.

Yet another type of steady-state optimization of S-systems was proposed by Hatzimanikatis and colleagues [345, 346]. Recognizing the one-to-one mapping between parameters and system structures in BST models, the authors proposed a mixed integer linear program (MILP) to optimize not just parameter values but the entire regulatory structure of a model. In this case, the presence or absence of regulatory features was modeled by setting the corresponding kinetic orders to zero or to nonzero positive or negative values and optimizing the system within these settings.

Three applications of several of these optimization methods have received particular attention. The first is citric acid production in the black fungus Aspergillus niger, which was originally modeled by Torres [183, 184], as discussed earlier. Over the years, the system was optimized, the model was refined, and it was optimized again; examples are [4, 66, 535–539, 653].

The second application has been the optimization of metabolites in the fermentation pathway of yeast. Here, the original BST model had been developed by Curto et al. [185, 508, 509], and optimization studies included [3, 4, 255, 319, 409, 510–520].

The third application targeted the improved production of L-(−)-carnitine. This substance is a valuable food supplement, especially for individuals receiving HIV treatment. While it is possible to synthesize carnitine in vitro, the result is a racemic mixture that is expensive to separate. The strategy was therefore to produce carnitine in a modified E. coli strain. The original model was developed and optimized by Alvarez-Vasquez and colleagues, who used the IOM method described before [523]. Some of the predictions from the optimization analysis were subsequently tested in an experimental lab and found to be correct [654, 655]. Specifically, the investigators altered the dilution rate and the initial precursor concentration in amounts suggested by the model optimization and obtained a substantial increase in carnitine production rate. In subsequent modeling studies, the group analyzed the induction of carnitine by cAMP [656] and studied the effects of salt stress conditions on carnitine metabolism and thereby elucidated the role of carnitine as an osmoprotectant in E. coli [657].

Other model applications addressed the increased production of tryptophan in bacteria by means of genetic manipulations of the tryptophan operon, which led to the not-yet validated prediction of a strongly increased tryptophan flux [658]; see also [640, 659, 660]. Similar methods were furthermore used to detect drug targets in cases of diseases caused by enzyme failure [621], and for studies of the catalytic efficiency of the enzyme triosephosphate isomerase [661].

6.3. Optimization of Transients

All optimization tasks so far were related to optimal system operation under steady-state conditions. A conceptually and mathematically different task is the steering of a system toward a desired state or along a desired trajectory. For instance, it might be important to reach a desired operating state in as short a time period as possible. The simplest situation is the following. Suppose that a system needs to be moved to a new steady state, and the question is how (independent) control variables would have to be set to make the system reach the desired state. It is easy to imagine that the problem has many solutions. For instance, one might be able to change a few control variables a lot or many control variables a little. Also, some approaches of the new state may be faster than others.

If the model is formulated as an S-system, the task is again much facilitated by the linearity of the steady-state equations. Indeed, the task becomes a matter of inverting the system matrix in (29) [379, 380]. If the numbers of dependent and independent variables are such that the system matrix has full rank, the solution just requires a simple matrix inversion. In other cases, pseudoinversion is required. In typical cases, this pseudoinversion permits additional features to be optimized. For instance, one could demand that the control variables deviate from their normal values as little as possible.

A more complicated situation arises if the desired state is not a steady state or if the time allowed to reach the desired state is finite. Ervadi-Radhakrishnan and Voit approached this problem by transforming an S-system into an affine nonlinear control system [594]. Controllability through independent variables was achieved with an exact feedback linearization method. The method was illustrated with a small glycolytic-glycogenolytic pathway model that had been proposed by Torres and which subsequently became a benchmark example for these types of control tasks [593]. For instance, the group of Meskin and Nounou proposed several variations of control schemes, for instance, based on Kalman filters or fuzzy algebra, for moving the variables in this system to new states [595–597, 662]. Lin et al. studied the control of signaling cascades [384].

Domingues et al. considered the problem of identifying a control function that, within a finite time interval, produced the maximally possible concentration of a desired product [663]. They proposed a combined strategy of optimal control that combined stoichiometric and kinetic features BST model in S-systems form. Using Pontryagin’s Maximum Principle, the authors showed that the control function, defined within the interval [0, 1], achieved optimality at one of the extremes and that a control regimen consisted of optimized switches between 0 and 1.

In a different line of work, Long and colleagues developed a predictive control method for inferring states of a system that are impossible or difficult to measure directly [664]. Specifically, they designed a controller that operates by taking process data at discrete time intervals and uses the measured information to formulate an optimization problem that minimizes some objective function. The optimization task is solved repeatedly and leads to an optimal control trajectory.

7. Methodological Extensions of BST

The initial rules for setting up BST models were established in Savageau’s early work [1, 10, 100–102], and they were later reviewed in a variety of papers addressing different audiences, as was discussed before. Not surprisingly, with an expansion in scope, specific methods were developed where needed, and some of these capitalized on the particular structure of BST models, while other were more generic and did not explicitly utilize the particular power-law structure.

Several BST articles addressed the topic of metabolic channeling [61, 323, 665]. This phenomenon is associated with the observation that enzymes are often located close to each other, for instance by being anchored in a membrane, which facilitates the transfer of substrates in a chain of enzymatic reactions. As a consequence, the individual reactions in the chain are not independent of each other, and the implicit assumption of a homogeneous spatial distribution of substrates and enzymes is no longer valid.

More generally, the question was asked how kinetic rate equations are affected by nonhomogeneous milieus. Inspired by precise experimental and biophysical work on intracellular kinetics [666–670], Savageau treated this situation by introducing power-law representations for fractal kinetics, which were shown to capture spatially restricted reaction systems better than, for instance, Michaelis-Menten formulations [60, 671–673]. Intriguingly, the spatial restrictions of reactions lead to much higher kinetic orders than for Michaelis-Menten reactions in a homogeneous three-dimensional space. Bajzer’s [674–676] group tested fractal power-law representations with carefully designed experiments and found them to be valid and more appropriate than models with time-dependent reaction rates. Wu et al. analyzed the same data with stochastic equivalents of GMA systems [176].

Goel and others asked to what degree ill-characterized systems may be represented with BST models. They assumed that a “concept map” of the topological interactions of an otherwise ill-defined system was known and that additional biological insights or intuition permitted a coarse description of the dynamics of the system components, following some stimuli. Based on this information, they suggested the use of a BST representation combined with inverse methods for constructing a first, broad-stroke model [45, 612]. Somewhat related is the construction of mesoscopic models of medium granularity, which may be abstracted toward the discovery of design principles or expanded toward more detailed simulation models [44].

Ubiquitous metabolites like ATP or NADH are always problematic for modeling studies, because they are involved in dozens, if not hundreds of reactions. As a consequence, the modeler faces the conundrum of either trying to include all reactions, which is typically infeasible, or to make simplifying assumptions, such as constancy of the metabolites or factors themselves or of constructs like the total ATP + ADP + AMP pool, which have their own issues. Voit and Ferreira therefore translated a common strategy from biochemistry, namely, the use of buffers, into corresponding computational buffers, which are modules within BST that either absorb excess materials or release materials that are temporarily in demand [677].

Some authors introduced slight variations on the pure BST structure. For instance, if an inhibitor is modeled with a negative kinetic order, the corresponding terms grow without bound for small concentrations. A simple remedy is the definition of the inhibitor by a term like [564, 620].

Delays are often ignored in purely biochemical systems. However, if additional time scales must be incorporated in a model, the explicit representation of delays may be needed. Interestingly, delays can be used in BST models without destroying their mathematical structure. While the delays are approximated, the approximation error can be made arbitrarily small [172, 174, 678]. It was demonstrated that the inclusion of delays is sometimes mandatory in multi-time-scale models, lest the model results are quantitatively, and even qualitatively, compromised [422, 599].

Of course it is possible to model some components of a system with power-law models and some with other structures. However, this strategy destroys some of the advantages of canonical models. If the heterogeneous components are also ODE models, the method of recasting can be used to regain a complete model in BST (see later). However, this strategy has its own issues, as artificial variables must be introduced. Nonetheless, it is, for instance, possible to construct recast input modules, such as circadian oscillators, that govern the temporal features of a system [3, 421, 679]. If the heterogeneous components are not representable with ODEs, other strategies are needed. For instance, Wu and Voit showed how BST models can be merged with discrete and stochastic effects through their embedding in the framework of Hybrid Functional Petri Nets (HFPNs) [172, 173]. Searson and colleagues used a hybrid S-system model for the analysis of fed-batch data [360]. Vinga and colleagues discussed advantages of integrating BST models with aspects of dynamic energy budget theory, a modeling framework that represents certain constraints on the organization of metabolic network at the organismic level in a nonspecies specific manner [170].

While many studies have described the distribution of a radioisotope label in network systems at steady state, Voit and colleagues developed models to capture the exact dynamics of this distribution upon an input of radioactive material [680, 681]. The group also investigated the effect of spacing in radiotherapy, in order to develop isoeffect relationships [682], and pointed to the importance of dynamic modeling in the analysis of radiation damage [683].

Marin-Sanguino and colleagues studied the question of whether a BST model, which is expressed in terms of metabolites, could also be expressed in terms of fluxes. In other words, this “dual” system contains fluxes as dependent variables. Such a transformation to the dual form is indeed possible with methods of advanced algebra [684].

8. Mathematical Features of BST Models

8.1. Accuracy

BST models are usually developed as approximations, and their accuracy of representation is a priori unknown. Nonetheless, four aspects are clear. First, the functions to be approximated by power-law expressions are in truth almost always unknown for biological systems. They are typically complex, convoluted aggregates of functions without an evident mathematical representation. Thus, it is immediately difficult, if not impossible, to assess with generality how well BST models or other representations perform. Second, with the correct parameter values, a BST model is absolutely exact at an operating, and it is very accurate close by, as it is guaranteed by Taylor’s theory. In principle, the accuracy of representation could also be estimated from Taylor’s theory, if the approximated functions were known, but such an assessment is practically infeasible in most cases [685]. Third, except for rare cases, the quality of representation eventually degrades in a distance from the operating point. This simple fact has been used as a generic argument against the use of power-law models [62, 151, 686, 687]. However, the argument is not quite fair, because all dynamic models in biology suffer this problem in one form or another. Finally, it is always possible to improve the accuracy of representation, at least in principle. One option is the use of piecewise approximations, which were already mentioned in the original BST papers [101] and which are directly related to breakpoint analysis [112], which is one root of BST models. The pieces may be concatenated in an ad hoc fashion, in response to some input, or in an automated fashion that optimizes the overall data fit [36, 385, 386, 688]. A second option is the inclusion of higher-order derivatives in the Taylor approximation. Cascante et al. [689] and Guebel [397] described the details for a second-order representation. While this representation is more accurate, its format becomes so cumbersome that this approach has not been used in practical applications.

Hernández and collaborators suggested the use of power-law models, in which the parameter values were not obtained from approximation at a single operating point, but by regression over a reasonable domain of the involved variables [192, 193]. In this case, the error between the original and the power-law function is distributed over an a priori determined range. The use of computational buffers was already mentioned [677]. By absorbing excess material and releasing material on demand, these buffers permit larger variations in system variables.

Finally, the technique of recasting permits increases in accuracy. Recasting is a method that uses equivalence transformations to convert a system of arbitrary ODEs exactly into a GMA or S-system; it will be discussed in the next section. As an illustrative example, consider the so-called Brusselator, which is a limit cycle system in the format of a GMA system [420]. Approximating two power-law terms in this system with a single power-law term, which would convert the GMA into an S-system, is locally quite accurate, but the S-system format loses the limit cycle property, whereas recasting the GMA into and S-system retains this feature perfectly [421].

In addition to these unambiguous mathematical facts, one may speculate more generically about the accuracy of BST systems. Two arguments seem reasonable. First, the fact that power-law representations permit nonlinearities seems to imply that these functions are probably better suited for biological modeling than linear functions. Second, one might argue that the accuracy of power-law approximations tends to become better for larger systems, because larger systems are usually better buffered against perturbations, and this buffering keeps the system variables in small ranges around a normal operating point. Related to this supposition is the conjecture that kinetic orders tend to become smaller in magnitude for larger systems, which in turn reduces many of the sensitivities of the system model and thus increases robustness [3].

Other assessments of accuracy fall into three categories. In the first, power-law models may be compared to functions that are assumed to be correct, at least in certain situations. The second, semiheuristic category covers cases where carefully generated experimental data suggest power-law relationships, while the third category contains cases where BST models fit experimental data very well.

8.1.1. Comparisons with Other Approximations

Before discussing details of model comparisons, one should note that many representations perform similarly well, if variables stay relatively close to their operating values, which are often taken at the normal steady state of the system. As a consequence, dynamic simulations with different model types often exhibit very similar results (e.g., [63, 186, 187]).

Shiraishi and Savageau discussed different typical alternatives for representing biochemical reactions [37]. They showed that several of these standard models are in fact special cases of power-law models and that the level of approximation plays a role in the assessment of accuracy. For instance, the Michaelis-Menten (MM) model in its explicit form is not a special case of a power-law model. However, formulating the MM processes in terms of elementary chemical reactions makes the model a mass action system and therefore a special case of a GMA system.

Several studies compared BST models against other dynamic modeling formats. Examples included comparisons with lin-log models, which perform better for very high substrate concentrations, but lead to negative rates for very small concentrations [58, 62, 63, 71, 151]. Kaddi and colleagues compared several modeling frameworks, including GMA systems, but could not identify a clear winner [690]. Similarly, Dräger et al. 2009 compared various rate laws, especially with respect to their optimization potential and obtained mixed results. Depending on the situation, a GMA model or a combination of MM with so-called convenience kinetics produced the best results [691]. Costa et al. considered a combination of lin-log and MM models best, unless the concentrations in the system were small [167]. Hadlich and colleagues (2009) compared several modeling formats for biochemical networks and found that there is “no silver bullet of metabolic model formulation,” primarily because all models are approximations with a limited range of valid representation [692]. Similarly, Grima and Schnell compared GMA models with kinetic formulations permitting time-dependent rate coefficients, and the results were not clear cut [693].

Addressing systems with relatively few molecules, Wolkenhauer’s group compared GMA models with a compact version of a Gillespie representation for stochastic kinetic systems in the format of the Chemical Master Equation [694]. Wu characterized under what conditions such stochastic systems can be modeled as power-law functions with sufficient accuracy [176].

Maybe surprisingly, the S-system variant is more accurate than the corresponding GMA model if MM or Hill rate laws are to be represented [695]. This finding was explained with the fact that power-law approximations tend to overestimate hyperbolic functions, such as MM, while the aggregation of terms tends to underestimate sums of processes, thereby leading to a partial compensation of errors. Similar results were demonstrated for reversible reaction systems, where different types of aggregation are possible [54–56, 454].

8.1.2. Semiheuristic Analyses of Accuracy and Heuristic Evidence

Much circumstantial support for power-law representations comes from good model fits to data characterizing systems in vitro and in vivo. Indeed, most of the applied studies described before were tested against some data and found sufficiently accurate. Of course, these fits are neither proof of correctness nor superiority over other models, because the data often were not detailed enough to permit such assessments. Nevertheless, some types of data lend direct support to the use of power-law functions. For example, Savageau observed that many processes in vitro and in vivo naturally follow power-law relationships over surprisingly wide ranges of variation that span several orders of magnitude. Good examples include the induction characteristics of several genes [1, 10].

Kopelman’s group conducted careful experiments characterizing the kinetics of chemical reactions in homogeneous three-dimensional environments as well as in constrained, lower-dimensional spaces, such as membranes or channels [666, 667, 669, 670]. They determined that fractal kinetics, as described by Savageau [13, 60, 671], represented reality well. Similarly, Neff and Bajzer compared different model representations against experimental data in viscous media and found that fractal kinetics within BST seemed to be slightly superior to other alternatives [675, 676].

Vlad and colleagueS-systematically analyzed data characterizing a specific recycling process in a prothrombin assay. For the slow processes, they formulated a variant of a mass-action law, while fast reactions were modeled with delay expressions. They concluded that GMA models capture the empirical equations well [696]. In other contexts, several analyses of metabolic time series data were fitted quite well with GMA and S-system models. Examples included bacterial and yeast systems (e.g., [201, 357, 547]).

Growth may be seen as a heuristic manifestation of the long-term dynamics of organisms. To demonstrate this point, Savageau derived growth functions and the phenomenon of allometry from first principles of cellular processes [128, 697, 698]. Indeed, allometry, which describes the rate of growth of one part of an organism in relation to other parts, is directly and uniquely commensurate with power-law functions [3, 582, 697, 699–701]. More generally, many growth phenomena were represented well with power-law models within BST, sometimes directly, and sometimes using the method of recasting, which will be discussed next [25, 119, 128, 165, 423, 447, 485, 575, 576, 582, 584, 620, 697, 698, 702–705].

9. Recasting

The growth functions just mentioned present a good opportunity to discuss a feature of BST models that is very intriguing. Namely, any system of ODEs can be converted into an exactly equivalent BST model in GMA or S-system format, or even in the much simpler format of a binary Half-system that only has exponents of 0 or 1 [113, 706]. This generality of the BST format first became evident during the development of the fundamental theory underlying BST. Namely, Savageau noted that growth functions can be converted in to equivalent S-systems through the introduction of one or two auxiliary variables [128, 698]. It was shown later that even a simple two-variable Half-system format can be used to classify most of the standard growth laws found in the literature [25, 624, 706].

The general principles of recasting are surprisingly simple. For each function that does not appear in an ODE system as a power-law term, one defines a new variable and differentiates it. Iterating this process eventually leads to a GMA system. Furthermore, the repeated definition of a product of two new variables for the sum or difference of two terms within a GMA system reduces this system to the S-system or Half-system form. The first component of this strategy was independently observed in the field of mathematical physics [707], while the second component was shown somewhat later for BST models [113, 136]. At the same time, Peschel and Mende showed that all ODE systems can be recast as Lotka-Volterra (LV) systems [134], and the equivalence of the two formats was confirmed soon after [21, 136].

The observation that essentially all nonlinearities could be equivalently represented as either LV or BST systems elevated these model representations to the status of universal formats. Hernández-Bermejo and Fairén combined the two formats into the representation of a Generalized Lotka-Volterra model, which allowed unique algebraic classification tasks, and declared this format as truly “canonical” [144, 145, 147, 708–710]. Papachristodoulou and Prajna demonstrated that recasting can be used to study nonpolynomial vector fields by recasting them into rational vector fields [711].

As an illustrative example, consider the differential equation with , , and . Clearly, the sine function needs to be replaced, and we define . Differentiation of yields , and we define, for instance, . Thus, we obtain the two derivatives In addition, we reduce the Michaelis-Menten function by defining , which has the derivative . The initial values are set according to the definitions of the new variables, namely, , , and . Taken together, we obtain

A plot of the original and the recast is shown in Figure 15. The auxiliary variables are usually not of particular interest.

Figure 15: Confirmation that recasting leads to equivalent solutions.The red trajectory describes in the original ODE shown in (35). The variable of the recast system (37) is shown with dots, because a line would exactly cover up the red line.

In the case just discussed the original “system” has one variable, where the recast system has four. The recast system is thus much “bigger.” However, correctly fixing the initial values completely defines a trajectory that is equivalent to the original equation. Thus, the original is embedded in a higher-dimensional space, where it is described exclusively by power-law functions. Several articles have discussed generic features of recasting and highlighted the fact that the process is not unique. For instance, polynomials may be recast in distinctly different ways [25, 706, 712]. Different recast versions of the same original system intersect in a high-dimensional space, and this intersection contains (or is equivalent to) the original.

The last step of a typical recasting process is the reduction of a GMA system to the S-system format [113]. This step raised the question of whether it is possible to transform S-systems equivalently back into GMA systems with fewer variables. As one might expect, such a reduction in dimensionality is not possible in general. However, it is possible in select cases, some of which can be characterized algebraically with methods of Lie transformations [712–714].

Recasting can be very beneficial and may, for instance, speed up numerical solutions [87, 113], but it does not eradicate complicated problems with the original system. For instance, the computation of a steady state is not much simplified, because the recast S-system tends to have a system matrix with lower than maximal rank.

Recasting can be used as a modeling tool. For example, if a system is affected by a circadian process, it may not be feasible to model this process in detail. Instead, the periodic process may be modeled by a sine function and recast as shown above [3, 421]. It is even possible to study the effects of chaos on a system by modeling the chaotic process as a recast BST system [679].

It is also to some degree possible to recast other systems of ODEs into the GMA or S-system format and then to use BST methods for further analysis. As examples, one can optimize this recast system toward the maximization of yield [646] or study features of bistability [36, 385, 386].

Outside growth functions, recasting has been widely applied to statistical distribution functions. Savageau initiated this effort by showing how all typical univariate probability functions can be embedded in a “suprasystem” of S-system models [715]. Rust, Chen, and others extended this idea to probability density functions that are otherwise difficult to evaluate, such as the noncentral , , beta, gamma, and Chi-square distributions, as well as the distribution of the correlation coefficient [79, 716–730].

While recasting provided a means for numerically evaluating complicated probability distribution functions, the high dimensionality of Savageau’s suprasystem suggested the search for simpler alternatives. Recognizing that cumulative distribution functions always grow monotonically from 0 to 1 and very much resemble growth functions, Voit proposed a single S-system equation as a good approximation of cumulative distribution functions, calling it the S-distribution [731]. It turned out that this S-distribution has interesting features. For instance, the initial value is directly related to the median of the distribution, the rate constant, which must be the same for both terms in the S-system equation, is related to the variance, and the kinetic orders determine the shape of the distribution. Indeed, the two kinetic orders were used as a shape classification system for continuous as well as discrete distribution functions [731–733]. The same distribution was subsequently used in survival analysis and risk assessment [28, 625, 734–738], and as a tool for random number generation and quantile analysis [739, 740], as well as for inference [741, 742]. The efficiency and flexibility of random number generation permitted the use of S-distributions for traditional and hierarchical Monte-Carlo simulations [424, 743, 744].

Further analysis showed that the S-distribution has interesting scalability features that permit analyses analogous to z-score computations with normal distributions [81, 745].

Parameters of the distribution were estimated with least-squares and maximum likelihood methods [731, 740, 746].

Yu generalized the S-distribution to multiple variates, through the introduction of copulas [747].

Sorribas’ group used the S-distribution, as well as a generalized GS-distribution [748], in a clinical setting to analyze reference intervals of normalcy and receiver operating characteristic (ROC) curves, which offer an effective method for the evaluation of the performance of a diagnostic test [190, 749, 750]. They also used the GS-distribution to study questions in survival analysis [751]. Voit’s group used the S-distribution for health-economical questions [752].

Considering dynamic systems as modulators of the S-distribution, changes in distributional shapes over time were characterized. As examples, the sizes of girls in healthy populations and the changes in size distributions of growing tree stands were analyzed [575, 584, 702].

10. Conclusions

During the past decade, the field of systems biology has been expanding at an amazing speed, and as this paper indicates, the technological developments and applications of BST have grown at a similar rate. The question then arises: what’s next? Of course, predictions are always treacherous, but some trends are emerging at the horizon, and they appear to be very well aligned with BST.

First, paralleling the increased scope in data generation, larger and larger systems are being tackled with computational models. Typically, large systems are better buffered against perturbations than small systems. As a consequence, key variables in larger systems tend to remain within smaller ranges of variation. As far as this is true in specific situations, the accuracy of BST will be sufficient in many cases.

Second, the search for design and operating principles has become popular [78]. This search has been a central theme in BST for a long time [1]. Most of the BST analyses in this area focused on small modules that could be investigated, at least partially, with crisp mathematical methods. It seems that the next phase of this theme might be the investigation of functional and operational principles that are embedded within, or distributed throughout, larger systems [44]. The relatively new focus on design spaces is a first significant step in this direction [492, 493], but it might be that additional concepts must be conceived to grasp design and operating features spanning large systems and several organizational scales.

Third, the community of systems biologists is fully recognizant of the fact that our current tools for addressing multiscale systems are not powerful enough. This deficiency pertains to models for several overlapping time scales, where neither slow nor fast processes can validly be ignored or considered constant, for spatial scales, where it is not feasible to represent all processes at similarly detailed molecular scales, as well as for organizational scales, where system responses extend from molecular to organismic scales and beyond. The telescopic property of power-law systems has been discussed theoretically [128], especially for different organizational scales, but it has not been used all that much in practical applications. This property may work well with ideas of mesoscopic modeling, because these models are located at a medium scale, which is extendable toward larger, more detailed systems, and also to more abstracted skeletal systems of smaller size that permit design analyses [44]. The telescopic property may also align well with methods of concept map modeling [45], where the topology of a system is complemented with coarse information, or even a biologist’s intuition, in order to convert a conceptual diagram into an initial dynamical model that can be used to sharpen intuition, gain novel insights, and suggest a new set of experimental hypotheses.

Fourth, recent developments in experimental biology have been empowering the field to generate molecular time-series data. These data mandate the creation of more efficient inverse methods for parameter estimation than are currently available. Moreover, in spite of recent and future advancements, these data can seldom be expected to be complete. Thus, systems biology must develop computational methods for filling gaps, merging heterogeneous data, and stitching series of static measurements together into dynamic trajectories. Given that the processes underlying these data are usually not fully known, the minimally biased, procedural model design methods of BST might provide excellent initial default models for this purpose. In particular, the power to get started, quasi-automatically, with the design of symbolic equations from biological diagrams, the rich repertoire of experience with parameter values, and the efficacy of the tools available for BST analyses provide superb starting conditions that may lead to the full completion of an analysis or at least show where finer or different approximations are needed. As an alternative to starting from a biological diagram, one might also start with the static results of stoichiometric or flux balance analyses and develop methods for converting these into a dynamic BST models. Some rudimentary analyses of this type have been proposed [323], but much more effort is needed. As one intriguing aspect of this pursuit, computational systems analysts might become enabled to propose minimal combinations of data generation experiments that would permit valid conversions of static into dynamic models.

BST has been around for slightly over forty years, and, indeed, this may be its prime time.

Acknowledgments

This work was funded in part by the National Science Foundation (Projects MCB-0946595 (PI: EOV) and ARRA-0928196 (PI: E. Mann)), the National Institutes of Health (Projects NIH-GM063265 (PI: Y. A. Hannun) and P01-ES016731 (PI: G. W. Miller)), and the BioEnergy Science Center (BESC; PI: Paul Gilna), a U.S. Department of Energy Research Center supported by the Office of Biological and Environmental Research in the DOE Office of Science. The funding agencies are not responsible for the content of this paper.

References

M. A. Savageau, Biochemical Systems Analysis: A Study of Function and Design in Molecular Biology, Addison-Wesley, Reading, Mass, USA, 1976.

E. O. Voit, Canonical Nonlinear Modeling. S-System Approach to Understanding Complexity, Van Nostrand Reinhold, New York, NY, USA, 1991.

E. O. Voit, Computational Analysis of Biochemical Systems: A Practical Guide for Biochemists and Molecular Biologists, Cambridge University Press, Cambridge, UK, 2000.

N. V. Torres and E. O. Voit, Pathway Analysis and Optimization in Metabolic Engineering, Cambridge University Press, Cambridge, UK, 2002.

G. Goel, Reconstructing Biochemical Systems. Systems Modeling and Analysis Tools for Decoding Biological Designs, VDM Verlag Dr. Müller, Saarbrücken, Germany, 2008.

E. O. Voit, A First Course in Systems Biology, Garland Science, New York, NY, USA, 2012.

E. O. Voit, Computational Analysis of Biochemical Systems. A Practical Guide for Biochemists and Molecular Biologists, Cambridge University Press, Cambridge, UK, 2006.

N. V. Torres and E. O. Voit, Pathway Analysis and Optimization in Metabolic Engineering, Cambridge University Press, Cambridge, UK, 2005.

F. Shiraishi, BST: Biochemical Systems Theory, 2007.

M. A. Savageau, “The behavior of intact biochemical control systems,” Current Topics in Cellular Regulation, vol. 6, pp. 63–129, 1972.

M. A. Savageau, “Mathematics of organizationally complex systems,” Biomedica Biochimica Acta, vol. 44, no. 6, pp. 839–844, 1985.

M. A. Savageau, “Critique of the enzymologist's test tube,” in Fundamentals of Medical Cell Biology, E. E. Bittar, Ed., vol. 3, pp. 45–108, JAI Press, Greenwich, Conn, USA, 1992.

M. A. Savageau, “Enzyme kinetics in vitro and in vivo: Michaelis-Menten revisited,” in Principles of Medical Biology, E. E. Bittar, Ed., vol. 4, pp. 93–146, JAI Press, Greenwich, Conn, USA, 1995.

M. A. Savageau, “A kinetic formalism for integrative molecular biology: manifestation in biochemical systems theory and use in elucidating design principles for gene circuits,” in Integrative Approaches to Molecular Biology, J. Collado-Vides, B. Magasanik, and T. F. Smith, Eds., pp. 115–146, MIT Press, Cambridge, Mass, USA, 1996.

M. A. Savageau and E. O. Voit, “Power-law approach to modeling biological systems—I—theory,” Journal of Fermentation Technology, vol. 60, pp. 221–228, 1982.

E. O. Voit and M. A. Savageau, “Power-law approach to modeling biological systems—III—methods of analysis,” Journal of Fermentation Technology, vol. 60, pp. 223–241, 1982.

E. O. Voit, “Canonical modeling: review of concepts with emphasis on environmental health,” Environmental Health Perspectives, vol. 108, no. 5, supplement, pp. 895–909, 2000.

E. O. Voit and M. A. Savageau, “S-system analysis of biological systems,” in Mathematics in Biology and Medicine, V. Capasso, E. Grosso, and S. L. Paveri-Fontana, Eds., vol. 57 of Lecture Notes in Biomathematics, pp. 517–524, Heidelberg, Germany, 1985.

E. O. Voit, “Models-of-data and models-of-processes in the post-genomic era,” Mathematical Biosciences, vol. 180, pp. 263–274, 2002.

A. Marin-Sanguino, S. K. Gupta, E. O. Voit, and J. Vera, “Biochemical pathway modeling tools for drug target detection in cancer and other complex diseases,” Methods in Enzymology, vol. 487, pp. 319–369, 2011.

M. Peschel, W. Mende, M. A. Savageau, and E. O. Voit, “Allgemeine Systemkonzepte für homogene dynamische Netzwerke,” Messen-Steuern-Regeln, vol. 32, pp. 170–172, 1989.

K. J. Sims, F. Alvarez-Vasquez, E. O. Voit, and Y. A. Hannun, “A guide to biochemical systems modeling of sphingolipids for the biochemist,” Methods in Enzymology, vol. 432, pp. 319–350, 2007.

M. A. Savageau, “Power-law formalism: a canonical nonlinear approach to modeling and analysis,” in Proceedings of the World Congress of Nonlinear Analysts, V. Lakshmikantham, Ed., pp. 3323–3334, Walter de Gruyter Publishers, 1996.

E. O. Volt, “Control in perspective,” Trends in Biochemical Sciences, vol. 12, p. 221, 1987.

E. O. Voit, “Recasting nonlinear models as S-systems,” Mathematical and Computer Modelling, vol. 11, pp. 140–145, 1988.

E. O. Voit, “Modelling metabolic networks using power-laws and S-systems,” Essays in Biochemistry, vol. 45, pp. 29–40, 2008.

E. O. Voit, Z. Qi, and G. W. Miller, “Steps of modeling complex biological systems,” Pharmacopsychiatry, vol. 41, no. 1, pp. S78–S84, 2008.

E. O. Voit and M. K. Schubauer-Berigan, “The role of canonical modeling as a unifying framework for ecological and human risk assessment,” in Risk Assessment: Logic and Measurement, M. C. Newman and C. L. Stojan, Eds., pp. 101–139, Ann Arbor Press, Chelsea, Mich, USA, 1998.

M. A. Savageau, “Introduction to S-systems and the underlying power-law formalism,” Mathematical and Computer Modelling, vol. 11, pp. 546–551, 1988.

E. O. Voit and J. H. Schwacke, “Understanding through modeling,” in Systems Biology: Principles, Methods, and Concepts, A. K. Konopka, Ed., pp. 27–82, CRC Press/Taylor & Francis Books, Boca Raton, Fla, USA, 2007.

E. O. Voit and S. R. Veflingstad, “Systems biology as an inspiration for mechatronics,” Journal of Biomechatronics Engineering, vol. 1, pp. 55–69, 2008.

M. A. Savageau, “Biochemical systems theory: operational differences among variant representations and their significance,” Journal of Theoretical Biology, vol. 151, no. 4, pp. 509–530, 1991.

E. O. Voit, “Tutorial on the structure of S-systems. Tutorials of the Iizuka,” in Proceedings of the 4th International Conference on Soft Computing, Lizuka, Fukuoka, Japan, 1996.

M. A. Savageau, “Reconstructionist molecular biology,” New Biologist, vol. 3, no. 2, pp. 190–197, 1991.

M. A. Savageau, “The challenge of reconstruction,” New Biologist, vol. 3, no. 2, pp. 101–102, 1991.

M. A. Savageau, “Design principles for elementary gene circuits: elements, methods, and examples,” Chaos, vol. 11, no. 1, pp. 142–159, 2001.

F. Shiraishi and M. A. Savageau, “The tricarboxylic acid cycle in Dictyostelium discoideum. I. Formulation of alternative kinetic representations,” Journal of Biological Chemistry, vol. 267, no. 32, pp. 22912–22918, 1992.

F.-S. Wang and W.-H. Wu, “Biomolecular pathway modeling,” in Systems Biology, pp. 55–84, World Scientific, Singapore, 2012.

R. Alves, E. Vilaprinyo, and A. Sorribas, “Integrating bioinformatics and computational biology: perspectives and possibilities forin silico network reconstruction in molecular systems biology,” Current Bioinformatics, vol. 3, pp. 98–129, 2008.

S. R. Veflingstad, P. Dam, Y. Xu, and E. O. Voit, “Microbial pathway models,” in Computational Methods for Understanding Bacterial and Archaeal Genomes, Y. Xu and J. P. Gogarten, Eds., vol. 7, Imperial College Press, London, UK, 2008.

J. Vera, E. Balsa-Canto, P. Wellstead, J. R. Banga, and O. Wolkenhauer, “Power-law models of signal transduction pathways,” Cellular Signalling, vol. 19, no. 7, pp. 1531–1541, 2007.

R. Alves, E. Vilaprinyo, B. Hernández-Bermejo, and A. Sorribas, “Mathematical formalisms based on approximated kinetic representations for modeling genetic and metabolic pathways,” Biotechnology and Genetic Engineering Reviews, vol. 25, pp. 1–40, 2008.

E. O. Voit, “Metabolic modeling: a tool of drug discovery in the post-genomic era,” Drug Discovery Today, vol. 7, no. 11, pp. 621–628, 2002.

E. O. Voit, Z. Qi, and S. Kikuchi, “Mesoscopic models of neurotransmission as intermediates between disease simulators and tools for discovering design principles,” Pharmacopsychiatry, vol. 45, no. 1, supplement, pp. S22–S30, 2012.

G. Goel, I. C. Chou, and E. O. Voit, “Biological systems modeling and analysis: a biomolecular technique of the twenty-first century,” Journal of Biomolecular Techniques, vol. 17, no. 4, pp. 252–269, 2006.

E. O. Voit, “Theory and applications of S-systems,” in Dynamical Networks, W. Ebeling and M. Peschel, Eds., pp. 37–51, Akademie, Berlin, Germany, 1989.

E. O. Voit, M. A. Savageau, and D. H. Irvine, “An introduction to S-systems,” in Canonical Nonlinear Modeling. S-system Approach to Understanding Complexity, E. O. Voit, Ed., pp. 47–66, Van Nostrand Reinhold, New York, NY, USA, 1991.

K. J. Sims, S. D. Spassieva, E. O. Voit, and L. M. Obeid, “Yeast sphingolipid metabolism: clues and connections,” Biochemistry and Cell Biology, vol. 82, no. 1, pp. 45–61, 2004.

E. O. Voit, “The dawn of a new era of metabolic systems analysis,” Drug Discovery Today, vol. 2, no. 5, pp. 182–189, 2004.

D. Tominaga and M. Okamoto, “Design of canonical model describing complex nonlinear dynamics,” in Proceedings of the 7th International Conference on Computer Applications in Biotechnology, pp. 85–90, 1998.

E. O. Voit, “Canonical nonlinear simulation of complex systems,” in Proceedings of the European Simulation Multiconference, pp. 34–39, Nürnberg, Germany, 1990.

M. A. Savageau, E. O. Voit, and D. H. Irvine, “Biochemical systems theory and metabolic control theory—1—fundamental similarities and differences,” Mathematical Biosciences, vol. 86, no. 2, pp. 127–145, 1987.

M. A. Savageau, E. O. Voit, and D. H. Irvine, “Biochemical systems theory and metabolic control theory—2—the role of summation and connectivity relationships,” Mathematical Biosciences, vol. 86, no. 2, pp. 147–169, 1987.

A. Sorribas and M. A. Savageau, “Strategies for representing metabolic pathways within biochemical systems theory: reversible pathways,” Mathematical Biosciences, vol. 94, no. 2, pp. 239–269, 1989.

A. Sorribas and M. A. Savageau, “A comparison of variant theories of intact biochemical systems. II. flux-oriented and metabolic control theories,” Mathematical Biosciences, vol. 94, no. 2, pp. 195–238, 1989.

A. Sorribas and M. A. Savageau, “A comparison of variant theories of intact biochemical systems. I. enzyme-enzyme interactions and biochemical systems theory,” Mathematical Biosciences, vol. 94, no. 2, pp. 161–193, 1989.

A. Sorribas, “Optimal strategies for modeling biochemical systems,” in Canonical Nonlinear Modeling. S-System Approach to Understanding Complexity, E. O. Voit, Ed., Van Nostrand Reinhold, New York, NY, USA, 1991.

F. S. Wang, C. L. Ko, and E. O. Voit, “Kinetic modeling using S-systems and lin-log approaches,” Biochemical Engineering Journal, vol. 33, no. 3, pp. 238–247, 2007.

M. A. Savageau, “Dominance according to metabolic control analysis: major achievement or house of cards?” Journal of Theoretical Biology, vol. 154, no. 1, pp. 131–136, 1992.

M. A. Savageau, “Michaelis-Menten mechanism reconsidered: implications of fractal kinetics,” Journal of Theoretical Biology, vol. 176, no. 1, pp. 115–124, 1995.

M. A. Savageau, “Metabolite channeling: implications for regulation of metabolism and for quantitative description of reactions in vivo,” Journal of Theoretical Biology, vol. 152, no. 1, pp. 85–92, 1991.

J. J. Heijnen, “Approximative kinetic formats used in metabolic network modeling,” Biotechnology and Bioengineering, vol. 91, no. 5, pp. 534–545, 2005.

R. C. H. del Rosario, E. Mendoza, and E. O. Voit, “Challenges in lin-log modelling of glycolysis in Lactococcus lactis,” IET Systems Biology, vol. 2, no. 3, pp. 136–149, 2008.

E. O. Voit and N. V. Torres, “Simulation and steady-state optimization of integrated biochemical systems: theory and applications in biotechnology,” in Proceedings of the EUROSIM Simulation Congress, F. Breitenecker and I. Husinsky, Eds., Elsevier Science B.V., Vienna, Austria, 19951995.

N. V. Torres, F. Alvarez-Vasquez, and E. O. Voit, “Optimization of biotechnological processes with S-system models. Methodology and applications to fungal metabolism,” in Handbook of Fungal Biotechnology, D. K. Arora, Ed., Marcel Dekker, New York, NY, USA, 2th edition, 2002.

N. V. Torres, E. O. Voit, C. Glez-Alcón, and F. Rodríguez, “A novel approach to design of overexpression strategy for metabolic engineering. Application to the carbohydrate metabolism in the citric acid producing mould Aspergillus niger,” Food Technology and Biotechnology, vol. 36, no. 3, pp. 177–184, 1998.

E. O. Voit and N. V. Torres, “Canonical modeling of complex pathways in biotechnology (invited review),” Recent Research Developments in Biotechnology & Bioengineering, vol. 1, pp. 321–341, 1998.

I. C. Chou and E. O. Voit, “Recent developments in parameter estimation and structure identification of biochemical and genomic systems,” Mathematical Biosciences, vol. 219, no. 2, pp. 57–83, 2009.

E. O. Voit, S. Marino, and R. Lall, “Challenges for the identification of biological systems from in vivo time series data,” In Silico Biology, vol. 5, no. 2, pp. 83–92, 2005.

E. O. Voit, “Model identification: a key challenge is computational systems biology,” in Optimization and Systems Biology, D.-Z. Du and X. S. Shang, Eds., pp. 1–12, World Publishing Corp., 2008.

E. O. Voit and I.-C. Chou, “Parameter estimation in canonical biological systems models,” International Journal of Systems and Synthetic Biology, vol. 1, pp. 1–19, 2010.

E. O. Voit, “What if the fit is unfit? Criteria for biological systems estimation beyond residual errors,” in Applied Statistics for Biological Networks, M. Dehmer, F. Emmert-Streib, and A. Salvador, Eds., pp. 183–200, John Wiley and Sons, New York, NY, USA, 2011.

M. A. Savageau, “A theory of alternative designs for biochemical control systems,” Biomedica Biochimica Acta, vol. 44, no. 6, pp. 875–880, 1985.

M. A. Savageau, “Coupled circuits of gene regulation,” in Sequence Specificity in Transcription and Translation, R. R. Calendar and L. Gold, Eds., pp. 633–642, A. R. Liss, New York, NY, USA, 1985.

M. A. Savageau, “Are there rules governing patterns of regulation?” in Theoretical Biology-Epigenetic and Evolutionary Order, B. C. Goodwin and P. T. Saunders, Eds., Edinburgh, UK, Edinburgh University Press, 1989.

E. O. Voit, “Design principles and operating principles: the yin and yang of optimal functioning,” Mathematical Biosciences, vol. 182, no. 1, pp. 81–92, 2003.

E. O. Voit, “Design and operation: keys to understanding biological systems,” in Function and Regulation of Cellular Systems: Experiments and Models, A. Deutsch, J. Howard, M. Falcke, and W. Zimmermann, Eds., Birkhäuser, 2004.

R. Alves and A. Sorribas, “Special issue on biological design principles,” Mathematical Biosciences, vol. 231, no. 1, pp. 1–2, 2011.

E. O. Voit and P. F. Rust, “Invited Tutorial: S-system analysis of continuous univariate probability distributions,” Journal of Statistical Computing and Simulation, vol. 42, pp. 187–249, 1992.

A. Sorribas, E. O. Voit, P. F. Rust, and J. Sentis, “S-systems: a useful representation for computing statistical distributions,” Biometric Bulletin, vol. 7, p. 19, 1990.

E. O. Voit, “Canonical modeling: a link between environmental models and statistics,” Austrian Journal for Statistics, vol. 27, pp. 109–121, 1998.

M. A. Savageau, “20 years of S-systems,” in Canonical Nonlinear Modeling. S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 1–44, Van Nostrand Reinhold, New York, NY, USA, 1991.

E. O. Voit, D. H. Irvine, and M. A. Savageau, The User's Guide to ESSYNS, Medical University of South Carolina Press, Charleston, SC, USA, 1989.

D. H. Irvine, E. O. Voit, and M. A. Savageau, “Analysis of complex dynamic networks witrh ESSYNS,” in Canonical Nonlinear Modeling. S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 133–141, Van Nostrand Reinhold, New York, NY, USA, 1991.

D. H. Irvine, M. A. Savageau, and E. O. Voit, “Numerical analysis of S-systems with ESSYNS,” in Canonical Nonlinear Modeling. S-system Approach to Understanding Complexity, E. O. Voit, Ed., pp. 133–141, Van Nostrand Reinhold, New York, NY, USA, 1991.

D. H. Irvine, “Efficient solution of nonlinear models expressed in S-system canonical form,” Mathematical and Computer Modelling, vol. 11, pp. 123–128, 1988.

D. H. Irvine and M. A. Savageau, “Efficient solution of nonlinear ordinary differential equations expressed in S-system canonical form,” SIAM Journal on Numerical Analysis, vol. 27, no. 3, pp. 704–735, 1990.

F. Shiraishi, H. Takeuchi, T. Hasegawa, and H. Nagasue, “A Taylor-series solution in Cartesian space to GMA-system equations and its application to initial-value problems,” Applied Mathematics and Computation, vol. 127, no. 1, pp. 103–123, 2002.

A. Ferreira, Power Law Analysis and Simulation, Version 1.2, 2000.

Y. Yamada, A. Kinoshita, Y. Nakayama, and M. Tomita, “Automatic transformation of kinetic equations into S-system and GMA forms,” Genome Informatics, vol. 13, pp. 482–483, 2002.

M. Okamoto, Y. Morita, D. Tominaga et al., “Design of virtual-labo-system for metabolic engineering: development of biochemical engineering system analyzing tool-kit (BEST KIT),” Computers and Chemical Engineering, vol. 21, no. 1, pp. S745–S750, 1997.

J. Yoshimura, T. Shimonobou, T. Sekiguchi, and M. Okamoto, “Development of the parameter-fitting module for web-based biochemical reaction simulator BEST-KIT,” Chem-Bioinformatics Journal, vol. 3, pp. 114–129, 2003.

T. Sekiguchi and M. Okamoto, “WinBEST-KIT: windows-based biochemical reaction simulator for metabolic pathways,” Journal of Bioinformatics and Computational Biology, vol. 4, no. 3, pp. 621–638, 2006.

J. Vera, C. Sun, Y. Oertel, and O. Wolkenhauer, “PLMaddon: a power-law module for the Matlab SBToolbox,” Bioinformatics, vol. 23, no. 19, pp. 2638–2640, 2007.

J. L. Luo, D. Frank Hsu, and C. Y. Kao, “Constructing a SMBL-based S-system simulation platform,” in Proceedings of the Emerging Information Technology Conference, pp. 170–171, August 2005.

A. Dräger, N. Hassis, J. Supper, A. Schröder, and A. Zell, “SBMLsqueezer: a CellDesigner plug-in to generate kinetic rate equations for biochemical networks,” BMC Systems Biology, vol. 2, article 39, 2008.

Cadlive CADLIVE (Computer-Aided Design of LIVing systEms), 2009, http://www.cadlive.jp/

J. Vera and N. V. Torres, “MetMAP: an integrated Matlab package for analysis and optimization of metabolic systems,” In Silico Biology, vol. 4, no. 2, pp. 97–108, 2004.

M. A. Savageau, “Software for design space analysis,” 2010, http://www.bme.ucdavis.edu/savageaulab/research/projects/

M. A. Savageau, “Biochemical systems analysis—II. The steady-state solutions for an n-pool system using a power-law approximation,” Journal of Theoretical Biology, vol. 25, no. 3, pp. 370–379, 1969.

M. A. Savageau, “Biochemical systems analysis. I. Some mathematical properties of the rate law for the component enzymatic reactions,” Journal of Theoretical Biology, vol. 25, no. 3, pp. 365–369, 1969.

M. A. Savageau, “Biochemical systems analysis—III—dynamic solutions using a power-law approximation,” Journal of Theoretical Biology, vol. 26, no. 2, pp. 215–226, 1970.

D. Garfinkel, L. Garfinkel, M. Pring, S. B. Green, and B. Chance, “Computer applications to biochemical kinetics,” Annual Review of Biochemistry, vol. 39, pp. 473–498, 1970.

D. Garfinkel, “The role of computer simulation in biochemistry,” Computers and Biomedical Research, vol. 2, pp. 31–44, 1968.

D. Garfinkel, “Computer-based modeling of biological systems which are inherently complex: problems, strategies, and methods,” Biomedica Biochimica Acta, vol. 44, no. 6, pp. 823–829, 1985.

M. V. Henri, Lois Générales de l’Action des Diastases, Hermann, Paris, France, 1903.

L. Michaelis and M. L. Menten, “Die Kinetik der Inver-tinwirkung,” Biochemische Zeitschrift, vol. 49, pp. 333–369, 1913.

A. V. Hill, “Possible effects of the aggregation of the molecules of haemoglobin on its dissociation curves,” Journal of Physiology, vol. 40, pp. 4–8, 1910.

A. R. Schulz, Enzyme Kinetics: From Diastase to Multi-Enzyme Systems, Cambridge University Press, New York, NY, USA, 1994.

R. Heinrich and T. A. Rapoport, “A linear steady state treatment of enzymatic chains: general properties, control and effector strength,” European Journal of Biochemistry, vol. 42, no. 1, pp. 89–95, 1974.

R. Heinrich, S. M. Rapoport, and T. A. Rapoport, “Metabolic regulation and mathematical models,” Progress in Biophysics and Molecular Biology, vol. 32, no. 1, pp. 1–82, 1977.

H. W. Bode, Network Analysis and Feedback Amplifier Design, Van Nostrand, Princeton, NJ, USA, 1945.

M. A. Savageau and E. O. Voit, “Recasting nonlinear differential equations as S-systems: a canonical nonlinear form,” Mathematical Biosciences, vol. 87, no. 1, pp. 83–115, 1987.

M. A. Savageau, “Demand theory of gene regulation—II—quantitative application to the lactose and maltose operons of Escherichia coli,” Genetics, vol. 149, no. 4, pp. 1677–1691, 1998.

M. A. Savageau, “Demand theory of gene regulation—I—quantitative development of the theory,” Genetics, vol. 149, no. 4, pp. 1665–1676, 1998.

G. Craciun and M. Feinberg, “Multiple equilibria in complex chemical reaction networks: extensions to entrapped species models,” IEE Proceedings, vol. 153, no. 4, pp. 179–186, 2006.

G. Shinar and M. Feinberg, “Concordant chemical reaction networks,” Mathematical Biosciences, vol. 240, no. 2, pp. 92–113, 2012.

M. A. Savageau, “The power-law formalism: generic properties and relatedness to other canonical nonlinear formalisms,” in Proceedings of the 4th International Conference on Soft Computing, Fuzzy Logic Institute, Iizuka, Japan, 1996.

E. O. Voit and P. J. Sands, “Modeling forest growth—I. Canonical approach,” Ecological Modelling, vol. 86, no. 1, pp. 51–71, 1996.

F. Shiraishi and S. Fujiwara, “An efficient method for solving two-point boundary value problems with extremely high accuracy,” Journal of Chemical Engineering of Japan, vol. 29, no. 1, pp. 88–94, 1996.

F. Shiraishi, “Highly accurate solution of the axial dispersion model expressed in S-system canonical form by Taylor series method,” Chemical Engineering Journal, vol. 83, no. 3, pp. 175–183, 2001.

F. Shiraishi and E. O. Voit, “Solution of a two-point boundary value model of immobilized enzyme reactions, using an S-system-based root-finding method,” Applied Mathematics and Computation, vol. 127, no. 2-3, pp. 289–310, 2002.

F. Shiraishi, S. Furuta, T. Ishimatsu, and J. Akhter, “A simple and highly accurate numerical differentiation method for sensitivity analysis of large-scale metabolic reaction systems,” Mathematical Biosciences, vol. 208, no. 2, pp. 590–606, 2007.

F. Shiraishi, Y. Hatoh, and T. Irie, “An efficient method for calculation of dynamic logarithmic gains in biochemical systems theory,” Journal of Theoretical Biology, vol. 234, no. 1, pp. 79–85, 2005.

J. H. Schwacke and E. O. Voit, “Computation and analysis of time-dependent sensitivities in Generalized Mass Action systems,” Journal of Theoretical Biology, vol. 236, no. 1, pp. 21–38, 2005.

F. Shiraishi, T. Tomita, M. Iwata, A. A. Berrada, and H. Hirayama, “A reliable Taylor series-based computational method for the calculation of dynamic sensitivities in large-scale metabolic reaction systems: algorithm and software evaluation,” Mathematical Biosciences, vol. 222, no. 2, pp. 73–85, 2009.

F. Shiraishi, M. Egashira, M. Iwata, K. Sriyudthsak, and K. Hattori, “Highly reliable computation of dynamic sensitivities in metabolic reaction systems by a variable-step Taylor series method,” Asia-Pacific Journal of Chemical Engineering, vol. 7, pp. S32–S38, 2012.

M. A. Savageau, “Growth of complex systems can be related to the properties of their underlying determinants,” Proceedings of the National Academy of Sciences of the United States of America, vol. 76, no. 11, pp. 5413–5417, 1979.

S. Marino and E. O. Voit, “An automated procedure for the extraction of metabolic network information from time series data,” Journal of Bioinformatics and Computational Biology, vol. 4, no. 3, pp. 665–691, 2006.

G. R. Gavalas, Nonlinear Differential Equations of Chemically Reacting Systems, Springer, Berlin, Germany, 1968.

A. Lotka, Elements of Physical Biology, Williams and Wilkins, 1924, reprinted as “Elements of Mathematical Biology”, Dover, New York, NY, USA, 1956.

R. M. May, “Stability and complexity in model ecosystems,” Monographs in Population Biology, vol. 6, pp. 1–235, 1973.

E. P. Odum, Fundamentals of Ecology, Saunders, Philadelphia, Pa, USA, 1953.

M. Peschel and W. Mende, The Predator-Prey Model: Do We Live in a Volterra World?Akademie, Berlin, Germany, 1986.

V. Volterra, “Variazioni e fluttuazioni del numero d'individui in specie animali conviventi,” Memorie della Reale Accademia Nazionale dei Lincei, vol. 2, pp. 31–113, 1926.

E. O. Voit and M. A. Savageau, “Equivalence between S-systems and Volterra systems,” Mathematical Biosciences, vol. 78, no. 1, pp. 47–55, 1986.

J. C. Sprott, J. A. Vano, J. C. Wildenberg, M. B. Anderson, and J. K. Noel, “Coexistence and chaos in complex ecologies,” Physics Letters, Section A, vol. 335, no. 2-3, pp. 207–212, 2005.

J. A. Vano, J. C. Wildenberg, M. B. Anderson, J. K. Noel, and J. C. Sprott, “Chaos in low-dimensional Lotka-Volterra models of competition,” Nonlinearity, vol. 19, no. 10, article 006, pp. 2391–2404, 2006.

J. E. Bailey and D. F. Ollis, Biochemical Engineering Fundamentals, McGraw-Hill, New York, NY, USA, 1977.

S. Aiba, A. I. Shoda, and A. I. Nagatani, “Kinetics of product inhibition in alcohol fermentation,” Biotechnology and Bioengineering, vol. 67, no. 6, pp. 689–690, 2000.

S. Aiba, A. I. Shoda, and A. I. Nagatani, “Reassessment of the product inhibition in alcohol fermentation,” Journal of Fermentation Technology of Japan, vol. 47, pp. 790–805, 1969.

R. Díaz-Sierra, B. Hernández-Bermejo, and V. Fairén, “Graph-theoretic description of the interplay between non-linearity and connectivity in biological systems,” Mathematical Biosciences, vol. 156, no. 1-2, pp. 229–253, 1999.

V. Fairén and B. Hernández-Bermejo, “Mass action law conjugate representation for general chemical mechanisms,” Journal of Physical Chemistry, vol. 100, no. 49, pp. 19023–19028, 1996.

B. Hernández-Bermejo and V. Fairén, “Lotka-Volterra representation of general nonlinear systems,” Mathematical Biosciences, vol. 140, no. 1, pp. 1–32, 1997.

B. Hernández-Bermejo and V. Fairén, “Simple evaluation of Casimir invariants in finite-dimensional Poisson systems,” Physics Letters, Section A, vol. 241, no. 3, pp. 148–154, 1998.

B. Hernández-Bermejo and V. Fairén, “Hamiltonian structure and Darboux theorem for families of generalized Lotka-Volterra systems,” Journal of Mathematical Physics, vol. 39, no. 11, pp. 6162–6174, 1998.

B. Hernández-Bermejo, V. Fairén, and L. Brenig, “Algebraic recasting of nonlinear systems of ODEs into universal formats,” Journal of Physics A, vol. 31, no. 10, pp. 2415–2430, 1998.

B. Hernández-Bermejo, “Renormalization group approach to power-law modeling of complex metabolic networks,” Journal of Theoretical Biology, vol. 265, no. 3, pp. 422–432, 2010.

V. Hatzimanikatis and J. E. Bailey, “MCA has more to say,” Journal of Theoretical Biology, vol. 182, no. 3, pp. 233–242, 1996.

D. Visser and J. J. Heijnen, “The mathematics of Metabolic Control Analysis revisited,” Metabolic Engineering, vol. 4, no. 2, pp. 114–123, 2002.

L. Wu, W. Wang, W. A. Van Winden, W. M. Van Gulik, and J. J. Heijnen, “A new framework for the estimation of control parameters in metabolic pathways using lin-log kinetics,” European Journal of Biochemistry, vol. 271, no. 16, pp. 3348–3359, 2004.

E. O. Voit, “Accuracy of alternative nonlinear power-law models for biochemical systems: advantages of S-systems,” in IMACS Transactions on Scientific Computing: Modelling od Biomedical Systems, J. Eisenfeld and M. Witten, Eds., vol. 5, Elsevier, North Holland, The Netherlands, 1986.

M. A. Savageau, “Control of metabolism: where is the theory?” Trends in Biochemical Sciences, vol. 12, pp. 219–220, 1987.

M. A. Savageau, “Biochemical systems theory—alternative views of metabolic control,” in Control of Metabolic Processes, A. Cornish-Bowden and M. L. Cardenas, Eds., pp. 69–87, Elsevier, Amsterdam, The Netherlands, 1990.

E. O. Voit, “Comparison of accuracy of alternative models for biochemical pathways,” in Proceedings of the Advanced NATO Research Workshop on Control in Metabolic Systems, A. Cornish-Bowden and M. L. Cárdenas, Eds., pp. 89–100, Plenum Press, 1990.

A. Sorribas, “Discovering another view of control analysis,” Trends in Biochemical Sciences, vol. 12, pp. 221–222, 1987.

A. Sorribas, “Alternative S-system representations for reversible biochemical pathways,” Mathematical and Computer Modelling, vol. 11, pp. 129–133, 1988.

A. Sorribas, “Modeling intracellular biochemical pathways that involve multi-enzyme complexes. A critical evaluation of alternative theories of intact biochemical systems,” in Proceedings of the 1st IFAC Symposium on Modelling and Control in Biomedical Systems, pp. 239–249, April 1988.

D. Visser, R. Van Der Heijden, K. Mauch, M. Reuss, and S. Heijnen, “Tendency modeling: a new approach to obtain simplified kinetic models of metabolism applied to Saccharomyces cerevisiae,” Metabolic Engineering, vol. 2, no. 3, pp. 252–275, 2000.

A. Marin-Sanguino, N. V. Torres, E. R. Mendoza, and D. Oesterhelt, “Metabolic Engineering with power-law and linear-logarithmic systems,” Mathematical Biosciences, vol. 218, no. 1, pp. 50–58, 2009.

S. W. Omholt, E. Plahte, L. Øyehaug, and K. Xiang, “Gene regulatory networks generating the phenomena of additivity, dominance and epistasis,” Genetics, vol. 155, no. 2, pp. 969–980, 2000.

P. Ao, “Metabolic network modelling: including stochastic effects,” Computers and Chemical Engineering, vol. 29, no. 11-12, pp. 2297–2303, 2005.

M. C. Kohn, “Use of sensitivity analysis to assess reliability of metabolic and physiological models,” Risk Analysis, vol. 22, no. 3, pp. 623–631, 2002.

S. Bewick, R. Yang, and M. Zhang, “Complex mathematical models of biology at the nanoscale,” Wiley Interdisciplinary Reviews. Nanomedicine and Nanobiotechnology, vol. 1, no. 6, pp. 650–659, 2009.

W. H. Huang and F. S. Wang, “Kinetic modeling of batch fermentation for mixed-sugar to ethanol production,” Journal of the Taiwan Institute of Chemical Engineers, vol. 41, no. 4, pp. 434–439, 2010.

F. Shiraishi, K. Sriyudthsak, and Y. Suzuki, “Calculation errors of time-varying flux control coefficients obtained from elasticity coefficients by means of summation and connectivity theorems in metabolic control analysis,” Mathematical Biosciences, vol. 223, no. 2, pp. 105–114, 2010.

R. S. Costa, D. Machado, I. Rocha, and E. C. Ferreira, “Hybrid dynamic modeling of Escherichia coli central metabolic network combining Michaelis-Menten and approximate kinetic equations,” BioSystems, vol. 100, no. 2, pp. 150–157, 2010.

A. Sorribas, B. Hernández-Bermejo, E. Vilaprinyo, and R. Alves, “Cooperativity and saturation in biochemical networks: a saturable formalism using Taylor series approximations,” Biotechnology and Bioengineering, vol. 97, no. 5, pp. 1259–1277, 2007.

A. Sorribas, E. Vilaprinyo, and R. Alves, “Approximate kinetic formalisms for modeling metabolic networks: does anything work?” Philippines Information Technology Journal, vol. 1, 2008.

S. Vinga, A. R. Neves, H. Santos, B. W. Brandt, and S. A. L. M. Kooijman, “Subcellular metabolic organization in the context of dynamic energy budget and biochemical systems theories,” Philosophical Transactions of the Royal Society B, vol. 365, no. 1557, pp. 3429–3442, 2010.

N. Tenazinha and S. Vinga, “A survey on methods for modeling and analyzing integrated biological networks,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 8, no. 4, pp. 943–958, 2011.

J. Wu and E. Voit, “Hybrid modelling in biochemical systems theory by means of functional petri nets,” Journal of Bioinformatics and Computational Biology, vol. 7, no. 1, pp. 107–134, 2009.

J. Wu and E. Voit, “Integrative biological systems modeling: challenges and opportunities,” Frontiers of Computer Science in China, vol. 3, no. 1, pp. 92–100, 2009.

J. Wu, Z. Qi, and E. O. Voit, “Investigation of delays and noise in dopamine signaling with hybrid functional Petri nets,” In Silico Biology, vol. 10, Article ID 0005, 2010.

A. Marin-Sanguino and E. R. Mendoza, “Hybrid modeling in computational neuropsychiatry,” Pharmacopsychiatry, vol. 41, no. 1, supplement, pp. S85–S88, 2008.

J. Wu, B. Vidakovic, and E. O. Voit, “Constructing stochastic models from deterministic process equations by propensity adjustment,” BMC Systems Biology, vol. 5, article 187, 2011.

J. Paulsson, “The stochastic nature of intracellular control circuits,” Uppsala University, 2000, http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-465

K. M. Mueller, S. A. Burns, and M. A. Savageau, “A comparison of the monomial method and the S-system method for solving systems of algebraic equations,” Applied Mathematics and Computation, vol. 90, pp. 167–180, 1998.

M. A. Savageau, “Finding multiple roots of nonlinear algebraic equations using S-system methodology,” Applied Mathematics and Computation, vol. 55, no. 2-3, pp. 187–199, 1993.

F. Nabli and S. Soliman, “Steady-state solution of biochemical systems, beyond S-systems via T-invariants,” in Proceedings of the 8th International Conference on Computational Methods in Systems Biology (CMSB '10), pp. 14–22, October 2010.

J. A. Torsella and A. M. Bin Razali, “An analysis of forestry data,” in Canonical Nonlinear Modeling: S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 181–199, Van Nostrand Reinhold, New York, NY, USA, 1991.

E. O. Voit, W. C. Newstetter, and M. L. Kemp, “A feel for systems,” Molecular Systems Biology, vol. 8, article 609, 2012.

N. V. Torres, “Modeling approach to control of carbohydrate metabolism during citric acid accumulation by Aspergillus niger—II—sensitivity analysis,” Biotechnology and Bioengineering, vol. 44, no. 1, pp. 112–118, 1994.

N. V. Torres, “Modeling approach to control of carbohydrate metabolism during citric acid accumulation by Aspergillus niger—I—model definition and stability of the steady state,” Biotechnology and Bioengineering, vol. 44, no. 1, pp. 104–111, 1994.

R. Curto, A. Sorribas, and M. Cascante, “Comparative characterization of the fermentation pathway of Saccharomyces cerevisiae using biochemical systems theory and metabolic control analysis: model definition and nomenclature,” Mathematical Biosciences, vol. 130, no. 1, pp. 25–50, 1995.

R. Curto, E. O. Voit, A. Sorribas, and M. Cascante, “Mathematical models of purine metabolism in man,” Mathematical Biosciences, vol. 151, no. 1, pp. 1–49, 1998.

F. Alvarez-Vasquez, K. J. Sims, Y. A. Hannun, and E. O. Voit, “Integration of kinetic information on yeast sphingolipid metabolism in dynamical pathway models,” Journal of Theoretical Biology, vol. 226, no. 3, pp. 265–291, 2004.

F. Alvarez-Vasquez, H. Riezman, Y. A. Hannun, and E. O. Voit, “Mathematical modeling and validation of the ergosterol pathway in Saccharomyces cerevisiae,” PloS ONE, vol. 6, Article ID e28344, 2011.

T. Hasegawa and F. Shiraishi, “Application of biochemical systems theory to determination of intrinsic kinetic parameters of an immobilized enzyme reaction following Michaelis-Menten kinetics,” in Methodologies for the Conception, Design, and Application of Intelligent Systems, T. Yamakawa and G. Matsumoto, Eds., World Scientific, Singapore, 1996.

A. Sorribas, J. March, and J. Trujillano, “A new parametric method based on S-distributions for computing receiver operating characteristic curves for continuous diagnosis tests,” Statistics in Medicine, vol. 21, no. 9, pp. 1213–1235, 2002.

A. Sorribas, J. B. Lozano, and V. Fairén, “Deriving chemical and biochemical model networks from experimental measurements,” Recent Developments in Chemical Physics, vol. 2, pp. 553–573, 1998.

B. H. Bermejo, V. Fairén, and A. Sorribas, “Power-law modeling based on least-squares minimization criteria,” Mathematical Biosciences, vol. 161, no. 1-2, pp. 83–94, 1999.

B. Hernández-Bermejo, V. Fairén, and A. Sorribas, “Power-law modeling based on least-squares criteria: consequences for system analysis and simulation,” Mathematical Biosciences, vol. 167, no. 2, pp. 87–107, 2000.

R. Díaz-Sierra and V. Fairén, “Simplified method for the computation of parameters of power-law rate equations from time-series,” Mathematical Biosciences, vol. 171, no. 1, pp. 1–19, 2001.

T. Kitayama, A. Kinoshita, M. Sugimoto, Y. Nakayama, and M. Tomita, “A simplified method for power-law modelling of metabolic pathways from time-course data and steady-state flux profiles,” Theoretical Biology and Medical Modelling, vol. 3, article 24, 2006.

A. Sorribas and M. Cascante, “Assessment of the regulatory properties of a metabolic pathway: parameter estimation from steady-state measurements,” in Proceedings of the World Congress of Nonlinear Analysts, V. Lakshmikantham, Ed., vol. 4, pp. 3357–3368, Walter de Gruyter, Berlin, Germany, 1992.

A. Sorribas, S. Samitier, E. I. Canela, and M. Cascante, “Metabolic pathway characterization from transient response data obtained in situ: parameter estimation in S-system models,” Journal of Theoretical Biology, vol. 162, no. 1, pp. 81–102, 1993.

A. Sorribas and M. Cascante, “Steady-state measurements and identifiability of regulatory patterns in metabolic studies,” in Modern Trends in Biothermokinetics, S. Schuster, Ed., pp. 125–131, Plenum Press, New York, NY, USA, 1993.

A. Sorribas and M. Cascante, “Structure identifiability in metabolic pathways: parameter estimation in models based on the power-law formalism,” Biochemical Journal, vol. 298, no. 2, pp. 303–311, 1994.

M. A. Savageau, “Concepts relating the behavior of biochemical systems to their underlying molecular properties,” Archives of Biochemistry and Biophysics, vol. 145, no. 2, pp. 612–621, 1971.

E. O. Voit and M. A. Savageau, “Power-law approach to modeling biological systems—II. Application to ethanol production,” Journal of Fermentation Technology, vol. 60, pp. 229–232, 1982.

J. M. Varah, “A spline least squares method for numerical parameter estimation in differential equations,” SIAM Journal on Scientific and Statistical Computing, vol. 3, pp. 28–46, 1982.

E. O. Voit and J. Almeida, “Decoupling dynamical systems for pathway identification from metabolic profiles,” Bioinformatics, vol. 20, no. 11, pp. 1670–1681, 2004.

N. J.-B. Brunel, “Parameter estimation of ODE’s via nonparametric estimators,” Electronic Journal of Statistics, vol. 2, pp. 1242–1267, 2008.

E. J. Crampin, S. Schnell, and P. E. McSharry, “Mathematical and computational techniques to deduce complex biochemical reaction mechanisms,” Progress in Biophysics and Molecular Biology, vol. 86, no. 1, pp. 77–112, 2004.

P. Gennemark and D. Wedelin, “Efficient algorithms for ordinary differential equation model identification of biological systems,” IET Systems Biology, vol. 1, no. 2, pp. 120–129, 2007.

P. Gennemark and D. Wedelin, “Benchmarks for identification of ordinary differential equations from time series data,” Bioinformatics, vol. 25, no. 6, pp. 780–786, 2009.

M. T. Swain, J. J. Mandel, and W. Dubitzky, “Comparative study of three commonly used continuous deterministic methods for modeling gene regulation networks,” BMC Bioinformatics, vol. 11, article 459, 2010.

J. Sun, J. M. Garibaldi, and C. Hodgman, “Parameter estimation using metaheuristics in systems biology: a comprehensive review,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 9, pp. 185–202, 2012.

S. Gugushvili and C. A. J. Klaassen, “√n-consistent parameter estimation for systems of ordinary differential equations: bypassing numerical integration via smoothing,” Bernoulli, vol. 18, pp. 1061–1098, 2012.

C. Sima, J. Hua, and S. Jung, “Inference of gene regulatory networks using time-series data: a survey,” Current Genomics, vol. 10, no. 6, pp. 416–429, 2009.

S. Džeroski and L. Todorovski, “Equation discovery for systems biology: finding the structure and dynamics of biological networks from time course data,” Current Opinion in Biotechnology, vol. 19, no. 4, pp. 360–368, 2008.

L. Todorovski and S. Džeroski, “Modeling the dynamics of biological networks from time course data,” in Systems Biology for Signaling Networks, S. Choi, Ed., vol. 1, pp. 275–294, Springer, 2010.

W. P. Lee and W. S. Tzou, “Computational methods for discovering gene networks from expression data,” Briefings in Bioinformatics, vol. 10, no. 4, pp. 408–423, 2009.

T. Akutsu, S. Miyano, and S. Kuhara, “Automated construction and analysis of the design space for biochemical systems,” Bioinformatics, vol. 16, no. 8, pp. 727–734, 2000.

Y. Maki, D. Tominaga, M. Okamoto, S. Watanabe, and Y. Eguchi, “Development of a system for the inference of large scale genetic networks,” in Proceedings of the Pacific Symposium on Biocomputing, pp. 446–458, 2001.

A. Shin and H. Iba, “Construction of genetic network using evolutionary algorithm and combined fitness function,” Genome Informatics, vol. 14, pp. 94–103, 2003.

Y. Maki, Y. Takahashi, Y. Arikawa et al., “An integrated comprehensive workbench for inferring genetic networks: VoyaGene,” Journal of Bioinformatics and Computational Biology, vol. 2, no. 3, pp. 533–550, 2004.

S. Kikuchi, D. Tominaga, M. Arita, K. Takahashi, and M. Tomita, “Dynamics modeling of genetic networks using genetic algorithm and S-system,” Bioinformatics, vol. 19, no. 5, pp. 643–650, 2003.

S. Kimura, K. Sonoda, S. Yamane, H. Maeda, K. Matsumura, and M. Hatakeyama, “Function approximation approach to the inference of reduced NGnet models of genetic networks,” BMC Bioinformatics, vol. 9, article 23, 2008.

N. Noman and H. Iba, “Reverse engineering genetic networks using evolutionary computation,” Genome Informatics, vol. 16, no. 2, pp. 205–214, 2005.

Y. Maki, T. Ueda, M. Okamoto, N. Uematsu, Y. Inamura, and Y. Eguchi, “Inference of genetic network using the expression profile time course data of mouse P19 cells,” Genome Informatiics, vol. 13, pp. 382–383, 2002.

S. Kimura, M. Hatakeyama, and A. Konagaya, “Inference of S-system models of genetic networks from noisy time-series data,” Chem-Bio Informatics Journal, vol. 4, no. 1, pp. 1–14, 2004.

N. Noman and H. Iba, “Inference of gene regulatory networks using S-system and Differential Evolution,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '05), pp. 439–446, June 2005.

N. Noman and H. Iba, “Inference of genetic networks using S-system: information criteria for model selection,” in Proceedings of the 8th Annual Genetic and Evolutionary Computation Conference 2006, pp. 263–270, July 2006.

S. J. Wu, C. H. Chou, C. T. Wu, and T. T. Lee, “Inference of genetic network of Xenopus frog egg: improved genetic algorithm,” in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society, vol. 1, pp. 4147–4150, 2006.

S. Kimura, K. Ide, A. Kashihara et al., “Inference of S-system models of genetic networks using a cooperative coevolutionary algorithm,” Bioinformatics, vol. 21, no. 7, pp. 1154–1163, 2005.

S. Kimura, K. Matsumura, and M. Okada-Hatakeyama, “Efficient parameter estimation for the inference of S-system models of genetic networks: proposition of further problem decomposition and alternate function optimization,” Chem-Bio Informatics Journal, vol. 9, 2009.

S. Kimura, K. Matsumura, and M. Okada-Hatakeyama, “Efficient parameter estimation for the inference of S-system models of genetic networks: proposition of further problem decomposition and alternate function optimization,” Chem-Bio Informatics Journal, vol. 11, no. 1, pp. 24–40, 2011.

S. Kimura, K. Sonoda, S. Yamane, K. Matsumura, and M. Hatakeyama, “Function approximation approach to the inference of normalized Gaussian network models of genetic networks,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '06), pp. 4525–4532, July 2006.

S. Kimura, K. Sonoda, S. Yamane, K. Matsumura, and M. Hatakeyama, “Function approximation approach to the inference of reduced NGnet models of genetic networks,” IPSJ Transactions on Bioinformatics, vol. 2007, pp. 9–19, 2007.

S. Kimura, S. Nakayama, and M. Hatakeyama, “Genetic network inference as a series of discrimination tasks,” Bioinformatics, vol. 25, no. 7, pp. 918–925, 2009.

S. Kimura, Y. Shiraishi, and M. Hatakeyama, “Inference of genetic networks using linear programming machines: application of a priori knowledge,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '09), pp. 1617–1624, June 2009.

S. Kimura, Y. Shiraishi, and M. Okada, “Inference of genetic networks using LPMs: assessment of confidence values of regulations,” Journal of Bioinformatics and Computational Biology, vol. 8, no. 4, pp. 661–677, 2010.

S. Kimura, K. Matsumura, and M. Okada-Hatakeyama, “Bootstrap analysis of genetic networks inferred by the method using LPMs,” in Proceedings of the International Conference on Computational Science and Its Applications (ICCSA '10), pp. 296–299, IEEE Computer Society, Washington, DC, USA, 2010.

S. Kimura, Y. Amano, K. Matsumura, and M. Okada-Hatakeyama, “Effective parameter estimation for S-system models using LPMs and evolutionary algorithms,” in Proceedings of the 6th IEEE World Congress on Computational Intelligence, July 2010.

S. Kimura, D. Araki, K. Matsumura, and M. Okada-Hatakeyama, “Inference of S-system models of genetic networks by solving one-dimensional function optimization problems,” Mathematical Biosciences, vol. 235, pp. 161–170, 2012.

M. Nakatsui, T. Ueda, Y. Maki, I. Ono, and M. Okamoto, “Method for inferring and extracting reliable genetic interactions from time-series profile of gene expression,” Mathematical Biosciences, vol. 215, no. 1, pp. 105–114, 2008.

M. Nakatsui, T. Ueda, and M. Okamoto, “Integrated system for inference of gene expression network,” Genome Informatics, vol. 14, pp. 282–283, 2003.

M. Nakatsui, T. Ueda, I. Ono, and M. Okamoto, “Control aspect of common interactions extracted from inferred network candidates of gene expression,” Genome Informatics, pp. P008–P009, 2004.

M. Nakatsui, T. Ueda, I. Ono, and M. Okamoto, “Efficient method for extracting common core binomial genetic interactions,” Genome Informatics, vol. 215, pp. P148–P149, 2005.

D. Tominaga and M. Okamoto, “Nonlinear mumerical optimization technique based on genetic algorithm for inverse problem,” Kagaku Kougaku Ronbunshu, vol. 25, pp. 220–225, 1999.

D. Tominaga, N. Koga, and M. Okamoto, “Efficient numerical optimization algorithm based on genetic algorithm for inverse problem,” in Proceedings of the Genetic and Evolutionary Computation Conference, p. 261, 2000.

T. Ueda, N. Koga, and M. Okamoto, “Efficient numerical optimization technique based on real-coded genetic algorithm,” Genome Informatics, vol. 12, pp. 451–453, 2001.

M. Okamoto, D. Tominaga, N. Koga, and Y. Maki, “Efficient numerical optimization algorithm based on genetic algorithm for inverse problem,” in Proceedings of the 1st International Conference on Systems Biology, pp. 130–135, 2000.

T. Ueda, I. Ono, and M. Okamoto, “Development of system identification technique based on real-coded genetic algorithm,” Genome Informatics, vol. 13, pp. 386–387, 2002.

S. Kikuchi, D. Tominaga, M. Arita, and M. Tomita, “Pathway finding from given time-courses using genetic algorithm,” Genome Informatics, vol. 12, pp. 304–305, 2001.

E. Sakamoto and H. Iba, “Inferring a system of differential equations for a gene regulatory network by using genetic programming,” in Proceedings of the Congress on Evolutionary Computation, pp. 720–726, May 2001.

H. Wang, L. Qian, and E. Dougherty, “Inference of gene regulatory networks using S-system: a unified approach,” IET Systems Biology, vol. 4, no. 2, pp. 145–156, 2010.

X. Yang, J. E. Dent, and C. Nardini, “An S-system parameter estimation method (SPEM) for biological networks,” Journal of Computational Biology, vol. 19, pp. 175–187, 2012.

T. Nakayama, S. Seno, Y. Takenaka, and H. Matsuda, “Inference of S-system models of gene regulatory networks using immune algorithm,” Journal of Bioinformatics and Computational Biology, vol. 9, no. 1, supplement, pp. 75–86, 2011.

L. Z. Liu, F. X. Wu, and W. J. Zhang, “Inference of biological S-system using the separable estimation method and the genetic algorithm,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 9, no. 4, pp. 955–965, 2012.

S. Ando and H. Iba, “Real-coded GA with multimodal uniform distribution,” in Proceedings of the Congress on Evolutionary Computation (CEC '04), pp. 827–834, June 2004.

W. C. Yeh, W. B. Lin, T. J. Hsieh, and S. L. Liu, “Feasible prediction in S-system models of genetic networks,” Expert Systems with Applications, vol. 38, no. 1, pp. 193–197, 2011.

D. Y. Cho, K. H. Cho, and B. T. Zhang, “Identification of biochemical networks by S-tree based genetic programming,” Bioinformatics, vol. 22, no. 13, pp. 1631–1640, 2006.

I. Ono, N. Ono, Y. Seike, M. Nakatsui, R. Morishita, and M. Okamoto, “An evolutionary algorithm taking account of mutual interactions among substances for inference of genetic networks,” in Proceedings of the Congress on Evolutionary Computation (CEC '04), pp. 2060–2067, June 2004.

N. Noman and H. Iba, “Enhancing differential evolution performance with local search for high dimensional function optimization,” in Proceedings of the Genetic and Evolutionary Computation Conference, pp. 967–974, June 2005.

N. Noman and H. Iba, “A new generation alternation model for differential evolution,” in Proceedings of the 8th Annual Genetic and Evolutionary Computation Conference, pp. 1265–1272, July 2006.

N. Noman and H. Iba, “Inferring gene regulatory networks using differential evolution with local search heuristics,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 4, no. 4, pp. 634–647, 2007.

T. Daisuke and P. Horton, “Inference of scale-free networks from gene expression time series,” Journal of Bioinformatics and Computational Biology, vol. 4, no. 2, pp. 503–514, 2006.

T. Hasegawa and J. Yoshimura, “An effective method to increase solvability in biochemical systems using S-system,” Mathematical Biosciences, vol. 201, no. 1-2, pp. 125–142, 2006.

S. Y. Ho, C. H. Hsieh, F. C. Yu, and H. L. Huang, “Evolutionary divide-and-conquer approach to inferring S-system models of genetic networks,” in Proceedings of the IEEE Congress on Evolutionary Computation (IEEE CEC '05), pp. 691–698, September 2005.

S.-Y. Ho, C.-H. Shieh, and F.-C. Yu, “Inference of S-system models for large-scale genetic networks,” in Proceedings of the 21st International Conference on Data Engineering Workshops (ICDEW '05), p. 1155, IEEE Computer Society, 2005.

H. Imade, N. Mizuguchi, I. Ono, N. Ono, and M. Okamoto, ““Gridifying” an evolutionary algorithm for inference of genetic networks using the improved GOGA framework and its performance evaluation on OBI grid,” in Proceedings of the 1st International Workshop on Life Science Grid (LSGRID '04), pp. 171–186, June 2004.

K.-Y. Kim, D.-Y. Cho, and B.-T. Zhang, “Multi-stage evolutionary algorithms for efficient identification of gene regulatory networks,” in Proceedings of the EvoWorkshops, pp. 45–56, Springer, 2006.

S. Kimura, M. Hatakeyama, and A. Konagaya, “Inference of S-system models of genetic networks using a genetic local search,” in Proceedings of the Congress on Evolutionary Computation (CEC '03), pp. 631–638, IEEE Press, Canberra, Australia, 2003.

S. Kimura, K. Sonoda, S. Yamane, K. Yoshida, K. Matsumura, and M. Hatakeyama, “Inference of genetic networks using a reduced NGnet model,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '07), pp. 932–937, August 2007.

Y. Matsubara, S. Kikuchi, M. Sugimoto, and M. Tomita, “Parameter estimation for stiff equations of biosystems using radial basis function networks,” BMC Bioinformatics, vol. 7, article 230, 2006.

R. Morishita, H. Imade, I. Ono, N. Ono, and M. Okamoto, “Finding multiple solutions based on an evolutionary algorithm for inference of genetic networks by S-system,” in Proceedings of the The Congress on Evolutionary Computation (CEC '03), pp. 615–622, 2003.

M. Okamoto, T. Nonaka, S. Ochiai, and D. Tominaga, “Nonlinear numerical optimization with use of a hybrid Genetic Algorithm incorporating the Modified Powell method,” Applied Mathematics and Computation, vol. 91, no. 1, pp. 63–72, 1998.

T. Ueda, N. Koga, I. Ono, and M. Okamoto, “Application of numerical optimization technique based on real-coded genetic algorithm to inverse problem in biochemical systems,” in Proceedings of the Genetic and Evolutionary Computation Conference, p. 701, 2002.

Z. Zhang, E. O. Voit, and L. H. Schwacke, “Parameter estimation and sensitivity analysis of S-systems using a genetic algorithm,” in Methodologies for the Conception, Design, and Application of Intelligent Systems, T. Yamakawa and G. Matsumoto, Eds., pp. 155–158, World Scientific.

L.-S. Shu, H.-L. Huang, S.-J. Ho, and S.-Y. Ho, “Establishing large-scale gene regulatory networks using a gene-knowledge-embedded evolutionary computation method,” in Proceedings of the IEEE International Conference on Computer Science and Automation Engineering (CSAE '11), pp. 272–276, 2011.

M. M. Hasan, N. Noman, and H. Iba, “A prior knowledge based approach to infer gene regulatory networks,” in Proceedings of the International Symposium on Biocomputing (ISB '10), February 2010.

C. H. Chuang and C. L. Lin, “Estimation of noisy gene regulatory networks,” in Proceedings of the SICE Annual Conference, pp. 69–74, August 2010.

A. R. Chowdhury and M. Chetty, “An improved method to infer gene regulatory networks using S-systems,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '11), pp. 1012–1019, 2011.

S. J. Wu, C. T. Wu, and T. T. Lee, “Computation intelligent for eukaryotic cell-cycle gene network,” in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 1, pp. 2017–2020, 2006.

S. J. Wu, C. T. Wu, G. H. Chou, and T. T. Lee, “Evolution—based gene regulatory network of yeast cell cycle,” in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, pp. 1291–1295, October 2006.

P. C. Naval, L. G. Sison, and E. Mendoza, “Metabolic network parameter inference using particle swarm optimization,” in Proceedings of the International Conference on Molecular Systems Biology (ICMSB '06), Munich, Germany, 2006.

P. C. Naval, L. G. Sison, and E. R. Mendoza, “Parameter estimation with term-wise decomposition in biochemical network GMA models by hybrid regularized least squares-particle swarm optimization,” in Proceedings of the 6th IEEE World Congress on Computational Intelligence, July 2010.

P. C. Naval, Robust term-wise parameter estimation in biochemical Generalized Mass Action (GMA) models by hybrid regularized least squares-particle swarm optimization [Dissertation], University of the Philippines, Diliman, Quezon City, 2007.

B. Yang, M. Jiang, and Y. Chen, “A fast and efficient method for inferring structure and parameters of S-system models,” in Proceedings of the 11th International Conference on Hybrid Intelligent Systems (HIS '11), pp. 235–240, 2011.

Y.-T. Hsiao and W.-P. Lee, “Inferring robust gene networks from expression data by a sensitivity-based incremental evolution method,” BMC Bioinformatics, vol. 13, article S8, 2012.

P. C. Zuñiga, J. Pasia, H. Adorna, R. C. H. del Rosario, and P. Naval, “An ant colony optimization algorithm for parameter estimation and network inference problems in S-system models,” in Proceedings of the International Conference on Molecular Systems Biology 2008 (ICMSB '08), pp. 105–106, Manila, Philippines, 2008.

P. C. C. Zuniga, “An ant colony optimization for the network inference and parameter estimation of S-Systems,” in Proceedings of the 3rd International Conference on BioMedical Engineering and Informatics (BMEI '10), pp. 2363–2367, October 2010.

O. R. Gonzalez, C. Küper, K. Jung, P. C. Naval, and E. Mendoza, “Parameter estimation using simulated annealing for S-system models of biochemical networks,” Bioinformatics, vol. 23, no. 4, pp. 480–486, 2007.

P. C. Naval, O. R. Gonzalez, E. Mendoza, and L. G. Sison, “Heuristic parameter estimation methods for S-system models of biochemical networks,” in Proceedings of the 2nd Humanoid, Nanotechnology, Information, Communication and Control, Environment and Management, IEEE-Philippine Section, Manila, Philippines, 2005.

J. Sayol, L. Nolle, G. Schaefer, and T. Nakashima, “Comparison of simulated annealing and SASS for parameter estimation of biochemical networks,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '08), pp. 3568–3571, June 2008.

W. C. Yeh and T. J. Hsieh, “Artificial bee colony algorithm-neural networks for S-system models of biochemical networks approximation,” Neural Computing and Applications, vol. 21, pp. 365–375, 2012.

R. C. H. del Rosario, M. T. Echavez, and M. T. de Paz, “MADMan: a benchmarking framework for parameter estimation in biochemical systems theory models,” in Proceedings of the International Conference on Molecular Systems Biology (ICMSB '08), pp. 10–13, Manila, Philippines, 2008.

B. A. McKinney and D. Tian, “Grammatical immune system evolution for reverse engineering nonlinear dynamic Bayesian models,” Cancer Informatics, vol. 6, pp. 433–447, 2008.

W. P. Lee and K. C. Yang, “A clustering-based approach for inferring recurrent neural networks as gene regulatory networks,” Neurocomputing, vol. 71, no. 4–6, pp. 600–610, 2008.

T. Johnson, “Estimating parameters of S-systems,” in Canonical Nonlinear Modeling: S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 200–216, Van Nostrand Reinhold, New York, NY, USA, 1991.

S. Vinga, K. Thomaseth, J. M. Lemos, A. R. Neves, H. Santos, and A. T. Freitas, “Structural analysis of metabolic networks: a case study on Lactococcus lactis,” in Proceedings of the 8th Portuguese Conference on Automatic Control (CONTROLO '08), Lisbon: APCA-Associação Portuguesa de Controlo Automático, Vila Real, Portugal, 2008.

N. Meskin, H. Nounou, M. Nounou, A. Datta, and E. R. Dougherty, “Parameter estimation of biological phenomenamodeled by S-systems: an extended Kalman filter approach,” in Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference (CDC-ECC '11), Orlando, Fla, USA, 2011.

J. S. Almeida and E. O. Voit, “Neural-network-based parameter estimation in S-system models of biological networks,” Genome Informatics, vol. 14, pp. 114–123, 2003.

H. Murata, M. Koshino, M. Mitamura, and H. Kimura, “Inference of S-system models of genetic networks using product unit neural networks,” in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (SMC '08), pp. 1390–1395, October 2008.

W. Tucker, Z. Kutalik, and V. Moulton, “Estimating parameters for generalized mass action models using constraint propagation,” Mathematical Biosciences, vol. 208, no. 2, pp. 607–620, 2007.

W. Tucker and V. Moulton, “Reconstructing metabolic networks using interval analysis,” in Proceedings of the 5th International Workshop on Algorithms in Bioinformatics (WABI '05), pp. 192–203, Springer, Berlin, Germany, 2005.

W. Tucker and V. Moulton, “Parameter reconstruction for biochemical networks using interval analysis,” Reliable Computing, vol. 12, no. 5, pp. 389–402, 2006.

Z. Kutalik, K. H. Cho, and O. Wolkenhauer, “Optimal sampling time selection for parameter estimation in dynamic pathway modeling,” BioSystems, vol. 75, no. 1–3, pp. 43–55, 2004.

Z. Kutalik, W. Tucker, and V. Moulton, “S-system parameter estimation for noisy metabolic profiles using Newton-flow analysis,” IET Systems Biology, vol. 1, no. 3, pp. 174–180, 2007.

I. C. Chou, H. Martens, and E. O. Voit, “Parameter estimation in biochemical systems models with alternating regression,” Theoretical Biology and Medical Modelling, vol. 3, article 25, 2006.

I. C. Chou, H. Martens, and E. O. Voit, “Parameter estimation of S-distributions with alternating regression,” Statistics and Operations Research transactions, vol. 31, no. 1, pp. 55–74, 2007.

L. Mu, Parameter estimation methods for biological systems [M.S. thesis], University of Saskatchewan, 2010.

L. P. Tian, L. Mu, and F. X. Wu, “Alternating constraint least squares parameter estimation for S-system models of biological networks,” in Proceedings of the 4th International Conference on Bioinformatics and Biomedical Engineering (iCBBE '10), June 2010.

R. Lall, A. Rutes, H. Santos, J. S. Almeida, and E. O. Voit, “A new approach to parameter estimation using S-systems: modeling the glycolytic pathway of Lactococcus lactis,” in Proceedings of the 4th Georgia Tech-UGA Conference on Bioinformatics, Atlanta, Ga, USA, 2003.

R. Lall and E. O. Voit, “Parameter estimation in modulated, unbranched reaction chains within biochemical systems,” Computational Biology and Chemistry, vol. 29, no. 5, pp. 309–318, 2005.

S. F. Chen, Y. L. Juang, W. K. Chou et al., “Inferring a transcriptional regulatory network of the cytokinesis-related genes by network component analysis,” BMC Systems Biology, vol. 3, article 110, 2009.

F. S. Wang, T. L. Su, and H. J. Jang, “Hybrid differential evolution for problems of kinetic parameter estimation and dynamic optimization of an ethanol fermentation process,” Industrial and Engineering Chemistry Research, vol. 40, no. 13, pp. 2876–2885, 2001.

K. Y. Tsai and F. S. Wang, “Evolutionary optimization with data collocation for reverse engineering of biological networks,” Bioinformatics, vol. 21, no. 7, pp. 1180–1188, 2005.

F. S. Wang, “A modified collocation method for solving differential-algebraic equations,” Applied Mathematics and Computation, vol. 116, no. 3, pp. 257–278, 2000.

F. S. Wang and P.-K. Liu, “Inverse problems of biochemical systems using hybrid differential evolution and data collocation,” Journal of Systems and Synthetic Biology, vol. 1, pp. 21–38, 2010.

W. H. Huang, C. H. Yuh, and F. S. Wang, “Reverse engineering for embryonic gene regulatory network in zebrafish via evolutionary optimization with data collocation,” in Proceedings of the 7th International Conference on Systems Biology, Yokohama, Japan, 2006.

P. K. Liu and F. S. Wang, “Inference of biochemical network models in S-system using multiobjective optimization approach,” Bioinformatics, vol. 24, no. 8, pp. 1085–1092, 2008.

P. K. Liu and F. S. Wang, “Inverse problems of biological systems using multi-objective optimization,” Journal of the Chinese Institute of Chemical Engineers, vol. 39, no. 5, pp. 399–406, 2008.

S. J. Wu, C. T. Wu, and J. Y. Chang, “Fuzzy-based self-interactive multi-objective evolution optimization for reverse engineering of biological networks,” IEEE Transactions on Fuzzy Systems, vol. 20, no. 5, pp. 865–882, 2012.

W.-H. Wu, F. S. Wang, and M.-S. Chang, “Multi-objective optimization of enzyme manipulations in metabolic networks considering resilience effects,” BMC Systems Biology, vol. 5, article 145, 2011.

P. K. Polisetty, E. O. Voit, and E. P. Gatzke, “Identification of metabolic system parameters using global optimization methods,” Theoretical Biology and Medical Modelling, vol. 3, article 4, 2006.

C. Pozo, G. Guillén-Gosálbez, A. Sorribas, and L. Jiménez, “A spatial branch-and-bound framework for the global optimization of kinetic models of metabolic networks,” Industrial and Engineering Chemistry Research, vol. 50, no. 9, pp. 5225–5238, 2011.

S. Ando, E. Sakamoto, and H. Iba, “Evolutionary modeling and inference of gene network,” Information Sciences, vol. 145, no. 3-4, pp. 237–259, 2002.

W. Yin and E. O. Voit, “Function and design of the Nox1 system in vascular smooth muscle cells,” submitted

Y. Lee, F. Chen, L. Gallego-Giraldo, R. A. Dixon, and E. O. Voit, “Integrative analysis of transgenic alfalfa (Medicago sativa L.) suggests new metabolic control mechanisms for monolignol biosynthesis,” PLoS Computational Biology, vol. 7, no. 5, Article ID e1002047, 2011.

S. Y. Ho, C. H. Hsieh, F. C. Yu, and H. L. Huang, “An intelligent two-stage evolutionary algorithm for dynamic pathway identification from gene expression profiles,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 4, no. 4, pp. 648–660, 2007.

G. Jia, G. N. Stephanopoulos, and R. Gunawan, “Parameter estimation of kinetic models from metabolic profiles: two-phase dynamic decoupling method,” Bioinformatics, vol. 27, no. 14, pp. 1964–1970, 2011.

F. X. Wu and L. Mu, “Separable parameter estimation method for nonlinear biological systems,” in Proceedings of the 3rd International Conference on Bioinformatics and Biomedical Engineering (iCBBE '09), pp. 1–4, June 2009.

M. Hecker, S. Lambeck, S. Toepfer, E. van Someren, and R. Guthke, “Gene regulatory network inference: data integration in dynamic models-A review,” BioSystems, vol. 96, no. 1, pp. 86–103, 2009.

F. Mao, H. Wu, P. Dam, I.-C. Chou, E. O. Voit, and Y. Xu, “Prediction of biological pathways through data mining and information fusion,” in Computational Methods for Understanding Bacterial and Archaeal Genomes, Y. Xu and J. P. Gogarten, Eds., vol. 7, Imperial College Press, London, UK, 2008.

R. Thomas, S. Mehrotra, E. T. Papoutsakis, and V. Hatzimanikatis, “A model-based optimization framework for the inference on gene regulatory networks from DNA array data,” Bioinformatics, vol. 20, no. 17, pp. 3221–3235, 2004.

R. Thomas, C. J. Paredes, S. Mehrotra, V. Hatzimanikatis, and E. T. Papoutsakis, “A model-based optimization framework for the inference of regulatory interactions using time-course DNA microarray expression data,” BMC Bioinformatics, vol. 8, article 228, 2007.

P. Lecca, A. Palmisano, A. Ihekwaba, and C. Priami, “Calibration of dynamic models of biological systems with KInfer,” European Biophysics Journal, vol. 39, no. 6, pp. 1019–1039, 2010.

C. L. Ko, E. O. Voit, and F. S. Wang, “Estimating parameters for generalized mass action models with connectivity information,” BMC Bioinformatics, vol. 10, article 140, 2009.

M. T. A. P. Kresnowati, W. A. Van Winden, and J. J. Heijnen, “Determination of elasticities, concentration and flux control coefficients from transient metabolite data using linlog kinetics,” Metabolic Engineering, vol. 7, no. 2, pp. 142–153, 2005.

D. Calçada, S. Vinga, A. T. Freitas, and A. L. Oliveira, “Quantitative modeling of the Saccharomyces cerevisiae FLR1 regulatory network using an S-system formalism,” Journal of Bioinformatics and Computational Biology, vol. 9, pp. 613–630, 2011.

C. Seatzu, “A parameter estimation method for a special class of systems of ordinary differential equations,” in Proceedings of the 7th Mediterranean Conference on Control and Automation (MED '99), Haifa, Israel, 1999.

C. Seatzu, “A fitting based method for parameter estimation in S-systems,” Dynamic Systems and Applications, vol. 9, pp. 77–98, 2000.

M. Vilela, C. C. H. Borges, S. Vinga et al., “Automated smoother for the numerical decoupling of dynamics models,” BMC Bioinformatics, vol. 8, article 305, 2007.

M. Vilela, I. C. Chou, S. Vinga, A. T. R. Vasconcelos, E. O. Voit, and J. S. Almeida, “Parameter optimization in S-system models,” BMC Systems Biology, vol. 2, article 35, 2008.

H. Wang, J. E. Glover, and L. Qian, “A comparative study of the time-series data for inference of gene regulatory networks using B-spline,” in Proceedings of the IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB '10), pp. 32–36, May 2010.

M. N. Nounou, H. N. Nounou, N. Meskin, A. Datta, and E. R. Dougherty, “Multiscale denoising of biological data: A comparative analysis,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 9, pp. 1539–1544, 2012.

S. R. Veflingstad, J. Almeida, and E. O. Voit, “Priming nonlinear searches for pathway identification,” Theoretical Biology and Medical Modelling, vol. 1, article 8, 2004.

S. Srinath and R. Gunawan, “Parameter identifiability of power-law biochemical system models,” Journal of Biotechnology, vol. 149, no. 3, pp. 132–140, 2010.

R. N. Gutenkunst, J. J. Waterfall, F. P. Casey, K. S. Brown, C. R. Myers, and J. P. Sethna, “Universally sloppy parameter sensitivities in systems biology models,” PLoS Computational Biology, vol. 3, no. 10, pp. 1871–1878, 2007.

M. Vilela, S. Vinga, M. A. G. M. Maia, E. O. Voit, and J. S. Almeida, “Identification of neutral biochemical network models from time series data,” BMC Systems Biology, vol. 3, article 47, 2009.

V. Hatzimanikatis, C. A. Floudas, and J. E. Bailey, “Optimization of regulatory architectures in metabolic reaction networks,” Biotechnology and Bioengineering, vol. 52, pp. 485–500, 1996.

V. Hatzimanikatis, C. A. Floudas, and J. E. Bailey, “Analysis and design of metabolic reaction networks via mixed-integer linear optimization,” AIChE Journal, vol. 42, no. 5, pp. 1277–1290, 1996.

M. Khoury, F. Guerin, and G. M. Coghill, “Learning dynamic models of compartment systems by combining symbolic regression with fuzzy vector envisionment,” in Proceedings of the 9th Annual Genetic and Evolutionary Computation Conference (GECCO '07), pp. 2769–2776, July 2007.

C. Spieth, F. Streichert, N. Speer, and A. Zell, “Optimizing topology and parameters of gene regulatory tetwork models from time-series experiments,” in Proceedings of the Genetic and Evolutionary Computation (GECCO '04), vol. 3102 of Lecture Notes in Computer Science, pp. 461–470, 2004.

C. Spieth, F. Streichert, N. Speer, and A. Zell, “A memetic inference method for gene regulatory networks based on S-systems,” in Proceedings of the Congress on Evolutionary Computation (CEC '04), pp. 152–157, usa, June 2004.

C. Spieth, F. Streichert, N. Speer, and A. Zell, “Iteratively inferring gene regulatory networks with virtual knockout experiments,” in Proceedings of the 2nd European Workshop on Evolutionary Bioinformatics, vol. 3005 of Lecture Notes in Computer Science, pp. 104–112, 2004.

C. Spieth, F. Streichert, N. Speer, and A. Zell, “Utilizing an Island model for EA to preserve solution diversity for inferring gene regulatory networks,” in Proceedings of the Congress on Evolutionary Computation (CEC '04), pp. 146–151, June 2004.

C. Spieth, F. Streichelt, N. Speer, and A. Zell, “Multi-objective model optimization for inferring gene regulatory networks,” in Proceedings of the 3rd International Conference on Evolutionary Multi-Criterion Optimization (EMO '05), pp. 607–620, March 2005.

C. Spieth, F. Streichert, J. Supper, N. Speer, and A. Zell, “Feedback memetic algorithms for modeling gene regulatory networks,” in Proceedings of the IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB '05), November 2005.

A. R. Chowdhury, M. Chetty, and N. X. Vinh, “Adaptive regulatory genes cardinality for reconstructing genetic networks,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '12), pp. 1–8, 2012.

S. J. Galbraith, L. M. Tran, and J. C. Liao, “Transcriptome network component analysis with limited microarray data,” Bioinformatics, vol. 22, no. 15, pp. 1886–1894, 2006.

L. Z. Liu, F. X. Wu, L. L. Han, and W. J. Zhang, “Structure identification and parameter estimation of biological s-systems,” in Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2'010), pp. 329–334, December 2010.

E. O. Voit, J. Almeida, S. Marino et al., “Regulation of glycolysis in Lactococcus lactis: an unfinished systems biological case study,” IEE Proceedings, vol. 153, no. 4, pp. 286–298, 2006.

J. Srividhya, E. J. Crampin, P. E. McSharry, and S. Schnell, “Reconstructing biochemical pathways from time course data,” Proteomics, vol. 7, no. 6, pp. 828–838, 2007.

S. J. Horne, D. P. Searson, M. J. Willis, and A. R. Wright, “Modelling of chemical processes using S-systems,” in Proceedings of the 11th APCChe Congress, p. 335, Kuala Lumpur, 2006.

D. P. Searson, M. J. Willis, S. J. Horne, and A. R. Wright, “Inference of chemical reaction networks using hybrid S-system models,” Chemical Product and Process Modeling, vol. 2, no. 1, article 10, 2007.

G. D. Kattas, P. Gennemark, and D. Wedelin, “Structural identification of GMA models: algorithm and model comparison,” in Proceedings of the 8th International Conference on Computational Methods in Systems Biology (CMSB '10), pp. 107–113, October 2010.

G. Goel, I. C. Chou, and E. O. Voit, “System estimation from metabolic time-series data,” Bioinformatics, vol. 24, no. 21, pp. 2505–2511, 2008.

E. O. Voit, G. Goel, I. C. Chou, and L. L. Fonseca, “Estimation of metabolic pathway systems from different data sources,” IET Systems Biology, vol. 3, no. 6, pp. 513–522, 2009.

I.-C. Chou and E. O. Voit, “Estimation of dynamic flux profiles from metabolic time series data,” BMC Systems Biology, vol. 6, article 84, 2012.

S. Dolatshahi and E. Voit, “Identifiation of dynamic fluxes from metabolic time series data,” submitted

E. O. Voit, “Characterizability of metabolic pathway systems from time series data,” Math. Biosci. In press

J. Ndukum, L. L. Fonseca, H. Santos, E. O. Voit, and S. Datta, “Statistical inference methods for sparse biological time series data,” BMC Systems Biology, vol. 5, article 57, 2011.

K. Kawagoe, T. Bernecker, H. P. Kriegel, M. Renz, A. Zimek, and A. Züfle, “Similarity search in time series of dynamical model-based systems,” in Proceedings of the 21st International Workshop on Database and Expert Systems Applications (DEXA '10), pp. 110–114, September 2010.

N. F. Lages, C. Cordeiro, M. Sousa Silva, A. Ponces Freire, and A. E. Ferreira, “Optimization of time-course experiments for kinetic model discrimination,” PloS ONE, vol. 7, Article ID e32749, 2012.

T. C. Ni and M. A. Savageau, “Model assessment and refinement using strategies from biochemical systems theory: application to metabolism in human red blood cells,” Journal of Theoretical Biology, vol. 179, no. 4, pp. 329–354, 1996.

T. C. Ni and M. A. Savageau, “Application of biochemical systems theory to metabolism in human red blood cells: signal propagation and accuracy of representation,” Journal of Biological Chemistry, vol. 271, no. 14, pp. 7927–7941, 1996.

T.-C. Ni and M. A. Savageau, “Scanning algorithm for refinement of complex biological models,” in Methodologies for the Conception, Design, and Application of Intelligent Systems, T. Yamakawa and G. Matsumoto, Eds., pp. 147–150, World Scientific, Singapore, 1996.

R. Alves, E. Herrero, and A. Sorribas, “Predictive reconstruction of the mitochondrial iron-sulfur cluster assembly metabolism—II—role of glutaredoxin Grx5,” Proteins: Structure, Function and Genetics, vol. 57, no. 3, pp. 481–492, 2004.

R. Alves, E. Herrero, and A. Sorribas, “Predictive reconstruction of the mitochondrial iron-sulfur cluster assembly metabolism—I—the role of the protein pair ferredoxin-ferredoxin reductase (Yah1-Arh1),” Proteins, vol. 56, no. 2, pp. 354–366, 2004.

J. Němcová, Rational systems in control and system theory [Doctoral dissertation], Vrije Universiteit Amsterdam, 2009.

J. Němcová, “Structural identifiability of polynomial and rational systems,” Mathematical Biosciences, vol. 223, no. 2, pp. 83–96, 2010.

M. Shiota, Nash Manifolds, Springer, New York, NY, USA, 1987.

A. Papachristodoulou and B. Recht, “Determining interconnections in chemical reaction networks,” in Proceedings of the American Control Conference (ACC '07), pp. 4872–4877, July 2007.

E. O. Voit, “A systems-theoretical framework for health and disease: inflammation and preconditioning from an abstract modeling point of view,” Mathematical Biosciences, vol. 217, no. 1, pp. 11–18, 2009.

Y. Lee, P. W. Chen, and E. O. Voit, “Analysis of operating principles with S-system models,” Mathematical Biosciences, vol. 231, no. 1, pp. 49–60, 2011.

L. Tournier, “Approximation of dynamical systems using S-systems theory: application to biological systems,” in Proceedings of the International Symposium on Symbolic and Algebraic Computation, pp. 317–324, July 2005.

T. Hasegawa, H. Takatani, and J. Yoshimura, “Application of power-law formalism method to equilibrium computation of vapor growth epitaxy,” Journal of Chemical Engineering of Japan, vol. 32, no. 4, pp. 506–513, 1999.

T. Hasegawa, F. Shiraishi, and H. Nagasue, “Numerical tests for usefulness of power-law formalism method in parameter optimization problem of immobilized enzyme reaction,” Journal of Chemical Engineering of Japan, vol. 33, no. 2, pp. 197–204, 2000.

C. L. Lin, Y. W. Liu, and C. H. Chuang, “Control design for signal transduction networks,” Bioinformatics and Biology Insights, vol. 2009, no. 3, pp. 1–14, 2009.

M. A. Savageau, “Alternative designs for a genetic switch: analysis of switching times using the piecewise power-law representation,” Mathematical Biosciences, vol. 180, pp. 237–253, 2002.

E. O. Voit, “Smooth bistable S-systems,” IEE Proceedings Systems Biology, vol. 152, no. 4, pp. 207–213, 2005.

O. A. Igoshin, C. W. Price, and M. A. Savageau, “Signalling network with a bistable hysteretic switch controls developmental activation of the σF transcription factor in Bacillus subtilis,” Molecular Microbiology, vol. 61, no. 1, pp. 165–184, 2006.

O. A. Igoshin, M. S. Brody, C. W. Price, and M. A. Savageau, “Distinctive topologies of partner-switching signaling networks correlate with their physiological roles,” Journal of Molecular Biology, vol. 369, no. 5, pp. 1333–1352, 2007.

O. A. Igoshin, R. Alves, and M. A. Savageau, “Hysteretic and graded responses in bacterial two-component signal transduction,” Molecular Microbiology, vol. 68, no. 5, pp. 1196–1215, 2008.

B. Salvado, E. Vilaprinyo, H. Karathia, A. Sorribas, and R. Alves, “Two component systems: physiological effect of a third component,” PloS ONE, vol. 7, Article ID e31095, 2012.

M. A. Savageau, “Parameter sensitivity as a criterion for evaluating and comparing the performance of biochemical systems,” Nature, vol. 229, no. 5286, pp. 542–544, 1971.

M. Cascante, R. Franco, and E. Canela, “Sensitivity analysis: a common foundation of theories for the quantitative study of metabolic control,” in Canonical Nonlinear Modeling: S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 76–89, Van Nostrand Reinhold, New York, NY, USA, 1991.

A. Salvador, “Steady-state synergisms in kinetic models: estimation and applications,” in Methodologies for the Conception, Design, and Application of Intelligent Systems, T. Yamakawa and G. Matsumoto, Eds., pp. 143–146, World Scientific, Singapore, 1996.

A. Salvador, Development of methodology and software for analysis of kinetic models of metabolic processes. Application to the mitochondrial metabolism of lipid hydroperoxides [Doctoral thesis], Lisbon, Portugal, 1997.

A. Salvador, “Synergism analysis of biochemical systems—II. Tensor formulation and treatment of stoichiometric constraints,” Mathematical Biosciences, vol. 163, no. 2, pp. 131–158, 2000.

A. Salvador, “Synergism analysis of biochemical systems—I. Conceptual framework,” Mathematical Biosciences, vol. 163, no. 2, pp. 105–129, 2000.

D. V. Guebel, “Canonical sensitivities: a useful tool to deal with large perturbations in metabolic network modeling,” In Silico Biology, vol. 4, no. 2, pp. 163–182, 2004.

B. S. Chen, Y. C. Wang, W. S. Wu, and W. H. Li, “A new measure of the robustness of biochemical networks,” Bioinformatics, vol. 21, no. 11, pp. 2698–2705, 2005.

B. S. Chen and Y. C. Wang, “On the attenuation and amplification of molecular noise in genetic regulatory netwoks,” BMC Bioinformatics, vol. 7, article 52, 2006.

B. S. Chen and W. S. Wu, “Robust filtering circuit design for stochastic gene networks under intrinsic and extrinsic molecular noises,” Mathematical Biosciences, vol. 211, no. 2, pp. 342–355, 2008.

B. S. Chen, W. S. Wu, Y. C. Wang, and W. H. Li, “On the robust circuit design schemes of biochemical networks: steady-state approach,” IEEE Transactions on Biomedical Circuits and Systems, vol. 1, no. 2, pp. 91–104, 2007.

B.-S. Chen, W.-S. Wu, W.-S. Wu, and W.-H. Li, “On the adaptive design rules of biochemical networks in evolution,” Evolutionary Bioinformatics, no. 3, pp. 27–29, 2007.

L. Ma and P. A. Iglesias, “Quantifying robustness of biochemical network models,” BMC Bioinformatics, vol. 3, article 38, 2002.

B. S. Chen, Y. T. Chang, and Y. C. Wang, “Robust -stabilization design in gene networks under stochastic molecular noises: fuzzy-interpolation approach,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 38, no. 1, pp. 25–42, 2008.

B. S. Chen and C. W. Li, “On the interplay between entropy and robustness of gene regulatory networks,” Entropy, vol. 12, no. 5, pp. 1071–1101, 2010.

M.-G. Shi, M. R. Lyu, and T.-M. Lok, “Maximal-robustness-minimal-fragility controller: a compromise between robustness and fragility of biochemical networks,” in Proceedings of the Advanced Intelligent Computing Theories and Applications, D.-S. Huang, Ed., vol. 5227 of Lecture Notes in Computer Science, pp. 1012–1021, Springer, Heidelberg, Germany, 2008.

W. H. Wu, F. S. Wang, and M. S. Chang, “Dynamic sensitivity analysis of biological systems,” BMC Bioinformatics, vol. 9, no. 12, article S17, 2008.

F. Shiraishi and Y. Hatoh, “Dynamic sensitivities in chaotic dynamical systems,” Applied Mathematics and Computation, vol. 186, no. 2, pp. 1347–1359, 2007.

K. Sriyudthsak and F. Shiraishi, “Identification of bottleneck enzymes with negative dynamic sensitivities: ethanol fermentation systems as case studies,” Journal of Biotechnology, vol. 149, no. 3, pp. 191–200, 2010.

F. Shiraishi and Y. Suzuki, “Method for determination of the main bottleneck enzyme in a metabolic reaction network by dynamic sensitivity analysis,” Industrial and Engineering Chemistry Research, vol. 48, no. 1, pp. 415–423, 2009.

K. Sriyudthsak and F. Shiraishi, “Instantaneous and overall indicators for determination of bottleneck ranking in metabolic reaction networks,” Industrial and Engineering Chemistry Research, vol. 49, no. 5, pp. 2122–2129, 2010.

M. L. Chen and F. S. Wang, “Dynamic sensitivity analysis of oscillating biochemical systems using modified collocation method,” Journal of the Taiwan Institute of Chemical Engineers, vol. 40, no. 4, pp. 371–379, 2009.

J. K. Horner, “Sensitivity of blood serum uric acid concentration in HGPRT deficiency to initial conditions of the purine metabolism pathway,” in Proceedings of the International Conference on Scientific Computing, pp. 261–267, CSREA Press, Las Vegas, Nev, USA, 2012.

T. Drengstig, T. Kjosmoen, and P. Ruoff, “On the relationship between sensitivity coeffcients and transfer functions of reaction kinetic networks,” Journal of Physical Chemistry B, vol. 115, no. 19, pp. 6272–6278, 2011.

V. Weinberger, “Symbolic analysis of S-systems with MACSYMA,” in Canonical Nonlinear Modeling. S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 110–132, Van Nostrand Reinhold, New York, NY, USA, 1991.

E. Hopf, “Abzweigung einer periodischen Lösung von einer stationären Lösung eines Differentialsystems,” Berichte der Mathematisch-Physikalischen Klasse der Sächsischen Akademie, vol. 94, pp. 1–22, 1942.

S. Wiggins, Introduction to Applied Nonlinear Dynamical Systems and Chaos, Springer, New York, NY, USA, 1990.

D. C. Lewis, “A qualitative analysis of S-systems: Hopf bifurcations,” in Canonical Nonlinear Modeling: S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 304–344, Van Nostrand Reinhold, New York, NY, USA, 1991.

W. Yin and E. O. Voit, “Construction and customization of stable oscillation models in biology,” Journal of Biological Systems, vol. 16, no. 4, pp. 463–478, 2008.

J. J. Tyson, “Some further studies of nonlinear oscillations in chemical systems,” The Journal of Chemical Physics, vol. 58, no. 9, pp. 3919–3930, 1973.

M. S. Morrison, “Recasting as a modeling tool,” in Canonical Nonlinear Modeling. S-System Approach to Understanding Complexity, E. Voit, Ed., pp. 258–277, Van Nostrand Reinhold, New York, NY, USA, 1991.

S. Nikolov, X. Lai, U. W. Liebal, O. Wolkenhauer, and J. Vera, “Integration of sensitivity and bifurcation analysis to detect critical processes in a model combining signalling and cell population dynamics,” International Journal of Systems Science, vol. 41, no. 1, pp. 81–105, 2010.

E. O. Voit and M. A. Savageau, “Analytical solutions to a generalized growth equation,” Journal of Mathematical Analysis and Applications, vol. 103, no. 2, pp. 380–386, 1984.

E. O. Voit, “Hierarchical Monte Carlo modeling with S-distributions: concepts and illustrative analysis of mercury contamination in king mackerel,” Environment International, vol. 21, no. 5, pp. 627–635, 1995.

M. Cascante, R. Curto, and A. Sorribas, “Testing the robustness of the steady-state characteristics of a metabolic pathway: parameter sensitivity as a basic feature for model validation,” Journal of Biological Systems, vol. 3, pp. 105–113, 1995.

F. Alvarez-Vasquez, K. J. Sims, L. A. Cowart, Y. Okamoto, E. O. Voit, and Y. A. Hannun, “Simulation and validation of modelled sphingolipid metabolism in Saccharomyces cerevisiae,” Nature, vol. 433, no. 7024, pp. 425–430, 2005.

B. Mishra, “A symbolic approach to modeling cellular behavior,” in Proceedings of the High Performance Computing (HIPC '02), vol. 2552, pp. 725–732, Springer, 2002.

B. Mishra, V. Cherepinsky, N. Silver et al., “A sense of life: computational and experimental investigations with models of biochemical and evolutionary processes,” OMICS, vol. 7, no. 3, pp. 253–268, 2003.

M. Antoniotti, A. Policriti, N. Ugel, and B. Mishra, “XS-systems: eXtended S-systems and algebraic differential automata for modeling cellular behavior,” in Proceedings of the High performane computing (HIPC '02), vol. 2552 of Lecture Notes in Computer Science, pp. 431–442, 2002.

M. Antoniotti, F. Park, A. Policriti, N. Ugel, and B. Mishra, “Foundations of a query and simulation system for the modeling of biochemical and biological processes,” Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing, pp. 116–127, 2003.

M. Antoniotti, A. Policriti, N. Ugel, and B. Mishra, “Model building and model checking for biochemical processes,” Cell Biochemistry and Biophysics, vol. 38, no. 3, pp. 271–286, 2003.

M. Antoniotti, C. Piazza, A. Policriti, M. Simeoni, and B. Mishra, “Taming the complexity of biochemical models through bisimulation and collapsing: theory and practice,” Theoretical Computer Science, vol. 325, no. 1, pp. 45–67, 2004.

B. Mishra, M. Antoniotti, S. Paxia, and N. Ugel, “Simpathica: a computational systems biology tool within the valis bioinformatics environment,” in Computational Systems Biology, A. Kriete and R. Eils, Eds., pp. 79–102, Elsevier Academic Press, 2006.

B. Mishra, “Algebraic systems biology: theses and hypotheses,” in Proceedings of the Algebraic Biology, H. Anai, K. Horimoto, and T. Kutsia, Eds., vol. 4545 of Lecture Notes in Computer Science, pp. 1–14, Springer, Berlin, Germany, 2007.

B. Mishra, “Intelligently deciphering unintelligible designs: algorithmic algebraic model checking in systems biology,” Journal of the Royal Society Interface, vol. 6, no. 36, pp. 575–597, 2009.

M. Antoniotti, B. Mishra, C. Piazza, A. Policriti, and M. Simeoni, “Modeling cellular behavior with hybrid automata: bisimulation and collapsing,” in Proceedings of the Computational Methods in Systems Biology, vol. 2602 of Lecture Notes in Computer Science, pp. 57–74, 2003.

M. B. Elowitz and S. Leibier, “A synthetic oscillatory network of transcriptional regulators,” Nature, vol. 403, no. 6767, pp. 335–338, 2000.

R. Curto, E. O. Voit, and M. Cascante, “Analysis of abnormalities in purine metabolism leading to gout and to neurological dysfunctions in man,” Biochemical Journal, vol. 329, no. 3, pp. 477–487, 1998.

R. Curto, E. O. Voit, A. Sorribas, and M. Cascante, “Validation and steady-state analysis of a power-law model of purine metabolism in man,” Biochemical Journal, vol. 324, no. 3, pp. 761–775, 1997.

R. Gentilini, “Toward integration of systems biology formalism: the gene regulatory networks case,” Genome Informatics, vol. 16, no. 2, pp. 215–224, 2005.

D. Campagna and C. Piazza, “Hybrid automata in systems biology: how far can we go?” Electronic Notes in Theoretical Computer Science, vol. 229, no. 1, pp. 93–108, 2009.

M. A. Savageau, “Comparison of classical and autogenous systems of regulation in inducible operons,” Nature, vol. 252, no. 5484, pp. 546–549, 1974.

M. A. Savageau, “Autogenous and classical regulation of gene expression: a general theory and experimental evidence,” in Biological Regulation and Development, R. F. Goldberger, P. Berg, R. T. Schimke, K. Moldave, P. Leder, and L. E. Hood, Eds., vol. 1, pp. 57–108, Plenum, New York, NY, USA, 1979.

M. A. Savageau, “Genetic regulatory mechanisms and the ecological niche of Escherichia coli,” Proceedings of the National Academy of Sciences of the United States of America, vol. 71, no. 6, pp. 2453–2455, 1974.

M. A. Savageau, “Significance of autogenously regulated and constitutive synthesis of regulatory proteins in repressible biosynthetic systems,” Nature, vol. 258, no. 5532, pp. 208–214, 1975.

M. A. Savageau, “Design of molecular control mechanisms and the demand for gene expression,” Proceedings of the National Academy of Sciences of the United States of America, vol. 74, no. 12, pp. 5647–5651, 1977.

M. A. Savageau, “Escherichia coli habitats, cell types, and molecular mechanisms of gene control,” American Naturalist, vol. 122, no. 6, pp. 732–744, 1983.

M. A. Savageau, “Models of gene function: general methods of kinetic analysis and specific ecological correlates,” in Foundations of Biochemical Engineering Kinetics and Thermodynamics in Biological Systems, H. W. Blanch, E. T. Papoutsakis, and G. N. Stephanopoulos, Eds., pp. 3–25, American Chemical Society, Washington, DC, USA, 1983.

M. A. Savageau and P. J. Sands, “Completely uncoupled and perfectly coupled circuits for inducible gene regulation,” in Canonical Nonlinear Modeling. S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 145–165, Van Nostrand Reinhold, New York, NY, USA, 1991.

M. A. Savageau, “Rules for the evolution of gene circuitry,” in Proceedings of the Pacific Symposium on Biocomputing, pp. 54–65, 1998.

M. A. Savageau, “Design of gene circuitry by natural selection: analysis of the lactose catabolic system in Escherichia coli,” Biochemical Society Transactions, vol. 27, no. 2, pp. 264–270, 1999.

M. A. Savageau, “Regulation of gene expression: new theory and the experimental evidence,” Zagadnienia Biofizyki Wsopolczesnej, vol. 4, pp. 129–143, 1979.

M. A. Savageau, “Design of the lac gene circuit revisited,” Mathematical Biosciences, vol. 231, no. 1, pp. 19–38, 2011.

M. A. Savageau and A. Sorribas, “Constraints among molecular and systemic properties: implications for physiological genetics,” Journal of Theoretical Biology, vol. 141, no. 1, pp. 93–115, 1989.

W. S. Hlavecek and M. A. Savageau, “Subunit structure of regulator proteins influences the design of gene circuitry: analysis of perfectly coupled and completely uncoupled circuits,” Journal of Molecular Biology, vol. 248, no. 4, pp. 739–755, 1995.

W. S. Hlavacek and M. A. Savageau, “Rules for coupled expression of regulator and effector genes in inducible circuits,” Journal of Molecular Biology, vol. 255, no. 1, pp. 121–139, 1996.

W. S. Hlavacek and M. A. Savageau, “Completely uncoupled and perfectly coupled gene expression in repressible systems,” Journal of Molecular Biology, vol. 266, no. 3, pp. 538–558, 1997.

W. S. Hlavacek and M. A. Savageau, “Comparison of completely uncoupled and perfectly coupled gene expression in repressible biosynthetic systems,” in Methodologies for the Conception, Design, amd Application of Intelligent Systems, T. Yamakawa and G. Matsumoto, Eds., vol. 1, pp. 167–170, World Scientific, Singapore, 1996.

W. S. Hlavacek and M. A. Savageau, “Method for determining natural design principles of biological control circuits,” Journal of Intelligent and Fuzzy Systems, vol. 6, no. 1, pp. 147–160, 1998.

M. E. Wall, W. S. Hlavacek, and M. A. Savageau, “Design principles for regulator gene expression in a repressible gene circuit,” Journal of Molecular Biology, vol. 332, no. 4, pp. 861–876, 2003.

M. E. Wall, W. S. Hlavacek, and M. A. Savageau, “Design of gene circuits: lessons from bacteria,” Nature Reviews Genetics, vol. 5, no. 1, pp. 34–42, 2004.

D. H. Irvine and M. A. Savageau, “Network regulation of the immune response: modulation of suppressor lymphocytes by alternative signals including contrasuppression,” Journal of Immunology, vol. 134, no. 4, pp. 2117–2130, 1985.

D. H. Irvine and M. A. Savageau, “Network regulation of the immune response: alternative control points for suppressor modulation of effector lymphocytes,” Journal of Immunology, vol. 134, no. 4, pp. 2100–2116, 1985.

J. H. Schwacke and E. O. Voit, “Improved methods for the mathematically controlled comparison of biochemical systems,” Theoretical Biology and Medical Modelling, vol. 1, article 1, 2004.

M. A. Savageau, “Regulation of differentiated cell-specific functions,” Proceedings of the National Academy of Sciences of the United States of America, vol. 80, no. 5 I, pp. 1411–1415, 1983.

M. R. Atkinson, M. A. Savageau, J. T. Myers, and A. J. Ninfa, “Development of genetic circuitry exhibiting toggle switch or oscillatory behavior in Escherichia coli,” Cell, vol. 113, no. 5, pp. 597–607, 2003.

M. A. Savageau, “Optimal design of feedback control by inhibition. Steady state considerations,” Journal of Molecular Evolution, vol. 4, no. 2, pp. 139–156, 1974.

M. A. Savageau, “Optimal design of feedback control by inhibition: dynamic considerations,” Journal of Molecular Evolution, vol. 5, no. 3, pp. 199–222, 1975.

M. A. Savageau, “Feedforward inhibition in biosynthetic pathways: inhibition of the aminoacyl-tRNA synthetase by the penultimate product,” Journal of Theoretical Biology, vol. 77, no. 4, pp. 385–404, 1979.

M. A. Savageau and G. Jacknow, “Feedforward inhibition in biosynthetic pathways: inhibition of the aminoacyl-tRNA synthetase by intermediates of the pathway,” Journal of Theoretical Biology, vol. 77, no. 4, pp. 405–425, 1979.

R. Alves and M. A. Savageau, “Effect of overall feedback inhibition in unbranched biosynthetic pathways,” Biophysical Journal, vol. 79, no. 5, pp. 2290–2304, 2000.

R. Alves and M. A. Savageau, “Systemic properties of ensembles of metabolic networks: application of graphical and statistical methods to simple unbranched pathways,” Bioinformatics, vol. 16, no. 6, pp. 534–547, 2000.

R. Alves and M. A. Savageau, “Comparing systemic properties of ensembles of biological networks by graphical and statistical methods,” Bioinformatics, vol. 16, no. 6, pp. 527–533, 2000.

R. Alves and M. A. Savageau, “Irreversibility in unbranched pathways: preferred positions based on regulatory considerations,” Biophysical Journal, vol. 80, no. 3, pp. 1174–1185, 2001.

R. Alves and M. A. Savageau, “Comparative analysis of prototype two-component systems with either bifunctional or monofunctional sensors: differences in molecular structure and physiological function,” Molecular Microbiology, vol. 48, no. 1, pp. 25–51, 2003.

R. Alves and M. A. Savageau, “Evidence of selection for low cognate amino acid bias in amino acid biosynthetic enzymes,” Molecular Microbiology, vol. 56, no. 4, pp. 1017–1034, 2005.

M. A. Savageau, “Evolution of regulation examined with a novel strategy for comparative optimization,” in Evolution and Optimization, H. M. Voigt, H. Mühlenbein, and H. P. Schwefel, Eds., pp. 9–30, Akademie, Berlin, Germany, 1990.

A. Salvador and M. A. Savageau, “Quantitative evolutionary design of glucose 6-phosphate dehydrogenase expression in human erythrocytes,” Proceedings of the National Academy of Sciences of the United States of America, vol. 100, no. 2, pp. 14463–14468, 2003.

A. Salvador and M. A. Savageau, “Evolution of enzymes in a series is driven by dissimilar functional demands,” Proceedings of the National Academy of Sciences of the United States of America, vol. 103, no. 7, pp. 2226–2231, 2006.

P. M. B. M. Coelho, A. Salvador, and M. A. Savageau, “Quantifying global tolerance of biochemical systems: design implications for moiety-transfer cycles,” PLoS Computational Biology, vol. 5, no. 3, Article ID e1000319, 2009.

P. M. B. M. Coelho, A. Salvador, and M. A. Savageau, “Relating mutant genotype to phenotype via quantitative behavior of the NADPH redox cycle in human erythrocytes,” PLoS ONE, vol. 5, no. 9, Article ID e13031, 2010.

R. Alves, E. Vilaprinyo, A. Sorribas, and E. Herrero, “Evolution based on domain combinations: the case of glutaredoxins,” BMC Evolutionary Biology, vol. 9, no. 1, article 66, 2009.

B. Salvado, H. Karathia, A. U. Chimenos et al., “Methods for and results from the study of design principles in molecular systems,” Mathematical Biosciences, vol. 231, no. 1, pp. 3–18, 2011.

G. Guillén-Gosálbez and A. Sorribas, “Identifying quantitative operation principles in metabolic pathways: a systematic method for searching feasible enzyme activity patterns leading to cellular adaptive responses,” BMC Bioinformatics, vol. 10, article 386, 2009.

A. Martinez-Antonio, J. G. Lomnitz, S. Sandoval, M. Aldana, and M. A. Savageau, “Regulatory design governing progression of population growth phases in bacteria,” PloS ONE, vol. 7, Article ID e30654, 2012.

E. O. Voit, “Biochemical and genomic regulation of the trehalose cycle in yeast: review of observations and canonical model analysis,” Journal of Theoretical Biology, vol. 223, no. 1, pp. 55–78, 2003.

Y. Lee, L. Escamilla-Treviño, R. A. Dixon, and E. O. Voit, “Functional analysis of metabolic channeling and regulation in lignin biosynthesis: a computationalapproach,” PLoS Computational Biology, vol. 8, no. 11.

J. Puigjaner, M. Cascante, and A. Sorribas, “Assessing optimal designs in metabolic pathways,” Journal of Biological Systems, vol. 3, pp. 197–206, 1995.

Q. Zhang, S. Bhattacharya, M. E. Andersen, and R. B. Conolly, “Computational systems biology and dose-response modeling in relation to new directions in toxicity testing,” Journal of Toxicology and Environmental Health Part B, vol. 13, no. 2–4, pp. 253–276, 2010.

R. Alves and M. A. Savageau, “Extending the method of mathematically controlled comparison to include numerical comparisons,” Bioinformatics, vol. 16, no. 9, pp. 786–798, 2000.

M. A. Savageau, “Biomedical engineering strategies in system design space,” Annals of Biomedical Engineering, vol. 39, no. 4, pp. 1278–1295, 2011.

M. A. Savageau, P. M. B. M. Coelho, R. A. Fasani, D. A. Tolla, and A. Salvador, “Phenotypes and tolerances in the design space of biochemical systems,” Proceedings of the National Academy of Sciences of the United States of America, vol. 106, no. 16, pp. 6435–6440, 2009.

M. A. Savageau and R. A. Fasani, “Qualitatively distinct phenotypes in the design space of biochemical systems,” FEBS Letters, vol. 583, no. 24, pp. 3914–3922, 2009.

R. A. Fasani and M. A. Savageau, “Automated construction and analysis of the design space for biochemical systems,” Bioinformatics, vol. 26, no. 20, Article ID btq479, pp. 2601–2609, 2010.

D. A. Tolla and M. A. Savageau, “Regulation of aerobic-to-anaerobic transitions by the FNR cycle in Escherichia coli,” Journal of Molecular Biology, vol. 397, no. 4, pp. 893–905, 2010.

D. A. Tolla and M. A. Savageau, “Phenotypic repertoire of the FNR regulatory network in Escherichia coli,” Molecular Microbiology, vol. 79, no. 1, pp. 149–165, 2011.

B.-S. Chen and W.-S. Wu, “Underlying principles of natural selection in network evolution: systems biology approach,” Evolutionary Bioinformatics, vol. 3, pp. 245–262, 2007.

R. Wu, J. Cao, Z. Huang, Z. Wang, J. Gai, and E. Vallejos, “Systems mapping: how to improve the genetic mapping of complex traits through design principles of biological systems,” BMC Systems Biology, vol. 5, article 84, 2011.

M. A. Savageau, “Accuracy of proofreading with zero energy cost,” Journal of Theoretical Biology, vol. 93, no. 1, pp. 179–195, 1981.

M. A. Savageau and R. R. Freter, “On the evolution of accuracy and cost of proofreading tRNA aminoacylation,” Proceedings of the National Academy of Sciences of the United States of America, vol. 76, no. 9, pp. 4507–4510, 1979.

M. A. Savageau and R. R. Freter, “Energy cost of proofreading to increase fidelity of transfer ribonucleic acid aminoacylation,” Biochemistry, vol. 18, no. 16, pp. 3486–3493, 1979.

M. A. Savageau and D. S. Lapointe, “Optimization of kinetic proofreading: a general method for derivation of the constraint relations and an exploration of a specific case,” Journal of Theoretical Biology, vol. 93, no. 1, pp. 157–177, 1981.

R. R. Freter and M. A. Savageau, “Proofreading systems of multiple stages for improved accuracy of biological discrimination,” Journal of Theoretical Biology, vol. 85, no. 1, pp. 99–123, 1980.

M. Okamoto, J. J. Yoshii, and K. Hayasji, “GTP-dependent kinetic proofreading,” in Canonical Nonlinear Modeling. S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 166–180, Van Nostrand Reinhold, New York, NY, USA, 1991.

M. Okamoto and M. A. Savageau, “Integrated function of a kinetic proofreading mechanism: dynamic analysis separating the effects of speed and substrate competition on accuracy,” Biochemistry, vol. 23, no. 8, pp. 1710–1715, 1984.

M. Okamoto and M. A. Savageau, “Integrated function of a kinetic proofreading mechanism: steady-state analysis testing internal consistency of data obtained in vivo and in vitro and predicting parameter values,” Biochemistry, vol. 23, no. 8, pp. 1701–1709, 1984.

M. Okamoto and M. A. Savageau, “Integrated function of a kinetic proofreading mechanism: double-stage proofreading by isoleucyl-tRNA synthetase,” Biochemistry, vol. 25, no. 8, pp. 1969–1975, 1986.

M. Cascante, R. Curto, and A. Sorribas, “Comparative characterization of the fermentation pathway of Saccharomyces cerevisiae using biochemical systems theory and metabolic control analysis: steady-state analysis,” Mathematical Biosciences, vol. 130, no. 1, pp. 51–69, 1995.

M. Cascante, R. Curto, and A. Sorribas, “Comparative characterization of the fermentation pathway of Saccharomyces cerevisiae using biochemical systems theory and metabolic control analysis: model validation and dynamic behavior,” Mathematical Biosciences, vol. 130, no. 1, pp. 71–84, 1995.

F. Rodríguez-Acosta, C. M. Regalado, and N. V. Torres, “Non-linear optimization of biotechnological processes by stochastic algorithms. Application to the maximization of the production rate of ethanol, glycerol and carbohydrates by Saccharomyces cerevisiae,” Journal of Biotechnology, vol. 68, no. 1, pp. 15–28, 1999.

N. V. Torres, E. O. Voit, C. Glez-Alcón, and F. Rodríguez, “An indirect optimization method for biochemical systems: description of method and application to the maximization of the rate of ethanol, glycerol, and carbohydrate production in Saccharomyces cerevisiae,” Biotechnology and Bioengineering, vol. 55, pp. 758–772, 1997.

J. Vera, P. De Atauri, M. Cascante, and N. V. Torres, “Multicriteria optimization of biochemical systems by linear programming: application to production of ethanol by Saccharomyces cerevisiae,” Biotechnology and Bioengineering, vol. 83, no. 3, pp. 335–343, 2003.

P. K. Polisetty, E. P. Gatzke, and E. O. Voit, “Yield optimization of regulated metabolic systems using deterministic branch-and-reduce methods,” Biotechnology and Bioengineering, vol. 99, no. 5, pp. 1154–1169, 2008.

P. K. Polisetty, E. O. Voit, and E. P. Gatzke, “Yield optimization of Saccharomyces cerevisiae using a GMA model and a MILP-based piecewise linear relaxation method,” in Proceedings of the Foundations of Systems Biology in Engineering, Santa Barbara, Calif, USA, 2005.

P. K. Polisetty, E. Voit, and E. P. Gatzke, “Deterministic global optimization techniques for solution of Nlp and Minlp problems using piecewise linear relaxations with applications in metabolic engineering,” in Proceedings of the AIChE Annual Meeting and Fall Showcase, pp. 6186–6187, November 2005.

R. Lall, T. J. Donohue, S. Marino, and J. C. Mitchell, “Optimizing ethanol production selectivity,” Mathematical and Computer Modelling, vol. 53, no. 7-8, pp. 1363–1373, 2011.

Y. Chang and N. V. Sahinidis, “Optimization of metabolic pathways under stability considerations,” Computers and Chemical Engineering, vol. 29, no. 3, pp. 467–479, 2005.

G. Xu, “Bi-objective optimization of biochemical systems by linear programming,” Applied Mathematics and Computation, vol. 218, pp. 7562–7572, 2012.

O. H. Sendín, J. Vera, N. V. Torres, and J. R. Banga, “Mathematical and computer modelling of dynamical systems: Methods, tools and applications in engineering and related sciences,” Mathematical and Computer Modelling of Dynamical Systems: Methods, Tools and Applications in Engineering and Related Sciences, vol. 12, pp. 469–487, 2006.

G. Xu, “An iterative strategy for yield optimization of metabolic pathways,” in Proceedings of the 4rth International Joint Conference on Computational Sciences and Optimization (CSO '10), pp. 268–269, May 2010.

C. L. Ko, F. S. Wang, Y. P. Chao, and T. W. Chen, “S-system approach to modeling recombinant Escherichia coli growth by hybrid differential evolution with data collocation,” Biochemical Engineering Journal, vol. 28, no. 1, pp. 10–16, 2006.

C. L. Ko and F. S. Wang, “On-line estimation of biomass and intracellular protein for recombinant Escherichia coli cultivated in batch and fed-batch modes,” Journal of the Chinese Institute of Chemical Engineers, vol. 38, no. 3-4, pp. 197–203, 2007.

F. Alvarez-Vasquez, M. Cánovas, J. L. Iborra, and N. V. Torres, “Modeling, optimization and experimental assessment of continuous L-(-)-carnitine production by Escherichia coli cultures,” Biotechnology and Bioengineering, vol. 80, no. 7, pp. 794–805, 2002.

R. Lall and J. Mitchell, “Metal reduction kinetics in Shewanella,” Bioinformatics, vol. 23, no. 20, pp. 2754–2759, 2007.

R. Sheridan, G. A. Jackson, L. Regan, J. Ward, and P. Dunhill, “Rational engineering of the TOL meta-cleavage pathway,” Biotechnology and Bioengineering, vol. 58, pp. 240–249, 1998.

Y. Q. Sun, W. T. Qi, H. Teng, Z. L. Xiu, and A. P. Zeng, “Mathematical modeling of glycerol fermentation by Klebsiella pneumoniae: concerning enzyme-catalytic reductive pathway and transport of glycerol and 1,3-propanediol across cell membrane,” Biochemical Engineering Journal, vol. 38, no. 1, pp. 22–32, 2008.

E. Voit, A. R. Neves, and H. Santos, “The intricate side of systems biology,” Proceedings of the National Academy of Sciences of the United States of America, vol. 103, no. 25, pp. 9452–9457, 2006.

J. K. Horner and M. A. Wolinsky, “A power-law sensitivity analysis of the hydrogen-producing metabolic pathway in Chlamydomonas reinhardtii,” International Journal of Hydrogen Energy, vol. 27, no. 11-12, pp. 1251–1255, 2002.

O. Jorquera, A. Kiperstok, E. A. Sales, M. Embiruçu, and M. L. Ghirardi, “S-systems sensitivity analysis of the factors that may influence hydrogen production by sulfur-deprived Chlamydomonas reinhardtii,” International Journal of Hydrogen Energy, vol. 33, no. 9, pp. 2167–2177, 2008.

T. Zhang, “Dynamics modeling of hydrogen production by sulfur-deprived Chlamydomonas reinhardtii culture in tubular photobioreactor,” International Journal of Hydrogen Energy, vol. 36, pp. 12177–12185, 2011.

T. Zhang, “Effects of culture parameters, light, and mixing on H2 production by sulfur-deprived Chlamydomonas reinhardtii in flat plate reactor,” International Journal of Hydrogen Energy, vol. 36, pp. 15168–15176, 2011.

F. Streichert, C. Spieth, H. Ulmer, and A. Zell, “How to evolve the head-tail pattern from reaction-diffusion systems,” in Proceedings of the NASA/DoD Conference on Evolvable Hardware, pp. 261–268, June 2004.

M. Berovic and M. Legisa, “Citric acid production,” Biotechnology Annual Review, vol. 13, pp. 303–343, 2007.

F. O. Licht, 2011, http://renewablechemicals.agra-net.com/2011/10/chinese-citric-acid-industry-begins-to-consolidate/

F. Alvarez-Vasquez, C. Gonzalez-Alcon, and N. V. Torres, “Metabolism of citric acid production by Aspergillus niger: model definition, steady-state analysis and constrained optimization of citric acid production rate,” Biotechnology and Bioengineering, vol. 70, pp. 82–108, 2000.

J. García and N. Torres, “Mathematical modelling and assessment of the pH homeostasis mechanisms in Aspergillus niger while in citric acid producing conditions,” Journal of Theoretical Biology, vol. 282, no. 1, pp. 23–35, 2011.

D. V. Guebel and N. V. Torres Darias, “Optimization of the citric acid production by Aspergillus niger through a metabolic flux balance model,” Electronic Journal of Biotechnology, vol. 4, no. 1, pp. 3–19, 2001.

N. V. Torres, C. González-Alcón, and E. O. Voit, “Optimization of metabolic systems with linear programming. Application to biotechnological processes,” in Methodologies for the Conception, Design, and Application of Intelligent Systems, T. Yamakawa and G. Matsumoto, Eds., pp. 171–174, World Scientific, Singapore, 1996.

M. Papagianni, “Advances in citric acid fermentation by Aspergillus niger: biochemical aspects, membrane transport and modeling,” Biotechnology Advances, vol. 25, no. 3, pp. 244–263, 2007.

W. A. de Jongh and J. Nielsen, “Enhanced citrate production through gene insertion in Aspergillus niger,” Metabolic Engineering, vol. 10, no. 2, pp. 87–96, 2008.

R. Alves and A. Sorribas, “In silico pathway reconstruction: iron-sulfur cluster biogenesis in Saccharomyces cerevisiae,” BMC Systems Biology, vol. 1, article 10, 2007.

F. Alvarez-Vasquez, K. J. Sims, E. O. Voit, and Y. A. Hannun, “Coordination of the dynamics of yeast sphingolipid metabolism during the diauxic shift,” Theoretical Biology and Medical Modelling, vol. 4, article 42, 2007.

E. O. Voit and T. Radivoyevitch, “Biochemical systems analysis of genome-wide expression data,” Bioinformatics, vol. 16, no. 11, pp. 1023–1037, 2000.

E. Vilaprinyo, R. Alves, and A. Sorribas, “Use of physiological constraints to identify quantitative design principles for gene expression in yeast adaptation to heat shock,” BMC Bioinformatics, vol. 7, article 184, 2006.

E. Vilaprinyo, R. Alves, and A. Sorribas, “Minimization of biosynthetic costs in adaptive gene expression responses of yeast to environmental changes,” PLoS Computational Biology, vol. 6, no. 2, Article ID e1000674, 2010.

G. Guillén-Gosálbez, C. Pozo, L. Jiménez, and A. Sorribas, “A global optimization strategy to identify quantitative design principles for gene expression in yeast adaptation to heat shock,” Computer Aided Chemical Engineering, vol. 26, pp. 1045–1050, 2009.

L. L. Fonseca, C. Sánchez, H. Santos, and E. O. Voit, “Complex coordination of multi-scale cellular responses to environmental stress,” Molecular BioSystems, vol. 7, no. 3, pp. 731–741, 2011.

E. O. Voit, F. Alvarez-Vasquez, and Y. A. Hannun, “Computational analysis of sphingolipid pathway systems,” Advances in Experimental Medicine and Biology, vol. 688, pp. 264–275, 2010.

P.-W. Chen, L. Fonseca, Y. A. Hannun, and E. O. Voit, “Coordination of rapid sphingolipid responses to heat stress in yeast,” submitted

L. L. Fonseca, P.-W. Chen, and E. O. Voit, “Canonical modeling of the multi-scale regulation of the heat stress response in yeast,” Metabolites, vol. 2, pp. 221–241, 2012.

F. Shiraishi and M. A. Savageau, “The tricarboxylic acid cycle in Dictyostelium discoideum—4. Resolution of discrepancies between alternative methods of analysis,” Journal of Biological Chemistry, vol. 267, no. 32, pp. 22934–22943, 1992.

F. Shiraishi and M. A. Savageau, “The tricarboxylic acid cycle in Dictyostelium discoideum—III. Analysis of steady state and dynamic behavior,” Journal of Biological Chemistry, vol. 267, no. 32, pp. 22926–22933, 1992.

F. Shiraishi and M. A. Savageau, “The tricarboxylic acid cycle in Dictyostelium discoideum—II. Evaluation of model consistency and robustness,” Journal of Biological Chemistry, vol. 267, no. 32, pp. 22919–22925, 1992.

F. Shiraishi and M. A. Savageau, “The tricarboxylic acid cycle in Dictyostelium discoideum. Systemic effects of including protein turnover in the current model,” Journal of Biological Chemistry, vol. 268, no. 23, pp. 16917–16928, 1993.

F. Shiraishi and M. A. Savageau, “The tricarboxylic acid cycle in Dictyostelium discoideum—two methods of analysis applied to the same model,” Journal of Theoretical Biology, vol. 178, no. 2, pp. 219–222, 1996.

J. Vera, J. Bachmann, A. C. Pfeifer et al., “A systems biology approach to analyse amplification in the JAK2-STAT5 signalling pathway,” BMC Systems Biology, vol. 2, article 38, 2008.

J. Vera and O. Wolkenhauer, “A system biology approach to understand functional activity of cell communication systems,” Methods in Cell Biology, vol. 90, pp. 399–415, 2009.

J. Vera and O. Wolkenhauer, “A system biology approach to understand functional activity of cell communication systems,” in Methods in Nano Cell Biology, B. Ramaswamy, Ed., Elsevier, 2008.

J. Vera, T. Millat, W. Kolch, and O. Wolkenhauer, “Dynamics of receptor and protein transducer homodimerisation,” BMC Systems Biology, vol. 2, article 92, 2008.

J. Vera, O. Rath, E. Balsa-Canto, J. R. Banga, W. Kolch, and O. Wolkenhauer, “Investigating dynamics of inhibitory and feedback loops in ERK signalling using power-law models,” Molecular BioSystems, vol. 6, no. 11, pp. 2174–2191, 2010.

X. Lai, S. Nikolov, O. Wolkenhauer, and J. Vera, “A multi-level model accounting for the effects of JAK2-STAT5 signal modulation in erythropoiesis,” Computational Biology and Chemistry, vol. 33, no. 4, pp. 312–324, 2009.

S. Nikolov, J. Vera, O. Rath, W. Kolch, and O. Wolkenhauer, “Role of inhibitory proteins as modulators of oscillations in NFκB signalling,” IET Systems Biology, vol. 3, no. 2, pp. 59–76, 2009.

Y.-W. Liu, C.-K. Chen, and C.-L. Lin, “Signal transduction networks in biological systems based on Michaelis-Menten equation and S-system,” in Proceedings of the 7th WSEAS International Conference on Computational Intelligence, Man-Made Machine Systems and Cybernetics, pp. 25–28, 2008.

E. R. Boykin and W. O. Ogle, “Using heterogeneous data sources in a systems biology approach to modeling the Sonic Hedgehog signaling pathway,” Molecular BioSystems, vol. 6, no. 10, pp. 1993–2003, 2010.

J. C. J. Ray and D. E. Kirschner, “Requirement for multiple activation signals by anti-inflammatory feedback in macrophages,” Journal of Theoretical Biology, vol. 241, no. 2, pp. 276–294, 2006.

J. H. Schwacke and E. O. Voit, “Concentration-dependent effects on the rapid and efficient activation of the MAP kinase signaling cascade,” Proteomics, vol. 7, no. 6, pp. 890–899, 2007.

J. H. Schwacke and E. O. Voit, “The potential for signal integration and processing in interacting MAP kinase cascades,” Journal of Theoretical Biology, vol. 246, no. 4, pp. 604–620, 2007.

A. Sorribas, “Exploring the properties of signal transduction pathways by mathematical controlled comparisons based on power-law models,” in Methodologies for the Conception, Design, and Application of Intelligent Systems, T. Yamakawa and G. Matsumoto, Eds., pp. 179–182, World Scientific, Singapore, 1996.

C.-L. Lin, Y.-W. Liu, and C.-H. Chuang, “Analysis of signal transduction networks in Michaelis-Menten equations and S-systems,” International Journal of Biology and Biomedical Engineering, vol. 2, pp. 69–78, 2008.

D. F. Smith, “Quantitative analysis of the functional relationships existing between ecosystem components—I. Analysis of the linear intercomponent mass transfers,” Oecologia, vol. 16, no. 2, pp. 97–106, 1974.

D. F. Smith, “Quantitative analysis of the functional relationships existing between ecosystem components—II. Analysis of non-linear relationships,” Oecologia, vol. 16, no. 2, pp. 107–117, 1974.

D. F. Smith, “Quantitative analysis of the functional relationships existing between ecosystem components—III. Analysis of ecosystem stability,” Oecologia, vol. 21, no. 1, pp. 17–29, 1975.

N. V. Torres, “S-system modelling approach to ecosystem: application to a study of magnesium flow in a tropical forest,” Ecological Modelling, vol. 89, no. 1–3, pp. 109–120, 1996.

P. J. Sands and E. O. Voit, “Flux-based estimation of parameters in S-systems,” Ecological Modelling, vol. 93, no. 1–3, pp. 75–88, 1996.

E. O. Voit, “Dynamic trends in distributions,” Biometrical Journal, vol. 38, no. 5, pp. 587–603, 1996.

E. O. Voit and P. J. Sands, “Modeling forest growth—II. Biomass partitioning in Scots pine,” Ecological Modelling, vol. 86, no. 1, pp. 73–89, 1996.

P. Kaitaniemi, “A canonical model of tree resource allocation after defoliation and bud consumption,” Ecological Modelling, vol. 129, no. 2-3, pp. 259–272, 2000.

P. G. Martin, “The use of canonical S-system modelling for condensation of complex dynamic models,” Ecological Modelling, vol. 103, no. 1, pp. 43–70, 1997.

M. Renton, J. Hanan, and K. Burrage, “Using the canonical modelling approach to simplify the simulation of function in functional-structural plant models,” New Phytologist, vol. 166, no. 3, pp. 845–857, 2005.

M. Renton, P. Kaitaniemi, and J. Hanan, “Functional-structural plant modelling using a combination of architectural analysis, L-systems and a canonical model of function,” Ecological Modelling, vol. 184, no. 2–4, pp. 277–298, 2005.

M. Renton, D. Thornby, and J. Hanan, “Canonical modeling,” in Functional-Structural Plant Modelling in Crop Production, J. Vos, L. F. M. Marcelis, P. H. B. d. Visser, P. C. Struik, and J. B. Evers, Eds., pp. 151–164, Springer, 2007.

E. O. Voit, “Dynamics of self-thinning plant stands,” Annals of Botany, vol. 62, no. 1, pp. 67–78, 1988.

S. D. Pittman and E. C. Turnblom, “A study of self-thinning using coupled allometric equations: implications for coastal Douglas-fir stand dynamics,” Canadian Journal of Forest Research, vol. 33, no. 9, pp. 1661–1669, 2003.

E. O. Voit and A. Sorribas, “Computer modeling of dynamically changing distributions of random variables,” Mathematical and Computer Modelling, vol. 31, no. 4-5, pp. 217–225, 2000.

T. Johnson, “Estimation and simulation of 3-systems,” Mathematical and Computer Modelling, vol. 11, pp. 134–139, 1988.

T. Johnson, “Modeling growth for economic analysis of dynamic agricultural systems,” Departmental Report, Department of Agricultural and Resource Economics, North Carolina State University, Raleigh, NC, USA, 1985.

Y. Lee and E. O. Voit, “Mathematical modeling of monolignol biosynthesis in Populus xylem,” Mathematical Biosciences, vol. 228, no. 1, pp. 78–89, 2010.

K. Chaudhuri and T. Johnson, “Bioeconomic dynamics of a fishery modeled as an S-system,” Mathematical Biosciences, vol. 99, no. 2, pp. 231–249, 1990.

S. Ganguly and K. S. Chaudhuri, “Regulation of a single-species fishery by taxation,” Ecological Modelling, vol. 82, no. 1, pp. 51–60, 1995.

A. B. Brown, Determining the economically optimum slaughter age and time paths for dietary energy and protein [Doctoral dissertation], North Carolina State University, Raleigh, NC, USA, 1991.

A. B. Brown and T. Johnson, Use of an S-System in Optimal Control of a Biological System, Department of Agricultural and Resource Economics, North Carolina State University, Raleigh, NC, USA, 1992.

J. A. Hormiga, E. Almansa, A. V. Sykes, and N. V. Torres, “Model based optimization of feeding regimens in aquaculture: application to the improvement of Octopus vulgaris viability in captivity,” Journal of Biotechnology, vol. 149, no. 3, pp. 209–214, 2010.

N. V. Torres, “Modelization and experimental studies on the control of the glycolytic- glycogenolytic pathway in rat liver,” Molecular and Cellular Biochemistry, vol. 132, no. 2, pp. 117–126, 1994.

A. Ervadi-Radhakrishnan and E. O. Voit, “Controllability of non-linear biochemical systems,” Mathematical Biosciences, vol. 196, no. 1, pp. 99–123, 2005.

H. N. Nounou and N. Meskin, “Fuzzy intervention in biological phenomena,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 9, no. 6, pp. 1819–1825, 2012.

N. Meskin, H. N. Nounou, M. Nounou, A. Datta, and E. R. Dougherty, “Intervention in biological phenomena modeled by S-systems,” IEEE Transactions on Biomedical Engineering, vol. 58, no. 5, pp. 1260–1267, 2011.

N. Meskin, H. Nounou, M. Nounou, E. R. Datta, and A. E. R. Dougherty, “Intervention in biological phenomena modeled by S-systems: A Model predictive control approach,” in Proceedings of the American Control Conference, pp. 3519–3523, 2011.

S. L. Reilly, C. F. Sing, M. A. Savageau, and S. T. Turner, “Analysis of systems influencing renal hemodynamics and sodium excretion. I. Biochemical systems theory,” Integrative Physiological and Behavioral Science, vol. 29, no. 1, pp. 55–73, 1994.

W. Yin, H. Jo, and E. O. Voit, “Systems analysis of the role of bone morphogenic protein 4 in endothelial inflammation,” Annals of Biomedical Engineering, vol. 38, no. 2, pp. 291–307, 2010.

A. Sorribas and A. González, “The power-law formalism as a tool for modeling hormonal systems,” Journal of Theoretical Medicine, vol. 2, no. 2, pp. 19–38, 2000.

G. M. H. Thomas, “Modelling the effects of inhibitors of guanine nucleotide synthesis: implications for studies of cellular differentiation pathways,” Biochemical Society Transactions, vol. 38, no. 5, pp. 1314–1318, 2010.

Z. Qi, S. Kikuchi, F. Tretter, and E. O. Voit, “Effects of dopamine and glutamate on synaptic plasticity: a computational modeling approach for drug abuse as comorbidity in mood disorders,” Pharmacopsychiatry, vol. 44, no. 1, pp. S62–S75, 2011.

Z. Qi, G. W. Miller, and E. O. Voit, “A mathematical model of presynaptic dopamine homeostasis: implications for schizophrenia,” Pharmacopsychiatry, vol. 41, no. 1, pp. S89–S98, 2008.

Z. Qi, G. W. Miller, and E. O. Voit, “Computational systems analysis of dopamine metabolism,” PLoS ONE, vol. 3, no. 6, Article ID e2444, 2008.

Z. Qi, G. W. Miller, and E. O. Voit, “Computational analysis of determinants of dopamine (DA) dysfunction in DA nerve terminals,” Synapse, vol. 63, no. 12, pp. 1133–1142, 2009.

Z. Qi, G. W. Miller, and E. O. Voit, “Computational modeling of synaptic neurotransmission as a tool for assessing dopamine hypotheses of schizophrenia,” Pharmacopsychiatry, vol. 43, no. 1, pp. S50–S60, 2010.

Z. Qi, G. W. Miller, and E. O. Voit, “The internal state of medium spiny neurons varies in response to different input signals,” BMC Systems Biology, vol. 4, article 26, 2010.

Z. Qi, G. W. Miller, and E. O. Voit, “Mathematical Models in Schizophrenia,” in Textbook of Schizophrenia Spectrum Disorders, M. S. Ritsner, Ed., vol. 1, Springer, New York, NY, USA, 2011.

Z. Qi, G. W. Miller, and E. O. Voit, “Mathematical models of dopamine metabolism in Parkinson’s disease,” in The Systems Biology of Parkinson’s Disease, P. W. A. M. Cloutier, Ed., Springer, New York, NY, USA, 2012.

B. Dulam-Banawa, A. Marin-Sanguino, and E. Mendoza, “The evolution of synapse models from numbers to networks to spaces,” Pharmacopsychiatry, vol. 43, no. 1, pp. S42–S49, 2010.

E. R. Mendoza, “From communicational to computational: systems modeling approaches for psychiatric research,” in Systems Biology and Psychiatric Research, F. Tretter, P. Gebicke-Härter, G. Winterer, and E. R. Mendoza, Eds., Wiley VCH, 2010.

A. Marin-Sanguino, R. C. del Rosario, and E. R. Mendoza, “Concept maps and canonical models in neuropsychiatry,” Pharmacopsychiatry, vol. 42, pp. S110–117, 2009.

M. B. Sass, A. N. Lorenz, R. L. Green, and R. A. Coleman, “A pragmatic approach to biochemical systems theory applied to an α-synuclein-based model of Parkinson's disease,” Journal of Neuroscience Methods, vol. 178, no. 2, pp. 366–377, 2009.

S. Liu, C. Tao, Z. Huang, and S. Huang, “Modeling of p53 signaling pathway based on S-system equations,” Journal of Biomedical Engineering, vol. 27, pp. 505–510, 2010 (Chinese).

J. Vera, J. Schultz, S. Ibrahim, Y. Raatz, O. Wolkenhauer, and M. Kunz, “Dynamical effects of epigenetic silencing of 14-3-3σ expression,” Molecular BioSystems, vol. 6, no. 1, pp. 264–273, 2009.

T. M. Broome and R. A. Coleman, “A mathematical model of cell death in multiple sclerosis,” Journal of Neuroscience Methods, vol. 201, pp. 420–425, 2011.

A. E. N. Ferreira, A. M. J. Ponces Freire, and E. O. Voit, “A quantitative model of the generation of Nε-(carboxymethyl)lysine in the Maillard reaction between collagen and glucose,” Biochemical Journal, vol. 376, no. 1, pp. 109–121, 2003.

J. Garcia, J. Shea, F. Alvarez-Vasquez et al., “Mathematical modeling of pathogenicity of Cryptococcus neoformans,” Molecular Systems Biology, vol. 4, article 183, 2008.

J. Garcia, K. J. Sims, J. H. Schwacke, and M. D. Poeta, “Biochemical systems analysis of signaling pathways to understand fungal pathogenicity,” Methods in Molecular Biology, vol. 734, pp. 173–200, 2011.

P. H. Berg, E. O. Voit, and R. L. White, “A pharmacodynamic model for the action of the antibiotic imipenem on Pseudomonas aeruginosa populations in vitro,” Bulletin of Mathematical Biology, vol. 58, no. 5, pp. 923–938, 1996.

J. Vera, R. Curto, M. Cascante, and N. V. Torres, “Detection of potential enzyme targets by metabolic modelling and optimization: application to a simple enzymopathy,” Bioinformatics, vol. 23, no. 17, pp. 2281–2289, 2007.

B. M. Langer, C. Pou-Barreto, C. Gonzalez-Alcon, B. Valladares, B. Wimmer, and N. V. Torres, “Modeling of Leishmaniasis infection dynamics: novel application to the design of effective therapies,” BMC Systems Biology, vol. 6, article 1, 2012.

G. Magombedze and N. Mulder, “Understanding TB latency using computational and dynamic modelling procedures,” Infection, Genetics and Evolution. In press

E. O. Voit, “S-system modelling of endemic infections,” Computers and Mathematics with Applications, vol. 20, no. 4–6, pp. 161–173, 1990.

W. L. Balthis, E. O. Voit, and G. M. Meaburn, “Setting prediction limits for mercury concentrations in fish having high bioaccumulation potential,” Environmetrics, vol. 7, pp. 429–439, 1996.

E. O. Voit and R. G. Knapp, “Derivation of the linear-logistic model and Cox's proportional hazard model from a canonical system description,” Statistics in Medicine, vol. 16, pp. 1705–1729, 1997.

E. O. Voit, “Utility of Biochemical Systems Theory for the analysis of metabolic effects from low-dose chemical exposure,” Risk Analysis, vol. 20, no. 3, pp. 393–402, 2000.

E. O. Voit and K. L. Brigham, “The role of systems biology in predictive health and personalized medicine,” The Open Pathology Journal, vol. 2, pp. 68–70, 2008.

Y. Vodovotz, G. Constantine, J. Rubin, M. Csete, E. O. Voit, and G. An, “Mechanistic simulations of inflammation: current state and future prospects,” Mathematical Biosciences, vol. 217, no. 1, pp. 1–10, 2009.

D. Faratian, R. G. Clyde, J. W. Crawford, and D. J. Harrison, “Systems pathology—taking molecular pathology into a new dimension,” Nature Reviews Clinical Oncology, vol. 6, no. 8, pp. 455–464, 2009.

D. Faratian, J. L. Bown, V. A. Smith, S. P. Langdon, and D. J. Harrison, “Cancer Systems Biology,” in Stem Cells: The Importance of Modelling, vol. 662 of Methods in Molecular Biology, pp. 245–263, Springer, 2010.

C. A. Athale, M. O. Christensen, R. Eils, F. Boege, and C. Mielke, “Inferring a system model of subcellular topoisomerase IIβ localization dynamics,” OMICS, vol. 8, no. 2, pp. 167–175, 2004.

B. Ø. Palsson, Systems Biology: Properties of Reconstructed Networks, Cambridge University Press, New York, NY, USA, 2006.

E. O. Voit, “Optimization in integrated biochemical systems,” Biotechnology and Bioengineering, vol. 40, no. 5, pp. 572–582, 1992.

L. Regan, I. D. L. Bogle, and P. Dunnill, “Simulation and optimization of metabolic pathways,” Computers and Chemical Engineering, vol. 17, no. 5-6, pp. 627–637, 1993.

E. O. Voit and M. D. Signore, “Assessment of effects of experimental imprecision on optimized biochemical systems,” Biotechnology and Bioengineering, vol. 74, no. 5, pp. 443–448, 2001.

A. Marín-Sanguino and N. V. Torres, “Optimization of biochemical systems by linear programming and general mass action model representations,” Mathematical Biosciences, vol. 184, no. 2, pp. 187–200, 2003.

J. Vera, N. V. Torres, C. G. Moles, and J. Banga, “Integrated nonlinear optimization of bioprocesses via linear programming,” AIChE Journal, vol. 49, no. 12, pp. 3173–3187, 2003.

G. Xu, C. Shao, and Z. Xiu, “A modified iterative IOM approach for optimization of biochemical systems,” Computers and Chemical Engineering, vol. 32, no. 7, pp. 1546–1568, 2008.

G. Xu, “Optimization of biochemical networks under uncertainty,” in Proceedings of the IEEE Biomedical Circuits and Systems Conference (BioCAS '09), pp. 157–160, November 2009.

G. Xu, “Comparison of iterative IOM approaches for optimization of biological systems under uncertainty,” in Proceedings of the 2nd International Conference on Intelligent Computing Technology and Automation (ICICTA '09), pp. 163–167, October 2009.

A. Marin-Sanguino, E. O. Voit, C. Gonzalez-Alcon, and N. V. Torres, “Optimization of biotechnological systems through geometric programming,” Theoretical Biology and Medical Modelling, vol. 4, article 38, 2007.

A. Sorribas, C. Pozo, E. Vilaprinyo, G. Guillén-Gosálbez, L. Jiménez, and R. Alves, “Optimization and evolution in metabolic pathways: global optimization techniques in Generalized Mass Action models,” Journal of Biotechnology, vol. 149, no. 3, pp. 141–153, 2010.

G. Guillén-Gosálbez, C. Pozo, L. Jiménez, and A. Sorribas, “An outer approximation algorithm for the global optimization of regulated metabolic systems,” in Proceedings of the 10th International Symposium on Process Systems Engineering, T. M. de Brito Alves, C. A. Oller, and E. C. Biscaia, Eds., pp. 1707–1712, Elsevier B.V., 2009.

C. Pozo, G. Guillén-Gosálbez, A. Sorribas, and L. Jiménez, “Outer approximation-based algorithm for biotechnology studies in systems biology,” Computers and Chemical Engineering, vol. 34, no. 10, pp. 1719–1730, 2010.

C. Pozo, A. Marin-Sanguino, R. Alves, G. Guillen-Gosalbez, L. Jimenez, and A. Sorribas, “Steady-state global optimization of metabolic non-linear dynamic models through recasting into power-law canonical models,” BMC Systems Biology, vol. 5, article 137, 2011.

Y. Zheng, C. W. Yeh, C. D. Yang, S. S. Jang, and I. M. Chu, “On the local optimal solutions of metabolic regulatory networks using information guided genetic algorithm approach and clustering analysis,” Journal of Biotechnology, vol. 131, no. 2, pp. 159–167, 2007.

K. Sriyudthsak and F. Shiraishi, “Investigation of the performance of fermentation processes using a mathematical model including effects of metabolic bottleneck and toxic product on cells,” Mathematical Biosciences, vol. 228, no. 1, pp. 1–9, 2010.

K. Sriyudthsak and F. Shiraishi, “Selection of best indicators for ranking and determination of bottleneck enzymes in metabolic reaction systems,” Industrial and Engineering Chemistry Research, vol. 49, no. 20, pp. 9738–9742, 2010.

J. Vera, C. González-Alcón, A. Marín-Sanguino, and N. Torres, “Optimization of biochemical systems through mathematical programming: methods and applications,” Computers and Operations Research, vol. 37, no. 8, pp. 1427–1438, 2010.

H. Link, J. Vera, D. Weuster-Botz, N. Torres Darias, and E. Franco-Lara, “Multi-objective steady state optimization of biochemical reaction networks using a constrained genetic algorithm,” Computers and Chemical Engineering, vol. 32, no. 8, pp. 1707–1713, 2008.

J. Vera, C. G. Moles, J. Banga, and N. V. Torres, “Optimal non-linear design and control of bioprocesses via linear programming,” in Computer Applications in Biotechnology, M.-N. Pons and J. F. M. Van Impe, Eds., pp. 469–472, Elsevier IFAC Publications, 2004.

N. V. Torres, E. O. Voit, C. Glez-Alcón, and F. Rodríguez, “Optimization of nonlinear biotechnological processes with linear programming. Application to citric acid production in Aspergillus niger,” Biotechnology and Bioengineering, vol. 49, pp. 247–258, 1996.

A. Sevilla, J. Vera, Z. Díaz, M. Cánovas, N. V. Torres, and J. L. Iborra, “Design of metabolic engineering strategies for maximizing L-(-)-carnitine production by Escherichia coli. Integration of the metabolic and bioreactor levels,” Biotechnology Progress, vol. 21, no. 2, pp. 329–337, 2005.

M. Cánovas, V. Bernal, Á. Sevilla, and J. L. Iborra, “Role of wet experiment design in data generation: from in vivo to in silico and back,” In Silico Biology, vol. 7, no. 2, pp. 3–16, 2007.

J. Hormiga, C. González-Alcón, A. Sevilla, M. Cánovas, and N. V. Torres, “Quantitative analysis of the dynamic signaling pathway involved in the cAMP mediated induction of L-carnitine biosynthesis in E. coli cultures,” Molecular BioSystems, vol. 6, no. 4, pp. 699–710, 2010.

G. Santos, J. A. Hormiga, P. Arense, M. Canovas, and N. V. Torres, “Modelling and analysis of central metabolism operating regulatory interactions in salt stress conditions in a L-carnitine overproducing E. coli strain,” PloS ONE, vol. 7, Article ID e34533, 2012.

A. Marín-Sanguino and N. V. Torres, “Optimization of tryptophan production in bacteria. Design of a strategy for genetic manipulation of the tryptophan operon for tryptophan flux maximization,” Biotechnology Progress, vol. 16, no. 2, pp. 133–145, 2000.

L. K. Nguyen and D. Kulasiri, “On multiple regulatory mechanisms in the tryptophan operon system in Escherichia coli: in silico study of perturbation dynamics,” In Silico Biology, vol. 8, no. 5-6, pp. 485–510, 2008.

Y. Sun, X. Mu, Z. Li, H. Teng, and Z. Xiu, “Robustness and nonlinear dynamic analysis for trp operan and optimization of tryptophan production: an integrated model considering gene regulation, genes interaction and product excretion,” in Proceedings of the 4th International Conference on Bioinformatics and Biomedical Engineering (iCBBE '10), pp. 1–7, June 2010.

A. Marín-Sanguino and N. V. Torres, “Modelling, steady state analysis and optimization of the catalytic efficiency of the triosephosphate isomerase,” Bulletin of Mathematical Biology, vol. 64, no. 2, pp. 301–326, 2002.

N. Meskin, H. Nounou, M. Nounou, A. Datta, and E. Dougherty, “Output-feedback model predictive control of biological phenomena modeled by S-systems,” in Proceedings of the American Control Conference, Montréal, Canada, 2012.

A. Domingues, S. Vinga, and J. M. Lemos, “Optimization strategies for metabolic networks,” BMC Systems Biology, vol. 4, article 113, 2010.

C. E. Long, E. O. Voit, and E. P. Gatzke, “A mixed integer moving horizon formulation for prioritized objective inferential control of a bioprocess system,” in Proceedings of the American Control Conference, pp. 2365–2370, June 2003.

M. Cascante, A. Sorribas, and E. I. Canela, “Enzyme-enzyme interactions and metabolite channelling: alternative mechanisms and their evolutionary significance,” Biochemical Journal, vol. 298, no. 2, pp. 313–320, 1994.

P. W. Klymko and R. Kopelman, “Fractal reaction kinetics: exciton fusion on clusters,” Journal of Physical Chemistry, vol. 87, no. 23, pp. 4565–4567, 1983.

L. W. Anacker and R. Kopelman, “Fractal chemical kinetics: simulations and experiments,” The Journal of Chemical Physics, vol. 81, no. 12, pp. 6402–6403, 1984.

R. Kopelman, “Reaction kinetics in restricted spaces,” Israel Journal of Chemistry, vol. 31, pp. 147–157, 1991.

R. Kopelman, “Rate processes on fractals: theory, simulations, and experiments,” Journal of Statistical Physics, vol. 42, no. 1-2, pp. 185–200, 1986.

R. Kopelman, “Fractal reaction kinetics,” Science, vol. 241, no. 4873, pp. 1620–1626, 1988.

M. A. Savageau, “Influence of fractal kinetics on molecular recognition,” Journal of Molecular Recognition, vol. 6, no. 4, pp. 149–157, 1993.

M. A. Savageau, “Development of fractal kinetic theory for enzyme-catalysed reactions and implications for the design of biochemical pathways,” BioSystems, vol. 47, no. 1-2, pp. 9–36, 1998.

M. A. Savageau, “Fractal kinetic effects on equilibrium,” in Methodologies for the Conception, Design, amd Application of Intelligent Systems, T. Yamakawa and G. Matsumoto, Eds., vol. 1, pp. 187–190, World Scientific, Singapore, 1996.

Ž. Bajzer, M. Huzak, K. L. Neff, and F. G. Prendergast, “Mathematical analysis of models for reaction kinetics in intracellular environments,” Mathematical Biosciences, vol. 215, no. 1, pp. 35–47, 2008.

K. L. Neff, Biochemical reaction kinetics in dilute and crowded solutions: predictions of macroscopic and mesoscopic models and experimental observations [Doctoral dissertation], Mayo Clinic, Rochester, Minn, USA, 2010.

K. L. Neff, C. P. Offord, A. J. Caride, E. E. Strehler, F. G. Prendergast, and Ž. Bajzer, “Validation of fractal-like kinetic models by time-resolved binding kinetics of dansylamide and carbonic anhydrase in crowded media,” Biophysical Journal, vol. 100, no. 10, pp. 2495–2503, 2011.

E. O. Voit and A. E. N. Ferreira, “Buffering in models of integrated biochemical systems,” Journal of Theoretical Biology, vol. 191, no. 4, pp. 429–437, 1998.

W. T. Mocek, R. Rudnicki, and E. O. Voit, “Approximation of delays in biochemical systems,” Mathematical Biosciences, vol. 198, no. 2, pp. 190–216, 2005.

E. O. Voit, “S-system modelling of complex systems with chaotic input,” Environmetrics, vol. 4, no. 2, pp. 153–186, 1993.

E. O. Voit, F. Alvarez-Vasquez, and K. J. Sims, “Analysis of dynamic labeling data,” Mathematical Biosciences, vol. 191, no. 1, pp. 83–99, 2004.

F. Alvarez-Vasquez, Y. A. Hannun, and E. O. Voit, “Dynamics of positional enrichment: theoretical development and application to carbon labeling in Zymomonas mobilis,” Biochemical Engineering Journal, vol. 40, no. 1, pp. 157–174, 2008.

E. O. Voit and P. N. Yi, “Comparison of isoeffect relationships in radiotherapy,” Bulletin of Mathematical Biology, vol. 52, no. 5, pp. 657–675, 1990.

L. Feinendegen, P. Hahnfeldt, E. E. Schadt, M. Stumpf, and E. O. Voit, “Systems biology and its potential role in radiobiology,” Radiation and Environmental Biophysics, vol. 47, no. 1, pp. 5–23, 2008.

A. Marin-Sanguino, E. R. Mendoza, and E. O. Voit, “Flux duality in nonlinear GMA systems: implications for metabolic engineering,” Journal of Biotechnology, vol. 149, no. 3, pp. 166–172, 2010.

E. Kreyszig, Advanced Engineering Mathematics, John Wiley and Sons, New York, NY, USA, 7th edition, 1993.

P. de Atauri, A. Sorribas, and M. Cascante, “Analysis and prediction of the effect of uncertain boundary values in modeling a metabolic pathway,” Biotechnology and Bioengineering, vol. 68, pp. 18–30, 2000.

P. De Atauri, R. Curto, J. Puigjaner, A. Cornish-Bowden, and M. Cascante, “Advantages and disadvantages of aggregating fluxes into synthetic and degradative fluxes when modelling metabolic pathways,” European Journal of Biochemistry, vol. 265, no. 2, pp. 671–679, 1999.

A. Machina, A. Ponosov, and E. O. Voit, “Automated piecewise power-law modeling of biological systems,” Journal of Biotechnology, vol. 149, no. 3, pp. 154–165, 2010.

M. Cascante, A. Sorribas, R. Franco, and E. I. Canela, “Biochemical systems theory: increasing predictive power by using second-order derivatives measurements,” Journal of Theoretical Biology, vol. 149, no. 4, pp. 521–535, 1991.

C. Kaddi, C. F. Quo, and M. D. Wang, “Quantitative metrics for bio-modeling algorithm selection,” in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 4613–4616, 2008.

A. Dräger, M. Kronfeld, M. J. Ziller et al., “Modeling metabolic networks in C. glutamicum: a comparison of rate laws in combination with various parameter optimization strategies,” BMC Systems Biology, vol. 3, article 5, 2009.

F. Hadlich, S. Noack, and W. Wiechert, “Translating biochemical network models between different kinetic formats,” Metabolic Engineering, vol. 11, no. 2, pp. 87–100, 2009.

R. Grima and S. Schnell, “How reaction kinetics with time-dependent rate coefficients differs from generalized mass action,” ChemPhysChem, vol. 7, no. 7, pp. 1422–1424, 2006.

O. Wolkenhauer, M. Ullah, W. Kolch, and K. H. Cho, “Modeling and simulation of intracellular dynamics: choosing an appropriate framework,” IEEE Transactions on Nanobioscience, vol. 3, no. 3, pp. 200–207, 2004.

E. O. Voit and M. A. Savageau, “Accuracy of alternative representations for integrated biochemical systems,” Biochemistry, vol. 26, no. 21, pp. 6869–6880, 1987.

M. O. Vlad, A. D. Corlan, F. Morán, R. Spang, P. Oefner, and J. Ross, “Kinetic laws, phase-phase expansions, renormalization group, and INR calibration,” Proceedings of the National Academy of Sciences of the United States of America, vol. 106, no. 16, pp. 6465–6470, 2009.

M. A. Savageau, “Allometric morphogenesis of complex systems: derivation of the basic equations from first principles,” Proceedings of the National Academy of Sciences of the United States of America, vol. 76, no. 12, pp. 6023–6025, 1979.

M. A. Savageau, “Growth equations: a general equation and a survey of special cases,” Mathematical Biosciences, vol. 48, no. 3-4, pp. 267–278, 1980.

E. O. Voit, “Selecting a model for integrated biomedical systems,” in Biomedical Modeling and Simulation, J. Eisenfeld, D. S. Levine, and M. Witten, Eds., pp. 465–472, Elsevier Science Publishers, Amsterdam, The Netherlands, 1992.

G. B. West, J. H. Brown, and B. J. Enquist, “A general model for the origin of allometric scaling laws in biology,” Science, vol. 276, no. 5309, pp. 122–126, 1997.

G. B. West, J. H. Brown, and B. J. Enquist, “A general model for ontogenetic growth,” Nature, vol. 413, no. 6856, pp. 628–631, 2001.

A. Sorribas, J. March, and E. O. Voit, “Estimating age-related trends in cross-sectional studies using S-distributions,” Statistics in Medicine, vol. 19, pp. 697–713, 2000.

E. O. Voit, “Cell cycles and growth laws: the CCC model,” Journal of Theoretical Biology, vol. 114, no. 4, pp. 589–599, 1985.

E. O. Voit, “Generic modeling of population dynamics with S-systems,” in Proceedings of the 2nd International Conference on Mathematical Population Dynamics, pp. 261–280, Marcel Dekker, 1990.

E. O. Voit, H. J. Anton, and J. Blecker, “Regenerative growth curves,” Mathematical Biosciences, vol. 73, no. 2, pp. 253–269, 1985.

E. O. Voit, “Recasting of nonlinearities as S-systems,” in Canonical Nonlinear Modeling. S-system Approach to Understanding Complexity, E. O. Voit, Ed., pp. 213–237, Van Nostrand, Reinhold, NY, USA, 1991.

E. H. Kerner, “Universal formats for nonlinear ordinary differential systems,” Journal of Mathematical Physics, vol. 22, no. 7, pp. 1366–1371, 1980.

L. Brenig, “Complete factorisation and analytic solutions of generalized Lotka-Volterra equations,” Physics Letters A, vol. 133, no. 7-8, pp. 378–382, 1988.

L. Brenig, “New special functions solfing nonlinear autonomous dynamical systems,” http://arxiv.org/abs/0910.2584

L. Brenig and A. Goriely, “Universal canonical forms for time-continuous dynamical systems,” Physical Review A, vol. 40, no. 7, pp. 4119–4122, 1989.

A. Papachristodoulou and S. Prajna, “Analysis of non-polynomial systems using the sum of squares decomposition,” in Positive Polynomials in Control, D. Henrion and A. Garuli, Eds., pp. 23–43, Springer, Berlin, Germany, 2005.

E. O. Voit, “How many variables? Some comments on the dimensionality of nonlinear systems,” in Proceedings of the World Congress of Nonlinear Analysts, V. Lakshmikantham, Ed., Walter de Gruyter & Co, New York, NY, USA, 1992.

E. O. Voit, “Algebraic properties of S-systems,” in Canonical Nonlinear Modeling. S-system Approach to Understanding Complexity, E. O. Voit, Ed., pp. 278–303, Van Nostrand, Reinhold, NY, USA, 1991.

E. O. Voit, “Symmetries of S-systems,” Mathematical Biosciences, vol. 109, no. 1, pp. 19–37, 1992.

M. A. Savageau, “A suprasystem of probability distributions,” Biometrical Journal, vol. 24, pp. 323–330, 1982.

P. F. Rust and E. O. Voit, “Non-central chi-square distributions computed by S-system differential equations,” in Proceedings of the Annual Meeting of the American Statistical Association, Statistical Computing Section, pp. 118–121, San Francisco, Calif, USA, 1987.

P. F. Rust and E. O. Voit, “S-system computation of central and noncentral F densities and cumulatives,” in Proceedings of the Annual Meeting of the American Statistical Association, Statistical Computing Section, pp. 274–279, 1988.

P. F. Rust and E. O. Voit, “S-system analysis of the noncentral t distribution with fractional degrees of freedom,” in Proceedings of the Annual Meeting of the American Statistical Association, Statistical Computing Section, pp. 84–87, 1989.

P. F. Rust and E. O. Voit, “Statistical densities, cumulatives, quantiles, and power obtained by S-system differential equations,” Journal of the American Statistical Association, vol. 85, pp. 572–578, 1990.

E. O. Voit and P. F. Rust, “Evaluation of the noncentral t distribution with S-systems,” Biometrical Journal, vol. 32, pp. 681–695, 1990.

P. F. Rust, “Modeling approximately normal distributions with S-systems,” in Annual Meeting of the American Statistical Association, Statistical Computing Section, pp. 162–166, 1991.

P. F. Rust, “Applications of recasting in statistical distributions,” in Canonical Nonlinear Modeling. S-System Approach to Understanding Complexity, E. O. Voit, Ed., pp. 238–257, Van Nostrand Reinhold, 1991.

Y. C. Chou, P. L. Chang, and Z. Y. Chen, “Comparing S-system with existing methods for the computation of noncentral beta distribution,” International Journal of Information and Management Sciences, vol. 11, no. 2, pp. 37–48, 2000.

Z. Y. Chen and Y. C. Chou, “Computing the noncentral beta distribution with S-system,” Computational Statistics and Data Analysis, vol. 33, no. 4, pp. 343–360, 2000.

Z. Y. Chen, C. C. Chen, and C. Y. Lai, “On the S-system computation of statistical distributions,” Journal of the Chinese Statistical Association, vol. 37, pp. 222–201, 1999 (Chinese).

Z. Y. Chen, “On the statistical computation of the sample multiple correlation coefficient,” Journal of Statistical Computation and Simulation, vol. 70, no. 4, pp. 299–324, 2001.

Z. Y. Chen, “Computing the distribution of the squared sample multiple correlation coefficient with S-systems,” Communications in Statistics Part B, vol. 32, no. 3, pp. 873–898, 2003.

M. H. Lee and B. R. Ahmad Mahir, “Penggunaan pendekatan sistem-S dan ESSYNS dalam analisis taburan normal,” Pertanika Journal of Science & Technology, vol. 2, pp. 165–173, 1994.

M. H. Lee and B. R. Ahmad Mahir, “Analisis berangka bagi taburan khi kuasa dua melalui persamaan terbitan sistem-S,” Sains Malaysiana, vol. 23, no. 4, pp. 129–147, 1994.

Z. Y. Chen, “The S-system computation of non-central gamma distribution,” Journal of Statistical Computation and Simulation, vol. 75, no. 10, pp. 813–829, 2005.

E. O. Voit, “The S-distribution. A tool for approximation and classification of univariate, unimodal probability distributions,” Biometrical Journal, vol. 34, pp. 855–878, 1992.

E. O. Voit and S. Yu, “The S-distribution. Approximation of discrete distributions,” Biometrical Journal, vol. 36, pp. 205–219, 1994.

E. O. Voit and S. Yu, “A new tool for distribution approximation and classification,” in Annual Meeting of the American Statistical Association, Boston, Mass, USA, 1992.

Q. He, Completing the Kaplan-Meier estimator when there is extreme right censoring [Ph.D. Dissertation], Medical University of South Carolina, 1997.

S. Yu and E. O. Voit, “A graphical classification of classic survival distributions,” in Proceedings of the International Research Conference on Lifetime Data Models in Reliability and Survival Analysis, Boston, Mass, USA, 1994.

S. Yu and E. O. Voit, “A simple, flexible failure model,” Biometrical Journal, vol. 37, pp. 595–609, 1995.

S. S. Yu and E. O. Voit, “A graphical classification of survival distributions,” in Lifetime Data: Models in Reliability and Survival Analysis, N. P. Jewell, A. C. Kimber, M.-L.T. Lee, and G. A. Whitmore, Eds., pp. 385–392, Kluwer Academic Publishers, Dordrecht, The Netherlands, 1996.

Q. He and E. O. Voit, “Estimation and completion of survival data with piecewise linear models and S-distributions,” Journal of Statistical Computation and Simulation, vol. 75, no. 4, pp. 287–305, 2005.

E. O. Voit and L. H. Schwacke, “Random number generation from right-skewed, symmetric, and left-skewed distributions,” Risk Analysis, vol. 20, no. 1, pp. 59–71, 2000.

B. Hernández-Bermejo and A. Sorribas, “Analytical quantile solution for the S-distribution, random number generation and statistical data modeling,” Biometrical Journal, vol. 43, pp. 1007–1025, 2001.

S. V. Aksenov and M. A. Savageau, “Mathematica and C Programs for Minimum Distance Estimation of the S Distribution and for Calculation of Goodness-of-Fit by Bootstrap,” Nimep of Moscow State University 2002

S. V. Aksenov and M. A. Savageau, “Statistical inference and modeling with the S-distribution,” 2001, http://arxiv.org/pdf/physics/0112046.pdf

W. L. Balthis, Application of hierarchical Monte Carlo simulation to the estimation of human exposure to mercury via consumption of King Mackerel (Scomberomorus cavalla) [Doctoral dissertation], Medical University of South Carolina, 1998.

J. K. Bangerter, Uncertainty and variability analysis in the estimation of human exposure to mercury from seafood consumption using two-dimensional Monte Carlo simulations [Doctoral dissertation], Medical University of South Carolina, 1998.

E. O. Voit and L. H. Schwacke, “Scalability properties of the S-distribution,” Biometrical Journal, vol. 40, no. 6, pp. 665–684, 1998.

E. O. Voit, “A maximum likelihood estimator for shape parameters of S-distributions,” Biometrical Journal, vol. 42, no. 4, pp. 471–479, 2000.

L. Yu and E. O. Voit, “Construction of bivariate S-distributions with copulas,” Computational Statistics and Data Analysis, vol. 51, no. 3, pp. 1822–1839, 2006.

J. M. Muiño, E. O. Voit, and A. Sorribas, “GS-distributions: a new family of distributions for continuous unimodal variables,” Computational Statistics and Data Analysis, vol. 50, no. 10, pp. 2769–2798, 2006.

J. Trujillano, J. M. Muiño, J. March, and A. Sorribas, “A more flexible parametric estimation of univariate reference intervals: a new method based on the GS-distribution,” Clinica Chimica Acta, vol. 379, no. 1-2, pp. 71–80, 2007.

J. March, J. Trujillano, M. Tor, and A. Sorribas, “Estimating conditional distributions using a method based on S-distributions reference percentile curves for body mass index in Spanish children,” Growth, Development, and Aging, vol. 67, no. 2, pp. 59–72, 2003.

A. Sorribas, J. M. Muiño, and M. Rué, “Univariate parametric survival analysis using GS-distributions,” Statistics and Operations Research Transactions, vol. 30, no. 2, pp. 205–218, 2006.

E. O. Voit, L. H. Schwacke, and K. N. Simpson, “Application of S-distributions to resource use and cost data in clinical economic studies,” in Proceedings of the Annual Meeting of the American Statistical Association, Section on Survery Research methods, pp. 120–125, 2000.