The Optimal Control and MLE of Parameters of a Stochastic Single-Species System

This paper investigates the optimal control and MLE maximum likelihood estimation for a single-species system subject to random perturbation. With the help of the techniques of stochastic analysis and mathematical statistics, sufficient conditions for the optimal control threshold value, the optimal control moment, and the maximum likelihood estimation of parameters are established, respectively. An example is presented to illustrate the feasibility of our theoretical results.


Introduction
The Malthus model is usually expressed as dx t dt rx t , 1.1 where x 0 x 0 > 0, x t stands for the density of species x at t moment, and r is the intrinsic growth rate.As everyone knows, model 1.1 has epoch-making significance in mathematics and ecology and later, many deterministic mathematical models have been widely studied see 1-5 .In fact, a population system is inevitably affected by the environmental noise in the real world.As a consequence, it is reasonable to study a corresponding stochastic model.Notice that some recent results, especially on optimal control, for the following stochastic model dx t x t rdt σdw t , 1.2 Discrete Dynamics in Nature and Society have been obtained see 6-9 , where w t stands for the standard Brownian motion.However, for some pest populations, their generations are nonoverlapping e.g., poplar and willow weevil, osier weevil and paranthrene tabaniformis and the discrete models are more appropriate than the continuous ones.Compared with the continuous ones, the study on discrete mathematical models is more challenging.Inspired by 1-12 , in this paper we will consider the following discrete model of system 1.2 x n x n − 1 exp r σε n , 1.3 where x 0 > 0, ε i ∼ N 0, 1 , i 1, 2, . . ., n, and any two of them are independent.σ stands for the noise intensity.We will focus on the optimal control threshold value, the optimal control moment, and the maximum likelihood estimation of parameters.To the best of our knowledge, no work has been done for system 1.3 .The rest of this paper is organized as follows.In Section 2, some preliminaries are introduced.In Section 3, we give three results of this paper.As applications of our main results; an example is presented to illustrate the feasibility of our theoretical results in Section 4.

Preliminaries
In this section, we summarize several definitions, assumptions, and lemmas which are useful for the later sections.Definition 2.1.Only when the quantity of pest population reaches U one starts to control the pest population, and the real number U is called to be a control threshold value.Definition 2.2.Until the N 0 th generation, the total quantity of pest population first reaches the control threshold value, then one says that N 0 is the first reaching time.
Two main goals of this paper are to seek the optimal control threshold value and the optimal control moment from the point of view of the lowest control cost.Considering that the practical control to some pest population must be in the limited time range, we give the first assumption: H 1 n ≤ n 0 , where n is the number of generation of pest population in a control period and n 0 is a positive integer.
Denote M max{x 0 , x 1 , . . ., x n 0 }.Usually, at the beginning, the number of pest population is very small, so we give the second assumption: Let the life period of pest population x be τ, we should annihilate pest at N 0 τ moment from the point of view of the lowest control cost.We further give the third assumption.
H 3 The number of pest population x will not reach the extent which can cause damage again after being annihilated.
By H 3 , we have So we can give the expression of the total loss caused by pest and expending for annihilating pest, respectively.It is obvious that the loss caused by pest population comes from the quantity of population and damaging time.We need to the fourth assumption H 4 The generation of pest population is nonoverlapping.
On one hand, the loss caused by pest can be expressed as where k 1 stands for the loss caused by unit number pest in one generation, E x n is the mean function of x n .On the other hand, the expending for annihilating pest can be expressed as where H x is defined by that is, where k 2 stands for the expending for annihilating pest once.Since S N 0 is dependent on random variable N 0 and k 2 H M − U is dependent on random variable M and threshold value U, the total cost is a random variable, which can be expressed as Thus, we need to search for U * such that J U * is minimum and consequently, we can give the optimal control moment.
Next, we will give some lemmas which are very important to the proofs of three theorems in the following section.
Lemma 2.3.The solution of system 1.3 can be expressed as Proof.By 1.3 , we have Thus, one has . . .
x n x n − 1 exp r σε n .

2.9
By a simplification, we obtain that is,

2.11
Lemma 2.4.If E x n is the mean-value function of the solution of system 1.3 , then one has Proof.One has

2.16
Lemma 2.5.Let the life period of pest population be τ, let k 1 be the loss caused by unit number pest in one generation, and let k 2 be the expending for annihilating pests once time.The loss caused by pest can be expressed as 2.17 Proof.Consider

2.22
By H 2 , we have

2.24
By 2.24 , we have

2.25
Moreover, one has

2.27
Lemma 2.7.The mean-value function of the loss caused by pest population is

2.28
Proof.By the definition of mean value function, we have then by Lemma 2.6, we obtain

2.31
Proof.By the definitions of M and U, we have 2.32

Main Results
In this section, we give three main results.We first give the optimal control threshold value.
Theorem 3.1.If the assumptions H 1 -H 4 are satisfied, then the optimal control threshold value of system 1.3 is the minimal nonnegative solution of the following equation about U where

3.2
Proof.By Lemmas 2.3-2.8,we obtain that the total loss can be expressed as

3.3
A calculation leads to Denote U * is the minimal nonnegative solution of the above equation, it follows from 3.4 that J U * 0 and U * is the optimal control threshold value of system 1.3 .The proof of Theorem 3.1 is complete.
In the following, we give the optimal control moment.Theorem 3.2.If the assumptions H 1 -H 4 hold, then the optimal control moment of system 1.3 can be expressed as where U * is defined in Theorem 3.1 and τ is the life period of the pest population.
Proof.By the definition of N 0 , we have T 0 E N 0 τ .Furthermore, it follows from Lemma 2.6 that

3.6
The proof of Theorem 3.2 is complete.
Finally, we give the estimate of the maximum likelihood estimations of the parameters r and σ of system 1.3 .

3.10
Further, we have ln

3.11
From 3.11 , we obtain the following likelihood equation

3.13
The proof of Theorem 3.3 is complete.

An Example
In this section, to illustrate the feasibility of our theoretical results, we will give the following example.
Example 4.1.Consider the following system x n x n − 1 exp 0.3 0.08ε n .

4.1
The choose the loss caused by the unit number pest k 1 0.8, the expending for annihilating pest once k 2 0.2, and initial value x 0 0.01, n 0 5.By Theorems 3.1 and 3.2, we can obtain the approximates of the optimal control threshold value U * 0.1168326 and the optimal control moment T 0 3.3217.
Next, we give the MLE of the parameters r and σ to compare the true value with estimation.In Table 1, for the given true value of parameters r 0.3 and σ 0.1, the number of the sample "size n" increases from 500 to 2000, the data of the columns r-MLE and σ-MLE are obtained by the average of 10 MLEs from the data coming from system 1.3 .The columns of AE shows the absolute error of MLE.Table 1 shows that, with the augment of the number of the sample, the absolute error of MLE of r and σ will decrease, which implies that it is reasonable to estimate the parameters of system 1.3 by MLE.
no. 210134, 212111 and the Innovation Term of Hubei University for Nationalities no.MY2011T007 .

Theorem 3 . 3 .
Let r and σ be the maximum likelihood estimations of the parameters r and σ, one has From system 1.3 , we have ln x n − ln x n − 1 r σε n , 3.8 let y n ln x n , then we obtain y n − y n − 1 r σε n .3.9 Since ε n i.i.d N 0, 1 , we have y n − y n − 1 i.i.d N r, σ 2 .Let x n be the quantity of the nth generation pest population, we can obtain corresponding values y 0 , y 1 , . . ., y n , then the likelihood function of parameters r and σ is 2, . . ., n, we have

Table 1 :
The average value and absolute error of MLE of parameters with different number of sample.