Journal of Applied Mathematics
Volume 2015 (2015), Article ID 563060, 7 pages
http://dx.doi.org/10.1155/2015/563060

Research Article

Compensating Operator and Weak Convergence of Semi-Markov Process to the Diffusion Process without Balance Condition

Igor V. Malyk

Department of the System Analysis and Insurance and Financial Mathematics, Yuriy Fedkovych Chernivtsi National University, Universitetska Street 12, Chernivtsi 58012, Ukraine

Received 22 August 2015; Revised 8 November 2015; Accepted 9 November 2015

Academic Editor: Jinde Cao

Copyright © 2015 Igor V. Malyk. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Weak convergence of semi-Markov processes in the diffusive approximation scheme is studied in the paper. This problem is not new and it is studied in many papers, using convergence of random processes. Unlike other studies, we used in this paper concept of the compensating operator. It enables getting sufficient conditions of weak convergence under the conditions on the local characteristics of output semi-Markov process.

1. Introduction

Weak convergence conditions for semi-Markov stochastic processes in the diffusion approximation scheme without balance condition are studied in the paper. Theory of Markov and semi-Markov processes is used in security market (Black-Sholes equation, Vasicek model, and their modifications) [1], queuing systems [2, 3], engineering [4], biology [5], climate models [6, 7], and publicity models [8]. But numerous papers were devoted to problems of Markov processes convergence. This approach produces errors of mathematical model because exponential distribution of sojourn time in states is supposed. The supposition enables staying in the state any time with nonzero probability. This is unacceptable in physics systems. That is why the subject of this research is semi-Markov processes. Beside this, other techniques of weak convergence research are used in many papers. In this case authors get different sufficient conditions of the convergence. For example, in [9] author states his results as solution of some martingale problem. It complicates testing these conditions. In [3] author focuses on the convergence of characteristic functions and claims the convergence of characteristic functions for prelimited processes. In [10] author claims the convergence of the generators of the prelimited processes to the generator of some diffusion process.

In contrast to abovelisted works, only moment’s conditions on the semi-Markov process local characteristic are used in this paper. Using the term of compensating operator makes it possible to not use convergence of the generators of prelimited processes.

2. Main Result

Consider the conditions of weak convergence of semi-Markov random processes (SMP) in diffusion approximation scheme. Consideration of these problems can be found in [3, 9–15]. Let us consider SMP , , on the probability space [11, 16, 17] in Euclidian space , , which is generated by the Markov renewal process (MRP)

that is

where is the counting process.

Denote the sojourn time in states , . MRP is determined by semi-Markov kernel, which sets conditional probabilities of jump’s values, and by distribution of the sojourn time in states:

where , , , , is the Borel -algebra on , and

Note that in this section the important fact will be one when the kernel has decomposition:

because in general this assumption is not valid.

In this paper suppose that balance condition did not hold; it means that

In this case it is impossible to consider the process in the scheme of diffusive approximation, which is defined by relation

because it is impossible to write the asymptotic representation of compensating operator (CO) of the process. That is why we consider semi-Markov process , , in averaging scheme, which is defined by equation

We can prove weak convergence of the process , where is the solution of differential equation

where

Consider stochastic process:

According to (11), we get

Let us define

Consider compensating operator for some process.

Definition 1. The compensating operator for SMP , , is defined by the relation

on the test-functions .

In this case there is a weak convergence SMP in the scheme of diffusive approximation without balance conditions.

Theorem 2. Let the following conditions be satisfied:

(D1)Uniform integrability (bounded time in states):

(D2), , that inequality

 is uniform by and .(D3)Boundary of the second moment of jump’s value:

(D4)Kernel satisfies the following conditions:

 where , .(D5)Function satisfies the condition

(D6)Convergence of the initial conditions is as follows:

Then weak convergence takes place in , , as :

where , , is the diffusion process with generator

Remark 3. Boundary operator depends on the averaged evolution ; that is why it is advisable to consider weak convergence of two-component evolution . But, according to [11, 18–20], we will prove theorem only for the process, which consists of parameter of series , in other words .

The proof of Theorem 2 consists of two steps.

Step 1. Let us solve the problem of the singular perturbation for CO of process as .

Consider an evolution equation

that corresponds with

and with semigroup

By analogues, an evolution equation

corresponds with operator

with semigroup

Lemma 4. CO of two-component process on test-functions is given by

where

Proof. By Definition 1, we got a relation for values of jumps and time of renewals:

Then

So, according to the condition we get

For embedded chain , , we get

Then calculate

So, finally we get representation of the compensating operator for two-component evolution :

as we wanted to show.
Lemma 4 is proved.

Consider asymptotic behavior of CO, from Lemma 4 as .

Lemma 5. On test-functions CO of the process has asymptotic representation

where is given by the following relation:

and for the negligible term,

is true.

Proof. Let us use an algebraic identity

According to Lemma 4 and algebraic identity (40) we get

Let us use the equations for semigroups [9]:

Then for the term , by semigroups properties and condition (D5), we get the following relation:

Similarly for we get

From factorization , according to (40), terms , were considered. is built by these terms. It is easy to check that the sum of the rest of the terms is as , if conditions (D3)–(D5) hold.
Using representation for semigroups , , and , it is easy to show that negligible term is as .
Lemma 5 is proved.

Step 2. Let us show the relative compactness of the processes family as . We will use Theorem 1.4.6 from [21]. Let us formulate and prove the statement we need to use this theorem.

Remark 6. Conditions of relative compactness can also be found in [22, 23].

Lemma 7. There is an inequality

for test-functions , where constant depends only on function .
For function there is a bound

where constant depends only on the function , independent from .

Proof. Let us use the result of Lemma 5:

According to the definition of test-function we have . To prove the lemma, condition (D3) for a boundary of the first and the second moments, condition (D4), and condition (D2) remain to be used, from which it follows that .
Then

where constant depends only on , .
To prove condition (46) the properties of the function remain to be remembered; namely

Lemma 7 is proved.

Lemma 8. , , is relatively compact family.

Proof. To determine the relative compactness of the family , , according to Theorem 1.4.6 [21] submartingality of the stochastic process for nonnegative infinitely differentiable and for some constant and inequality (45) and (46) remains to be shown, where .
Let us prove that stochastic process is nonnegative submartingale relatively to the stream of -algebras , :

Two last terms tend to 0 as . By Lemma 7

Measurability of the process relatively to the stream is obvious. So, is nonnegative submartingale.
Lemma 8 is proved.

According to Lemma 8  , , is a relatively compact family. To complete the proof of the theorem the family that converges to martingale remains to be shown. Consider stochastic processes:

Then

According to Lemma 7 the third term satisfies the relation

By the same way we can prove that the first and the fourth terms tend to 0, because is continuous.

The last term tends to 0 by Lemma 5, because

on test-functions , which have uniform bounded derivatives of any order.

The second term is equal to

and has a martingale condition according to Lemma 6.1 [11].

Let us use its martingale condition:

Finally we have

where as .

Now from theorem’s condition (D6) we get

in another words, is martingale.

So, we have checked all conditions of the weak convergence, namely, the compactness of the processes family and the martingality of the limited process. Beside this according to Lemma 5 CO converges to the generator of diffusion process.

Theorem 2 is proved.

3. Numerical Example

Consider semi-Markov process , , in . For this process has uniform distribution on and has Bernoulli distribution with parameters . Then

and average evolution , , has representation

where are initial condition. It is easy to verify the conditions of the theorem. Prelimited processes are shown in Figures 1 and 2 for .

Figure 1: Diffusion approximation with epsilon = 0.1.

Figure 2: Diffusion approximation with epsilon = 0.01.

4. Conclusions

Weak convergence of semi-Markov processes in the diffusive approximation scheme on conditions on the local characteristics of semi-Markov process is studied in this paper.

Conflict of Interests

The author declares that there is no conflict of interests regarding the publication of this paper.

References

M.-H. Chang, Stochastic Control of Hereditary Systems and Applications, Springer, New York, NY, USA, 2008.

M. Pinsky and S. Karlin, An Introduction to Stochastic Modeling, Academic Press, San Diego, Calif, USA, 2010.

V. V. Anisimov, Switching Processes in Queueing Models, ISTE, London, UK, 2008.

N. Matloff, From Algorithms to Z-Scores: Probabilistic and Statistical Modeling in Computer Science, University of California, Berkeley, Calif, USA, 2013.

Y. I. Petunin, Application of Stochastic Processes in Biology and Medicine Theory, Naukova Dumka, Kyiv, Ukraine, 1981.

R. Cogburn, “The ergodic theory of Markov chains in random environments,” Wahrscheinlichkeitstheorie und Verwandte Gebiete, vol. 66, no. 1, pp. 109–128, 1984.

H. Pruscha, Statistical Analysis of Climate Series, Springer, Berlin, Germany, 2013.

D. P. Kroese and J. C. C. Chan, Statistical Modeling and Computation, Springer, New York, NY, USA, 2014.

S. N. Ethier and T. G. Kurtz, Markov Processes: Characterization and Convergence, Wiley, New York, NY, USA, 1986.

M. N. Sviridenko, About Semi-Markov Process Family Convergence to the Markov Process, VINITI, Moscow, Russia, 1986.

V. S. Koroliuk and N. Limnios, Stochastic Systems in Merging Phase Space, World Scientific, Singapore, 2005.

V. S. Koroliuk and N. Limnios, “First integrals in the diffusion approximation scheme,” Applied Mathematics Letters, vol. 21, no. 3, pp. 227–231, 2008.

V. S. Koroliuk, N. Limnios, and I. V. Samoilenko, “Independent increments and Semi-Markov switching—towards application and reliability,” in Advances in Degradation Models, pp. 105–111, 2009.

Y. Kozachenko, A. Olenko, and O. Polosmak, “Uniform convergence of compactly supported wavelet expansions of gaussian random processes,” Communications in Statistics—Theory and Methods, vol. 43, no. 10-12, pp. 2549–2562, 2014.

Y. Kozachenko, A. Olenko, and O. Polosmak, “On convergence of general wavelet decompositions of nonstationary stochastic processes,” Electronic Journal of Probability, vol. 18, article 69, 21 pages, 2013.

A. K. Alechkov, “Linear systems with poisson impulse actions stability,” in Physics, Technical, Chemistry and Geology Sciences, no. 6, pp. 75–77, Nauka, Kazan, Russia, 1990.

V. V. Anisimov, “Switching processes,” Cybernetic and System Analysis, no. 4, pp. 590–595, 1977.

P. Billingsley, Convergence of Probability Measures, Nauka, Moscow, Russia, 1977.

V. Y. Korolev and E. V. Kossova, “On limit distributions of randomly indexed multidimensional random sequences with an operator normalization,” Journal of Mathematical Sciences, vol. 72, no. 1, pp. 2915–2929, 1994.

V. V. Anisimov, “Averaging in markov models with fast semi-markov switches and applications,” Communications in Statistics—Theory and Methods, vol. 33, no. 3, pp. 517–531, 2004.

D. W. Stroock and S. R. S. Varadhan, Multidimensional Diffusion Processes, Springer, Berlin, Germany, 1979.

A. Yurachkivsky, “A criterion for relative compactness of a sequence of measure-valued random processes,” Acta Applicandae Mathematicae, vol. 79, no. 1, pp. 157–164, 2003.

L. Wang, “Strong law of large number for branching Hunt processes,” Acta Mathematica Sinica (English Series), vol. 31, no. 7, pp. 1189–1202, 2015.