In an Energy Harvesting system (EHS) the gamma process is used to model the electromagnetic energy received from radiofrequency (RF) radiation. The stochastic characterization of the harvested energy as a continuous-time stochastic process, namely, gamma process, is obtained from the Nakagami-m fading model, which describes the signal reception in a large amount of types of radiofrequency channels. Using the gamma process, some performance measures of the EHS system are obtained. Also, a transmission policy subject to different fading conditions is considered.
Gobierno de Extremadura, SpainIB18073European UnionMinisterio de Economía y Competitividad, SpainMTM2015-63978-PGobierno de Extremadura, ERDF and SferaOneGlobalEnergy AA-16-0124-2Ministerio de Economía y Competitividad, SpainTEC2017-85376-C2-X-RMinisterio de Educación, Cultura y DeporteFPU 00022/151. Introduction
The energy present in the environment, from sources as wind, solar energy, vibration, and electromagnetic radiofrequency (RF), can be harvested to power systems as low and ultralow power electronics and sensor networks [1]. Nowadays, Energy Harvesting Systems (EHS) are emerging as a promising technology for charging batteries used to supply ultra low power micro controllers, sensors, and wearable systems [2].
In an EHS, the energy is incoming from an exogenous source and is managed using two points of view
Harvest-store-use (HSU) where a battery stores the harvested energy before its future use. It requires an energy storage device or battery along with an appropriate management of the stored energy.
Harvest-use (HU) where the harvested energy is not stored and it is directly consumed.
Many works in the literature deal with the HSU architectures due to their interest in commercial applications. Although HU architecture literature is not very common, it is a suitable technology for limited battery systems. For a HSU system, two approaches have been developed taking into account the capacity of storage of the battery: infinite and finite capacity. Assuming infinite capacity means that the harvested energy can always be stored in the battery. This infinity assumption is valid for devices with large storage capacity compared to the incoming energy [3]. On the other hand, for a device with finite capacity, the harvested energy can be stored up to a limit. Beyond this limit, incoming energy cannot be stored and would be lost [4].
From the system theoretical perspective, the harvested energy can be modeled as a deterministic or a stochastic process. In a deterministic model, the incoming energy and its fluctuation are known in advance. These models are suitable for energy sources with predictable or with low fluctuation power sources. For example, assuming no cloud coverage, the sun can be modeled as a deterministic source of energy.
In a RF energy harvesting system, the energy is captured from the electromagnetic spectrum, from sources as radio FM, wireless radio (for example, Wi-Fi communication systems, mobile communications systems), TV broadcasting, or cognitive wireless sensor systems [5, 6]. One of the advantages of the RF harvesting is that the energy is ubiquitous and permanently available; in contrast, energy levels are low, except in the surroundings of the transmitter, because the power of the electromagnetic wave is in inverse proportion to the square of the distance to the transmitter [7]. Other kinds of ambient sources for harvesting as mechanical, thermal, or acoustics are nor ubiquitous but with levels of energy greater than electromagnetic in many cases [8].
In practice, the amount of energy that can be harvested from the environment is generally a random quantity [9]. For example, when RF harvested energy is used, the harvested energy is randomly distributed since it depends on the channel fading [10]. Channel fading is a random adverse phenomenon that affects the signal and energy reception due to multipath and shadowing. Some authors have characterized the RF power received by an energy harvester node assuming a specific distribution for the fading. For example, if the fading follows a Rayleigh distribution and assuming Gamma shadowing, and the RF received power a the antenna can be modelled using a sum of gamma distributions [11].
In this paper, we focus on the distribution probability for the energy harvested. In the literature, the stochastic models used to describe the energy harvested by the system include Poisson processes [12], Markov models [13], or compound Poisson processes [14, 15].
For a compound Poisson process, energy arrivals occur at random times (following a Poisson process) and in random amounts. Using a compound Poisson process model, the total harvested energy at time t can be expressed as (1)Yt=∑i=1NtDi,where N(t) represents the number of energy arrivals at time t and Di the harvested energy at the i-th arrival. Under the HSU architecture, to characterize the storage model in the battery, some authors use the so-called compound Poisson dam storage process [14, 15]. So, the energy stored in the battery at time t is given by(2)Xt=X0+∑i=0NtDi-∫0tpXsds,where ∫0tp(X(s))ds represents the total energy expenditure until time t being p(·) the power delivered. In the case of a finite capacity battery EK (EK<∞), expression (2) incorporates a process Z(t) (Z(0)=0) called reflection process, that it is null at zero, nondecreasing, continuous almost everywhere as follows:(3)Xt=X0+∑i=0NtDi-∫0tpXsds-Zt.This reflection process ensures that the storage process does not exceed the threshold EK for any energy arrival, (4)∫R+EK-XsdZs.These stochastic models assume a discrete arrival scheme for the incoming energy (more discrete models of energy arrival can be found in [3, 12]). However, energy harvesting devices receive their energy from external nondiscrete fluctuating sources (such as radio waves) and a continuous model would be a better model when these sources are used. Despite this fact, there are very limited results for the energy harvesting systems with continuous energy arrival except from a few papers such as [16, 17].
Considering a continuous scheme for the energy arrival, in this paper we propose a stochastic process to model the energy harvested by an RF harvesting system. This stochastic process is the gamma process. The reason to choose this process is based on electromagnetic propagation statistical models and its use is justified in the paper. When the electromagnetic RF channel is dominated by nonline-of-sight (LOS) propagation, the energy stored in the battery can be modeled accurately by a gamma process.
Before defining a gamma process, the definition of gamma distribution is first recalled. We say that a random variable X follows a gamma distribution with parameters (α,β) if its probability density function is given by(5)fXx=βαΓαe-βxxα-1,x>0,where Γ(α) is the gamma function given by(6)Γα=∫0∞xα-1e-αxdx.In mathematical terms, an homogeneous gamma process with shape parameter α and scale parameter β is a continuous-time stochastic process X(t),t≥0 with the following properties:
P(X(0)=0)=1.
Increments X(t+s)-X(t) are independent for all t and s.
The increments X(s+t)-X(s) follow a gamma distribution with parameters αt and β.
A gamma process is a pure-jump increasing Lévy process mainly used to model the deterioration of a system over the time [18]. Other examples of the application of gamma processes are the theory of water storage by dams and the risk theory [19]. The gamma process can be thought as a compound Poisson process in which the Poisson rate tends to infinity while the sizes of the increments tend to zero in proportion [20]. Although the compound Poisson process has been used to model the harvested energy process, as far as the authors are concerned, the gamma process has not been used to model the harvested energy. An advantage of using this gamma process in the stochastic modeling is that the required mathematical calculations are relatively straightforward. We again emphasize that the harvested energy process is continuous rather than slotted [21].
The general framework of this paper is the following. The use of the gamma process to model the harvested energy is justified. Afterwards, this process models the harvested energy by an EHS. This EHS contains an antenna that gathers energy from the environment, a rectifier, and a battery with finite capacity to store the harvested energy. Furthermore, a device is powered by the battery. Due to the finite capacity of the battery, energy may overflow without being utilized and hence is wasted. To model the energy harvested by the system, a gamma process is used. The battery delivers to the device a deterministic quantity of energy at certain instants of time that we call feeding times. Denoting by τ1,τ2,… the successive feeding times, we assume a uniform scheduling policy for the feeding times, that is, τi+1-τi=T>0 for each i=1,2,….
Some constraints are imposed to this system.
The energy stored in the battery at time t, EB(t), is limited by the battery capacity EK (that is, EB(t)≤EK,∀t).
The energy drawn from the battery can not exceed the energy stored in the battery (Energy Casualty).
When the system detects that its stored energy is going to drop below a certain threshold, the feeding process to the device stops. This threshold corresponds to the minimum energy reserve of the battery that can not be consumed. Denoting by EM this threshold, the stored energy in the battery at time t fulfills EM≤EB(t)≤EK for all t.
Under this general framework, a transmission policy is implemented. Renewal process theory is used to analyze the optimal transmission policy.
The objectives of this paper and its main contributions are the following.
Firstly, the use of the gamma process as a probabilistic tool to model the energy harvested by a RF harvesting system is justified. Since the gamma process is a continuous stochastic process, the continuous scheme for the energy arrival in EHS system is extended. Up to our knowledge, there are not works in the literature that deal with the use of the gamma process to model the harvested energy. It is, therefore, the main novelty and contribution of this paper.
Secondly, to establish an optimal transmission policy to optimize the functioning of the RF harvesting system. For that, probabilistic efficiency measures are obtained. Another novelty of the paper is the approach used to deal with the transmission policy. In this work, renewal techniques are used to find the optimal transmission policy, in particular, the renewal-reward theorem. Although the renewal techniques are not new in the harvesting system literature [22, 23], the use of the renewal reward theorem to achieve a transmission policy is not a common practice in energy harvesting system literature (except some particular cases as [24]).
To obtain these objectives, the paper is structured as follows. In Section 2, the stochastic process used to model the harvested energy is described and its use is justified. Section 3 describes the main assumptions of the system functioning. Sections 4 and 5 obtain probabilistic efficiency measures related to the system functioning to analyze the optimal transmission policy for this system. Section 6 shows some numerical examples associated with the system and finally Section 7 concludes.
2. Harvested Energy Model as a Gamma Process
In this section, we shall analyze the gamma process as a feasible tool to model the energy harvested by an EHS located in a RF fading channel environment. To obtain a first practical confirmation of this hypothesis, the storage of the energy received by an antenna in a Rayleigh fading environment has been simulated using the Matlab Communication System Toolbox™. The channel is modeled with the command channel = rayleighchan (Ts, FD) with Ts the sampling period equals to 100μs and FD the maximum Doppler shift of 15 Hz that corresponds to a frequency-flat Rayleigh fading channel. We establish a mean received power at antenna output of 80μW. The instantaneous received power is harvested by a RF rectifier with no efficiency loss obtaining the energy harvested energy at time t as (7)EHt=∫0tPrτdτ,where Pr(τ) denotes the instantaneous received power at time τ.
In Figure 1, the simulated received power and the harvested energy by the system in the first 4s are represented. This harvested energy can be easily interpreted as the realization of an increasing stochastic process. In particular, we shall show that the harvested energy can be modeled by a gamma process. To validate this assumption, we have performed goodness-of-fit tests to compare the distribution of the sampling increments EH(iT)-EH((i-1)T) for different values of T with a gamma distribution of parameters αT and β being α-1=35ms and β-1=2.8μJ. These statistical goodness-of-fit tests characterize the discrepancy between the simulated harvested energy and the expected values under a theoretical gamma distribution [25]. The Kolmogorov-Smirnov test is used to validate the gamma distribution of the increments. The p-values of the test are represented in Figure 2. As we can see, Figure 2 shows how well the gamma distribution fits the observed data for T≥140μs (approximately 4 times the value of α-1 or 2 times the value of the inverse of the maximum Doppler shift). In general, if the increments of time are large compared to the length of the fading, we can consider that the harvested and stored energy can be modeled by a gamma process. In practice T0, the value of the increment of T from which the simulated process fits as a gamma process is proportional to the correlation length of the fading. In any case, the length of the fading is tiny enough (usually of order of milliseconds) compared to the order of magnitude of the times in which the EHS supplies energy to other devices. Consequently, considering fine and coarse time increments, harvested and stored energy is well modeled by a gamma process except for very fine time requirements.
Received power and energy stored by a battery in a simulation of a Rayleigh fading channel environment.
P-values of the Kolmogorov-Smirnov test for the increments in the energy stored in a battery by channel simulation.
Nakagami-m fading model is a very general model which fits a lot of different empirical measurements for signal reception levels in different multipaths and multisignal reception. This distribution includes and generalizes Rayleigh fading (as the distribution used in the previous example) used for nonline-of-sight propagation models (NLOS). It also approximates well other set of channel variations dominated by line-of-sight (LOS) propagation as Rician fading. The density function of the Nakagami-m model with parameters m and Ω is(8)fx=2mΩmx2m-1Γmexp-mx2Ω,for x≥0, where Γ(m) is the gamma function given by (6). The Nakagami-m distribution has two parameters, a shape parameter m≥1/2 and a second parameter Ω>0 controlling the spread. It is well known that if Y follows a Nakagami-m distribution with parameters m and Ω, Y2 follows a gamma distribution with parameters (α,β)=(m,Ω/m) [26].
Since the received power is proportional to the square of the signal amplitude, assuming a signal amplitude modeled as a Nakagami-m distribution, the received power Pr at time t is gamma distributed with parameters (αP,βP) with βP=αP/Pr¯ being Pr¯ the mean received power.
Assuming that there is not efficiency loss, the harvested energy by the EHS at time t is given by(9)EHt=∫0tPrτdτ,where Pr(τ) corresponds to the received power at time τ. In the sequel of this work, we denote by EH(t),t≥0 the harvested energy process.
2.1. EH(t),t≥0 as a Gamma Process
Let t1,t2,…,tn be a partition of Pr(τ) in [0,t] as follows: (10)n=tΔw,ti=i-12Δw,where · denotes the floor function. Considering this partition we approximate EH(t) as(11)EHt=∫0tPrτdτ≅∑i=1nPrtiΔw.Since Pr(ti) follows a gamma distribution with parameters αP and βP, then the approximation of EH(t) given by (11) also follows a gamma distribution with parameters αt and β with (12)α=αPΔw,β=βPΔwsince the sum of independent random and gamma distributed variables with the same scale parameter is also gamma distributed (gamma additivity property). Notice that (13)Pr¯=αβ=αPβP.Obviously, in this approximation, the parameter α of the gamma process depends on the length Δω of discretization of (11), which looks inconsistent. Nevertheless, neither small Δω nor large Δω can be used. Firstly, large values of Δω might invalidate the Simpson rule in (11). Also, small values of Δω might imply that Pr(ti) and Pr(ti+1) are correlated and the assumption of independence in the gamma additivity property is violated. For small intervals of time, the fading of the channel is highly correlated; otherwise, the independence assumption can be assumed as true. The exact computation of α is out of the scope of this paper. In general, α-1 is inversely proportional to the shape factor m of the Nakagami-m fading channel and directly proportional to the correlation length of the fading (because the length of the fading is strongly related to the best Δw). In the example shown in Figures 1 and 2, we obtained the values of Pr¯=α/β=80μW, that is, equal to the power reception provided in the simulation and α=(35ms)-1≃28.6Hz which is approximately the double of the maximum Doppler frequency shift. Since the fading time variations are very fast compared to the orders of magnitude of time used in the functioning of the harvesting system, we can consider that the discrete approximation in (11) can be used in continuous mode without loss of accuracy. In fact, for the example given in Figure 2, we showed that, for intervals length bigger than 140ms, the hypothesis of gamma process fits well.
For the same received power at antenna output, in a Rayleigh Channel environment, simulations have been performed to obtain an empiric relation between the parameters α and β of the gamma process (used to model the harvested energy) and the fading length. In the case of the Rayleigh Channel simulation provided by Matlab, the Doppler frequency shift, FD, is the parameter which is inversely proportional to the fading length. Figure 3 shows the α and β parameters estimated for the gamma process versus the Doppler shift varying from 2 to 100 Hz. A total of 5000 simulations of 10s of time length have been performed for each Doppler shift frequency. In Figure 3, we can see that α/β is actually equal to the mean power received (80μW) independently of the Doppler shift and the α parameter varies linearly with the Doppler frequency shift, approximately α=1.85FD.
Relationship between gamma process parameters and Doppler frequency shift in a Rayleigh channel environment.
Therefore, for a Nakagami-m or a Rayleigh RF channel, the process EH(t),t≥0 is modeled using an homogeneous gamma process that fulfills the following properties:
P(EH(0)=0)=1.
Increments EH(T+s)-EH(T) are independent for all T and s.
The harvested energy in an interval of amplitude T, EH(s+T)-EH(s), follows a gamma distribution with parameters αT and β with density(14)fEHTx=βαTΓαTxαT-1exp-βx,
for x>0 where we recall that Pr¯=α/β corresponds to the mean received power.
The mean level of harvested energy and the variance in an time interval of amplitude T is given by(15)EEHT=Pr¯T,varEHT=α-1TPr¯2.In the remainder of this work, the expectation operator E(·) is used to avoid confusion between energy and expectation. So, we have a simplified model for the harvesting process using a continuous cumulative stochastic process.
3. System Description
We assume a harvesting system which contains an antenna, a RF rectifier and a battery to store the harvested energy. The battery powers a device. The system functioning is described as follows:
We suppose that no efficiency loss is present in the RF rectifier and the battery.
The fading of the channel is modeled using a Nakagami-m distribution with density given in (8).
Let EH(t) be the harvested energy at the output of the rectifier at time t, and EH(t),t≥0 follows an homogeneous gamma process with parameters α and β, where the ratio α/β=Pr¯ corresponds to the mean received power.
Let EB(t) be the stored energy in the battery at time t with EB(0)=E0, where E0 denotes the initial stored energy. For operational reasons, the stored energy in the battery must always exceed a threshold EM.
We assume that the capacity of the battery is finite and equals to EK, hence(16)EM≤EBt≤EK,∀t.
The battery wear is assumed to be much slower than the time scale of the problem.
The device can be in two modes: ON and OFF depending on its feeding process. In ON mode, the device is operational and powered by the battery. In OFF mode the device is turned off and the feeding process of the device stops.
Feeding times. At certain instantaneous times named feeding times the device consumes EC units of energy performing, for example, an instantaneous measurement. Let T0,T1,…,Tn be the feeding times. We consider a block-based policy for the feeding times where they are scheduled periodically during an ON state with Ti-Ti-1=T>0 for i=1,2,…. We assume a large enough value of T to consider that the gamma process model for the harvested energy is satisfied.
The standby consumption of the device is negligible compared to the periodic consumption.
Device turn on. At the time of the turn on, the device needs to perform transitory tasks that consume Eon energy units. The turn on instant is also considered a feeding time. At short, there is an instantaneous requirement of energy of Eon+EC units in the turn on of the device. We assume that(17)E0≥EC+Eon+EM,
i.e., the device turn on is ensured.
Let EB(Tn-) be the stored energy in the battery right before the feeding time Tn for n=1,2,…
If EB(Tn-)-EC≥EM, then the device is properly powered and it is called a feasible feeding task.
If EB(Tn-)-EC<EM, the feeding of the device starts but, when the system detects that the stored energy is going to drop below EM, the feeding process is stopped. In this case, the device is not properly powered and it is called an unfeasible feeding task. Furthermore, there is a waste of EB(Tn-)-EM energy units. Right after an unfeasible feeding task, the energy stored in the battery is equal to the threshold EM and the device enters in OFF mode until the energy stored in the battery exceeds again the level E0 (see Figure 4).
Denoting by EB(Tn+) the energy stored in the battery right after Tn, we get that (18)EBTn+=maxEBTn--EC,EM.
Notice that condition EM=0 implies that as long as there is energy in the battery, the device remains in ON mode.
Evolution of the energy stored in the battery due to the operation of the EHS. Blue arrows correspond to feasible feeding tasks. Red arrows correspond to unfeasible feeding tasks.
Figure 4 shows a realization of the process EB(t),t≥0 that represents the energy stored in the battery. Initially, the energy stored in the battery is equal to E0 units and the device consumes Eon+EC energy units. Furthermore, the device consumes EC units of energy each T units of time whenever the device is in ON mode. In red color, an unfeasible feeding task is shown since the energy stored in the battery was not enough to feed the device fulfilling the energy constraint given in (16). Right after an unfeasible feeding task, the OFF period starts and it remains in this mode until the energy stored in the battery exceeds the threshold E0.
At the activation of the device, its consumption is equal to Eon+EC. Assuming an activation at t=0, we get that(19)EB0+=E0-Eon-EC.To fulfill the constraint given in (16), E0 has to verify (20)EM+Eon+EC<E0.This lower limit is imposed by (17). Whenever (16) is fulfilled in [0,t], the total energy consumed by the device due to the feeding tasks at time t, ED(t), is equal to (21)EDt=tT+1EC,and the total energy stored in the battery at time t can be expressed as (22)EBt=E0-Eon+EHt-EDt,with expectation(23)EEBt=E0-Eon+Pr¯t-tT+1EC.Let EH(i)(t),t≥0 be replicas of the process EH(t),t≥0 for i=1,2,…. Starting from t=0, the system evolves as follows. For 0≤t<T, we get that (24)EBt=EH1t+EB0+,0≤t<T.The harvested energy in [0,T) is EH(1)(T) with density function given by (14). Right before T, the energy stored in the battery is equal to(25)EBT-=minEH1T+EB0+,EKwhere EB(0+) is given by (19) and EK denotes the battery capacity with EK>EM+EC. The overflow in (0,T) is produced when (26)EH1T+EB0+>EK,with probability given by (27)∫EK-EB0+∞fEHTxdx,where fEH(T)(x) is given by (14). At time T, if EB(T-)-EC>EM, the feeding task is performed properly and the device remains in ON mode. Otherwise, the feeding task is unfeasible and the device enters in OFF mode. Hence, the energy stored in the battery right after the feeding time T is given by(28)EBT+=maxEBT--EC,EM,where EB(T-) is given by (25).
Let Vi be the following event:(29)Vi=EBiT--EC>EM),i=1,2,…,that corresponds to a feasible feeding task at time iT. Given EB(T-)-EC≥M, next feeding time is scheduled at time 2T and the energy harvested in [T,2T) is given by EH(2)(2T)-EH(2)(T) that follows a gamma distribution with density shown in (14). Hence, right before 2T, the energy stored in the battery is given by(30)EB2T-=minEBT++EH22T-EH2T,EK1V1where 1 denotes the indicator function which equals 1 if the argument is true and 0 otherwise and V1 is given by (29). At time 2T, condition (31)EB2T--EC>EMcorresponds to a feasible feeding task. Otherwise, an unfeasible feeding task takes place consuming EB(2T-)-EM energy units. Hence, the energy stored in the battery right after 2T is given by (32)EB2T+=maxEB2T--EC,EM1V1,where V1 is given by (29).
In a general setting, we assume that the feeding tasks performed at times 0,T,2T,3T,…iT have been feasible. Then, right before feeding time (i+1)T, the energy stored in the battery is given by(33)EBi+1T-=minEBiT++EHi+1i+1T-EHi+1iT,EK1⋂j=1iVjand just after the feeding time, we get that the energy stored in the battery is equal to (34)EBi+1T+=maxEBi+1T--EC,EM1⋂j=1iVjAs before, in (33), the variable (35)EHi+1i+1T-EHi+1iTis gamma distributed with density given by (14).
4. Time to the First Unfeasible Feeding Task
After the turn on of the device and before the first unfeasible feeding task, the device is in ON mode. After an unfeasible feeding task, the device enters in OFF mode and it remains in this mode until the stored energy reaches again the level E0. Let Zon be the time from the turn on to the first unfeasible feeding task. Let nuf be the index of the first unfeasible feeding task, that is,(36)nuf=infi≥0,EBiT--EC<EM,then Zon=nufT.
Before computing the reliability function of Zon, we define the mixture random variable WA given by(37)WA=EHT+AEHT+A≤EKEKEHT+A>EKwith EK>A and where the density of EH(T) is shown in (14). The distribution of WA is given by(38)PWA<w=∫0w-AfEHTxdx,w<EKPWA=EK=∫w-A∞fEHTxdxPWA>w=0,w>EK.Notice that WA corresponds to the energy stored in the battery between two feeding times Ti-1 and Ti if the energy in the battery just after Ti-1 is equal to A (A<EK).
Let F¯Zon be the reliability function of Zon, that is, (39)F¯Zont=PZon≥t.Next, the analytical formulation of F¯Zon is obtained.
For 0≤t<T, (40)F¯Zont=1,
by the condition given in (17).
For T≤t<2T, we get that (41)F¯Zont=PEC+EM≤EH1T+EB0+≤EK+PEH1T+EB0+>EK=PEH1T+EB0+-EC≥EM=∫EM+Ec-EB0+∞fEHTudu,
where fEH(T) is given by (14). For T≤t<2T, F¯Zon(t) represents the probability of a feasible feeding time at time T.
For 2T≤t<3T, we get that (42)F¯Zont=PminEB2T-,EBT->EC+CM=PEB2T->EC+EM,EBT->EC+EM=∫EC+EMEKfWEB0+u1F¯Wu1-ECEC+EMdu1,
where fWEB(0+) and fWu1-EC denote the density of probability of WEB(0+) and Wu1-EC given in (37).
In a general setting, for iT≤t≤(i+1)T with i≥1, we get that for iT<t≤(i+1)T(43)F¯Zont=P(⋂j=1iEBjT->EM+EC)=∫EM+ECEKfWEB0+u1du1∫EC+EMEK∫EC+EMEK…∫EC+EMEK∏n=1i-1fWun-ECun+1dun+1,
where for n=1,2,…, fWun-EC denotes the density of the variable Wun-EC given in (37).
5. Renewal Process
As in previous sections, the device is switch on at time t=0 and the energy stored in the battery is equal to E0. The device remains in ON state until the first unfeasible feeding time (see Figure 4). After this unfeasible feeding time, the device enters in OFF mode and the system keeps harvesting energy until the energy stored in the battery exceeds the level E0, time in which the device again enters in ON mode. Let Zoff be the time in which the device is OFF. Next, we analyse the distribution of Zoff. By Assumption 10, at the time of the first unfeasible feeding time, that is, t=nufT, where nuf is given by (36), the energy stored in the battery is equal to (44)EBnufT+=EM.After this unfeasible feeding task, the device remains in OFF mode until the energy stored in the battery reaches the level E0. Then, Zoff follows the same distribution as σE0-EM, where σE0-EM denotes the first hitting time to the level E0-EM of an homogeneous gamma process. The distribution function of Zoff is given by(45)FZofft=FσE0-EMt=Γαt,E0-EMPr¯/αΓαt,t≥0,where Γ(αt) is given by (6) and Γ(αt,(E0-EM)Pr¯/α) denotes the incomplete gamma function given by (46)Γαt,E0-EMPr¯α=∫E0-EMPr¯/α∞zαt-1e-zdz,(see [27, 28] for more details). Although the exact distribution of FZoff(t) is given in (45), it is very difficult to compute in practice. However, some approximations to this distribution are given. A Birnbaum−Saunders (BS) distribution is used to approximate the distribution of the first hitting time in a gamma process [29]. So, we can approximate Zoff(t) by a BirnbaumSaunders (BS) distribution with parameters (47)α∗=1E0-EMPr¯/α,β∗=E0-EMαPr¯.Furthermore, if (48)E0-EMPr¯α≫E0-EMPr¯α,then the distribution of Zoff is approximated closely by the inverse Gaussian distribution with parameters (49)μ=E0-EMPr¯α2,λ=E0-EM2Pr¯2α3.Due to the jump discontinuities of the sample paths of a gamma process, the energy stored in the battery in the OFF period fulfills EB(Zoff)≥E0-EM; hence the overshoot (50)EBZon+Zoff-E0is positive almost surely. To avoid complicated mathematical technicalities, it seems realistic from a practical point of view to disregard the overshoot and consider that the energy stored in the battery right after the end of the OFF period of the device is equal to E0, that is, (51)EBZon+Zoff=E0.As a matter of fact, in most studies, the overshoot of the gamma process is not mentioned at all [30].
A goal of this paper is the optimization of the functioning of this system. The renewal process and its generalization (the quasirenewal process) are useful tools to analyze the optimal transmission policy for a system.
To optimize the transmission policy, a renewal argument is used. We recall that a renewal process is an arrival process in which the interarrival intervals are independent and identically distributed random variables. In this paper, a renewal cycle takes place every time that the OFF mode of the device ends. So, let R1,R2,… be the time between renewals, where Ri are independent and identically distributed variables with Ri≡dR and where R is given by (52)R=Zon+Zoffwith expectation (53)ER=EnufT+EZoff.
Let nf be the number of feasible feeding tasks in a renewal cycle; then (54)nf=nuf-1,where nuf is given by (36). Under the assumptions of the model (55)Pnf=0=0,since the initial consumption of the device is guaranteed. Following the previous results, we get that (56)Pnf=1=∫0EM+EC-EB0fEHTxdx,where fEH(T) is given in (14). In a general setting, for i≥1, we get that (57)Pnf=i=F¯Zoni-1T-F¯ZoniT,where F¯Zon is given by (43). It is easy to check that(58)Enf=∑i=1∞iF¯Zoni-1T-F¯ZoniT=∑i=0∞F¯ZoniT.Hence, the expected time to a renewal cycle can be expressed as(59)ER=EnufT+EZoff=Enf-1T+EZoff=T∑i=0∞F¯ZoniT-1+EZoff≃T∑i=1∞F¯ZoniT+E0-EMPr¯α2,where this approximation has been obtained using the inverse Gaussian distribution if (α)≫1 and where F¯Zon is given by (43). The expectation also can also be approximated by(60)ER=EnufT+EZoff≃T∑i=1∞F¯ZoniT+E0-EMPr¯α+12α,using the Birnbaum−Saunders distribution.
Next, we describe an optimal transmission policy for this EHS. By optimal, we mean the policy that maximizes an objective function. Renewal techniques are used to approach the search of the optimal transmission policy. Let R1,R2,…,Ri be the successive renewal cycles (as we explained before, a renewal cycle in this paper takes place every time the OFF mode of the device ends). Let C1,C2,…,Cn be the total of feasible tasks performed in a renewal cycle. Denoting by C(t) the total of feasible tasks up to time t and using the renewal-reward theorem, we get that (61)limt→∞Ctt=EC1ER1.Hence, the limit of the total of feasible tasks per unit time can be reduced to the behavior of this ratio in the first renewal cycle. To deal with the optimal transmission policy, the ratio(62)Tf-1=EnfERwhere ER and Enf are given by (59) and (58), respectively, is chosen as objective cost function. The optimal transmission policy corresponds to the value of T (the time between feeding times) that maximizes the expected number of feasible feeding tasks per unit time in a renewal cycle, that is,(63)supT>0EnfER.The analytic formulation of Tf-1 given in (63) is not straightforward since it involves multidimensional integrals as we can check in (58) and (59). Traditional quadrature methods to solve these multidimensional integrals are outperformed and the Monte Carlo method is chosen to analyze the optimization problem formulated in (63). Monte Carlo method is an adequate method when integrals are multidimensional [31].
Next section shows some numerical examples of the search of the optimal transmission policy using Monte Carlo method. For that, replicas of the first renewal cycle are simulated and the expected values given in (62) are numerically estimated using these simulations. Optimal values for the transmission policy are obtained by inspection considering these estimations.
6. Numerical Examples
We assume a battery with a finite capacity of EK=6 milijoules (mJ) and an energy threshold of EM=1mJ. This battery powers a device and we assume that its consumption is equal to EC=1mJ in each feasible feeding task. Due to the transitory effects, at the device turn on, it consumes Eon=3mJ. The initial stored energy in the battery is equal to E0=5.3mJ (see Figure 4 for a better understanding). We consider that the harvested energy comes from an RF channel with Nakagami m-fading and a mean power harvested equals to Pr¯=120μW.
The model used to describe the harvested energy is an homogeneous gamma process with parameters α and β=α/Pr¯. Parameter α depends on fading rate. In this numerical example, three different rates have been considered α-1=1s, α-1=5s, and α-1=10s. Notice that α-1 is related to the fading length, so the examples show a range of possibilities: from moderate fast fading to slow fading depending on α. A total of 50000 complete renewal cycles for each point have been performed to obtain the results.
In Figure 5, the expected number of feasible feedings per minute, Tf-1=E[nf]/E[R] is shown. For high values of T, almost all the feeding times are feasible since there is enough energy in the battery to feed the device. Instead, high values of T-1 cause a lot of unfeasible feeding tasks and, therefore, the repetitive switch off of the device. The maximum value of feasible feeding tasks per unit time corresponds to the optimal policy for the system operation and it is reached at T-1≃7min-1 (7 feeding times per minute), T-1≃6.5min-1, and T-1≃6min-1 according to the value of α-1. It is relevant that, for high values of α-1, the number of feasible feeding tasks decreases. So, for α-1=10s the maximum expected feasible feeding tasks per minute are equal to Tf-1=5.23tasks/min, for α-1=5s are Tf-1=5.88tasks/min, and for α-1=1s are Tf-1=7tasks/min. As one would hope, the expected number of feasible feeding tasks per unit time is closely related to the RF channel characteristics. In contrast, for low values of T (that is, large number of feeding times per unit time), slow fading channel may be less disadvantageous, as in the present case.
Expected number of feasible tasks per minute for several lengths of fading.
Figure 6 shows the energy lost per unit time (power lost) versus T-1. The lost power in the system is due to three factors: energy not stored in the battery due to its finite capacity (overflow), energy consumed in the device turn on and wasted energy due to the unfeasible feeding tasks. As we could expect, the minimum of the lost power is reached at the values described above (T-1≃[7,6.5,6](min-1)) with values of 3.33μW, 21.91μW, and 32.85μW, respectively. Notice that the power received at the antenna is 120μW consequently, and the efficiency of the system is 97.23%, 81.74%, and 72.63% for α-1=1s, α-1=5s, and α-1=10s, respectively.
Expected lost power (lost energy per unit time) at the EHS for several lengths of fading.
Another interesting measure is the ratio of unfeasible feeding tasks, calculated as (64)ru=T-1-Tf-1T-1;which is represented in Figure 7. In Figure 7, we can see that for small values of T-1 the ratio ru is reduced. As we expected, the lower α-1 (fast fading) the better ratio.
Ratio of unfeasible feeding tasks for several lengths of fading.
In general, fast fading channels (that correspond to small values of α-1) are more advantageous for harvesting systems since the storage battery fluctuations are much less susceptible to variations; i.e., the gamma process associated with the harvested energy presents a lower variance varEHt=Pr¯2t/α.
7. Conclusions and Further Works
An EHS system that consists of an antenna, a RF rectifier and a battery used to store harvested energy and a device powered by the battery, is considered in this paper.
The harvested energy of ambient RF energy in a NLOS fading environment is modeled using a gamma process. As far as the authors are concerned, this stochastic process is new to the area of energy harvesting. Due to the properties of the gamma process, the mathematical model of the whole system is tractable and some probabilistic quantities are obtained. These quantities are useful for the construction and analysis of a transmission policy of this EHS. Since the functioning of the system can be described using renewal arguments, the optimal scheduling policy is numerically analyzed.
As we showed in the examples, the fading of the signal causes losses in the efficiency of the harvesting system but this loss can be reduced to reasonable limits in fast fading environments. Fast fading channels are more advantageous for harvesting systems since the storage battery are much less susceptible to variations rather than slow fading channels.
In this paper, we have considered a perfect and ideal energy storage. It means that the battery saves in a proper way the energy that it receives. However, energy storage inefficiency can be developed in further works. For example, an inefficiency which occurs at the time of the energy storage can be analyzed. Also, the energy demand of the device has been modeled as a ideal instantaneous process. Further works could consider a continuous demand of energy.
We have also assumed in this paper an uniform transmission policy that schedules the feeding times uniformly. However, a scheduling policy could be considered in future works where the future feeding times are planned taking into account the stored energy in previous feeding times.
Data Availability
No data were used to support this study.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work is supported by the Gobierno de Extremadura, Spain (Project IB18073), and European Union (European Regional Development Funds, ERDF). For the first author, this research was also supported by Ministerio de Economía y Competitividad, Spain (Project MTM2015-63978-P). For the second and third author, this research was supported by Gobierno de Extremadura, ERDF and SferaOne (Project GlobalEnergy AA-16-0124-2), and by Ministerio de Economía y Competitividad, Spain (Project TEC2017-85376-C2-X-R). For the third author this research was supported also by Spanish Ministerio de Educación, Cultura y Deporte (FPU 00022/15).
DudinS. A.LeeM. H.Analysis of single-server queue with phase-type service and energy harvesting2016201616814274310.1155/2016/8142743MR3476182ShakirM. Z.DobreO. A.ImranM. A.PapathanassiouA.ZhangZ.VasilakosA. V.WangH.HaradaH.Emerging applications, services, and engineering for cellular cognitive systems: Part II [Guest Editorial]201553766682-s2.0-8493796221110.1109/MCOM.2015.7158267OzelO.UlukusS.Achieving AWGN capacity under stochastic energy harvesting201258106471648310.1109/TIT.2012.2204389MR2982673TutuncuogluK.YenerA.Optimum transmission policies for battery limited energy harvesting nodes2012113118011892-s2.0-8485833261510.1109/TWC.2012.012412.110805LuX.NiyatoD.KimD. I.Wireless networks with rf energy harvesting: a contemporary survey201517275778910.1109/comst.2014.23689992-s2.0-84927658290PiñuelaM.MitchesonP. D.LucyszynS.Ambient RF energy harvesting in urban and semi-urban environments2013617271527262-s2.0-8489668976910.1109/TMTT.2013.2262687BalanisC. A.2012John Wiley & SongsYildizF.Potential ambient energy-harvesting sources and techniques2009351404810.21061/jots.v35i1.a.6KuM.-L.LiW.ChenY.Ray LiuK. J.Advances in energy harvesting communications: past, present, and future challenges20161821384141210.1109/COMST.2015.24973242-s2.0-84971524643OzelO.TutuncuogluK.YangJ.UlukusS.YenerA.Transmission with energy harvesting nodes in fading wireless channels: optimal policies20112981732174310.1109/jsac.2011.1109212-s2.0-80052040201OliveiraD.OliveiraR.Characterization of energy availability in RF energy harvesting networks201620169814274310.1155/2016/7849175YangJ.WuX.WuJ.Optimal online sensing scheduling for energy harvesting sensors with infinite and finite batteries2016345157815892-s2.0-8497638526910.1109/JSAC.2016.2551561KuM.-L.ChenY.LiuK. J. R.Data-driven stochastic models and policies for energy harvesting sensor communications2015338150515202-s2.0-84937774509KhuzaniM. B.MitranP.On online energy harvesting in multiple access communication systems20146031883189810.1109/TIT.2013.2295606MR3168443MotlaghM. S.KhuzaniM. B.MitranP.On lossy joint source-channel coding in energy harvesting communication systems201563114433444710.1109/TCOMM.2015.24720122-s2.0-84959536608DevillersB.GündüzD.A general framework for the optimization of energy harvesting communication systems with battery imperfections201214213013910.1109/JCN.2012.62530612-s2.0-85008530768RezaeeM.MirmohseniM.ArefM. R.Energy harvesting systems with continuous energy and data arrivals: the optimal offline and heuristic online algorithms201634123739375310.1109/JSAC.2016.26213552-s2.0-85009729271LiuZ.MaX.YangJ.ZhaoY.Optimal condition-based maintenance policy with delay for systems subject to competing failures under continuous monitoring2014201410829597van NoortwijkJ. M.A survey of the application of gamma processes in maintenance200994122110.1016/j.ress.2007.03.0192-s2.0-52149085018LawlessJ.CrowderM.Covariates and random effects in a gamma process model with application to degradation and failure200410321322710.1023/B:LIDA.0000036389.14073.ddMR2086957Zbl1054.621222-s2.0-4043052862MichelusiN.StamatiouK.ZorziM.Transmission policies for energy harvesting sensors with time-correlated energy supply2013617298830012-s2.0-8488118193010.1109/TCOMM.2013.052013.120565SeyediA.SikdarB.Energy efficient transmission strategies for body sensor networks with energy harvesting2010587211621262-s2.0-7795483333710.1109/TCOMM.2010.07.080544GuruacharyaS.HossainE.Self-sustainability of energy harvesting systems: concept, analysis, and design20182117519210.1109/TGCN.2017.2773565BakninaA.UlukusS.Online scheduling for energy harvesting channels with processing costs2017132473240010.1109/TGCN.2017.2713774Grall-MaësE.Use of the Kolmogorov-Smirnov test for gamma process201222666246342-s2.0-8487393476010.1177/1748006X12462522DuK.SwamyM. N.2010Cambridge, UKCambridge University Press10.1017/CBO9780511841453HuynhK. T.BarrosA.BérenguerC.CastroI. T.A periodic inspection and replacement policy for systems subject to competing failure modes due to degradation and traumatic events20119644975082-s2.0-7925161435010.1016/j.ress.2010.12.018CaballéN. C.CastroI. T.Analysis of the reliability and the maintenance cost for finite life cycle systems subject to degradation and shocks201752731746MR3716320ParkC.PadgettW. J.Accelerated degradation models for failure based on geometric Brownian motion and gamma processes200511451152710.1007/s10985-005-5237-8MR2213502Zbl1120.620882-s2.0-27844522713NicolaiR. P.FrenkJ. B. G.DekkerR.Modelling and optimizing imperfect maintenance of coatings on steel structures20093132342442-s2.0-6134916551110.1016/j.strusafe.2008.06.015DumW. L.ShultisJ.2011Elsevier