Energy-Efficient Incentives Resource Allocation Scheme in Cooperative Communication System

Appropriate resource allocation has great significance to enhance the energy efficiency (EE) for cooperative communication system. The objective is to allocate the resource to maximize the energy efficiency in single-cell multiuser cooperative communication system. We formulate this problem as subcarrier-based resource allocation and solve it with path planning in graph theory. A twolevel neural network model is designed, in which the users and subcarrier are defined as network nodes. And then we propose an improved intelligent water drops algorithm combined with Genetic Algorithm; boundary condition and initialization rules of path soil quantity are put forward.The simulation results demonstrate that the proposed resource allocation scheme can effectively improve the energy efficiency and enhance QoS performance.


Introduction
The rapid energy consumption due to the demands of mobile communication services has become a subject of global interests from environment perspective.On one hand, because of its slow development and limited capacity, battery technology becomes the bottleneck of limiting the development of the portable terminals [1]; on the other hand, enormous energy consumption of the communication industry indirectly leads to the greenhouse gas emission and increases the operators' operating costs.Statistics show that, in 2009, the power consumption of three service providers in China was 28.9 billion degrees, which equals 4.41 million tons of coal burning.By 2014, the energy consumption had been up to 6.71 million tons, with a 52% increase in 5 years [2,3].Compared to other industries, it is essential for the communication industry to reduce energy consumption.Meanwhile, as important support for social informatization, there is a very broad prospect for the communication industry to promote energy conservation in the society information industry.Therefore, designing a high energy-efficient communication system has become a consensus of the communication industry.
Cooperative communication [4,5] is defined as follows: in a cell, the adjacent devices with single antenna create a virtual MIMO system by sharing their antennas with each other [6,7] to achieve the goal of overcoming the multipath fading and gaining the benefit of multiantenna space diversity.In cooperative communication system, a reasonable resource allocation scheme has great significance in improving the spectral efficiency and reducing the energy consumption.The traditional design of cooperative communication system mainly focuses on the improvement of system capacity, outage probability, spectral efficiency, and other performances.With the scholars' attention to the energy consumption of communication industry and the concept of green communication, the energy efficiency of cooperative communication system is gaining widespread concern.Wong et al. [8] studied the network-level resource scheduling scheme in cooperative communication system and proposed a cooperative concept to obtain the higher energy efficiency; at the same time they also designed high energy-efficient network architecture.A resource allocation scheme on game theory is established; it is proven that the cooperation between users can effectively improve the energy efficiency of the system [9].In [10],  an algorithm is proposed to select the optimal relay in a single-relay cooperation system.Compared with the fixed cooperation method, the energy consumption is significantly reduced.The wireless sensor networks (WSNs) with energy harvesting and cooperative communication were studied in [11], and an energy-efficient scheduling strategy is proposed; the optimal scheduling problem is solved by using a Markov Decision Process (MDP).In [12], the process of collaboration was divided into two time slots.An algorithm of relay selection and power allocation is proposed for the minimum BER and maximum system capacity, respectively.However, these studies have achieved the purpose of improving the energy efficiency from the perspective of energy consumption and have not analyzed the energy efficiency in the form of quantitative indicators.QoS in the actual scenario is not considered, especially the demands of high transmission rate.
In this paper, we consider a single-cell multiuser cooperative communication system.To meet the demands of QoS performance, a two-level neural network model based on intelligent water drops (IWDs) algorithm is proposed to solve the problem of resource allocation with optimal energy efficiency.And then, the IWDs algorithm combined with Genetic Algorithm (GA) is improved to allocate resources flexibly and enhance performance.
This paper is organized as follows.Section 2 introduces the system model as well as the function of the proposed optimal problem.In Section 3, a novel algorithm is proposed.After that, the optimal energy-efficient resource allocation scheme is presented in Section 4. In Section 5, numerical results are depicted.Finally, Section 6 concludes the paper.

System Model and Problem Formulation
In this section, the proposed system model is presented, followed by the optimization problem.

System Model.
We consider an uplink single-cell multiuser cooperative communication scenario as shown in Figure 1, and the radius is 600 meters.It consists of source node , relay node , and destination node .In particular, the source node is  users with call requests, and  is the relay node that participates in the cooperative communication, and the destination node is the base station (BS).Orthogonal Frequency Division Multiple Access (OFDMA) is the multiple access scheme, and the available bandwidth  is divided into , in which the subcarriers are orthogonal to each other.It is assumed that the relay node has perfect channel state information (CSI).Further, the channels are considered as large-scale and small-scale fading.That is, large-scale fading is defined as path loss and small-scale fading is Rayleigh fading, respectively.Moreover, the forwarding mode is Decodeand-Forward (DF), and the relay network is operated in halfduplex mode.

Problem Formulation.
Assume that the channel states between any two terminals (  ,   , ) are independent of each other.ℎ   (,  ∈ {  ,   , }) indicates the channel fading between the device  and .The channel fading between the nodes can be given by [13]  (      ℎ where denote the CSI on the subcarrier , from the user   to the destination node , from the user   to the relay   , and from the relay   to the destination node , respectively.  (,  ∈ {  ,   , }) represents the distance between the device  and .(⋅) is the average operator, and  ∈ [3,5] is the channel fading factor.
The energy efficiency is defined as follows [14]: where  represents the total transfer rate and  tot denotes the total energy consumption.The transmission procedures of cooperative communication system are divided into two time slots [15]: the first is the broadcast slots, during which the source node  broadcasts the information to the relay node  and the destination node ; the second is the forwarding slot, during which the relay node  processes the received signal and forwards it to the destination node .In the case of dynamic allocation of transmission time slot, it is normalized.Particularly,  represents the transmission time in the broadcast slot, and (1−) denotes the time of the relay forwarding slot.Due to the different environments in which three terminals are located, the channel fadings are independent of each other in two different time slots.Two hops of information (broadcasting and forwarding) occupy different time slots, respectively.Therefore, in two hops, we can use the same subcarriers without considering the interference between them, but the system performance may be limited.So, the subcarriers should be allocated independently in two time slots, which involves the subcarrier pair matching and allocation issue.
The distribution coefficient of subcarrier pairs   , ∈ {0, 1} is introduced firstly.  , = 1 represents the case where subcarrier  (1 ≤  ≤ ) is paired with  (1 ≤  ≤ ), which is noted as the subcarrier pair (, ).That is, user  transfers the information on the subcarrier  at the first slot and on the subcarrier  at the second slot.On the contrary,   , = 0 means that the subcarrier  is not paired with .
According to the Shannon's equation, after the user   cooperates with the relay node   , the transfer rate on the subcarrier pair (, ) can be written as [ where , and |ℎ     | 2 , respectively, represent the channel coefficients on the subcarrier pair (, ) between the devices ,  (,  ∈ {  ,   , }). , is the relay selection factor, and  , = 1 indicates that the th relay node participates in the th user cooperative communication process and vice versa with no participation.The solution of  , is the problem of relay selection in cooperative communication system; we use the method "dichotomous map" proposed in [17].  is the transmitting power of the user node, and   is the transmitting power of the relay node.Respectively,    ,   are the noises at the relay node  and the destination node .
The transmission consumption of user  can be written as where  is the reciprocal of the drain efficiency of the power amplifier at the transmitter,  CT is the fixed circuit power at the transmitter, and  CR is the fixed circuit power at the receiver.From (2), the energy efficiency of user  can be defined as follows: and the optimal energy-efficient resource allocation is given by where C1 is the subcarrier matching and the allocation coefficient, indicating that the subcarriers have two states of cooperative communication and noncooperative communication; C2 means that a subcarrier is assigned to one user only; C3 nidicates that a user selects only one subcarrier to cooperate; C4 is defined as the power limitation between users and relay nodes; and C5 is the transmission rate, and  min is the minimum transmission rate, which is QoS.

Proposed Optimal Resource Allocation Scheme
In this section, we proposed an improved algorithm to solve the optimal resource allocation formulated in (6).

Intelligent Water Drops
Algorithm.Intelligent water drops (IWDs) algorithm is an intelligent algorithm introduced by Shah-Hosseini inspired by the flow of natural water drops, which construct a solution by cooperation with each other [18].The IWDs are associated with two properties: the amount of soil in the path and the velocity of the IWDs.When the water drops pass through different paths, the change of the soil quantity on the different paths is different due to the difference of the path distance.When the subsequent water drops face different available paths, they are more likely to choose a path with less soil, in which the IWDs move faster.As shown in Figure 2, the initial amounts of soil at two paths are the same; when  = 0, different intelligent water drops will select the paths ACB and ADB with the same probability.
After the intelligent water drops pass these two paths, due to a shorter path of ACB, the water drops selecting this path will run faster and carry a lot of soil, leading the soil on the path ACB to be less than that on ADB after the initial iteration.At  = 1, the intelligent water drops will select a shorter path, ACB, with a greater probability.After repeated feedback at many times, the intelligent water drops will find the shortest path between A and B. The intelligent water drops algorithm draws on the feedback mechanism of changing soil quantity on the path and completes iterative search.

Improved Intelligent Water Drops Algorithm.
The main drawback of the IWDs algorithm is the low speed at the early stage of training.Because the total amount of soil is the same on all paths, the intelligent water drops will randomly select a path, even if that path is not the optimal one; this will change the amount of soil on that path, resulting in the phenomenon of path dependence in the subsequent iteration process.Therefore, other water drops are inclined more to select that path and many invalid searching paths appear.Genetic Algorithm (GA) [19] is an adaptive heuristic search algorithm based on the biological evolution process, reserving well-adapted individuals in the process of crossover and mutation, and after several evolutions, the optimal solution of the objective function is obtained.It starts the iterative process in individual population, which makes it easy to achieve expansion and algorithm fusion.GA has the characteristics of implicit parallelism and strong global search ability [20], which can quickly seek the solution in search space without trapping into the local optimal solution.The local search occurs in GA when the value of gItermax is too small, and GA will stop iterative search without finding the optimal solution; then IWDs algorithm begins, thus affecting the searching efficiency.In practice, GA encounters premature convergence problems.
As mentioned previously, IWDs algorithm is prone to many ineffective searches in the early stage, and the local search ability of the GA is limited in later period.We proposed a novel algorithm to improve the IWDs algorithm with GA.That is, in the early stage of the process, the global search ability of the GA is applied to achieve the rapid optimal solution, which is used as the initial solution of the IWDs algorithm.Finally, the global optimal solution is obtained by the characteristics of fast convergence of IWDs algorithm.
The flowchart of improved IWDs algorithm is shown in Figure 3.
Two main problems in improved IWDs algorithm should be mentioned as follows.
(1) Value of Boundary Condition   .In the calculation process, the convergence is different due to different scale of data.The boundary condition Iter max of GA and IWDs algorithm should be determined by the population size.The local search occurs in GA when the value of Iter max is too small, and GA will stop iterative search without finding the optimal solution; then the algorithm transfers to IWDs algorithm, thus affecting the searching efficiency.On the contrary, if the value of Iter max is too large, it leads to the slow convergence in GA due to redundant computing.Furthermore, the early maturing of GA causes the phenomenon of path dependence in IWDs algorithm.
According to the convergence analysis of GA based on the Markov chain model mentioned in [21], the value of Iter max is expressed as where  and  are the numbers of subcarriers and users, respectively.  and   are the probability of crossover and mutation,   min is the minimum selection probability of the nonoptimal individual,  * ( 1 ) is the fitness value of the best individual in initial population, and  * is the best individual fitness value in current population.In particular,  * is the optimal solution generated by GA.   ( = 1, 2, 3) refers to the three optimal solutions generated by GA and sorted by the fitness value. and   , respectively, refer to the weight of solution at the initialization.6) is the combinatorial optimization problem, which should meet a series of continuous or discrete conditions to obtain the optimal resource allocation.So, we present two-level neural network model to solve the problems of resource allocation in cooperative communication system and then seek the optimal path with improved IWDs algorithm.

Optimal Resource Allocation Scheme
The two-level neural network model is shown in Figure 4.It is composed of two types of network nodes and the connection edges between adjacent nodes.The basic unit is rows.A row of  master nodes represents the  users and a row of  secondary nodes represents the  unallocated subcarriers in cooperative communication system.The user's primary nodes are a total of  + 1 rows.A new row inserted between two adjacent rows represents secondary nodes of subcarriers.A path between two roles of primary nodes presents the two selected subcarriers, and then this path is weighted according to (6).From the first row to the  + 1 column, a path passing 2 nodes represents a possible allocation scheme.In this way, the optimal energy-efficient resource allocation in cooperative communication system transfers into the path planning in this two-level neural network.The red path in this figure represents a possible allocation scheme.

Optimal Resource Allocation Scheme.
The optimal resource allocation flow of improved IWDs algorithm is described as follows.
Step 1. Initialize global static parameters; the amount of IWDs  IWD = .
Step 2.1.Initialize the population and the static parameters.
Step 2.3.Operate the heredity and mutation on the population according to the boundary conditions of (8); operate the mutation and iteration until the end of loop.Step 3. Place  IWD water drops on primary nodes on the left as shown in Figure 4, and iterate each intelligent water drop according to Steps 4 and 5.
Step 4.1.Initialize the intelligent water drops' parameters and the soil quantity on the path according to (9).
Step 4.2.Empty the Tabu list, and list all subcarriers as assignable.
Step 4.3.With the Tabu list, calculate the probability of all selectable paths (subcarrier pair scheme), and select the most suitable subcarrier pair (, ) as the user's allocation scheme.
Step 4.4.Put the subcarrier  in Tabu list 1 and subcarrier  in Tabu list 2, which indicates that this subcarrier pair has been occupied by the system in two time slots.
Step 4.5.Update the amount of path soil and soil carried by the intelligent water drops.
Step 4.6.Intelligent water drops pass through the path to the next primary node; set the primary node as the initial position of the next path selection, repeat the steps from Step 4.3 to Step 4.5 until the water drops reach the model on the right side as shown in Figure 4, and this loop ends.
Step 5.At the end of the current iteration, calculate the optimal solution of all paths of water drops, and update the total amount of the path soil according to the optimal solution.
Step 6. Determine whether the number of iterations satisfies Iter ≤ Iter max ; if it does, then repeat Steps 4 and 5; otherwise, it goes to the end of program and optimal solution is shown.

Numerical Analysis
In this section, we evaluate the performance of the proposed optimal resource allocation scheme via simulation on MAT-LAB 2014b.The parameters are shown in Table 1.

Performance Analysis of Proposed Optimal Scheme.
In Figure 5, if the number of users in system is 10, the  relationship between energy efficiency and Iter max is depicted.The proposed algorithm is combined with GA and IWDs algorithm.That is, after pretraining by GA at early period of iterations, the performance is further improved by using IWDs at later period.It is obvious that when the value of boundary condition is 0.75 * Iter max , the premature convergence occurs.In this case, it is inefficient that IWDs are operated due to GA getting struck at local optimal solution.When the value of boundary condition is 1.25 * Iter max , the performance declines, and the premature convergence of GA makes the phenomenon of path dependence in IWDs occur.6 illustrates the performance comparison of improved IWDs algorithm in terms of energy efficiency.Obviously, the energy efficiency obtained by employing the proposed algorithm is much higher than that of GA and Ant Colony Optimization (ACO) algorithm mentioned in [22].That is, the better performance is achieved by using improved IWDs algorithm.However, the algorithmic stability of IWDs is poor for its local optimum.Meanwhile, the performance increases at the beginning and then decreases, while the number of users increases.Due to limitation of system resources, when the number of users increases, it results in a lack of system resources and furthermore the performance degradation.

Performance Comparison of Variant Algorithms. Figure
If the number of users is 10, the radius is 600 meters.Figure 7 shows the relationship between energy efficiency and the distance between the users and BS, comparison of different resource allocation schemes.It is proven that the proposed improved IWDs algorithm obtains better performance than that of algorithms in [22].At the same time, with the increasing of transmission distance, the energy efficiency is gradually reduced.When the transmission distance is far, the channel condition becomes more severe, so the transmitting power increases to overcome the path loss, resulting in reduced system energy efficiency.
Figure 8 shows the convergence rate of different algorithms if the number of users is 10.The improved IWDs algorithm has a faster convergence rate and obtains a better performance, while the original IWDs algorithm encounters premature convergence.

Conclusion
We have addressed the optimal resource allocation for uplink single-cell multiuser cooperative communication system.With the goal of optimizing energy efficiency, the improved IWDs algorithm has faster convergence rate, which achieves better resource allocation.The performance evaluation results demonstrate the effectiveness of the proposed solution.
It is important to notice that a subcarrier is assigned to a user only in this paper.In the practical communication scenario, users' data are abrupt and asymmetric.In the future, a real-time resource allocation strategy can be established to meet the demands of rapid development of mobile services.

4. 1 .
Optimal Resource Allocation Model.The model in (

Figure 5 :
Figure 5: Energy efficiency comparison of different Iter max .

Figure 6 :Figure 7 :
Figure 6: Energy efficiency comparison of different user numbers.