Delay-Constrained Routing Based on Stochastic Model for Flying Ad Hoc Networks

. This paper aims at solving the end-to-end delay-constrained routing problem in a local way for ﬂying ad hoc networks (FANETs). Due to the high mobility, it is diﬃcult for each node in FANETs to obtain the global information. To solve this issue, we propose an adaptive delay-constrained routing with the aid of a stochastic model, which allows the senders to deliver the packets with only local information. We represent the problem in a mathematical form, where the eﬀective transmission rate is viewed as the optimization objective and the link quality and end-to-end delay as the constraints. And, some mathematical tools are used to obtain the approximate solutions for the optimization problem. Before designing the routing scheme, the senders calculate the transition probability for its relay node by jointly considering local delay estimation and expected one-hop delay. Then, the sender transmits the packets to their relay node with transition probability. Finally, we prove the convergence of the proposed routing algorithm and analyse its performances. The simulation results show that the proposed routing policy can improve the network performance eﬀectively in terms of throughput, loss rate, and end-to-end delay.


Introduction
Unmanned aerial vehicles (UAVs) can serve as the role of sensors to collect environmental data (such as temperature, humidity, and wind speed) [1] and transmit these collected data to a ground base (GB).Because of the versatility, flexibility, and easy installation of UAVs, single-UAV systems have been in use for decades, but the simple function and limited coverage of these systems restrict their further applications.Hence, the multi-UAV system is built to improve the operational performance through cooperation.In the case of multi-UAV system [2], to solve the problem that the links between UAVs and GB become disconnected caused by the limited communication radius, an alternative solution is to establish ad hoc networks among UAVs, which are called flying ad hoc networks (FANETs).It does not demand a link between each UAV and GB in FANETs; only a subset of UAVs which have direct links with GB is required to help other UAVs transmitting the packets.FANETs can be used in many potential application domains including emergency and rescue operations, disaster relief, and military applications.In these environments, FANETs are particularly vulnerable to the motion of nodes and link failures, which can dramatically impact on the network performance.
As pointed out in [2], FANETs can be viewed as a special case of mobile ad hoc networks (MANETs) characterized by a higher mobility.
erefore, routing is one of the most challenging and crucial issues for FANETs, where real-time and reliable transmissions of critical information are vital for mission completion.
e routing algorithms designed for existing MANETs [3] adapt not well to environment variations, because the topologies of FANETs change more frequently than that of typical MANETs.e routing methods proposed for delay tolerant network (DTN), such as EPI-DEMIC [4], BUBBLE [5], GDTN [6], and PROPHET [7], are destined to handle the recurrent disconnections of the links due to the high degree of nodes' mobility.In most cases, this category of routing methods uses the technique of store-carry-and-forward when the senders lose connectivity with their neighbors to deliver the packets to destination.is well-known technique allows the nodes to store data packets for a certain distance until they meet the suitable nodes moving toward the destination.Although these routing methods can be well adapted to the dynamic network topology of FANETs, they create more delays in completing the transmission for each session due to the lack of delay control mechanism.In addition, the routing methods for DTN mainly focus on the best-effort delivery with less consideration of the various channel statuses, which are not well adapted to real-time applications because of increasing delay consumption for single-hop transmission.Most of routing algorithms designed for FANETs fail to follow the fast evolution of channel states, which may cause the path established by the source out of service soon.ese algorithms will take up lots of time to maintain the end-to-end path between the source and GB, which is unacceptable to FANETs where the channel states between any pair of UAVs change more dramatically than traditional MANETs.A new routing method called stochastic routing [8] has been proposed to solve the insufficiency presented above.Stochastic routing initiates a session without preselected path and allows the relay nodes to decide the optimal route in a local way.
In this paper, each packet attaches to a time stamp; a successful mission completion means that the end-to-end delay is less than the given threshold; otherwise, the transmission would be deemed invalid.To meet the requirement of the end-to-end delay constraint, we consider the link quality as an optimization objective, which can reduce delays consumed by each transmission due to the less retransmission.In addition, each sender uses remaining delays as a parameter to obtain transition probability, which ensures that the end-to-end transmission meets the delay requirement with certain probability rather than mandatory.As we know, there are few works to study the routing problem with a delay constraint for FANETs.e main goal of this paper is to maximize the effective transmission rate and ensure the total delay within the threshold while there is no global information available for each intermediate node.
Our contributions in this paper are listed as below: (i) We design an optimization framework to maximize the minimum effective transmission rate with endto-end delay constraint in FANETs.Considering the relationship between the transmission rate and queuing delay, the original optimization problem is transformed into the distributed problem.en, we jointly use one-order derivative and projection method to get the local optimal solution which shows that the balance between the transmission rate and delay is obtained at relay nodes.(ii) We propose a delay-constrained stochastic routing algorithm which only requires relay nodes to collect their local channel information.And, the approximate local solution is used as the routing index to select the relay node.To satisfy the requirement of the end-to-end delay constraint, we combine the remaining delays and the distance from the relay node to GB to obtain transition probability which is used as a guide for transmissions.Finally, we prove the convergence of the algorithm.
e remainder of this paper is organized as follows: In Section 2, we introduce some previous work researched by others.In Section 3, we present some preparatory work and parameter estimation.In Section 4, we provide the detailed implement process of the stochastic routing algorithm and analyse the convergence of algorithm.In Section 5, we show the experiment results for the proposed routing algorithm.Finally, we conclude the paper and discuss the future work in Section 6.

Related Work
ere are many researches proposed for the routing problem in FANETs to consider the different network performances [9,10], but only few of them consider the end-to-end delay constraint problem.Vasiliev et al. [11] analysed Quality of Service (QoS) metrics for AODV, OLSR, and HWMP routing protocols in FANETs and compared these three routing protocols to search and maintain paths in FANETs based on the hop count, packet delivery ratio, and overheads metrics.In recent years, some methods are proposed to design the routing algorithms considering the high mobility of FANETs.In order to adapt the routing algorithms to dynamic topologies in FANETs, some researches focus on the prediction technique [12] and the idea of distance vector routing protocols [13] to design the routing algorithms for FANETs.Sugranes and Razi [14] proposed an optimal routing method based on Dijkstra's shortest path algorithm (OR-DSP) and prediction technique for UAV networks with queued communication systems by incorporating predicted network topology.Rosati et al. [15] proposed predictive OLSR (P-OLSR) which is an OLSR extension designed for FANETs, to solve the challenging issues that the existing routing protocols designed for MANETs partly fail in tracking network topology changes.P-OLSR computes the relative speed between two nodes and takes the relative speed as a parameter of path metric to help each node making a wise routing decision.In order to adapt the routing strategy to high-speed mobility and frequent topology changes of FANETs, Gankhuyag et al. [16] proposed adaptive hybrid communication protocols including a novel position-prediction-based directional MAC protocol (PPMAC) and a self-learning routing protocol based on reinforcement learning (RLSRP), which can meet the demands of autonomy in FANETs.
Due to the high degree of nodes' mobility, the network would suffer from recurrent disconnections which result in distorting the end-to-end paths built gradually to the target destination.erefore, the researches take more attention to the routing methods designed for DTN and attempt to apply them to FANETs.Peters et al. [17] and Jabbars and Sterbenz [18] proposed Aeronautical Routing Protocol (AeroRP), which is a geographical delay tolerant routing protocol designed for aeronautical networks.AeroRP requires each node to calculate a metric called Time to Intercept (TTI) 2 Mobile Information Systems based on positions and velocities of its neighboring nodes and selects the fastest relay node among its neighboring nodes moving toward destination.Hyeon et al. [19] proposed the Geographic Routing protocol for Aircraft Ad hoc Network (GRAA) based on Greedy Perimeter Stateless Routing (GPSR).e core idea of GRAA is that each node takes into account the position and the velocity of its neighbors and the destination to make a routing decision locally at each intermediate node.Next, we introduce some other types of routing algorithms designed for FANETs; Vasiliev and Abilov [20] investigated throughput efficiencies of relaying algorithms with the ideal selective-repeat ARQ in FANETs.Multiple token structure has been implemented for UAVs in [21] acting with a dynamic topology, and the results show that it enables each node to obtain more accurate position information of other nodes.Gankhuyag et al. [22] proposed a combined omnidirectional and directional transmission scheme with dynamic angle adjustment to overcome the obstacles that the routing protocols in MANETs are not suitable for FANETs due to high-speed mobility.e routing algorithms presented above only consider the reachability of transmission and ignore the delay constraint attached to the packets.Li et al. [23] conducted a statistical analysis for the packet delay in a wireless network of UAVs under nonsaturated traffic and channel fading conditions.e one-hop packet delay computed in [23] cannot be applied in FANETs which implements the routing in multihop manner rather than one-hop manner.erefore, we propose a delay-constrained routing algorithm for FANETs to overcome the weaknesses in transmission quality and real time.In Table 1, we list the comparison results between the proposed algorithm and existing routing algorithms in terms of several important performance metrics.

System Model
3.1.Network Model.In this paper, we focus on the FANETs composed of multiple UAVs and one GB, where the location of GB is unchangeable.ere are some UAVs that are located in the communication range of GB all the time, and all UAVs communicate with GB in single-hop or multihop mode, as shown in Figure 1.A standard undirected graph G � (V, L) is used to represent the network topology, where V is a node set containing all UAVs, and L is an edge set consisting of all links (the dotted lines in Figure 1) between any pair of UAVs.e tuple (i, j) denotes a link with two endpoints i and j in subsequent sections, and the transmission rate r ij over link (i, j) at time t is decided by current channel state information (CSI).When node i broadcasts a radio signal, and if node j decodes it correctly and returns acknowledgement information to i, node j is regarded as a neighbor of node i, namely, j ∈ N t i , where N t i is a neighbor set of node i at time t.Let L(N t i ) denote the set of all links between node i and its neighbors at time t.ere is a pair of source s and GB; let p s be an end-to-end path selected by s to transmit the packets to GB.Let L(p s ) be a set containing all links on path p s .For each link on the path p s , the delay for one-hop transmission on the link (i, j) ∈ L(p s ) is D ij , and the total delay T(p s ) for all links on the path p s should be within the delay threshold I s , where T(p s ) �  (i,j)∈L(p s ) D ij .In this paper, we assume that all packets have the same delay threshold.
e definitions of all parameters used in this paper are shown in Notations.

SINR Prediction and Outage Probability
Model.In our scenario, all nodes in the network are not stationary, and the distance between any pair of nodes changes with time elapse.
e interference prediction method proposed in [24] can capture this dynamic nature and be used to estimate the interference value at node i after Δt time.Assume that the current time is t 0 and the future time is t after elapsing Δt time.
e quantity I(t | t 0 ) represents the interference prediction at time t based on the information available at time t 0 ; hence, it is a random variable due to the uncertainty in mobility over the time duration from t 0 to t.If t 0 � t, the quantity I(t | t) is equal to the instantaneous interference value [25] at time t.
Assume that the mobility of nodes follows the same distribution model; let f y (y) represent the probability density function of distance y at current time between any pair of UAVs, and g ij (y) denote path fading gain of link (i, j).Let y(t 0 ) denote a function of distance between two UAVs at time t 0 ; the detailed form can refer to the Rayleigh model.So the mean interference prediction at node j can be expressed as an integral form: (1) Using (1), we calculate the signal-interference-noise ratio (SINR) at node j: where is abbreviated as c i j in following sections.To obtain the accurate value of link quality, we define the rate-outage probability as the probability that the transmission rate r ij on the link exceeds the instantaneous Shannon capacity c ij similar to [26,27].
e rate-outage constraint can be expressed as follows: where δ max ij ∈ (0, 1) is a constant and denotes the maximum probability value with outage on each link.For the Rayleigh fading model, the δ-outage capacity can be obtained according to the result presented in [28]: Mobile Information Systems where Φ is SINR gap which re ects a particular modulation and coding scheme and Φ −log(1 − δ max ij ).e rate-outage probability in the closed form for the Rayleigh fading model by considering both ( 3) and ( 4) can be expressed as follows [28]: where q ij is the quality of link (i, j), and the detailed definition can be found in [28].

Expected Queuing Delay.
We assume that all packets have an exponentially distributed length with a mean K bits and each node maintains a unique queue [29].According to [30], we can get an approximate value of expected queuing delay for link (i, j): where r ij and c ij are the transmission rate and outage rate, respectively.

Problem Formulation.
e transmission rate on each link only re ects the current CSI, but does not represent the link quality in the time interval Δt.To let each sender to know CSI more accurately and reliably from its receivers, the e ective transmission rate [31] is de ned as the total probability multiplied by the transmission rate on link (i, j): Based on the rate-outage probability and delay constraint, we de ne the problem in a mathematical form with e ective transmission rate as the objective function and the  4 Mobile Information Systems rate-outage probability and total delay on the selected path as the constraints.e detailed form is expressed as follows: max min

Distributed Solution.
To make the routing algorithm adapt to the changes of the link states, it is necessary to convert problem (8) into the problem that can be solved in a distributed mode.To solve this problem, we assume that there always exists at least one end-to-end path that meets the delay constraint.Because of the existence of the delay constraint, if no one path satisfies the constraint, all packets will be discarded at intermediate nodes.In this case, no packets arrive at GB within the delay threshold, which results in failures to provide services for any sources.Due to the absence of end-to-end link state information, each sender uses the current remaining delays to distinguish the available node set.To ensure that the distributed solution meets the requirement of the delay constraint, an alternative method is to optimize two objective functions including the effective transmission rate and one-hop delay at relay nodes, that is, to maximize the one-hop effective transmission rate and minimize the one-hop delay of all links.e first objective can be expressed mathematically by max R ij , and the second one can be characterized by min Based on the fact that the function min f(•) is equivalent to max −f(•), the two objectives defined above can be combined into one function.Considering the rate-outage constraint and the one-hop delay constraint, the problem can be completely expressed as follows: It is noted that the outage probability δ max ij is intimately related to the tradeoff between the transmission rate r ij and maximum transmission rate M s .e higher transmission rate indicates that more packets loss may occur, which can be interpreted with (5).If the transmission rate is smaller than the outage capacity to transmit the packets, GB will receive the packet correctly with the probability infinitely approaching to 1. Hence the maximum transmission rate for each node can be defined as outage capacity  c ij ; the optimization problem presented in ( 9) is rewritten as e problem in (10) only considers the quality of onehop transmission, and the scale of the problem is small enough to enable local transmission to obtain the optimal performance in polynomial time.
In FANETs, the link quality and the length of each queue are unstable, which introduces additional delays for one-hop transmissions.When time t approaches infinity, the system is considered to achieve a stable state, in which the average delay consumed by the one-hop transmission is equal to expected delay of the link.Assume that a node selects a link with minimum expected delay D ij to transmit the packet.
e objective function is modified as max We use a generally approved inequality 1 + x ≤ e x to simplify the double exponential form as ). e closed-form solution of problem ( 10) is difficult to obtain due to the unconcave attribution of the effective transmission rate in (7).To solve this obstacle, the logarithmic form is taken for each parameter including effective transmission rate and expected queuing delay.Using the mathematical tools, we can get the approximate expression of transmission rate: where f ′ (r ij ) denotes one-order derivative of function f(r ij ), [x] b a is a projection operation and its value takes min max a, x { }, b { }.Equation ( 11) denotes the transmission rate on each link when the tradeoff between transmission rate and one-hop delay is achieved.

Algorithm Description and Implementation.
It is obvious that some optimization loss will occur in (10) as opposed to the optimization problem (8) due to the volatility of the estimated delay compared to the expected delay at the current sender.We will introduce some other parameters to reduce the optimization loss as far as possible for each session in the execution process of the routing algorithm.Before starting the operation, we first estimate the one-hop delay for node i depending on the remaining delay denoted by T i s .If the neighbor j is selected as a relay by i, the singlehop packet progress [32] to GB is defined as where d i is the distance from node i to GB and d i > 0. If node i has received a packet from its upstream node correctly and selects node j as relay node, the value of estimated one-hop delay can be obtained with the following equation: We define the notation H ij as the probability that the expected delay calculated in (6) is less than the estimated one-hop delay in (13), and the expression of H ij is From ( 14), we can see that there is a positive correlation between H ij and  T ij .It is noted that the larger value of  T ij Mobile Information Systems denotes the closer distance from node j to GB than any other neighbor of i as shown in (14).ere is an opposite trend between the values of H ij and D ij , and the senders may select the neighbor with a smaller D ij as the relay node due to the delay constraint.
To make a wise decision at each relay node, we define an indicator notation N i j as the number of times that the link (i, j) has been selected by node i up to present time.We jointly consider parameters H ij and N i j to obtain the transition probability F t ij , and the detailed expression is listed as below: It is noted that there is a positive correlation between the value of F t ij and the selection times of relay nodes.In addition, if N i j → ∞ holds, the value of F t ij approaches 1.Before discussing the stochastic routing algorithm, we provide the following notations.Let S t i ∈ N t i denote the potential relay set of neighbors of node i; these nodes not only receive the packets from i correctly but also satisfy the transmission condition as relay nodes.e notation A(S t i ) is defined as the available relay set that node i can take at time t, and a t i is actual relay selected by node i at time t.Before implementing the routing algorithm, we need to solve the problem that how to assign the transition probability to each available relay in A(S t i ). e detailed process of routing algorithm is as follows.
Algorithm 1 is executed in a local way, in which each node transmits the received packets based on the one-hop channel conditions of its neighbors in step 4-8.It does not require all nodes to have the global synchronization information, the steps 2-20 are independently processed at each intermediate node.In initialization phase, each node configures its own parameters (such as location and cache) independently and periodically exchanges the beacon message with its neighbors; this operation runs in the asynchronous mode.In transmission phase, the senders collect the CSI from their neighbors N t i and exploit the judgement condition of step 5-6 to decide the candidate set A(S t i ).Next, each sender selects its relay node by running steps 9-20 and transmits the packet to selected relay node; this operation is terminated until the packet arrives at GB.If there are more than one relay nodes that have same metric value as described in step 13, the senders select the relay nodes from their candidate set by exploiting different operations as described in steps 13-16.From ( 14), we can see that the value of H ij increases with the increase of  T ij ; hence, step 14 can ensure that more packets arrive at GB within delay threshold.In our channel model, CSI remains unchanged in a given interval which results in the optimality of selected link between the sender and its relay node until the interval ends.erefore, step 21 ensures that the packets transmitted to GB along the optimal path in a given interval.After determining the relay node, the sender calculates transition probability F t ij and transmits the packet to its relay node with F t ij as shown in steps 18 and 19. e advantage of step 19 is to avoid the routing process falling into local optimum.
e transmission rate, outage probability, and expected delay are updated at each transmission; these operations are performed in the local way rather than in the global way.Considering the local operation, the transmissions at relay nodes are only related to the current time and independent of other transmissions in our scenario, which makes Algorithm 1 more suitable for FANETs.
In our routing algorithm, we do not explicitly propose the mechanism for load balancing which is achieved by controlling the queue length at intermediate nodes.From (6), it is noted that the queuing length is related to the rate r ij ; hence, the load balancing can be achieved by adjusting the size of r ij .In addition, the stochastic model requires the senders to transmit the packets to their relay nodes with the transition probability, which also avoids transmitting the packets through the same path.

Algorithm Analysis.
From Algorithm 1 we can see the routing decision is made at each intermediate node in an adaptive manner rather than at the source.A better routing strategy needs to have the approximate optimal performance; hence, we would like to show that the proposed routing method can converge to the optimal routing method under some mild assumptions.For the convenience of analysis, it is reasonable to assume that the one-hop transmission can be completed in one slot, such that the maximum delay constraint is equal to the maximum hop count constraint.Before proving the convergence of Algorithm 1, we need to do some preliminary work.
For the sake of convenience, we use the notation π * to denote the optimal routing policy and the notation ϕ to denote the routing policy proposed in this paper, and assume that ϕ is a uniformly good policy [33].We define the (1) //Initialization; (2) if node i has received the packet then (3) S t i ⟵ N t i ; (4) for each node j ∈ S t i do (5) if sp ij > 0 and D ij ≤  T ij then (6) A(S t i ) ⟵ j; (7) end if (8) end for (9) for each node j ∈ A(S t i ) do (10) Uses ( 5) and ( 11) to compute q ij and r ij ; (11) end for (12) Uses (7)

6
Mobile Information Systems termination time υ k T to be the stopping time when packet k is terminated within delay constraint and υ k s to be the stopping timeout of delay threshold.e notation μ k,n denotes the transmission gain when the packet k is transmitted at slot n, and μ k,n < ∞.Assume that the maximum number of hops (H max ) of all sessions is bounded as O(log|V|).We use the notation V * to denote the transmission gain under the policy π * .Before analysing the performance of Algorithm 1, there are some assumptions have to be provided.Assumption 1.If node i receives the packet from its upstream correctly, the event that i selects a candidate set S t i from its neighbor set N t i occurs with probability P(S t i | i) which is independent of time and all other routing decisions.
In FANETs, the link quality is unstable and the packets are received by relay nodes with a certain probability.When the relay node fails to receive the packets, its upstream node needs to transmit the same packet again; hence, node i is always a recipient of its own transmission, namely, i ∈ S t i .If i ∉ S t i , the probability P(S t i | i) � 0.
Assumption 2. Node i is able to receive the acknowledgement information from all nodes in set S t i which receive the packet from node i correctly.
In practice, Assumption 2 is hard to be satisfied, because the channel states change dramatically and the set S t i is timevariant.To make two assumptions presented above hold, we also propose another assumption.

Assumption 3.
ere is a time interval Δt > 0; the link quality keeps relatively stable, and all components in set S t i remains invariant within interval Δt.

Lemma 1.
If the routing policy ϕ is followed, Δt → ∞, and when state S t i is visited infinitely often (i.o) for ∀i ∈ V, then the active a t i ∈ S t i is visited i.o, and each state-action (S t i , a t i ) for ∀i ∈ V is visited i.o. e proof of Lemma 1 is similar to ([34], Lemma 5, and Lemma 6), and the interested readers can refer to [34].Definition 1. ere exists a sequence of relay nodes which possess the knowledge about local network topology; if Lemma 1 holds, the expected transmission gain for packet k under policy ϕ is defined as

Lemma 2. If Assumptions 1-3 hold and Δt → ∞, the proposed routing method ϕ can converge to the optimal policy π * under the consideration of Lemma 1; in other words, the difference of transmission gain between two routing methods approaches zero.
Proof.Given a constant α ≥ 0, for a packet with index k, when n > υ k s , and ξ n (i, ≤ α with probability 1.To generalize our problem, assume that there exists a constant k 0 < ∞; for the packet index k, let k > k 0 .Packet k is generated at source s at time υ k s .Now, we define an event Ψ k m , which denotes there exist m instances when Algorithm 1 transmits packet k differently from the possible set of optimal relays.Mathematically speaking, event μ k,n k m (j), where l � 1, 2, . . ., k and μ k,n k m (j) is transmission gain of node j for packet k.We call event Ψ k m a miss routing of order k.Such that, we can obtain an inequality as Considering the definition of the expected transmission gain, for packets k > k 0 , the differential regret under policies ϕ and π * is computed as follows: where and ς � (( , and the difference between υ k s and υ k T is equal to the maximum delay threshold, (υ k T − υ k s ) ≤ I s .We assume that there is a nonnegative constant δ 0 > 1 that the equation H max � δ 0 log|V| is followed, so the value ς is rewritten as ς � (δ 0 log |V|Δ max • α)/ (1 − α) 2 .Based on the practical routing implementation, it is reasonable that R ϕ ≥ 0.
Assume that the network can achieve the stable state presented in Lemma 1 during the interval Δt; the nodes that satisfy the transmission requirements will be selected with higher probability.If Δt → ∞, we can know that the parameter N i j also approaches ∞.In this case, it is easy to obtain the conclusion that F t ij → 1 by considering (15) for each link.According to the definition of ξ n (i, S t i ), we can see, if F t ij → 1 holds, the value of ξ n (i, S t i ) approaches zero; hence, we have the relation max i,S t i ξ n (i, S t i ) → 0. If the value of α is zero, it is easy to obtain that ς � 0 according to the relationship between ς and α.Considering inequality (16), the following inequality holds R ϕ ≤ 0. Concluding the analysis above, it is obvious that the proposed routing method can converge to optimal solution under some assumptions.

Analysis of the Simulation Result
In this paper, we use OMNeT++ 5.0 to simulate the network scenario and collect relevant results.In the initialization phase, the nodes spread uniformly in an area of Mobile Information Systems 5 km * 5 km * 2 km and randomly move with the Random Way-Point model [17].All end-to-end transmissions have the same delay constraint which is set to 0.1 s.Each node is able to send the packets using same transmission power 1000 mw and di erent transmission rates which vary from 1 Mbps to 3 Mbps.e sources randomly generate packets with a generation rate of 25 packets per second and the size of each packet is 20 kb.
e coordinate of GB is unchangeable, and other nodes can move randomly with a certain speed in the speci ed region.All nodes transmit the packets with same power, and the communication radius of nodes is set to 1 km.When the nodes transmit packets to the relay nodes, the receivers obtain a random interference value from other transmissions.To get more accurate results, we perform ve times for each parameter under the same network con guration, and the nal results are collected by calculating the mean value based on the ve groups of results.
Considering several kinds of physical parameters including number of nodes, speeds, and hello intervals, we collected the results and generated the Figures 2-10.For simplifying the transmission process, each relay node only has one chance to retransmit the packet on each link.We divide the experimental results into two parts: Figures 2-4 show the changing trends of network parameters when the di erent moving speeds and hello intervals are considered that only our proposed routing policy is followed, and the Figures 5-10 indicate the di erent network performances under two di erent routing policies which include the proposed method, OR-DSP [14], P-OLSR [15], and GRAA [19].e reason for comparison with these three routing algorithms is the di erent path selection criteria for designing the routing algorithms.From the introduction in Section 2, we can see that OR-DSP mainly exploits Dijkstra's shortest path and anticipated locations of intermediate nodes to design the routing algorithm.P-OLSR incorporates relative speed between two nodes and links states into routing selection, and the routing process employed by GRAA exploits a time-based movement prediction of the nodes and the routing idea designed for DTN to improve the performance of the position-based routing.e evaluation results of di erent network parameters, which include timeout rate, packet loss rate, and throughput, are displayed in Figures 5-10 under di erent speeds and the number of nodes.From Figure 2, we can see that the total packet loss rate increases with the increase of speeds.
ere are two major factors to decide the total packet loss rate: link quality and delay constraint.e previous factor will bring more retransmissions which could increase the end-to-end delay.It also hints that the total delay consumed by the packet would exceed the delay threshold with greater possibility.e latter factor increases the loss rate because the packets will be discarded by relay nodes when the delays consumed for transmissions are larger than the given threshold.
e proposed routing policy in this paper only collects the local information from the one-hop neighbors and uses them to make a routing decision.e interval to exchange the beacons between a pair of nodes seriously a ects the reliability of one-hop transmission, where the senders select relay nodes with outdated CSI to make a worse decision.e CIS computed in ( 2) is closely related to the distance between two nodes; when the moving speed of nodes changes dramatically, the increasing hello interval will decrease the network performances.erefore, from Figure 3, we can see that when the relay nodes use the previously stored CSI to select the next node, the stored CSI does not characterize the current link quality and may mislead nodes to make a worse routing decision, which will dramatically decrease the number of packets received correctly by GB.In the practical implement process, we are interested to know how to set the hello interval to meet the success rate requirement for each transmission when the moving speed of nodes is xed. Figure 4 indicates the relationship between hello interval and moving speed of nodes when the network requires the   Mobile Information Systems transmission rate to reach 80%.e coordinate of each node changes gently in slower moving mode, and the current link quality is closer to the previous CSI.e transmitters only use stored CSI to select relay node rather than exchanging the beacons to obtain current CSI, which can reach similar network performance with current CSI.Next, we analyse the di erent network performances under the proposed methods: OR-DSP, P-OLSR, and GRAA.e delay constraint condition is an important factor to be considered in the design process of the routing algorithm for the proposed method.erefore, the optimization iteration at each relay node not only considers the di erent network metrics (such as link quality) but also takes attention to the delay requirement.Although OR-DSP incorporates the waiting time at intermediate nodes into path selection to reduce end-to-end delay, as with other routing algorithms (P-OLSR and GRAA), OR-DSP does not explicitly consider end-to-end delay constraint problem, and reducing one-hop delay does not mean that the total delay can meet the given delay threshold.erefore, when OR-DSP, P-OLSR, and GRAA are performing, the packet timeout rate is larger than that of the proposed method, which can be validated in Figures 5 and 8. From Figure 8, it is noted that the timeout rate increases with the increase of moving speeds in four methods; the reason can be explained as the high mobility of nodes introduce worse link quality at each transmission.A main optimization goal of the proposed method is to maximize the e ective transmission rate which considers the practical   transmission rate and link quality simultaneously.e adjustable transmission rate can adapt to the changes in network topology and provide better link quality; hence, we can get the conclusion that the timeout rate calculated in the proposed method has a weak relationship with the moving speed.More number of nodes can provide more chances for each transmission to make a wise routing decision and ensure the link quality.Hence, the timeout rate decreases with the increase of the number of nodes, as shown in Figure 5.
In addition, this paper considers the interference from other transmissions and calculates the link quality for each transmission depending on (5).In our simulation, assume that each relay node has one chance to retransmit the packet, which means that more packets will be discarded at relay nodes with poorer link quality.e proposed method regards the transmission rate and link quality as optimization goals; the packets will consume less delays to arrive at GB. e consideration of link quality ensures that the packet can arrive at GB with higher probability.P-OLSR regards the link quality as part of routing metric to adapt to dynamic network topology of FANETs rather than the variations of channel status.OR-DSP and GRAA only focuses on the location prediction and the shortest distance between two nodes as routing metric.ese three methods do not consider the impact of the interference on link quality; hence, the relay nodes may select the links with lower reliability as parts of the end-to-end path.e worse link quality leads to more retransmissions at relay nodes for each session, which increases the total delays and the number of the packets discarded at relay nodes.Summarizing the above analysis, we get two conclusions: one is that the proposed method can provide better reliability for end-to-end transmission than OR-DSP, P-OLSR, and GRAA.Hence the packet loss rate which does not include packet timeout rate in the proposed method is smaller than that in OR-DSP, P-OLSR, and GRAA as shown in Figures 6 and 9. e other is that the throughput in our method is higher than that in OR-DSP, P-OLSR, and GRAA under di erent number of nodes and speeds, as shown in Figures 7 and 10.

Conclusion
To solve the delay-constrained routing problem in FANETs, we formalize it into a global optimization problem.By considering the link quality and one-hop delay estimation, the global optimization is converted into a distributed optimization, and we use the one-order derivative and  Mobile Information Systems projection method to obtain the local optimal solution in polynomial time.In order to avoid the routing process falling into local optimum, the transition probability is calculated by jointly considering remaining delay and the distance to GB for relay nodes.From the simulation results we can see, the proposed routing algorithm can improve the network performance in terms of network throughput, packet loss rate, and packet timeout rate.
ere are some open issues that need to be solved in FANETs including the link connectivity and the void region problems.e selection of the relay node only refers to effective transmission rate, and it is insufficient to ensure network performance.For example, there is a link connecting nodes i and j at time t 0 , but the link will disappear during transmission due to the mobility of nodes.In a worst case, the sender cannot find any available neighbors to relay packets, and if nothing else is done, the packet would be discarded in our scenario.e consideration of connection time as in [22] can reduce link maintenance costs and avoid the void region problem.erefore, our future work will consider these problems in our optimization framework.

V:
Set of all nodes L: Set of all links (i, j): A link connecting node i and j r ij : Transmission rate over link (i, j) R ij : Effective transmission rate over link (i, j) N t i : Neighbor set of node i at time t L(N t i ): Link set between node i and its neighbors at time t I s : Delay threshold for source s c ij : Instantaneous capacity of link (i, j)  c ij : Outage capacity of link (i, j) q ij : Quality of link (i, j) for session s D ij : Expected queuing delay on link (i, j) p s : e end-to-end path selected by s L(p s ): Link set on path p s T(p s ): Total delays on path p s K: Length of data packet d i : Distance from node i to GB T i s : Remaining delays the packet from s arrive at i  T ij : Estimated one-hop delay of link (i, j) F t ij : Transition probability over link (i, j) at time t S t i : Potential relay set of node i at time t A(S t i ): Available relay set of node i H max : Maximum hops for all end-to-end path.

Figure 3 :Figure 2 :
Figure 3: e average throughput with di erent speeds under di erent hello intervals.

Figure 5 :Figure 6 :Figure 4 :
Figure 5: e packet timeout rate with di erent number of nodes under four routing policies.

Figure 7 :
Figure 7: e average throughput with di erent number of nodes under four routing policies.

Table 1 :
Comparison of existing routing algorithms.
to obtain R ij ; (13) if more than one node satisfy max Figure 8: e packet timeout rate with di erent speeds under four routing policies.Figure 9: e packet loss rate with di erent speeds under four routing policies.Figure 10: e average throughput with di erent speeds under four routing policies.