Congestion Control Based on Multiple Model Adaptive Control

The congestion controller based on the multiple model adaptive control is designed for the network congestion in TCP/AQM network. As the conventional congestion control is sensitive to the variable network condition, the adaptive control method is adopted in our congestion control.Themultiple model adaptive control is introduced in this paper based on the weight calculation instead of the parameter estimation in past adaptive control. The model set is composed by the dynamic model based on the fluid flow. And three “local” congestion controllers are nonlinear output feedback controller based on variable RTT, H 2 output feedback controller, andproportional-integral controller, respectively.Ns-2 simulation results in section 4 indicate that the proposed algorithm restrains the congestion in variable network condition and maintains a high throughput together with a low packet drop ratio.


Introduction
In recent years, with the rapid growth of network size and network applications, congestion control has been exposed as an essential factor in communication network design. Congestion [1] occurs when the aggregate demand for a resource exceeds the available capacity of the resource, which may deteriorate the performance and the reliability of the network. Resulting effects from such congestion include long delays in data delivery, wasted resources due to lost or dropped packets, and even possible congestion collapse [2], in which all communications cease in the entire network.
TCP can only provide best effort service, in which the traffic is processed as quickly as possible, but there is no guarantee as to timeliness or actual delivery [3]. Moreover, it is difficult for the data source to perceive the network condition. When the incoming packet rate is higher than the router's outgoing packet rate, the queue size will increase and eventually give rise to the congestion. The queue management scheme in router will use queue to smooth spike in the incoming packet rates. In the Drop Tail (DT) policy which is the most extensive dropping policy, the packet will be dropped when it arrives and finds the queue full. It has been shown that the DT mechanism interacts badly with TCP's congestion control mechanisms and could lead to a poor performance [3].
In the same time, Active Queue Management (AQM) is the early notification of incipient congestion so that TCP senders can reduce their transmission rate before the queue overflows [4]. Random Early Detection (RED) [5,6] is an important AQM mechanism, which is recommended by Internet Engineering Task Force (IETF) [7]. The basic idea behind RED queue management is to detect incipient congestion early and convey congestion notification to the end hosts, allowing them to reduce their transmission rates before queues in the network overflow and packets are dropped. To fulfill this aim, RED maintains an exponentially weighted moving average of the queue length which it uses to detect congestion. RED takes an average measure of the queue length and randomly drop packets that are within a threshold between min th and max th . As a result, RED requires a wide range of parameters to operate correctly under different congestion scenarios. When RED parameters are not correctly defined, RED may perform even worse than the traditional tail drop policy [8,9].
To solve the problem of the parameter setting in RED, application of the control theory to solve the congestion problem has been considered since late 1990s [10]. In such 2 Mathematical Problems in Engineering approach, the main idea is to analyses the dynamic of TCP/AQM networks, build the mathematical models, and use the available tools to design and analyze suitable congestion controllers [11]. Based on the close loop system for the communication networks, several conventional controllers such as P, PI [12], PID [13], Lyapunov Drifts [14], and variable structure control (VSC) [15] have been designed as AQM scheme in TCP/AQM networks.
Due to inevitability of the time-variable parameters in network, some limitations and disadvantages are presented in the controllers mentioned above. For example, PI controllers are very sensitive to system parameter variations, and PID controller would generate a high fluctuation in queue length of router buffers [13]. Consequently, the controller seems necessary, which is of better performance in variable network condition. In [16], a self-regulating AQM controller has been proposed, which has been compared with RED and PI controllers in variable network parameters. However, it is known that self-regulatory control performs weakly in the presence of noise. In order to overcome this, congestion controller based on adaptive controller is presented in [17][18][19][20][21][22][23]. The parameters in conventional adaptive controllers would be considered as the infinite model identification [24].
Through the analysis above, the congestion control based on multiple model adaptive control (MMAC) is designed in this paper. Multiple model adaptive control [25][26][27][28] is considered as the finite model identification method, which uses the weight calculation rather than the parameters estimation. Simulation results indicate that the proposed multiple model adaptive congestion control (MMACC) is superior from queue length in bottleneck router, throughput for the data source, and drop ratio for the whole communication network of the conventional congestion control.
We believe that three aspects of this paper will make it interesting to general readers. Firstly, the congestion control algorithm based on the adaptive control is proposed in variable network condition. Secondly, the multiple model adaptive control is introduced in this paper based on the weight calculation instead of the parameter estimation in traditional adaptive control. Finally, the model set is introduced in the paper, which is composed by the dynamic model based on the fluid flow. The rest of the paper is structured as follows. The dynamic model of TCP/AQM in congestion control is discussed in Section 2. Section 3 investigates the design of our proposed MMACC for congestion control. Simulation results are presented in Section 4. Finally, Section 5 concludes the paper.

A Fluid-Flow Model of TCP Behavior
In this section, we overview the system model [29] for TCP and queue dynamics based on fluid-flow and stochastic differential equation analysis. This model describes a sample path of each long-lived TCP connection with an additive increase and multiplicative decrease (AIMD) strategy and is given by the following coupled, nonlinear differential equations: where is the average congestion window size (packets), is the average queue length (packets), ( ) = ( )/ ( ) + is the round trip time (secs), and is the probability of packet mark/drop in AQM, which takes value only in [0, 1]. , and denote the link capacity (packets/sec), the propagation delay (secs), and the connection number, respectively. 1/ ( ) indicates the additive increase strategy, and ( )/2 means the multiplicative decrease strategy. Simulation results demonstrated that this model accurately captured the dynamics of TCP. Hollot et al. [30] illustrated these differential equations in the block diagram of Figure 1 which highlights TCP window-control and queue dynamics.
Taking ( , ) as the state variables and as the reference input, the equilibrium point ( 0 , 0 , 0 ) is defined bẏ= 0 anḋ= 0, so that where the steady sate queue length 0 is the desired queue length in the buffer and ( ) ≡ 0 and ( ) ≡ 0 are assumed as constants.
Employing small signal linearization, we linearize the model (1) about equilibrium point and ignore the delay term. The simplified dynamics is given as (3) and assuming 0 ≫ 0 / 0 (which allows us to ignore the delay), the open loop transfer function of linearized system can be obtained as Remark 1. For typical network condition, 0 ≫ 1 is a reasonable assumption. Based on formula (2), we can get Discrediting (4) with sampling period using the bilinear -transformation = (2/ )((1 − −1 )/(1 + −1 )), the equivalent discrete system model of the linearized TCP/AQM can be written as follows:

Congestion Control Based on Multiple Model Adaptive Control
In this section, we present the proposed multiple model adaptive congestion controller. First, we describe the multiple model adaptive control taken into consideration. Then, we introduce the "local" congestion controller assigned in MMAC.

Remark 2.
According to the statistics of MCI, 95% of bytes and 90% of packets are transported within the TCP scheme [31]. So the non-TCP data traffics, such as UDP, are considered as the noise in congestion control model.
In order to estimate the online parameters, the output ( ) can be rewritten as where M = { , = 1, 2, . . . , } is the model set that may include the true model of the unknown plant P. Further, define as the output of . For each model ∈ M, its output error is given by A concise block diagram is shown in Figure 2 to represent an MMAC system, where "local" controller is designed where ( ) is the output of the "local" controller . Typically, controller weights ( ) are calculated through a bank of Kalman filters [32]. But in [28], a new algorithm is proposed which is simpler in ( ) calculation; that is, In other words, three "local" congestion controllers ( 1 , 2 , and 3 ) should be designed to stabilize the submodel , respectively.
Firstly, nonlinear output feedback control based on variable RTT (NOFC-VRTT, 1 ) [33] is designed according to nonlinear dynamic model (1); that is, . . . . . . The congestion window observer is chosen aṡ where The control parameters 1 and 2 should satisfy the following inequalities: Secondly, based on the linear state space model (3), the H 2 output feedback controller (H 2 OFC, 2 ) could be presented as  This controller could also be described in the frequency domain by the nonrational transfer function where the parameter matriceŝ0,̂1,̂,̂0,̂1, andâ re regulated by the linear matrix inequalities. A detailed description of the regulation could be seen in Section 3 of [34]. In the same time, the transfer function in the -domain is obtained by the bilinear -transformation.
Lastly, the classical proportional integral control (PI, 3 ) is adopted in the transfer function model (4), and the parameter tuning is discussed in paper [35]:

Simulation
In this section, we verify the proposed MMACC via simulation using the Ns-2 simulator. The benchmark network topology is addressed as shown in Figure 3. The following numerical values are considered as the system parameters: = 30 TCP sessions, = 0.1 s, 0 = 200 packets, and buffer size is 800 packets. Also, the bottleneck link bandwidth is 10 Mb/s with an average packet size of 500 byte which results in = 2500 packets/s. Using these parameters, we can calculate other parameters such as 0 , 0 , and 0 according to formula (2). Node is set up as the UDP sender with a 0.5 Mb/s bandwidth as discussed in Section 3.1. The sample frequency is 160 Hz, and the simulation period equals to 300 s. The parameters of the three "local" controllers are designed by the network simulation condition above.
In detail, the parameters of 1 are as follows: The parameters of 2 are calculated as = 1.547 − 9, = 0.3607.
And the parameters of 3 are  Figure 4 shows the instantaneous queue length of the bottleneck router in variable network condition. As depicted in Figure 4, the instantaneous queue length maintains round the equilibrium value. The simulation results show that MMACC has a good robustness when network condition changes or modeling is uncertain. Experiment 4. MMACC is considered as the linear combination of the NOFC-VRTT, H 2 OUT, and PI. In this simulation experiment, we compare the performance of the four congestion controllers. Figure 5 displays the queue length of the bottleneck router adopting the four congestion control strategies. It is indicated that MMACC has well disturbance attenuation and strong convergence. Tables 1 and 2 show that MMACC achieves a lower packet drop ratio and a higher link utilization than the other three congestion controls in variable network conditions. The simulation results show that MMACC provides better network performance and higher quality of service (QoS). On the other hand, PI controller omitted the high frequency part of the fluid model, and NOFC-VRTT controller only gave the range of the control  coefficient. So the performance of H 2 OFC is much better among the three "local" congestion controllers.

Conclusion
A new AQM method for TCP network based on multiple model adaptive control has been presented in the paper.
Mathematical Problems in Engineering 7 Three dynamic models based on the TCP/AQM fluid-flow mode have been designed for the MMAC. Then the proposed adaptive method regulates the weight of the "local" congestion controller. Simulation results demonstrate that the proposed MMACC scheme is able to preserve the queue length efficiently in the bottleneck router around the desired point. In addition, the superior performance of the proposed controller has been illustrated through the results obtained via Ns-2 simulation. In the MMACC, all of the "local" congestion controllers are queue-based AQM scheme. As the rate-based schemes, providing early feedback for congestion, the rate-based "local" congestion controller would improve our MMACC, which is the next step for us.