Enhanced Virtualization-Based Dynamic Bin-Packing Optimized Energy Management Solution for Heterogeneous Clouds

Chitkara University Institute of Engineering and Technology, Chitkara University, Patiala, Punjab, India KIET Group of Institutions, Ghaziabad, Delhi NCR, India Department of Information Technology, College of Computing and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia Govt. Bikram Colleges of Commerce, Patiala, Punjab, India LBEF Campus, Kathmandu, Nepal Chulalongkorn University, Bangkok, 4ailand


Introduction
Cloud computing is the trading of resources over the Internet with reliability and security of data [1,2]. e ease of accessing computing resources has attracted big organizations to avail the services from cloud computing on pay-peruse model. As the demand of digitization in current scenario is increasing, more customers are linking with cloud computing technology to get the benefits. Due to this, the total energy consumption has become a challenge for service providers as the situation will get even worse with coming days in the absence of suitable solution. e increasing energy is affecting the environment by increasing carbon footprints. In this direction, service providers started using the concept of virtualization. It is not worth to dedicate all resources of a single server to customer for completing the task, so multiple virtual instances are created on each server and instead of providing the server, cloud service provider assigns virtual machines to the customer with CPU capacity depending on the task to be executed by the customer. is process of creating virtual machines on server is known as virtualization [2] as shown in Figure 1. All the virtual machines share the resources of host server and provide service to the user. e software which provisions and maintains the virtual machines is hypervisor which can operate on hardware level or operating system level depending upon the configuration done by cloud service provider.
It is necessary to assign the VM to the server in very efficient manner so that the overall energy consumption can be turned down along with proper resource utilization. To overcome this problem, a technique of bin-packing [3] came into existence. According to bin-packing, all incoming VM requests are assigned to the server according to the CPU capacity available in server and CPU capacity required by the virtual machine.
e main role of bin-packing technique is to reduce number of active bins to lessen energy consumption. e basic heuristics of bin-packing technique which are prevalent in the cloud paradigm are as follows: (1) assigning VM to the first available physical host with required computing capacity (first-fit algorithm); (2) assigning the VM to the server such that after assignment, server has minimum available space (best-fit algorithm); and (3) assigning the VM to the server such that after assignment, server has maximum available space (worst-fit algorithm). Some other heuristics are also present like "first-fit decreasing (FFD)," "best-fit decreasing (BFD)," and "worst-fit decreasing (WFD)" which function like above-mentioned heuristics, but the difference is that all VMs are sorted in descending order of CPU capacity before allotting them to servers. erefore, as the bin-packing has an imperative importance in energy management solutions, the contributions of this research work are as follows: (i) A dynamic bin-packing energy-efficient solution is proposed that can increase resource utilization and thus assist service providers in extracting maximum cost benefit with the available resources. (ii) A dynamic bin-packing switcher-based solution is proposed that can reduce energy consumption by switching among the proposed and existing techniques that are consuming least energy in every pivot run. (iii) A detailed comparison study is done between proposed algorithms and existing algorithms. e organization of the paper is presented as follows. Section 2 illustrates an intensive survey of cloud-based binpacking heuristics. Section 3 discusses the proposed approaches. Section 4 exhibits results and discussion giving a comparative analysis of the proposed and existing approaches. Section 5 presents the conclusion.

Literature Review
e review of current state of research with respect to binpacking mechanisms is presented below.
Kumaraswamy S. et al. in [5] presented bin-packingbased virtual machine placement (VMP) methods for cloud data centers in terms of heuristics used, energy awareness, bandwidth awareness, and QoS awareness factors. e paper also explained resource-aware VMP scheme, power-aware VMP scheme, network-aware VMP scheme, and cost-aware VMP scheme. Bin-packing heuristics are very effective in reducing energy. Gbaguidi et al. in [6] presented an algorithm to handle initial assignment of VM to physical servers using Vmware hypervisor ESXi 5.5. e algorithm is based on first-fit decreasing algorithm of bin-packing and is compared with manual and brute force method of placement. Li et al. in [7] proposed a variant of dynamic binpacking named as "MinTotal DBP" problem to decrease the cost of servers. Competitive ratio of all packing algorithms (first-fit, best-fit, and any-fit) is analyzed for the problem. e paper also proposed a new algorithm, hybrid-first fit, with better competitive ratio.
Fatima et al. in [8] focused on virtual machine placement problem and proposed "particle swarm optimization algorithm with variable sized bin-packing." Simulation was done on MATLAB. e given algorithm was compared with earlier existing "particle swarm optimization" and a hybrid of "Lévy flight and particle swarm optimization" and showed good performance by decreasing number of active servers. Baker et al. in [9] presented a novel multi-cloud service computing approach, i.e., "Cloud-SEnergy." e experiments were stimulated using Java EE8. e experiment was conducted to compare Cloud-SEnergy's efficiency with multi-cloud environments. Tantawi and Steinder in [10] introduced "adaptive bin-packing" algorithm which used the variable demand and resources in cloud data center to provide optimized results in C language.
Karwayun in [11] discussed dynamic resource allocation scheme based on the bin-packing approach. ree algorithms, first fit bin-packing resource allocation algorithm, energy consumption calculator, dynamic VM reallocation, were proposed for which simulation was done on CloudSim.
ese algorithms combined the allocation and migration algorithms and were found to be efficient. Gupta and Katiyar in [12] proposed a new static bin-packing algorithm EU-BFD to minimize the energy consumption. e algorithm was compared with "low perturbation bin-packing algorithm," "best-fit decreasing," and "power and computing capacity-aware best-fit decreasing" algorithms and proved to be more energy-efficient algorithm.
Ali et al. in [13] described all the energy-efficient techniques like virtual machine selection methods, virtual machine placement methods, virtual machine migration methods, virtual machine scheduling methods, and virtual machine allocation methods with their pros and cons. Berndt et al. in [14] considered fully dynamic bin-packing problem by calculating the amount of repacking by the term "migration factor." e paper also explained the methods to handle large and small size items in dynamic environment. Kumaraswamy and Nair in [15] discussed virtual machine placement problem and proposed three algorithms-"3-slot first-fit decreasing algorithm, PTAS-3-slot algorithm, and 3slot random fit algorithm," in which virtual machines were divided into three classes. e paper showed that three algorithms are optimal solutions for virtual machine placement problem. Guo and others in [16] focused on reducing the number of active servers and proposed "multi-dimensional cloud resource dynamic allocation model (MDCRA)" based on VBPP (vector bin-packing problem) which had significantly reduced the number of used servers. Gupta and Katiyar in [17] proposed a framework for calculation of energy used for scheduling resources on physical machines. e framework was tested for existing bin-packing techniques. Aydın et al. in [18] worked on virtual machine placement problem where start time and end time were considered. e paper worked on binary programming approach to develop different policies by improved heuristic. e proposed heuristics can solve largescale problems with minimum optimality gaps. Kaaouache and Bouamama in [19] proposed a hybrid genetic algorithm "hybrid genetic best fit (HGBF_BP)" based on best-fit decreasing bin-packing algorithm for infeasible chromosomes. It was proved to be an effective virtual placement technique. Tang et al. in [20] discussed new approach to solve MinUsageTime problem using first fit packing algorithm and established a new upper bound. Ghaderi et al. in [21] worked on the asymptotic best-fit algorithm and showed that it minimizes the number of servers asymptotically.
Azar and Shepherd in [22] discussed "d-dimensional bin-packing problem" and proposed virtual VBP algorithm and load balancing VBP algorithm. Mohiuddin et al. in [23] discussed basic bin-packing algorithm like first fit and best fit and proposed "secure distributed adaptive bin-packing algorithm" for better storage and time requirement. Wang and Liu in [24] proposed a new energy-efficient model considering energy efficiency in cloud computing environment to improve the bin-packing algorithm. Komarasamy and Muthuswamy in [25] proposed a new approach "dynamic load balancing with effective bin-packing and VM reconfiguration" which used the deadline-based job scheduler of jobs and stored them in other data structure. After differentiation, the jobs are prioritized using various parameters. Sharma and Saini in [26] proposed a VM placement system based on genetic properties and compared it with other existing VM placement techniques based on bin-packing and found genetic algorithm more useful in VM placement.

Summary.
Based on exploration done in the field of binpacking with a vision to discover solutions for energy mitigation, following are the observations on the survey conducted: (i) Efficient bin-packing technique plays a vital role in reducing the total energy consumption in cloud data centers. (ii) e four basic heuristics for static bin-packing are LPBP, BFD, PCA-BFD, and EU-BFD.
(iii) Out of the four static algorithms, BFD utilizes server efficiently as it chooses the server in which the vacant space left after assignment of VM is least. (iv) Some dynamic bin-packing algorithms are already proposed that can reduce more energy than static algorithms but with the growth in technology, more efficacious dynamic heuristics are required which can work on multiple parameters like energy, resource utilization, makespan, and so on, while reducing energy to a better extent.
e observations laid down above has arisen a need to transform existing static solutions which becomes a base for energy mitigation initiative into Dynamic one and should also possess characteristics of quality improvement. e need for this switch is presented as follows: (i) Nowadays, every organization is shifting towards digitization and their requirements have become heterogeneous and dynamic. e ever-increasing user requests across geographical boundaries have restricted these static algorithms in the current scenario and have forced the cloud management system to shift to dynamic approaches for each individual process. ough a number of dynamic solutions have been proposed in recent years, each solution was inclined towards reducing energy to some extent and was overlooking the performance of the cloud system as a whole.
(ii) As energy consumption has increased, it has led to a global impact resulting in high global warming, which has thus put extra overhead of escalated cost of service offering on service providers resulting in high cost on customers for service extraction. As the cloud is not comprised of a single user but has been implanted via a number of entities in form of both service providers and customers, it becomes imperative to address the solutions that can provide monetary benefits to both the participating entities. Reduced energy consumption can be achieved with newer solutions that can turn off servers by shifting their load on other operational servers.
erefore, dynamic energy management solutions are essentially required and are of utmost importance to cater to the ever-changing and escalating customer requirements without compromising the quality-of-service delivery in order to retain trust of user on automated systems. us, next section explains the contributions of the present research in the form of proposed approaches or heuristics.

Proposed Approaches
e increased energy usage by the cloud data centers has increased the effect of global warming [29] and the calculated cost of using computing resources online [30,31]. e inclination of bin-packing heuristics is towards reducing number of active servers for energy mitigation [4] in heterogeneous environment. In inception, the existing basic static algorithms [12]-low perturbation bin-packing To give better results in terms of energy consumption, two dynamic algorithms-dynamic energy efficient-best-fit decreasing (DEE-BFD) and EM switcher (energy mitigation switcher)-are proposed. e proposed approaches have the following characteristics: (i) Virtual machine is dedicated for one task only. (ii) Execution time of VM is taken to determine the lifetime of VM and algorithm itself removes the VM from server on its completion. (iii) After a specified time interval, VMs waiting for execution are allotted to the servers and energy consumption is calculated for each run. (iv) Once all VMs complete the tasks, resource utilization and makespan [28] value are calculated and can be used for improving the performance of servers.  Table 1.
After detailed discussion on the mathematical equations, the bin-packing algorithms are explained below.

Dynamic Energy Efficient-Best-Fit Decreasing (DEE-BFD)
Algorithm. Initially, the CPU capacity and power requirement of N servers and M virtual machines are entered as input. Firstly, servers are sorted based on power capacity and virtual machines are sorted in decreasing order of CPU capacity. en, M VMs are allotted to N servers. After every S seconds, new VM requests are allotted to server and energy consumption is calculated. After all runs, resource utilization and makespan are calculated to examine the overall data center's performance as shown in Figure 2. e algorithmic approach is presented below.

EM Switcher.
All the bin-packing algorithms can reduce the energy consumption depending on the user's request and available resources present in the cloud data centers. Any one algorithm cannot be considered as the best algorithm which can reduce the energy consumption in all situations, so a new algorithm is proposed which switches between the algorithms and implements the algorithm which uses least energy for the complete assignment. e detailed working of EM switcher algorithm is shown in Figure 3 which starts from data generation by different sectors followed by storage and processing of data at cloud data centers with the aim to complete the tasks with minimum energy consumption and better resource utilization. e next section presents the detailed analysis of the proposed approaches followed by discussion on the results.

Results and Discussion
e bin-packing approach revolves around the implementation of 4 prime techniques, namely, LPBP, BFD, PCA-BFD, and EU-BFD [12]. e techniques are static in nature as indicated above and have been converted into dynamic one for comparison with the proposed approaches DEE-BFD and EM switcher. Simulation is done on Java Computing capacity utilization factor of server i as a function of placement "F" and time "t" U i (F,t) � (CPU_util i )/(CPU i ) [27] P i (F,t) Utilized power of i th server Total power consumption � P i (F,t) for i � 1 to N, where P i (F,t) � 0.7 * P i + (0.3 * P i * U i (F,t)) for i th server [27]  Duration between first job submission and last job completion Makespan i � R i�1 [27] programming language with considered configuration as follows: upper limit for computing capacity of a server is 5000, computing capacity of a virtual machine is 1500, and power capacity of a server is 450. e assumptions for the simulation are as follows. (1) Sufficient servers are available in cloud data center. (2) Servers are compatible to provide required computing power to the VMs. For the simulation, 10 servers were taken with following configuration as presented in Table 2. A finite number of VM requests were sent on servers to analyze the energy usage, resource utilization, and makespan of servers for mentioned algorithms. e VM configurations entered for two such pivot runs are presented in Tables 3 and 4.  Figure 3: Workflow of EM switcher algorithm.   Enter CPU capacity and power requirement for N servers. While true If VMs are waiting in job Enter CPU capacity and execution time frame for M virtual machines Apply algorithms dynamic low perturbation bin-packing, dynamic best-fit decreasing, dynamic power and computing capacity aware best-fit decreasing, dynamic energy utilized best-fit decreasing, and dynamic energy efficient-best-fit decreasing on the current configuration of servers and virtual machines Compute total energy/power utilized by data center using utilization factor in all algorithms. Compare the energy consumption value for individual algorithm. Implement the algorithm with minimum energy for current run. End If End While Evaluate the total resource utilization and makespan of servers. ALGORITHM 2: EM switcher (energy mitigation switcher).  Considering the above-mentioned server and VM configuration, two consecutive runs were conducted, and energy consumption is calculated for each run along with resource utilization and makespan at the end of second run. e results of the simulation runs are presented in Table 5. e abbreviations used in Table 5 are as follows: E1-energy consumption after first run, E2-energy consumption after second run, RU-resource utilization after both runs, and MS-makespan after both runs.
According to Table 5, graphs are plotted for each parameter to study the comparative analysis of all dynamic bin-packing algorithms in terms of energy consumption, makespan, and resource utilization as shown in

Mathematical Problems in Engineering
According to Figures 4-9, EM switcher provides maximum energy reduction among all dynamic algorithms and DEE-BFD provides maximum reduction in makespan and maximum increment in resource utilization. e overall performance can be improved by working on individual parameters like energy consumption, makespan, and resource utilization.

Conclusion
Virtualization and bin-packing are key techniques used to reduce energy by creating multiple virtual machines and turning down the number of active bins in data centers. In this paper, the two new bin-packing algorithms are proposed, DEE-BFD and EM switcher. e performance of these algorithms is compared with other existing algorithms on same input values in Java. After execution of each slot of VMs, energy is computed to get the performance matrix of data center, and at any moment, cloud service provider can calculate the resource utilization and makespan for further improvement in resource efficiency. After the analysis, it has been observed that the DEE-BFD provides the best resource utilization and EM switcher provides reduced energy consumption and makespan. ough the algorithms are proficient in their working and are giving better results in comparison to the existing techniques, still shifting or balancing of load is required considering the situations of failure of server irresponsiveness due to heavy load. us, as a future work, subsequent to implementation of above approaches, strategies for live migration need to be explored and solutions should be proposed to avoid problems of server irresponsiveness.

Data Availability
e data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest
e authors declare that they have no conflicts of interest.

Authors' Contributions
Neha Gupta was responsible for conceptualization, formal analysis, methodology, and initial draft preparation. Kamali Gupta wrote the original draft and performed supervision. Deepali Gupta was responsible for visualization and project administration. Sapna Juneja conducted formal analysis. Gaurav Dhiman reviewed and edited the article. Sandeep  Kautish was responsible for the final supervision of the paper. Hamza Turabieh and Wattana Viriyasitavat performed the final review of the article.