The Scientific World Journal

Volume 2014 (2014), Article ID 176718, 16 pages

http://dx.doi.org/10.1155/2014/176718

Research Article

Improved Bat Algorithm Applied to Multilevel Image Thresholding

Adis Alihodzic¹ and Milan Tuba²

¹Faculty of Mathematics, University of Sarajevo, 71000 Sarajevo, Bosnia And Herzegovina

²Faculty of Computer Science, Megatrend University Belgrade, 11070 Belgrade, Serbia

Received 25 April 2014; Accepted 28 June 2014; Published 3 August 2014

Academic Editor: Xin-She Yang

Copyright © 2014 Adis Alihodzic and Milan Tuba. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Multilevel image thresholding is a very important image processing technique that is used as a basis for image segmentation and further higher level processing. However, the required computational time for exhaustive search grows exponentially with the number of desired thresholds. Swarm intelligence metaheuristics are well known as successful and efficient optimization methods for intractable problems. In this paper, we adjusted one of the latest swarm intelligence algorithms, the bat algorithm, for the multilevel image thresholding problem. The results of testing on standard benchmark images show that the bat algorithm is comparable with other state-of-the-art algorithms. We improved standard bat algorithm, where our modifications add some elements from the differential evolution and from the artificial bee colony algorithm. Our new proposed improved bat algorithm proved to be better than five other state-of-the-art algorithms, improving quality of results in all cases and significantly improving convergence speed.

1. Introduction

Image segmentation is process of subdivision of an image into homogeneous and disjoint sets sharing similar properties such as intensity, color, and contours. Homogeneous sets are introduced with respect to a certain criterion of homogeneity. Image segmentation usually represents the first step in image understanding and representation and the results obtained by segmentation are used for further high-level methods such as feature extraction, semantic interpretation, image recognition, and classification of objects. In general, image segmentation simplifies the process of dividing an image into regions that are used for further specific applications. Several practical applications cover character recognition [1], detection of video changes [2], medical imaging [3, 4], automatic target recognition [5], and so forth. Over the last few decades a lot of algorithms for image segmentation, either for gray level or color images, were presented in the literature. Good review of these algorithms can be found in [6]. In general, image segmentation algorithms can be grouped into thresholding, edge-based, region-grow, and clustering.

Image thresholding is one of the most widespread segmentation techniques that performs image segmentation based on the information contained in the global gray value of the image histogram. Thresholding is called bilevel thresholding in the case that an image is separated into two classes, one including those pixels with gray levels above a specified threshold and the other including the rest. Unlike bilevel thresholding, multilevel thresholding performs subdivision of an image into several classes. In this case the pixels belonging to the same class take gray levels from the intervals defined by successive thresholds. Multiple pixels belonging to the same class are not always homogeneous and may be represented by different feature values. Selection or computing of the multilevel thresholds is crucial in image segmentation since proper segmentation depends on adequately computed thresholds.

There are many different methods for computing the thresholds for an image such as maximizing the gray level variance [7], entropy [8], similarity [9], and measure of fuzziness [10]. In general, thresholding methods can be divided into parametric and nonparametric methods. Using parametric methods, such as a novel image thresholding method based on Parzen window estimate [11], nonsupervised image segmentation based on multiobjective optimization [12], a multilevel thresholding approach using a hybrid optimal estimation algorithm [13], and optimal multithresholding using a hybrid optimization approach [14], may involve the solution of nonlinear equations which increases of the computational complexity. Therefore, the nonparametric methods [15] are introduced for finding the thresholds by optimizing some discriminating criteria. Among the mentioned different thresholding criteria, the entropy is the most popular optimization method. Using the entropy of the histogram, Pun was the first to introduce a new method for gray level image thresholding [8]. Later, this method was corrected and improved by Kapur et al. [16], since Kapur found some artifacts in Pun’s method. Sahoo used Shanon’s concept of entropy, considering two probability distributions for background and foreground objects. He has proposed a thresholding technique based on Renyi’s entropy [17]. Information about the gray value of each pixel and the average value of its immediate neighborhood are obtained by two-dimensional entropy which is calculated by two-dimensional histogram.

Another important group of methods based on discriminant analysis is the clustering-based methods [18]. In these methods, gray values are clustered into several classes, so that there is a similarity of gray values within the class and dissimilarity between classes. To perform the separation of classes, Otsu has developed a thresholding method for computing the optimal thresholds by maximizing the between-class variance using an exhaustive search [7]. It has been shown that this method gives acceptable results when the number of pixels in each class is close to each other. For bilevel image thresholding, the above-mentioned methods are effective. However, for the optimal multilevel thresholding, the existing conventional methods are being hindered by an exhaustive search when the number of thresholds is increased. To overcome this problem, powerful metaheuristics are used to search for the optimal thresholds in order to achieve a fast convergence and reduce the computational time.

Metaheuristics are optimization methods that orchestrate an interaction between local improvement procedures and higher level strategies to create a process capable of escaping from local optima and performing a robust search of a solution space [19, 20]. Several metaheuristic algorithms derived from the behavior of biological and physical systems in the nature have been proposed as powerful methods for searching the multilevel image thresholds. Since magic algorithm that works for all problems does not exist [21], different approaches have been developed for different classes of problems such as combinatorial or continuous, with additions for constrained optimization problems [22]. Original versions of metaheuristic algorithms are often modified or hybridized in order to improve performance on some classes of problems. The most popular nature-inspired algorithms for optimization, with improvements, adjustments, and hybridizations, include particle swarm optimization (PSO) [23], differential evolution (DE) [24], firefly algorithm (FA) [25, 26], cuckoo search (CS) [27–29], ant colony optimization [30–33], artificial bee colony algorithm [34–38], bat algorithm (BA) [39, 40], and human seeker optimization (HSO) [41–43].

DE algorithm has been adapted for searching the optimal multilevel thresholds [44]. PSO algorithm modified by Yin to search for the thresholds can be found in [45]. Akay presented a comprehensive comparative study of the ABC and PSO algorithms for finding multilevel thresholds using Kapur’s and Otsu’s criteria [46]. Maitra and Chatterjee proposed an improved variant of PSO algorithm for the task of image multilevel thresholding [47]. The results showed that the ABC algorithm with both the between-class variance and the entropy criterion can be efficiently used in multilevel thresholding. Hammouche focused on solving the image thresholding problem by combining between-class variance criterion with metaheuristic techniques such as GA, PSO, DE, ACO, SA, and TS [48].

In this paper, we adapted the bat algorithm for multilevel image thresholding. Bat algorithm is simple to implement and produces good results. However, based on our experiments, it is powerful in intensification, but at times it may get trapped into local optima when it is applied to some difficult problems. Therefore, we propose an improved version of bat algorithm adopted to search for multilevel thresholds using Kapur and Otsu criteria. Our proposed modification merges three approaches to produce a new improved bat-inspired (IBA) algorithm according to the principle of bat algorithm, differential evolution, and some scout technique taken from the ABC algorithm. We compared our proposed algorithm with state-of-the-art algorithms from [49]. The experimental results show that the proposed IBA algorithm always gives better results compared to PSO, DE, CS, FA, and BA algorithms, considering both accuracy and, especially, convergence speed.

The remainder of the paper is organized as follows. Section 2 describes the multilevel thresholding problem and presents Kapur’s and Otsu’s objective functions. Section 3 and Section 4 describe the original BA and IBA algorithms adopted to search for the optimal multilevel thresholds, respectively. Section 5 shows the experimental and comparative results of applying PSO, DE, CS, FA, BA, and IBA to multilevel segmentation to standard benchmark images. Finally, our conclusions are discussed in Section 6.

2. Multilevel Image Thresholding

Thresholding technique performs image segmentation based on the information contained in the image histogram. If we consider a gray-scale input image as a set of pixels , multilevel thresholding can be defined as a method of dividing the set into disjoint subsets by some numbers such that

where is a pixel defined by coordinates and in the Cartesian coordinate system, presents a gray level value of pixel , and the takes values in the range . The aim of multilevel thresholding is to compute the optimal threshold values . The sets may represent different regions of the object. It is clear that , and their union presents the whole input image .

Optimal threshold selection for bilevel thresholding is not computationally expensive, while for multilevel thresholding, computing more than few optimal threshold values is an expensive and time consuming operation. The optimal threshold values can be determined by optimizing some criterion functions defined from the histogram of image. In this paper, we use two popular threshold criteria: Kapur’s entropy criterion and Otsu’s between-class variance criterion.

2.1. Kapur’s Thresholding Method

Entropy is a measure of uncertainty proposed by Shannon [50], later widely used [51]. Let be a discrete random variable taking values with probabilities , , respectively. Then its entropy is defined by

The Kapur’s method [16] based on the entropy is used to perform multilevel thresholding. For this method, the threshold criteria can be formulated as follows. Assume that an image contains pixels with gray levels belonging to the set . Let present the number of pixels at gray level , and is the probability of occurrences of gray level in the image . The subdivision of an image into classes can be considered as a -dimensional optimization problem for the calculation of optimal thresholds . The optimal thresholds are obtained by maximizing the objective function:

where the entropies are defined by

2.2. Otsu’s Thresholding Method

Otsu’s method [7] based on the maximization of the between-class variance is one of the most popular methods proposed for image thresholding. The algorithm for this method can be described as follows. Assume that an image can be represented by gray levels. The probabilities of pixels at level are denoted by so and . Cumulative probabilities for classes , , can be defined as

where are the thresholds separating these classes. For classes , , the goal is to maximize the objective function:

where the sigma functions are defined by

3. Bat Algorithm Adapted for Multilevel Image Thresholding

Bat algorithm is a recent metaheuristic introduced by Yang [39], based on so-called echolocation of the bats. In this algorithm, bats detect prey and avoid the obstacles by using the echolocation. Bat algorithm was successfully applied to a number of very different problems like large-scale optimization problems [52], global engineering optimization [53], fuzzy clustering [54], parameter estimation in dynamic biological systems [55], multiobjective optimization [56], image matching [57], economic load and emission dispatch problems [58], data mining [59], scheduling problems [60], neural networks [61], and phishing website detection [62].

In the bat algorithm, bats navigate by using time delay from emission to the reflection. The pulse rate can be simply determined in the range from to , where means that there is no emission and means that the bat’s emitting is at maximum. Apart from the control parameters, such as the population size and maximum iteration number which are common control parameters for all nature inspired algorithms, the BA has few important parameters such as frequency tuning parameter similar to the key feature used in the PSO and HS, parameter for automatically zooming into a region where the promising solutions have been found, and the control parameter for automatically switching from exploration to exploitation. This gives advantage to the BA over other metaheuristic algorithms in the literature.

In order to implement the bat algorithm, the following three idealized rules are used [39]:

 (i) all bats use echolocation to sense distance, and they also “know” the surroundings in some magical way; (ii) bats fly randomly with velocity at position with a fixed frequency , varying wavelength , and loudness to search for prey. They can automatically adjust the wavelength of their emitted pulses and adjust the rate of pulse emission from , depending on the proximity of their target;(iii) although the loudness can vary in many ways, it is assumed that the loudness varies from a positive large value to a minimum constant value .

The proposed bat algorithm tries to select threshold values which maximize the fitness functions which are described by (3) and (6), respectively. The details of the developed BA approach for multilevel image thresholding are given as follows.

Step 1 (generate initial population of solutions). The bat algorithm generates a randomly distributed initial population of solutions (bats) , where each solution has dimensions. All solutions can be presented by matrix :

where is the component value that is restricted to and for all . The fitness values for all solutions are evaluated and variable is set to one. The bat algorithm detects the most successful solution as before starting iterative search process.

Step 2 (calculation of new solutions). Calculation of a new solution is performed by moving virtual bats according to equation

where denotes the bat velocity of movement, and it is calculated by formula

In (10), denotes the frequency and denotes the current global best solution. The frequency can be calculated as

where is a random vector generated by a uniform distribution belonging to the closed interval . For min and max frequency, the recommended values and are used. In this computation step, the bat algorithm controls the boundary conditions of the calculated new solution . In the case that the value of a variable overflows the allowed search space limits, then the value of the related variable is updated with the value of the closer limit value to the related variable.

Step 3 (improving the current best solution). For each solution apply the next operator which is defined by

where is a uniform random number in range , is a scaling factor drawn from uniform distribution in the range , is the average loudness of all bats at the computation step , and is the pulse rate function. The pulse rate function is defined by

where is a constant and are initial pulse rates in the range . It can be seen from (12) that this function controls the intensive local search depending on the value of uniform variable and the rate . Also, at this step, the BA controls the boundary conditions at each iteration.

Step 4 (acceptation of a new solution by flying randomly). In this step, the solution obtained in Step 3 is accepted as a new solution and as a new objective function value by using

where is a uniform random number in range and is the loudness function defined by

where is a constant and plays a similar role as the cooling factor of a cooling schedule in the simulated annealing. Therefore, if the solution has the higher objective function value compared to the old solution and the loudness is more than , then the new solution is accepted, the old fitness value is updated, and functions defined by (13) and (15) are updated, too. Otherwise, the new solution is abandoned, and the old best solution is kept.

Step 5 (memorize the best current solution). Record the best solution so far (), that is, the solution with the highest objective function value.

Step 6 (check the stopping criteria). If the termination criterion is met or the variable is equal to the maximum number of iterations, then the algorithm is finished. Otherwise, increase the variable by one and go to Step 2.

4. Our Proposed Improved Bat Algorithm: IBA

As described in the previous section, we selected the BA for multilevel image thresholding. BA is simple to implement and it produces good results when the number of thresholds is small. However, based on our experiments, the BA algorithm often fails when the number of thresholds is larger, especially for the Kapur’s objective function. Therefore, an adjustment of the bat algorithm was required. In this paper, the improved hybridized bat algorithm (IBA) is proposed to overcome the mentioned drawback of the pure bat algorithm. It combines two different solution search equations of the bat algorithm and DE algorithm [24]. The IBA algorithm includes differential operators mutation and crossover from DE algorithm, with the aim of speeding up convergence and to achieve a good balance between intensification and diversification. Mutation and crossover operators are used to improve the original BA generation of a new solution for each bat so that the IBA can more efficiently explore and exploit the new search space and avoid being trapped into local optima.

In the pure BA, exploration and exploitation are controlled by pulse rate function (13). Analyzing this function we noticed that the algorithm loses exploration capability as iterations progress. The form of this function makes switching from the exploration to exploitation and vice versa possible. In this way, the exploration capability of BA can be modified by inserting differential operators for crossover and mutation [24] instead of (12) and for the exploitation capability (12) continues to be used for a good intensification. Therefore, a good balance is established between intensification and diversification.

Although the above modification can improve many solutions, some solutions will still remain stuck in some local optimum. In order to fix this lack of the former modification, we introduced the second modification which is inspired by launch of the scouts in the scout phase of the ABC algorithm. When some solution gets trapped in a local optimum after a certain number of iterations, it will eventually exceed the predetermined number of allowed trials called “limit.” When a solution exceeds the “limit” trials unchanged, it is redirected to search new space by using the random walk.

In the proposed IBA algorithm, bats form a population of threshold values. The threshold values produced by the bat are noted as , . All bats perform searching in the solution search space with the aim to optimize the objective functions described by (3) or (6). The details of the proposed IBA approach for multilevel thresholding are given as follows.

Step 1 (generate the initial population of solutions). The IBA begins by randomly generating population with dimensions as in the case of the proposed BA approach for multilevel thresholding. Each threshold value of the matrix generated by the bat is restricted to set and for all holds . Also, at this step initialization is done for the parameter limit which presents the number of allowed attempts to improve a bat, the initial loudness and pulse rate , as well as the initial values of the parameters in the DE algorithm such as the differential weight and crossover probability . After generation of the initial population, the fitness value for each solution is evaluated. Then the IBA algorithm detects the most successful solution as , before starting iterative search process. After that it sets the variable to one.

Step 2 (calculate the new population). Calculation of a new threshold is performed by moving virtual bats according to (9). The velocity and frequency are calculated by (10) and (11), respectively. At this computation step, the IBA controls the boundary conditions of the calculated new solution . In the case that the value of the is less than or is more than , then the value of the is updated with the value of the closer limit value to the variable .

Step 3 (improving the current best solution by differential operators). For each solution apply the next operator which is defined by

where is randomization term in the range , is the pulse rate function defined by (13), is the differential operator for mutation and crossover, and is the operator based on the local search in the BA. The differential mutation and crossover operations are performed by

where , , and are three randomly chosen different vectors in the range at the cycle , is the differential weight that scales the rate of modification, is the crossover probability in the interval , is randomly selected in the range , and is a uniform variable in the range . Inside the implementation of the differential operator , the boundary conditions for all are controlled. As an important improvement of the proposed method, the binomial “DE/rand/1/bin” scheme is used in order to increase the diversity of the bats and achieve both the precision and search efficiency. The local search is performed by

where is defined by

As in the ordinary BA, parameters and denote the scaling factor and the loudness function, respectively. Also, inside the local search operator , the boundary conditions for all are checked. In our proposed approach, we found that it is beneficial to replace (13) by . It will be shown in experimental study that the best results are obtained for initial pulse rates , initial loudness , and .

Step 4 (acceptation of a new solution by flying randomly). In this step, the solution obtained in Step 3 is accepted as a new solution and as a new objective function value by using

where is a random number in the range , is a vector recording the number of attempts through which solution could not be improved at cycle , and is defined by (15). In the above equation, if the solution cannot be improved, then the new solution is abandoned and the element of the trial vector tr is increased by one. Also, after certain number of cycles determined by the variable limit, if the solution cannot be further improved, it is abandoned and replaced by randomly generated solution. In this case, the element of the trial vector is set to . This modification can improve the exploration process and it will help to avoid trapping into some local optima. Also, it will improve the solution quality and speed convergence.

Step 5 (memorize the best current solution). Record the best solution so far (), that is, the solution with the highest objective function value.

Step 6 (check the stopping criteria). If the termination criterion is met or the variable is equal to the maximum number of iterations, then the algorithm is finished. Otherwise, increase the variable by one and go to Step 2.

5. Experimental Results

The multilevel image thresholding problem deals with finding optimal thresholds within the range that maximize the functions defined by (3) and (6). The dimension of the optimization problem is the number of thresholds , and the search space is . In this study our proposed IBA algorithm was compared against four other standard population based metaheuristic techniques: PSO, DE, CS, and FA from [49] and pure BA.

The experiments were conducted on 6 standard images, the same as used in [49], in order to make comparison of the obtained results simpler. Images used in this paper, namely, Barbara, Living room, Boats, Goldhill, and Lake, are of size and Aerial has size . Barbara and Boats images are available at http://decsai.ugr.es/~javier/denoise/test_images/. The Living room and Lake images were chosen from http://www.imageprocessingplace.com/root_files_V3/image_databases.htm. The Goldhill image can be found at https://ece.uwaterloo.ca/~z70wang/research/quality_index/demo.html. The Aerial image was taken from the University of Southern California Signal and Image Processing Institute’s image database at http://sipi.usc.edu/database/database.php?volume=misc. These original images and their gray level histograms are depicted in Figures 1 and 2, respectively.

(a)

(b)

(c)

(d)

(e)

(f)

Figure 1: Test images: (a) Barbara, (b) Living room, (c) Boats, (d) Goldhill, (e) Lake, and (f) Aerial.

(a)

(b)

(c)

(d)

(e)

(f)

Figure 2: Gray-level histogram of test images: (a) Barbara, (b) Living room, (c) Boats, (d) Goldhill, (e) Lake, and (f) Aerial.

For the Kapur’s and Otsu’s thresholding methods, the exhaustive search method was conducted first to derive the optimal solutions, the corresponding optimal objective function values, and the processing time for comparison with the results generated by the PSO, DE, CS, FA, BA, and IBA algorithms. These results generated by the exhaustive search for Kapur’s and Otsu’s criterion are presented in Tables 1 and 2, respectively. It is obvious that computational times increase exponentially and for more than 5 thresholds become unacceptable. We did not implement optimal use of multicore processor, but improvements would not be significant.

Table 1: Thresholds, objective function values, and time processing provided by the exhaustive search for Kapur’s method.

Images

Threshold values
Objective function
Time (ms)

Barbara
2
96, 168
12.668336540
25

3
76, 127, 178
15.747087798
341

4
60, 99, 141, 185
18.556786861
11103

5
58, 95, 133, 172, 210
21.245645310
666869

Living room
2
94, 175
12.405985592
31

3
47, 103, 175
15.552622213
339

4
47, 98, 149, 197
18.471055578
12612

5
42, 85, 124, 162, 197
21.150302316
478114

Boats
2
107, 176
12.574798244
25

3
64, 119, 176
15.820902860
342

4
48, 88, 128, 181
18.655733570
11461

5
48, 88, 128, 174, 202
21.401608305
469862

Goldhill
2
90, 157
12.546393623
24

3
78, 131, 177
15.607747002
329

4
65, 105, 147, 189
18.414213765
11958

5
59, 95, 131, 165, 199
21.099138996
399458

Lake
2
91, 163
12.520359742
24

3
72, 119, 169
15.566286745
336

4
70, 111, 155, 194
18.365636309
12658

5
64, 99, 133, 167, 199
21.024982760
410753

Aerial
2
68, 159
12.538208248
29

3
68, 130, 186
15.751881495
347

4
68, 117, 159, 200
18.615899102
11390

5
68, 108, 141, 174, 207
21.210455499
599570

Table 2: Thresholds, objective function values, and time processing provided by the exhaustive search for Otsu’s method.

Images

Threshold values
Objective function
Time (ms)

Barbara
2
82, 147
2608.610778507
39

3
75, 127, 176
2785.163280467
89

4
66, 106, 142, 182
2856.262131671
3014

5
57, 88, 118, 148, 184
2890.976609405
100079

Living room
2
87, 145
1627.909172752
39

3
76, 123, 163
1760.103018395
88

4
56, 97, 132, 168
1828.864376614
2945

5
49, 88, 120, 146, 178
1871.990616316
130397

Boats
2
93, 155
1863.346730649
38

3
73, 126, 167
1994.536306242
89

4
65, 114, 147, 179
2059.866280428
2931

5
51, 90, 126, 152, 183
2092.775965336
75879

Goldhill
2
94, 161
2069.510202452
38

3
83, 126, 179
2220.372641501
88

4
69, 102, 138, 186
2295.380469158
2775

5
63, 91, 117, 147, 191
2331.156597921
74674

Lake
2
85, 154
3974.738214185
39

3
78, 140, 194
4112.631097687
89

4
67, 110, 158, 198
4180.886161109
2613

5
57, 88, 127, 166, 200
4216.943583790
73019

Aerial
2
125, 178
1808.171050536
46

3
109, 147, 190
1905.410606582
103

4
104, 134, 167, 202
1957.017965982
2670

5
99, 123, 148, 175, 205
1980.656737348
99880

The number of thresholds explored in the experiments were 2, 3, 4, and 5. Since metaheuristic algorithms have stochastic characteristics, each experiment was repeated times for each image and for each value. Each run of an algorithm was terminated when the fitness value of the best solution reached the known optimal value (from the exhaustive search) of the objective function , that is, , where was a tolerance for the accuracy of the measurement. Hence, the stopping condition for all algorithms was the value of the fitness, unless optimum could not be reached within 2000 iterations.

The proposed IBA method has been implemented in programming language, as the rest of the algorithms. Results for CS and FA are from [49]. All tests were done on an Intel Core i7-3770K @3.5 GHz with 16 GB of RAM running under the Windows 8 x64 operating system. The PSO and DE algorithms have been implemented in their basic versions, while the BA and IBA have been implemented as it was described in the previous two sections.

5.1. Parameters Setup

To compare the proposed IBA algorithm with PSO, DE, CS, FA [49], and BA algorithms, the objective function evaluation was computed times, where is the population size and is the maximum number of generations (unless optimum was reached earlier). The population size in all algorithms was set to and the number of generation is set to for all algorithms, as in [49]. Besides these common control parameters, each of mentioned algorithms has additional control parameters that directly improve their performance. For both the proposed IBA and pure BA algorithms, the additional control parameters and were set to and , respectively. The initial values for parameters and loudness were set to and , respectively. The constant was set to . Instead of the average loudness of all bats, we found that the value was acceptable for all images. In the proposed IBA algorithm, control parameters introduced from DE algorithm, such as differential weight and crossover probability , were set to and , respectively. Also, in the IBA method, the parameter limit was set to .

5.2. Quality and Computational Analysis of the Results

The mean and standard deviations for 50 runs for six tested metaheuristic algorithms have been calculated and are presented in Table 3 for the experiments based on Kapur’s entropy and in Table 4 for the experiments based on Otsu’s objective function. These mean values can be compared to the optimal values of the corresponding objective functions found by an exhaustive search from Tables 1 and 2.

Table 3: Comparison of the mean values and standard deviations obtained for the PSO, DE, CS, FA, BA, and IBA based on Kapur’s entropy criterion for six test images over 50 runs.

Alg.

Barbara
Living room
Boats
Goldhill
Lake
Aerial

Mean values
St. Dev.
Mean values
St. Dev.
Mean values
St. Dev.
Mean values
St. Dev.
Mean values
St. Dev.
Mean values
St. Dev.

PSO
2
12.668336540

12.405792709

12.574798244

12.546393623

12.520359742

12.538208248

3
15.747087798

15.552015642

15.820679619

15.607747002

15.566286745

15.751881495

4
18.549612938

18.467328310

18.640100415

18.414173744

18.357505953

18.615899102

5
21.241857967

21.131564234

21.392020144

21.099092699

21.015922726

21.192396874

DE
2
12.668336540

12.405985592

12.574798244

12.546393623

12.520359742

12.538208248

3
15.747087798

15.552578874

15.820902860

15.607743578

15.566286745

15.751881495

4
18.556749938

18.470970822

18.655660844

18.603017275

18.365579671

18.615769177

5
21.245566656

21.149062508

21.401458219

21.409946039

21.024780111

21.210411012

CS
2
12.668336540

12.405985592

12.574798244

12.546393623

12.520359742

12.538208248

3
15.747087798

15.552622213

15.820902860

15.607747002

15.566286745

15.751881495

4
18.556786861

18.471055578

18.655733570

18.414197322

18.365636309

18.615899102

5
21.245645311

21.149400604

21.401608305

21.099125539

21.024962923

21.210455499

FA
2
12.668336540

12.405985592

12.574798244

12.546393623

12.520359742

12.538208248

3
15.747087798

15.552622213

15.820902860

15.607747002

15.566286745

15.751881495

4
18.556786861

18.471014902

18.655723798

18.414213765

18.365636309

18.615899102

5
21.245645311

21.149483979

21.401583877

21.099138996

21.024982760

21.210455499

BA
2
12.668336540

12.405885825

12.574798244

12.546393623

12.520359742

12.538208248

3
15.747087798

15.552622213

15.820902860

15.607747002

15.566286745

15.751881495

4
18.555593147

18.469796068

18.644796771

18.414213765

18.356346829

18.615899102

5
21.245645311

21.133082528

21.399205241

21.099138996

21.024982760

21.210452617

IBA
2
12.668336540

12.405985592

12.574798244

12.546393623

12.520359742

12.538208248

3
15.747087798

15.552622213

15.820902860

15.607747002

15.566286745

15.751881495

4
18.556786861

18.471055578

18.655733570

18.414213765

18.365636309

18.615899102

5
21.245645311

21.150302316

21.401608305

21.099138996

21.024982760

21.210455499

Table 4: Comparison of the mean values and standard deviations obtained for the PSO, DE, CS, FA, BA, and IBA based on Otsu’s criterion for six test images over 50 runs.

Alg.

Barbara
Living room
Boats
Goldhill
Lake
Aerial

Mean values
St. dev.
Mean values
St. dev.
Mean values
St. dev.
Mean values
St. dev.
Mean values
St. dev.
Mean values
St. dev.

PSO
2
2608.610778507

1627.909172752

1863.346730649

2069.510202452

3974.738214185

1808.171050536

3
2785.163280467

1760.103018395

1994.536306242

2220.372641501

4112.631097687

1905.410606582

4
2856.260804034

1828.864376614

2059.866220175

2295.380095430

4180.883976390

1955.085619462

5
2890.975549258

1871.984827146

2092.771150715

2331.156479206

4216.942888298

1979.170306260

DE
2
2608.610778507

1627.909172752

1863.346730649

2069.510202452

3974.738214185

1808.171050536

3
2785.162093432

1760.103018395

1994.535269293

2220.372641501

4112.631097687

1905.410606582

4
2856.261305066

1828.860328016

2059.865271461

2295.380095430

4180.883976390

1955.085619462

5
2890.971346990

1871.976701063

2092.766907541

2331.156479206

4216.942888298

1979.170306260

CS
2
2608.610778507

1627.909172752

1863.346730649

2069.510202452

3974.738214185

1808.171050536

3
2785.163280467

1760.103018395

1994.536306242

2220.372641501

4112.631097687

1905.410606582

4
2856.261511717

1828.864376614

2059.866280428

2295.380469158

4180.886161109

1957.017965982

5
2890.976540127

1871.990230213

2092.775817560

2331.155240485

4216.943583790

1980.651043072

FA
2
2608.610778507

1627.909172752

1863.346730649

2069.510202452

3974.738214185

1808.171050536

3
2785.163280467

1760.103018395

1994.536306242

2220.372641501

4112.631097687

1905.410606582

4
2856.262131671

1828.864376614

2059.866280428

2295.380469158

4180.886161109

1957.017965982

5
2890.976609405

1871.990616316

2092.773515829

2331.156597921

4216.943583790

1980.656737348

BA
2
2608.610778507

1627.909172752

1863.346730649

2069.510202452

3974.738214185

1808.171050536

3
2785.163280467

1760.103018395

1994.536306242

2220.372641501

4112.631097687

1905.410606582

4
2856.262131671

1828.864376614

2059.866280428

2295.380469158

4180.886161109

1957.017965982

5
2890.976609405

1871.990616316

2092.772750357

2331.156597921

4216.943583790

1979.513584665

IBA
2
2608.610778507

1627.909172752

1863.346730649

2069.510202452

3974.738214185

1808.171050536

3
2785.163280467

1760.103018395

1994.536306242

2220.372641501

4112.631097687

1905.410606582

4
2856.262131671

1828.864376614

2059.866280428

2295.380469158

4180.886161109

1957.017965982

5
2890.976609405

1871.990616316

2092.775965336

2331.156597921

4216.943583790

1980.656737348

The first conclusion that can be drown from the results in Tables 3 and 4 is that the cases when the number of desired thresholds is 2 or 3 are too easy and are not interesting for nondeterministic metaheuristics. Almost all algorithms in almost all cases reached optimal results (PSO and DE had few misses). We included these results in the tables for comparison with results in [49], but we will not discuss them further. All the remaining discussion is only about cases when the number of desired thresholds is 4 or 5.

From Tables 3, 4, 5, and 6 many details can be seen. We will here, in three additional tables, synthetize the most important conclusions concerning the quality of the results and the convergence speed.

Table 5: Mean of the CPU times (in milliseconds) and mean of the iteration numbers obtained for the PSO, DE, CS, FA, BA, and IBA based on Kapur’s entropy criterion for six test images over 50 runs.

Alg.

Barbara
Living room
Boats
Goldhill
Lake
Aerial

Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration

PSO
2
2.18
9.22
102.82
1165.14
3.08
11.84
2.54
8.84
2.41
8.86
2.62
10.7

3
3.30
14.28
21.96
218.56
16.23
136.58
3.18
13.54
3.65
14.58
3.24
13.9

4
49.00
495.36
77.23
853.62
123.62
1367.86
10.22
97.86
26.99
295.76
4.03
19.76

5
88.16
1050.8
153.53
1725.22
74.46
814.22
23.56
258.5
77.64
893.98
58.54
695.92

DE
2
3.56
14.59
4.34
18.92
3.38
16.92
2.15
16.44
5.0
15.74
3.81
17.01

3
6.3
30.0
8.02
70.60
8.84
43.32
7.94
69.30
6.24
30.04
6.51
30.96

4
24.46
240.68
33.62
322.91
46.92
477.16
48.36
125.48
22.12
165.08
14.12
124.56

5
47.8
527.96
77.14
801.21
65.48
683.29
22.2
116.28
55.9
603.01
56.38
624.16

CS
2
71.04
194.54
53.30
129.84
53.84
135.58
82.29
209.48
70.48
183.36
56.32
150.88

3
150.71
420.42
125.48
322.42
128.92
330.22
149.68
441.64
138.23
375.66
104.75
292.22

4
189.31
518.58
222.48
570.6
170.28
436.02
180.31
500.11
220.44
604.58
174.84
482.26

5
301.65
786.64
499.42
1303.8
247.15
631.36
280.55
720.34
336.29
915.92
193.21
532.76

FA
2
15.01
11.96
17.02
11.9
16.39
12.32
13.66
10.08
15.92
12.32
13.86
11.0

3
34.07
29.82
37.24
29.7
36.24
29.24
32.08
28.66
34.56
29.42
32.83
29.18

4
43.30
38.6
50.25
77.9
54.68
117.8
41.11
36.6
43.84
37.66
43.18
38.96

5
50.15
44.04
104.74
515.06
76.22
241.94
48.95
42.01
50.31
43.6
50.46
45.46

BA
2
1.78
2.04
96.82
722.92
24.17
142.96
2
1.8
1.6
1.74
1.22
5.06

3
2.52
6.74
89.78
734.8
64.96
421.48
2.84
6.94
2.32
8.82
3.6
14.4

4
40.2
146.46
124.16
1098.72
115.34
969.66
6.76
37.18
56.88
397.8
32.6
134.52

5
60.9
412.92
175.32
1718.82
98.42
785.04
30.92
157.92
39.24
238.12
64.48
463.78

IBA
2
2.12
9.14
6.34
25.14
5.36
10.02
2.88
8.92
2.28
9.18
2.7
11.18

3
3.84
16.8
5.3
22.8
5.5
22.4
3.84
16.62
5
17.5
5.96
19.88

4
7.16
26.26
9.92
35.48
10.3
43.3
6.28
28.82
7.14
26.98
7.48
30.98

5
8.66
40.06
24.7
134.38
14.4
50.9
7.88
38.62
9.5
42.7
9.5
44.98

Table 6: Mean of the CPU times (in milliseconds) and mean of the iteration numbers obtained for the PSO, DE, CS, FA, BA, and IBA based on Otsu’s entropy criterion for six test images over 50 runs.

Alg.

Barbara
Living room
Boats
Goldhill
Lake
Aerial

Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration
Mean time (ms)
Mean iteration

PSO
2
0.84
9.4
0.90
9.6
0.94
8.8
0.94
8.98
0.91
10.12
0.81
9.04

3
1.22
13.26
1.24
14.68
1.28
14.1
2.86
14.3
1.17
13.48
1.29
15.16

4
4.84
138.52
1.60
19.18
3.12
56.56
5.16
136.32
6.55
175.58
5.18
138.44

5
10.02
261.06
8.14
221.64
32.96
1012.3
7.52
222.92
7.01
179.38
20.21
622.38

DE
2
0.73
14.06
1.0
15.66
1.0
16.59
0.81
15.14
0.76
17.72
0.85
15.9

3
3.01
66.3
2.25
30.3
2.81
70.01
1.51
27.88
1.90
29.19
3.20
70.1

4
8.0
199.22
11.12
282.01
4.72
120.58
7.60
199.5
7.42
200.23
7.01
162.5

5
26.6
796.88
24.3
683.11
31.90
950.33
23.9
686.32
21.65
604.76
18.52
523.22

CS
2
35.80
179.0
30.03
223.34
32.74
204.04
27.88
195.30
38.04
267.66
32.45
254.10

3
51.66
370.88
56.67
371.50
53.74
378.40
59.98
424.62
49.68
381.36
52.78
395.44

4
100.78
723.22
83.43
578.94
76.98
595.66
70.92
531.74
85.30
646.44
83.84
593.52

5
114.63
802.80
122.78
836.32
102.84
677.04
159.69
1115.44
109.90
746.36
209.36
1487.06

FA
2
8.16
12.02
8.72
12.54
7.17
10.64
8.61
12.68
7.28
11.66
7.94
12.18

3
15.73
28.62
12.67
28.54
16.10
28.7
15.61
27.78
13.38
30.04
15.56
27.7

4
17.84
37.7
19.16
38.78
18.43
38.2
17.12
37.66
18.49
38.86
18.05
38.58

5
21.27
43.9
20.15
43.78
43.51
669.52
20.93
44.54
21.27
43.12
20.58
44.68

BA
2
0.4
1.86
0.4
1.66
0.42
1.58
0.42
1.75
0.38
1.7
0.38
1.64

3
0.98
6.08
1.48
6.82
1.24
8.54
0.8
5.58
0.82
6.14
1.08
6.94

4
3.68
30.16
3.56
28.72
4
33.56
3.72
30.36
4.48
31.32
5.1
42.14

5
21.16
30.16
14.32
134.7
73.44
963.32
16.88
170.42
16.54
156.36
55.12
654.72

IBA
2
1.34
9.02
1.31
8.5
1.68
9.18
1.26
8.88
1.36
8.98
1.34
8.86

3
2.38
16.36
2.32
16.44
2.24
16.34
2.44
16.6
2.36
16.54
2.36
16.38

4
3.74
26.60
3.6
26.48
3.66
26.56
3.7
26.3
3.58
26.56
3.46
25.84

5
6.88
38.62
5.3
39.2
7.16
52.48
6.38
40.14
5.36
37.48
5.66
41.08

Table 7, computed from Tables 3 and 4, shows for each tested algorithm in what percentage of cases it achieved the best result, considering all tested images and both optimization criteria. From Table 7, we can see that PSO and DE were very inferior compared to other tested algorithms. The results for the CS and FA [49] algorithms are quite acceptable, where FA had slightly better results.

Table 7: The percent of the best results for thresholds 4 and 5.

Alg.
Kapur’s method
Otsu’s method

PSO
8%
8%

DE
0%
0%

CS
67%
58%

FA
67%
92%

BA
42%
83%

IBA
100%
100%

For the BA we can notice that it gives rather poor results for the Kapur’s method, while it gives rather good results for the Otsu’s method. When the Kapur’s criterion is used, the BA gets trapped in local optima, so it consumes the maximum number of iterations without switching to another subspace which is more promising. That explains why it needed some modifications to be introduced to help it leave the local optimum space and continue to search new spaces.

Our proposed improved IBA algorithm, by taking some features of the DE and ABC algorithms, obtained the best results compared to the rest of algorithms. It actually achieved the best result for both mean value and variance, for all tested cases.

Tables 5 and 6 report the mean number of iterations and the average CPU time taken by each algorithm to satisfy the stopping condition for Kapur’s and Otsu’s criteria, respectively. Most significant conclusions concerning the convergence speed of the tested algorithms are shown in Tables 8 and 9.

Table 8: The number of evaluations for all test images and all threshold values for Kapur’s method.

Alg.
Trsh. 2
Trsh. 3
Trsh. 4
Trsh. 5
Total

PSO
1214
411
3130
5439
10194

DE
96
186
1456
3356
5094

CS
1004
2183
3112
4891
11189

FA
70
176
347
932
1525

BA
876
1193
2784
3777
8631

IBA
74
116
192
352
734

Table 9: The number of evaluations for all test images and all threshold values for Otsu’s method.

Alg.
Trsh. 2
Trsh. 3
Trsh. 4
Trsh. 5
Total

PSO
56
85
665
25206
3326

DE
95
294
1164
4245
5798

CS
1323
2322
3669
5665
12979

FA
72
171
230
889
1362

BA
10
40
196
2110
2356

IBA
53
99
158
249
559

In Table 8 (for Kapur’s criterion) in each column labeled by we calculated for each of the tested algorithms: PSO, DE, CS, FA, BA, and IBA, the sum of mean number of required iterations for each test image. We can observe that in the case of the FA and especially the IBA method, the number of iterations does not grow rapidly with the increase of the number of thresholds as is the case with the rest of algorithms. From Table 8 we can also observe that the proposed IBA converges in considerably less iterations compared to the rest of algorithms.

From Table 9 (for the Otsu’s criterion), it can be seen that the proposed IBA method in this case also converges in considerably less iterations compared to the other methods. It also maintains the feature of linearity with increasing the number of thresholds. Actually, in both cases, for Kapur’s and Otsu’s criteria, our proposed IBA algorithm improved the convergence speed by more than a factor of 2, compared to the next best algorithm.

6. Conclusion

In this paper, we considered an important optimization problem of multilevel image thresholding. It is an exponential problem and as such it is appropriate for swarm intelligence metaheuristics. We adapted new bat algorithm for this problem and compared it to other state-of-the-art algorithms from [49]. Pure version of the bat algorithm performed well, but the results were slightly below the average, especially when Kapur’s criterion was used. We determined that the pure bat algorithm, when applied to this problem, may be easily trapped into local optimum so we modified it by changing new solution equation by hybridized one with elements from DE. We also included limit parameter similar to the one used in the ABC algorithm.

Our proposed improved bat-inspired hybridized with DE (IBA) algorithm was tested on 6 standard benchmark images, the same as used in [49]. It proved to be superior to all other tested algorithms considering the quality of the solutions (it actually achieved the best result for both mean value and variance, for all tested cases), especially it significantly improved convergence speed (more than two times better than the next algorithm). This shows that our proposed algorithm is excellent choice for the multilevel image thresholding problem. Additional adjustments can be done in the future using larger set of synthetic images which will allow more precise modifications and parameter adjustment.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

The research is supported by the Ministry of Science of Republic of Serbia, Grant no. III-44006.

References

J. Lázaro, J. L. Martín, J. Arias, A. Astarloa, and C. Cuadrado, “Neuro semantic thresholding using OCR software for high precision OCR applications,” Image and Vision Computing, vol. 28, no. 4, pp. 571–578, 2010.

Y.-T. Hsiao, C.-L. Chuang, Y.-L. Lu, and J.A. Jiang, “Robust multiple objects tracking using image segmentation and trajectory estimation scheme in video frames,” Image and Vision Computing, vol. 24, no. 10, pp. 1123–1136, 2006.

R. Adollah, M. Y. Mashor, H. Rosline, and N. H. Harun, “Multilevel thresholding as a simple segmentation technique in acute leukemia images,” Journal of Medical Imaging and Health Informatics, vol. 2, no. 3, pp. 285–288, 2012.

A. Rojas Domínguez and A. K. Nandi, “Detection of masses in mammograms via statistically based enhancement, multilevel-thresholding segmentation, and region selection,” Computerized Medical Imaging and Graphics, vol. 32, no. 4, pp. 304–315, 2008.

G. C. Anagnostopoulos, “SVM-based target recognition from synthetic aperture radar images using target region outline descriptors,” Nonlinear Analysis: Theory, Methods and Applications, vol. 71, no. 12, pp. e2934–e2939, 2009.

N. R. Pal and S. K. Pal, “A review on image segmentation techniques,” Pattern Recognition, vol. 26, no. 9, pp. 1277–1294, 1993.

N. Otsu, “A threshold selection method for grey level histograms,” IEEE Transactions on Systems, Man and Cybernetics, vol. 9, no. 1, pp. 62–66, 1979.

T. Pun, “A new method for grey-level picture thresholding using the entropy of the histogram,” Signal Processing, vol. 2, no. 3, pp. 223–237, 1980.

T. Chaira and A. K. Ray, “Threshold selection using fuzzy set theory,” Pattern Recognition Letters, vol. 25, no. 8, pp. 865–874, 2004.

T. Chaira and A. K. Ray, “Segmentation using fuzzy divergence,” Pattern Recognition Letters, vol. 24, no. 12, pp. 1837–1844, 2003.

S. Wang, F. L. Chung, and F. Xiong, “A novel image thresholding method based on Parzen window estimate,” Pattern Recognition, vol. 41, no. 1, pp. 117–129, 2008.

A. Nakib, H. Oulhadj, and P. Siarry, “Non-supervised image segmentation based on multiobjective optimization,” Pattern Recognition Letters, vol. 29, no. 2, pp. 161–172, 2008.

S. S. Fan and Y. Lin, “A multi-level thresholding approach using a hybrid optimal estimation algorithm,” Pattern Recognition Letters, vol. 28, no. 5, pp. 662–669, 2007.

E. Zahara, S. S. Fan, and D.-M. Tsai, “Optimal multi-thresholding using a hybrid optimization approach,” Pattern Recognition Letters, vol. 26, no. 8, pp. 1082–1095, 2005.

M. Horng, “A multilevel image thresholding using the honey bee mating optimization,” Applied Mathematics and Computation, vol. 215, no. 9, pp. 3302–3310, 2010.

J. N. Kapur, P. K. Sahoo, and A. K. C. Wong, “A new method for gray-level picture thresholding using the entropy of the histogram,” Computer Vision, Graphics, and Image Processing, vol. 29, no. 3, pp. 273–285, 1985.

S. Zarezadeh and M. Asadi, “Results on residual Rényi entropy of order statistics and record values,” Information Sciences, vol. 180, no. 21, pp. 4195–4206, 2010.

P. K. Sahoo, S. Soltani, and A. K. C. Wong, “A survey of thresholding techniques,” Computer Vision, Graphics and Image Processing, vol. 41, no. 2, pp. 233–260, 1988.

X.-S. Yang, “Efficiency analysis of swarm intelligence and randomization techniques,” Journal of Computational and Theoretical Nanoscience, vol. 9, no. 2, pp. 189–198, 2012.

X.-S. Yang, “Review of meta-heuristics and generalised evolutionary walk algorithm,” International Journal of Bio-Inspired Computation, vol. 3, no. 2, pp. 77–84, 2011.

X.-S. Yang, “Free lunch or no free lunch: that is not just a question?” International Journal on Artificial Intelligence Tools, vol. 21, no. 3, Article ID 1240010, pp. 5360–5366, 2012.

A. H. Gandomi and X.-S. Yang, “Evolutionary boundary constraint handling scheme,” Neural Computing & Applications, vol. 21, no. 6, pp. 1449–1462, 2012.

J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of the IEEE International Conference on Neural Networks (ICNN '95), vol. 4, pp. 1942–1948, December 1995.

R. Storn and K. Price, “Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces,” Journal of Global Optimization, vol. 11, no. 4, pp. 341–359, 1997.

X.-S. Yang, “Firefly algorithms for multimodal optimization,” in Stochastic Algorithms: Foundations and Applications, vol. 5792 of Lecture Notes in Computer Science, pp. 169–178, Springer, Berlin, Germany, 2009.

I. Fister, I. Fister Jr., X.-S. Yang, and J. Brest, “A comprehensive review of firefly algorithms,” Swarm and Evolutionary Computation, vol. 13, no. 1, pp. 34–46, 2013.

X.-S. Yang and S. Deb, “Cuckoo search via Lévy flights,” in Proceedings of the World Congress on Nature and Biologically Inspired Computing (NABIC '09), pp. 210–214, Coimbatore, India, December 2009.

X.-S. Yang and S. Deb, “Engineering optimisation by cuckoo search,” International Journal of Mathematical Modelling and Numerical Optimisation, vol. 1, no. 4, pp. 330–343, 2010.

A. H. Gandomi, X.-S. Yang, and A. H. Alavi, “Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems,” Engineering with Computers, vol. 29, no. 1, pp. 17–35, 2013.

M. Dorigo and L. M. Gambardella, “Ant colonies for the travelling salesman problem,” BioSystems, vol. 43, no. 2, pp. 73–81, 1997.

M. Tuba and R. Jovanovic, “Improved ACO algorithm with pheromone correction strategy for the traveling salesman problem,” International Journal of Computers, Communications & Control, vol. 8, no. 3, pp. 477–485, 2013.

R. Jovanovic and M. Tuba, “An ant colony optimization algorithm with improved pheromone correction strategy for the minimum weight vertex cover problem,” Applied Soft Computing Journal, vol. 11, no. 8, pp. 5360–5366, 2011.

R. Jovanovic and M. Tuba, “Ant colony optimization algorithm with pheromone correction strategy for the minimum connected dominating set problem,” Computer Science and Information Systems, vol. 10, no. 1, pp. 133–149, 2013.

D. Karaboga, “An idea based on honey bee swarm for numerical optimization,” Tech. Rep. TR06, Erciyes University, Engineering Faculty, Computer Engineering Department, 2005.

N. Bacanin and M. Tuba, “Artificial bee colony (ABC) algorithm for constrained optimization improved with genetic operators,” Studies in Informatics and Control, vol. 21, no. 2, pp. 137–146, 2012.

I. Brajevic and M. Tuba, “An upgraded artificial bee colony (ABC) algorithm for constrained optimization problems,” Journal of Intelligent Manufacturing, vol. 24, no. 4, pp. 729–740, 2013.

M. Subotic and M. Tuba, “Parallelized multiple swarm artificial bee colony algorithm (MS-ABC) for global optimization,” Studies in Informatics and Control, vol. 23, no. 1, pp. 117–126, 2014.

M. Tuba and N. Bacanin, “Artificial bee colony algorithm hybridized with firefly metaheuristic for cardinality constrained mean-variance portfolio problem,” Applied Mathematics & Information Sciences, vol. 8, no. 6, pp. 2831–2844, 2014.

X.-S. Yang, “A new metaheuristic bat-inspired Algorithm,” Studies in Computational Intelligence, vol. 284, pp. 65–74, 2010.

A. Alihodzic and M. Tuba, “Improved hybridized bat algorithm for global numerical optimization,” in Proceedings of the 16th IEEE International Conference on Computer Modelling and Simulation (UKSim-AMSS '14), pp. 57–62, March 2014.

C. Dai, W. Chen, Y. Song, and Y. Zhu, “Seeker optimization algorithm: A novel stochastic search algorithm for global numerical optimization,” Journal of Systems Engineering and Electronics, vol. 21, no. 2, pp. 300–311, 2010.

M. Tuba, I. Brajevic, and R. Jovanovic, “Hybrid seeker optimization algorithm for global optimization,” Applied Mathematics & Information Sciences, vol. 7, no. 3, pp. 867–875, 2013.

M. Tuba and N. Bacanin, “Improved seeker optimization algorithm hybridized with firefly algorithm for constrained optimization problems,” Neurocomputing, 2014.

S. Sarkar, G. R. Patra, and S. Das, “A differential evolution based approach for multilevel image segmentation using minimum cross entropy thresholding,” in Swarm, Evolutionary, and Memetic Computing, vol. 7076 of Lecture Notes in Computer Science, pp. 51–58, 2011.

P. Yin, “Multilevel minimum cross entropy threshold selection based on particle swarm optimization,” Applied Mathematics and Computation, vol. 184, no. 2, pp. 503–513, 2007.

B. Akay, “A study on particle swarm optimization and artificial bee colony algorithms for multilevel thresholding,” Applied Soft Computing Journal, vol. 13, no. 6, pp. 3066–3091, 2013.

M. Maitra and A. Chatterjee, “A hybrid cooperative-comprehensive learning based PSO algorithm for image segmentation using multilevel thresholding,” Expert Systems with Applications, vol. 34, no. 2, pp. 1341–1350, 2008.

K. Harnrnouche, M. Diaf, and P. Siarry, “A comparative study of various meta-heuristic techniques applied to the multilevel thresholding problem,” Engineering Applications of Artificial Intelligence, vol. 23, no. 5, pp. 676–688, 2010.

I. Brajevic and M. Tuba, “Cuckoo search and firefly algorithm applied to multilevel image thresholding,” in Cuckoo Search and Firefly Algorithm: Theory and Applications, X.-S. Yang, Ed., vol. 516 of Studies in Computational Intelligence, pp. 115–139, Springer, Berlin, Germany, 2014.

D. Campos, “Real and spurious contributions for the Shannon, Rényi and Tsallis entropies,” Physica A, vol. 389, no. 18, pp. 3761–3768, 2010.

M. Tuba, “Asymptotic behavior of the maximum entropy routing in computer networks,” Entropy, vol. 15, no. 1, pp. 361–371, 2013.

G.-Q. Huang, W.-J. Zhao, and Q.-Q. Lu, “Bat algorithm with global convergence for solving large-scale optimization problem,” Application Research of Computers, vol. 30, no. 5, pp. 1323–1328, 2013.

X.-S. Yang and A. H. Gandomi, “Bat algorithm: A novel approach for global engineering optimization,” Engineering Computations, vol. 29, no. 5, pp. 464–483, 2012.

K. Khan, A. Nikov, and A. Sahai, “A fuzzy bat clustering method for ergonomic screening of office workplaces,” in Advances in Intelligent and Soft Computing, vol. 101, pp. 59–66, Springer, 2011.

L. Jiann-Horng, C. Chao-Wei, Y. Chorng-Horng, and T. Hsien-Leing, “A chaotic levy ight bat algorithm for parameter estimation in nonlinear dynamic biological systems,” Journal of Computer and Information Technology, vol. 2, no. 2, pp. 56–63, 2012.

X.-S. Yang, “Bat algorithm for multi-objective optimisation,” International Journal of Bio-Inspired Computation, vol. 3, no. 5, pp. 267–274, 2011.

J. Zhang and G. Wang, “Image matching using a bat algorithm with mutation,” Applied Mechanics and Materials, vol. 203, no. 1, pp. 88–93, 2012.

B. Ramesh, C. Jagan Mohan, and V. Reddy, “Application of bat algorithm for combined economic load and emission dispatch,” International Journal of Electrical and Electronics Engineering & Telecommunications, vol. 2, no. 1, pp. 1–9, 2013.

F. A. Banu and C. Chandrasekar, “An optimized approach of modified BAT algorithm to record deduplication,” International Journal of Computer Applications, vol. 62, no. 1, pp. 10–15, 2012.

M. K. Marichelvam and T. Prabaharam, “A bat algorithm for realistic hybrid flowshop scheduling problems to minimize makespan and mean flow time,” ICTACT International Journal on Soft Computing, vol. 3, no. 1, pp. 428–433, 2012.

K. Khan and S. Ashok, “A comparison of ba, ga, pso, bp and lm for training feed forward neural networks in e-learning context,” International Journal of Intelligent Systems and Applications, vol. 4, no. 7, pp. 23–29, 20112.

R. Damodaram and M. L. Va larmathi, “Phishing website detection and optimization using modified bat algorithm,” International Journal of Engineering Research and Applications, vol. 2, no. 1, pp. 870–876, 2012.