Natural Image Enhancement Using a Biogeography Based Optimization Enhanced with Blended Migration Operator

This paper addresses a novel and efficient algorithm for solving optimization problem in image processing applications. Image enhancement (IE) is one of the complex optimization problems in image processing. The main goal of this paper is to enhance color images such that the eminence of the image is more suitable than the original image from the perceptual viewpoint of human. Traditional methods require prior knowledge of the image to be enhanced, whereas the aim of the proposed biogeography based optimization (BBO) enhanced with blended migration operator (BMO) algorithm is to maximize the objective function in order to enhance the image contrast by maximizing the parameters like edge intensity, edge information, and entropy. Experimental results are compared with the current state-of-the-art approaches and indicate the superiority of the proposed technique in terms of subjective and objective evaluation.


Introduction
Image enhancement plays a vital role in a variety of fields such as vision, medical image analysis, remote sensing, and in our real life photographic images [1].Since images can worsen due to poor quality of the acquisition device, lack of proficiency of the operation, and the climatic conditions at the time of acquisition.Such image may not expose all the fine points in the captured scene and may have a dull and aberrant look.Hence, it has become a necessity to develop algorithms for image enhancement.The image enhancement (IE) approach improves the quality of the image by extracting critical details of the images to improve the interpretability or perception of the image for human viewers.IE accentuates or sharpens image features such as edge boundaries or contrast to make a graphic display more beneficial to further image applications such as enhancing edges and image segmentation and to enforce the capability of machine recognition systems to interpret useful information in the image [2].It has become a necessity to develop tools and algorithms for color image enhancement with the rapid increase in the usage of color images.
Histogram transformation is considered one of the fundamental processes for image enhancement of gray level images [3], which facilitates subsequent higher level operations such as detection and identification.Histogram equalization [4] and contrast manipulations [5] are well-known methods for enhancing the contrast of a given image but most of them tend to be heuristic based on deep expert knowledge for image processing.Hence these techniques require a large amount of analysis and computation because of complicated formulations.Histogram modification framework reveals maximum information contained in the image indirectly modifies the image histogram [6].weighted threshold HE (WTHE), [7][8][9][10][11] suggests modifying the image histogram by weighting and threshold before histogram equalization.These methods modify the image histogram indirectly and reveal the maximum information contained in the image.
Optimization plays an imperative role in computer science, artificial intelligence, operational research, and other 2 Mathematical Problems in Engineering related fields [12,13].It is the process of trying to find the best possible solution to an optimization problem within a reasonable time limit.Several evolutionary algorithms (EA) such as genetic algorithm (GA), particle swarm optimization (PSO), and differential evolution (DE) have been introduced in recent years in the field of image processing because of their fast computing ability.Several meta heuristics method mainly EA, PSO,GA, DE etc., have been applied for image processing applications [12][13][14][15] including image enhancement problem.GA finds weights and combines four types of nonlinear transform elements [16].In [17] a real coded GA to adapt the gray level intensity transformation in the image with an evaluation criterion [18] combines different transformation functions with different parameters to produce enhanced image.Genetic algorithm (GA) [19][20][21] is used to minimize entropy value in order to enhance the image and to preserve the information.DE is applied to solve image enhancement for gray scale images [22].PSO based image enhancement [23][24][25][26][27] is introduced; [28] cuckoo search algorithm [18,29], a fuzzy logic approach to image enhancement, takes less time to converge to a better optimal.It gives poor contrast without proper tuning of parameters.
Generalizing gray scale image enhancement to color image enhancement is not a trivial task.Several factors must be considered for color image enhancement such as selection of a color model, characteristics of the human visual system, and color contrast sensitivity.Multiscale approach to contrast enhancement [2] uses a nonlinear scale-space representation of image generated by anisotropic diffusion.Another multiscale contrast enhancement technique through nonlinear pyramid recombination is introduced in [30,31].Color images can also be enhanced by separating the image into chromaticity and intensity components [11].In [32] color enhancement based on saturation is proposed.A method for color equalization with its application to color images is proposed in [33].A space-variant luminance map based color image enhancement is proposed in [34].A scheme for color image enhancement employing genetic algorithm is proposed in [17].A hue preserving and gamut problem free color image enhancement is proposed in [35] considering RGB and CMY color spaces.In [36,37] color image enhancement using Artificial Bee Colony is proposed.
In this paper the color image enhancement is approached as a constrained optimization problem.In comparison to other optimization algorithms the solutions do not die at the end of each generation [38].At the same time BBO-BMO does not take unnecessary computational time.Our objective is to maximize the objective function in order to enhance the contrast by maximizing the number of pixels in the edges, increase the overall edges intensity, and increase the entropy measure.The color contrast of the image is preserved by adjusting the background illumination and prevents the degradation of the image pixels.The resulted color enhanced images by BBO-BMO are found to be better compared with other image enhancement techniques.Both objective and subjective evaluations on the resulted image show the goodness of BBO-BMO.
The rest of the paper is organized as follows.Section 2 presents the fundamentals of image enhancement.In Section 3 the concepts BBO and BMO are described.Implementation of the proposed biogeography based optimization and blended migration operation (BBO-BMO) for image enhancement algorithm is described in Section 4. Experimental results are presented in Section 5 to describe the advantage of color image enhancement using our algorithm.Finally conclusions are addressed in Section 6.

Image Enhancement
Image enhancement improves the visual appearance of an image by increasing its contrast and sharpening the features.Image enhancement technique requires a transformation function which takes the intensity value of each pixel from the input image and generates a new intensity value to produce the enhanced image.The quality of the enhanced image is evaluated by the evaluation function.
where  and  are two parameters whose value is to be optimized, (, ) is the local mean of the (, )th pixel of the input image over an  ×  window, and (, ) is the enhancement function which takes both global and local information.
The local mean is given as The enhancement function (, ) is defined as where  and  are the two parameters to be optimized, (, ) is the local standard deviation of input image, and  is the global mean.The global mean is defined as where  and  are the number of pixels in the horizontal and vertical direction of the image.The local standard deviation (, ) is defined as The transformation function is defined as By this transformation equation the contrast of the image is enhanced considering local mean to be the center of enhancement.The term (, )  has brightening and smoothing effect and thus smoothes the enhanced image and the four parameters introduced in the transformation function; that is, , ,  and  are the parameters of the enhancement function and the small variation in their value produces a large variation in the processed image and thus the value of these parameters should be precisely set.The approximate range of these parameters is defined [39] as [0, 1.5], [0, (/2)], [0, 1], and [0.5, 1.5].

Enhancement Evaluation Criterion.
To evaluate the quality of an enhanced image without human intervention needs an objective function.Many objective functions are presented in the literature [40][41][42].The objective function is obtained combining the performance measures entropy value, sum of the edge intensities, and edge pixels and is defined as where () is the fitness function applied to species .() denotes original image  with a transformation  applied according to (7) where the respective parameters , , , and  are given by the species  = (, , , ).(  ()) is the intensity of the edges detected with edge detector, where the detector is applied to the transformed image (). is the number of edge pixels detected with the edge detector.
(()) is the entropy of the image () [26]: where   = ℎ  log 2 (ℎ  ) if ℎ  ̸ = 0; otherwise   = 0 and ℎ  is the probability of occurrence of th intensity value of enhanced image.[38] in 2008.BBO is based on the study of the distribution of species and is characterized by two probabilistic operators, that is, migration and mutation.The species are distributed in habitats that are geographically isolated from other habitats.The suitability of residing in a habitat is determined by a dependent variable known as habitat suitability index (HSI).The variables that characterize habitability are called suitability index variables (SIVs).Habitats with high HSI have large number of species while habitats with low HSI have small number of species.Migration refers to the movement of species from one habitat to another habitat.This movement of species is always from habitat with high HSI to habitat with low HSI.

Biogeography Based Optimization. Biogeography based optimization is a new population based optimization algorithm proposed by Simon
Sometimes due to sudden changes in natural calamities or other events the HSI of a habitat might get changed.This event of sudden change in HSI of a habitat is represented as mutation of SIV in BBO.Mutation in each habitat is controlled by its species count probability.

Blended Migration
Operator.Migration refers to the flow of species between any two habitats.Habitats with high HSI have low immigration rate and high emigration rate, while habitats with low HSI have low immigration rate and high emigration rate.Thus high HSI habitats are more static in species distribution while low HSI habitats are dynamic.The concept of migration is expressed as Equation (10) shows that the species from habitat   is emigrating to the habitat   .The probability that   is selected as the emigrating habitat is proportional to the emigration rate   and the probability   selected as immigrating habitat is proportional to its immigration rate   .A good solution has high  and low  and vice versa for poor solution.The immigration and emigration rate of a habitat is calculated as below: where  and  are maximum immigration and emigration rates, respectively.() is the fitness rank of the th individual and  is the number of candidate solutions in a population.In this work, a new migration operator is presented called as blended migration operator (BMO) [43].The concept of blended migration is borrowed from the blended crossover in GA.Unlike the standard BBO, in blended migration a solution feature of   is not simply replaced by a new solution feature from   .Instead, a new solution feature of   is comprised of two migrated components: first, the solution feature from a habitat   and, second, the solution feature from itself.The blended migration is expressed as Equation (13) shows that the new solution feature of   comes from a combination of its own SIV and emigrating habitat   .Blended migration is more advantageous than the normal migration.Due to blended migration good solutions are less likely to be degraded and poor solutions can still accept a lot of new features from the good solutions.

Mutation.
Random events such as disease and natural catastrophes, cause the species count of a habitat to differ from its equilibrium value.Mutation in BBO refers to the random modification of a habitat's SIV based on its mutation probability.For standard BBO, the mutation probability is inversely proportional to the solution probability and it is expressed as where  max is the maximum mutation probability and   is the species count probability.The probability of species counts for each habitat is governed by a differential equation given as where   and   are immigration and emigration rates of a habitat when there are S species.Mutation is carried on both good solutions and poor solutions.It helps improve the low HSI solution and provides high HSI solution improving even more than they already have.

Implementation of BBO-BMO for Image Enhancement
The Image enhancement using BBO-BMO algorithm can be described with the following algorithm.
Step 1 (image preprocessing).(a) Color Conversion.Obtain the color image and convert it into CIEL *  *  * color model.Image enhancement of color images is typically done by transforming an image to a color space that has image intensity as one of its components.CIEL *  *  * color spaces are used as a part of the color image pipeline in video and digital photography systems.Manipulating luminosity affects the intensity of the pixels while preserving the original colors.Figure 1 illustrates the color conversion model obtained in the natural image.
(b) Noise Separation.Noise reduction [44,45] should attempt to remove noise without sacrificing real detail from the scene photographed.Color images find chroma noise more objectionable than luminance noise; the colored blobs are considered "digital looking" and unnatural, compared to the grainy appearance of luminance noise that some compare to film grain.Adaptive bilateral filter attempts to remove noise without sacrificing real detail from the natural image; one risks a greater loss of detail from luminance noise reduction than chroma noise reduction because most scenes have high frequency chroma detail.For these reasons, our noise reduction filter splits the image detail into chroma and luminance components and applies more noise reduction by preserving the sharpness.
(c) Edge Detection.Apply edge detector to detect the edges by combining the filter which increases the edge slope of the given image for obtaining proper edge enhanced image [46].Figure 2 illustrates the edge detection process.
Step 2 (initialization).Initialize the BBO parameter such as number of habitats  is the total number of image pixels, habitat modification probability  mod , mutation probability  mut , maximum mutation rate  max , maximum immigration rate , maximum emigration rate , lower limit for immigration probability per gene  lower , upper limit for immigration probability per gene  upper , step size for numerical integration , elitism parameter , and maximum number of iteration.Also initialize the maximum and minimum pixel value of an image, that is, number of SIV .Since the real comparison of pixel values is the decision variables for the problem, they are represented as SIV in a habitat.A population of habitat is represented as Each habitat consists of  number of SIVs.An individual habitat   with SIVs is represented as where  = 1, 2, . . .,  and  = 1, 2, 3, . . ., .Each habitat is one of the possible solutions for the problem.In a habitat   the component SIV  refers to the pixel value of the th pixel of the th habitat.
Step 3 (initialization of SIV).Each SIV in the matrix  is randomly initialized within the minimum and maximum pixel value of the neighborhood pixels, respectively.
Step 4 (evaluation of fitness of the population).Calculate the fitness of each habitat which is known as HSI in BBO.The fitness is calculated using a function  given in (8).If the fitness of previous pixel value is greater than the current pixel value after considering fitness evaluation which depends upon global intensity value of image, it should be replaced.Habitat with maximum  value is said to have high HSI and vice versa.
Step 5 (identification of elite habitats).In BBO the best habitats in each iteration are preserved from modifications caused by migration and mutation.Thus an elitism parameter is used to provide a memory for the algorithm.Based on the HSI values of each habitat, which refers to the edge intensity variation of the image through iteration, a set of "" elite habitats are preserved.Habitats with the best (i.e., maximum) pixel value are chosen as elite habitats in each iteration.
Step 6 (blended migration).(6.1) Calculate the immigration rate   and emigration rate   for each habitat using ( 11) and ( 12).(6.2) Calculate  scale for each habitat using (16): where  lower / upper are user defined parameters,  min is the minimum value of the lambda, and  max is the maximum value of the lambda. (6. 3) The migration operation for each nonelite habitat is performed as shown in Algorithm 1.
(7.2) Elitism is implemented by setting species count probability to zero for  elite habitats (7.2) Mutation process for each nonelite habitat is carried out as shown in Algorithm 2.
Step 8 (termination criterion).Check for the termination criteria.If maximum generation is reached, stop execution; otherwise go to Step 3.

Experimental Setup.
The optimization problem considered in this paper is to solve the image enhancement problem using BBO-BMO approach.Our goal is to maximize the objective function in order to enhance the contrast by maximizing the number of pixels in the edges, increase the overall edges intensity, and increase the entropy measure [47].Figure 3 shows the texture and edge intensity of the natural images.The performance of IE using the proposed method is validated by applying it to various natural images.The results obtained were compared with WTHE [7], fuzzy algorithm [18], GA [17], PSO [27], and DE [22].

Qualitative Assessment on Natural
Images.Image enhancement can be easily extended to color natural images.The most obvious way to extend the grayscale IE to color images is to apply the method to luminance components only and to preserve the chrominance components.Few examples of natural images were shown in Figures 4 and 5. is the noisy image.This image has poor contrast quality.Figure 4(d) is the WTHE image; this image has nonuniform illumination.This becomes more apparent as it stretches the histogram to increase the contrast by darkening the pixels in the lower range and brightening the pixel in the higher range.Figure 4(e) is the fuzzy image; this image preserves the brightness and keeps the details by increasing the contrast.It has an unnatural look in Figure 4(f) GA performs better than Fuzzy it does not remove this effect completely.In Figures 4(g) and 4(h) PSO image and DE image performs better than GA but it does not preserve the edge.The proposed algorithm on the other hand does not darken the images as much as WTHE, and it preserves the bright regions, enhances the edge intensity and entropy, and as a result produces a better contrast enhance result by preserving the edges.
In Figure 5(d) WTHE results in loss of details.Figures 5(e) and 5(f) fuzzy and GA result a better than WTHE.It still has an unnatural look.In Figures 5(g) and 5(h) PSO and DE show results better than GA; however, the result in images is not as pleasing as the one obtained with the proposed method.Some portions are still brighter and edge intensity is not enhanced.The proposed method in Figure 5(i) gives a more natural looking image by preserving the brightness and enhancing the edge intensity.

Quantitative Assessment.
Quality assessment of image enhancement is not an easy task; it is desirable to have an objective assessment approach to compare image enhancement techniques.There are some metrics that approximate an average contrast in the image based on entropy or other measures.If these metrics are used, BBO-BMO can achieve the best performance even though it may not produce the visually pleasing image and possibly may produce an unrealistic look.Hence, we will use the following quantitative measures: peak signal noise ratio (PSNR), the discrete entropy (), and the fitness criteria [48][49][50].
The performance of image enhancement technique can be measured by comparing PSNR value.The PSNR value for enhancing the image using the proposed algorithm is compared with other traditional techniques and observations are shown in Table 1 which shows the PSNR values compared with traditional IE techniques and the proposed method.Table 2 shows the PSNR values compared with traditional IE techniques and the proposed method for different iterations.
The discrete entropy is used to measure the content of an image, where a higher value indicates an image with richer details.The entropy approximates an average contrast in the image by dividing image into nonoverlapping blocks, finding a measure based on minimum and maximum intensity values in each block and averaging them.It is computed pixelby-pixel by adding up the squared differences of all the pixels and dividing by the total pixel count.Table 3 shows the comparison of entropy values with the traditional IE techniques.
The performance can be measured by comparing the fitness value of some optimization algorithms with that of the proposed algorithm.The parameters of these algorithms are set as described in their own paper.Since the compared algorithms except WTHE are stochastic and population based methods, 30 independent runs were made for each of the methods to show the efficiency of these algorithms.We implemented the BBO-BMO algorithm in Matlab with a 1.73 GHz Intel Pentium Dual-Core processor with 2 GB of random access memory.

Conclusion
In this paper a new BBO-BMO based color image enhancement technique is proposed.This algorithm is employed with few natural images and the results obtained are compared with other population based methods.By maximizing the fitness criterion and adopting the parameters the algorithm enhances the contrast and detail of the image.The proposed method is applicable to a wide variety of natural images.From many decades, image enhancement is implemented using techniques like PSO and GA.BBO-BMO is uniquely a biogeography technique used for implementing image enhancement which provides more accurate enhanced images as compared to other evolutionary algorithms.BBO-BMO is a population based optimization algorithm and it does not involve reproduction or the generation of "children." The simulation results show the effectiveness of the algorithm in terms of quality assessment and computation efficiency with the other IE algorithms.The obtained results are visually pleasing, artifact free, and natural looking.Comparative experimental results on real-world natural images have demonstrated the efficiency and effectiveness of our proposed method.

Figure 2 :Figure 3 :
Figure 2: Illustrations of edge detection of the natural images: (a) original image and (b) edge detection.

Figure 4 (
Figure 4(b) is the CIEL *  *  * image and Figure 4(c)is the noisy image.This image has poor contrast quality.Figure4(d) is the WTHE image; this image has nonuniform illumination.This becomes more apparent as it stretches the histogram to increase the contrast by darkening the pixels in the lower range and brightening the pixel in the higher range.Figure4(e) is the fuzzy image; this image preserves the brightness and keeps the details by increasing the contrast.It has an unnatural look in Figure4(f) GA performs better than Fuzzy it does not remove this effect completely.In Figures4(g) and 4(h) PSO image and DE image performs better than GA but it does not preserve the edge.The proposed algorithm on the other hand does not darken the images as much as WTHE, and it preserves the bright regions, enhances the edge intensity and entropy, and as a result produces a better contrast enhance result by preserving the edges.In Figure5(d) WTHE results in loss of details.Figures5(e) and 5(f) fuzzy and GA result a better than WTHE.It still has an unnatural look.In Figures5(g) and 5(h) PSO and DE show results better than GA; however, the result in images is not as pleasing as the one obtained with the proposed method.Some portions are still brighter and edge intensity is not enhanced.The proposed method in Figure5(i) gives a more natural looking image by preserving the brightness and enhancing the edge intensity.

Table 1 :
Table 4 shows the fitness comparison of PSNR values compared with traditional IE techniques.

Table 2 :
PSNR values compared with traditional IE techniques for different iterations.

Table 3 :
Discrete entropy  compared with traditional IE techniques.

Table 4 :
Fitness values () for the optimization algorithms.
the proposed algorithm based IE technique with the Fuzzy, GA, DE and PSO.