An Application of Artificial Intelligence for the Joint Estimation of Amplitude and Two-Dimensional Direction of Arrival of Far Field Sources Using 2-L-Shape Array

. An easy and efficient approach, based on artificial intelligence technique, is proposed to jointly estimate the amplitude, elevation, and azimuth angles of far field sources impinging on 2-L-shape array. In these proposed artificial intelligence techniques, the metaheuristics based on genetic algorithm and simulated annealing are used as global optimizers assisted with rapid local version of pattern search for optimization of the adaptive parameters. The performance metric is employed on a fitness evaluation function depending on mean square error which is optimum and requires single snapshot to converge. The proposed approaches are easy to understand, and simple to implement; the genetic algorithm specifically hybridized with pattern search generates fairly good results. The comparison of the given schemes is carried out with 1-L-shape array, as well as, with parallel-shape array and is found to be in good agreement in terms of accuracy, convergence rate, computational complexity, and mean square error. The effectiveness and efficiency of the given schemes are examined through Monte Carlo simulations and their inclusive statistical analysis.


Introduction
Two-dimensional direction of arrival (2D DOA) estimation for multiple signals received at sensors array is one of the indispensable steps for adaptive beamformer to maneuver the main beam in any preferred direction, while allocating nulls in the direction of unwanted signals [1,2].From this perspective, 2D DOA estimation has direct applications in radar, sonar, and mobile communications [3].The most common problem in 2D DOA estimation includes pair matching between elevation and azimuth angles, estimation failure and computational complexity.In the literature, many algorithms have already been discussed in the last two decades to estimate 2-D DOA [4][5][6][7], but they have the aforementioned problems.In [8], Wu et al. proposed an algorithm based on propagator method (PM) to overcome the computational load of [7], but it fails to avoid the pair matching problem and estimation failure problem in the range of 1.2217 (radians) to 1.5708 (radians).Moreover, the parallel-shape array is used in [8] which not only needs more sensors but also requires a large number of snapshots to achieve the goal (at least 200 snapshots per sensor are required).Besides that, [8] also failed to estimate the sources amplitudes which also an important parameter to be estimated.
In order to overcome these problems, we thank evolutionary computing techniques (ECTs) and L-shape arrays (1-L and 2-L shape).It is well acknowledged in the literature that ECTs such as genetic algorithm (GA), ant colony optimization (ACO), differential evolution (DE), and particle swarm optimization (PSO) have achieved great success in solving different optimization problems especially in the field of array signal processing [9,10].These techniques have got attention among the researchers due to their ease in understanding, simplicity in implementation, and less probability to get stuck in the local minima.One of the other most significant aspects of ECT is that their accuracy and reliability increase more when hybridized with any other capable algorithm such as pattern search (PS), interior point algorithm (IPA), and active International Journal of Antennas and Propagation set algorithm (ASA) [11][12][13][14][15].In [13], GA is hybridized with IPA for 3D source localization of near field sources impinging on uniform linear array (ULA), and the hybrid GA-IPA approach has shown better performance as compared to GA and IPA alone.In [14], PSO is mixed with PS to estimate the DOA of far field sources, and again the hybrid PSO-PS technique produced better results as compared to PSO [9] and PS alone.GA is hybridized with PS to jointly estimate 3D parameters (amplitude, elevation angle, and azimuth angle) of far field sources arriving at 1-L shape array and again the results of hybrid GA-PS technique were remarkable as compared to GA and PS alone [15].In [13][14][15], every time GA and PSO are treated as global optimizers, while PS and IPA are used as local search optimizers and mean square error (MSE) is used as a fitness function.
In this paper, an easy and efficient approach based on hybridized GA with PS (GA-PS) and hybrid simulated annealing (SA) technique with PS (SA-PS) are developed for joint estimation of amplitudes and 2-D DOA of far field sources impinging on 2-L-shape array.In these approaches GA and SA are exploited as global optimizers, while PS is incorporated for rapid local search to improve the results further.Mean square error (MSE) is used as an objective function based on an error between actual and estimated signals which is basically derived from maximum likelihood principle [13].This fitness function needs single snapshot to achieve the results and avoids any uncertainty among the angles that are supplement to one another.The validity and effectiveness of the proposed approaches are tested on a large number of simulations which include different cases based on a different number of sources, a different number of sensors, computational complexity, and the proximity of the sources.Initially, the results of GA, PS, SA, SA-PS, and GA-PS are compared with each other for 2-L-shape array, and then, the entire results are compared with the results of 1-L-shape array [15].Later on, the results are also compared with parallel shape array which uses PM [8].
Throughout the paper, the matrices are denoted by capital bold letters, while vectors are expressed by small bold letters, whereas "" denotes the transpose of vectors or matrices.
The left behind paper is organized as follows: the problem formulation is discussed in Section 2, whereas its proposed methodology is provided in Section 3. Section 4 demonstrates the comprehensive simulations along with the discussion of the results, while conclusion and future directions for the research are revealed in Section 5.

Problem Formulation
In this section, we addressed the unknown parameters of the received signals.Consider a 2-L-shape array which consists of three uniform linear arrays (ULAs) placed along -axis, axis, and -axis.Each ULA contains  − 1 elements with the same interelement spacing "", while the reference sensor is common for all subarrays as shown in Figure 1 [16].Consider  narrow band sources impinging on the 2-L-shape array where   ,   , and   are the th source amplitude, elevation angle, and azimuth angle, respectively.
Output Vector along -Axis Subarray.The subarray along axis is used to estimate the elevation angle.The signal received at th element from  sources can be written as where  = 0, 1, 2, . . .,  − 1.
In matrix-vector form, the output of entire subarray can be written as where B is called steering matrix, which contains steering vectors; that is, Similarly, in (2), where   is called additive white Gaussian noise (AWGN) added at the output of each sensor placed in -axis subarray.
Output Vector along -Axis Subarray.The subarray along axis is used to estimate the -component of azimuth angle and elevation angle.The output at th sensor placed in the axis subarray for  sources can be written as In vector-matrix form, it can be written as where Similarly, where   is AWGN added at the output of each sensor in axis subarray.
Output Vector along -Axis Subarray.In the same manner, the -axis subarray is used to estimate the -component of elevation and azimuth angle.The output at th sensor in this subarray is given as follows: where where Similarly, where   is AWGN added at the output of each sensor in axis subarray.Here, the problem in hand is very clear which is to estimate the unknown parameters, that is, amplitudes and 2D-DOA (elevation, azimuth) angles for  sources impinging from far field on 2-L-shape array.

Proposed Techniques
In this section, a brief introduction, parameter setting, and flow diagram are given for GA, PS, SA, GA-PS, and SA-PS.
Simulated Annealing.Simulated annealing (SA) technique is used for both discrete and continuous optimization problems.SA works on those problems, which have controlled heating and cooling properties as evident from its name "annealing", which means "To heat and then cool." Due to easiness in implementation and the capability to avoid getting stuck in local minima, SA is a well-liked technique over the last few decades and has been successfully used in wide range of engineering problems [17].In this paper, an MATLAB "built-in optimization tool box" is used for which the parameter setting is shown in Table 1.The best individual result of SA is further passed through PS for further tuning.
Pattern Search.Pattern search (PS) was introduced by Hookes and Jeeves in 1961 which does not require the gradient or derivative of the problem and can be used for both local and global optimization problems.Basically, PS works on mesh which is defined according to some specific rules.If no improvement in cost function is achieved at the mesh points of current iteration, then the mesh is polished and the process is repeated.It has already got application almost in every field such as signal processing and soft computing [18].
Genetic Algorithm.GA is basically different from previously discussed algorithm (SA and PS) and is applicable to a wide range of optimization problems.GA is a more prominent and proficient algorithm than any other evolutionary computing technique due to its ease in conception, ease in implementation, and more importantly less probability to get stuck in the presence of local optima.GA is being successfully applied to a wide range of problems having application in commerce to the leading scientific research [19,20].The structure of GA exploited for the joint estimation is given in Figure 2.
The general settings consisting of population size, number of generations of the algorithm, function evaluations, and stoppage criteria are defined in Table 1, along with some specific parameter setting/values of the three algorithms based on GA, PS, and SA.
The logical steps for GA and GA-PS in the form of pseudo code are given in the following steps.
Step 1 (initialization).Generate randomly  number of chromosomes (particles) where the length of each chromosome is 3×.In each chromosome, the first  genes represent amplitudes, the next  genes contain the elevation angles, while the last  genes represent the azimuth angles.Mathematically, the th chromosome can be written as Step 2 (objective function).MSE is used as an objective evaluation function, which is derived from MLP [13].For th chromosome, it can be written as where ,   , and   are defined in (1), (3), and (7), respectively, while ŵ  , ŵ  , and ŵ  at th element of each subarray for th chromosome are given as where   is defined in (14).
Step 3 (termination criteria).The termination criteria depending on the following conditions are achieved.
(a) If the objective function value is achieved, which is predefined, that is,  ≤ 10 −12 .
(b) The total number of iterations is completed.
(c) The Tol Fun exceeded.
(d) Tol Con occurred.Step 4 (reproduction).New population is generated by using the operators of crossover, elitism, and mutation selection as provided in Table 1.
Step 5 (hybridization).In this step, the finest results got through GA are further given to PS for more improvement.The setting used for PS is also provided in Table 1.
Step 6 (storage).Store global best of the current iteration which will be used for comparison and better statistical analysis, and repeat Steps 2 to 5 for enough numbers of independent runs.

Results and Discussions
This section is broadly divided into two parts.In first part of simulations, GA, PS, SA, GA-PS, and SA-PS are examined for 2-L-shape array in terms of estimation accuracy, convergence rate, and at the same time, the results are compared with 1-L-shape array [15].In the second part, the performance of the best scheme among the above-mentioned five schemes for 2-L-shape array is not only compared with 1-L-shape array but also with parallel-shape array [8].Throughout the simulations, the distance "" between two consecutive sensors in each subarray is kept /2.All the values of the DOA (elevation and azimuth angle) of sources are taken in radian (rad), and all the results for 2-L-shape array are carried out for threshold value of MSE 10 −2 .The MATLAB built-in "Optimization Tool Box" is used for GA, SA, and PS for which the settings are provided in Table 1.As in [15], no noise is added to the system for estimation accuracy and convergence rate.All the results are comprehensively examined for 100 independent runs.
Case 1.In this case, the estimation accuracy of GA, PS, SA, GA-PS, and SA-PS is discussed for two sources imping-ing on 2-L-type array.For better comparison and analysis, all the values of amplitudes and DOA are the same as in [15] for 1-L-shape array, so the amplitudes and DOA values are { 1 ,  2 ,  1 ,  2 ,  1 ,  2 } = {1, 2, 0.5236 (rad), 0.8727 (rad), 1.2217 (rad), 1.9199 (rad)} where  1 ,  1 , and  1 represent the amplitudes, elevation angle, and azimuth angles of first source and so on.The 2-L-shape array is composed of 4 sensors in which 1 sensor is placed along each subarray, while the reference sensor is common for them.As provided in Table 2, all the five mentioned techniques are quite capable of producing fairly good estimate of the actual values.However, among them, the hybrid approach GA-PS produced better results as compared to the other techniques used.The second and third best results are provided by GA and PS, respective ly.The results of SA are also improved when hybridized with PS.
The results of 1-L-shape array for 2 sources are provided in Table 3 which requires 7 sensors [15].The 1-L-shape array in [15] also uses the same techniques.One can clearly deduce from the comparison of Tables 2 and 3 that 2-L-shape array produced more accurate results as compared to 1-L-shape array with less number of sensors.
Case 2. In this case, the estimation accuracy of all the abovementioned five techniques is discussed for three sources impinging on 2-L-shape array.This time the 2-L-shape array consists of 7 sensors; that is, 2 sensors are placed along each subarray, while the reference sensor is common for them.For better comparison with 1-L-type array, the same values of amplitudes and DOA are used as in [15], which are provided in Table 4.In this case, few local minima are observed due to which the performance of all five techniques especially SA, SA-PS, and PS is despoiled.However, again the hybrid GA-PS shows excellence in accuracy even in the presence of local minima.The second best result is shown by GA alone.Now compare the results with 1-L-type array as provided in Table 5 which requires thirteen sensors [15].Now, one can observe that 2-L-shape array not only requires less number of sensors but also produces more accurate results as compared to 1-L-shape array.
Case 3. In this case, the estimation accuracy is examined for 4-sources.The 2-L-shape array consists of 10 sensors; that is, 3 elements are placed along each subarray, while the reference element is common for them.As provided in Table 6, again the hybrid GA-PS leads the edge over the remaining four techniques in terms of estimation accuracy.The results for 1-L-shape array for the same schemes and the same number of sources are provided in Table 7 which needs fifteen sensors [15].One can again make out the advantages of 2-L-shape array over 1-L-type array in terms of accuracy and the number of sensors required.
Case 4. In this case, the convergence rate is evaluated for 2-Lshape array against a different number of sources in the presence of 10 dB noise.As shown in Figure 3, the convergence rates of all schemes are degraded with the increase of sources.However, one can notice that the convergence rate of GA is remarkable in case of hybridization with PS.The second best convergence is produced by GA itself alone.Now, by comparing with 1-L-shape array whose convergence rate is shown in Figure 4, one can conclude that all the five schemes have better convergence rate for 2-L-shape array as compared to 1-L-shape array.
Case 5.In this case, we checked the validation of all techniques for more practical scenario; that is, we considered DOA on the reference axis of L-shape arrays.For this, the 2-L-shape array is composed of 12 sensors where the amplitudes and DOA of the four sources are  As provided in Table 8, an obvious degradation can be observed in the estimation accuracy of each scheme for all the elevation angles taken near the reference axis, while for azimuth angle near the reference axis, the accuracy is slightly degraded.However, among all of them the GA-PS technique is less degraded as compared to the others.Now, if we check the same DOA using 1-L-shape array, then one can see in Table 9 that the estimation accuracy of all schemes is degraded more as compared to 2-L-shape array.
Up till now, the performance of GA, PS, SA, SA-PS, and GA-PS is discussed for both 1-L-and 2-L-type arrays, and it has been shown through various cases that GA-PS produced fairly good results for both arrays.So, from now onwards, our focus will be limited to the GA-PS technique only.In the upcoming second part of the simulations, we will compare  the GA-PS technique used for 2-L-shape array not only with GA-PS technique used for 1-L-shape array but also with PM which utilizes parallel-shape array [8].Case 6.In this case, the estimation accuracy in terms of MSE is discussed for GA-PS technique against the increasing number of sources.For this, the 2-L-shape array is composed of 13 sensors, while the 1-L-shape array is consisting of 19 sensors.As shown in Figure 5, the MSE is degraded for both L-shape arrays against the increasing number of sources.However, the MSE of GA-PS for 2-L-shape array is better than 1-L-shape array.
Case 7. In this case, Tables 10,11, and 12 list the variances, means, and standard deviations for parallel-shape array with PM method and L-shape arrays with hybrid GA-PS approach.For this, the elevation angle varies between 1.2217 (rad) and 1.5708 (rad) for a fixed azimuth angle of 0.6109 (rad) in the presence of 10 dB noise.The performance of PM method with parallel-shape array is worse for this range of elevation angle, while the 2-L-shape array with GA-PS technique produced accurate estimation.The second best result is produced by GA-PS for 1-L-shape array.This range of elevation angles is very important for mobile communication, and hence, 2-L-shape array with GA-PS is a good choice to be used.Moreover, the range of elevation and azimuth angles for 2-L-shape array is (0, ) and (0, 2), respectively, while the parallel-shape array and 1-Lshape array have the range of elevation, and azimuth angles are (0, /2) and (0, 2), respectively, so both arrays cannot be operated for elevation angles beyond /2.For more details, the readers are encouraged to see [21].
Case 8.In this case, we discussed the computational complexity of GA-PS used for L-shape arrays and PM with parallel-shape array.The PM required total  (3 ×  ×  × ) computations where  is the total number of sensors,  is the total number of sources, and  is the number of snapshots which is 200 [8].On the other hand, the major computations involved in GA-PS with 2-L-shape array include the total number of multiplication in fitness function ( 2 (3 +  required for GA-PS with 1-L-shape array are  ( 2 ((3 + 20 × )) + 20 × )), where  is the number of particles which is 12 in this work.The GA-PS technique with 2-L-shape array is less computationally expensive as compared to PM scheme with parallel-shape array [8].However, it is little more computationally expensive from GA-PS with 1-L-shape array [15].
Case 9.In this simulation, we compared the RMSE of GA-PS used for 2-L-shape array with its counterpart used for 1-L-shape array [15] as well as with PM for parallel-shape array [8].In this, a single source is considered which has elevation and azimuth angles 1.0472(rad) and 1.9199(rad), respectively.The values of signal to noise ratio (SNR) are ranging from 5 dB to 25 dB.For GA-PS with L-shape arrays, we have used 10 log ×√(MSE) where MSE is defined in (16).
It is quite obvious from Figure 6, that GA-PS with 2-L-shape array maintained minimum values of RMSE for all values of SNR.The second best RMSE is maintained by another GA-PS technique with 1-L-shape array.PM using parallel-shape array [8] GA-PS using 1-L-shape array [15] GA-PS using 2-L-shape array Case 10.In Table 13, some general properties of parallelshape array [8], 1-L-shape array [15] and 2-L-shape array are listed.The main drawbacks of parallel-shape array with PM method include estimation failure in the range of 1.2217 (rad) to 1.5708 (rad), its computational complexity, pair matching problem, and need of more sensors.Some of the drawbacks are covered in 1-L-shape array by using GA-PS technique.However, the main disadvantage of 1-L-shape array [15] is the range limitation of elevation angles beyond /2, and it also requires more sensors.The 2-L-shape array with GA-PS technique is more effective and requires not only a minimum number of sensors but also covers the range of elevation angle beyond /2 to  which is of great practical importance in mobile communication [21].

Conclusion and Future Work Direction
In this work, five techniques, that is, GA, PS, SA, SA-PS, and GA-PS, are used to jointly estimate amplitude, elevation angle and azimuth angle of far field sources impinging on 2-L-shape array.It has been shown through various simulations that the hybrid GA-PS technique is the best technique among them.It was also found that the GA-PS technique used for 2-L shape array performed well in terms of estimation accuracy, convergence rate, RMSE, number of sensors required as compared to 1-L-shape array and PM for parallel-shape array.Hence, GA-PS approach with 2-L-shape array is more practical and less expensive in terms of hardware budget for wireless communications.
In future, one can look into same hybrid approach for null steering and sidelobe reduction as well.

Figure 2 :
Figure 2: Generic structure of the hybrid intelligent approach.

Figure 3 :
Figure 3: Convergence rate versus number of sources for 2-L-shape array at 10 dB noise.

Figure 4 :
Figure 4: Convergence rate versus number of sources for 1-L-shape array at 10 dB noise.

Figure 5 :
Figure 5: MSE versus number of sources at 10 dB noise.

Table 1 :
Parameter settings for GA, SA, and PS.

Table 2 :
Estimation accuracy of 2-L-shape array for 2 sources.

Table 4 :
Estimation accuracy of 2-L-type array for 3 sources.

Table 10 :
[8]ns, variances, and standard deviations at 10 dB noise for different elevation angles and fixed azimuth angle by using PM with parallel-shape array[8].

Table 11 :
[15]s, variances, and standard deviations at 10 dB noise for different elevation angles and fixed azimuth angle by using GA-PS with 1-L-shape array[15].
16 × )) plus the multiplications involved in crossover which is approximately 16 ×  2 and the multiplication required for PS which is 16 × .So, the total number of major multiplications involved in GA-PS for 2-L-shape array is  ( 2 ((3+32×))+16×).Similarly, the major computations

Table 12 :
Means, variances, and standard deviations at 10 dB noise for different elevation angles and fixed azimuth angle by using GA-PS with 2-L-shape array.