M-PAM Signals Classification Using Modified Gabor Filter Network

AModified Gabor Filter (MGF) network based approach is used for feature extraction and classification ofM-ary Pulse Amplitude Modulated (M-PAM) signals by adaptively tuning the parameters of MGF network. Modulation classification of M-PAM signals is done under the influence of additive white Gaussian noise (AWGN) and channel effects such as Rayleigh flat fading and Rician flat fading. The MGF network uses the network structure of two layers. First layer which is input layer constitutes the adaptive feature extraction part and second layer constitutes the signal classification part.The Gabor atom parameters are tuned using Delta rule and updating of weights of MGF using Recursive Least Square (RLS) algorithm. The simulation results in the form confusion matrix show that proposedmodifiedmodulation classification algorithm has high classification accuracy at low signal to noise ratio (SNR). The performance comparison with state-of-the-art existing techniques shows the significant performance improvement of proposed MGF based classifier.


Introduction
Automatic Modulation Classification (AMC) is an approach which classifies the modulation format of the received signal at the receiver side.AMC has found extensive importance in the field of electronic surveillance, military domain, electronic counter measures, civil domain, software defined radios, and lately cognitive radios.For example, in military domains, it may be employed for monitoring and interference recognitions, while in civil domain it includes interference confirmation, spectrum management, and signal confirmation.The most important applications in civil domain are intelligent modems, software defined radios, and cognitive radios.Due to incremental technologies such as cognitive radios, the recent research has been focussed to identify and then classify these types of signal as discussed by Haykin [1].
To accomplish AMC, there are two approaches, decision theoretic approach, which is based upon likelihood function of the received signal, and pattern recognition approach, which is based upon features extraction from the received signal [2].The likelihood function based decision theoretic approach is optimal, but computationally complex.The classifier based upon decision theoretic approach is proposed in [3].In [4], author gives survey of the decision theoretic approach and the comparison of proposed classifier performances in the literature.The modulation classification in decision theoretic approach is viewed as multiple hypothesis test or may be sequence of pairwise multiple hypothesis test.Once the likelihood function is set up, average likelihood ratio test (ALRT), generalized likelihood ratio test (GLRT), hybrid likelihood ratio test (HLRT), and combinations of these tests are to be used to determine the modulation format of the received signal [5].Due to phase errors, channel effects, timing jitter, and frequency offset, the decision theoretic approach is not robust to model mismatch [6].Maximum likelihood method is used in classification of digital modulations in [7].The author shows that ML classifier is capable of classifying any finite set constellations with zero error rate when the number of available data symbols goes to infinity.The modulation classification algorithm proposed for identification of software defined radio modulation schemes without pilot symbols between transmitter and receiver in [8].The classifier based upon likelihood ratio test loads the values of test function for likelihood ratio test; the proposed algorithm converts unknown signal symbol to the address of lookup table .The feature extraction based pattern recognition approach (PRA) is robust to model mismatch, but not optimal with less computational complexity as compared to decision theoretic approach.The PRA is divided into two modules.In the first module, distinct features are extracted from the received signal, which undergo channel effects such as fading and also channel noise such as additive white Gaussian noise (AWGN).After the successful extraction of these features, second module is classifier which decides about the modulation format of the received signal [9].
The previous techniques employed in literature for feature extraction based modulation classification are discussed below.In [10], authors considered seven modulation formats for classification using genetic algorithm (GA) based clustering.The features extracted are spectral features from the received signal and reduced set of parameters is derived from these coefficients and input to GA based clustering technique.The modulation classification based upon combination of 2nd, 4th, 6th, and 8th order cumulants and spectral features are proposed in [11].Hierarchical support vector machine (SVM) is used as classifier.The optimization Bee algorithm is used to improve the overall performance of proposed classifier.Spectral features, statistical features, and wavelet based features are used to classify the modulation formats in [12] and performance is evaluated on AWGN channel.The authors proposed a classifier based upon SVM and optimization of algorithm is done using particle swarm optimization (PSO).The modulation formats are recognized using artificial neural network (ANN) and resilient back propagation in [13].The GA is used to select the best feature subset from the combined spectral features and statistical features.The classifier based on a SVM is proposed as multiclass classifier in [14].The features used are higher order statistics and GA is used for selecting the parameters of classifier.The performance is discussed with or without optimization.The modulation classification of -QAM signals is considered in [15].The classifier based upon combination of subtractive clustering and PSO is used to extract features.The algorithm gives higher accuracy in the presence of AWGN channel at higher SNRs.Higher order cumulants (HOC) are used as feature set for the classification of several modulation formats in the presence of AWGN channel in [16].Hybrid classifier which is neural network based is used for classification.The Cramer-Rao lower bound is derived for 4th order cumulants estimator in [17], and the classification accuracy is measured on AWGN channel.The author proposed a classifier which is based upon optimized distribution sampling test (ODST) for classification [18].GA is used to optimize distance metrics using sampled distribution parameters.The decision is based upon candidate modulation and distance between tested signals.Time frequency distributions are proposed for modulation classification in [19].The classification accuracy increased using time frequency features and multilayer classifier are used to classify six modulation formats.
From literature review of the feature based modulation classifications approaches, there are some issues which need to be properly addressed for the development of efficient classifier.The main two issues are choice of extraction of features from the received signal which had undergone channel effects and noise and the classifier structure which is used to discriminate the features for desired modulation format.
In this paper, MGF based efficient features are extracted from the received signal which to the best of our knowledge have not been utilized for the problem of modulation classification of -ary Pulse Amplitude Modulated signals.
The features are extracted from the noisy (AWGN) signals plus channel effects (Rayleigh flat fading and Rician flat fading) using MGF network.After successful extraction of the features, weights of adaptive filter are updated using RLS algorithm and classification algorithm efficiently classifies the -PAM signals.Our previous paper for -QAM, -PSK, and -FSK classification was not at all efficient for -PAM signals [20].In this paper, we have made two important changes to make it efficient for -PAM signals.The classification accuracy of the proposed classifier is also compared with well-known state-of-the-art existing techniques.
The rest of the paper is organized as follows.Section 2 represents the Modified Gabor Filter network and system model and also feature extraction using Gabor filter is presented.In Section 3, Modified Gabor Filter algorithm for training and testing is presented.In Section 4, performance of proposed modified classifier in the presence of AWGN channel, Rician fading channel, and Rayleigh fading channel is presented.Section 5 concludes the paper.

Gabor Filter Based System Model
2.1.System Model.The generalized expression for signal received is given by a work of Ghauri et al. [2]: where () is complex baseband envelope of received signal and () is the additive white Gaussian noise with zero mean and a variance of  2  .The () is defined as where () is the input symbol sequence which is drawn from set of  constellations of known symbols and it is not necessary that symbols are equiprobable. is the amplitude of signal,   is angular frequency offset constant,  is symbol spacing,   is the phase jitter which varies from symbol to symbol, ℎ(⋅) is the channel effects, and ∈  is the timing jitter.
The system model for classification of -PAM signals is shown in Figure 1.The received signal is first preprocessed in which the main part is to remove the noise from the signal Serial to parallel conversion (STP) or to eliminate the sources of variations.After preprocessing efficient features are extracted using Gabor filter network and these features are used for classification of -PAM formats among class of -PAM signals.

Feature Extraction Using Modified Gabor Filter Network.
The Gabor atom is used for the extraction of features and in generalized form it can be written as where () = 2 1/4  − 2 and , , and  are shift parameter, scale parameter, and modulation parameter, respectively [20].There are two layer structures for Gabor filter; in first layer, features are extracted adjusting the Gabor atom parameters (, , ) until some cost function is minimized.In second layer, adjustment of adaptive filter weights and the classification process is to be done.As seen from Figure 2,  = {  ,  = 1, 2, . . ., } input to the filter is first serial to parallel converted and after that Gabor atom nodes are calculated using the relationship   = |⟨  ,   ⟩|.The output of the th Gabor atom node is   corresponding to input signal   .Thus, output of Gabor atom is defined as The Gabor atom {  ,  = 1, 2, 3, . . ., } is defined as The output of the Gabor atom node   in the input layer is weighted by   ; that is, where  = 1, 2, . . ., .The difference between the desired outputs () and actual output () is defined as The cost function is square of error function () which is given by The four parameters of Gabor filter network and adaptive filter (, , , ) are adjusted until the () is minimized and approaches to zero.

Testing and Training of Proposed Algorithm
To classify the -PAM signals, the training and testing of the proposed algorithm have to be done.The PAM formats are spread about axis, and as increasing the  which may vary from 2 to 64, the values of amplitudes are also increasing.The increased values of amplitudes destroy the convergence of the algorithm.To cope up with the problem of divergence, following are the proposed changes in the existing algorithm [20] for classification of PAM formats: (1) The absolute values of amplitude are taken instead of taking whole input modulated signal; for example, PAM 4 have amplitudes {−3, −1, 1, 3} but only take absolute values of amplitudes, that is, {3, 1, 1, 3}.
(3) The weights of the adaptive filter are updated using Recursive Least Square (RLS) algorithm instead of using Least Mean Square (LMS) algorithm for the two motives.First, the convergence rate of RLS is sooner than the LMS.Second, the mean square error produced by RLS is lesser than the LMS.

Input signal X
Gabor filter PAM 8 Gabor filter PAM 4 Gabor filter PAM 2
To initialize the algorithm, weights are initialized as (0) = [1, 1, . . ., 1] and the  is referred to as inverse correlation matrix.The () is the input vector and  is forgetting factor.

Algorithm 1 (training of Modified Gabor Filter network for modulation classification).
Step 1. Initialize Gabor atom parameters.
Step 5.If error is less than chosen threshold, then training of algorithm is stopped and save Gabor atom parameters (  ,   ,   ) and Gabor filter weights   .
Step 6.If error is not less than threshold, repeat step (3) by using the error calculated in step (4).
(B) Testing of MGF Network. Figure 3 shows the testing of MGF network by computing the error function of each Gabor filter network.The minimum error corresponds to the desired modulation format among class of -PAM signals.
The algorithm for testing of MGF network for classification of -PAM signals is as shown below.

Algorithm 2 (testing of Modified Gabor Filter network for modulation classification).
Step 1. Input digital modulated signal which may be PAM 2 to 64 modulated.
Step 2. Compute the output of each Gabor filter network by using the relation Step 3. Compute the error function of each Gabor filter network.
Step 4. Minimum error corresponds to the desired modulation format of the input signal.

Simulation Results
The simulation results are divided into two modules; in the first module, training of Gabor filter network is evaluated for the -PAM signal classification in tabular form and also curves for mean square error versus number of iterations and signal to noise ratio are evaluated.The considered modulation formats are trained accordingly in the class of -PAM signals.The received signal is also corrupted form AWGN and efficient features are calculated and used for training of Gabor filter network.At the end of training, the three parameters of Gabor filter network (shift, scale, and modulation parameters) and adaptive filter weights are saved for minimum mean square error.In the second module, the testing of Gabor filter network is carried out by finding the error function of each Gabor filter network and minimum error corresponds to desired modulation format.The simulation results in testing module are in the form of probability of correctness curve versus SNR under the effects of AWGN and channel effects.

Training of Modified Gabor Filter Network.
Figure 4 shows the training of Gabor filter network under no noise conditions.From Figure 4, it is clear that the minimum means square error (MMSE) is approaching to zero as the number of iterations increases for all considered modulation formats.The training of network is stopped when MMSE reaches some threshold or zero and the features are stored.
Figure 5 shows the training of Gabor filter network under the influence of AWGN channel with fixed number of iterations.The MMSE is approaching to zero as SNR increases from −10 to 20 dB for the considered modulation formats as shown in Figure 5.
Table 1 shows the training performance of Gabor filter network in the form of diagonal matrix or accuracy matrix for the classification of considered modulation formats

Testing of Modified
Gabor Filter Network.Table 3 shows the testing performance of Gabor filter network in the form of diagonal matrix for the -PAM signal classification.The performance is evaluated at SNR of 5 dB and it is shown from the table that percentage accuracy for classifying the modulation formats is much better at low SNRs.
Table 4 shows the testing performance of Gabor filter network in the form of diagonal matrix for the -PAM signal classification at SNR of 10 dB and it is shown from the table that percentage accuracy for classifying the modulation  formats is 98.7%.The testing performance is better due to two facts: first choice of efficient features from the Gabor filter network and second the classifier.
Figure 6 shows the probability of correctness (POC) plotted against number of iterations and from Figure 6, it is clear that POC is approximately 1 when number of iterations increased up to 500.The example considered in Figure 6 is PAM 16 among class of -PAM signals which are classified correctly.
Figure 7 shows the probability of correctness (POC) plotted against signal to noise (SNR) for fixed number of iterations and from Figure 7 it is clear that POC is approximately 1 when SNR is increased up to 10.The example considered in Figure 7 is PAM 16 and classification accuracy is approximately 90% at SNR greater than 3 dB.The classification performance of PAM 8 considered example among the -PAM signals is evaluated in Figure 8. Figure 8 also shows the performance comparison under the effect of AWGN channel, Rician flat fading channel, and Rayleigh flat fading channel.The classification accuracy is much better for the considered example on considered channels.
Table 5 shows the performance comparison of percentage classification on the AWGN channel, Rician flat fading channel, and Rayleigh flat fading channel for the example of 8-PAM among class of -PAM signals.The classifier performance is evaluated for SNR −4 to 10 dB on fading channel plus AWGN.The classifier performance is approximately 100% on AWGN channel, 95% on Rician flat fading channel, and 92% for the Rayleigh flat fading channel at SNR of 10 dB.[22] S p e c t r a l f e a t u r e s 9 0 % Multilayer Perceptron, Hierarchical SVM + Bees Algorithm for Optimization (2012) [11] Spectral features HOM 97.45% (w/o optimization) 99.83% (optimization) SVM + PSO (2012) [12] Spectral features Statistical features Wavelets features 98.8% Artificial Neural Network (2003) [23] S p e c t r a l f e a t u r e s 93% 8 dB of SNR Genetic Algorithm based Clustering (2011) [10] S p e c t r a l f e a t u r e s 98.32% (GA) 98.12% (-mean) Hierarchical Architecture (2000) [24] H The efficient features extraction from the Gabor filter network easily classifies the considered modulation formats with very low probability of error.
Table 6 shows the classification performance comparison with well-known existing techniques.The classification performance of proposed MGF network based classifier is much better at lower SNRs.The proposed classifier is also capable of classifying -PSK, -QAM, and M-FSK [20].The three features are used to classify -PAM signals.

Conclusion
On the basis of simulations, it can be concluded that proposed MGF network efficiently classifies the -PAM signals on

Figure 1 :
Figure 1: System model for classification of -PAM signals.

Figure 2 :
Figure 2: Training of Modified Gabor Filter network for -PAM signals classification.

(
A) Training of MGF Network.The training of MGF network for PAM 2, PAM 4, PAM 8, PAM 16, PAM 32, and PAM 64 is carried out by adjusting the three parameters of MGF network which are shift, scale, and modulation parameters (, , ) and weights of the adaptive filter ().
Figure 2   shows the training of Gabor filter network by adjusting the three parameters and weights of the adaptive filter by using Delta rule and RLS algorithm, respectively.The training process continues until error function is minimized to some threshold or approaches to zero.To update (, , ), Delta rule is used to calculate the change in shift parameter   , scale parameter   , and modulation parameter   :

Figure 3 :
Figure 3: Testing of Modified Gabor Filter network for -PAM signals classification.

Figure 4 :
Figure 4: Training of Gabor filter network for the -PAM formats under no noise.

Figure 5 :
Figure 5: Training of Gabor filter network for the -PAM formats on AWGN channel.

Figure 6 :
Figure 6: Probability of correctness curve for the example of PAM 16.

Figure 7 :Figure 8 :
Figure 7: Probability of correctness curve under AWGN channel for the example of PAM 16.

Table 1 :
Training performance of Gabor filter network of -PAM signal classification without noise.

Table 2 :
Training performance of Gabor filter network of -PAM signal classification on AWGN channel.

Table 2
shows the training performance of Gabor filter network in the form of diagonal matrix or accuracy matrix for the classification of -PAM signals under the influence of additive white Gaussian noise.The training of Gabor filter network is done at SNR of 5 dB and accuracy is approximately 99.5% for considered modulation formats.

Table 3 :
Testing performance of Gabor filter network of -PAM signal classification at SNR = 5 dB on AWGN channel.

Table 4 :
Testing performance of Gabor filter network for -PAM signal classification at SNR = 10 dB on AWGN channel.

Table 5 :
Testing performance comparison of Gabor filter network on AWGN and fading channels for the example of 8-PAM format.

Table 6 :
Performance comparison with existing techniques.