A brain computer interface BCI enables direct communication between a brain and a computer translating brain activity into computer commands using preprocessing, feature extraction, and classification operations. Feature extraction is crucial, as it has a substantial effect on the classification accuracy and speed. While fractal dimension has been successfully used in various domains to characterize data exhibiting fractal properties, its usage in motor imagery-based BCI has been more recent. In this study, commonly used fractal dimension estimation methods to characterize time series Katz's method, Higuchi's method, rescaled range method, and Renyi's entropy were evaluated for feature extraction in motor imagery-based BCI by conducting offline analyses of a two class motor imagery dataset. Different classifiers fuzzy k-nearest neighbours FKNN, support vector machine, and linear discriminant analysis were tested in combination with these methods to determine the methodology with the best performance. This methodology was then modified by implementing the time-dependent fractal dimension TDFD, differential fractal dimension, and differential signals methods to determine if the results could be further improved. Katz's method with FKNN resulted in the highest classification accuracy of 85%, and further improvements by 3% were achieved by implementing the TDFD method.
1. Introduction
A brain computer interface (BCI) enables direct communication between a brain and a computer translating brain activity into computer commands, thus providing nonmuscular interaction with the environment. Sensorimotor rhythms (SMRs) are rhythmic brain waves found in the frequency range of 8 to 12 Hz over the left and right sensorimotor cortices. Movement, movement preparation, and motor imagery desynchronize SMRs, whereas during relaxation or postmovement, they are synchronized [1]. Since motor imagery does not require any muscular activity, motor imagery-regulated SMRs are commonly utilized in BCI [2, 3]. This is particularly beneficial for people with neurological disorders, since their voluntary muscular activities might be impaired. Another advantage of the utilization of motor imagery-regulated SMRs in BCI is the short training period required [4]. Motor imagery tasks are identified by detecting the synchronization and desynchronization of SMRs. The most common motor imagery tasks are imagery hand [5], foot [4], and tongue [3] movements. Once acquired, SMRs are analyzed using preprocessing, feature extraction, and classification operations.
Feature extraction is the process of accurately simplifying the representation of data by reducing its dimensionality while extracting its relevant characteristics for the desired task. It has a substantial effect on the classification accuracy and speed, since classification carried out without a successful feature extraction process on a high dimensional and redundant data would be computationally complex and would overfit the training data. Fractal dimension is a statistical measure indicating the complexity of an object or a quantity that is self-similar over some region of space or time interval. It has been successfully used in various domains to characterize such objects and quantities [6, 7], but its usage in motor imagery-based BCI has been more recent [8, 9]. There are several fractal dimension estimation methods, some of which are not applicable to all types of data exhibiting fractal properties. In order to achieve a higher classification accuracy and speed, the fractal dimension estimation method that is most suitable to the data at hand should be chosen.
In this study, Katz’s method [10], Higuchi’s method [11], the rescaled range (R/S) method [12], and Renyi’s entropy [13] were evaluated for feature extraction in motor imagery-based BCI by conducting offline analyses of a two-class motor imagery dataset. Fuzzy k nearest neighbors (FKNN), support vector machine (SVM), and linear discriminant analysis (LDA) were tested in combination with these methods to determine the methodology with the best performance. This methodology was then modified by implementing time-dependent fractal dimension (TDFD) [14], differential fractal dimension, (DFD) and differential signals (DS) [15].
2. Materials and Methods2.1. Dataset
The motor imagery dataset from the BCI Competition II (Data set III) provided by the Department of Medical Informatics, Institute for Biomedical Engineering, University of Technology Graz was analyzed. The data was acquired over seven runs from a healthy 25-year-old female subject during imagery left and right hand movements. The signals were recorded with a sampling rate of 128 Hz from three electrodes placed at the standard positions of the 10–20 international system (C3, Cz, and C4) and filtered between 0.5 and 30 Hz. Each run consisted of 40 trials and each trial was nine seconds long. During the first two seconds of each trial, neither a stimulus was presented nor did the subject perform any motor imagery task. After this period, an acoustic and a visual stimulus indicating the beginning of the motor imagery task were presented. Then, for six seconds, a cue (a left or right arrow) indicating the required motor imagery task was presented (in a random order for each trial), and the subject performed this task. During this period, a feedback bar was displayed. Both the training and testing sets consisted of 140 samples.
2.2. Preprocessing
The samples from each electrode were zero phase filtered using a 6th-order bandpass digital Butterworth filter with cutoff frequencies of 0.5 and 30 Hz in both the forward and reverse directions. The last six seconds of each trial were extracted to discard the period without any motor imagery. Two different electrode configurations (C3 and C4, and C3, Cz, and C4) were tested.
2.3. Feature Extraction
In Katz’s method, Higuchi’s method, and the R/S method, the fractal dimension of the samples from selected electrodes were concatenated into feature vectors. In the TDFD, DFD, and DS methods, the fractal dimensions were estimated using the fractal dimension estimation method of the methodology with the best performance.
2.3.1. Katz’s Method
Katz’s method [10] calculates the fractal dimension of a sample as follows: the sum and average of the Euclidean distances between the successive points of the sample (L and a, resp.) are calculated as well as the maximum distance between the first point and any other point of the sample (d). The fractal dimension of the sample (D) then becomesD=log(L/a)log(d/a)=log(n)log(n)+log(d/L),
where n is L divided by a.
2.3.2. Higuchi’s Method
Higuchi’s method [11] calculates the fractal dimension of a sample as follows: first, subsample sets (Xk) are constructed from the sample (X) asXkm={X(m+ik)}i=0[(N-m)/k],
where k∈ [1, kmax], m∈ [1, k] and N is the sample size. Then, the length of each Xk(Lm) is calculated as Lm(k)=(∑i=1[(N-m)/k]|X(m+ik)-X(m+(i-1)k)|(N-1)/([(N-m)/k]k))k.
Finally, the fractal dimension of the sample (D) is solved from〈L(k)〉∝k-D,
where 〈L〉 is the average of Lm. Three kmax values from the range of 8 to 18 [16] (8, 13, and 18) were tested.
2.3.3. R/S Method
The R/S method [12] calculates the fractal dimension of a sample by iteratively dividing it into nonoverlapping subsamples with decreasing subsample size and performing the following operations at each iteration: for each subsample, a new subsample (X) is constructed from its zero mean (ξ) such that the nth point of X is the cumulative sum of the first n points of ξ. Then, the difference between the maximum and the minimum values, and the standard deviation of X (R and S, resp.) are calculated in order to obtain their ratio (R/S). Finally, R/S of each X is averaged ((R/S)avg). After obtaining (R/S)avg at each iteration, the Hurst exponent (H) becomes the slope of the log-log plot of (R/S)avg versus subsample size. The fractal dimension then becomes 2-H.
2.3.4. Renyi’s Entropy
Renyi’s entropy [13] is generalization of Shannon’s entropy. Renyi’s entropy is defined asRq=11-qlog2(∑i=1npiq),
where q>0, q≠1. However, R1 exists and the value is subset of Shannon’s entropy. Therefore, Shannon’s entropy is limit case to Rq when q=1limq→1Rq=S.
This is the fractal dimension on the basic of Renyi’s entropyDq=limδx→011-qlog2log2∑i=1npiqlog2δx,
can be replaced with faster algorithmDq=limδx→0log2∑i=1nNiq-qlog2Nlog2δx.
2.3.5. TDFD Method
In TDFD method, a window (with size s) is slid over a sample by a time step, and the fractal dimension of the part of the sample inside the window is estimated. The fractal dimensions were concatenated into feature vectors. Different window sizes were tested using a time step of one second.
2.3.6. DFD and DS Methods
The DFD method is a variation of the DS method. In the DFD method, first, the fractal dimensions of the samples from selected electrodes are estimated, and then, the pairwise differences of the fractal dimensions are calculated. However, in the DS method [15], first, the pairwise differences of the samples from selected electrodes are calculated, and then, the fractal dimensions of the pairwise differences are estimated. In both methods, the resultant values were concatenated into feature vectors. Only the three electrode configuration was tested, since the two electrode configuration results in one-dimensional feature vectors.
2.4. Classification
After constructing the feature vectors, the test samples were classified as imagery left or right hand movements using different classifiers. FKNN, SVM, and LDA were tested.
FKNN is a variation of KNN. The main difference between the two is that KNN assigns a class label to a sample that is most frequent among the k nearest neighbors of that sample, whereas FKNN assigns a membership value for each class in this neighborhood and classifies the sample as the class with the highest membership value. The membership value for a class was calculated by dividing the sum of the distances between the samples belonging to this class and the test sample by the sum of the distances between all the samples in the neighborhood and the testing sample. Number of nearest neighbors between one and the square root of the sample length were tested.
SVM separates the samples using a hyperplane that maximizes the margin between those belonging to different classes. SVM with a linear kernel was used.
LDA finds a linear combination of features that best separates the samples belonging to different classes and can be used as a classifier. To assign a class label to a sample, the probabilities of the sample belonging to each class were estimated using LDA. The label of the class with the highest probability was then assigned to the sample.
3. Results
The classification accuracies (Table 1) and the computation times (Table 2) were evaluated for each fractal dimension calculation method and classifier combination. Katz’s method was the fastest method, and combining it with FKNN, the highest classification accuracy of 85% (the three electrode configuration and k=9) as well as the second highest classification accuracy of 83% (the two electrode configuration and k=9) were achieved. R/S method with any classifier performed the slowest with the classification accuracies and the computation times ranging from 69% to 71% and 7.32 to 11.07 s, respectively. On the other hand, Renyi’s entropy with any classifier performed the worst with the classification accuracies and the computation times ranging from 55% to 66% and 1.84 to 4.87 s, respectively. The performances of the rest of the combinations were similar (Tables 1 and 2). The classification accuracies (except for the R/S method and Renyi’s entropy) and computation times (except for the R/S method) increased with the number of the number of selected electrodes.
Maximum classification accuracies (percentage of correctly classified testing samples) obtained by the combination of fractal dimension estimation methods and classifiers with the two and three electrode configurations (and the parameters (k and kmax) used to obtain these values).
Classification accuracy (%)
Katz’s method
Higuchi’s method
R/S method
Renyi’s entropy
C3, C4
C3, Cz, C4
C3, C4
C3, Cz, C4
C3, C4
C3, Cz, C4
C3, C4
C3, Cz, C4
FKNN
83 (k=9)
85 (k=9)
77(k=7, kmax=18)
79 (k=5, kmax=18)
71 (k=9)
69 (k=9)
66 (k=9, q=4)
65 (k=9, q=5)
SVM
77
79
78 (kmax=13)
81 (kmax=13)
71
70
59 (q=2)
55 (q=4)
LDA
78
81
78 (kmax=13)
79 (kmax=13)
71
70
59 (q=3)
57 (q=18)
Computation times (time it took for feature extraction and classification) corresponding to the maximum classification accuracies obtained by the combination of fractal dimension estimation methods and classifiers with the two and three electrode configurations (and the parameters (k and kmax) used to obtain these values).
Computation time (s)
Katz’s method
Higuchi’s method
R/S method
Renyi’s entropy
C3, C4
C3, Cz, C4
C3, C4
C3, Cz, C4
C3, C4
C3, Cz, C4
C3, C4
C3, Cz, C4
FKNN
0.17 (k=9)
0.23 (k=9)
1.03 (k=7, kmax=18)
1.5 (k=5, kmax=18)
7.37 (k=9)
11.07 (k=9)
2.35 (k=9, q=4)
2.60 (k=9, q=5)
SVM
0.34
0.34
1.07 (kmax=13)
1.4 (kmax=13)
7.36
10.99
1.90 (q=2)
4.87 (q=4)
LDA
0.12
0.21
0.83 (kmax=13)
1.26 (kmax=13)
7.32
10.99
1.84 (q=3)
3.01 (q=18)
Table 3 shows the computation times and classification accuracies obtained by modifying the best performing methodology. Although all the modifications increased the computation time, further improvements in the classification accuracy (by 3%) were achieved only by implementing TDFD method (the two channel configuration, k=5 and s=10). However, implementing the DFD and DS methods resulted in lower classification accuracies.
Computation times and classification accuracies obtained by modifying the highest performing methodology (Katz’s Method with FKNN) (and the parameters (k and s) used to obtain these values).
TDFD method
DFD method
DS method
C3, C4
C3, Cz, C4
C3, Cz, C4
C3, Cz, C4
Classification accuracy (%)
88 (k=5, s=10)
85 (k=7, s=64)
84 (k=11)
71 (k=11)
Computation time (s)
3.47 (k=5, s=10)
0.94 (k=7, s=64)
0.41 (k=11)
0.26 (k=11)
Mental activity may modulate FD of EEG signal which implies that it is timed-ependent in nature. By implementing TDFD method in Katz’s Method with FKNN, we may measure the fractality in short time intervals of time-sequential data from one end of the waveform to the other sequentially, and we may observe the dynamical changes in the FDs with respect the time series. These FDs, namely, are referred to the time-dependent fractal dimensions (TDFD) [17, 18].
Katz’s algorithm is the most consistent method due to its exponential transformation of FD values and relative insensitivity to noise. Hiaguchi’s method, however, yields a more accurate estimation of signal FD, when tested on synthetic data, but it is more sensitive to noise. In the experiment, EEG datasets used are real data sets which contain noise, hence Katz’s method exhibits better result [19].
4. Conclusions
Since all fractal dimension estimation methods are not applicable to all types of data exhibiting fractal properties, commonly used fractal dimension estimation methods to characterize time series with different classifiers were evaluated to find the most suitable method for motor imagery data. Katz’s method with FKNN was determined to be the best methodology, and the results were further improved by implementing the TDFD method. The results warrant further research to use this methodology in online analysis of motor imagery data and analysis of other signals.
Acknowledgments
The authors would like to thank Alfonsius Geraldi, Umut Güçlüa, and Yağmur Güçlütürkaal and also gratefully acknowledge the helpful comments and suggestions of the reviewers.
KüblerA.MüllerK.DornhegeG.MillanJ. D. R.HinterbergerT.McFarlandD. J.MüllerK.An introduction to brain-computer interfacing2007Boston, Mass, USAThe MIT Press125JeyabalanV.vickneswaran.jeyab07@mmu.edu.mySamrajA.andrews.samraj@mmu.edu.myKiongL. C.ckloo@mmu.edu.myClassification of motor imaginary signals for machine commmunication: a novel approach for brain machine interface designProceedings of the International Conference on Signal Acquisition and Processing (ICSAP '09)2009Los Alamitos, Calif, USAIEEE Computer Society343810.1109/ICSAP.2009.29PfurtschellerG.BrunnerC.SchlöglA.Lopes da SilvaF. H.Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks20063111531592-s2.0-3364656158610.1016/j.neuroimage.2005.12.003Müller-PutzG. R.SchererR.PfurtschellerG.RuppR.EEG-based neuroprosthesis control: a step towards clinical practice20053821-21691742-s2.0-1944436896910.1016/j.neulet.2005.03.021PfurtschellerG.NeuperC.SchloglA.LuggerK.Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters19986331632510.1109/86.712230NakamuraY.YamamotoY.MuraokaI.Autonomic control of heart rate during physical exercise and fractal dimension of heart rate variability19937428758812-s2.0-0027409465PetersE. E.1994New York, NY, USAJohn Wiley & SonsBoostaniR.MoradiM. H.A new approach in the BCI research based on fractal dimension as feature and Adaboost as classifier2004142122172-s2.0-1904439934010.1088/1741-2560/1/4/004PhothisonothaiM.NakagawaM.EEG-based classification of motor imagery tasks using fractal dimension and neural network for brain-computer interface2008E91-D144532-s2.0-6554910351310.1093/ietisy/e91-d.1.44KatzM. J.Fractals and the analysis of waveforms19881831451562-s2.0-0023819518HiguchiT.Approach to an irregular time series on the basis of the fractal theory198831227728395563210.1016/0167-2789(88)90081-4ZBL0649.580462-s2.0-45549113571HurstH. E.Long-term storage capacity of reservoirs1951116770799RényiA.On a new axiomatic theory of probability195563-42853352-s2.0-34250599768008100810.1007/BF02024393ZBL0067.10401SabanalS.NakagawaM.A study of time-dependent fractal dimensions of vocal sounds1995649322632382-s2.0-21844519954TakuyaI.MasahiroN.An application of EEG analyses based on fractal theory to emotion information processing20051047535358SpasićS.sladjana@ibiss.bg.ac.yuKalauziA.ĆulićM.GrbićG.MartaćL.Estimation of parameter kmax in fractal analysis of rat brain activity2005104842742910.1196/annals.1342.054BashashatiA.WardR. K.BirchG. E.HashemiM. R.KhalilzadehM. A.Fractal dimension-based EEG biofeedback systemProceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS '03)September 2003222022232-s2.0-1542330981PhothisonothaiM.NakagawaM.EEG signal classification method based on fractal features and neural networkProceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS '08)August 2008Vancouver, Canada388038832-s2.0-61849096204EstellerR.VachtsevanosG.EchauzJ.LittB.Comparison of fractal dimension algorithms using synthetic and experimental dataProceedings of the IEEE International Symposium on Circuits and Systems (ISCAS '99)May-June 1999Orlando, Fla, USA199202.2-s2.0-1542284930