Compared with the efficacy of traditional physical therapy, a new therapy utilizing motor imagery can induce brain plasticity and allows partial recovery of motor ability in patients with hemiplegia after stroke. Here, we proposed an updated paradigm utilizing motor coordination imagery involving the lower limbs (normal gait imagery and hemiplegic gait imagery after stroke) and decoded such imagery via an electroencephalogram- (EEG-) based brain network. Thirty subjects were recruited to collect EEGs during motor coordination imagery involving the lower limbs. Time-domain analysis, power spectrum analysis, time-frequency analysis, brain network analysis, and statistical analysis were used to explore the neural mechanisms of motor coordination imagery involving the lower limbs. Then, EEG-based brain network features were extracted, and a support vector machine was used for decoding. The results showed that the two employed motor coordination imageries mainly activated sensorimotor areas; the frequency band power was mainly concentrated within theta and alpha bands, and brain functional connections mainly occurred in the right forehead. The combination of the network attributes of the EEG-based brain network and the spatial features of the adjacency matrix had good separability for the two kinds of gait imagery (p < 0.05), and the average classification accuracy of the combination feature was 92.96% ± 7.54%. Taken together, our findings suggest that brain network features can be used to identify normal gait imagery and hemiplegic gait imagery after stroke.
National Natural Science Foundation of China81771926617630228147008461463024Yunnan Provincial Department of Education2020J00641. Introduction
Approximately 45% of poststroke hemiplegic patients depend on wheelchairs to move [1–4]. Unfortunately, traditional physical therapy has only a limited effect on rehabilitation of the lower limbs of poststroke hemiplegic patients [5]. In contrast, motor imagery therapy can induce plasticity in the brain [6–10], which can partially restore lower limb movement in poststroke hemiplegic patients [11–14]. At present, most motor imagery therapies have focused on improving the performance of the upper limbs [15, 16], whereas only a few studies have aimed at improving performance of the lower limbs [17]. In addition, current and past studies on motor coordination have mainly focused on control of redundant degrees of freedom in motor coordination [18–23], quantification of motor coordination [24–29], external environments [30], and evaluation methods of motor coordination [31–34]. However, few studies have investigated the neural mechanisms of motor coordination imagery, and there has not been much focus on decoding motor coordination imagery involving the lower limbs.
For the decoding of motor coordination imagery, conventional features have mainly adopted time-domain features [35], frequency-domain features [36], time-frequency features [37], spatial-domain features [38], and fusion of time-frequency-spatial multidomain features [39]. These traditional features mainly reflect the activation level of the corresponding brain area. However, motor coordination imagery of the lower limbs involves not only the activation of related brain regions but also the coordinated control among related brain regions [36]. Therefore, it is necessary to use brain network features to more comprehensively analyze the neural correlates of motor coordination imagery.
In the present study, we proposed a new paradigm (normal gait imagery and hemiplegic gait imagery after stroke) of motor coordination imagery involving the lower limbs. In our paradigm, normal gait imagery is abbreviated as motor coordination imagery (MCI), and poststroke hemiplegic gait imagery is abbreviated as imaging exceptional gait (IEG). In addition to traditional time-domain analysis, power spectrum analysis, and time-frequency analysis, a method for brain network analysis was also used to investigate the neural mechanisms and decoding of motor coordination imagery involving the lower limbs.
The rest of the paper is organized as follows. Details of the method are illuminated in Section 2 including experiments configuration and data analysis. Section 3 displays the brain topographic maps, functional brain networks during MCI, IEG, and REST, and comparison results of the average classification accuracy of MCI and IEG. In Section 4, a brief discussion of the results is given. Finally, Section 5 concludes the paper.
2. Methods2.1. Subjects
Previous studies have shown that brain activity patterns evoked by motor imagery and actual exercise are similar [33]. Hence, our present study used the Kinesthetic and Visual Imagery Questionnaire (KVIQ) [38–50] to recruit 30 healthy subjects (numbered s1–s30) with strong motor imagery abilities (questionnaire score ≥ 70 points) to serve as participants for data collection. All recruited subjects were male, right-handed, without psychological disease and were 25 ± 1 years old. This study was approved by the Medical Ethics Committee of Kunming University of Science and Technology. Each subject signed an informed written consent before the start of the experiment.
2.2. Experimental Paradigm
Coordinated movement is a type of exercise to restore and strengthen motor coordination. It usually involves the coordinated movement of multiple joints and limbs. Specifically, it includes motor coordination of the following: the upper and lower limbs, the limb trunk, and both symmetrical coordination and asymmetrical coordination of the left and right limbs. Among these components, coordinated movement of the upper limbs and hands can train the accuracies, reaction speeds, and rhythms of actions, while coordinated movement of the lower limbs can train correct gaits and motor coordination of the upper and lower limbs. In order to establish a method for recovering motor abilities of poststroke hemiplegic patients, the present study focused on motor coordination imagery of the lower limbs. We designed MCI and IEG. The timing of each trial is shown in Figure 1. The screen at the beginning of the experiment showed a fixed cross for 5 s, which prompted subjects to prepare for the experiment. When the fixed cross disappeared, the screen showed a prompt for normal gait imagery for 2 s, which prompted subjects to prepare for normal gait imagery. Once the prompt disappeared, the screen became blank and required the subjects to imagine a normal gait for 3 s. When the imagery period ended, the screen showed a star prompt for 5 s, indicating the subjects to rest. After the star prompt disappeared, the screen showed a prompt for poststroke hemiplegic gait imagery for 2 s, which prompted subjects to prepare for poststroke hemiplegic gait imagery. After the prompt disappeared, the screen became blank and required subjects to imagine a poststroke hemiplegic gait for 3 s. At the end of the imagery period, the screen showed a star prompt for 5 s, prompting the subjects to rest. This entire sequence comprised one experimental block, and each subject completed a total of 50 blocks.
The timing of a single trial.
2.3. Experimental Setup
During the experiment, subjects were approximately 70 cm away from the prompt screen, and their hands were placed on the desktop. A TCL 24-inch LCD monitor was used for task prompts. A Lenovo ThinkPad computer running Windows 10 was used for data acquisition and processing via MATLAB software. The electroencephalogram (EEG) amplifier consisted of an NT9200 series (Beijing Zhongke Xintuo Instrument Co., Ltd.) with a sampling rate of 1000 Hz and 45 Hz low-pass filtering. At the beginning of the experiment, each subject completed the task according to the prompts in Figure 1. During the experiment, the subjects were required to avoid movements and blinking as much as possible during the visual imagery task. Figure 2 shows the schematic diagram of the electrode layout. The collected EEG data consisted of the following channels: Fp1, Fp2, F7, F3, Fz, F4, F8, FT7, FC3, FCz, FC4, FT8, T7, C3, Cz, C4, T8, TP7, TP8, CP3, CP4, CPz, P7, P3, Pz, P4, P8, PO7, PO8, O1, O2, and Oz. The electrode layout included spatial positioning over the frontal lobe, parietal lobe, occipital lobe, and temporal lobe. The reference electrodes are denoted as A1 and A2.
Schematic diagram of the electrode layout.
2.4. Data Analysis2.4.1. Data Preparation
Visual inspection was carried out on the collected EEG data to remove any data segments with substantial noise in the EEG signal. Then, the EEG data of the 30 subjects under different task conditions were extracted.
2.4.2. Pretreatment
First, baseline drift correction was performed on the extracted EEG signals to eliminate deviations of the EEG signal from the baseline [51]. An elliptic filter was used for 8–30 Hz band-pass filtering. Then, independent component analysis (ICA) was used to remove electrooculogram artifacts and electromyographical artifacts. Additionally, alpha, beta, gamma, zeta, delta, and theta bands were extracted.
2.4.3. Time-Domain Analysis
After preprocessing, the data were divided into three categories: MCI, IEG, and process of rest (REST). Then, these three categories of data were stacked and averaged, and we compared the movement-related cortical potentials (MRCPs) among them in the time domain and compared the MRCP average across channels and the grand average across subjects among these three categories of data.
2.4.4. Analysis of Brain Topography
In order to determine the activation location of the brain region under the three tasks of MCI, IEG, and REST, the three categories of data were preprocessed and then averaged, after which the brain topographies during the three tasks were determined at 1, 100, 200, 300, 400, and 500 ms.
2.4.5. Power Spectrum Analysis
In order to analyze the EEG power associated with the task and reduce the impact of absolute power between subjects and electrodes, the absolute powers, ABSP, of MCI and IEG were obtained by using the power of MCI minus the power of REST, as well as by using the power of IEG minus the power of REST. The quantitative method for determining the power spectral density was via a fast Fourier transform algorithm. ABSP was calculated as follows [52]:(1)ABSPMCI=POWERMCI−POWERREST,ABSPIEG=POWERIEG−POWERREST.
2.4.6. Brain Network Analysis
In order to determine the connectivity of the brain function network under the three tasks of MCI, IEG, and REST, a multivariable autoregressive (MVAR) model was established to obtain a time-varying direct directed transfer function (dDTF). Because dDTF can eliminate the pseudocausal relationship derived from other leads [53], dDTF was used as a measure of causality, and Granger causality analysis was performed on the three types of preprocessed data to generate a dDTF weight matrix. The threshold value used in the present study was set to 0.2. Then, we generated an adjacency matrix under the selected threshold. Finally, we obtained the brain function network under the three types of tasks.
Specifically, the original EEG data, Xt, of the N lead can be expressed as follows:(2)Xt=X1t,X2t,…,XNtT.
Among them, Xit is the EEG time series of the ith lead. MVAR can be constructed according to Xt [54]:(3)Xt=∑k=1pAkXt−k+Et.
Among them, Ak is a matrix of model coefficients of N×N, which represents the dependence of the time delay, k;p is the model order, and Et is the random noise. Our present study used the Bayesian information criterion to determine the model order, p.
By Fourier transform of Ak, we obtain(4)Af=−∑k=0pAke−i2πfk.
Furthermore, Xf in the frequency domain can be obtained as follows:(5)Xf=Af−1Ef=HfEf.
Among them, Hf is the transfer matrix of the system.
Furthermore, the dDTF can be obtained as [55](6)χij2f=Fij2fCij2f.
Among them, Fij2fis the full frequency DTF, and the calculation method is as follows:(7)Fij2f=Hijf2∑f∑k=1NHikf2,where Cijf is the partial coherence. The calculation method is as follows:(8)Cijf=MijfMiifMjjf,where Mij is a minor of spectral matrix (matrix of spectra and cross-spectra) with the i-th row and j-th column removed.
2.4.7. Measurement Analysis of the Brain Function Network
In order to analyze the connectivity of the brain function network in detail, four kinds of network measures (characteristic path length, global efficiency, clustering coefficient, and local efficiency) were selected for comparative analysis of the three types of tasks. The characteristic path length, PL, and global efficiency, Eglob, measure the global transmission capability of the network as follows [56]:(9)PL=1NN−1∑i,j∈N,i≠jdij,(10)Eglob=1NN−1∑i,j∈N,i≠jdij.
In equations (9) and (10), the distance between two nodes, i and j, in the network is represented by dij, which represents the edge number information of the shortest path, and N is the total number of nodes in the network. It can be determined from formulas (9) and (10) that the calculation method of global efficiency is similar to the characteristic path length. The difference is that the global efficiency, Eglob, does not need to consider the isolated points in the network, which is suitable for a regular network, small world network, or a random network.
The local efficiency Eloc measures the local transmission capacity of the network. The local efficiency Eloc of the network is the average of the global efficiency of the subgraphs corresponding to all nodes in the network:(11)Eloc=1N∑i∈NEglobGi.
In equation (11), Gi represents the subnetwork formed by all nodes directly connected with node i.
The cluster coefficient CLa measures the degree of grouping of the network. The cluster coefficient CLa of a network is the mean value of the cluster coefficient cli of all nodes in the network, where the cluster coefficient of node i is defined as follows:(12)cli=2eikiki−1=∑j,maijaimajmkiki−1.
In equation (12), ∑j,maijaimajm is the number of edges included in the subnetwork composed of node i and is directly connected to nodes j and m. kiki−1 is the maximum number of edges of the subnetwork, and ki is the degree of node i. Therefore, the clustering coefficient CLa of a network is as follows:(13)CLa=1N∑i=1Ncli.
In equation (13), N represents the total number of nodes in the network.
2.5. Classification Verification
In order to verify the difference between normal motor coordination imagery involving the lower limbs and that of poststroke hemiplegia gait imagery, the time-domain MRCP feature, power spectrum feature, time-frequency feature, network attribute feature, combined features of network attributes, and the adjacency matrix space were extracted. Since the SVM classifier has a good classification effect on small sample data [57], SVM was used for classification verification.
Specifically, the MRCP feature was used to extract the peak and phase of the 32 electrodes and to form a 32-dimensional feature matrix. The feature of the power spectrum was used to for the AR model to estimate the power spectrum and to obtain a 32-dimensional feature matrix. The time-frequency feature was to extract the time-frequency energy of the 32-lead EEGs by HHT and to form a 32-dimensional feature matrix. The network attribute feature was used to calculate the characteristic path length of the 32 electrodes to form a 32-dimensional characteristic matrix. The spatial feature of the adjacency matrix was used to extract the 16-dimensional feature matrix of the adjacency matrix using a spatial filter.
2.6. Statistical Analysis
In order to test the significance of the task differences, the characteristic path lengths of 15 channels for the three types of tasks were compared in pairs by repeated-measures analysis of variance. The statistical significance level was set as p < 0.05.
3. Results
Figure 3(a) shows the average EEG waveforms across channels and the grand average across subjects during MCI. The colored line represents the average EEG data during MCI across all subjects, and the black line represents the grand average EEG data of MCI across the 32 channels. It can be seen from Figure 3(a) that a negative ERP was generated at about 200 ms. Figure 3(b) shows the average and grand average waveforms during IEG for all subjects. Figure 3(c) shows a comparison of the stack average of EEG data after preprocessing under MCI, IEG, and REST tasks. Figure 3(d) shows the phase difference of EEG data between MCI and REST, IEG and REST, and MCI and IEG. The EEG waveform trends of IEG and REST states were relatively consistent, while the EEG waveform trends of MCI and REST states were almost opposite to one another; additionally, the EEG waveform trends of MCI and IEG states were also opposite to one another (Figure 3(d)).
The average EEG waveforms across subjects, the average EEG across channels, and the phase difference of EEG data during MCI, IEG, and REST.
Figure 4(a) shows the MRCP difference between the MCI and IEG on the C3 and C4 channels, and Figure 4(b) shows the MRCP phase difference between the MCI and IEG on the C3 and C4 channels. Figure 4 shows that, for the MCI MRCPs, the waveforms of the C3 and C4 channels were similar, but there was a significant difference at about 200 ms. For the IEG MRCPs, the waveforms of the C3 and C4 channels were nearly opposite to one another, and the waveforms of the C3 channel were half a cycle ahead of those of the C4 channel, while they reached a consistency at about 200 ms.
Differences in MRCPs and MRCP phases between MCI and IEG.
Figure 5 shows the brain topographic maps at 1, 100, 200, 300, 400, and 500 ms during MCI, IEG, and REST. At about 200 ms, during MCI, the brain topographic map was mainly activated in the right brain sensorimotor area (C4 channel); during IEG, the brain topographic map was mainly activated in the left brain sensorimotor area (C3 channel) and the parietal lobe (Pz channel), while during REST the brain topographic map was mainly activated in the left and right sensorimotor areas (C3 and C4).
The brain topographic maps at 1, 100, 200, 300, 400, and 500 ms during MCI, IEG, and REST. The left, middle, and right columns show the brain topographic maps during MCI, IEG, and REST tasks, respectively. The brain topographic maps, from top to bottom, occurred at 1, 100, 200, 300, 400, and 500 ms during the corresponding task.
In terms of timing, MCI first activated the right frontal lobe (F4 channel), left sensorimotor area (C3 channel), and parietal lobe (Pz channel) at 100 ms; the right sensorimotor area (C4 channel) was activated at 200 ms, whereas the left sensorimotor area (C3 channel) and parietal lobe (Pz channel) were activated at 300 ms. The central frontal area (FCz channel), central sensorimotor area (Cz channel), and right parietal lobe (P4 channel) were activated at 400 ms; the central areas of right frontal lobe (FC4 channel) and left parietal lobe (P3 channel) were activated at 500 ms. IEG first activated the left and right parietal central areas (CP3 and CP4 channels) at 100 ms; the left sensorimotor area (C3 channel) and the parietal lobe (Pz channel) were activated at 200 ms; the frontal central area (FCz channel) was activated at 300 ms. The left frontal central areas (FC3 channel), middle frontal lobe (FCz channel), and left parietal lobes (P3 channel) were activated at 400 ms; the left frontal lobe (F3 channel) was activated at 500 ms. REST first activated the central area of the left and right parietal lobes (CP3 and CP4 channels) at 100 ms; the left and right sensorimotor regions (C3 and C4) were activated at 200 ms. The left frontal lobes (F3 channel), left sensorimotor region (C3 channel), and the central area of the parietal lobes (Pz channel) were activated at 400 ms.
Figure 6 shows the power spectrum during MCI, IEG, and REST tasks, as well as the absolute power spectrum of MCI and IEG. According to changes in the absolute power spectrum of MCI and IEG in Figures 6(d) and 6(e), the power distributions of MCI and IEG were in the θ wave (4–7 Hz), α wave (8–13 Hz), and β wave (14–16 Hz). The frequency band corresponding to the absolute power showed that the power related to MCI was mainly concentrated in the α wave, while the power related to IEG was mainly concentrated in the θ wave.
Comparison of absolute power changes during MCI and IEG.
Figure 7 shows the brain function networks of MCI, IEG, and REST at 1, 100, 200, and 300 ms. The main core nodes of the brain network were F7, FT7, T8, CP3, Pz, and PO8 at 1 ms for MCI, and the network connection took place from the left frontal lobe to the right occipital lobe (Figure 7). The main core nodes of the brain network were FP1, Fz, Oz, and PO8 at 100 ms, and the network connection took place from the forehead to the occipital lobe. The main core nodes of the brain network were F8, FT8, FCz, CP4, TP8, PO7, and O1 at 200 ms. The main core nodes of the brain network were FP2, F3, FT7, T8, TP8, PO8, and Oz at 300 ms, and the network connection occurred from the right forehead to the right occipital lobe. At 1 ms, the main core nodes during IEG were F7, FP2, F4, FCz, C4, P3, and O2, and the network connection took place in the left and right hemispheres; at 100 ms, the main core nodes of the brain network were F7, Fz, P4, and PO8, and the network connection took place from the left forehead to the right occipital lobe. At 200 ms, the main core nodes of the brain network were F4, FCZ, CP4, TP7, and Pz, and the network connection took place in the right hemisphere; at 300 ms, the main core nodes of the brain network were FCz, FT8, P7, Pz, and O1, and the network connection occurred from right forehead to left occipital lobe. When REST was 1 ms, the main core nodes of brain network were FP1, FP2, F7, FC3, T8, O1, and O2, and the network connection took place in the left prefrontal lobe and the right occipital lobe; when REST was 100 ms, the main core nodes of the brain network were PO7, CPz, CP4, P4, and TP8, and the network connection took place in the left and right occipital lobes. At 200 ms during REST, the main core nodes of the brain network were F7, T8, and O2, and the network connection took place in the left prefrontal lobe; when REST was 300 ms, the main core nodes of the brain network were FP2, CPZ, and PO8, and the network connection occurred from the right forehead to the occipital lobe.
Functional brain networks at 1, 100, 200, and 300 ms during MCI, IEG, and REST. The upper, middle, and lower rows show the brain function networks during MCI, IEG, and REST, respectively. From left to right, the brain function networks occur at 1, 100, 200, and 300 ms during the corresponding task, respectively.
Figure 8 shows the comparison of brain network measures among MCI, IEG, and REST tasks. The four selected brain network measures were as follows: characteristic path length, global efficiency, clustering coefficient, and local efficiency. Among these four measures, the difference in the characteristic path lengths was the largest across MCI, IEG, and REST, while the other three measures exhibited only small differences across groups (Figure 8). REST had the largest characteristic path length, followed by MCI and finally IEG. The characteristic path length showed that the speed of information transmission between nodes in IEG was the fastest, followed by MCI and REST.
Comparison of network measures during MCI, IEG, and REST.
In order to statistically analyze differences among MCI, IEG, and REST, the characteristic path lengths of the 15 channels during MCI, IEG, and REST were selected for repeated-measures single-factor analysis of variance. Table 1 shows the statistical results, where significant differences are marked in red. The difference in the characteristic path length between MCI and REST was significant, and only the O2 channel of MCI was not significantly different between MCI and REST (Table 1). There was no significant difference between IEG and REST. Only the p values of P3, C3, CP4, and Pz channel were small during IEG, and there was a significant difference between MCI and IEG.
Results of repeated-measures one-way analysis of variance of characteristic path lengths of the 15 channels during MCI, IEG, and REST.
p values
REST
F3
F4
FC3
FC4
C3
Cz
C4
CP3
CP4
P3
Pz
P4
O1
O2
Oz
MCI
F3
0.000
0.000
0.001
0.000
0.000
0.002
0.001
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
F4
0.000
0.002
0.007
0.000
0.002
0.014
0.009
0.000
0.000
0.001
0.000
0.001
0.002
0.000
0.000
FC3
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
FC4
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
C3
0.000
0.000
0.000
0.000
0.000
0.001
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
Cz
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
C4
0.000
0.000
0.000
0.000
0.000
0.001
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
CP3
0.000
0.000
0.001
0.000
0.000
0.002
0.001
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
CP4
0.000
0.003
0.007
0.000
0.003
0.012
0.009
0.000
0.000
0.001
0.000
0.001
0.002
0.000
0.000
P3
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
Pz
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
P4
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
O1
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
0.000
O2
0.031
0.160
0.277
0.000
0.174
0.359
0.312
0.063
0.044
0.113
0.045
0.154
0.199
0.011
0.022
Oz
0.001
0.008
0.017
0.000
0.008
0.025
0.021
0.002
0.001
0.004
0.001
0.006
0.009
0.000
0.001
IEG
F3
0.000
0.005
0.012
0.000
0.005
0.019
0.016
0.001
0.000
0.002
0.000
0.002
0.005
0.000
0.000
F4
0.002
0.039
0.104
0.000
0.041
0.162
0.127
0.005
0.003
0.017
0.003
0.023
0.048
0.001
0.003
FC3
0.050
0.483
0.949
0.000
0.527
0.796
0.936
0.133
0.079
0.315
0.082
0.488
0.686
0.018
0.039
FC4
0.034
0.226
0.422
0.000
0.244
0.549
0.478
0.074
0.048
0.148
0.051
0.213
0.299
0.014
0.025
C3
0.000
0.003
0.009
0.000
0.003
0.017
0.012
0.000
0.000
0.001
0.000
0.001
0.003
0.000
0.000
Cz
0.118
0.852
0.588
0.000
0.925
0.365
0.480
0.310
0.184
0.621
0.195
0.933
0.827
0.040
0.080
C4
0.042
0.426
0.861
0.000
0.465
0.887
0.973
0.111
0.065
0.270
0.067
0.419
0.604
0.016
0.033
CP3
0.021
0.214
0.454
0.000
0.232
0.622
0.531
0.048
0.031
0.121
0.033
0.181
0.291
0.009
0.017
CP4
0.000
0.005
0.014
0.000
0.005
0.023
0.019
0.001
0.000
0.002
0.000
0.002
0.006
0.000
0.000
P3
0.049
0.372
0.702
0.000
0.404
0.897
0.787
0.116
0.073
0.244
0.077
0.363
0.507
0.019
0.037
Pz
0.000
0.006
0.017
0.000
0.007
0.029
0.023
0.001
0.000
0.002
0.000
0.003
0.007
0.000
0.000
P4
0.019
0.257
0.595
0.000
0.285
0.833
0.699
0.046
0.030
0.134
0.031
0.213
0.363
0.008
0.017
O1
0.074
0.644
0.821
0.000
0.703
0.568
0.701
0.198
0.117
0.440
0.122
0.679
0.911
0.026
0.054
O2
0.028
0.156
0.273
0.000
0.166
0.348
0.309
0.059
0.040
0.108
0.042
0.148
0.199
0.011
0.019
Oz
0.022
0.147
0.275
0.000
0.159
0.356
0.015
0.015
0.015
0.015
0.015
0.015
0.015
0.015
0.01
Figure 9 shows the average classification results obtained by classifying MCI and IEG. The classifier adopted features of MRCPs, time-frequency analysis (Time-freq), power spectrum analysis (Power spec), network attribute analysis (Net-attr), a combination of the network attribute features, and the spatial features of the adjacency matrix (Net-attr + Adj-mat-space). The average classification accuracies of MRCPs, time-frequency analysis, power spectrum analysis, network attribute analysis, a combination of the network attribute features, and the spatial features of the adjacency matrix were 67.89% ± 9.14%, 78.12% ± 8.91%, 81.08% ± 8.99%, 89.12% ± 9.92%, and 92.96% ± 7.54%, respectively. According to the average classification results, the combination of the network attribute feature and the spatial feature of the adjacency matrix had the highest classification accuracies.
Comparison of the average classification results of MCI and IEG classified by MRCPs, time-frequency analysis, power spectrum analysis, network attribute analysis, a combination of the network attribute features, and the spatial features of the adjacency matrix.
4. Discussion
Compared with the efficacy of traditional physical therapy, motor imagery therapy can induce brain plasticity, which can partially restore motor abilities of poststroke hemiplegic patients. At present, motor imagery therapy is mostly used for the recovery of upper-limb motor abilities but rarely for the recovery of lower-limb motor abilities. In addition, although there have been studies on the actual motor coordination of the lower limbs, few studies have investigated the neural mechanisms and decoding of imagined motor coordination of the lower limbs. Therefore, the focus of our present study was distinct from that of traditional studies on motor coordination, such that we focused on motor coordination imagery involving the lower limbs.
First, our present study was different from the simple motor imagery used traditionally for a unilateral limb, such as studies that focused on the upper limbs [58–64], as well as lower limbs [65–67]. Prior to our present study, no related studies on EEG-based lower-limb motor coordination have been published. In order to determine a rehabilitation method for lower-limb motor coordination in poststroke hemiplegic patients, we used a paradigm of motor coordination imagery involving the lower limbs that consisted of both normal gait imagery and poststroke hemiplegic gait imagery. Simple motor imagery of a unilateral limb mainly activates the contralateral brain area [68], while motor coordination imagery involving both lower limbs involves coordination of the left and right lower limbs, which requires the coordinated participation of relevant brain regions on the left and right sides of the brain. This kind of motor coordination imagery training may be beneficial for inducing plasticity of brain network structure/function or affected patients. In future research, we will design and improve our experimental research paradigm for poststroke hemiplegic patients with problems in motor coordination of the lower limbs.
The EEG pattern induced by motor coordination imagery involving the lower limbs is closely related to the performance of motor imagery psychological activities of subjects [68]. In order to ensure the effective completion of the motor coordination imagery involving the lower limbs and the reliability of the corresponding data, before the experiment, subjects were selected according to their scores on a motor-vision imagery questionnaire; subjects with scores higher than 70 were selected for participation in our present study. After the experiment, for the designed imagery task, each subject was required to fill in a questionnaire about the implementation of psychological activities and the degree of difficulty of imagination during completion of the experiments in our present study. The subjects reported that they could complete MCI and IEG in a controllable way, but that for MCI was easier to imagine compared to that for IEG. In future research, we intend to use online neurofeedback to further improve subjects’ motor coordination imagery performance of the lower limbs.
In terms of analysis content, previous studies have mainly focused on the control of redundant degrees of freedom, quantification of motor coordination, external environments, and evaluation of motor coordination, while our present study focused on the neural mechanisms and decoding of motor coordination imagery involving the lower limb. In the EEG analysis method, in addition to traditional sensorimotor rhythm analysis [58–67], we also used MRCPs and brain networks to study motor coordination imagery involving the lower limbs. Previous studies have shown that MRCPs can represent neural activities related to planning before each exercise, the execution of each exercise, and the end of each exercise [64]. Previous studies have also shown that features of brain networks can represent the coordination among brain regions during activities such as sensation, perception, representation, and cognition [53]. The motor coordination imagery in our present study involved planning, execution, and termination of motor imagery, as well as coordination between brain regions.
In the time domain, the EEG patterns of IEG and REST were more consistent, while the EEG patterns of MCI and REST were almost opposite to one another, and the EEG patterns of MCI and IEG were also nearly opposite to one another. These findings may be due to the fact that the subjects were more familiar with resting states and walking states but were not as familiar with poststroke hemiplegic gaits. Unusual imagery can trigger different EEG patterns [36]. In our present study, the MRCPs of MCI and IEG were significantly different in terms of their EEG signals in the C3 and C4 channels. The EEG waveforms of MCI in the C3 and C4 channels were similar, but there was a significant difference at about 200 ms. The EEG waveforms of IEG in the C3 and C4 channels were nearly opposite to one another. The waveform of the C3 channel was a half cycle ahead of the waveform of the C4 channel, whereas they reached a consistent value at about 200 ms. This result may be due to MCI mainly involving bilateral lower limbs, while IEG mainly involves unilateral lower limbs. MRCPs will trigger ERP waveforms around 200 ms [35], so the ERP waveform is formed in the contralateral brain.
As demonstrated by brain topography, motor coordination imagery involving the lower limbs is mainly activated in sensorimotor areas, which is due to motor coordination imagery of the lower limbs representing a form of motor imagery, the latter of which has been shown to activate sensorimotor areas [10]. In addition to activating sensorimotor areas, the visual area located in the occipital lobe also has corresponding activation, which may be because the cues provided to the subjects are processed through the visual pathway before being transmitted to the sensorimotor area [68].
In the present study, power spectrum analysis showed that the power distribution related to MCI was distributed in α waves, while the power related to IEG was distributed in θ waves. Simultaneously, the absolute power of the IEG was much higher than the absolute power of the MCI. This result may be due to MCI being easier to complete than IEG, resulting in MCI inducing lower energy.
Under the condition of motor coordination or imagery, external stimulation acts on sensory organs and causes nerve excitation. The activation of brain-related areas and the coordinated control between brain areas transmit such nerve excitation to synergetic and antagonistic muscles, such that each muscle’s activation is timed appropriately and ensures smooth completion of motor actions. Not only the activation of brain area but also the features of the brain network to represent the coordinated motion or imagination need to be calculated. In the present study, brain network analysis showed that brain functional connections during MCI, IEG, and REST mainly occurred in the right forehead, which may have been due to these psychological activities being related to the subconscious since human subconscious behavior is mainly related to the right forehead network [37, 53, 65, 69]. Our present brain network analysis also showed that the characteristic path length was a good distinguishing feature for MCI and IEG and that the other three measures were not. In addition, because the characteristic path length and the global efficiency determined the efficiency of the entire information transmission of the network [53], the characteristic path length and the global efficiency of the three types of tasks were quite different. IEG had the smallest characteristic path length and the highest global efficiency, so its network-information transfer rate was the fastest, followed by MCI; the slowest was REST, which may have been due to IEG needing to recruit more neural resources.
In the present study, the features of MRCPs, time-frequency analysis, power spectrum analysis, network attribute analysis, a combination of the network attribute features, and the spatial features of the adjacency matrix in MCI and IEG were classified by SVM, and the average classification accuracies were 67.89 ± 9.14%, 78.12 ± 8.91%, 81.08 ± 8.99%, 89.12 ± 9.92%, and 92.96 ± 7.54%, respectively. The results showed that the average classification accuracy of the combination of the network attribute features and the spatial features of the adjacency matrix was 92.96%, confirming that these were the two best classification features. This result may be due to features representing collaborative information among related brain regions; also, the feature dimensionality was high, so the relevant features were extracted and retained comprehensively.
Statistical analysis showed that there was a significant difference in the characteristic path lengths between MCI and REST, for which only the O2 channel was not statistically significant. There was no significant difference between the characteristic path lengths between IEG and REST, whereas the p values of P3, C3, CP4, and Pz channels of IEG were small, but the difference between MCI and IEG was significant. This result may be due to the fact that imagining MCI and REST is a relatively easy psychological activity, while imagining IEG is a relatively difficult psychological activity.
In Figure 5, there are some transition areas which are not clear by uncertainty. This is often more frequent in reality than one might think. We may segment each image obtained in order to delimit each activated area using a fuzzy procedure [70, 71].
5. Conclusion
In order to determine a rehabilitation method for lower-limb motor coordination in poststroke hemiplegic patients, a novel paradigm using lower-limb motor coordination imagery (normal gait imagery and poststroke hemiplegic gait imagery) was employed in the present study. Time-domain analysis, power spectrum analysis, time-frequency analysis, brain network analysis, and statistical analysis were used to investigate the neural mechanisms and decoding methods of motor coordination imaging of the lower limbs. The results showed that motor coordination imagery involving the lower limbs was mainly activated in sensorimotor areas and that the brain functional connection mainly occurred in the right forehead. The results also showed that the average classification accuracies of the combination feature of the network attributes and the spatial features of the adjacency matrix were 92.96% for normal gait imagery and poststroke hemiplegic gait imagery. Taken together, our findings may provide ideas for the rehabilitation of movement in poststroke hemiplegic patients based on motor coordination imagery involving the lower-limb brain-computer interface (BCI). Finally, our future directions are as follows: (1) EEG combined with fMRI to study the neural mechanisms of motor coordination imagery involving the lower limbs and (2) online verification of motor coordination imagery via BCI.
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work was supported by the National Natural Science Foundation of China (Nos. 81771926, 61763022, 81470084, 61463024, and 62006246) and the Science Research Foundation of Yunnan Provincial Education Department (No. 2020J0064).
TeasellR. W.BhogalS. K.FoleyN. C.SpeechleyM. R.Gait retraining post stroke2003102346510.1310/udxe-mjff-53v2-eap02-s2.0-0042467553PaolucciS.BragoniM.CoiroP.Quantification of the probability of reaching mobility independence at discharge from a rehabilitation hospital in nonwalking early ischemic stroke patients: a multivariate study2008261162210.1159/0001356482-s2.0-46449087498FlansbjerU. B.HolmbäckA. M.DownhamD.PattenC.LexellJ.Reliability of gait performance tests in men and women with hemiparesis after stroke2005372758210.1080/165019704100172152-s2.0-15944388586HutinE.PradonD.BarbierF.Walking velocity and lower limb coordination in hemiparesis20123622051110.1016/j.gaitpost.2012.02.0162-s2.0-84862900069PollockA.BaerG.PomeroyV.LanghorneP.Physiotherapy treatment approaches for the recovery of postural control and lower limb function following stroke200720071CD00192010.1016/S0031-9406(05)60025-9TakeuchiN.IzumiS.-I.Rehabilitation with poststroke motor recovery: a review with a focus on neural plasticity20132013121312864110.1155/2013/1286412-s2.0-84878335430Belda-LoisJ.-M.Mena-del HornoS.Bermejo-BoschI.Rehabilitation of gait after stroke: a review towards a top-down approach2011816610.1186/1743-0003-8-662-s2.0-83255188935BirbaumerN.CohenL. G.Brain-computer interfaces: communication and restoration of movement in paralysis2007579Pt 362163610.1113/jphysiol.2006.1256332-s2.0-33947096471BuchE.WeberC.CohenL. G.Think to move: a neuromagnetic brain-computer interface (BCI) system for chronic stroke200839391091710.1161/strokeaha.107.5053132-s2.0-41249093155Luz MariaA. V.Ricardo AntonioS. R.Ramirez-MendozaR. A.Motor imagery based brain-computer interfaces: an emerging technology to rehabilitate motor deficits20157935436310.1016/j.neuropsychologia.2015.09.0122-s2.0-84949531939RossiniP. M.CalauttiC.PauriF.BaronJ.-C.Post-stroke plastic reorganisation in the adult brain20032849350210.1016/s1474-4422(03)00485-x2-s2.0-0038714832CariaA.WeberC.BrötzD.Chronic stroke recovery after combined BCI training and physiotherapy: a case report201148457858210.1111/j.1469-8986.2010.01117.x2-s2.0-79952064938SitaramR.VeitR.StevensB.Acquired control of ventral premotor cortex activity by feedback training201226325626510.1177/15459683114183452-s2.0-84857305016VarkutiB.GuanC.PanY.Resting state changes in functional connectivity correlate with motor recovery for BCI and robot-assisted upper-limb training after stroke20122710.1177/15459683124459102-s2.0-84870607372WolpawJ. R.BirbaumerN.McFarlandD. J.PfurtschellerG.VaughanT. M.Brain-computer interfaces for communication and control2002113676779110.1016/s1388-2457(02)00057-32-s2.0-0036271135NilsenD. M.GillenG.GordonA. M.Use of mental practice to improve upper-limb recovery after stroke: a systematic review201064569570810.5014/ajot.2010.090342-s2.0-78149337403DoA. H.WangP. T.KingC. E.ChunS. N.NenadicZ.Brain-computer interface controlled robotic gait orthosis: a case reportProceedings of the International Conference of the Institute of Electrical and Electronics Engineers (IEEE) Engineering in Medicine & Biology SocietySeptember 2012San Diego, CA, USAhttp://arxiv.org/abs/1208.5024BernsteinB. N.The co-ordination and regulation of movements196727234810.1097/00005072-196804000-00011de RugyA.RiekS.OytamY.CarrollT. J.DavoodiR.CarsonR. G.Neuromuscular and biomechanical factors codetermine the solution to motor redundancy in rhythmic multijoint arm movement2008189442143410.1007/s00221-008-1437-22-s2.0-48349089931CheronG.BengoetxeaA.DanB.DrayeJ. P.Multi-joint coordination strategies for straightening up motor in humans1998242313513810.1016/s0304-3940(98)00053-62-s2.0-0032548756ClarkJ. E.PhillipsS. J.A longitudinal study of intralimb coordination in the first year of independent walking: a dynamical systems analysis19936441143115710.2307/1131331GallowayJ.KoshlandG.General coordination of shoulder, elbow and wrist dynamics during multijoint arm movements2002142216318010.1007/s0022101008822-s2.0-0036139631KelsoJ. A.Phase transitions and critical behavior in human bimanual coordination19842466R1000R100410.1152/ajpregu.1984.246.6.r1000ShafirT.BrownS. H.Timing and the control of rhythmic upper-limb movements2009421718410.1080/002228909033971372-s2.0-75149175753MusselmanK. E.YangJ. F.Interlimb coordination in rhythmic leg movements: spontaneous and training-induced manifestations in human infants200810042225223410.1152/jn.90532.20082-s2.0-57349113049Van EmmerikR.Stability and instability in the coordination of multi joint limb motors1990Champaign, IL, USAUniversity of Illinois at Urbanahttp://hdl.handle.net/2142/19522DiedrichF. J.WarrenW. H.Why change gaits? dynamics of the walk-run transition199521118320210.1037/0096-1523.21.1.1832-s2.0-0029246443FarmerS. E.PearceG.StewartC.Developing a technique to measure intra-limb coordination in gait: applicable to children with cerebral palsy200828221722110.1016/j.gaitpost.2007.12.0052-s2.0-46049120427SparrowW. A.Chapter 5 measuring changes in coordination and control19928414716210.1016/s0166-4115(08)61685-42-s2.0-77956734949BlackD. P.Synergies in within- and between-person interlimb rhythmic coordination: effects of coordination stability and environmental anchoring2005252Cincinnati, OH, USAUniversity of CincinnatiPh.D. thesisKammK.ThelenE.JensenJ. L.A dynamical systems approach to motor development1990701276377510.1093/ptj/70.12.7632-s2.0-0025245517LinternG.Dynamic patterns: the self‐organization of brain and behavior1997210.1002/(sici)1099-0526(199701/02)2:3<45::aid-cplx8>3.0.co;2-mMillerR. H.ChangR.BairdJ. L.Van EmmerikR. E. A.HamillJ.Variability in kinematic coupling assessed by vector coding and continuous relative phase201043132554256010.1016/j.jbiomech.2010.05.0142-s2.0-77956400436MaffiulettiN. A.BizziniM.SchattS.MunzingerU.A multi-joint lower-limb tracking-trajectory test for the assessment of motor coordination2005384110611110.1016/j.neulet.2005.04.0642-s2.0-20444456935JinJ.DalyI.ZhangY.WangX.CichockiA.An optimized ERP brain-computer interface based on facial expression changes201411303600410.1088/1741-2560/11/3/0360042-s2.0-84901288338ScholzJ. P.SchönerG.The uncontrolled manifold concept: identifying control variables for a functional task1999126328930610.1007/s0022100507382-s2.0-0033006455HackneyM. E.LimL. H.JessicaB.BruceC.McgregorK. M.Context-dependent neural activation: internally and externally guided rhythmic lower limb motor in individuals with and without neurodegenerative disease2015610.3389/fneur.2015.002512-s2.0-84954540806HuaL.Yu-QiC.YangL. I.TongZ.Xiang-JiangR.Construct validity of Chinese version of kinesthetic and visual imagery questionnaire20172310.3969/j.issn.1006-9771.2017.05.019AlanD.AnnetteS.DosA. S. M.BastosC. A.A brazilian-Portuguese version of the kinesthetic and visual motor imagery questionnaire2018761263110.1590/0004-282X201701812-s2.0-85040975845CharaP. J.HammD. A.An inquiry into the construct validity of the vividness of visual imagery questionnaire198969112713610.2466/pms.1989.69.1.1272-s2.0-0024325155MarksD. F.DavidF.Bibliography of research utilizing the vividness of visual imagery questionnaire198969370771810.2466/pms.1989.69.3.7072-s2.0-0024801483MarksD. F.DavidF.Construct validity of the vividness of visual imagery questionnaire198969245946510.2466/pms.1989.69.2.4592-s2.0-0024744895MckelvieS. J.The vividness of visual imagery questionnaire: commentary on the marks-chara debate199070255156010.2466/pms.1990.70.2.5512-s2.0-0025325565RichardsonJ. T. E.Gender differences in the vividness of visual imagery questionnaire: a meta-analysis1995193-4177187CamposA.GonzálezM. A.AmorA.The Spanish version of the vividness of visual imagery questionnaire: factor structure and internal consistency reliability200290250350610.2466/pr0.2002.90.2.5032-s2.0-0036548344MalouinF.RichardsC. L.JacksonP. L.LafleurM. F.DurandA.DoyonJ.The kinesthetic and visual imagery questionnaire (kviq) for assessing motor imagery in persons with physical disabilities: a reliability and construct validity study2007311202910.1097/01.npt.0000260567.24122.642-s2.0-34347359143AllbuttJ.ShafiullahM.LingJ.The relationship between self-report imagery questionnaire scores and subtypes of socially desirable responding: visual and motor imagery2006301-212010.2190/Y067-0726-M45W-37W8CamposA.Pérez-FabelloM. J.Psychometric quality of a revised version vividness of visual imagery questionnaire2009108379880210.2466/pms.108.3.798-8022-s2.0-70350458117RandhawaB.HarrisS.BoydL. A.The kinesthetic and visual imagery questionnaire is a reliable tool for individuals with Parkinson disease201034316116710.1097/npt.0b013e3181e1aa712-s2.0-77956057511HidekiN.TakayukiK.KazumasaU.SatoruK.ShioriH.ShinM.Reliability and validity of the Japanese version of the kinesthetic and visual imagery questionnaire (kviq)201885798110.3390/brainsci80500792-s2.0-85047569591VidaurreC.BlankertzB.Towards a cure for BCI illiteracy201023219419810.1007/s10548-009-0121-62-s2.0-77954534870PfurtschellerG.Lopes da SilvaF. H.Event-related EEG/MEG synchronization and desynchronization: basic principles1999110111842185710.1016/s1388-2457(99)00141-82-s2.0-0032829330LiL.CaldwellG. E.Coefficient of cross correlation and the time domain correspondence19999638538910.1016/s1050-6411(99)00012-72-s2.0-0032729317KayS. M.Modern spectral estimation1988Hoboken, NJ, USAPrentice-HallBlinowskaK. J.Review of the methods of determination of directed connectivity from multichannel data201149552152910.1007/s11517-011-0739-x2-s2.0-79959871131PichiorriF.PettiM.MoroneG.MolinariM.MattiaD.Yia2: different brain network modulation following motor imagery bci-assisted training after stroke2014125110.1016/s1388-2457(14)50098-3MalikA. N.IqbalJ.TiwanaM. I.EEG signals classification and determination of optimal feature-classifier combination for predicting the movement intent of lower limbProceedings of the International Conference on Robotics & Artificial IntelligenceNovember 2016Rawalpindi, PakistanIEEE10.1109/ICRAI.2016.77912262-s2.0-85011103579FongS.NgS.GuoX.WangY.KiW.MacfarlaneD.Lower limb muscle reflex contraction latency, peak force and motor control in children with developmental coordination disorder2016http://hdl.handle.net/10722/227730ZhiX.MingZ.WongW. C.ZhangD.SunZ.JiangW.Inter-joint coordination of lower-limb kinematics between able-bodied person and transtibial amputee during walking2015http://xueshu.baidu.com/usercenter/paper/show?paperid=1k710xx0p31q0xp0yk180gm069265067&site=xueshu_se&hitarticle=1StephensonJ. L.LamontagneA.SerresS. J. D.The coordination of upper and lower limb motors during gait in healthy and stroke individuals200929101610.1016/j.gaitpost.2008.05.0132-s2.0-57649152936HutinE.PradonD.BarbierF.GraciesJ. M.BusselB.RocheN.Lower limb coordination patterns in hemiparetic gait: factors of knee flexion impairment201126330431110.1016/j.clinbiomech.2010.10.0072-s2.0-79952693807SilvaM. G.StruberL.BrandoJ. G. T.DanielO.NougierV.Influence of dual-task constraints on the interaction between posture and movement during a lower limb pointing task201823610.1007/s00221-018-5189-32-s2.0-85041181929PriscilaD. B. S.OliveiraA. S. C.Mrachacz-KerstingN.KerstingU. G.Effects of wobble board training on single-leg landing neuromechanics20172810.1111/sms.130272-s2.0-85041132357LiepertJ.HassaT.TüscherO.SchmidtR.Motor excitability during movement imagination and movement observation in psychogenic lower limb paresis2011701596510.1016/j.jpsychores.2010.06.0042-s2.0-78650526351ReaM.RanaM.LugatoN.Lower limb movement preparation in chronic stroke201428656457510.1177/15459683135204102-s2.0-84903577263BoseR.KhasnobishA.BhaduriS.TibarewalaD. N.Performance analysis of left and right lower limb movement classification from EEGProceedings of the 2016 3rd International Conference on Signal Processing and Integrated Networks (SPIN)February 2016Noida, IndiaIEEE10.1109/SPIN.2016.75666832-s2.0-84991738464SueyoshiY.ShimodozonoM.KawahiraK.YamashitaM.Immediate effects of functional vibratory stimulation on the gait of stroke hemiplegia patients201741444810.1166/jnsne.2017.1105TurveyM. T.Coordination199045893895310.1037/0003-066x.45.8.9382-s2.0-0025471237DebaereF.AsscheD. V.KiekensC.VerschuerenS.SwinnenS.Coordination of upper and lower limb segments: deficits on the ipsilesional side after unilateral stroke2001141451952910.1007/s0022101008912-s2.0-0035210674VersaciM.MorabitoF. C.Image edge detection: a new approach based on fuzzy entropy and fuzzy divergence202110.1007/s40815-020-01030-5VersaciM.MorabitoF. C.AngiulliG.Adaptive image contrast enhancement by computing distances into a 4-dimensional fuzzy unit hypercube20175269222693110.1109/ACCESS.2017.27763492-s2.0-85035795365