Computational Intelligence and NeuroscienceVolume 2011 (2011), Article ID 364385, 5 pagesdoi:10.1155/2011/364385

Research Article

Square or Sine: Finding a Waveform with High Success Rate of Eliciting SSVEP

Fei Teng,¹ Yixin Chen,¹ Aik Min Choong,¹ Scott Gustafson,² Christopher Reichley,¹ Pamela Lawhead,¹ and Dwight Waddell1,3

¹Department of Computer and Information Science, University of Mississippi, MS 38677, USA²Department of Psychology, University of Mississippi, MS 38677, USA³Department of Health, Exercise Science, and Recreation Management, University of Mississippi, MS 38677, USA

Received 26 March 2011; Accepted 17 July 2011

Academic Editor: Li Yuanqing

Copyright © 2011 Fei Teng et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Steady state visual evoked potential (SSVEP) is the brain's natural electrical potential response for visual stimuli at specific frequencies. Using a visual stimulus flashing at some given frequency will entrain the SSVEP at the same frequency, thereby allowing determination of the subject's visual focus. The faster an SSVEP is identified, the higher information transmission rate the system achieves. Thus, an effective stimulus, defined as one with high success rate of eliciting SSVEP and high signal-noise ratio, is desired. Also, researchers observed that harmonic frequencies often appear in the SSVEP at a reduced magnitude. Are the harmonics in the SSVEP elicited by the fundamental stimulating frequency or by the artifacts of the stimuli? In this paper, we compare the SSVEP responses of three periodic stimuli: square wave (with different duty cycles), triangle wave, and sine wave to find an effective stimulus. We also demonstrate the connection between the strength of the harmonics in SSVEP and the type of stimulus.

1. Introduction

A brain-computer interface (BCI) translates brain activities into commands that control external devices. BCI research was initially motivated by the need of a new type of communication tools for paralyzed or elderly people [1, 2]. In recent years, many researchers have investigated BCI for computer gaming and entertainment applications [3–6], which makes noninvasive electroencephalography (EEG) a popular choice [7]. Three types of neuronal signals are most commonly used in EEG-based BCI systems: event-related potentials (ERP) [6, 8, 9], motor-imagery-related brain activity [10, 11], and steady state visual evoked potentials (SSVEP) [12–20].

Among these choices, SSVEP is viewed, by many researchers, as a promising electrophysiological source for BCI systems [21]. When looking at a light stimulus flickering at a given frequency, a user's SSVEP is entrained at the same frequency. Hence, by examining the EEG signal, a simple algorithm can identify the corresponding stimulus at which the subject is looking [22, 23]. It has been reported that SSVEPs can be elicited in the range of 4–100 Hz [24–26]. Although the strongest responses were observed in the range of 5–20 Hz, high-frequency stimuli (greater than 30 Hz) present minimal safety hazards due to photo-induced epileptic seizures [27].

Because EEG is always mixed with background noises, the efficacy of an SSVEP-based BCI system relies heavily on the signal-noise ratio. Intuitively, SSVEP will be detected much faster and with greater easy if the signal-noise ratio is high. The faster an SSVEP is identified, the faster a BCI system can correctly respond, hence a higher information throughput [28]. As it is currently unknown whether the choice of a square wave, triangle wave, or sine wave light signal affects the strength of the elicited SSVEP, these three waveforms (square wave with different duty cycles) were compared in Section 3 for their success rate in eliciting an SSVEP response. In addition, researchers have observed that a stimulus at frequency can elicit SSVEP not only at , but also at harmonics , , or sometimes even higher orders [29, 30]. This seems to suggest that harmonics may be used to detect the stimulating frequency. In order to take advantage of the harmonics in the design of a BCI system, the following question needs to be addressed: are SSVEP harmonics elicited by the fundamental frequency, that is, , or by the artifacts of the stimulus?

From a signal perspective, the commonly used flickering stimulus is a periodic square wave with 50% duty cycle. Its spectrum contains nonzero Fourier components at , . Therefore, under a square wave stimulus, the cause of a harmonic in SSVEP is unclear. In this paper, we explore the SSVEP responses of three periodic stimuli: square waves with different duty cycles, triangle waves, and sine waves. This group of waveforms provides us with the flexibility to adjust the strength of harmonics in a stimulus, hence allowing us to investigate the effects of artifact on SSVEPs.

The remainder of the paper is organized as follows. In Section 2, we describe the stimuli used in the experiments and the experimental setup. The results are given in Section 3. We conclude in Section 4.

2. Methodology

Three types of periodic stimuli were used in the experiments: square waves (with duty cycle ), triangle waves, and sine waves. If we define the relative strength of the th harmonic frequency with respect to the fundamental frequency as , where and are the Fourier coefficients for the fundamental frequency and the th harmonic frequency, respectively, it is straightforward to show that for and 0 otherwise; ; . Clearly, in theory, there are no harmonic frequencies in a sine wave. In a triangle wave, the harmonic frequencies only exist for odd . Its magnitude is proportional to . For a square wave with duty cycle , there are also no harmonics for even . The magnitude of odd harmonics is, however, proportional to , that is, stronger than that of a triangle wave. Note that the magnitude of harmonics of a square wave depends on its duty cycle, for example, for .

The above wave forms were rendered using an LED. In order to generate sine and triangle luminance signal, the LED needs to work in a linear (or close to linear) operating region. For the LED used in our experiments, a 3.25 V DC bias was applied. The resulting linear operating region is [3 V, 3.5 V]. The luminance of the LED was converted to an electrical signal using a Lutron LX-102 light meter. The output of the light meter was visualized using a Agilent 54621D oscilloscope and recorded using an integrated sound card. Figure 1 shows the luminance signal and its spectrum of the three waves. Note that the light signals were not perfectly sine, triangle, or square waves due to the nonlinearity of the LED. The artifacts in the sine and triangle waves were more significant than in the square wave. For example, , which should not exist theoretically in sine or triangle waves, appeared in the measured luminance signal. Nevertheless, the amplitude of in the measured sine or triangle luminance is roughly one order of magnitude smaller.

(a) 22 Hz sine

(b) Spectrum of sine wave

(c) 22 Hz triangle

(d) Spectrum of triangle wave

(e) 22 Hz 50% duty cycle square

(f) Spectrum of square wave

Figure 1: (a), (c), and (e) are the luminance figures of an LED measured by a Lutron LX-102 light meter. Their corresponding frequency representations are given in (b), (d), and (f), respectively. The spectrum of the square wave strictly adheres to theory, that is, a peak demonstrated at fundamental frequency as well as a peak at the harmonic. The sine wave and the triangle wave do not. They have weak harmonics that should not exist at . However, these harmonics should not affect the result, since their strength are one tenth that of the fundamental frequency.

Five subjects participated in this experiment. EEG was recorded with one channel over the occipital cortex at a sampling rate of 1 kHz, filtered by a 0.15 Hz high-pass filter and a 150 Hz low-pass filter. The distance between the LED and a subject was 50 cm. We examined stimuli of 11 Hz, 13 Hz, 15 Hz, 18 Hz, and 22 Hz and recorded the SSVEPs of square, triangle, and sine waves. Square waves were generated with 10%, 25%, and 50% duty cycles. In each recording session, the subject was told to look at the stimulus for 8 seconds and close their eyes for a rest period of a random duration from 10 to 20 seconds. The recorded data were discarded when muscle movements artifacts were significant.

3. Results

The primary research goals of these experiments are to find out what kind of waveforms is preferred for future SSVEP based systems. Table 1 reports the SSVEP results from all subjects. is the fundamental frequency of the stimulus. “Valid trials” is the number of trials where the magnitude of FFT coefficients of SSVEP at , , or are 50% greater than the baseline. “Total trials" is the number experiments in which a stimulus is presented to a user regardless of whether the SSVEP peaks were detected. “1 occurs, occurs, and occurs” are the number of observed SSVEP peaks at , and , respectively.

Table 1: Statistic of harmonics in SSVEP.

occurs
occurs
occurs
Valid trials
Total trials

11 Hz sine
20
10
7
22
29

13 Hz sine
22
9
2
22
30

15 Hz sine
23
8
5
25
33

18 Hz sine
23
9
6
25
34

22 Hz sine
19
12
1
20
26

11 Hz triangle
14
10
4
16
22

13 Hz triangle
19
10
0
19
21

15 Hz triangle
16
5
5
16
17

18 Hz triangle
17
6
2
17
21

22 Hz triangle
15
9
3
15
19

11 Hz 50% square
20
11
15
20
21

13 Hz 50% square
17
5
5
17
19

15 Hz 50% square
17
9
8
16
17

18 Hz 50% square
18
9
8
19
19

22 Hz 50% square
18
9
8
18
19

11 Hz 25% square
11
9
5
11
15

13 Hz 25% square
17
8
6
18
18

15 Hz 25% square
7
7
7
10
15

18 Hz 25% square
17
14
10
18
18

22 Hz 25% square
15
15
10
18
18

11 Hz 10% square
8
9
4
12
17

13 Hz 10% square
13
13
6
17
17

15 Hz 10% square
15
12
11
19
20

18 Hz 10% square
16
9
10
20
21

22 Hz 10% square
13
6
6
15
19

Theoretically, SSVEP peaks appear at the stimulus frequency and its harmonics , , and so forth. An SSVEP system has to use an recognizable component to identify which frequency the subject is looking at, while it sometimes uses its harmonics to improve the accuracy. Thus, a valid trial without a peak may not be acceptable in a real SSVEP system. So, we define a trial in which occurs as an accurate trial, and the accuracy of a certain type of waveform of a certain frequency is . Figure 2 shows the accuracies of SSVEP trials driven by the three waves above.

Figure 2: 11, 13, 15, 18, and 22 Hz were used as the stimulus frequencies. The accuracies of the SSVEP experiments are computed with equation .

We have the following observations. (i)A square waves with 50% duty cycle have a significantly higher accuracy than other stimuli in our experiment. As shown in Figure 2, the average accuracies ) of sine, triangle, and square waves with duty cycle 50%, 25%, and 10% were , , , , and , respectively. Using statistic analysis techniques, we check if the performance of 50% square wave is better than that of triangle wave, which is intuitively the second best waveform as seen in Figure 2, with a significant level less than 0.05. ) 50% square waves and triangle waves evoked SSVEP, thus . Since , we conclude that square waves with duty cycle have a significantly higher accuracy than other stimuli in our experiment. (ii)A square wave has a higher success rate than sine or triangle waves in eliciting SSVEPs. In our experiments, the success rates (number of valid trials divided by the total number of trials) for sine, triangle, and square waves were , , and , respectively. (iii)All three wave forms elicited component in SSVEPs. In our experiments, the success rates for component in SSVEP were for sine waves, for triangle waves, and for square waves (averaged over all three duty cycles). Among the three duty cycles, , , and , of the square wave, the success rates were , , and , respectively.(iv)A square wave has a significantly higher success rate than sine or triangle wave in eliciting component in SSVEPs. In our experiments, the success rates for component in SSVEP were 18.4% for sine waves, 14.0% for triangle waves, and 48.0% for square waves (averaged over all three duty cycles). Among the three duty cycles, 10%, 25%, and 50%, of the square wave, the success rates were 44.6%, 50.7%, and 55.0%, respectively.

Although sine, triangle, and square waves with duty cycle do not contain component, they all elicited in SSVEP with similar success rates. Square wave with duty cycle contains a strong component. Its success rate is significantly higher (). This suggests that (1) the component is primarily elicited by the fundamental frequency and (2) the artifacts in the stimuli increase the success rate of in SSVEP. A similar observation is obtained for . This seems to suggest that although the fundamental frequency can elicit harmonics (2 and in our experiments) in SSVEP, the success rate of getting harmonics in SSVEPs is positively correlated with the strength of the artifacts in a stimulus.

4. Conclusion

Our results showed that the harmonics associated with SSVEP are elicited both by the fundamental frequency and the artifacts of the stimuli, with the component mainly produced by the fundamental frequency and the mainly by the artifacts of square waves. At the same time, SSVEP elicited with square waves do not always contain all the artifactual frequency components, for example, , and SSVEP with sine waves may have harmonics, which is not a part of the stimuli artifacts.

We also observed that square waves with duty cycle have a significantly higher accuracy than other stimuli in our experiment. As a result, the use of square waves with duty cycle is preferred if high SSVEP eliciting rate is the goal, while sine waves for SSVEP simulation should be chosen if few harmonic artifacts are wanted.

Acknowledgments

This work was supported by the Department of Computer and Information Science and the School of Engineering, University of Mississippi. We would like to thank James Church, Joseph Smith, Xiaofei Nan, and Jing Ma for the help in data collection.

References

T. Hinterberger, A. Kübler, J. Kaiser, N. Neumann, and N. Birbaumer, “A brain-computer interface (BCI) for the locked-in: comparison of different EEG classifications for the thought translation device,” Clinical Neurophysiology, vol. 114, no. 3, pp. 416–425, 2003.

N. Birbaumer, A. Kübler, N. Ghanayim et al., “The thought translation device (TTD) for completely paralyzed patients,” IEEE Transactions on Rehabilitation Engineering, vol. 8, no. 2, pp. 190–193, 2000.

L. Piccini, S. Parini, L. Maggi, and G. Andreoni, “A wearable home BCI system: preliminary results with SSVEP protocol,” in Proceedings of the 27th Annual International Conference of the Engineering in Medicine and Biology Society, (IEEE-EMBS 2005), pp. 5384–5387, September 2005.

E. Lalor, S. Kelly, C. Finucane et al., “Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment,” Eurasip Journal on Applied Signal Processing, vol. 2005, no. 19, pp. 3156–3164, 2005.

V. Jaganathan, T. M. Srihari Mukesh, and M. Reddy, “Design and implementation of high performance visual stimulator for brain computer interfaces,” in Proceedings of the 27th Annual International Conference of the Engineering in Medicine and Biology Society, (IEEE-EMBS 2005), pp. 5381–5383, September 2005.

G. Pfurtscheller, C. Neuper, C. Guger et al., “Current trends in Graz brain-computer interface (BCI) research,” IEEE Transactions on Rehabilitation Engineering, vol. 8, no. 2, pp. 216–219, 2000.

K. Nielsen, A. Cabrera, and O. do Nascimento, “EEG based BCI—towards a better control. Brain-computer interface research at Aalborg University,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 14, no. 2, Article ID 1642769, pp. 202–204, 2006.

N. Birbaumer, N. Ghanayim, T. Hinterberger et al., “A spelling device for the paralysed,” Nature, vol. 398, no. 6725, pp. 297–298, 1999.

J. Wolpaw, N. Birbaumer, D. McFarland, G. Pfurtscheller, and T. Vaughan, “Brain-computer interfaces for communication and control,” Clinical Neurophysiology, vol. 113, no. 6, pp. 767–791, 2002.

H. Lee, A. Cichocki, and S. Choi, “Nonnegative matrix factorization for motor imagery EEG classification,” in Proceedings of the 16th International Conference on Artificial Neural Networks, (ICANN 2006), vol. 4132 of Lecture Notes in Computer Science, pp. 250–259, 2006.

B. Lou, B. Hong, X. Gao, and S. Gao, “Bipolar electrode selection for a motor imagery based brain-computer interface,” Journal of Neural Engineering, vol. 5, no. 3, pp. 342–349, 2008.

M. Middendorf, G. McMillan, G. Calhoun, and K. S. Jones, “Brain-computer interfaces based on the steady-state visual-evoked response,” IEEE Transactions on Rehabilitation Engineering, vol. 8, no. 2, pp. 211–214, 2000.

S. P. Kelly, E. C. Lalor, C. Finucane, G. McDarby, and R. B. Reilly, “Visual spatial attention control in an independent brain-computer interface,” IEEE Transactions on Biomedical Engineering, vol. 52, no. 9, pp. 1588–1596, 2005.

S. P. Kelly, E. C. Lalor, R. B. Reilly, and J. J. Foxe, “Visual spatial attention tracking using high-density SSVEP data for independent brain-computer communication,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 13, no. 2, pp. 172–178, 2005.

G. R. Muller-Putz, R. Scherer, C. Brauneis, and G. Pfurtscheller, “Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components,” Journal of Neural Engineering, vol. 2, no. 4, pp. 123–130, 2005.

M. Cheng, X. Gao, S. Gao, and D. Xu, “Design and implementation of a brain-computer interface with high transfer rates,” IEEE Transactions on Biomedical Engineering, vol. 49, no. 10, pp. 1181–1186, 2002.

O. Friman, I. Volosyak, and A. Gräser, “Multiple channel detection of steady-state visual evoked potentials for brain-computer interfaces,” IEEE Transactions on Biomedical Engineering, vol. 54, no. 4, article 20, pp. 742–750, 2007.

E. Sutter, “The brain response interface: communication through visually-induced electrical brain responses,” Journal of Microcomputer Applications, vol. 15, no. 1, pp. 31–45, 1992.

T. Mukesh, V. Jaganathan, and M. Reddy, “A novel multiple frequency stimulation method for steady state VEP based brain computer interfaces,” Physiological Measurement, vol. 27, no. 1, pp. 61–71, 2006.

F. Teng, A. Choong, S. Gustafson, D. Waddell, P. Lawhead, and Y. Chen, “Steady state visual evoked potentials by dual sine waves,” in Proceedings of the Association for Computing Machinery Southeast Conference, (ACMSE), 2010.

F. Beverina, G. Palmas, S. Silvoni, F. Piccione, and S. Giove, “User adaptive BCIs: SSVEP and P300 based interfaces,” PsychNology Journal, vol. 1, pp. 331–354, 2003.

S. T. Morgan, J. C. Hansen, and S. A. Hillyard, “Selective attention to stimulus location modulates the steady-state visual evoked potential,” Proceedings of the National Academy of Sciences of the United States of America, vol. 93, no. 10, pp. 4770–4774, 1996.

M. Muller and S. Hillyard, “Effects of spatial selective attention on the steady-state visual evoked potential in the 20–28 Hz range,” Cognitive Brain Research, vol. 6, no. 4, pp. 249–261, 1998.

D. Regan, Human Brain Electrophysiology: Evoked Potentials and Evoked Magnetic Fields in Science and Medicine, Elsevier, New York, NY, USA, 1989.

C. S. Herrmann, “Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena,” Experimental Brain Research, vol. 137, no. 3-4, pp. 346–353, 2001.

G. Garcia, D. Ibanez, V. Mihajlovic, and D. Chestakov, “Detection of high frequency steady state visual evoked potentials for brain-computer interfaces,” in Proceedings of the 17th European Signal Processing Conference (EUSIPCO 2009), 2009.

M. A. Pastor, J. Artieda, J. Arbizu, M. Valencia, and J. C. Masdeu, “Human cerebral activation during steady-state visual-evoked responses,” Journal of Neuroscience, vol. 23, no. 37, pp. 11621–11627, 2003.

B. Allison, I. Sugiarto, B. Graimann, and A. Graser, “A display optimization in SSVEP BCIs,” in Proceedings of the Computer-Human Interaction, (CHI 2008), Florence, Italy, April 2008.

G. Bin, X. Gao, Z. Yan, B. Hong, and S. Gao, “An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method,” Journal of Neural Engineering, vol. 6, no. 4, Article ID 046002, 6 pages, 2009.

D. J. Krusienski and B. Z. Allison, “Harmonic coupling of steady-state visual evoked potentials,” in Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, (EMBS'08), pp. 5037–5040, August 2008.