Professional Documents
Culture Documents
Abstract
EEGs of 6 normal subjects were recorded during sequences of periodic left or right hand movement. Left or right was indicated by a
visual cue. The question posed was: 'Is it possible to move a cursor on a monitor to the right or left side using the EEG signals for cursor
control?' For this purpose the EEG during performance of hand movement was analyzed and classified on-line. A neural network in
form of a learning vector quantizertion (EVQ) with an input dimension of 16 was trained to classify EEG patterns from two electrodes
and two time windows. After two training sessions on 2 different days, 4 subjects showed a classification accuracy of 89-100%. For two
subjects classification was not possible. These results show that in general movement specific EEG-pattems can be found, classified in
real time and used to move a cursor on a monitor to the left or right. On-line EEG classification is necessary when the EEG is used as
input signal to a brain computer interface (BCI). Such a BCI can be a help for handicapped people.
Keywords: Neural networks; Movement; Event-related desynchronization; Post-movement beta synchronization; Brain computer interface
1. Introduction
On-line EEG classification is a prerequisite for the construction of an EEG-based brain computer interface (BCI).
Such a BCI is a communication system which classifies
different EEG patterns in real time and produces a control
signal depending on the classification result (Farwell and
Donchin, 1988; W o l p a w et al., 1991; McFarland et al.,
1993; Pfurtscheller et al., 1993; W o l p a w and McFarland,
1994). EEG patterns such as those generated in sensorimotor areas can be modified either by preparation for and
execution of movement (Chatrian et al., 1959; Pfurtscheller and Berghold, 1989) or by imagination thereof (Wolpaw and McFarland, 1994). The latter is useful to patients
with severe motor impairment as a new communication
channel. Although ultimately only mental activity (i.e.
without a motor act) should be transformed into control
signals, it is an important intermediate step to investigate
the possibility of using EEG signals recorded before and
* Corresponding author. Tel.: +43 316 8735311; fax: +43 316 812964.
EEG 95689
417
D2
B9
D1
D8
A5
D5
-1.5/-0.5
-2.5/-1.5
-2.0/-1.0
-1.0/0.0
-1.5/-0.5
-2.0/-1.0
-0.5/+0.5
-0.5/+0.5
0.0/+1.0
-0.5/+0.5
-1.0/0.0
12-15
8-14
14-18
16-20
12-16
18-24
16-24
16-20
12-14
12-16
18-24
2.1. Subjects
Six subjects (two females, 4 males, 22-28 years old)
served as volunteers. All were students and reported no
history of neurological disorders or use of medication.
"lefthand"
Feedback
1st beep
presentationl
I
V y \/
q
R Reference
period
2nd beep
3 sec
V
movement
Fig. 1. Timing of the movement experiment with time of target, beep and
feedback presentation; in addition, the reference period used for ERD
computation (R) is indicated.
418
"=
(wi[xi-Yi])
(1)
2.6. On-line artifact detection
419
3. Results
3.1. Time windows and frequency components
The 1 s time windows selected for classifcation are
summarized in Table 1. Table 2 shows the average classification accuracy of DSLVQ for different subjects, sessions and both time windows. The average classification
performance was used to compare different feature sets
and sessions. An average classification accuracy close to
50% indicated that no feature combination was found
which could be used for reliable classification. Only data
from time windows with an average classification accuracy >57% (this threshold was chosen arbitrarily) were
used for frequency component selection.
Examples of the DSLVQ weight values for all 6 subjects
are presented in Fig. 2 for time window I1 and in Fig. 3 for
time window 12. The results of two training sessions X1
and X2, and for comparison also of the results of test
session X3, are superimposed. It can be seen that for subject D2, the optimal frequency band is strongly dependent
on the time window. Classification accuracies of the single
examples were extremely high in both training sessions
(between 66% and 77%; see also Table 2). The figures
show that the most relevant frequency components are at
13 Hz for the first and at 19 Hz for the second window.
Therefore, the bands for the online experiment were determined as 12-15 and 16-24 Hz.
Subject A5 showed a clear peak centered around 13 Hz
in both time windows and both sessions. In addition, the
classification accuracies (in all cases) were between 58%
and 78%. According to these results, the 12-16 Hz band
was selected. For subject D5, the frequency band 18-24
Hz was chosen from time window 1 and used for both time
windows (the classification accuracy of time window 2
was 54% and 45%, respectively).
The inspection of the DSLVQ weights of subject D8 in
Figs. 2 and 3 revealed no consistent behavior over the
frequency components of sessions X1 and X2, although
the classification averages in session X2 were 60% and
67%. Thus for subject D8, and also for subjects B9 and
D1, both with poor classification results (see Table 2), the
selection of the relevant frequency band for on-line analysis was done by inspection of average ERD time courses
from both training sessions X1 and X2 (in addition to the
standard frequency bands, the 8 - 14, 12-14 and 14-18 Hz
bands were chosen for ERD calculations). Table 1 summarizes the frequency bands which have been selected for
each of the subjects for on-line control.
3.2. ERD time courses
Fig. 4 displays examples of ERD time courses in the
frequency bands which were finally selected for three subjects (D2, D1, A5) during left hand movement. From these
Table 2
Average classification accuracies of data vectors based on 18 frequency
components (7-24 Hz) for both 1 s time windows (I1, I2), 3 sessions
(X1, X2, X3) and 6 subjects
D2
B9
D1
D8
A5
D5
X1 I1
X1 I2
X2 I1
X2 12
X3 I1
X3 12
77
54
56
53
69
67
66
60
47
58
59
54
69
47
49
67
78
75
67
51
63
60
58
45
67
58
51
57
72
69
57
57
55
54
67
55
420
Table 3 summarizes the results for each of t h e 6 subjects, showing the overall performance (i.e. the percentage
of correctly classified trials), the average number of classifications and the maximum number of classifications
within the trials. Notice the inverse relationship between
the average number of classifications and the performance.
This could, however, be a result of the data processing
method employed.
The results of the classifier output are summarized in
D2
0.07
0.08
0.05
0.04
0.02
0.05.
.A"
,..
o.o4
::%
......
0.03
A J'
O.O3
B9
Weights
Weights
,/
~;.
~;
0.02- ~
'"
0.01
0.01
--
""
\1
,
O,
e 10 11 12 13 14 1 $ 1 6 17 18 19 20 21 22 23 24
D1
0.04
~<"..~.,.,"X ,,
", '
0.02
t ./ ./".
,",,..V\
-'"
., .
.,
,'
,'
.. .... ~
-"
.'%
Hz
I: ~-.
'
/\
',
'.
'
'
'
'
'
D5
0.08
0.07
0.08
0.05
":
0.04,
0.03
0.02
0.01
0.
0
8
/~
Weights
0.08 ~
7 8 9 10 11 12 13 14 15 16 17 18 t9 20 21 22 23 24 H z
0.08
i "~
.4
"
;i
!'.q
002
",-
A5
o.12
003
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Weights
0.15
',
i ~
o.o,
O.Ol
D8
0.05
.~. I
0.01
,.
0.07
0.08
0.05
..':"
',
Weights
0.06-
0.1)3
',
7 8 9 10 11-12 13 14 15 16 17 18 19 20 21 22 23 24 H Z
Weights
,,,.':
'
Hz
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
X1
Hz
..''2
X2
?.
,"
."
9 10 I1 12 13 14 15 16 17 18 19 20 21 22 23 24 H Z
X3
..o...o-
Fig. 2. Distribution of DSLVQ weight values for 18 frequency components in time window I1 for 6 subjects (D2, B9, D1, D8, A5, D5). For comparison,
the results of 3 sessions (X1, X2, X3) are superimposed.
421
Discussion
The results show that for 4 out of 6 subjects, classification accuracies of between 89 and 100% (mean 94%) were
obtained. For the other two subjects, however, the classification accuracies were close to the random level of 50%.
From this we can conclude that not all subjects are suitable
for on-line EEG classification using the employed set of
methods. One reason for this can be inappropriate electrode positioning, another the masking of the sensorimotor
rhythms by occipital alpha or other rhythms. Another
B9
D2
Weights
Weights
0.06.
0.06,
0.05'
oo , - -
0.04.
0.04.
0.03.
0.02.
. A
,%,/
,,
-"'"
~:'.
0.01
,.
......'....
: . . . . .
o.o..
k.
,,,
o.o1
r"
9 1o 11 lg: 13 14 15 16 17 18 19 20 21 22 23 24 H z
~
"
"
o.,.._....
/'.,
o.= ~.,, ~ .,
=,
.'
9 10 11 12 13 14 1$ 16 17 18 19 20 21 22 23 24
'
D8
.,
. ,.
.| .
.=
o.o2 .'
V'
. i
/,,
:
o.o~
.~
s. ~
".,:
oi
..
. ..
. .
..
,,"
D5
o.o5
,;
',/%/
,,
"~
",
0.01
llt
Weights
o.o6
: "'-',o'V
;,..,
v
"x':i
'
'
o.os
~,K
,,:t /'.~":A
v ~.
"
,/ ,,
:
: ~
'' ""/
-';
",,,
~ , , ~ . .. . , .
~, . .~"f
A5
Weights
A-"
^,.
O, " ; : ; " : : : : ; : : : : : ; I
7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 J"
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 H Z
o..
.....
...of.
0.01
0.01
8
Jt
0.04.
0.06.
.,
Weights
0.06.
o=
""
D1
Weights
0.~.
'
">'.A
00,
0.02
"
-'.A
.,
-...,~
~-e,, /
0.01
'
"
9 10 11 12 13 14 t5 16 17 18 19 20 21 22 23 24 H Z
Xl
X2
,41
\'"'V"
"
=:
'
9 10 11 12 t3 14 IS 16 17 18 19 20 21 22 23 24
X3
Fig. 3. Distribution of DSLYQ weight values for 18 frequency components in time window I2 for all subjects and sessions (see Fig. 2).
'
422
03
200
D2
150
electrode
200]
16 - 24 Hz
-50'
10
.50
P~lo
-50
?,,'r,.,~r
'2 4
d
12
[s]
200 ]
10
12
14
150 1
'1
50 -] ".
;i ,
I.
li
[s]
......
- lOO
14
Is]
4
10
12
14
200
~so
,-'.[
:',.
[%1 0
,.1'
! ","[
2
""::,,
-50
- 1O0
0
J'f
-100
1'2' 14
- 16 Hz
":
-50
I
I
[%] o t
-50 !
14 - 1 8 H z
D1
-i
150 1
100
50.
~]0
-100 0
04
10
12
:.
Is] -loo
14
Xl
",
is]
0
X2
10
12
14
X3
Fig. 4. Average time courses of band power changes (in %) for 3 subjects (D2, D1, A5) in 3 sessions (X1, X2, X3). The EEG data presented were
recorded from electrodes C3 and C4 during left hand movement. The time points of beep presentation are marked by vertical lines. Positive deflection
indicates a band power increase (synchronization), negative deflection a band power decrease (desynchronization).
measured best with an electrode placed slightly more posterior compared to the best location for measuring the
Table 3
Results of on-line classification accuracy (performance in %), average
number and maximum number of single beep classifications within trials
D2
B9
D1
D8
A5
D5
Performance
(%)
Av. no.
class,
Max. no.
class.
93.7
60.3
50.8
88.9
100
90.6
3.65
6.63
6.35
4.92
2.57
3.65
12
17
28
25
8
15
D2
80
423
B9
30
60
40
10
20
0
-20
15.--29--43--57
.10 ~
-20 /
D1
sl
D5
8O
60
40
.........
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
-20
A5
IO0
8O
D8
80
60
40
20
20
0
0
11 21 31 41 51 61 71 81 91 101 1.11 12.1 .131 141 151 161
-20
Fig. 5. Visualization of classification results of the 6 subjects from on-line experiments. The x-axis displays the number of classifications (beeps) with 21
trials per block. On the y-axis the value of the cumulative classifications is displayed. A correct classification results is an increase dependent on the
quality measure of the LVQ classifier and a wrong classification result in a decrease. Between blocks the cumulative classifier value is reset to zero.
424
Acknowledgements
This research was supported by the 'Allgemeine Unfallversicherungsanstalt (AUVA)' and the 'Fonds zur
Frrderung der wissenschaftlichen Forschung' (projects
P9043 and P11208-MED). We thank Doris Petz for realization of the measurements.
References
Chatrian, G.E. and Lairy, G.C. The mu rhythm. In: A. Remond (Ed.),
Handbook of EEG and Clinical Neurophysiology. Elsevier, Amsterdam, 1976, pp. 46-69.
Chatrian, G.E., Petersen, M.C. and Lazarte, J.A. The blocking of the
rolandic wicket rhythm and some central changes related to movement. Electroenceph. clin. Neurophysiol., 1959, 11: 497-510.
Derambure, P., Defebvre, L., Dujardin, K., Bourriez, J.L., Jacquesson,
J.M., Destee, A. and Guieu, J.D. Effect of aging on the spatiotemporal pattern of event-related desynchronization during a voluntary movement. Electroenceph. clin. Neurophysiol., 1993, 89: 197203.
Dumermuth, G. and Molinari, L. Relationships among signals: crossspectral analysis of the EEG. In: R. Weitkunat (Ed.), Digital Biosignal
Processing. Elsevier, Amsterdam, 1991, pp. 361-398.
Farwell, L.A. and Donchin, E. Talking off the top of your head: toward a
mental prosthesis utilizing event-related brain potential. Electroenceph. clin. Neurophysiol., 1988, 70: 510-523.
Flotzinger, D. Feature Selection and Classification of EEG Data: Prerequisites for a Brain-Computer Interface. PhD Thesis, Graz University of Technology, Graz, Austria, 1994.
Flotzinger, D., Pfurtscheller, G., Neuper, C., Berger, J. and Mohl, W.
Classification of non-averaged EEG data by learning vector quantization and the influence of signal preprocessing. Med. Biol. Eng. Comp.,
1994, 32: 571-576.
Gastaut, H., Etude electrocorticographique de la reactivite des rhythmes
rolandiques. Rev. Neurol., 1952, 87: 176-182.
Howe, R.C. and Sterman, M.B. Cortical-subcortical EEG correlates of
suppressed motor behavior during sleep and waking in the cat. Electroenceph, clin. Neurophysiol., 1972, 32: 681-695.
Kalcher, J., Flotzinger, D. and Pfurtscheller, G. A new approach to a
Brain-Computer Interface (BCI) based on Learning Vector Quantisation (LVQ3). Proc. 14th Int. Conf. IEEE Biomed. Eng., Paris, 1992,
pp. 1658-1659.
Kalcher, J., Flotzinger, D., Neuper, C., Grlly, S. and Pfurtscheller, G.
Graz Brain-Computer Interface II: towards communication between
man and computer based on on-line classification of three different
EEG patterns. Med. Biol. Eng. Comp., 1996, in press.
Klimesch, W., Schimke, H. and Schwaiger, J. Episodic and semantic
memory: an analysis in the EEG theta and alpha band. Electroenceph.
clin. Neurophysiol., 1994, 91: 428-441.
Kohonen, T. The self-organizing map. Proc. IEEE, 1990, 78: 14641480.
Kuhlmann, W.N. Functional topography of the human mu rhythm. Electroenceph, clin. Neurophysiol., 1978a, 44: 83-93.
Kuhlmann, W.N. EEG feedback training of epileptic patients: clinical
and electroencephalographic analysis. Electroenceph. clin. Neurophysiol., 1978b, 45: 699-710.
McFarland, D.J., Neat, G.W., Read, R.F. and Wolpaw, J.R. An EEGbased method for graded cursor control. Psychobiology, 1993, 21: 7781.
Mulholland, T. Human EEG, behavioral stillness and biofeedback. Int. J.
Psychophysiol., 1995, 19: 263-279.
Pfurtscheller, G. Central beta rhythm during sensory motor activities in
man. Electroenceph. clin. Neurophysiol., 1981, 51: 253-264.
Pfurtscheller, G. Event-related synchronization (ERS): an electrophysiological correlate of cortical areas at rest. Electroenceph. clin. Neurophysiol., 1992, 83: 62-69.
Pfurtscheller, G. and Aranibar, A. Event-related cortical desynchronization detected by power measurements of scalp EEG. Electroenceph.
clin. Neurophysiol., 1977, 2: 817-826.
Pfurtscheller, G. and Berghold, A. Patterns of cortical activation during
planning of voluntary movement. Electroenceph. clin. Neurophysiol.,
1989, 72: 250-258.
Pfurtscheller, G., Flotzinger, D. and Kalcher, J. Brain-Computer Interface: a new communication device for handicapped persons. J. Microcomput. Appl., 1993, 16: 293-299.
Pfurtscheller, G., Pregenzer, M. and Neuper, C. Visualization of sensorimotor areas involved in preparation for hand movement based on
classification of mu and central beta rhythms in single EEG trials in
man. Neurosci. Lett., 1994a, 181: 43-46.
Pfurtscheller, G., Neuper, C. and Berger, J. Source localization using
event-related desynchronization (ERD) within the alpha band. Brain
Topogr., 1994b, 6: 269-275.
Pfurtscheller, G., Flotzinger, D., Pregenzer, M., Wolpaw, J.R. and
McFarland, D. EEG-based Brain Computer Interface (BCI): search
for optimal electrode positions and frequency components. Med.
Prog. Technol., 1996a, 21: 111-121.
Pfurtscheller, G., Stancgtk, Jr., A. and Neuper, Ch. Post-movement beta
synchronization: a correlate of an idling motor area? Electroenceph.
clin. Neurophysiol., 1996b, 98: 281-293.
Pregenzer, M., Flotzinger, D. and Pfurtscheller, G. Distinction sensitive
425