1. Brain-Computer Interface:Brain-Computer Interface:
Alexander Kaplan, Professor,
Head of the NNCI Lab.
Contacts: akaplan@mail.ru; http://brain.bio.msu.ru
Lomonosov Moscow State UniversityLomonosov Moscow State University
Faculty of BiologyFaculty of Biology
Rebuilding radically new outputRebuilding radically new output
of the Human Brainof the Human Brain
Laboratory for Neurophysiology and Neuro-
Computer Interfaces (NNCI Moscow)

2. Fundamental
research in
NNC Lab at
Faculty of
Biology
Silicon Skolkovo
supports the BCI
research for
aplications
NPO
ENERGIYA –
industry for
limb
prosthesis
and
manipulators
OUR key project is EEG driven limb
prosthesis and manipulators

3. ““ A Brain-Computer Interface is aA Brain-Computer Interface is a
communication system that docommunication system that do
not depend on peripheral nervesnot depend on peripheral nerves
and muscles “and muscles “
[J. R. Wolpaw et al. “Brain-[J. R. Wolpaw et al. “Brain-
computer interface technology: A reviewcomputer interface technology: A review
of the firstof the first international meeting,” IEEEinternational meeting,” IEEE
Trans. Rehab. Eng., vol. 8, no. 2, pp.Trans. Rehab. Eng., vol. 8, no. 2, pp.
164–173, 2000]164–173, 2000]
What is the Definition of BCI ?What is the Definition of BCI ?

4. In the last few years, a lot of labs
begin to research the DIRECT
communicate interface between brain
and external environment –
Brain-Computer Interface (BCI).
The purpose is for human to
communicate with external device
WITHOUT MUSCLES but DIRECTLY
by using only the electrical brain
activity - EEG.
2 4
48
127
233
310
345
0
50
100
150
200
250
300
350
400
1985-
1990
1991-
1995
1996-
2000
2001-
2004
2004-
2005
2006-
2008
2009-
2010
Peer-reviewed papers
To this time we already published some basic papers on EEG
computing for example: A.Ya.Kaplan et al. Nonstationary nature of the
brain activity as revealed by EEG/MEG.
In: Signal processing, 2005;85:2190–2212
and established new so called segmental approach in EEG analysis.
BCI has seen increasing interest since 2000

5. 2005
et al.
Our startup in BCI research in 2005

6. Neuroscience Letters
Article in Press, Accepted Manuscript –
Copyright © 2011 Published by Elsevier Ireland Lt
________________________
EVENT-RELATED POTENTIALS IN A MOVING MATRIX
MODIFICATION OF THE P300 BCI PARADIGM
Sergei L. Shishkin, Ilya P. Ganin, Alexander Ya. Kaplan*
M.V.Lomonosov Moscow State University, Faculty of Biology, Dept. of Human and
Animal Physiology, Human Brain Research Group, 1/12 Leninskie Gory, Moscow
119991, Russia
Our resent BCI research

7. Our nearest patents which incorporate the
BCI technology

8. A possible approach how to overcomeA possible approach how to overcome
this disconnection isthis disconnection is bypassingbypassing thethe
damaged area by means of adamaged area by means of a
technical device which can detecttechnical device which can detect
cortex commands and translate onescortex commands and translate ones
to the commands for electronic devicesto the commands for electronic devices
that replaced the muscle actions.that replaced the muscle actions.
What is the idea of BCI in Neuroengineering ?What is the idea of BCI in Neuroengineering ?
The practical idea is very simple: when a disconnection ofThe practical idea is very simple: when a disconnection of
the main motor pathway occurs, thethe main motor pathway occurs, the motor commandsmotor commands
generated in the cortex cannot travel through thegenerated in the cortex cannot travel through the
pyramidal (spinal) tract to reach the executing organ, thepyramidal (spinal) tract to reach the executing organ, the
muscles.muscles.

9.  The aim of BCI research is to establish aThe aim of BCI research is to establish a
new augmented communication systemnew augmented communication system
that translates human intentions —that translates human intentions —
reflected by suitable brain signalsreflected by suitable brain signals — into a— into a
control signal for an output device such ascontrol signal for an output device such as
a computer.a computer.
 Brain electrical activity or EEG is a mostBrain electrical activity or EEG is a most
suitable signal for BCI implementationsuitable signal for BCI implementation
What is fundamental aim of the BCIWhat is fundamental aim of the BCI
technology ?technology ?

10. Psychological
Effort
(Intention)
Modification of
EEG Brain Signals
Signal Features
Classification
Of Intent
appropriate feature extraction
appropriate feedback strategy
usertraining
computertraining
Environment
Brain Computer
What isWhat is logical scheme oflogical scheme of BCIBCI??

11. Only in USA, more than 200,000Only in USA, more than 200,000
patients live with the motorpatients live with the motor
consequences of serious injury.consequences of serious injury.
Nicolelis, 2001
What is the motivation for BCI Research ?What is the motivation for BCI Research ?
Motivation for Patients:Motivation for Patients: is to giveis to give
disable people to communicate, todisable people to communicate, to
operate prostheses, and even tooperate prostheses, and even to
operate wheelchairs using brainoperate wheelchairs using brain
signalssignals
Only theOnly the INVASIVE SURGEON TECHNIQUEINVASIVE SURGEON TECHNIQUE allows puttingallows putting
electrode into a very local area of a brain uniting a fewelectrode into a very local area of a brain uniting a few
neurons. These neurons could be belong to the cortexneurons. These neurons could be belong to the cortex
center, for example, for finger control.center, for example, for finger control.

12. Even if patients can not act, they also
can use Brain-Computer Interface (BCI)
to communicate with environment or
control the devices.
The EEG is the residual signal that can
be used as command signal for
HUNDRED THOUSANDS neurologically
impaired patients with:
- amyotrophic lateral sclerosis,
- stroke,
- old man with disabilities ,
- spinal injuries with limb paralysis
(tetraplegia etc.) ,
- Locked-in syndrome
What is EEG for BCI Research ?What is EEG for BCI Research ?

13.  CommunicationCommunication
 NeuroprostheticsNeuroprosthetics
 EnvironmentalEnvironmental
controlcontrol
 Robotics /Robotics /
Manipulators/Manipulators/
Mobility devicesMobility devices
Disability Level and Application:Disability Level and Application:
BCI for common peopleBCI for common people
Most Disable
people
Health people

14.  For more than 40,000 years evolution adaptedFor more than 40,000 years evolution adapted
Homo sapiens brain abilities to control theHomo sapiens brain abilities to control the
environment only by means of muscular output.environment only by means of muscular output.
 A contemporary industry (high speed physicalA contemporary industry (high speed physical
objects, processes and informational streams)objects, processes and informational streams)
make this output like bottleneck for humanmake this output like bottleneck for human
activityactivity
 Thought Driven Control is not fantasy now.Thought Driven Control is not fantasy now.
Motivation BCI for Health peopleMotivation BCI for Health people

15. How it is possible? EEG code for BCIHow it is possible? EEG code for BCI
 In 1990s researchesIn 1990s researches realized that if a person canrealized that if a person can
change her own EEG therefore she can give thechange her own EEG therefore she can give the
conscious signals to BCI by means of EEGconscious signals to BCI by means of EEG
changes.changes.
 BCI should react to changes in EEG. If the personBCI should react to changes in EEG. If the person
could produce two distinct changes in EEG it willcould produce two distinct changes in EEG it will
make the binary code for BCI!make the binary code for BCI!

16. 1. Feature
extraction;
2. EEG changes
classification;
3. Command
translation;
4. Feedback
Precision microelectronics
Neuro- and
Psychophysiology
Mathematics and
ProgrammingSignal processing
1
2
3 4
Neuro- and
Psychophysiology
1
Medicine5
Precision
microelectronics
2
Automatic control
theory6
Feedback
Functional scheme of “internal” type BCIFunctional scheme of “internal” type BCI

17. N
europhysiology
and
P
sycho-
M
athem
atics
M
edicine
M
icro-
electronics
Statistics
Signal processing
Programming
EEG analysis
Neuro theory
Mind-body
problem
Rehabilitation
Surgery
Clinics
Amplifiers
Wireless tech
Chip design
Nanotechnology
for dry EEG
sensors
and for
money
The multi-disciplinary approach is a key for new
generation of BCI technology

18. 1.1. One mental stateOne mental state  one BCI commandone BCI command
2.2. Too slow (24 bit per min – 6-8 letters per min)Too slow (24 bit per min – 6-8 letters per min)
3.3. Low accuracy (no more then 75% for cursorLow accuracy (no more then 75% for cursor
control)control)
4.4. Unpredictable training results (how many daysUnpredictable training results (how many days
or months?)or months?)
What are the problems with “internal” type BCI?What are the problems with “internal” type BCI?

19. Alfa Theta Gamma
t
S(2)S(1) S(3) S(4) S(5) S(6) S(i)
Dynamics of neuronal ensembles

20. Go left
Go right
Go ahead
Go back

21. Subject
EEG
Recognizing
single channel
EEG patterns
New 1
Finding
repeating spatial
EEG patterns
New 2
On-line EEG
pattern
classification
Setting EEG
commands
1, 2, 3, 4, 5…
Selection
of functional
commands only
Instrumental
conditioning
training
A B C
Electronic
drivers
Neurofeedback
A B C
External
objects
New 3
P > 75%
MultimodalityMultimodality
Cognition
s
Cognition
s
Emotion
s
Emotion
s
Executive part
Neurofeedback part
Pattern detection part
USER part
CreativityCreativity
Moscow Brain-Computer Interface

22. 1.1. To design the cognitive training for EEGTo design the cognitive training for EEG
patter conditioningpatter conditioning
2.2. To investigate what is the key cortexTo investigate what is the key cortex
area for unconscious BCI control -area for unconscious BCI control -
EEG/fMRI study.EEG/fMRI study.
3.3. To design the adaptive algorithms forTo design the adaptive algorithms for
unconscious training with EEG patternunconscious training with EEG pattern
recognitionrecognition
4.4. New microelectronicsNew microelectronics
How to realize the Moscow BCI?

23. (Donchin, 1988, 2000)
Flashing of rows/columns
containing the desired letter will
elicit P300 response at vertex
Online testing :
• 15 or above trials averaging
• Correct letter - 56% of all trials
• Correct row/column – 36%
• totally wrong – 8%
Experiment DesignExperiment Design for “external” type BCItype BCI

24. P300
P300 wave “external” type BCItype BCI
P300
NCI lab in Moscow P300 driven
typing
…..I am Ivan Basul…
High-speed Moscow P300
BCI is only first step for real
BCI spelling system
16-20 chatacters per min with 97% accuracy in Moscow NNCI lab
– is the world record at the moment!

25. Attention dissociation is big problem for
“external” type BCItype BCI
Hybrid Brain-Gaze-Computer Interface (BGCI)
is the final decision for “Attention dissociation”
problem.

26. The integration eye tracker date with ongoing EEG date
will correct the “Attention dissociation” problem

27. The toy car directly controlledThe toy car directly controlled
by Dr. Kaplan’s Brainby Dr. Kaplan’s Brain
Kaplan A.Ya., et. al.
Unconscious operant conditioning in the paradigm
of brain-computer interface based on color
perception
Intern. J. Neuroscience, 2005 115:781–802,
Kaplan A.Ya., et. al.
Nonstationary nature of the brain activity as
revealed by EEG/MEG: methodological, practical
and conceptual challenges Signal processing.
Signal Processing 85 (2005) 2190–2212
Full-text papers of Dr. Kaplan are available at:
http:// brain.bio.msu.ru

28. Motor execution vs. MovementMotor execution vs. Movement
imagination (lee_stbdayAY10.ppt)imagination (lee_stbdayAY10.ppt)
Imagination
Execution
Subject g3, 16-20 Hz Subject f7, 20-24 Hz
ERD ERS500mstime

29. Dr. Emanuel Donchin
He designed first BCI for mind
driven speller at 1988
(University of South Florida)
Dr. Christoph Guger (Graz, Austria)
the owner of “g.tec Medical
Engineering GmbH”
Dr. Philip KennedyDr. Philip Kennedy
First implantation forFirst implantation for
BCIBCI
(Emory(Emory University)University)
AcademicianAcademician
Victor A.SadovnichiyVictor A.Sadovnichiy
Rector of LomonosovRector of Lomonosov
MSU (Russia)MSU (Russia)
Partners for collaboration