Brain Gate Technology used to Human Machine Interface

1. By:- RANVEER SINGH
M.Tech(ICE) – 3rd
Sem.1
Brain Gate Technology
Date : 16/10/2017

2. Contents
2
 Introduction
 History
 What is Brain Gate?
 Working
 Basic Elements of Brain Gate
 How information is transmitted
 Brain Signals
 Software Behind BrainGate
 Applications
 BrainGate Research in India
 Future scope
 Conclusion
 References

3. Introduction
3
 BrainGate is a brain implant system developed by the bio-tech
company‚ Cyber kinetics in 2003 in conjunction with the Department
of Neuroscience at Brown University.
 Currently under development and in clinical trials, designed to help
those who have lost control of their limbs, or other bodily functions,
such as patients with amyotrophic lateral sclerosis (ALS) or spinal
cord injury.
 The computer chip, which is implanted into the brain, monitors brain
activity in the patient and converts the intention of the user into
computer commands.
 Currently the chip uses about 100 hair-thin electrodes that sense
the electro-magnetic signature of neurons firing in specific areas of
the brain.
 for example, the area that controls arm movement. The activity is
translated into electrically charged signals and are then sent and
decoded using a program, which can move either a robotic arm or a
computer cursor.

4. Cont…
4
 The goal of the Brain Gate program is to develop a fast
and reliable connection between the brain of a severely
disabled person and a personal computer . The ‘Brain
Gate’ device can provide paralyses or motor-impaired
patients a mode of communication through the
translation of thought into direct computer control.

5. History
5
 Father Of BRAIN GATE - Professor John Origin - Rhode Island
(U.S.A.)
 Research on BCIs has been going on for more than 30 years, but
from the mid-1990s there has been a dramatic increase in working
experimental implants.
 The year 1998 marked a significant development in the field of brain
mapping when researcher Philiip Kennedy implanted object into a
human being. However, the BCI object was of limited function.
 John Donoghue and his team of Brown University researchers
formed a public traded company, Cyberkinetics, in 2001. The goal
was to commercially design a brain computer interface , the so
called Brain Gate.
 Brain gate was developed by the bio-tech company Cyberkinetics in
2003 in conjunction with the Department of Neuroscience at Brown
University by Nicholas Halso.

6. Cont…
6
 Brain Gate Research in animals:
 At first, rats were implanted with BCI.
 Signals recorded from the cerebral cortex of rat to operate BCI to
carry out the movement.
 He was able to record individual neurons in rates, but that wasn’t
enough to unravel their signals.

7. Cont…
7
 Researchers at the University of Pittsburgh had demonstrated on a
monkey that can feed itself with a robotic arm simply by using
signals from its brain.(In 2002, Donoghue published a paper in
Nature)
Fig.- https://www.wired.co.uk/article/monkey playing a video game with its brain.

8. Cont…
8
 In June 22, 2004, brain-computer interface had been
clinically tested on a human by an American company
Cyberkinetics.
 The Nature report describes the first participant in these
trials, a 25-year-old man who had sustained a spinal cord
injury leading to paralysis in all four limbs three years prior to
the study.
 Over a period of nine months, he took part in 57 sessions
during which the implanted Brain Gate sensor recorded
activity in his motor cortex while he imagined moving his
paralyzed limbs and then used that imagined motion for
several computer-based tasks such as, moving a computer
cursor to open simulated e-mail, draw circular shapes and
play simple video games.

9. What is Brain Gate ?
9
 Brain gate is an electrode chip which can be
implemented in the brain. When it is
implemented in the brain, the electrical
signal exchanged by neurons within the
brain.
 Those signals are sent to brain and it
executes body movement.
 All the signaling process handled by special
software. The signal sends to the computer
and then the computer is controlled by
patient.
 Whenever a man lost his brain
communication due to certain accidental
matter or he had loss his part of his body, at
that time this electrode chip can be
implemented on his brain and active the man
as well.

10. Working
10

11. Block Diagram
11

12. Basic Elements of BrainGate
12
 The chip: A four-millimeter square silicon chip studded with
about 100 hair-thin microelectrodes is embedded in the
primary motor cortex-the region of the brain responsible for
controlling movement.
 The connector: When somebody thinks ‚move cursor up and
left his cortical neurons fire in a distinctive pattern the signal
is transmitted through the pedestal plug attached to the skull.
 The converter: The signal travels to an amplifier where it is
converted to optical data and bounced by fiber optic cable to
a computer.
 The computer: Brain gate learns to associate patterns of
brain activity with particular imagined movements up, down,
left, right and to connect those movements to a cursor.
 Cerebus 128 channel neural data acquisition system.

13. Neuro Chip
13
 In 1992, Richard Normann created the Utah Electrode
Array, a thin sheet of silicon embedded with 100
conductive platinum-tipped needles that could sit inside
the cortex of a human brain.
 A device to record from multiple neurons for getting big
data.

14. BrainGate Pilot Device
14

15. Neural DAQ
15
 Cerebus 128 channel neural data acquisition system.
 Fiber-optic link for noise immunity
 High-resolution signal recording (30 kHz at 16 bits)
 Interface to NeuroExplorer, Spike2, MATLAB, C/C++ and
other third-party software
 AC input range : ± 8.191 mV
 AC input conversion : 16-bit resolution at 0.25 μV/bit
 Common mode rejection input range : ± 3.0 V
 Common mode rejection : >90 dB at 50/60 Hz
 High pass filter : 1st-order 0.3 Hz (full-bandwidth mode)
 Low pass filter : 3rd-order Butterworth 7.5 kHz

16. DAQ Setup
16

17. How information is transmitted
17
Fig.- https://www.scribd.com/presentation/84905574/Braingate-technology.

18. Cont…
18
 In BrainGate setup, the voice of a dozen neurons is
transmitted from a subject to the cart of machines,
where it is converted into spikes of data on a screen.
 The general idea is you have these spike times coming
in since you know the exact timing of all the spikes of all
these channels.
 It takes practice to train a machine to understand brain
commands.

19. Cont…
19

20. Brain Signals
20
EEG Band
Type
Frequenc
y
Associated Brain Region and Intentions
Delta <4 Hz Deeper regions such as the thalamus;
continuous-attention tasks
Theta 4-8 Hz Hippocampus; memory
Mu (Alpha) 8-13 Hz Motor cortex; motor intentions
beta 18-24 Hz Motor cortex; motor intentions
Gamma >30 Hz Local neural circuits in cortex; motor intentions,
auditory processing, and speech production

21. Software behind Brain Gate
21
 The computers translate brain activity and create the
communication output using custom decoding software.
 System uses adaptive algorithms and pattern- matching
techniques to facilitate communication. The algorithms
are written in C, JAVA and MATLAB.

22. Brain Computer Interface
22
 BCI :– Direct communication pathway between a brain
or brain cell culture and a device (computer).
 One way BCI : Computers either accept commands from
the brain or send signals to it.
 Two way BCI : Allow brains and external devices to
exchange information in both directions.
 Invasive BCI – the chip is implanted directly into the grey
matter of the brain
 produces the highest quality signals but are prone to scar
tissue build up.
 Scar tissue causes the signal to become weaker and even
lost as the body reacts to a foreign object

23. Applications
23
 Massachusetts native, Mathew
Nagel a 25 year-old quadriplegic
sits in a wheelchair with wires
coming out of a bottle-cap-size
connector stuck in his skull. The
wires run from 100 tiny sensors
implanted in his brain and out to
a computer. Using just his
thoughts, he was playing the
computer game Pong, control a
computer cursor.
 It remained inside his brain for a
year. Although Nagle died from
his injuries in 2007.

24. Control the Robotic Arm
24
 The person who is physically
Handicapped and not able to do any
movement of body parts, so that
person can use BrainGate to move
the Robotic Arm.
 In April 2010, Hutchinson, 58, is the
first almost-fully paralyzed person to
maneuver a vessel to her mouth and
drink from it and she's completed
that action solely using her mind.
 Hutchinson is tetraplegic; she was
paralysed from the neck down,
leaving her unable to speak, after a
brainstem stroke in 1996.
 Using a blue-and-silver prosthetic
arm, this is the first time in more
than a decade that she has fed
herself.

25. 25
Neural data produced by a subject imagining their hand moving in a
set way. These spikes are translated into mechanical movement

26. Other Applications
26
 In classification of EEG signal.
 In multimedia communication.
 In evaluation of spike detection algorithms.
 Actuated control of mobile robot by human EEG.
 To controlling the home appliances like TV, lights, fan
etc.
 In evaluating the machine learning algorithms.

27. Advantages
27
 Controlling remote devices
 Making and receiving telephone calls
 Accessing the internet.
 Turn on or off the lights
 Control robotic arm
 Watch and control television
 Use the pc
 Locking or unlocking doors
 Motorized wheelchair

28. Disadvantages
28
 It is very Expensive.
 Risky Surgery and Not Wireless yet
 Difficulty in adaptation and learning.
 Limitation in information transform rate. The
latest technology is 20bits/min.

29. BrainGate Research in India
29
 In India basic brain science research is conducted only at
NBRC Manesar and IISC Bangalore by some students.
 Although many work on closely related research involving
similar Neural Data Analysis Techniques applied on EEG,
EMG signals for neuroscienctific investigations.
 In 2016, PESIT-Bangalore south campus, students made a
project of mini wheelchair by just focusing on a set of boxes
flickering on the screen using BCI application.
 In recent, Dr. C. Kesavadas(Professor at SCTIMST
Trivandrum) involved in research on BCI collaborated with
Germany and Turkey under the new INDIGO partnership
program.
 If India launch its own brain project, required apprx. 5000cr.
To funding for basics of neuroscience problems.

30. Future Enhancement
30
 Feb,2016 A research team at Toyohashi University of
Technology in Japan has fabricated an implanted wireless
power transmission (WPT) device to deliver power to an
implanted neural interface system using thin film.
 Avoids risk of infections through skull opening and leakage of
cerebrospinal fluid, and allows for free-moving subjects and more
flexible uses of brain-computer interfaces

31. Cont…
31
 In March 2013, Researchers at Brown University have
succeeded in creating the first wireless, implantable,
rechargeable, long-term brain-computer interface with sealed
titanium, looks a lot like a pacemaker.
 Inside there’s a li-ion battery, an inductive charging loop, a
chip that digitizes the signals from your brain, and an antenna
for transmitting those neural spikes to a nearby computer.
 Small chip of 100 electrodes produce a lot of data, which the
BCI transmits at 24Mbps over the 3.2 and 3.8GHz bands to a
receiver that is one meter away.
 The BCI’s battery takes two hours to charge via wireless
inductive charging, and then has enough juice to last for six
hours of use.
 Power consumption is about 100mW only.

32. 32

33. Non-EEG-based Human-Computer
Interface33
 EEG-based interfaces also
require some time and effort
prior to each usage session,
whereas non-EEG-based ones,
as well as invasive ones require
no prior-usage training.
 On 3 September 2014,
scientists at Duke University
reported that direct
communication between human
brains was possible over
extended distances through
Internet transmission of EEG
signals.
• In a recent 2016 article, an entirely new communication device and
non-EEG-based human-computer interface was developed,
requiring no visual fixation.

34. First Brain Implant in World
34
 Nov. 2016, Doctors from Netherlands have performed
the first ever brain implant on a 58-year-old woman
paralysed by Loy Gehrig’s disease.
 Neuroscientist and lead researcher of this project was
Nick Ramsay.
 When De Bruijne watches the screen, she’ll see a
square moving over letter, she must imagine moving her
right hand to click on the letter.
 After just six months of training , she can use the system
with 95% accuracy. “At first, it took her 50 seconds to
select a letter – she can now do it in 20 seconds.

35. Future Scope
35
 Smaller ,wireless device .
 Current new advances include a second-generation interface
software M*Power controller that will enable users to perform
a wide variety of daily activities without assistances of
technician.
 Brain Gate is currently recruiting patients with a range of
neuromuscular and neuron degenerative conditions for pilot
clinical trials being conducted under an Investigational Device
Exemption (IDE)in the United States.
 Cyber kinetics hopes to refine the Brain Gate in the next two
years to develop a wireless device doesn’t have a plug,
making it safer and less visible. And once the basics of brain
mapping are worked out, there is potential for a wide variety
of further applications

36. Conclusion
36
 A number of developments have been taking place in the
field.
 The idea of moving robots or prosthetic devices not by
manual control, but by mere thinking (i.e., the brain activity of
human subjects) has been a fascinated approach. Medical
cures are unavailable for many forms of neural and muscular
paralysis.
 The enormity of the deficits caused by paralysis is a strong
motivation to pursue BMI solutions. So this idea helps many
patients to control the prosthetic devices of their own by
simply thinking about the task.
 This technology is well supported by the latest fields of
Biomedical Instrumentation, Microelectronics, signal
processing, Artificial Neural Networks and Robotics which has
overwhelming developments. Hope these systems will be
effectively implemented for many Biomedical applications.

37. References
37
 http://www.wired.co.uk/article/braingate/wired magazine May 2015.
 http://www.authorstream.com/Presentation/shreya.sachan-1194988-ppt-of-
brain-gate-latest
 Luca Citi, “Defining brain machine interface application by matching
interface performance with device requirements” Journal of Neuroscience
methods,167 (2008)
 John P. Donoghue, “Connecting cortex to machine: recent advances in
brain interfaces”, Nature publishing group,5, 1085-1088
 https://www.scribd.com/doc/38763994/Ppt-on-Brain-Gate
 http://braincominterface.blogspot.in/2008/04/animal-bcis-research.html
 http://studymafia.org/wp-content/uploads/2015/03/CSE BrainGate-
report.pdf
 http://www.kurzweilai.net/powering-brain-implants-without-wires-with-thin-
film-wireless-power-transmission-system/feb,2016 news.
 https://en.wikipedia.org/wiki/Brain computer_interface

38. 38