This document provides an introduction to using Azure IoT services for mind-machine interfacing by capturing brain activity data through EEG devices, discussing how brainwaves are produced and categorized into different frequency bands that correlate to mental states, and demonstrating how the collected brainwave data can be analyzed in the cloud and used to control IoT devices or machines.

1. Introduction to Mind Machine Interfacing
using Azure IoT Hub and other cloud
offerings

2. Bank of America Merrill Lynch
 Who am I?
Sr. Application Architect / Data Analyst
16+ years in the IT industry
10+ years in SharePoint
bhakthil@gmail.com
@bhakthil
https://www.linkedin.com/pub/bhakthi-liyanage/14/15/912
https://github.com/bhakthil

3. Agenda
 Introduction to IoT
 Azure IoT Service Architecture
 What are brain BRAINWAVES and how to capture brain activity
 Introduction to Mind-Machine Interfacing
 Demo

4. Simply put this is the concept of basically connecting any device with an on and off switch to the
Internet (and/or to each other). This includes everything from cell phones, coffee makers,
washing machines, headphones, lamps, wearable devices and almost anything else you can think
of

5. The “Internet of Things” is exploding and is made up of billions of “smart” devices—from miniscule
chips to mammoth machines—that use wireless technology to talk to each other (and to us).
Our IoT world is growing at a breathtaking pace, from 2 billion objects in 2006 to a projected 200
billion by 2020.1 That will be around 26 smart objects for every human being on Earth!
There will be 40 times more devices than people on the Internet in 20202
The ‘Internet of Things’ will generate $14.4 trillion of value over the next decade3.
1IDC, Intel, United Nations
2 http://www.idc.com/getdoc.jsp?containerId=prUS24366813
3 read.bi/1yDOQQ3

6. ATMs
These ubiquitous
money
dispensers went
online for the
first time way
back in 1974.
The Birth of the Web
Computers and modems had
been around for years, but only
until the World Wide Web made
its debut in 1991 were they
united to revolutionize
computing and
communications.
Smart Meters
The first power
meters to
communicate
remotely with
the grid were
installed in the
early 2000s.

7. The HAPIfork is an
electronic fork that helps
you monitor and track
your eating habits. It also
alerts you with the help of
indicator lights and gentle
vibrations when you are
eating too fast.
Canary is a complete
security
system packed into a
single, device. It adapts
to your home over time
and sends intelligent
notifications with HD
video directly to your
smartphone.
BigBelly alerts when it
needs to be emptied
so smarter collection
decisions can be
made.
A reflective mirror with
programmable
applications and digital
display for the home,
office and public
environments (hotels,
hospitals, retail shops).

8. Mind-Machine Interface
IoT devices are now able to collect data on the
human body, but new research is testing our
ability to control machines—and even each
other—with our minds
We, Robots
In the future, connected robots will have
the ability to learn from each other and
work in teams to increase efficiency and
solve scientific problems.
EMOTIV Epoc+ OpenBCI NeuroSky
Consumer EEG devices
Cheap and accurate enough to be used in consumer applications

9. Event Hub
Storage blobs DocumentDB
Web/Mobile App
Stream AnalyticsIoT Hub Web Jobs
Power BI
Logic Apps
Back end
systems
and
processes
Devices
Device2Cloud
Cloud2Device
Azure Machine
Learning

10. The root of all our thoughts, emotions and behaviors is the communication between neurons within
our brains.
Brainwaves are produced by synchronized electrical pulses from masses of neurons communicating
with each other
EEG (electroencephalogram) technology offers insight on the human brain by capturing electrical
activity in the brain using small, flat metal discs (electrodes) attached to your scalp.

11. • An EEG has different “bands”, defined by the frequency of the waves
• Each of these bands are associated with different states of mental activity.
 delta (slow) waves are less than 4 Hz
Delta brainwaves are slow, loud brainwaves (low frequency and deeply
penetrating, like a drum beat). They are generated in deepest meditation
and dreamless sleep
 theta bands are 4-8 Hz
occur most often in sleep but are also dominant in deep meditation
 alpha bands range from 8 to 12 Hz;
Alpha brainwaves are dominant during quietly flowing thoughts, and in
some meditative states. Alpha is the resting state for the brain. Alpha
waves aid overall mental coordination, calmness, alertness, mind/body
integration and learning
 beta bands are anywhere from about 14-30 Hz
presents when we are alert, attentive, engaged in problem solving,
judgment, decision making, and engaged in focused mental activity
 gamma bands range from 30-80 Hz.
Gamma brainwaves are the fastest of brain waves (high frequency, like a
flute). It is speculated that Gamma rhythms modulate perception and
consciousness, and that a greater presence of Gamma relates to

12. IoT Hub
Azure
Functions

13. http://aka.ms/azureiotdevintro
http://aka.ms/azureiotdev
http://github.com/azure/azure-iot-sdks
https://docs.microsoft.com/en-
us/azure/azure-functions/
Microsoft Virtual Academy
www.risingskyline.com