iOS + Neuroscience
Brain-iPhone interfaces
Imagine
• Cocoa
• Cocoa Touch
• Cocoa Thought
Biology
Connectome
Open Worm Project
Neurointerfaces
Backyard Brain
Roboroach video
Transcranial direct current stimulation
Foc.Us
• Enhance language and mathematical
ability, attention span, problem
solving, memory, and coordination.
• accepted ...
Foc.Us API
- (void)peripheralDidWriteChracteristic:(CBCharacteristic *)characteristic
withPeripheral:(CBPeripheral *)perip...
Foc.Us
Electroencephalography
δ <4 Gz
slow-wave sleep,
some continuous-attention tasks
θ 4-7 Gz drowsiness,
idling,
inhibition of elicited responses
α 7...
MindWave Mobile by NeuroSky
2 mind states:
- Attention (0 – 100).
- Meditation (0 – 100).
• Blinking and it’s “power”.
- C...
API
- (void)dataReceived:(NSDictionary *)data {
if([data valueForKey:@"blinkStrength"])
if([data valueForKey:@"raw"]) {
if...
Reverse-engineering
Tools:
• lipo
• otool
• Hopper Disassembler
• MachOView
Results:
• Spline interpolation
• Spectral den...
Appl
icati
ons
https://github.com/orbotix/Sphero-iOS-SDK
https://github.com/MariaStoica/MindSphero
+
BrainOSC
Converts data from ThinkGear's MindWave to
OSC data
AdFence
Mood and proximity based advertising using the
MindWa...
Melon
3 electrodes on the
forehead.
Detects focus and
meditation.
Detects sleep phases.
$149.
Uses NeuroSky’s chip.
SDK wi...
Muse by InteraXon
Muse
6 dry sensors
$ 299
Sleep, calmness,
attention.
Has an iOS app.
Native library will be
available “soon”.
Right now: c...
Emotive EPOC
Emotive Insight
iOS SDK will be in summer.
C++, really ?
$ 229
API
struct emokit_contact_quality {//values > 4000 are good
short F3, FC6, P7, T8, F7, F8, T7, P8, AF4, F4, AF3, O2, O1, F...
API
Insight video
Emotive Insight
https://sites.google.com/a/emotiv.
com/wiki/documentation
Additional Resources
http://www.openbci.com/ - opensource BCI
http://personalneuro.com/about.htm - neuro
apps development
...
Additional Resources
http://wsyachina.narod.ru/biology/brain_17.ht
ml
http://wsyachina.narod.ru/medicine/drug_depe
ndence....
Thanks for your
[[data valueForKey:@"eSenseAttention"]
intValue]
Upcoming SlideShare
Loading in …5
×

iOS + Neuroscience : Braine-iPhone interfaces

630 views

Published on

Intro to Brain–computer interfaces for iOS developers.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
630
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
10
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

iOS + Neuroscience : Braine-iPhone interfaces

  1. 1. iOS + Neuroscience Brain-iPhone interfaces
  2. 2. Imagine • Cocoa • Cocoa Touch • Cocoa Thought
  3. 3. Biology
  4. 4. Connectome
  5. 5. Open Worm Project
  6. 6. Neurointerfaces
  7. 7. Backyard Brain
  8. 8. Roboroach video
  9. 9. Transcranial direct current stimulation
  10. 10. Foc.Us • Enhance language and mathematical ability, attention span, problem solving, memory, and coordination. • accepted maximum 2 mA, usually 1 mA or less • stimulation time - 20 minutes • 10 minutes - effects lasting for up to an hour. • 48 hours to a week before repeating the stimulation. • Studies indicates SAFETY in a SINGLE session. • No studies about long-term safety of repeated sessions of stimulation.
  11. 11. Foc.Us API - (void)peripheralDidWriteChracteristic:(CBCharacteristic *)characteristic withPeripheral:(CBPeripheral *)peripheral withError:(NSError *)error; - (void)peripheralDidReadChracteristic:(CBCharacteristic *)characteristic withPeripheral:(CBPeripheral *)peripheral withError:(NSError *)error; - (void)hardwareDidNotifyBehaviourOnCharacteristic:(CBCharacteristic *)characteristic withPeripheral:(CBPeripheral *)peripheral error:(NSError *)error; http://www.foc.us/bluetooth https://github.com/FocusBluetooth/focus-bluetooth-ios/blob/master/C
  12. 12. Foc.Us
  13. 13. Electroencephalography
  14. 14. δ <4 Gz slow-wave sleep, some continuous-attention tasks θ 4-7 Gz drowsiness, idling, inhibition of elicited responses α 7-14 Gz relaxed/reflecting, closing the eyes β 15-30 Gz active thinking, focus, hi alert, anxious γ 30-100 Gz cross-modal sensory processing, short-term memory matching of recognized objects, sounds, or tactile sensations μ 8-13 Gz Shows rest-state motor neurons, mirror neurons activity(?) σ 10-16 Gz Stage N2 sleep (consciousness shutdown)
  15. 15. MindWave Mobile by NeuroSky 2 mind states: - Attention (0 – 100). - Meditation (0 – 100). • Blinking and it’s “power”. - Contact with skin. - Signal quality. 1 electrode $99.95
  16. 16. API - (void)dataReceived:(NSDictionary *)data { if([data valueForKey:@"blinkStrength"]) if([data valueForKey:@"raw"]) { if([data valueForKey:@"heartRate"]) if([data valueForKey:@"poorSignal"]) { if([data valueForKey:@"respiration"]) { if([data valueForKey:@"heartRateAverage"]) { if([data valueForKey:@"heartRateAcceleration"]) { if([data valueForKey:@"rawCount"]) { if([data valueForKey:@"eSenseAttention"]){ eSenseValues.attention = [[data valueForKey:@"eSenseAttention"] intValue]; eSenseValues.meditation = [[data valueForKey:@"eSenseMeditation"] intValue]; eegValues.delta = [[data valueForKey:@"eegDelta"] intValue]; eegValues.theta = [[data valueForKey:@"eegTheta"] intValue]; eegValues.lowAlpha = [[data valueForKey:@"eegLowAlpha"] intValue]; eegValues.highAlpha = [[data valueForKey:@"eegHighAlpha"] intValue]; eegValues.lowBeta = [[data valueForKey:@"eegLowBeta"] intValue]; eegValues.highBeta = [[data valueForKey:@"eegHighBeta"] intValue]; eegValues.lowGamma = [[data valueForKey:@"eegLowGamma"] intValue]; eegValues.highGamma = [[data valueForKey:@"eegHighGamma"] intValue];
  17. 17. Reverse-engineering Tools: • lipo • otool • Hopper Disassembler • MachOView Results: • Spline interpolation • Spectral density estimation • Fast Fourier transform • …
  18. 18. Appl icati ons
  19. 19. https://github.com/orbotix/Sphero-iOS-SDK https://github.com/MariaStoica/MindSphero +
  20. 20. BrainOSC Converts data from ThinkGear's MindWave to OSC data AdFence Mood and proximity based advertising using the MindWave headset by NeuroSky and the Qualcomm Gimbal Proximity chip.
  21. 21. Melon 3 electrodes on the forehead. Detects focus and meditation. Detects sleep phases. $149. Uses NeuroSky’s chip. SDK will be available in summer.
  22. 22. Muse by InteraXon
  23. 23. Muse 6 dry sensors $ 299 Sleep, calmness, attention. Has an iOS app. Native library will be available “soon”. Right now: console, sockets, protobuf.
  24. 24. Emotive EPOC
  25. 25. Emotive Insight
  26. 26. iOS SDK will be in summer. C++, really ? $ 229
  27. 27. API struct emokit_contact_quality {//values > 4000 are good short F3, FC6, P7, T8, F7, F8, T7, P8, AF4, F4, AF3, O2, O1, FC5; }; struct emokit_frame { unsigned char counter; //loops from 0 to 128 (129 values) int F3, FC6, P7, T8, F7, F8, T7, P8, AF4, F4, AF3, O2, O1, FC5; //raw data values struct emokit_contact_quality cq; char gyroX, gyroY; unsigned char battery; //percentage of full charge, read on counter=128 };
  28. 28. API
  29. 29. Insight video
  30. 30. Emotive Insight https://sites.google.com/a/emotiv. com/wiki/documentation
  31. 31. Additional Resources http://www.openbci.com/ - opensource BCI http://personalneuro.com/about.htm - neuro apps development http://neurogadget.com/ - blog http://www.neurogamingconf.com/ - conference 2014 http://en.wikipedia.org/wiki/Brain %E2%80%93computer_interface http://neuroscience.uth.tmc.edu/toc.htm
  32. 32. Additional Resources http://wsyachina.narod.ru/biology/brain_17.ht ml http://wsyachina.narod.ru/medicine/drug_depe ndence.html https://eyewire.org/signup
  33. 33. Thanks for your [[data valueForKey:@"eSenseAttention"] intValue]

×