Recommended
More Related Content
What's hot
What's hot (20)
Similar to Expanding Human Intelligence with BCI
Similar to Expanding Human Intelligence with BCI (20)
Recently uploaded
Recently uploaded (20)
Expanding Human Intelligence with BCI
- 1. INTELLIGENCE EXPANDED Direct Human-Computer Integrations Today and Tomorrow
- 2. The story of BCI 2
- 3. 3
- 4. Music for Solo Performer (1965) 4
- 6. BCI today: brain responses in use 6
- 8. Population activity Actual arm movement Sum of prefered directions of neurons times their firing rate 8
- 9. Imagined motor and cognitive activity 9
- 12. Invasive stimulation Array of platinum-iridium microelectrodes implanted for extracellular stimulation ● Deep brain stimulation (DBS) ○ Implant in specific part of the brain to release disease’s symptoms; ○ Electrical pulses delivered continuously: ■ Closed loop under research (electrodes can record as well). ● Cochlear implants ○ 22 electrodes; ○ Stimulate the auditory nerve based on sounds received by external microphone. 12
- 13. Semi-invasive techniques Grid of m x n electrodes on the brain (m and n between 1 and 8) 2-10 mm apart: ● Electrocorticography (ECoG) ○ Coherent activity 10-100K of neurons recorded. ● Direct Cortical Electrical Stimulation (DCES) ○ Electric current (<15 mA) on <10K of neurons; ○ Generate / disrupt sensations and movements. ● Used to map the brain of neurosurgery patients. 13
- 15. Direct non-invasive recording Electroencephalography (EEG) ● Measurement of electrical potential differences across points on the scalp: ○ The coherent activity of cortical pyramidal neurons generates ionic currents; ○ Firing of >1000 is detectable on the scalp (range of uV). ● Excellent temporal resolution (ms scale); ● Moderate spatial resolution (cm scale). 15
- 16. Indirect non-invasive recording Blood oxygenation level dependent (BOLD) response ● Slow, appears within 100Ks ms, peaks 3-6 s. Functional magnetic resonance imaging (fMRI) ● deoxy-Hb more magnetic than oxy-Hb; ● Image deep regions, 1-3 mm range. 16
- 17. Indirect non-invasive recording Blood oxygenation level dependent (BOLD) response ● Slow, appears within 100Ks ms, peaks 3-6 s. Functional near infrared (fNIR) imaging ● deoxy-Hb and oxy-Hb light absorption differs for most wavelengths; ● Less spatial resolution, more noise-prone. 17
- 18. Non-invasive stimulation Transcranial current stimulation (tCS) ● Direct / Alternating Current / Random Noise ○ Neurons are influenced mostly by the component of the electric field parallel to their trajectory: ■ Excitatory / inhibitory; ■ The smaller electrodes the better (gyri and sulci!); ○ Effects depend on polarity. 18
- 19. BCI today: algorithms behind the scenes 19
- 20. Signal processing Received neural signals ● Noise (muscle / heart / line); ● Mixture of multiple neural groups. Some important methods ● Wavelet transform; ● Particle filtering (1993); ● Independent component analysis (1995). 20
- 21. Supervised machine learning Classification ● Classify ○ Wavelengths / states of consciousness. ○ Mental tasks; ● Generate discrete control outputs ○ Specific state detected; ○ Switch on / off, move up / down by preset amount. Regression ● Move a prosthetic device with a given velocity. 21
- 23. MRI scanners 23
- 25. Halo Sport 25
- 26. 26
- 27. Emotiv 27
- 28. Kokoon 28
- 29. Do it Yourself (Open Source) 29
- 30. Muse 30
- 31. Future of merging man with machine: visions 31
- 32. The Culture 32
- 33. Ghosts 33
- 35. Race with AI 35
- 36. Experiencing AI... The nature of: Where am “I”? 36
- 38. BCI tomorrow: research and ventures 38
- 39. Openwater 39
- 43. 43
- 44. 44
- 45. Brain computer interfaces: wrapping it all up 45
- 46. Brain Computer Interfaces BCI innovation holds a chance to co-create a large impact 1. Understanding and handling neurological and mental disorders: a. Epilepsy, parkinson, motoric disorders; b. Depression is the world’s most widespread illness (over 300M people, says WHO). 2. Personal understanding and mastering of mental processes: a. Understand better what it means to be human; 3. Creation of rich life experiences: a. The more unbiased knowledge we got about ourselves and the world, the easier it is to overcome false mental creations; b. The more real-time input we receive, the more “real” we might feel. 46
Editor's Notes
- Detail from the December 26, 1965 edition of the Sunday comic strip “Our New Age” http://aa-nplus1.tumblr.com/post/18075687043/detail-from-the-december-26-1965-edition-of-the Man landing on the moon: July 20, 1969
- http://alvin-lucier-film.com/solo_performer.html
- “Delgado developed an implantable chip (stimoceiver) that could be used to both stimulate the brain by radio and send electrical signals of brain activity by telemetry, allowing the subject to move about freely. Delgado used the stimoceiver to stop a charging bull in its tracks by pressing a remote-control button that delivered electrical stimulation to the caudate nucleus in the basal gaglia region of the bull´s brain.”
- Explain exactly the brain responses that are being used today for building BCI (from Introduction to Brain Computer Interfaces)
- Plasticity - essential property of neural circuits: Responses of neurons are adapted as a function of inputs; Works for both single and large populations of neurons. Conditioning: Classical (Pavlovian): Two inputs coming together = two sets of neurons firing together; If one was causing some another set to fire, now another one does too. Instrumental (Operant): Neurons that cause rewarding response get wired with desire for that response. On an image: TODO Is being used in EEG as well.
- Motor cortex
- Imagining a movement typically produces neural activity that is spatiotemporally similar to the activity generated during actual movement but smaller in magnitude. It has been noted that the initially weak response due to imagined movement becomes more robust as the subject receives feedback while learning to control the cursor. Similar to imagining movements, one can also ask a human subject to perform a cognitive task such as mental arithmetic or visualizing a face (call somebody’s number while imagining their face!) Use machine learning to classify imaginary and real activities.
- P300: Input: rare stimulus; Result: positive after 300 ms in parietal, temporal and frontal lobe. SSVEP: Input: flickering visual stimulus; Result: peaks at the stimulus frequency and harmonics. N100-P200: Input: unpredictable stimulus; Result: negative after 100 ms, positive after 200 ms in frontal and central regions. N400: Input: incongruent important input; Output: negative after 400 ms in central and parietal regions.
- 100000 neurons / mm3
- https://imotions.com/blog/what-is-eeg/ http://www.neuroelectrics.com/software/
- http://www.livescience.com/39074-what-is-an-mri.html
- http://www.livescience.com/39074-what-is-an-mri.html
- http://wiki.neuroelectrics.com/index.php/About_tCS
- Wavelet transform - transformation from time to frequency domain Particle filtering - time domain analysis Based on Bayesian filtering equasion; We are interested in finding the cause of a measured EEG signal, which corresponds to estimating the posterior probability P(stimulus|EEG). This probability is hard to estimate directly but the probability P(EEG|stimulus) can be estimated by exposing the subject to stimuli and collecting stimulus -response data from a number of trials. Independent component analysis - spatial filtering https://sccn.ucsd.edu/~jung/Site/EEG_artifact_removal.html Artifact-free event-related brain signals were obtained by projecting the sum of selected non-artifactual ICA components back onto the scalp; Removed eye movements and muscle artifacts. Do it at the example of EEG -> we got raw data, now what? Relevant innovation in signal processing
- https://www.researchgate.net/post/How_can_we_classify_the_EEG_signals_By_using_Machine_Learning_Algorithms http://www.cs.cmu.edu/~tanja/BCI/ABI2003.pdf A local neural classifier tries to recognize three different mental tasks; it may also respond “unknown” for uncertain samples as the classifier has incorporated statistical rejection criteria.
- http://www.nhs.uk/conditions/mri-scan/Pages/Introduction.aspx https://info.blockimaging.com/bid/92623/mri-machine-cost-and-price-guide
- http://www.neuroelectrics.com/products/starstim/
- https://www.emotiv.com/category/independent-studies/ https://www.emotiv.com/developer/
- http://theculture.wikia.com/wiki/Neural_lace http://www.vavatch.co.uk/books/banks/cultnote.htm The Culture is composed of: Several inter-bred humanoid species As well as artificially intelligent sentient machines, with intelligences ranging from human-equivalent drones, to hyper-intelligent Minds The Culture's economy: Is maintained automatically by its non-sentient machines, with high-level work entrusted to the Minds' subroutines, which allows its humanoid and drone citizens to indulge their passions, romances, hobbies, or other activities, without servitude. Human-machine interfacing: Humanity has gone through cyclical stages during which there has been extensive human-machine interfacing, and other stages (sometimes coinciding with the human-machine eras) when extensive genetic alteration has been the norm. The era of the stories written so far - dating from about 1300 AD to 2100 AD - is one in which the people of the Culture have returned, probably temporarily, to something more 'classical' in terms of their relations with the machines and the potential of their own genes. The standard Culture person would expect to be born with would include an Optimized immune system Enhanced senses Freedom from inheritable diseases or defects The ability to control their autonomic processes and nervous system (pain can, in effect, be switched off). Existence: Humans - a slightly empty existence only and merely enjoying themselves, and so need the good-works of the Contact section to let them feel vicariously useful. AIs, that need to feel useful is largely replaced by the desire to experience, but as a drive it is no less strong. Neural Lace: Voice and data may be transmitted directly to and from the brain via the lace.The communications function is optional. A lace improves memory retention and recall. It actively manages memory to minimize losses. However, it does not prevent noticeable loss or change of personality in long-lived persons. Virtual representations of dataverses may also be created, with the presented information being based on the lace's predictions of its host's needs. The representations could be near overwhelming, despite only being a fraction of the complexity and depth normally experienced by Minds. The experience provided by a lace may feel more "real" than the real world due to its detail and immersiveness. A lace also served as a timekeeping device. The lace may be used to interface with machines. Data from a spacecraft's sensors may be routed into a lace. The lace allows machines to be controlled a natural extensions of the host's body. The lace - in conjunction with glanding may raise awareness speed to at least near-AI levels. This facilitates machine interfacing and control, and data processing. What will be the experience of being connected with AI? Take Kaku’s explanation of how consciousness emerges into account.
- https://en.wikipedia.org/wiki/Philosophy_of_Ghost_in_the_Shell https://www.youtube.com/watch?v=0H7fRNexE2c&feature=youtu.be&t=138 https://www.quora.com/What-are-the-possible-socioeconomic-impacts-of-Neuralink-Elon-Musks-mind-machine-interface-start-up https://en.wikipedia.org/wiki/World_of_Ghost_in_the_Shell#Technology 2029 in Japan. A first successful experiment of integrating human brain into a fully robotic body. Cyberbrain: Device that acts as a self-contained module containing, protecting, and interfacing an artificially augmented brain. The "brain" includes the brain stem but excludes the eyes, optic nerves, and most of the spine. By being physically self-contained, the cyberbrain allows the artificially augmented brain inside to function or be physically stored inside a body, to be physically transferred between bodies, or to be temporarily stored or transported outside any body. Drugs are being provided in order to disable access to memories.
- Ray Kurzweil’s Wildest Prediction: Nanobots Will Plug Our Brains Into the Web by the 2030s Ray Kurzweil: “Everything possible is inevitable” That’s a several billion-fold increase in price/performance over the last forty years, an escalation we will see again in the next twenty-five years, when what used to fit in a building, and now fits in your pocket, will fit inside a blood cell. In this way we will merge with the intelligent technology we are creating. Intelligent nanobots in our bloodstream will keep our biological bodies healthy at the cellular and molecular levels. They will go into our brains noninvasively through the capillaries and interact with our biological neurons, directly extending our intelligence. This is not as futuristic as it may sound. There are already blood cell–sized devices that can cure type I diabetes in animals or detect and destroy cancer cells in the bloodstream. Based on the law of accelerating returns, these technologies will be a billion times more powerful within three decades than they are today.
- Elon Musk lives in fear of Google's killer robot army Elon Musk’s Neuralink wants to boost the brain to keep up with AI Video: We are already cyborgs | Elon Musk | Code Conference 2016 FEDOR Is a Gunslinging Robot That’s Just a Skin Suit Away From Westworld http://waitbutwhy.com/2017/04/neuralink.html Tim Urban - Wait But Why Elon Musk is known for his fear of AI: Threatening with Google’s Robot army (lately, we have seen potential of Russian robot army); In his opinion, “We should not build something smarter than us. That is Darwinian error”. "Government of the people, by the people, for the people, shall not perish from the Earth." - Abraham Lincoln “By the people, for the people” = OpenAI: Collaborative and transparent - any cutting edge algorithm should be available to entire humanity; “Of the people” = Neuralink: If AI is given capacities to take autonomous decisions, we do not know if it will serve us. This could be the beginning of ultimate dictatorship; The only choice: Allow humans “to be AI”.
- Following Kaku, page 58 + Elon Musk Kaku (43): Consciousness is the process of creating a model of the world using multiple feedback loops in various parameters, in order to accomplish a goal. (46): Human consciousness is a specific form of consciousness that creates a model of the world and then simulates it in time, by evaluating the past to simulate the future. This requires mediating and evaluating many feedback loops in order to make a decision to achieve a goal. (58): There is probably a specific part of the brain whose job is to unify the signals from the two hemispheres to create a smooth, coherent sense of self. Dr. Todd Heatherton: “The medial prefrontal cortex could be continually stitching together a sense of who we are.” Dr. Michael Gazzaniga: “The left brain of split-brain patients, when confronted with the fact that there seem to be two separate centers of consciousness, would simple confabulate strange explanations.” “It is the left hemisphere that engages in the human tendency to find order in chaos, that tries to fit everything into a story and put it into context. There is probably an evolutionary reason that we evolved our split brains. Oftentimes, the correct view emerges out of intense interaction with incorrect ideas. Returning to Ghost in the Shell: They have dropped person’s memories but they have purposefully left the spirit. What is meant as “spirit”, a will to fight, might be residing in patterns of medial prefrontal cortex. The Scientific Basis for the Spiritual Concept of the Third Eye - Medial prefrontal cortex: Part of the cognitive (mental) processing system of humans and appears to play a inhibitory calming or influencing role over the emotional or limbic part of the brain. Mediate and down-regulate the production of the stress hormone known as cortisol that is produced via the Hypothalamic-Pituitary gland-Adrenal gland axis (HPA axis) when a person is stressed. The signalling by the medial prefrontal cortex appears to regulate the generalization of fear and can dampen an overall increase in escalation of fear mediated by the Amygdala, which is the part of the brain that evokes a “fight or flight” response in us all. Eight consciousnesses (Yogacara school of Buddhism) Elon Musk & Tim Urban: AI system, he believes, will become as present a character in your mind as your monkey and your human characters—and it will feel like you every bit as much as the others do. I think that, conceivably, there’s a way for there to be a tertiary layer that feels like it’s part of you. It’s not something that you offload to, it’s you. You do most of your “thinking” with your cortex, but then when you get hungry, you don’t say, “My limbic system is hungry,” you say, “I’m hungry.” Likewise, Elon thinks, when you’re trying to figure out the solution to a problem and your AI comes up with the answer, you won’t say, “My AI got it,” you’ll say, “Aha! I got it.”
- What We Can Do Now To Stop AI Technology And Brain Mapping https://en.wikipedia.org/wiki/Tin_foil_hat A science fiction short story by Julian Huxley, "The Tissue-Culture King", first published in 1927, in which the protagonist discovers that "caps of metal foil" can block the effects of telepathy. The notion that a metal foil hat can significantly reduce the intensity of incident radio frequency radiation on the wearer's brain has some scientific validity, as the effect of strong radio waves has been documented for quite some time. A well-constructed aluminum foil enclosure would approximate a Faraday cage, reducing the amount of radiofrequency electromagnetic radiation passing through to the interior of the structure.
- Essential article: 5 Neuroscience Experts Weigh in on Elon Musk's Mysterious "Neural Lace" Company
- Jepsen's system measures that scattering holographically, inverts it, and then shines this inverted holographic image back into the body. The inverted holographic image then uses the scattering of the body itself as a lens, enabling the precise focusing of NIR light deep into the body. Her system lines a hat or bandage with flexible LCDs illuminated by NIR light, as well as the detectors. Since the body is in constant motion, the use of LCDs and video holograms is key, Jensen says, but she cut her teeth on that technology. In the late 1980s, when she was an undergrad at MIT, she made the world’s first holographic video system. “It was the closest thing to a religious experience I’ve ever had,” she says. OpenWater YouTube: The science of visible thought and our translucent selves Why Mary Lou Jepsen Left Facebook: To Transform Health Care and Invent Consumer Telepathy
- Neurosteer (YouTube)
- Dr Davide Valeriani: Using BCIs to extract neural information related to the confidence in a decision from the EEG signals of individual users. The BCI uses machine learning techniques to build an estimation of the confidence of each decision maker based on these neural correlates, response times (RTs) and other physiological measures (e.g., eye movements, skin conductance). “Discovering new methods to improve human decision-making during stressful situations” project (Dr Luca Citi): Make sense of the processes that take place in our brain while we acquire information about the world around us and try to build a coherent view of it in our mind; Our challenge as scientists is therefore to make the best use of the most advanced signal processing and modelling techniques and to develop new ones to uncover and understand the underlying neural processes of the brain; There are still many unanswered questions in neuroscience. This research project will help enhance our understanding of multisensory perception and will make it possible for people to improve their cognition and perception ability when engaging in demanding and complex tasks; The next step will be to create a brain-computer interface incorporating estimated mental states such as situational awareness, confidence in a decision and even the anticipation of a subject’s action. Davide Valeriani Research (EyeWink) Making the right decisions when the heat is on Davide Valeriani Research (Group decision-making with BCI)
- http://www.luminous-project.eu/ http://www.luminous-project.eu/wp-content/uploads/2016/06/LUMINOUSshort.pdf https://www.youtube.com/watch?v=QLXvL7j_rN4 https://www.youtube.com/watch?v=biFWsOIE5OQ
- From http://spectrum.ieee.org/the-human-os/biomedical/devices/5-neuroscience-experts-weigh-in-on-elon-musks-mysterious-neural-lace-company: Who did Elon Musk take on board? Vanessa Tolosa of Lawrence Livermore National Lab has been working on flexible polymer probes that look like little dipsticks Paper: “Towards a large-scale recording system: Demonstration of polymer-based penetrating array for chronic neural recording” This is our first step towards developing a 1000+ electrode system capable of providing high-quality, long-term neural recordings. Main interest: Electrode material development and characterization: iridium, electrochemically deposited iridium oxide (EIROF) and activated (AIROF), high-surface area platinum, PEDOT, novel materials Philip Sabes of University of California, San Francisco has experimented with a “micro-ECoG” array that drapes over the outer surface of the brain Paper: “A Large-Scale Interface for Optogenetic Stimulation and Recording in Nonhuman Primates” Timothy Gardner of Boston University works on carbon fiber electrodes that look like bundles of threads: From abstract: “We describe an assembly method for a 16-channel electrode array consisting of carbon fibers (<5 μm diameter) individually insulated with Parylene-C and fire-sharpened. The diameter of the array is approximately 26 μm along the full extent of the implant.” While Musk’s description of a neural lace “layer” makes Sabes’s superficial array sound like the winning contender, such a device couldn’t be injected through the jugular and travel through blood vessels to reach the upper surface of the brain. It’s possible that we shouldn’t take his works literally—Musk may have been speaking metaphorically about technology that would add a new layer of intelligence to the human brain.