The document discusses the development of brain-computer interfaces (BCI) that synergize software systems with human neural inputs for improved human-computer interaction. It explores the principles, state of the art, and applications of BCIs, including the mapping of user intentions through neural activity and sensory feedback. The emphasis is on creating self-adaptive systems that utilize covert attention to enhance user interaction with technology.

1. Shihong Huang
Department of Computer & Electrical Engineering
and Computer Science
Florida Atlantic University
Emmanuelle Tognoli
Center for Complex Systems & Brain Sciences
Florida Atlantic University
BRAINWARE:
Synergizing
software systems & neural inputs

2. Computer born from
efforts for
surrogate human
cognitive processing
(automatic counting, von
Neumann)
Computer
Brain Computer
Brain
Theories of cognition and behavior
inspired by architecture of computer
(artificial intelligence, computational
neuroscience)
Synergies between the “software” of human brains & computers
SAS
manager monitoring
analysisplanning
executive sensory
systems
cognition
(frontal)
executive
functions
motor
behavior
feedback

3. GOALS:
A leap forward in Human Computer Interaction

4. This is
Brain Computer
Interface (BCI)

5. BRAIN COMPUTER INTERFACE:
Principles and state of the art

6. BRAIN
Recordings of
neural activity
Interpreter
Theory
of
neural
activity
Sensory
feedback
Mapping user intention
to computer action
intentions,
attention,
memories,
thoughts…

7. control communication
neuroprosthetics navigation
games

8. EXAMPLARY NEURAL INPUT:
Tracking covert attention to know user’s
intention/forthcoming actions

9. A BCI for a self-adaptive system sensing users’ covert attention
Where her gaze is
directed at
overt attention
Where she pays attention
covert attention
(look from the corner of the eyes)
Covert attention (Posner, 1980): a low-level cognitive process to
evaluate information saliency prior to committing to the costly
process of moving eye gaze
(shall I gaze or shall I not? Is what happening there relevant to me?)

10. q
r
qr

11. GENERALIZATION:
Blueprint for Software Systems that are
“Neural Input”-ready

12. k
l

13. TAKE-HOME MESSAGE:
Self-Adaptive Systems: a natural basis for the
integration of neural inputs