Brain imaging for fun and profit Daniel Marcus, PhD Director, Neuroinformatics Research Group @ Washington University School of Medicine
Outline Brain imaging 101 Brain imaging & emerging technologies Brain imaging for hackers
100 billion neurons in the human brain 100 trillion synapses in the human brain Neuron is the basic computational unit in the brain
Neurons are organized into circuits in the cerebral cortex
Neuron    Network    Whole brain
Brain imaging: single neuron Misgeld &  Kerschensteiner,  2006 In vivo microscopy
Brain imaging: neuronal networks Livet, et al.  Nature  (2007) Transgenics & fluorescence microscopy
Brain imaging: whole brain Magnetic Resonance Imaging (MRI) Structural MRI Functional MRI Functional connectivity MRI Computed tomography (CT) Positron emission tomography (PET) EEG, MEG, MRS, SPECT, DTI,…
Structural MRI Essential in clinical care. Radiologists perform qualitative “lightbox” reads.  Most psychiatric and neurological disorders are invisible to reading radiologists.
Aging of the brain 20s 80s with mild Alzheimer’s 80s aging  gracefully http://www.oasis-brains.org
Brain volume declines with age Marcus et al., 2007
Advanced structural methods Van Essen et al., 2006 Csernansky et al., 2005
fMRI
fMRI depends on functional localization
The sad tale of Phineas Gage “ [P]ossessed a well-balanced mind, and was looked upon by those who knew him as a shrewd, smart businessman, very energetic and persistent” “ fitful, irreverent, indulging at times in the grossest profanity (which was not previously his custom), manifesting but little deference for his fellows, impatient of restraint or advice when it conflicts with his desires, at times pertinaciously obstinate, yet capricious and vacillating...” Harlow, J.M. (1868)
 
Natural History Museum, London
Another sad tale “ A preexisting  strong interest in pornography   dating back to adolescence ...” “ An  increasing  interest in pornography... acquired   an  expanding  collection of pornographic magazines and  increasingly   frequented Internet pornography sites.”  “ Much of this prurient   material emphasized children and adolescents and was specifically   targeted to purveyors of  child pornography . He also solicited   prostitution , which he had not previously   done.”  “ Despite his strong desire to avoid prison, he could   not restrain himself from soliciting sexual favors from staff   at the rehabilitation center.   ” Burns and Swerdlow, 2003
Another sad tale
Anatomy of an fMRI study Buckner & Wheeler, 2001 Study Test (in scanner)
Anatomy of an fMRI study Buckner & Wheeler, 2001 - = Old New
Applications of fMRI Discovery of basic brain function Discovery of brain dysfunction in disease Evaluation of treatment efficacy Sketchy things
http://www.noliemri.com
“ This is your brain on politics”, NY Times, Nov. 11, 2007
Voters sense both peril and promise in party brands.  Emotions about Hillary Clinton are mixed.   The gender gap may be closing. Mitt Romney shows potential.   In Rudy Giuliani versus Fred Thompson, the latter evokes more empathy.   John Edwards has promise — and a problem. Barack Obama and John McCain have work to do.
 
Where are the language areas?  Where are the motor areas?
 
With fMRI, patients must perform an action, which is unreliable in clinic.
Functional connectivity MRI (fcMRI) requires NO task. Highly reliable.
 
 
Functional connectivity MRI (fcMRI) requires NO task.
 
Emerging technology: quantitative radiology Patient visits doctor. Doctor orders fcMRI.  fcMRI brain scan.  Quantitative analysis Doctor receives report. Doctor makes dx. and plans treatment.  Quantitative report provides diagnostic measures,  guides treatment, assesses response.
Emerging technology: digital lab on the cloud Input:   Raw MRI scans Output:  Quantitative reports
Emerging technology: Patient-driven care Microsoft HealthVault
Google Health (prototype) Emerging technology: Patient-driven care
Brain imaging for hackers Get yourself some brain images Get yourself some brain analysis tools Discover something, invent something
Get your own brain scanned Buy a scanner and install it in your basement
Get your own brain scanned Buy a scanner and install it in your basement Inflict severe brain injury
Get your own brain scanned Buy a scanner and install it in your basement Inflict severe brain injury Volunteer for a study Contact local research centers  Ask for your scans (“I’ve brought a blank CD with me.  Will you please copy the DICOM files of my scans onto it?”)
Use open access data Neuron: Neuron Database @ Yale Sense Lab Gene expression: Allen Brain Atlas Structural MRI: Open Access Structural Imaging Series (OASIS), mBIRN Data Repository Functional MRI: fMRI Data Center, fBIRN Data Repository Functional connectivity MRI: Brainscape
oasis-brains.org
brainscape.org
Get yourself some tools Neuron    Network    Whole brain Genesis Neuron Slicer, Caret, AFNI, Freesurfer, SPM, FSL, ImageJ See also NITRC ( http:// www.nitrc.org / ) Ed Boyden, Thursday 11:50 “ Synthetic Neurobiology: Towards Engineering Brain Circuits for Health and Human Augmentation”
Some unsolved problems Automated brain extraction How many networks are in the brain Methods for distinguishing differences between populations Predicting disease and aptitude Data sharing Individual differences in performance (“gifted”, “savant”) Neuroethics “ Deidentifying” images Bridging the spatial divide Security and privacy Data mining
Start hacking.
Brain imaging: gene expression Lein et al.  Nature  (2007)
Veber den Kreislauf des Blutes in Menschlichen Gehirn (Concerning the circulation of the blood in the human brain)  Verlag von Viet & Company: Leipzig, 1881 Functional Brain Imaging and Brain Blood Flow Angelo Mosso
Monday noon, September 23, 1878 From: Angelo Mosso (1881) Resting quietly Forearm Brain Arrow: room clock strikes 12 noon and of church bells heard Brain Forearm Arrow: Mosso asked Bertino if the Ave Maria should have been said Brain Forearm Arrow: “What is 8 x 12?”  ω : response Brain Forearm
Michael Faraday 1845 Linus Pauling 1937 The Background & Basis of the BOLD Effect in fMRI Seiji Ogawa 1990 Room Air 100% Oxygen Room Air 100% Oxygen “ BOLD” Contrast
fMRI depends on blood oxygenation levels ∆  Blood Flow > ∆ Oxygen Consumption fMRI BOLD Signal Difference Image “ Rest” “ Activation”

Brain Imaging for Fun and Profit

  • 1.
    Brain imaging forfun and profit Daniel Marcus, PhD Director, Neuroinformatics Research Group @ Washington University School of Medicine
  • 2.
    Outline Brain imaging101 Brain imaging & emerging technologies Brain imaging for hackers
  • 3.
    100 billion neuronsin the human brain 100 trillion synapses in the human brain Neuron is the basic computational unit in the brain
  • 4.
    Neurons are organizedinto circuits in the cerebral cortex
  • 5.
    Neuron  Network  Whole brain
  • 6.
    Brain imaging: singleneuron Misgeld & Kerschensteiner, 2006 In vivo microscopy
  • 7.
    Brain imaging: neuronalnetworks Livet, et al. Nature (2007) Transgenics & fluorescence microscopy
  • 8.
    Brain imaging: wholebrain Magnetic Resonance Imaging (MRI) Structural MRI Functional MRI Functional connectivity MRI Computed tomography (CT) Positron emission tomography (PET) EEG, MEG, MRS, SPECT, DTI,…
  • 9.
    Structural MRI Essentialin clinical care. Radiologists perform qualitative “lightbox” reads. Most psychiatric and neurological disorders are invisible to reading radiologists.
  • 10.
    Aging of thebrain 20s 80s with mild Alzheimer’s 80s aging gracefully http://www.oasis-brains.org
  • 11.
    Brain volume declineswith age Marcus et al., 2007
  • 12.
    Advanced structural methodsVan Essen et al., 2006 Csernansky et al., 2005
  • 13.
  • 14.
    fMRI depends onfunctional localization
  • 15.
    The sad taleof Phineas Gage “ [P]ossessed a well-balanced mind, and was looked upon by those who knew him as a shrewd, smart businessman, very energetic and persistent” “ fitful, irreverent, indulging at times in the grossest profanity (which was not previously his custom), manifesting but little deference for his fellows, impatient of restraint or advice when it conflicts with his desires, at times pertinaciously obstinate, yet capricious and vacillating...” Harlow, J.M. (1868)
  • 16.
  • 17.
  • 18.
    Another sad tale“ A preexisting strong interest in pornography dating back to adolescence ...” “ An increasing interest in pornography... acquired an expanding collection of pornographic magazines and increasingly frequented Internet pornography sites.” “ Much of this prurient material emphasized children and adolescents and was specifically targeted to purveyors of child pornography . He also solicited prostitution , which he had not previously done.” “ Despite his strong desire to avoid prison, he could not restrain himself from soliciting sexual favors from staff at the rehabilitation center. ” Burns and Swerdlow, 2003
  • 19.
  • 20.
    Anatomy of anfMRI study Buckner & Wheeler, 2001 Study Test (in scanner)
  • 21.
    Anatomy of anfMRI study Buckner & Wheeler, 2001 - = Old New
  • 22.
    Applications of fMRIDiscovery of basic brain function Discovery of brain dysfunction in disease Evaluation of treatment efficacy Sketchy things
  • 23.
  • 24.
    “ This isyour brain on politics”, NY Times, Nov. 11, 2007
  • 25.
    Voters sense bothperil and promise in party brands. Emotions about Hillary Clinton are mixed. The gender gap may be closing. Mitt Romney shows potential. In Rudy Giuliani versus Fred Thompson, the latter evokes more empathy. John Edwards has promise — and a problem. Barack Obama and John McCain have work to do.
  • 26.
  • 27.
    Where are thelanguage areas? Where are the motor areas?
  • 28.
  • 29.
    With fMRI, patientsmust perform an action, which is unreliable in clinic.
  • 30.
    Functional connectivity MRI(fcMRI) requires NO task. Highly reliable.
  • 31.
  • 32.
  • 33.
    Functional connectivity MRI(fcMRI) requires NO task.
  • 34.
  • 35.
    Emerging technology: quantitativeradiology Patient visits doctor. Doctor orders fcMRI. fcMRI brain scan. Quantitative analysis Doctor receives report. Doctor makes dx. and plans treatment. Quantitative report provides diagnostic measures, guides treatment, assesses response.
  • 36.
    Emerging technology: digitallab on the cloud Input: Raw MRI scans Output: Quantitative reports
  • 37.
    Emerging technology: Patient-drivencare Microsoft HealthVault
  • 38.
    Google Health (prototype)Emerging technology: Patient-driven care
  • 39.
    Brain imaging forhackers Get yourself some brain images Get yourself some brain analysis tools Discover something, invent something
  • 40.
    Get your ownbrain scanned Buy a scanner and install it in your basement
  • 41.
    Get your ownbrain scanned Buy a scanner and install it in your basement Inflict severe brain injury
  • 42.
    Get your ownbrain scanned Buy a scanner and install it in your basement Inflict severe brain injury Volunteer for a study Contact local research centers Ask for your scans (“I’ve brought a blank CD with me. Will you please copy the DICOM files of my scans onto it?”)
  • 43.
    Use open accessdata Neuron: Neuron Database @ Yale Sense Lab Gene expression: Allen Brain Atlas Structural MRI: Open Access Structural Imaging Series (OASIS), mBIRN Data Repository Functional MRI: fMRI Data Center, fBIRN Data Repository Functional connectivity MRI: Brainscape
  • 44.
  • 45.
  • 46.
    Get yourself sometools Neuron  Network  Whole brain Genesis Neuron Slicer, Caret, AFNI, Freesurfer, SPM, FSL, ImageJ See also NITRC ( http:// www.nitrc.org / ) Ed Boyden, Thursday 11:50 “ Synthetic Neurobiology: Towards Engineering Brain Circuits for Health and Human Augmentation”
  • 47.
    Some unsolved problemsAutomated brain extraction How many networks are in the brain Methods for distinguishing differences between populations Predicting disease and aptitude Data sharing Individual differences in performance (“gifted”, “savant”) Neuroethics “ Deidentifying” images Bridging the spatial divide Security and privacy Data mining
  • 48.
  • 49.
    Brain imaging: geneexpression Lein et al. Nature (2007)
  • 50.
    Veber den Kreislaufdes Blutes in Menschlichen Gehirn (Concerning the circulation of the blood in the human brain) Verlag von Viet & Company: Leipzig, 1881 Functional Brain Imaging and Brain Blood Flow Angelo Mosso
  • 51.
    Monday noon, September23, 1878 From: Angelo Mosso (1881) Resting quietly Forearm Brain Arrow: room clock strikes 12 noon and of church bells heard Brain Forearm Arrow: Mosso asked Bertino if the Ave Maria should have been said Brain Forearm Arrow: “What is 8 x 12?” ω : response Brain Forearm
  • 52.
    Michael Faraday 1845Linus Pauling 1937 The Background & Basis of the BOLD Effect in fMRI Seiji Ogawa 1990 Room Air 100% Oxygen Room Air 100% Oxygen “ BOLD” Contrast
  • 53.
    fMRI depends onblood oxygenation levels ∆ Blood Flow > ∆ Oxygen Consumption fMRI BOLD Signal Difference Image “ Rest” “ Activation”