The document discusses the Individual Brain Charting (IBC) initiative, which provides a high-resolution fMRI dataset for linking brain systems to cognitive processes. It details the dataset's features, including its high spatial resolution, task-wise design, and fixed cohort, while also outlining the methodologies and analysis pipelines used. Future releases of the dataset are planned, which will include additional cognitive tasks and modalities.

1. Individual Brain Charting,
a high-resolution fMRI dataset
for cognitive mapping of the human brain
Ana Lu´ısa Pinho
Parietal Team, Inria
NeuroSpin, CEA Saclay
@ALuisaPinho
Science Pizza
ICM, Paris
3rd
of April 2019

2. Background and motivations
In cognitive neuroscience:
Brain systems
⇐⇒
Mental functions

3. Background and motivations
In cognitive neuroscience:
Brain systems
⇐⇒
Mental functions
tackle one psychological domain

4. Background and motivations
In cognitive neuroscience:
Brain systems
⇐⇒
Mental functions
tackle one psychological domain
be specific enough to accurately isolate brain
processes

5. Background and motivations
In cognitive neuroscience:
Brain systems
⇐⇒
Mental functions
tackle one psychological domain
be specific enough to accurately isolate brain
processes
⇓
Very hard to achieve!
Lack of generality.

6. Background and motivations
In cognitive neuroscience:
Brain systems
⇐⇒
Mental functions
Task-fMRI experiments allow to:
link brain systems to behavior
map neural activity at mm-scale

7. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)

8. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s

9. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks

10. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks
Fixed cohort - 13 healthy adults

11. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks
Fixed cohort - 13 healthy adults
Fixed environment
NeuroSpin platform, CEA-Saclay, France
Siemens 3T Magnetom Prismafit
64-channel coil

12. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks
Fixed cohort - 13 healthy adults
Fixed environment
Inclusion of other MRI modalities NeuroSpin platform, CEA-Saclay, France
Siemens 3T Magnetom Prismafit
64-channel coil

13. Features of the IBC dataset
High spatial-resolution fMRI data
(1.5mm)
TR = 2s
Task-wise dataset:
Many tasks
Fixed cohort - 13 healthy adults
Fixed environment
Inclusion of other MRI modalities
Not a longitudinal study!
NeuroSpin platform, CEA-Saclay, France
Siemens 3T Magnetom Prismafit
64-channel coil

14. Tasks
A task is:
a well-controlled sequence of behavioral operations

15. Tasks
A task is:
a well-controlled sequence of behavioral operations
Paradigms:
categorical designs ⇒ subtraction

16. Tasks
A task is:
a well-controlled sequence of behavioral operations
Paradigms:
categorical designs ⇒ subtraction
naturalistic stimuli

17. Tasks
A task is:
a well-controlled sequence of behavioral operations
Paradigms:
categorical designs ⇒ subtraction
naturalistic stimuli
Long-range cognitive order:
Perception ⇒ High-cognition

18. First release
Tasks
ARCHI tasks
Standard
Spatial
Social
Emotional
HCP tasks
Emotion
Gambling
Motor
Language
Relational
Social
Working Memory
RSVP Language

19. First release
Tasks
ARCHI tasks
Standard
Spatial
Social
Emotional
HCP tasks
Emotion
Gambling
Motor
Language
Relational
Social
Working Memory
RSVP Language
Sensory processing:
Retinotopy
Tonotopy
Somatotopy
High-cognitive order:
Calculation
Language
Social cognition
Theory-of-mind

20. First release
Tasks
ARCHI tasks
Standard
Spatial
Social
Emotional
HCP tasks
Emotion
Gambling
Motor
Language
Relational
Social
Working Memory
RSVP Language
Sensory processing:
Retinotopy
Tonotopy
Somatotopy
High-cognitive order:
Calculation
Language
Social cognition
Theory-of-mind
59 independent conditions

21. Behavioral protocols
Software Tools:
Presentation

22. Behavioral protocols
Software Tools:
Presentation
Protocols available on:
hbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocols

23. Behavioral protocols
Software Tools:
Presentation
More public repositories of behavioral protocols to
reproduce experiments!
Normatives to describe the experimental paradigms!
Protocols available on:
hbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocolshbp-brain-charting/public protocols

24. Storage of raw MRI data
Link

25. Storage of raw MRI data
Link
ds000244
Link

26. Storage of raw MRI data
Link
ds000244
Link
Data organization: BIDS Specification

27. Analysis pipeline

28. Analysis pipeline
Mass-univariate GLM analysis

29. Analysis pipeline
Mass-univariate GLM analysis
Individual statistical maps

30. Analysis pipeline
Mass-univariate GLM analysis
Individual statistical maps
Two-level model: within and between-subject level analysis

31. Analysis pipeline
Mass-univariate GLM analysis
Individual statistical maps
Two-level model: within and between-subject level analysis
Python package of the IBC analysis pipeline available here:
hbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis codehbp-brain-charting/public analysis code

32. Publication of data descriptor
doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105doi.org/10.1038/sdata.2018.105

33. Results

34. Post-processed data
Collection id=4438
Link
Group-level z-maps
qFDR < 0.05

35. Post-processed data
Collection id=4438
Link
Group-level z-maps
qFDR < 0.05

36. Brain coverage
Group-level F-map pFWE < 0.05
x=27x=12x=-13x=-28x=-43 -80
-40
0
40
80
Comprehensive brain coverage of functional activity
already in the first release!

37. Activation similarity fits task similarity
archiemotional
archisocial
archispatial
archistandard
hcpemotion
hcpgambling
hcplanguagehcpmotor
hcprelational
hcpsocial
hcpwmrsvplanguagearchi emotional
archi social
archi spatial
archi standard
hcp emotion
hcp gambling
hcp language
hcp motor
hcp relational
hcp social
hcp wm
rsvp language 0
1
archiemotional
archisocial
archispatial
archistandard
hcpemotion
hcpgambling
hcplanguagehcpmotor
hcprelational
hcpsocial
hcpwmrsvplanguage
archi emotional
archi social
archi spatial
archi standard
hcp emotion
hcp gambling
hcp language
hcp motor
hcp relational
hcp social
hcp wm
rsvp language 0
1

38. IBC reproduces ARCHI and HCP
storyvs.math
social-interactionmotionvs.random
motion
punishementvs.reward
tonguevs.anymotion
rightfootvs.anymotion
leftfootvs.anymotion
righthandvs.anymotion
lefthandvs.anymotion
faceimagevs.shapeoutline
relationalprocessingvs.visualmatching
toolimagevs.anyimage
placeimagevs.anyimage
faceimagevs.anyimage
bodyimagevs.anyimage
2-backvs.0-back
sentencereadingvs.sentencelistening
sentencereadingvs.checkerboard
lefthandvs.righthand
horizontalcheckerboardvs.verticalcheckerboard
mentalsubtractionvs.sentencereading
saccadesvs.fixation
leftorrighthandvs.handpalm
orback
objectgraspingvs.orientationjudgment
social-interactionmotionvs.random
motion
false-beliefstoryvs.mechanisticstory
false-belieftalevs.mechanistictale
expressionintentionvs.genderassessment
facetrustyvs.genderassessment
story vs. math
social-interaction motion vs. random motion
punishement vs. reward
tongue vs. any motion
right foot vs. any motion
left foot vs. any motion
right hand vs. any motion
left hand vs. any motion
face image vs. shape outline
relational processing vs. visual matching
tool image vs. any image
place image vs. any image
face image vs. any image
body image vs. any image
2-back vs. 0-back
sentence reading vs. sentence listening
sentence reading vs. checkerboard
left hand vs. right hand
horizontal checkerboard vs. vertical checkerboard
mental subtraction vs. sentence reading
saccades vs. fixation
left or right hand vs. hand palm or back
object grasping vs. orientation judgment
social-interaction motion vs. random motion
false-belief story vs. mechanistic story
false-belief tale vs. mechanistic tale
expression intention vs. gender assessment
face trusty vs. gender assessment
HCP contrasts ARCHI contrasts
IBCcontrasts
0.6
0.4
0.2
0.0
0.2
0.4
0.6
0.8

39. Variability of Functional Signatures
Individual z-maps
qFDR < 0.05

40. Variability of Functional Signatures
0.0 0.1 0.2 0.3 0.4
sentence reading vs. sentence listening
sentence reading vs. checkerboard
left hand vs. right hand
horizontal checkerboard vs. vertical checkerboard
mental subtraction vs. sentence reading
saccades vs. fixation
left or right hand vs. hand palm or back
object grasping vs. orientation judgment
social-interaction motion vs. random motion
false-belief story vs. mechanistic story
false-belief tale vs. mechanistic tale
expression intention vs. gender assessment
face trusty vs. gender assessment
face image vs. shape outline
punishement vs. reward
0.0 0.1 0.2 0.3 0.4
tongue vs. any motion
right foot vs. any motion
left foot vs. any motion
right hand vs. any motion
left hand vs. any motion
story vs. math
relational processing vs. visual matching
social-interaction motion vs. random motion
tool image vs. any image
place image vs. any image
face image vs. any image
body image vs. any image
2-back vs. 0-back
read pseudowords vs. consonant strings
read words vs. consonant strings
read words vs. read pseudowords
read sentence vs. read jabberwocky
read sentence vs. read words
Average and standard deviation of map correlation across subjects

41. Effect of subject and task on brain activity
Per-voxel ANOVA qFDR < 0.05
x=10
L R
z=10 -28
-14
0
14
28
L R
y=-50
Subject effect
x=10
L R
z=10 -37
-19
0
19
37
L R
y=-50
Condition effect

42. Effect of subject and task on brain activity
Per-voxel ANOVA qFDR < 0.05
x=10
L R
z=10 -28
-14
0
14
28
L R
y=-50
Subject effect
x=10
L R
z=10 -37
-19
0
19
37
L R
y=-50
Condition effect
IBC data suitable for cognitive and
individual-brain modeling!

43. Future releases
Next release is coming up soon!
Mental-Time Travel
Positive-Incentive Value
Theory-of-Mind + Pain Matrices
Visual Short-Term Memory + Enumeration

44. Future releases
Next release is coming up soon!
Mental-Time Travel
Positive-Incentive Value
Theory-of-Mind + Pain Matrices
Visual Short-Term Memory + Enumeration
Other releases:
Visual system: Passive-Watching of Naturalistic Scenes + Movie
Watching + Retinotopy
Anatomical data + Resting-State
Self-Reference Effect, Tonotopy and more...

45. Work-in-progress
Data acquisition till 2022
Final dataset: 50 acquisitions per participant

46. Work-in-progress
Data acquisition till 2022
Final dataset: 50 acquisitions per participant
Share your protocols with us!

47. Encoding models for cognitive mapping

48. Encoding models for cognitive mapping
Dictionary Learning

49. Encoding models for cognitive mapping
Model of occurences of mental concepts

50. Encoding models for cognitive mapping
Model of occurences of mental concepts

51. Thanks!
Bertrand Thirion
...and to
the IBC volunteers!!!
For more information, consult: project.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBCproject.inria.fr/IBC