SlideShare a Scribd company logo
Linguistic and embodied systems
in conceptual processing:
Role of individual differences
Pablo Bernabeu
Embodied Cognition Lab
Supervisors: Dermot Lynott, Louise Connell
Lancaster University, 29th Nov 2018
Terminology
Levels of processing:
From Bernabeu et al. (2017)
Terminology
Levels of processing:
Lexical
From Bernabeu et al. (2017)
Terminology
Levels of processing:
Lexical
Semantic
From Bernabeu et al. (2017)
Terminology
Systems:
Lexical
Semantic
From Pulvermuller (2013)
Terminology
Systems:
LINGUISTIC
Lexical
Semantic
From Pulvermuller (2013)
Terminology
Systems:
LINGUISTIC EMBODIED
Lexical
Semantic
From Pulvermuller (2013)
DOG PARADOX GRAB
pet irony take
walk text force
cute surprise coffee
Distributional semantics
DOG PARADOX GRAB
Latent Semantic Analysis (http:// lsa.colorado.edu)
pet irony take
walk text force
cute surprise coffee
Distributional semantics
DOG PARADOX GRAB
CORPUS: Populations (Louwerse & Zwaan, 2009)
RT: animals, body, geography (Lund & Burgess, 1996) *
BRAIN: Voxel-level neural activation predicted
by distributional statistics (Mitchell et al., 2008)
Latent Semantic Analysis (http:// lsa.colorado.edu)
pet irony take
walk text force
cute surprise coffee
Distributional semantics
DOG PARADOX GRAB
CORPUS: Populations (Louwerse & Zwaan, 2009)
RT: animals, body, geography (Lund & Burgess, 1996) *
BRAIN: Voxel-level neural activation predicted
by distributional statistics (Mitchell et al., 2008)
* Symbol-grounding problem
Latent Semantic Analysis (http:// lsa.colorado.edu)
pet irony take
walk text force
cute surprise coffee
Distributional semantics
DOG PARADOX GRAB
CORPUS: Populations (Louwerse & Zwaan, 2009)
RT: animals, body, geography (Lund & Burgess, 1996) *
BRAIN: Voxel-level neural activation predicted
by distributional statistics (Mitchell et al., 2008)
* Symbol-grounding problem
Latent Semantic Analysis (http:// lsa.colorado.edu)
pet irony take
walk text force
cute surprise coffee
Distributional semantics
Personal &
external
EXPERIENCE
DOG DOG
PARADOX PARADOX
GRAB GRAB
CORPUS: Populations (Louwerse & Zwaan, 2009)
RT: animals, body, geography (Lund & Burgess, 1996) *
BRAIN: Voxel-level neural activation predicted
by distributional statistics (Mitchell et al., 2008)
* Symbol-grounding problem
Latent Semantic Analysis (http:// lsa.colorado.edu)
pet irony take
walk text force
cute surprise coffee
Distributional semantics Embodied cognition
Personal &
external
EXPERIENCE
DOG DOG
PARADOX PARADOX
GRAB GRAB
CORPUS: Populations (Louwerse & Zwaan, 2009)
RT: animals, body, geography (Lund & Burgess, 1996) *
BRAIN: Voxel-level neural activation predicted
by distributional statistics (Mitchell et al., 2008)
* Symbol-grounding problem
Latent Semantic Analysis (http:// lsa.colorado.edu)
EMOTIONAL Kousta et al. (2011) * YES/NO
MOTOR Willems et al. (2011)
SENSORY Hald et al. (2011)
Simmons et al. (2007)
pet irony take
walk text force
cute surprise coffee
Distributional semantics Embodied cognition
‘Green’
Personal &
external
EXPERIENCE
DOG DOG
PARADOX PARADOX
GRAB GRAB
CORPUS: Populations (Louwerse & Zwaan, 2009)
RT: animals, body, geography (Lund & Burgess, 1996) *
BRAIN: Voxel-level neural activation predicted
by distributional statistics (Mitchell et al., 2008)
* Symbol-grounding problem
Latent Semantic Analysis (http:// lsa.colorado.edu)
EMOTIONAL Kousta et al. (2011) * YES/NO
MOTOR Willems et al. (2011)
SENSORY Hald et al. (2011)
Simmons et al. (2007)
(Hickok, 2014;
Willems & Francken, 2012;
Mahon & Caramazza, 2008)
pet irony take
walk text force
cute surprise coffee
Distributional semantics Embodied cognition
‘Green’
* Causality question
Personal &
external
EXPERIENCE
From Barsalou et al. (2008)
From Barsalou et al. (2008)
Language
From Barsalou et al. (2008)
Language Simulation
Zwaan, Stanfield, and Yaxley (2002)
Sentence-picture verification
Object orientation effect (classic embodiment effect)
Group replication (Psychological Science Accelerator)
Zwaan, Stanfield, and Yaxley (2002)
Sentence-picture verification
He saw the eagle in the sky
Object orientation effect
Group replication (Psychological Science Accelerator)
Object orientation effect
Group replication (Psychological Science Accelerator)
Zwaan, Stanfield, and Yaxley (2002)
Sentence-picture verification
He saw the eagle in the sky
Object orientation effect
Group replication (Psychological Science Accelerator)
Zwaan, Stanfield, and Yaxley (2002)
Sentence-picture verification: ‘Was this object in the sentence?’
[congruent]
Object orientation effect
Group replication (Psychological Science Accelerator)
Zwaan, Stanfield, and Yaxley (2002)
Sentence-picture verification: ‘Was this object in the sentence?’
[INcongruent]
Object orientation effect
Group replication (Psychological Science Accelerator)
Zwaan, Stanfield, and Yaxley (2002)
Sentence-picture verification: ‘Was this object in the sentence?’
[congruent]
He saw the eagle in the sky
[INcongruent]
• ORIGINAL RESULTS: Faster responses for congruent trials
Object orientation effect
Group replication (Psychological Science Accelerator)
Zwaan, Stanfield, and Yaxley (2002) replicated across 14 languages (NEng = 1,900)
Sentence-picture verification: ‘Was this object in the sentence?’
[congruent]
He saw the eagle in the sky
[INcongruent]
• ORIGINAL RESULTS: Faster responses for congruent trials.
• Interpretation: Mental simulation of orientation while reading
Object orientation effect
Group replication (Psychological Science Accelerator)
Zwaan, Stanfield, and Yaxley (2002) replicated across 14 languages (NEng = 1,900)
Sentence-picture verification: ‘Was this object in the sentence?’
[congruent]
He saw the eagle in the sky
[INcongruent]
• ORIGINAL RESULTS: Faster responses for congruent trials.
• Interpretation: Mental simulation of orientation while reading
• ADDITION: Individual differences in spatial cognition,
particularly mental rotation
Object orientation effect
Group replication (Psychological Science Accelerator)
Zwaan, Stanfield, and Yaxley (2002) replicated across 14 languages (NEng = 1,900)
Sentence-picture verification: ‘Was this object in the sentence?’
[congruent]
He saw the eagle in the sky
[INcongruent]
• ORIGINAL RESULTS: Faster responses for congruent trials.
• Interpretation: Mental simulation of orientation while reading
• ADDITION: Individual differences in spatial cognition,
particularly mental rotation
Object orientation effect
Group replication (Psychological Science Accelerator)
Zwaan, Stanfield, and Yaxley (2002) replicated across 14 languages (NEng = 1,900)
Sentence-picture verification: ‘Was this object in the sentence?’
[congruent]
He saw the eagle in the sky
[INcongruent]
• ORIGINAL RESULTS: Faster responses for congruent trials.
• Interpretation: Mental simulation of orientation while reading
• ADDITION: Individual differences in spatial cognition,
particularly mental rotation
From mercercognitivepsychology.pbworks.com
Psychological Science Accelerator
• Openly sourced projects, from pre-registration through testing etc.
• Aims: more robust analysis, super-sized samples
• Open for publishing project or just collaborating
• Materials and procedure created by lead lab, used by all others
(translated to each language)
DOG DOG
PARADOX PARADOX
GRAB GRAB
CORPUS: Populations (Louwerse & Zwaan, 2009)
RT: animals, body, geogra. (Lund & Burgess, 1996) *
BRAIN: Voxel-level neural activation predicted
by distributional statistics (Mitchell et al, 2008)
! Symbol-grounding problem
Latent Semantic Analysis (http:// lsa.colorado.edu)
EMOTIONAL Kousta et al (2011) * YES/NO
MOTOR Willems et al (2011)
SENSORY Hald et al (2011)
Simmons et al (2007)
(Hickok, 2014; Willems &
Francken, 2012; Mahon &
Caramazza, 2008)
pet irony take
walk text force
cute surprise coffee
Distributional semantics Embodied cognition
‘Green’
! Causality question
DOG DOG
PARADOX PARADOX
GRAB GRAB
CORPUS: Populations (Louwerse & Zwaan, 2009)
RT: animals, body, geogra. (Lund & Burgess, 1996) *
BRAIN: Voxel-level neural activation predicted
by distributional statistics (Mitchell et al, 2008)
! Symbol-grounding problem
Latent Semantic Analysis (http:// lsa.colorado.edu)
EMOTIONAL Kousta et al (2011) * YES/NO
MOTOR Willems et al (2011)
SENSORY Hald et al (2011)
Simmons et al (2007)
(Hickok, 2014; Willems &
Francken, 2012; Mahon &
Caramazza, 2008)
pet irony take
walk text force
cute surprise coffee
Distributional semantics Embodied cognition
‘Green’
! Causality question
DOG DOG
PARADOX PARADOX
GRAB GRAB
Linguistic and embodied interplay
• Linguistic co-occurrences processed before perceptual relationships
Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013)
• Linguistic co-occurrences processed before perceptual relationships
Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013)
• Depth of semantics: Language enough for shallow tasks, whereas
simulation necessary for deeper tasks
Sensibility judgment vs interpretation (Connell & Lynott, 2013)
Linguistic and embodied interplay
• Linguistic co-occurrences processed before perceptual relationships
Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013)
• Depth of semantics: Language enough for shallow tasks, whereas
simulation necessary for deeper tasks
Sensibility judgment vs interpretation (Connell & Lynott, 2013)
• Visualisers & verbalisers (Dils & Boroditsky, 2010)
Linguistic and embodied interplay
• Linguistic co-occurrences processed before perceptual relationships
Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013)
• Depth of semantics: Language enough for shallow tasks, whereas
simulation necessary for deeper tasks
Sensibility judgment vs interpretation (Connell & Lynott, 2013)
• Visualisers & verbalisers (Dils & Boroditsky, 2010)
• Motor expertise (Beilock et al., 2008)
• Linguistic expertise (Pexman & Yap, 2018)
Linguistic and embodied interplay
Linguistic and embodied interplay
• Linguistic co-occurrences processed before perceptual relationships
Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013)
• Depth of semantics: Language enough for shallow tasks, whereas
simulation necessary for deeper tasks
Sensibility judgment vs interpretation (Connell & Lynott, 2013)
• Visualisers & verbalisers (Dils & Boroditsky, 2010)
• Motor expertise (Beilock et al., 2008)
• Linguistic expertise (Pexman & Yap, 2018)
• Gender (Hutchinson & Louwerse, 2013)
5 modalities
3 Principal Components
- Louwerse and Connell (2011)
Conceptual modality switch effect
Toll for shifting mod-specific systems. Critical manipulation: cross-trial.
Property verification: ‘Typical?’
Lemony Aftertaste  YES/NO
[perceptual modality match] Juicy Apple  YES/NO
Glossy Screen  YES/NO
[perceptual modality mismatch] Cracking Leaves  YES/NO
[Transitions covert; bold added to targets]
RT: Pecher et al. (2003); Lynott & Connell (2009)
ERPs: Collins et al. (2011); Hald et al. (2011); Hald et al. (2013); Bernabeu et al. (2017)
5 modalities
3 Principal Components
- Louwerse and Connell (2011)
Conceptual modality switch effect
Toll for shifting mod-specific systems. Critical manipulation: cross-trial.
Property verification: ‘Typical?’
Lemony Aftertaste  YES/NO
[perceptual modality match] Juicy Apple  YES/NO
Glossy Screen  YES/NO
[perceptual modality mismatch] Cracking Leaves  YES/NO
[Transitions covert; bold added to targets]
RT: Pecher et al. (2003); Lynott & Connell (2009)
ERPs: Collins et al. (2011); Hald et al. (2011); Hald et al. (2013); Bernabeu et al. (2017)
Interplay of systems (Louwerse & Connell, 2011)
Linguistic and Embodied factor loadings from corpus used to predict switching costs
RESULTS:
Linguistic shifts  + RT
Embodied shifts  – RT
(R2 = .70)
Two systems: speed vs detail
(cf. Ferreira & Patson, 2007)
5 modalities
3 Principal Components:
Visuohaptic,
Olfactory-gustatory,
Auditory
- Louwerse and Connell (2011)
Task and stimulus variables extensively probed;
Task and stimulus variables extensively probed;
turn to individual differences.
Task and stimulus variables extensively probed;
turn to individual differences.
Summing up: current degrees of knowledge
Task and stimulus variables extensively probed;
turn to individual differences.
Summing up: current degrees of knowledge
Task and stimulus variables extensively probed;
turn to individual differences.
Summing up: current degrees of knowledge
• General patterns in linguistic and embodied system
Task and stimulus variables extensively probed;
turn to individual differences.
Summing up: current degrees of knowledge
• General patterns in linguistic and embodied system
• Individual variability
Task and stimulus variables extensively probed;
turn to individual differences.
Summing up: current degrees of knowledge
• General patterns in linguistic and embodied system
• Individual variability
• Interaction between individual differences and both systems
Individual differences
Individual differences
Influence of individuals’ linguistic and perceptual traits on the
interplay between linguistic and embodied systems.
Individual differences
Influence of individuals’ linguistic and perceptual traits on the
interplay between linguistic and embodied systems.
• Process of interest: post-lexical conceptual processing
Individual differences
Influence of individuals’ linguistic and perceptual traits on the
interplay between linguistic and embodied systems.
• Process of interest: post-lexical conceptual processing
• Paradigms: reading comprehension and perceptual simulation
• Tasks: shallower and deeper semantic tasks
(sensibility, concreteness, interpretation judgments)
Individual differences
Influence of individuals’ linguistic and perceptual traits on the
interplay between linguistic and embodied systems.
• Process of interest: post-lexical conceptual processing
• Paradigms: reading comprehension and perceptual simulation
• Tasks: shallower and deeper semantic tasks
(sensibility, concreteness, interpretation judgments)
• Task and stimulus variables alongside individual differences
Individual differences
Influence of individuals’ linguistic and perceptual traits on the
interplay between linguistic and embodied systems.
• Process of interest: post-lexical conceptual processing
• Paradigms: reading comprehension and perceptual simulation
• Tasks: shallower and deeper semantic tasks
(sensibility, concreteness, interpretation judgments)
• Task and stimulus variables alongside individual differences
• Individual differences collected after the core experimental tasks
Individual differences
Influence of individuals’ linguistic and perceptual traits on the
interplay between linguistic and embodied systems.
• Process of interest: post-lexical conceptual processing
• Paradigms: reading comprehension and perceptual simulation
• Tasks: shallower and deeper semantic tasks
(sensibility, concreteness, interpretation judgments)
• Task and stimulus variables alongside individual differences
• Individual differences collected after the core experimental tasks
• Linguistic: lexical decision, vocabulary size, reading and writing habits…
Individual differences
Influence of individuals’ linguistic and perceptual traits on the
interplay between linguistic and embodied systems.
• Process of interest: post-lexical conceptual processing
• Paradigms: reading comprehension and perceptual simulation
• Tasks: shallower and deeper semantic tasks
(sensibility, concreteness, interpretation judgments)
• Task and stimulus variables alongside individual differences
• Individual differences collected after the core experimental tasks
• Linguistic: lexical decision, vocabulary size, reading and writing habits…
• Sensory, motor, affective: spatial cognitive skills, exercising habits…
Individual differences
Influence of individuals’ linguistic and perceptual traits on the
interplay between linguistic and embodied systems.
• Process of interest: post-lexical conceptual processing
• Paradigms: reading comprehension and perceptual simulation
• Tasks: shallower and deeper semantic tasks
(sensibility, concreteness, interpretation judgments)
• Task and stimulus variables alongside individual differences
• Individual differences collected after the core experimental tasks
• Linguistic: lexical decision, vocabulary size, reading and writing habits…
• Sensory, motor, affective: spatial cognitive skills, exercising habits…
• General cognitive: cognitive control (e.g., AX-CPT task), IQ…
Literature-based hypotheses
Linguistic individual differences:
Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018)
Literature-based hypotheses
Linguistic individual differences:
Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018)
Sensory, motor, affective individual differences:
Higher skill  More perceptual simulation in semantic tasks
(Dils & Boroditsky, 2010)
Literature-based hypotheses
Linguistic individual differences:
Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018)
Sensory, motor, affective individual differences:
Higher skill  More perceptual simulation in semantic tasks
(Dils & Boroditsky, 2010)
Time
Literature-based hypotheses
Linguistic individual differences:
Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018)
Sensory, motor, affective individual differences:
Higher skill  More perceptual simulation in semantic tasks
(Dils & Boroditsky, 2010)
Time
Literature-based hypotheses
Linguistic individual differences:
Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018)
Sensory, motor, affective individual differences:
Higher skill  More perceptual simulation in semantic tasks
(Dils & Boroditsky, 2010)
Simulation
Time
Project plan
Phase 1: Individual variability and systems compatibility [On Internet]
Essential: Relative analysis across participants and conditions. Validates off-line measurement.
Project plan
Phase 1: Individual variability and systems compatibility [On Internet]
Essential: Relative analysis across participants and conditions. Validates off-line measurement.
Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan et
al., 2002)—matching advantage.
Project plan
Phase 1: Individual variability and systems compatibility [On Internet]
Essential: Relative analysis across participants and conditions. Validates off-line measurement.
Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan et
al., 2002)—matching advantage. Add individual differences analysis.
Hypotheses 1.1
MAIN EFFECT: Replication of original matching advantage
INTERACTION:
Greater perceptual experience  Larger matching advantage
Project plan
Phase 1: Individual variability and systems compatibility [On Internet]
Essential: Relative analysis across participants and conditions. Validates off-line measurement.
- Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan
et al., 2002)—matching advantage? Add individual differences analysis.
- Experiment 1.2: Participants generate properties for a concept (Santos et al.,
2011)—linguistic relations earlier, perceptual relations later?
Project plan
Phase 1: Individual variability and systems compatibility [On Internet]
Essential: Relative analysis across participants and conditions. Validates off-line measurement.
- Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan
et al., 2002)—matching advantage? Add individual differences analysis.
- Experiment 1.2: Participants generate properties for a concept (Santos et al.,
2011)—linguistic relations earlier, perceptual relations later? + Ind. Diffs.
Hypotheses 1.2
Replication of original Time – System interaction:
Linguistic relations produced earlier, perceptual relations later
System – Individual differences interaction:
• Greater linguistic experience  More linguistic relations
throughout time course
• Greater perceptual experience  More perceptual relations
throughout time course
Project plan
Phase 1: Individual variability and systems compatibility [On Internet]
Essential: Relative analysis across participants and conditions. Validates off-line measurement.
- Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan
et al., 2002)—matching advantage? Add individual differences analysis.
- Experiment 1.2: Participants generate properties for a concept (Santos et al.,
2011)—linguistic relations earlier, perceptual relations later? + Ind. Diffs.
Phase 2: Causality of each system and individual differences [In lab]
Essential: Online measurement as semantic processing unfolds.
Project plan
Phase 1: Individual variability and systems compatibility [On Internet]
Essential: Relative analysis across participants and conditions. Validates off-line measurement.
- Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan
et al., 2002)—matching advantage? Add individual differences analysis.
- Experiment 1.2: Participants generate properties for a concept (Santos et al.,
2011)—linguistic relations earlier, perceptual relations later? + Ind. Diffs.
Phase 2: Causality of each system and individual differences [In lab]
Essential: Online measurement as semantic processing unfolds.
- Experiment 2.1. Tasks: (1) Is this an actual word? | (2) How concrete is it?
TMS: Linguistic and perceptual resources briefly impaired right during task,
tapping into systems’ functional roles (Devlin et al., 2003; Vukovic et al., 2017).
Semantics impaired?
Project plan
Phase 1: Individual variability and systems compatibility [On Internet]
Essential: Relative analysis across participants and conditions. Validates off-line measurement.
- Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan
et al., 2002)—matching advantage? Add individual differences analysis.
- Experiment 1.2: Participants generate properties for a concept (Santos et al.,
2011)—linguistic relations earlier, perceptual relations later? + Ind. Diffs.
Phase 2: Causality of each system and individual differences [In lab]
Essential: Online measurement as semantic processing unfolds.
- Experiment 2.1. Tasks: (1) Is this an actual word? | (2) How concrete is it?
TMS: Linguistic and perceptual resources briefly impaired right during task,
tapping into systems’ functional roles (Devlin et al., 2003; Vukovic et al., 2017).
Semantics impaired? + Interaction with individual differences analysed.
Hypotheses 2.1
Replication of original System – Task interaction:
Reducing motor resources impairs semantic but not lexical processing
System – Task – Individual differences interaction:
• Reducing linguistic resources impairs semantic processing
for verbalisers but not for others.
Barsalou, Santos, Simmons, & Wilson (2008) Language and simulation in conceptual processing…
Bernabeu, Willems, & Louwerse (2017) Modality switch effects emerge early and increase…
Collins, Pecher, Zeelenberg, & Coulson (2011) Modality Switching in a Property Verification …
Connell & Lynott (2013) Flexible and fast: Linguistic shortcut affects both shallow and deep …
Devlin, Matthews, & Rushworth (2003) Semantic processing in the left inferior cortex: a …
Dils & Boroditsky (2010) Visual motion aftereffect from understanding language.
Hald, Marshall, Janssen, & Garnham (2011) Switching Modalities in A Sentence Verification …
Hickok (2014) The myth of mirror neurons: The real neuroscience of communication and ...
Louwerse & Connell (2009) A taste of words: Linguistic context and perceptual simulation …
Louwerse & Zwaan (2009) Language encodes geographical information.
Lund & Burgess (1996) Producing high-dimensional semantic spaces from lexical cooccurrence.
Lynott & Connell (2009) Modality exclusivity norms for 423 object properties.
References (1/2)
Mahon & Caramazza (2008) A critical look at the embodied cognition hypothesis and a new …
Mitchell, Shinkareva, Carlson, Chang, Malave, … Mason (2008) Predicting human brain …
Pecher, Zeelenberg, & Barsalou (2003) Verifying different-modality properties for concepts …
Pulvermuller (2013) How neurons make meaning: brain mechanisms for embodied and abstract…
Santos, Chaigneau, Simmons,, & Barsalou (2011) Property generation reflects word association…
Simmons, Hamann, Harenski, Hu, & Barsalou (2008) fMRI evidence for word association and …
Simmons, Ramjee, Beauchamp, McRae, Martin, & Barsalou (2007) A common neural substrate …
Vukovic, Feurra, Shpektor, Myachykov, & Shtyrov (2017) Primary motor cortex functionally …
Willems & Francken (2012) Embodied cognition: taking the next step.
Willems, Labruna, D’Esposito, Ivry, & Casasanto (2011) A functional role for the motor system …
Zwaan, Stanfield, & Yaxley (2002) Language Comprehenders Mentally Represent the Shapes of…
References (2/2)

More Related Content

Similar to Linguistic and embodied systems in conceptual processing: Role of individual differences

Musical training shapes structural brain development
Musical training shapes structural brain developmentMusical training shapes structural brain development
Musical training shapes structural brain development
pacojavierradio
 
Simulating meaning: a neural theory of discourse coherence
Simulating meaning: a neural theory of discourse coherenceSimulating meaning: a neural theory of discourse coherence
Simulating meaning: a neural theory of discourse coherence
Terry McDonough
 
Replication of Patel, Gibson, Ratner, Besson & Holbomb (1998)
Replication of Patel, Gibson, Ratner, Besson & Holbomb (1998)Replication of Patel, Gibson, Ratner, Besson & Holbomb (1998)
Replication of Patel, Gibson, Ratner, Besson & Holbomb (1998)
Hui Xin Ng
 
A leslla learner's oral language development
A leslla learner's oral language developmentA leslla learner's oral language development
A leslla learner's oral language development
Andrea DeCapua
 
Fmri of bilingual brain atl reveals language independent representations
Fmri of bilingual brain atl reveals language independent representations Fmri of bilingual brain atl reveals language independent representations
Fmri of bilingual brain atl reveals language independent representations
Emily Sabo
 
Zw second exam
Zw second examZw second exam
Zw second exam
zwaldman
 
A Flexible Mapping Scheme For Discrete And Dimensional Emotion Representations
A Flexible Mapping Scheme For Discrete And Dimensional Emotion RepresentationsA Flexible Mapping Scheme For Discrete And Dimensional Emotion Representations
A Flexible Mapping Scheme For Discrete And Dimensional Emotion Representations
Gina Rizzo
 
Language evolution and genomic imprinting
Language evolution and genomic imprintingLanguage evolution and genomic imprinting
Language evolution and genomic imprinting
Will Brown
 
いともたやすく行われるえげつない研究行為
いともたやすく行われるえげつない研究行為いともたやすく行われるえげつない研究行為
いともたやすく行われるえげつない研究行為
Yuki Yamada
 
Deep learning for natural language embeddings
Deep learning for natural language embeddingsDeep learning for natural language embeddings
Deep learning for natural language embeddings
Roelof Pieters
 
FisherPotsdamTalk
FisherPotsdamTalkFisherPotsdamTalk
FisherPotsdamTalk
Vanessa Nguyen
 
Milo
MiloMilo
1. Elaborate on the coca-cocaine commodity value chain and the ill.docx
1. Elaborate on the coca-cocaine commodity value chain and the ill.docx1. Elaborate on the coca-cocaine commodity value chain and the ill.docx
1. Elaborate on the coca-cocaine commodity value chain and the ill.docx
SONU61709
 
Powerpoint davis parkins therapies in the school
Powerpoint davis parkins therapies in the schoolPowerpoint davis parkins therapies in the school
Powerpoint davis parkins therapies in the school
Amanda Washington
 
PearlEnverga2014InPress_MindPrintLang
PearlEnverga2014InPress_MindPrintLangPearlEnverga2014InPress_MindPrintLang
PearlEnverga2014InPress_MindPrintLang
Lisa Pearl
 
Grounded Cognition: Grounding Language in Action
Grounded Cognition: Grounding Language in ActionGrounded Cognition: Grounding Language in Action
Grounded Cognition: Grounding Language in Action
Kristina Rebrova
 
Semantic_properties-BlackboxNLP
Semantic_properties-BlackboxNLPSemantic_properties-BlackboxNLP
Semantic_properties-BlackboxNLP
Pia Sommerauer
 
Cognition 131 (2014) 139–146Contents lists available at Scie
Cognition 131 (2014) 139–146Contents lists available at ScieCognition 131 (2014) 139–146Contents lists available at Scie
Cognition 131 (2014) 139–146Contents lists available at Scie
WilheminaRossi174
 
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
Delaina Hawkins
 
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
Golden Helix Inc
 

Similar to Linguistic and embodied systems in conceptual processing: Role of individual differences (20)

Musical training shapes structural brain development
Musical training shapes structural brain developmentMusical training shapes structural brain development
Musical training shapes structural brain development
 
Simulating meaning: a neural theory of discourse coherence
Simulating meaning: a neural theory of discourse coherenceSimulating meaning: a neural theory of discourse coherence
Simulating meaning: a neural theory of discourse coherence
 
Replication of Patel, Gibson, Ratner, Besson & Holbomb (1998)
Replication of Patel, Gibson, Ratner, Besson & Holbomb (1998)Replication of Patel, Gibson, Ratner, Besson & Holbomb (1998)
Replication of Patel, Gibson, Ratner, Besson & Holbomb (1998)
 
A leslla learner's oral language development
A leslla learner's oral language developmentA leslla learner's oral language development
A leslla learner's oral language development
 
Fmri of bilingual brain atl reveals language independent representations
Fmri of bilingual brain atl reveals language independent representations Fmri of bilingual brain atl reveals language independent representations
Fmri of bilingual brain atl reveals language independent representations
 
Zw second exam
Zw second examZw second exam
Zw second exam
 
A Flexible Mapping Scheme For Discrete And Dimensional Emotion Representations
A Flexible Mapping Scheme For Discrete And Dimensional Emotion RepresentationsA Flexible Mapping Scheme For Discrete And Dimensional Emotion Representations
A Flexible Mapping Scheme For Discrete And Dimensional Emotion Representations
 
Language evolution and genomic imprinting
Language evolution and genomic imprintingLanguage evolution and genomic imprinting
Language evolution and genomic imprinting
 
いともたやすく行われるえげつない研究行為
いともたやすく行われるえげつない研究行為いともたやすく行われるえげつない研究行為
いともたやすく行われるえげつない研究行為
 
Deep learning for natural language embeddings
Deep learning for natural language embeddingsDeep learning for natural language embeddings
Deep learning for natural language embeddings
 
FisherPotsdamTalk
FisherPotsdamTalkFisherPotsdamTalk
FisherPotsdamTalk
 
Milo
MiloMilo
Milo
 
1. Elaborate on the coca-cocaine commodity value chain and the ill.docx
1. Elaborate on the coca-cocaine commodity value chain and the ill.docx1. Elaborate on the coca-cocaine commodity value chain and the ill.docx
1. Elaborate on the coca-cocaine commodity value chain and the ill.docx
 
Powerpoint davis parkins therapies in the school
Powerpoint davis parkins therapies in the schoolPowerpoint davis parkins therapies in the school
Powerpoint davis parkins therapies in the school
 
PearlEnverga2014InPress_MindPrintLang
PearlEnverga2014InPress_MindPrintLangPearlEnverga2014InPress_MindPrintLang
PearlEnverga2014InPress_MindPrintLang
 
Grounded Cognition: Grounding Language in Action
Grounded Cognition: Grounding Language in ActionGrounded Cognition: Grounding Language in Action
Grounded Cognition: Grounding Language in Action
 
Semantic_properties-BlackboxNLP
Semantic_properties-BlackboxNLPSemantic_properties-BlackboxNLP
Semantic_properties-BlackboxNLP
 
Cognition 131 (2014) 139–146Contents lists available at Scie
Cognition 131 (2014) 139–146Contents lists available at ScieCognition 131 (2014) 139–146Contents lists available at Scie
Cognition 131 (2014) 139–146Contents lists available at Scie
 
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
 
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
SETBP1 as a novel candidate gene for neurodevelopmental disorders of speech a...
 

Recently uploaded

Randomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNERandomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNE
University of Maribor
 
Applied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdfApplied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdf
University of Hertfordshire
 
Medical Orthopedic PowerPoint Templates.pptx
Medical Orthopedic PowerPoint Templates.pptxMedical Orthopedic PowerPoint Templates.pptx
Medical Orthopedic PowerPoint Templates.pptx
terusbelajar5
 
Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.
Aditi Bajpai
 
Bob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdfBob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdf
Texas Alliance of Groundwater Districts
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
Sérgio Sacani
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
PRIYANKA PATEL
 
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
vluwdy49
 
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdfTopic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
TinyAnderson
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills MN
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
David Osipyan
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
University of Maribor
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
yqqaatn0
 
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdfwaterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
LengamoLAppostilic
 
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
AbdullaAlAsif1
 
20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx
Sharon Liu
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
yqqaatn0
 
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
Sérgio Sacani
 
Compexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titrationCompexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titration
Vandana Devesh Sharma
 
The binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defectsThe binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defects
Sérgio Sacani
 

Recently uploaded (20)

Randomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNERandomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNE
 
Applied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdfApplied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdf
 
Medical Orthopedic PowerPoint Templates.pptx
Medical Orthopedic PowerPoint Templates.pptxMedical Orthopedic PowerPoint Templates.pptx
Medical Orthopedic PowerPoint Templates.pptx
 
Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.
 
Bob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdfBob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdf
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
 
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
 
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdfTopic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
 
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdfwaterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
 
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
 
20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
 
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
 
Compexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titrationCompexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titration
 
The binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defectsThe binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defects
 

Linguistic and embodied systems in conceptual processing: Role of individual differences

  • 1. Linguistic and embodied systems in conceptual processing: Role of individual differences Pablo Bernabeu Embodied Cognition Lab Supervisors: Dermot Lynott, Louise Connell Lancaster University, 29th Nov 2018
  • 2. Terminology Levels of processing: From Bernabeu et al. (2017)
  • 8. DOG PARADOX GRAB pet irony take walk text force cute surprise coffee Distributional semantics
  • 9. DOG PARADOX GRAB Latent Semantic Analysis (http:// lsa.colorado.edu) pet irony take walk text force cute surprise coffee Distributional semantics
  • 10. DOG PARADOX GRAB CORPUS: Populations (Louwerse & Zwaan, 2009) RT: animals, body, geography (Lund & Burgess, 1996) * BRAIN: Voxel-level neural activation predicted by distributional statistics (Mitchell et al., 2008) Latent Semantic Analysis (http:// lsa.colorado.edu) pet irony take walk text force cute surprise coffee Distributional semantics
  • 11. DOG PARADOX GRAB CORPUS: Populations (Louwerse & Zwaan, 2009) RT: animals, body, geography (Lund & Burgess, 1996) * BRAIN: Voxel-level neural activation predicted by distributional statistics (Mitchell et al., 2008) * Symbol-grounding problem Latent Semantic Analysis (http:// lsa.colorado.edu) pet irony take walk text force cute surprise coffee Distributional semantics
  • 12. DOG PARADOX GRAB CORPUS: Populations (Louwerse & Zwaan, 2009) RT: animals, body, geography (Lund & Burgess, 1996) * BRAIN: Voxel-level neural activation predicted by distributional statistics (Mitchell et al., 2008) * Symbol-grounding problem Latent Semantic Analysis (http:// lsa.colorado.edu) pet irony take walk text force cute surprise coffee Distributional semantics Personal & external EXPERIENCE
  • 13. DOG DOG PARADOX PARADOX GRAB GRAB CORPUS: Populations (Louwerse & Zwaan, 2009) RT: animals, body, geography (Lund & Burgess, 1996) * BRAIN: Voxel-level neural activation predicted by distributional statistics (Mitchell et al., 2008) * Symbol-grounding problem Latent Semantic Analysis (http:// lsa.colorado.edu) pet irony take walk text force cute surprise coffee Distributional semantics Embodied cognition Personal & external EXPERIENCE
  • 14. DOG DOG PARADOX PARADOX GRAB GRAB CORPUS: Populations (Louwerse & Zwaan, 2009) RT: animals, body, geography (Lund & Burgess, 1996) * BRAIN: Voxel-level neural activation predicted by distributional statistics (Mitchell et al., 2008) * Symbol-grounding problem Latent Semantic Analysis (http:// lsa.colorado.edu) EMOTIONAL Kousta et al. (2011) * YES/NO MOTOR Willems et al. (2011) SENSORY Hald et al. (2011) Simmons et al. (2007) pet irony take walk text force cute surprise coffee Distributional semantics Embodied cognition ‘Green’ Personal & external EXPERIENCE
  • 15. DOG DOG PARADOX PARADOX GRAB GRAB CORPUS: Populations (Louwerse & Zwaan, 2009) RT: animals, body, geography (Lund & Burgess, 1996) * BRAIN: Voxel-level neural activation predicted by distributional statistics (Mitchell et al., 2008) * Symbol-grounding problem Latent Semantic Analysis (http:// lsa.colorado.edu) EMOTIONAL Kousta et al. (2011) * YES/NO MOTOR Willems et al. (2011) SENSORY Hald et al. (2011) Simmons et al. (2007) (Hickok, 2014; Willems & Francken, 2012; Mahon & Caramazza, 2008) pet irony take walk text force cute surprise coffee Distributional semantics Embodied cognition ‘Green’ * Causality question Personal & external EXPERIENCE
  • 16. From Barsalou et al. (2008)
  • 17. From Barsalou et al. (2008) Language
  • 18. From Barsalou et al. (2008) Language Simulation
  • 19. Zwaan, Stanfield, and Yaxley (2002) Sentence-picture verification Object orientation effect (classic embodiment effect) Group replication (Psychological Science Accelerator)
  • 20. Zwaan, Stanfield, and Yaxley (2002) Sentence-picture verification He saw the eagle in the sky Object orientation effect Group replication (Psychological Science Accelerator)
  • 21. Object orientation effect Group replication (Psychological Science Accelerator) Zwaan, Stanfield, and Yaxley (2002) Sentence-picture verification He saw the eagle in the sky
  • 22. Object orientation effect Group replication (Psychological Science Accelerator) Zwaan, Stanfield, and Yaxley (2002) Sentence-picture verification: ‘Was this object in the sentence?’ [congruent]
  • 23. Object orientation effect Group replication (Psychological Science Accelerator) Zwaan, Stanfield, and Yaxley (2002) Sentence-picture verification: ‘Was this object in the sentence?’ [INcongruent]
  • 24. Object orientation effect Group replication (Psychological Science Accelerator) Zwaan, Stanfield, and Yaxley (2002) Sentence-picture verification: ‘Was this object in the sentence?’ [congruent] He saw the eagle in the sky [INcongruent] • ORIGINAL RESULTS: Faster responses for congruent trials
  • 25. Object orientation effect Group replication (Psychological Science Accelerator) Zwaan, Stanfield, and Yaxley (2002) replicated across 14 languages (NEng = 1,900) Sentence-picture verification: ‘Was this object in the sentence?’ [congruent] He saw the eagle in the sky [INcongruent] • ORIGINAL RESULTS: Faster responses for congruent trials. • Interpretation: Mental simulation of orientation while reading
  • 26. Object orientation effect Group replication (Psychological Science Accelerator) Zwaan, Stanfield, and Yaxley (2002) replicated across 14 languages (NEng = 1,900) Sentence-picture verification: ‘Was this object in the sentence?’ [congruent] He saw the eagle in the sky [INcongruent] • ORIGINAL RESULTS: Faster responses for congruent trials. • Interpretation: Mental simulation of orientation while reading • ADDITION: Individual differences in spatial cognition, particularly mental rotation
  • 27. Object orientation effect Group replication (Psychological Science Accelerator) Zwaan, Stanfield, and Yaxley (2002) replicated across 14 languages (NEng = 1,900) Sentence-picture verification: ‘Was this object in the sentence?’ [congruent] He saw the eagle in the sky [INcongruent] • ORIGINAL RESULTS: Faster responses for congruent trials. • Interpretation: Mental simulation of orientation while reading • ADDITION: Individual differences in spatial cognition, particularly mental rotation
  • 28. Object orientation effect Group replication (Psychological Science Accelerator) Zwaan, Stanfield, and Yaxley (2002) replicated across 14 languages (NEng = 1,900) Sentence-picture verification: ‘Was this object in the sentence?’ [congruent] He saw the eagle in the sky [INcongruent] • ORIGINAL RESULTS: Faster responses for congruent trials. • Interpretation: Mental simulation of orientation while reading • ADDITION: Individual differences in spatial cognition, particularly mental rotation From mercercognitivepsychology.pbworks.com
  • 29. Psychological Science Accelerator • Openly sourced projects, from pre-registration through testing etc. • Aims: more robust analysis, super-sized samples • Open for publishing project or just collaborating • Materials and procedure created by lead lab, used by all others (translated to each language)
  • 30. DOG DOG PARADOX PARADOX GRAB GRAB CORPUS: Populations (Louwerse & Zwaan, 2009) RT: animals, body, geogra. (Lund & Burgess, 1996) * BRAIN: Voxel-level neural activation predicted by distributional statistics (Mitchell et al, 2008) ! Symbol-grounding problem Latent Semantic Analysis (http:// lsa.colorado.edu) EMOTIONAL Kousta et al (2011) * YES/NO MOTOR Willems et al (2011) SENSORY Hald et al (2011) Simmons et al (2007) (Hickok, 2014; Willems & Francken, 2012; Mahon & Caramazza, 2008) pet irony take walk text force cute surprise coffee Distributional semantics Embodied cognition ‘Green’ ! Causality question
  • 31. DOG DOG PARADOX PARADOX GRAB GRAB CORPUS: Populations (Louwerse & Zwaan, 2009) RT: animals, body, geogra. (Lund & Burgess, 1996) * BRAIN: Voxel-level neural activation predicted by distributional statistics (Mitchell et al, 2008) ! Symbol-grounding problem Latent Semantic Analysis (http:// lsa.colorado.edu) EMOTIONAL Kousta et al (2011) * YES/NO MOTOR Willems et al (2011) SENSORY Hald et al (2011) Simmons et al (2007) (Hickok, 2014; Willems & Francken, 2012; Mahon & Caramazza, 2008) pet irony take walk text force cute surprise coffee Distributional semantics Embodied cognition ‘Green’ ! Causality question DOG DOG PARADOX PARADOX GRAB GRAB
  • 32. Linguistic and embodied interplay • Linguistic co-occurrences processed before perceptual relationships Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013)
  • 33. • Linguistic co-occurrences processed before perceptual relationships Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013) • Depth of semantics: Language enough for shallow tasks, whereas simulation necessary for deeper tasks Sensibility judgment vs interpretation (Connell & Lynott, 2013) Linguistic and embodied interplay
  • 34. • Linguistic co-occurrences processed before perceptual relationships Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013) • Depth of semantics: Language enough for shallow tasks, whereas simulation necessary for deeper tasks Sensibility judgment vs interpretation (Connell & Lynott, 2013) • Visualisers & verbalisers (Dils & Boroditsky, 2010) Linguistic and embodied interplay
  • 35. • Linguistic co-occurrences processed before perceptual relationships Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013) • Depth of semantics: Language enough for shallow tasks, whereas simulation necessary for deeper tasks Sensibility judgment vs interpretation (Connell & Lynott, 2013) • Visualisers & verbalisers (Dils & Boroditsky, 2010) • Motor expertise (Beilock et al., 2008) • Linguistic expertise (Pexman & Yap, 2018) Linguistic and embodied interplay
  • 36. Linguistic and embodied interplay • Linguistic co-occurrences processed before perceptual relationships Production (Santos et al., 2011) & comprehension (Louwerse & Connell, 2013) • Depth of semantics: Language enough for shallow tasks, whereas simulation necessary for deeper tasks Sensibility judgment vs interpretation (Connell & Lynott, 2013) • Visualisers & verbalisers (Dils & Boroditsky, 2010) • Motor expertise (Beilock et al., 2008) • Linguistic expertise (Pexman & Yap, 2018) • Gender (Hutchinson & Louwerse, 2013)
  • 37. 5 modalities 3 Principal Components - Louwerse and Connell (2011)
  • 38. Conceptual modality switch effect Toll for shifting mod-specific systems. Critical manipulation: cross-trial. Property verification: ‘Typical?’ Lemony Aftertaste  YES/NO [perceptual modality match] Juicy Apple  YES/NO Glossy Screen  YES/NO [perceptual modality mismatch] Cracking Leaves  YES/NO [Transitions covert; bold added to targets] RT: Pecher et al. (2003); Lynott & Connell (2009) ERPs: Collins et al. (2011); Hald et al. (2011); Hald et al. (2013); Bernabeu et al. (2017) 5 modalities 3 Principal Components - Louwerse and Connell (2011)
  • 39. Conceptual modality switch effect Toll for shifting mod-specific systems. Critical manipulation: cross-trial. Property verification: ‘Typical?’ Lemony Aftertaste  YES/NO [perceptual modality match] Juicy Apple  YES/NO Glossy Screen  YES/NO [perceptual modality mismatch] Cracking Leaves  YES/NO [Transitions covert; bold added to targets] RT: Pecher et al. (2003); Lynott & Connell (2009) ERPs: Collins et al. (2011); Hald et al. (2011); Hald et al. (2013); Bernabeu et al. (2017) Interplay of systems (Louwerse & Connell, 2011) Linguistic and Embodied factor loadings from corpus used to predict switching costs RESULTS: Linguistic shifts  + RT Embodied shifts  – RT (R2 = .70) Two systems: speed vs detail (cf. Ferreira & Patson, 2007) 5 modalities 3 Principal Components: Visuohaptic, Olfactory-gustatory, Auditory - Louwerse and Connell (2011)
  • 40. Task and stimulus variables extensively probed;
  • 41. Task and stimulus variables extensively probed; turn to individual differences.
  • 42. Task and stimulus variables extensively probed; turn to individual differences. Summing up: current degrees of knowledge
  • 43. Task and stimulus variables extensively probed; turn to individual differences. Summing up: current degrees of knowledge
  • 44. Task and stimulus variables extensively probed; turn to individual differences. Summing up: current degrees of knowledge • General patterns in linguistic and embodied system
  • 45. Task and stimulus variables extensively probed; turn to individual differences. Summing up: current degrees of knowledge • General patterns in linguistic and embodied system • Individual variability
  • 46. Task and stimulus variables extensively probed; turn to individual differences. Summing up: current degrees of knowledge • General patterns in linguistic and embodied system • Individual variability • Interaction between individual differences and both systems
  • 48. Individual differences Influence of individuals’ linguistic and perceptual traits on the interplay between linguistic and embodied systems.
  • 49. Individual differences Influence of individuals’ linguistic and perceptual traits on the interplay between linguistic and embodied systems. • Process of interest: post-lexical conceptual processing
  • 50. Individual differences Influence of individuals’ linguistic and perceptual traits on the interplay between linguistic and embodied systems. • Process of interest: post-lexical conceptual processing • Paradigms: reading comprehension and perceptual simulation • Tasks: shallower and deeper semantic tasks (sensibility, concreteness, interpretation judgments)
  • 51. Individual differences Influence of individuals’ linguistic and perceptual traits on the interplay between linguistic and embodied systems. • Process of interest: post-lexical conceptual processing • Paradigms: reading comprehension and perceptual simulation • Tasks: shallower and deeper semantic tasks (sensibility, concreteness, interpretation judgments) • Task and stimulus variables alongside individual differences
  • 52. Individual differences Influence of individuals’ linguistic and perceptual traits on the interplay between linguistic and embodied systems. • Process of interest: post-lexical conceptual processing • Paradigms: reading comprehension and perceptual simulation • Tasks: shallower and deeper semantic tasks (sensibility, concreteness, interpretation judgments) • Task and stimulus variables alongside individual differences • Individual differences collected after the core experimental tasks
  • 53. Individual differences Influence of individuals’ linguistic and perceptual traits on the interplay between linguistic and embodied systems. • Process of interest: post-lexical conceptual processing • Paradigms: reading comprehension and perceptual simulation • Tasks: shallower and deeper semantic tasks (sensibility, concreteness, interpretation judgments) • Task and stimulus variables alongside individual differences • Individual differences collected after the core experimental tasks • Linguistic: lexical decision, vocabulary size, reading and writing habits…
  • 54. Individual differences Influence of individuals’ linguistic and perceptual traits on the interplay between linguistic and embodied systems. • Process of interest: post-lexical conceptual processing • Paradigms: reading comprehension and perceptual simulation • Tasks: shallower and deeper semantic tasks (sensibility, concreteness, interpretation judgments) • Task and stimulus variables alongside individual differences • Individual differences collected after the core experimental tasks • Linguistic: lexical decision, vocabulary size, reading and writing habits… • Sensory, motor, affective: spatial cognitive skills, exercising habits…
  • 55. Individual differences Influence of individuals’ linguistic and perceptual traits on the interplay between linguistic and embodied systems. • Process of interest: post-lexical conceptual processing • Paradigms: reading comprehension and perceptual simulation • Tasks: shallower and deeper semantic tasks (sensibility, concreteness, interpretation judgments) • Task and stimulus variables alongside individual differences • Individual differences collected after the core experimental tasks • Linguistic: lexical decision, vocabulary size, reading and writing habits… • Sensory, motor, affective: spatial cognitive skills, exercising habits… • General cognitive: cognitive control (e.g., AX-CPT task), IQ…
  • 56. Literature-based hypotheses Linguistic individual differences: Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018)
  • 57. Literature-based hypotheses Linguistic individual differences: Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018) Sensory, motor, affective individual differences: Higher skill  More perceptual simulation in semantic tasks (Dils & Boroditsky, 2010)
  • 58. Literature-based hypotheses Linguistic individual differences: Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018) Sensory, motor, affective individual differences: Higher skill  More perceptual simulation in semantic tasks (Dils & Boroditsky, 2010) Time
  • 59. Literature-based hypotheses Linguistic individual differences: Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018) Sensory, motor, affective individual differences: Higher skill  More perceptual simulation in semantic tasks (Dils & Boroditsky, 2010) Time
  • 60. Literature-based hypotheses Linguistic individual differences: Higher skill  Faster RT in semantic tasks (Pexman & Yap, 2018) Sensory, motor, affective individual differences: Higher skill  More perceptual simulation in semantic tasks (Dils & Boroditsky, 2010) Simulation Time
  • 61. Project plan Phase 1: Individual variability and systems compatibility [On Internet] Essential: Relative analysis across participants and conditions. Validates off-line measurement.
  • 62. Project plan Phase 1: Individual variability and systems compatibility [On Internet] Essential: Relative analysis across participants and conditions. Validates off-line measurement. Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan et al., 2002)—matching advantage.
  • 63. Project plan Phase 1: Individual variability and systems compatibility [On Internet] Essential: Relative analysis across participants and conditions. Validates off-line measurement. Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan et al., 2002)—matching advantage. Add individual differences analysis.
  • 64. Hypotheses 1.1 MAIN EFFECT: Replication of original matching advantage INTERACTION: Greater perceptual experience  Larger matching advantage
  • 65. Project plan Phase 1: Individual variability and systems compatibility [On Internet] Essential: Relative analysis across participants and conditions. Validates off-line measurement. - Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan et al., 2002)—matching advantage? Add individual differences analysis. - Experiment 1.2: Participants generate properties for a concept (Santos et al., 2011)—linguistic relations earlier, perceptual relations later?
  • 66. Project plan Phase 1: Individual variability and systems compatibility [On Internet] Essential: Relative analysis across participants and conditions. Validates off-line measurement. - Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan et al., 2002)—matching advantage? Add individual differences analysis. - Experiment 1.2: Participants generate properties for a concept (Santos et al., 2011)—linguistic relations earlier, perceptual relations later? + Ind. Diffs.
  • 67. Hypotheses 1.2 Replication of original Time – System interaction: Linguistic relations produced earlier, perceptual relations later System – Individual differences interaction: • Greater linguistic experience  More linguistic relations throughout time course • Greater perceptual experience  More perceptual relations throughout time course
  • 68. Project plan Phase 1: Individual variability and systems compatibility [On Internet] Essential: Relative analysis across participants and conditions. Validates off-line measurement. - Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan et al., 2002)—matching advantage? Add individual differences analysis. - Experiment 1.2: Participants generate properties for a concept (Santos et al., 2011)—linguistic relations earlier, perceptual relations later? + Ind. Diffs. Phase 2: Causality of each system and individual differences [In lab] Essential: Online measurement as semantic processing unfolds.
  • 69. Project plan Phase 1: Individual variability and systems compatibility [On Internet] Essential: Relative analysis across participants and conditions. Validates off-line measurement. - Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan et al., 2002)—matching advantage? Add individual differences analysis. - Experiment 1.2: Participants generate properties for a concept (Santos et al., 2011)—linguistic relations earlier, perceptual relations later? + Ind. Diffs. Phase 2: Causality of each system and individual differences [In lab] Essential: Online measurement as semantic processing unfolds. - Experiment 2.1. Tasks: (1) Is this an actual word? | (2) How concrete is it? TMS: Linguistic and perceptual resources briefly impaired right during task, tapping into systems’ functional roles (Devlin et al., 2003; Vukovic et al., 2017). Semantics impaired?
  • 70. Project plan Phase 1: Individual variability and systems compatibility [On Internet] Essential: Relative analysis across participants and conditions. Validates off-line measurement. - Experiment 1.1: Akin to sentence-picture verification paradigm (above; Zwaan et al., 2002)—matching advantage? Add individual differences analysis. - Experiment 1.2: Participants generate properties for a concept (Santos et al., 2011)—linguistic relations earlier, perceptual relations later? + Ind. Diffs. Phase 2: Causality of each system and individual differences [In lab] Essential: Online measurement as semantic processing unfolds. - Experiment 2.1. Tasks: (1) Is this an actual word? | (2) How concrete is it? TMS: Linguistic and perceptual resources briefly impaired right during task, tapping into systems’ functional roles (Devlin et al., 2003; Vukovic et al., 2017). Semantics impaired? + Interaction with individual differences analysed.
  • 71. Hypotheses 2.1 Replication of original System – Task interaction: Reducing motor resources impairs semantic but not lexical processing System – Task – Individual differences interaction: • Reducing linguistic resources impairs semantic processing for verbalisers but not for others.
  • 72. Barsalou, Santos, Simmons, & Wilson (2008) Language and simulation in conceptual processing… Bernabeu, Willems, & Louwerse (2017) Modality switch effects emerge early and increase… Collins, Pecher, Zeelenberg, & Coulson (2011) Modality Switching in a Property Verification … Connell & Lynott (2013) Flexible and fast: Linguistic shortcut affects both shallow and deep … Devlin, Matthews, & Rushworth (2003) Semantic processing in the left inferior cortex: a … Dils & Boroditsky (2010) Visual motion aftereffect from understanding language. Hald, Marshall, Janssen, & Garnham (2011) Switching Modalities in A Sentence Verification … Hickok (2014) The myth of mirror neurons: The real neuroscience of communication and ... Louwerse & Connell (2009) A taste of words: Linguistic context and perceptual simulation … Louwerse & Zwaan (2009) Language encodes geographical information. Lund & Burgess (1996) Producing high-dimensional semantic spaces from lexical cooccurrence. Lynott & Connell (2009) Modality exclusivity norms for 423 object properties. References (1/2)
  • 73. Mahon & Caramazza (2008) A critical look at the embodied cognition hypothesis and a new … Mitchell, Shinkareva, Carlson, Chang, Malave, … Mason (2008) Predicting human brain … Pecher, Zeelenberg, & Barsalou (2003) Verifying different-modality properties for concepts … Pulvermuller (2013) How neurons make meaning: brain mechanisms for embodied and abstract… Santos, Chaigneau, Simmons,, & Barsalou (2011) Property generation reflects word association… Simmons, Hamann, Harenski, Hu, & Barsalou (2008) fMRI evidence for word association and … Simmons, Ramjee, Beauchamp, McRae, Martin, & Barsalou (2007) A common neural substrate … Vukovic, Feurra, Shpektor, Myachykov, & Shtyrov (2017) Primary motor cortex functionally … Willems & Francken (2012) Embodied cognition: taking the next step. Willems, Labruna, D’Esposito, Ivry, & Casasanto (2011) A functional role for the motor system … Zwaan, Stanfield, & Yaxley (2002) Language Comprehenders Mentally Represent the Shapes of… References (2/2)