Brain signal seminar

1. The Journal of Neuroscience
Predictive Brain Mechanisms in Sound-to-
Meaning Mapping during Speech
Processing
-
Bingjiang Lyu, Jianqiao Ge, Zhendong Niu, Li Hai Tan, Jia-Hong Gao
Aug 2016
NAFIZ ISHTIAQUE AHMED
LITERATURE REVIEW
UOU – UNIVERSITY OF ULSAN

2. Abstract (초록)
Understanding spoken language relies deeply on the
contextual information.
However, how expectations influence this efficient
mapping on the brain is still unclear.

3. Abstract
This study found that, the left anterior superior temporal
gyrus is responsible for expectations related activations.
Where The inferior frontal gyrus (IFG) process semantic
prediction of spoken words.

4. Introduction
The human brain responds to speech both to recognition
of individual words and the contextual information within
100 –200 ms.

5. Introduction
Violations of Phrase–semantic expectation can be used to
address this question.
Like “班门弄斧” would be highly predicted by a native
Mandarin Chinese speaker after hearing the first portion
“班门”.
Therefore, by replacing ‘弄斧’ (last part) can induced
violation in native Mandarin Chinese speakers word
maping.

6. Introduction
This unexpected speech would more strongly engage with
brain functioning than expected speech.
To test this hypothesis, fMRI was used to record the brain
activity .

7. Materials and Methods
Participants –
38 native Mandarin Chinese speakers.
Age 21–28 years
mean 24.2,
15 male

8. Materials and Methods
Three types of auditory stimuli
1. expected phrases (EPs),
2. unexpected phrases (UPs),
3. time-reversed phrases (TPs),
Eps (expected phrases) are “耳边风” (meaning unheeded
advice and “班门弄斧” (meaning showing one’s slight skill
before an expert),

9. Materials and Methods
 Unexpected phrases (UPs)
Thus, the UP stimuli “鹤立之鉴” was the rearranged combination of
the first two characters of the idiom “鹤立鸡群” and the last two
characters of the idiom “前车之鉴” .
That violated the originally embedded phonological– semantic
expectation.

10. Materials and Methods
The stimuli of EPs and UPs were recorded digitally in a
soundproof studio by one male and one female native
Chinese speaker.
There were 84 auditory stimuli .
stimuli length (730 –1007 ms)

11. Materials and Methods
 Postscan behavioral dictation test
4 months later participant were presented those word in a random
sequence.
Subjects were asked to write down the Chinese characters of the phrases
they heard.
The dictation results were classified as:
(1) correct;
(2) phonologically correct; and
(3) incorrect.

12. Materials and Methods
 Univariate Analysis
Univariate Analysis identify brain regions that showed significantly
greater activities in response to different phrases.
 Multivariate pattern analysis
Multivariate pattern analysis (MVPA) identify the brain regions that
consistently demonstrated a distinct spatial pattern of activity for
one condition relative to another.
 Dynamic Causal Modeling
Dynamic causal modeling analysis how activity in one brain area is
affected by the other areas through calculating the effective
connectivity.

13. IFGtr

14. Result
FIG :: Univariate shows Brain Activation Strength in Different Contrasts

15. Result
FIG :: MVPA Shows Informative Regions Identified

16. Result
FIG:: psychophysiological interaction (PPI) analysis

17. Result
FIG :: resulting path way mapping

18. Results of the analysis.
Left anterior STG is supporting and facilitating quick
sound-to-meaning mapping.
Inter-connected interaction between left aSTG, STP, and
IFG in the brain pathways makes the mapping for sound to
meaning conversion.

19. Thank You
Nafiz Ishtiaque Ahmed
cse.ishtiaque@gmail.com
@Nafiz_Ishtiaque