SlideShare a Scribd company logo
Associating Gaze Information with Human Reading Strategies
Gaze behavior NLP technologies
Reading strategies
Text optimization
i o n s t h r e a t e n i n g t h e i r v e r y e x i s t e n c e ?
● ● ● ●
skipped
・Clues: word surface, POS, word length, frequency, etc.
・Prediction with 0.95 similarity to observed data
(for distribution across readers)
・Regardless of individuality / unstableness
 general reading strategy
: saccade●: fixation
Previous label
: inputSentence The man will have to
: labelFixation
/ skip
:
POS DT
The
Length 0.07
-Trigram
(2,3)
NN
man
0.07
-
(2,3)
MD
will
0.06
0.38
(3,3)
VB
have
0.06
0.48
(3,3)
TO
to
0.08
0.61
(3,3)Screen
-2 -1 0 1 2
:Position
Features of input sequence
:Surprisal
:
:
Word
Optimization of comma-placement
Prediction of word fixations/skips by readers
・For smoothing human reading Linguistic FeaturesCRF model
CRF model-based Comma Predictor
Gaze FeaturesHuman Annotation
Rule-based Comma Filter
+
+
Comma Distribution for Readability
Input (Comma-less) Text

More Related Content

More from Yoshinari Fujinuma

Yokoさん
YokoさんYokoさん
Yokoさん
Yoshinari Fujinuma
 
Panotさん
PanotさんPanotさん
Panotさん
Yoshinari Fujinuma
 
研究室紹介用ポスター
研究室紹介用ポスター研究室紹介用ポスター
研究室紹介用ポスターYoshinari Fujinuma
 
Minhさん
MinhさんMinhさん
Minhさん
Yoshinari Fujinuma
 
Pascualさん
PascualさんPascualさん
Pascualさん
Yoshinari Fujinuma
 
Pontusさん
PontusさんPontusさん
Pontusさん
Yoshinari Fujinuma
 
Tweet Recommendation with Graph Co-Ranking
Tweet Recommendation with Graph Co-RankingTweet Recommendation with Graph Co-Ranking
Tweet Recommendation with Graph Co-Ranking
Yoshinari Fujinuma
 

More from Yoshinari Fujinuma (10)

冨田さん
冨田さん冨田さん
冨田さん
 
藤沼さん
藤沼さん藤沼さん
藤沼さん
 
Yokoさん
YokoさんYokoさん
Yokoさん
 
Panotさん
PanotさんPanotさん
Panotさん
 
大橋さん
大橋さん大橋さん
大橋さん
 
研究室紹介用ポスター
研究室紹介用ポスター研究室紹介用ポスター
研究室紹介用ポスター
 
Minhさん
MinhさんMinhさん
Minhさん
 
Pascualさん
PascualさんPascualさん
Pascualさん
 
Pontusさん
PontusさんPontusさん
Pontusさん
 
Tweet Recommendation with Graph Co-Ranking
Tweet Recommendation with Graph Co-RankingTweet Recommendation with Graph Co-Ranking
Tweet Recommendation with Graph Co-Ranking
 

hara-san's research

  • 1. Associating Gaze Information with Human Reading Strategies Gaze behavior NLP technologies Reading strategies Text optimization i o n s t h r e a t e n i n g t h e i r v e r y e x i s t e n c e ? ● ● ● ● skipped ・Clues: word surface, POS, word length, frequency, etc. ・Prediction with 0.95 similarity to observed data (for distribution across readers) ・Regardless of individuality / unstableness  general reading strategy : saccade●: fixation Previous label : inputSentence The man will have to : labelFixation / skip : POS DT The Length 0.07 -Trigram (2,3) NN man 0.07 - (2,3) MD will 0.06 0.38 (3,3) VB have 0.06 0.48 (3,3) TO to 0.08 0.61 (3,3)Screen -2 -1 0 1 2 :Position Features of input sequence :Surprisal : : Word Optimization of comma-placement Prediction of word fixations/skips by readers ・For smoothing human reading Linguistic FeaturesCRF model CRF model-based Comma Predictor Gaze FeaturesHuman Annotation Rule-based Comma Filter + + Comma Distribution for Readability Input (Comma-less) Text