Shuai Tang - 2017 - Rethinking Skip-thought: A Neighborhood Based Approach
•
0 likes•85 views
RepLearn 2017 - W17-2625
![Rethinking Skip-thought:
A Neighborhood Based Approach
Shuai Tang, Hailin Jin, Chen Fang, Zhaowen Wang, Virginia R. de Sa
Skip-thought Skip-thought Neighbor
Similar
Similar
Worse
1 Sharing parameters
2
Incorporating Auto-
encoder
Similar
3
Increasing the Number
of Neighbors
One Target
Faster & Equally Accurate
4
5
Normalizing
Representation
Training:
Testing:
1 2 3 4 5
Unsupervised Training: BookCorpus
Evaluation: SICK, MSRP, TREC, MR, CR, SUBJ, MPQA.
Generated Sentences:
References:
[1] Kiros, Ryan, et al. "Skip-thought vectors.”
[2] Zhu, Yukun, et al. "Aligning books and movies: Towards story-like visual
explanations by watching movies and reading books.”
[3] Tang, Shuai, et al. "Trimming and Improving Skip-thought Vectors."
Sentence Retrieval:
Acknowledgements:
Adobe Research & NVIDIA
NSF IIS 1528214 & NSF SMA 1041755
!" #"
!"$%
!"&%
encoder
!" #"
!"$%
!"&%
encoder decoderself
!"
!" #"
!"$%
!"&%
encoder
!"$'
!"&'
!" #"
!"$%
!"&%
encoder decoder
!"
!" #"
!"$%
!"&%
encoder
!" #"
encoder decoder
!"$%
!" #"
!"$%
!"&%
encoder
!" #"
encoder normalization
#"
$
“ i do n’t want to talk about it . ”
“ i ’m not going to let you drive me home . ”
“ hey , what ’s wrong ? ”
i ’m not sure how i feel about him .
i was n’t going to be able to get to the beach .
he was n’t even looking at her .
“ i guess you ’re right . ”
i wish i had a better answer to that question .
i wish i knew the answer .
i only wish i had an answer .
my phone buzzed and i awoke from my trance .
i flipped my phone shut and drifted off to sleep .
i grabbed my phone and with groggy eyes , shut off the alarm .
i threw my bag on my bed and took off my shoes .
i sat down on my own bed and kicked off my shoes .
i fell in bed without bothering to remove my shoes .
i kept my eyes on the shadowed road , watching my every step .
i kept my eyes at my feet and up ahead on the trail .
i kept on walking , examining what i could out of the corner of my eye .](https://image.slidesharecdn.com/w17-2625-170918170008/85/Shuai-Tang-2017-Rethinking-Skip-thought-A-Neighborhood-Based-Approach-1-320.jpg)
Recommended
Recommended
More Related Content
Similar to Shuai Tang - 2017 - Rethinking Skip-thought: A Neighborhood Based Approach
Similar to Shuai Tang - 2017 - Rethinking Skip-thought: A Neighborhood Based Approach (6)
More from Association for Computational Linguistics
More from Association for Computational Linguistics (20)
Recently uploaded
Recently uploaded (20)
Shuai Tang - 2017 - Rethinking Skip-thought: A Neighborhood Based Approach
- 1. Rethinking Skip-thought: A Neighborhood Based Approach Shuai Tang, Hailin Jin, Chen Fang, Zhaowen Wang, Virginia R. de Sa Skip-thought Skip-thought Neighbor Similar Similar Worse 1 Sharing parameters 2 Incorporating Auto- encoder Similar 3 Increasing the Number of Neighbors One Target Faster & Equally Accurate 4 5 Normalizing Representation Training: Testing: 1 2 3 4 5 Unsupervised Training: BookCorpus Evaluation: SICK, MSRP, TREC, MR, CR, SUBJ, MPQA. Generated Sentences: References: [1] Kiros, Ryan, et al. "Skip-thought vectors.” [2] Zhu, Yukun, et al. "Aligning books and movies: Towards story-like visual explanations by watching movies and reading books.” [3] Tang, Shuai, et al. "Trimming and Improving Skip-thought Vectors." Sentence Retrieval: Acknowledgements: Adobe Research & NVIDIA NSF IIS 1528214 & NSF SMA 1041755 !" #" !"$% !"&% encoder !" #" !"$% !"&% encoder decoderself !" !" #" !"$% !"&% encoder !"$' !"&' !" #" !"$% !"&% encoder decoder !" !" #" !"$% !"&% encoder !" #" encoder decoder !"$% !" #" !"$% !"&% encoder !" #" encoder normalization #" $ “ i do n’t want to talk about it . ” “ i ’m not going to let you drive me home . ” “ hey , what ’s wrong ? ” i ’m not sure how i feel about him . i was n’t going to be able to get to the beach . he was n’t even looking at her . “ i guess you ’re right . ” i wish i had a better answer to that question . i wish i knew the answer . i only wish i had an answer . my phone buzzed and i awoke from my trance . i flipped my phone shut and drifted off to sleep . i grabbed my phone and with groggy eyes , shut off the alarm . i threw my bag on my bed and took off my shoes . i sat down on my own bed and kicked off my shoes . i fell in bed without bothering to remove my shoes . i kept my eyes on the shadowed road , watching my every step . i kept my eyes at my feet and up ahead on the trail . i kept on walking , examining what i could out of the corner of my eye .