Tweet2vec learning tweet_embeddings_using_characterlevel_cnn_lstm_encoder_decoder for UEC AI Community

1. Tweet2Vec: Learning Tweet
Embeddings Using
Character-level CNN-LSTM
Encoder-Decoder
@UEC AI Student Community

3. contents
• question
• points
• architecture
• components
• experiments
• summary

4. question
tweet

5. points
•
• decoder

6. architecture

7. components
• temporal convolution
• temporal max pooling
• lstm encoder
• lstm decoders

8. convolutional layer
http://deeplearning.stanford.edu/wiki/index.php/Feature_extraction_using_convolution

9. temporal convolution layer
• convolutional layer kernel l * n
• n-gram

10. max pooling

11. temporal max pooling
• temporal convolutional layer l * n max
pooling

12. lstm encoder
• cnn

13. lstm decoders
• encoder time step
decode
• decode softmax
tweet loss

14. architecture summary
1. CNN n-gram
2. LSTM encoder tweet
3. tweet

15. experiments
• tweet2vec

16. paraphrase and semantic
similarity
• tweet
•
• tweet Tweet2Vec
logistic regression

17. Sentiment Classification
• tweet
• positive, negative, neutral
• tweet logistic regression

18. summary
• char-CNN noisy
•
•