Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Semantic Compositional Networks for Visual Captioning

17 views

Published on

Semantic Compositional Networks for Visual Captioning

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Semantic Compositional Networks for Visual Captioning

  1. 1. Semantic Compositional Networks for Visual Captioning CVPR 2016
  2. 2. RNN for Image Captioning
  3. 3. Related Works • Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
  4. 4. Related Works • What value do explicit high level concepts have in vision to language problems?
  5. 5. Related Works • Image Captioning with Semantic Attention
  6. 6. Main Idea
  7. 7. Framework
  8. 8. The Model W(s) and U(s) are ensembles of tag-dependent weight matrices
  9. 9. The Problem – Complexity of Model • K x RNNs v.s. 1 x RNN
  10. 10. How to reduce complexity

×