Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Real-World Objects Interaction with Unconstrained Spoken Language Instructions

218 views

Published on

Invited talk at IROS2018 Workshop on Language and Robotics
http://iros2018.emergent-symbol.systems/program
Tittle: Real-World Objects Interaction with Unconstrained Spoken Language Instructions
Speaker: Kuniyuki Takahashi
Date: 1st October, 2018

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Real-World Objects Interaction with Unconstrained Spoken Language Instructions

  1. 1. Twitter: @Georgekt0927 Slide is available ↑ 1
  2. 2. < Career > - 2007.4 - 2017.3 - 2015.2 - 2016.3, 2017.2-2017.3 Technical University of Munich, Germany Twitter: @Georgekt0927 ↑ Slide is available 2
  3. 3. Preferred Networks (PFN) • • • • • Deep learning Industrial IoT Manufacturing Automotive Healthcare 3
  4. 4. credits: gpu by Misha Petrishchev from the Noun Project Network Switch by Creaticca Creative Agency from the Noun Project 4
  5. 5. Challenges in current robotics Source http://www.appraccel.com/blog/2017/1/4/freeing-up-humans-to-do-meaningful-work … Source http://toyota.jp/mirai/grade/Source http://toyota.jp/mirai/grade/ 5
  6. 6. New Area in Robotics Source http://www.appraccel.com/blog/2017/1/4/freeing-up-humans-to-do-meaningful-work 6
  7. 7. New Area in Robotics 7
  8. 8. Today’s topics 8
  9. 9. ● Previous works ● (e.g. [Yamada+ 2017]) ● [Paul+ 2017] [Shridhar+ 2017] 9
  10. 10. ● ● 10
  11. 11. ! " ! " 11
  12. 12. 12 1x 12
  13. 13. 13 1x 13
  14. 14. ! 14
  15. 15. ● ● ! Margin 15
  16. 16. About 100 types of commodities English 91k instructions, Japanese 7.7k instructions (At least three people give sentences to each object by crowdsourcing) 16
  17. 17. Our dataset 17
  18. 18. ● ● 18
  19. 19. ● ● ● 19
  20. 20. 20 1x 20
  21. 21. ● ● 21
  22. 22. ● ● 22
  23. 23. ● ● ● 92.7% in English, and 84.1% in Japanese 23
  24. 24. ! How to judge the texture of the object from the image? Today’s topics 24
  25. 25. 25
  26. 26. 26
  27. 27. 27
  28. 28. 28
  29. 29. 29
  30. 30. 30
  31. 31. 31
  32. 32. 33
  33. 33. 34 24 25 23
  34. 34. ? 35
  35. 35. 36
  36. 36. 37
  37. 37. Summary Twitter: @Georgekt0927 ↑ Slide is available 38

×