講演者: 竹内彰一（ステアラボ副所長）

1. Stair Captions and Stair Actions
New Datasets for Deep Learning
Akikazu Takeuchi
Principal Research Scientist
Stair Lab.

2. n
http://flowers.stair.center
n
n
n

3. n
http://flowers.stair.center
n
n
n
28
80
10

4. 2017/03/12 2017
Stair Captions Stair Actions
16
caption dataset
80
dataset
100,000

5. Stair Captions
Details
MS-COCO (Microsoft Common Objects in Context) 2014
n
• MS-COCO 2014
n
•
2017/03/12 2017

6. 2017/03/12 2017
1

7. NLP2017
STAIR Captions:
2017/03/12 2017
Andrej Karpathy NeuralTalk2 Stair Captions

8. Available now!
Stair Captions
n http://captions.stair.center
2017/03/12 2017

9. Stair Actions
Details
n
• 100
n
• 1000 5
2017/03/12 2017

10. 100
2017/03/12 2017

11. 62,000
Stair Actions
n http://actions.stair.center
n
Stair Actions
“Stair Actions” is based on results obtained from a project commissioned by the New Energy and
Industrial TechnologyDevelopment Organization (NEDO).
2017/03/12 2017

12. Stair Captions
2DCNN + RNN
2017/03/12 2017
Donahue et al., “Long-term Recurrent Convolutional
Networks for Visual Recognition and Description,”
CVPR2015.
Visual Input
Visual Features
CNN
Sequence Learning
LSTM
Predictions
UCF101 HMDB51 Ours
[Donahue et al., CVPR 2015] 71.12 ― ―
[Feichtenhofer et al., NIPS 2016] 93.46 66.41 ―
86.04 52.87 45.6

13. n
n
n 2012 ImageNet 100
n
n
n
2017/03/12 2017
FAQ

14. n
n x
n →
n
n
n CC0
2017/03/12 2017

15. Credit
Web
n mokha
n
n
n
n
n Scaleout
n
Stair Actions
“Stair Actions” is based on results obtained from a project commissioned by the New Energy and
Industrial TechnologyDevelopment Organization (NEDO).
2017/03/12 2017