忙しい人のために2017年の機械学習についてまとめました。 下記のイベントで使用した資料です。 https://math-coding.connpass.com/event/74846/

1. 2017 10

2. Transformer
Deep Image Prior
Cycle GAN
Unsupervised MachineTranslation
Using Monolingual Corpora Only
Relational Network
The Case for Learned
Index Structures
Capsule Network
Neural Graph Machines
SmoothGrad
MobileNet

3. Relational Network
DL →AI
bAbI project
(VQA) CLEVR
(Facebook AI Research)

4. Relational Network
bAbI
1 Mary moved to the bathroom.
2 John went to the hallway.
3 Where is Mary? bathroom 1
4 Daniel went back to the hallway.
5 Sandra moved to the garden.
6 Where is Daniel? hallway 4
7 John moved to the office.
8 Sandra journeyed to the bathroom.
9 Where is Daniel? hallway 4
10 Mary moved to the hallway.
11 Daniel travelled to the office.
12 Where is Daniel? office 11
→
20

5. Relational Network
bAbI
6
The (6) dialog bAbI tasks
1 hi
! hello what can i help you with today
2 can you make a restaurant reservation
with italian cuisine for six people
in a cheap price range
! i'm on it
3 <SILENCE>
! where should it be
4 rome please
! ok let me look into some options for you
5 <SILENCE>
! api_call italian rome six cheap
※
API 6

6. Relational Network
CLEVR

7. Relational Network

8. Relational Network
See also: Broadcasting Convolutional Network
See also: Relational Memory Network
See also: Entity Linking

9. Transformer
Google (GMNT) 4 ( )
BLEU +3.8 ( ⇢ Google )
BLEU:

10. Transformer
“Attention Mechanizm”

11. Transformer
RNN ( CNN) Attention

12. Transformer
RNN ( CNN) Attention
Positional Encoding

13. ( 2 )
( AutoEncoder )
( JPEG )
Deep Image Prior

14. Deep Image Prior
Inpaint
( )

15. Deep Image Prior
AutoEncoder

16. Deep Image Prior
AutoEncoder
Understanding Deep Learning
Requires Re-thinking Generization

17. Cycle GAN

18. Cycle GAN

19. Cycle GAN
X Y
(X⇢Y⇢X) (Y⇢X⇢Y)

20. : Star GAN
Cycle GAN + ACGAN( + )
CelebA( 20 ) RaFD( 5000 ) CycleGAN

21. Unsupervised MachineTranslation
Using Monolingual Corpora Only
CycleGAN
BLEU

22. Unsupervised MachineTranslation
Using Monolingual Corpora Only
⇢

23. Word Embedding ( : 82.3%)
Unsupervised MachineTranslation
Using Monolingual Corpora Only
AutoEncoder (BackTranslation)
( ) WORDTRANSLATION WITHOUT PARALLEL DATA

24. MobileNets

25. The Case for Learned Index Structures

26. Capsule Network

27. Neural Graph Machines

28. SmoothGrad
Grad SmoothGrad