The document discusses Amazon Web Services' (AWS) machine learning and artificial intelligence services that were announced or highlighted at the 2018 re:Invent conference. It provides an overview of 1) AI services like Amazon Personalize and Amazon Forecast, 2) machine learning frameworks and infrastructure like Amazon SageMaker, Elastic Inference, and EC2 instances, and 3) machine learning services like Amazon Rekognition and Amazon Comprehend. It also summarizes new services announced at re:Invent like Amazon SageMaker Ground Truth, AWS Marketplace for ML/AI, and Amazon SageMaker Neo.

1. CA Data Engineering and Data Analysis (CADEDA) #7
1

2. l
−
− ⇔
−
l :
− CS
− →
l :
2

3. 3
re:Invent 2018
(?)
AI Services
ML Frameworks & Infrastructure
ML Services (SageMaker)

4. re:Invent
Amazon Web Services

5. 5
50,000 1,381
: AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube
https://www.youtube.com/watch?v=ZOIkOnW640A

6. 655
2,100
: AWS re:Invent 2018
https://www.portal.reinvent.awsevents.com/connect/search.ww
3501

7. 7
: Campus | AWS re:Invent https://reinvent.awsevents.com/campus/
3.2km

8. l 50,000+
− 7
l 2,100+
l 100+
8

9. 9
re:Invent 2018
…

10. 10
Andy Jassy (CEO)
AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube
https://www.youtube.com/watch?v=ZOIkOnW640A
• Glacier Deep Archive
• FSx for Windows File Server
• FSx for Lustre
• Control Tower
• Security Hub
• Lake
Formation
• DynamoDB R/W
Capacity on Demand
• Timestream
• Quantum Ledger DB
• Managed Blockchain
• VMware Cloud
on AWS
• Outposts
165

11. l Amazon Personalize
l Amazon Forecast
l Amazon Textract
l Amazon Comprehend Medical
l Amazon Translate Custom
Terminology
l Amazon SageMaker Ground Truth
l Amazon SageMaker Neo
l AWS Marketplace for Machine
Learning & Artificial Intelligence
l Amazon SageMaker RL
l AWS DeepRacer
l AWS-optimized TensorFlow
l Amazon EC2 p3dn Instance
l Amazon Elastic Inference
l AWS Inferentia
11

12. 12
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon Machine Learning stack
A I S E R V I C E S
M L S E R V I C E S
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
A m a z o n
S a g e M a k e r
G r o u n d T r u t h A l g o r i t h m s
N o t e b o o k s
M a r k e t p l a c e
U n s u p e r v i s e d
L e a r n i n g
S u p e r v i s e d
L e a r n i n g
R e i n f o r c e m e n t
L e a r n i n g
O p t i m i z a t i o n
( N e o )
T r a i n i n g
H o s t i n g
D e p l o y m e n t
Frameworks Interfaces Infrastructure
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n
P o l l y
A m a z o n
T r a n s c r i b e
A m a z o n
T r a n s l a t e
A m a z o n
C o m p r e h e n d
A m a z o n
L e x
A m a z o n
R e k o g n i t i o n
V i d e o
Vision Speech Language Chatbots
A m a z o n
F o r e c a s t
Forecasting
A m a z o n
T e x t r a c t
A m a z o n
P e r s o n a l i z e
Recommendations
A m a z o n
E C 2 P 3
& P 3 D N
A m a z o n
E C 2 C 5
F P G A s A W S G r e e n g r a s s A m a z o n
E l a s t i c
I n f e r e n c e
A m a z o n
I n f e r e n t i a
AIM202-L , p.5
Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018
https://www.slideshare.net/AmazonWebServices/leadership-session-machine-
learning-aim202l-aws-reinvent-2018?from_action=save
ML
API
ML
ML

13. 13
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon Machine Learning stack
A I S E R V I C E S
M L S E R V I C E S
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
A m a z o n
S a g e M a k e r
G r o u n d T r u t h A l g o r i t h m s
N o t e b o o k s
M a r k e t p l a c e
U n s u p e r v i s e d
L e a r n i n g
S u p e r v i s e d
L e a r n i n g
R e i n f o r c e m e n t
L e a r n i n g
O p t i m i z a t i o n
( N e o )
T r a i n i n g
H o s t i n g
D e p l o y m e n t
Frameworks Interfaces Infrastructure
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n
P o l l y
A m a z o n
T r a n s c r i b e
A m a z o n
T r a n s l a t e
A m a z o n
C o m p r e h e n d
A m a z o n
L e x
A m a z o n
R e k o g n i t i o n
V i d e o
Vision Speech Language Chatbots
A m a z o n
F o r e c a s t
Forecasting
A m a z o n
T e x t r a c t
A m a z o n
P e r s o n a l i z e
Recommendations
A m a z o n
E C 2 P 3
& P 3 D N
A m a z o n
E C 2 C 5
F P G A s A W S G r e e n g r a s s A m a z o n
E l a s t i c
I n f e r e n c e
A m a z o n
I n f e r e n t i a
AIM202-L , p.5
Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018
https://www.slideshare.net/AmazonWebServices/leadership-session-machine-
learning-aim202l-aws-reinvent-2018?from_action=save
ML
API

14. l Amazon Personalize
−
− Amazon.com
l Amazon Forecast
−
− Amazon.com
14
l Textract: OCR; ;
l Comprehend Medical: ;
l Translate Custom Terminology : Translate

15. 15
| Amazon
Personalize | AWS https://aws.amazon.com/jp/personalize/
Amazon Personalize
( )
( )

16. l
l
− API
: Rekognition
l
− :
16

17. 17
Time Series Forecasting | Machine Learning | Amazon Forecast
https://aws.amazon.com/forecast/
Amazon Forecast
Timestream
CSV API

18. l
l Forecast
:
−
− API
− Amazon Timestream
l Lambda
18
re:Invent TSDB :
https://aws.amazon.com/timestream/

19. 19
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon Machine Learning stack
A I S E R V I C E S
M L S E R V I C E S
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
A m a z o n
S a g e M a k e r
G r o u n d T r u t h A l g o r i t h m s
N o t e b o o k s
M a r k e t p l a c e
U n s u p e r v i s e d
L e a r n i n g
S u p e r v i s e d
L e a r n i n g
R e i n f o r c e m e n t
L e a r n i n g
O p t i m i z a t i o n
( N e o )
T r a i n i n g
H o s t i n g
D e p l o y m e n t
Frameworks Interfaces Infrastructure
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n
P o l l y
A m a z o n
T r a n s c r i b e
A m a z o n
T r a n s l a t e
A m a z o n
C o m p r e h e n d
A m a z o n
L e x
A m a z o n
R e k o g n i t i o n
V i d e o
Vision Speech Language Chatbots
A m a z o n
F o r e c a s t
Forecasting
A m a z o n
T e x t r a c t
A m a z o n
P e r s o n a l i z e
Recommendations
A m a z o n
E C 2 P 3
& P 3 D N
A m a z o n
E C 2 C 5
F P G A s A W S G r e e n g r a s s A m a z o n
E l a s t i c
I n f e r e n c e
A m a z o n
I n f e r e n t i a
AIM202-L , p.5
Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018
https://www.slideshare.net/AmazonWebServices/leadership-session-machine-
learning-aim202l-aws-reinvent-2018?from_action=save
ML

20. l AWS-Optimized TensorFlow
− 256 GPUs
l EC2 p3dn
− GPU
l Amazon Elastic Inference
− EC2 GPU
20
l Amazon Inferentia: TPU 2019 ;

21. l AWS-Optimized TensorFlow
− AWS c5, p3
TensorFlow
− AMI DLAMI
l
− 256 GPUs
ResNet50 256 GPUs scaling efficiency
65% → 90%
21
Anaconda TensorFlow, MXNet, Chainer, Caffe, PyTorch
AMI AMI

22. l GPU
22
Model
NVIDIA
V100
Tensor
Core GPUs
GPU
Memory
NVIDIA
NVLink
vCPUs
Main
Memory
Local
Storage
Network
Bandwidth
EBS-
Optimized
Bandwidth
p3dn
.24xlarge
8 256 GB 300 GB/s 96 768 GiB
2 x
900 GB
NVMe SSD
100 Gbps 14 Gbps
NVLink & NCCL +
CADEDA #4 gihyo.jp
, 2018. ChainerMN , CADEDA #4.

23. l GPU
− GPU
l
GPU
23
Model GPUs vCPU Mem
GPU
Mem
Storage
Dedicated
EBS
Bandwidth
Networkin
g
p3
.2xlarge
1 8 61 16 EBS-Only 1.5 Gbps
Up to 10
Gigabit
p3 8CPU, 61GB Mem

24. 24
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon Machine Learning stack
A I S E R V I C E S
M L S E R V I C E S
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
A m a z o n
S a g e M a k e r
G r o u n d T r u t h A l g o r i t h m s
N o t e b o o k s
M a r k e t p l a c e
U n s u p e r v i s e d
L e a r n i n g
S u p e r v i s e d
L e a r n i n g
R e i n f o r c e m e n t
L e a r n i n g
O p t i m i z a t i o n
( N e o )
T r a i n i n g
H o s t i n g
D e p l o y m e n t
Frameworks Interfaces Infrastructure
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n
P o l l y
A m a z o n
T r a n s c r i b e
A m a z o n
T r a n s l a t e
A m a z o n
C o m p r e h e n d
A m a z o n
L e x
A m a z o n
R e k o g n i t i o n
V i d e o
Vision Speech Language Chatbots
A m a z o n
F o r e c a s t
Forecasting
A m a z o n
T e x t r a c t
A m a z o n
P e r s o n a l i z e
Recommendations
A m a z o n
E C 2 P 3
& P 3 D N
A m a z o n
E C 2 C 5
F P G A s A W S G r e e n g r a s s A m a z o n
E l a s t i c
I n f e r e n c e
A m a z o n
I n f e r e n t i a
AIM202-L , p.5
Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018
https://www.slideshare.net/AmazonWebServices/leadership-session-machine-
learning-aim202l-aws-reinvent-2018?from_action=save
ML

25. 25
[NEW!]
• SageMaker Ground Truth
• Jupyter
Notebook/Lab
• on-demand
•
• AWS Marketplace [NEW!]
• (RL) [NEW!]
[NEW!]
• SageMaker Neo
• scalable
(API)
•
• Marketplace [NEW!]

26. l Amazon SageMaker Ground Truth
−
l AWS Marketplace for ML & AI
− ML
l Amazon SageMaker Neo
− HW OSS
l Amazon SageMaker RL (Reinforcement Learning)
−
− : DeepRacer
26

27. l
−
Web UI
− Mechanical Turk
− Active Learning
27

28. l
− :
− :
28

29. l
−
→ IoT
−
29
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Train once, run anywhere
Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018
https://www.slideshare.net/AmazonWebServices/leadership-session-machine-
learning-aim202l-aws-reinvent-2018 ( p.85 )
SageMaker Neo

30. l RL
− RL
l
RL SageMaker
−
−
30
: ( )
“AlphaGo”

31. l AWS DeepRacer
−
− SageMaker
− Atom , , Wi-Fi
l
l re:Invent 2019
31
Amazon.com
m(_ _)m

32. 1. AI Services
− Personalize
−
2. ML Frameworks & Infrastructure
−
− Elastic Inference
3. ML Services
− ML
−
32

33. l re:Invent Web
− 1)
− 2)
l ID
33
1) https://www.portal.reinvent.awsevents.com/connect/search.ww
2) AWS re:Invent 2018 #reinvent
DevelopersIO
https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related-
sessions-list-of-materials-ja/
AIM317-R2
AI/ML “AIM”
repeat

34. l AI/ML : 228
34
ID
AIM (Artificial Intelligence & Machine learning)
113
ANT (ANalyTics) 47
WPS (Worldwide Public Sector) 8
CTD 5
FSV (Financial Services) 5
(
)
Artificial Intelligence & Machine Learning
repeat

35. l AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube
https://youtu.be/ZOIkOnW640A?t=4860
− 1:21:00
l AWS re:Invent 2018 - Keynote with Werner Vogels – YouTube
https://www.youtube.com/watch?v=femopq3JWJg
− Lambda, Step Functions, API Gateway
l Japan Wrap Up re:Invent2018
https://www.slideshare.net/KamedaHarunobu/japan-wrap-up-reinvent2018
− re:Invent
l AWS Black Belt Online Seminar AWS re:Invent 2018
https://www.slideshare.net/AmazonWebServicesJapan/125-aws-black-belt-online-seminar-aws-reinvent-2018
− re:Invent
AWS Q&A
35

36. l Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent
2018
https://www.slideshare.net/AmazonWebServices/leadership-session-machine-learning-aim202l-aws-
reinvent-2018
l AWS re:Invent 2018
#reinvent DevelopersIO
https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related-sessions-list-of-materials-ja/
−
− AWS re:Invent 2018
36