Download to read offline
![25
[NEW!]
• SageMaker Ground Truth
• Jupyter
Notebook/Lab
• on-demand
•
• AWS Marketplace [NEW!]
• (RL) [NEW!]
[NEW!]
• SageMaker Neo
• scalable
(API)
•
• Marketplace [NEW!]](https://image.slidesharecdn.com/20181214cadeda7tsunodafixed-181217061753/75/AWS-re-Invent-2018-25-2048.jpg)
Uploaded bycyberagent
機械学習エンジニアを見せたAWSの再：発明とは？ 〜re:Invent 2018 参加レポート〜
The document discusses Amazon Web Services' (AWS) machine learning and artificial intelligence services that were announced or highlighted at the 2018 re:Invent conference. It provides an overview of 1) AI services like Amazon Personalize and Amazon Forecast, 2) machine learning frameworks and infrastructure like Amazon SageMaker, Elastic Inference, and EC2 instances, and 3) machine learning services like Amazon Rekognition and Amazon Comprehend. It also summarizes new services announced at re:Invent like Amazon SageMaker Ground Truth, AWS Marketplace for ML/AI, and Amazon SageMaker Neo.
More Related Content
Similar to 機械学習エンジニアを見せたAWSの再：発明とは？ 〜re:Invent 2018 参加レポート〜
![[Retail & CPG Day 2019] 기조연설 | Cloud Journey of Traditional Retailers for Dig...](https://cdn.slidesharecdn.com/ss_thumbnails/keynote1-191024042352-thumbnail.jpg?width=640&height=640&fit=bounds)
機械学習エンジニアを見せたAWSの再：発明とは？ 〜re:Invent 2018 参加レポート〜
- 1. CA Data Engineeringand Data Analysis (CADEDA) #7 1
- 2. l − − ⇔ − l : −CS − → l : 2
- 3. 3 re:Invent 2018 (?) AI Services MLFrameworks & Infrastructure ML Services (SageMaker)
- 4.
- 5. 5 50,000 1,381 : AWSre:Invent 2018 - Keynote with Andy Jassy – YouTube https://www.youtube.com/watch?v=ZOIkOnW640A
- 6. 655 2,100 : AWS re:Invent2018 https://www.portal.reinvent.awsevents.com/connect/search.ww 3501
- 7. 7 : Campus |AWS re:Invent https://reinvent.awsevents.com/campus/ 3.2km
- 8. l 50,000+ − 7 l2,100+ l 100+ 8
- 9.
- 10. 10 Andy Jassy (CEO) AWSre:Invent 2018 - Keynote with Andy Jassy – YouTube https://www.youtube.com/watch?v=ZOIkOnW640A • Glacier Deep Archive • FSx for Windows File Server • FSx for Lustre • Control Tower • Security Hub • Lake Formation • DynamoDB R/W Capacity on Demand • Timestream • Quantum Ledger DB • Managed Blockchain • VMware Cloud on AWS • Outposts 165
- 11. l Amazon Personalize lAmazon Forecast l Amazon Textract l Amazon Comprehend Medical l Amazon Translate Custom Terminology l Amazon SageMaker Ground Truth l Amazon SageMaker Neo l AWS Marketplace for Machine Learning & Artificial Intelligence l Amazon SageMaker RL l AWS DeepRacer l AWS-optimized TensorFlow l Amazon EC2 p3dn Instance l Amazon Elastic Inference l AWS Inferentia 11
- 12. 12 © 2018, AmazonWeb Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML API ML ML
- 13. 13 © 2018, AmazonWeb Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML API
- 14. l Amazon Personalize − −Amazon.com l Amazon Forecast − − Amazon.com 14 l Textract: OCR; ; l Comprehend Medical: ; l Translate Custom Terminology : Translate
- 15. 15 | Amazon Personalize |AWS https://aws.amazon.com/jp/personalize/ Amazon Personalize ( ) ( )
- 16.
- 17. 17 Time Series Forecasting| Machine Learning | Amazon Forecast https://aws.amazon.com/forecast/ Amazon Forecast Timestream CSV API
- 18. l l Forecast : − − API −Amazon Timestream l Lambda 18 re:Invent TSDB : https://aws.amazon.com/timestream/
- 19. 19 © 2018, AmazonWeb Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML
- 20. l AWS-Optimized TensorFlow −256 GPUs l EC2 p3dn − GPU l Amazon Elastic Inference − EC2 GPU 20 l Amazon Inferentia: TPU 2019 ;
- 21. l AWS-Optimized TensorFlow −AWS c5, p3 TensorFlow − AMI DLAMI l − 256 GPUs ResNet50 256 GPUs scaling efficiency 65% → 90% 21 Anaconda TensorFlow, MXNet, Chainer, Caffe, PyTorch AMI AMI
- 22. l GPU 22 Model NVIDIA V100 Tensor Core GPUs GPU Memory NVIDIA NVLink vCPUs Main Memory Local Storage Network Bandwidth EBS- Optimized Bandwidth p3dn .24xlarge 8256 GB 300 GB/s 96 768 GiB 2 x 900 GB NVMe SSD 100 Gbps 14 Gbps NVLink & NCCL + CADEDA #4 gihyo.jp , 2018. ChainerMN , CADEDA #4.
- 23. l GPU − GPU l GPU 23 ModelGPUs vCPU Mem GPU Mem Storage Dedicated EBS Bandwidth Networkin g p3 .2xlarge 1 8 61 16 EBS-Only 1.5 Gbps Up to 10 Gigabit p3 8CPU, 61GB Mem
- 24. 24 © 2018, AmazonWeb Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML
- 25. 25 [NEW!] • SageMaker GroundTruth • Jupyter Notebook/Lab • on-demand • • AWS Marketplace [NEW!] • (RL) [NEW!] [NEW!] • SageMaker Neo • scalable (API) • • Marketplace [NEW!]
- 26. l Amazon SageMakerGround Truth − l AWS Marketplace for ML & AI − ML l Amazon SageMaker Neo − HW OSS l Amazon SageMaker RL (Reinforcement Learning) − − : DeepRacer 26
- 27. l − Web UI − MechanicalTurk − Active Learning 27
- 28.
- 29. l − → IoT − 29 © 2018,Amazon Web Services, Inc. or its affiliates. All rights reserved. Train once, run anywhere Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018 ( p.85 ) SageMaker Neo
- 30. l RL − RL l RLSageMaker − − 30 : ( ) “AlphaGo”
- 31. l AWS DeepRacer − −SageMaker − Atom , , Wi-Fi l l re:Invent 2019 31 Amazon.com m(_ _)m
- 32. 1. AI Services −Personalize − 2. ML Frameworks & Infrastructure − − Elastic Inference 3. ML Services − ML − 32
- 33. l re:Invent Web −1) − 2) l ID 33 1) https://www.portal.reinvent.awsevents.com/connect/search.ww 2) AWS re:Invent 2018 #reinvent DevelopersIO https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related- sessions-list-of-materials-ja/ AIM317-R2 AI/ML “AIM” repeat
- 34. l AI/ML :228 34 ID AIM (Artificial Intelligence & Machine learning) 113 ANT (ANalyTics) 47 WPS (Worldwide Public Sector) 8 CTD 5 FSV (Financial Services) 5 ( ) Artificial Intelligence & Machine Learning repeat
- 35. l AWS re:Invent2018 - Keynote with Andy Jassy – YouTube https://youtu.be/ZOIkOnW640A?t=4860 − 1:21:00 l AWS re:Invent 2018 - Keynote with Werner Vogels – YouTube https://www.youtube.com/watch?v=femopq3JWJg − Lambda, Step Functions, API Gateway l Japan Wrap Up re:Invent2018 https://www.slideshare.net/KamedaHarunobu/japan-wrap-up-reinvent2018 − re:Invent l AWS Black Belt Online Seminar AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServicesJapan/125-aws-black-belt-online-seminar-aws-reinvent-2018 − re:Invent AWS Q&A 35
- 36. l Leadership Session:Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine-learning-aim202l-aws- reinvent-2018 l AWS re:Invent 2018 #reinvent DevelopersIO https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related-sessions-list-of-materials-ja/ − − AWS re:Invent 2018 36