Skip to main content
UploadLanguage (EN)Support
BusinessMobileSocial MediaMarketingTechnologyArt & PhotosCareerDesignEducationPresentations & Public SpeakingGovernment & NonprofitHealthcareInternetLawLeadership & ManagementAutomotiveEngineeringSoftwareRecruiting & HRRetailSalesServicesScienceSmall Business & EntrepreneurshipFoodEnvironmentEconomy & FinanceData & AnalyticsInvestor RelationsSportsSpiritualNews & PoliticsTravelSelf ImprovementReal EstateEntertainment & HumorHealth & MedicineDevices & HardwareLifestyle
cyberagent, profile picture
Uploaded bycyberagent
3,717 views

機械学習エンジニアを見せたAWSの再：発明とは？ 〜re:Invent 2018 参加レポート〜

The document discusses Amazon Web Services' (AWS) machine learning and artificial intelligence services that were announced or highlighted at the 2018 re:Invent conference. It provides an overview of 1) AI services like Amazon Personalize and Amazon Forecast, 2) machine learning frameworks and infrastructure like Amazon SageMaker, Elastic Inference, and EC2 instances, and 3) machine learning services like Amazon Rekognition and Amazon Comprehend. It also summarizes new services announced at re:Invent like Amazon SageMaker Ground Truth, AWS Marketplace for ML/AI, and Amazon SageMaker Neo.

Engineering◦
CA Data Engineering and Data Analysis (CADEDA) #7 1
l − − ⇔ − l : − CS − → l : 2
3 re:Invent 2018 (?) AI Services ML Frameworks & Infrastructure ML Services (SageMaker)
re:Invent Amazon Web Services
5 50,000 1,381 : AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube https://www.youtube.com/watch?v=ZOIkOnW640A
655 2,100 : AWS re:Invent 2018 https://www.portal.reinvent.awsevents.com/connect/search.ww 3501
7 : Campus | AWS re:Invent https://reinvent.awsevents.com/campus/ 3.2km
l 50,000+ − 7 l 2,100+ l 100+ 8
9 re:Invent 2018 …
10 Andy Jassy (CEO) AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube https://www.youtube.com/watch?v=ZOIkOnW640A • Glacier Deep Archive • FSx for Windows File Server • FSx for Lustre • Control Tower • Security Hub • Lake Formation • DynamoDB R/W Capacity on Demand • Timestream • Quantum Ledger DB • Managed Blockchain • VMware Cloud on AWS • Outposts 165
l Amazon Personalize l Amazon Forecast l Amazon Textract l Amazon Comprehend Medical l Amazon Translate Custom Terminology l Amazon SageMaker Ground Truth l Amazon SageMaker Neo l AWS Marketplace for Machine Learning & Artificial Intelligence l Amazon SageMaker RL l AWS DeepRacer l AWS-optimized TensorFlow l Amazon EC2 p3dn Instance l Amazon Elastic Inference l AWS Inferentia 11
12 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML API ML ML
13 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML API
l Amazon Personalize − − Amazon.com l Amazon Forecast − − Amazon.com 14 l Textract: OCR; ; l Comprehend Medical: ; l Translate Custom Terminology : Translate
15 | Amazon Personalize | AWS https://aws.amazon.com/jp/personalize/ Amazon Personalize ( ) ( )
l l − API : Rekognition l − : 16
17 Time Series Forecasting | Machine Learning | Amazon Forecast https://aws.amazon.com/forecast/ Amazon Forecast Timestream CSV API
l l Forecast : − − API − Amazon Timestream l Lambda 18 re:Invent TSDB : https://aws.amazon.com/timestream/
19 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML
l AWS-Optimized TensorFlow − 256 GPUs l EC2 p3dn − GPU l Amazon Elastic Inference − EC2 GPU 20 l Amazon Inferentia: TPU 2019 ;
l AWS-Optimized TensorFlow − AWS c5, p3 TensorFlow − AMI DLAMI l − 256 GPUs ResNet50 256 GPUs scaling efficiency 65% → 90% 21 Anaconda TensorFlow, MXNet, Chainer, Caffe, PyTorch AMI AMI
l GPU 22 Model NVIDIA V100 Tensor Core GPUs GPU Memory NVIDIA NVLink vCPUs Main Memory Local Storage Network Bandwidth EBS- Optimized Bandwidth p3dn .24xlarge 8 256 GB 300 GB/s 96 768 GiB 2 x 900 GB NVMe SSD 100 Gbps 14 Gbps NVLink & NCCL + CADEDA #4 gihyo.jp , 2018. ChainerMN , CADEDA #4.
l GPU − GPU l GPU 23 Model GPUs vCPU Mem GPU Mem Storage Dedicated EBS Bandwidth Networkin g p3 .2xlarge 1 8 61 16 EBS-Only 1.5 Gbps Up to 10 Gigabit p3 8CPU, 61GB Mem
24 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML
25 [NEW!] • SageMaker Ground Truth • Jupyter Notebook/Lab • on-demand • • AWS Marketplace [NEW!] • (RL) [NEW!] [NEW!] • SageMaker Neo • scalable (API) • • Marketplace [NEW!]
l Amazon SageMaker Ground Truth − l AWS Marketplace for ML & AI − ML l Amazon SageMaker Neo − HW OSS l Amazon SageMaker RL (Reinforcement Learning) − − : DeepRacer 26
l − Web UI − Mechanical Turk − Active Learning 27
l − : − : 28
l − → IoT − 29 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Train once, run anywhere Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018 ( p.85 ) SageMaker Neo
l RL − RL l RL SageMaker − − 30 : ( ) “AlphaGo”
l AWS DeepRacer − − SageMaker − Atom , , Wi-Fi l l re:Invent 2019 31 Amazon.com m(_ _)m
1. AI Services − Personalize − 2. ML Frameworks & Infrastructure − − Elastic Inference 3. ML Services − ML − 32
l re:Invent Web − 1) − 2) l ID 33 1) https://www.portal.reinvent.awsevents.com/connect/search.ww 2) AWS re:Invent 2018 #reinvent DevelopersIO https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related- sessions-list-of-materials-ja/ AIM317-R2 AI/ML “AIM” repeat
l AI/ML : 228 34 ID AIM (Artificial Intelligence & Machine learning) 113 ANT (ANalyTics) 47 WPS (Worldwide Public Sector) 8 CTD 5 FSV (Financial Services) 5 ( ) Artificial Intelligence & Machine Learning repeat
l AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube https://youtu.be/ZOIkOnW640A?t=4860 − 1:21:00 l AWS re:Invent 2018 - Keynote with Werner Vogels – YouTube https://www.youtube.com/watch?v=femopq3JWJg − Lambda, Step Functions, API Gateway l Japan Wrap Up re:Invent2018 https://www.slideshare.net/KamedaHarunobu/japan-wrap-up-reinvent2018 − re:Invent l AWS Black Belt Online Seminar AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServicesJapan/125-aws-black-belt-online-seminar-aws-reinvent-2018 − re:Invent AWS Q&A 35
l Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine-learning-aim202l-aws- reinvent-2018 l AWS re:Invent 2018 #reinvent DevelopersIO https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related-sessions-list-of-materials-ja/ − − AWS re:Invent 2018 36