Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

機械学習エンジニアを見せたAWSの再:発明とは? 〜re:Invent 2018 参加レポート〜

2,662 views

Published on

CA Data Engineering and Data Analysis(CADEDA)#7
機械学習エンジニアを見せたAWSの再:発明とは?
〜re:Invent 2018 参加レポート〜

Published in: Engineering
  • Be the first to comment

機械学習エンジニアを見せたAWSの再:発明とは? 〜re:Invent 2018 参加レポート〜

  1. 1. CA Data Engineering and Data Analysis (CADEDA) #7 1
  2. 2. l − − ⇔ − l : − CS − → l : 2
  3. 3. 3 re:Invent 2018 (?) AI Services ML Frameworks & Infrastructure ML Services (SageMaker)
  4. 4. re:Invent Amazon Web Services
  5. 5. 5 50,000 1,381 : AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube https://www.youtube.com/watch?v=ZOIkOnW640A
  6. 6. 655 2,100 : AWS re:Invent 2018 https://www.portal.reinvent.awsevents.com/connect/search.ww 3501
  7. 7. 7 : Campus | AWS re:Invent https://reinvent.awsevents.com/campus/ 3.2km
  8. 8. l 50,000+ − 7 l 2,100+ l 100+ 8
  9. 9. 9 re:Invent 2018 …
  10. 10. 10 Andy Jassy (CEO) AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube https://www.youtube.com/watch?v=ZOIkOnW640A • Glacier Deep Archive • FSx for Windows File Server • FSx for Lustre • Control Tower • Security Hub • Lake Formation • DynamoDB R/W Capacity on Demand • Timestream • Quantum Ledger DB • Managed Blockchain • VMware Cloud on AWS • Outposts 165
  11. 11. l Amazon Personalize l Amazon Forecast l Amazon Textract l Amazon Comprehend Medical l Amazon Translate Custom Terminology l Amazon SageMaker Ground Truth l Amazon SageMaker Neo l AWS Marketplace for Machine Learning & Artificial Intelligence l Amazon SageMaker RL l AWS DeepRacer l AWS-optimized TensorFlow l Amazon EC2 p3dn Instance l Amazon Elastic Inference l AWS Inferentia 11
  12. 12. 12 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML API ML ML
  13. 13. 13 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML API
  14. 14. l Amazon Personalize − − Amazon.com l Amazon Forecast − − Amazon.com 14 l Textract: OCR; ; l Comprehend Medical: ; l Translate Custom Terminology : Translate
  15. 15. 15 | Amazon Personalize | AWS https://aws.amazon.com/jp/personalize/ Amazon Personalize ( ) ( )
  16. 16. l l − API : Rekognition l − : 16
  17. 17. 17 Time Series Forecasting | Machine Learning | Amazon Forecast https://aws.amazon.com/forecast/ Amazon Forecast Timestream CSV API
  18. 18. l l Forecast : − − API − Amazon Timestream l Lambda 18 re:Invent TSDB : https://aws.amazon.com/timestream/
  19. 19. 19 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML
  20. 20. l AWS-Optimized TensorFlow − 256 GPUs l EC2 p3dn − GPU l Amazon Elastic Inference − EC2 GPU 20 l Amazon Inferentia: TPU 2019 ;
  21. 21. l AWS-Optimized TensorFlow − AWS c5, p3 TensorFlow − AMI DLAMI l − 256 GPUs ResNet50 256 GPUs scaling efficiency 65% → 90% 21 Anaconda TensorFlow, MXNet, Chainer, Caffe, PyTorch AMI AMI
  22. 22. l GPU 22 Model NVIDIA V100 Tensor Core GPUs GPU Memory NVIDIA NVLink vCPUs Main Memory Local Storage Network Bandwidth EBS- Optimized Bandwidth p3dn .24xlarge 8 256 GB 300 GB/s 96 768 GiB 2 x 900 GB NVMe SSD 100 Gbps 14 Gbps NVLink & NCCL + CADEDA #4 gihyo.jp , 2018. ChainerMN , CADEDA #4.
  23. 23. l GPU − GPU l GPU 23 Model GPUs vCPU Mem GPU Mem Storage Dedicated EBS Bandwidth Networkin g p3 .2xlarge 1 8 61 16 EBS-Only 1.5 Gbps Up to 10 Gigabit p3 8CPU, 61GB Mem
  24. 24. 24 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon Machine Learning stack A I S E R V I C E S M L S E R V I C E S M L F R A M E W O R K S & I N F R A S T R U C T U R E A m a z o n S a g e M a k e r G r o u n d T r u t h A l g o r i t h m s N o t e b o o k s M a r k e t p l a c e U n s u p e r v i s e d L e a r n i n g S u p e r v i s e d L e a r n i n g R e i n f o r c e m e n t L e a r n i n g O p t i m i z a t i o n ( N e o ) T r a i n i n g H o s t i n g D e p l o y m e n t Frameworks Interfaces Infrastructure A m a z o n R e k o g n i t i o n I m a g e A m a z o n P o l l y A m a z o n T r a n s c r i b e A m a z o n T r a n s l a t e A m a z o n C o m p r e h e n d A m a z o n L e x A m a z o n R e k o g n i t i o n V i d e o Vision Speech Language Chatbots A m a z o n F o r e c a s t Forecasting A m a z o n T e x t r a c t A m a z o n P e r s o n a l i z e Recommendations A m a z o n E C 2 P 3 & P 3 D N A m a z o n E C 2 C 5 F P G A s A W S G r e e n g r a s s A m a z o n E l a s t i c I n f e r e n c e A m a z o n I n f e r e n t i a AIM202-L , p.5 Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018?from_action=save ML
  25. 25. 25 [NEW!] • SageMaker Ground Truth • Jupyter Notebook/Lab • on-demand • • AWS Marketplace [NEW!] • (RL) [NEW!] [NEW!] • SageMaker Neo • scalable (API) • • Marketplace [NEW!]
  26. 26. l Amazon SageMaker Ground Truth − l AWS Marketplace for ML & AI − ML l Amazon SageMaker Neo − HW OSS l Amazon SageMaker RL (Reinforcement Learning) − − : DeepRacer 26
  27. 27. l − Web UI − Mechanical Turk − Active Learning 27
  28. 28. l − : − : 28
  29. 29. l − → IoT − 29 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Train once, run anywhere Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine- learning-aim202l-aws-reinvent-2018 ( p.85 ) SageMaker Neo
  30. 30. l RL − RL l RL SageMaker − − 30 : ( ) “AlphaGo”
  31. 31. l AWS DeepRacer − − SageMaker − Atom , , Wi-Fi l l re:Invent 2019 31 Amazon.com m(_ _)m
  32. 32. 1. AI Services − Personalize − 2. ML Frameworks & Infrastructure − − Elastic Inference 3. ML Services − ML − 32
  33. 33. l re:Invent Web − 1) − 2) l ID 33 1) https://www.portal.reinvent.awsevents.com/connect/search.ww 2) AWS re:Invent 2018 #reinvent DevelopersIO https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related- sessions-list-of-materials-ja/ AIM317-R2 AI/ML “AIM” repeat
  34. 34. l AI/ML : 228 34 ID AIM (Artificial Intelligence & Machine learning) 113 ANT (ANalyTics) 47 WPS (Worldwide Public Sector) 8 CTD 5 FSV (Financial Services) 5 ( ) Artificial Intelligence & Machine Learning repeat
  35. 35. l AWS re:Invent 2018 - Keynote with Andy Jassy – YouTube https://youtu.be/ZOIkOnW640A?t=4860 − 1:21:00 l AWS re:Invent 2018 - Keynote with Werner Vogels – YouTube https://www.youtube.com/watch?v=femopq3JWJg − Lambda, Step Functions, API Gateway l Japan Wrap Up re:Invent2018 https://www.slideshare.net/KamedaHarunobu/japan-wrap-up-reinvent2018 − re:Invent l AWS Black Belt Online Seminar AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServicesJapan/125-aws-black-belt-online-seminar-aws-reinvent-2018 − re:Invent AWS Q&A 35
  36. 36. l Leadership Session: Machine Learning (AIM202-L) - AWS re:Invent 2018 https://www.slideshare.net/AmazonWebServices/leadership-session-machine-learning-aim202l-aws- reinvent-2018 l AWS re:Invent 2018 #reinvent DevelopersIO https://dev.classmethod.jp/cloud/aws/reinvent2018-machine-learning-related-sessions-list-of-materials-ja/ − − AWS re:Invent 2018 36

×