Download as PDF, PPTX
Uploaded byAWS Germany
Maschinelles Lernen auf AWS für Entwickler, Data Scientists und Experten
The document outlines Amazon Web Services' (AWS) machine learning offerings, emphasizing the tools and platforms available for developers and data scientists, such as Amazon SageMaker, Rekognition, and Polly. It highlights AWS's commitment to empowering users through advanced computing capabilities like GPU instances and various AI services. Additionally, it discusses the operational processes for utilizing machine learning, from data wrangling to model deployment.
More Related Content
Similar to Maschinelles Lernen auf AWS für Entwickler, Data Scientists und Experten
Maschinelles Lernen auf AWS für Entwickler, Data Scientists und Experten
- 1. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon ML Services Christian Petters Solutions Architect, Amazon Web Services
- 2. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. At Amazon, we invest in Machine Learning since the very beginning … Search & Discover Fulfillment & Logistics Current Products Future Intiatives
- 3. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Machine Learning at Amazon (1995)
- 4. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Put machine learning in the hands of every developer and data scientist ML @ AWS: Our mission
- 5. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Customers Running ML on AWS Today
- 6. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Frameworks & Infrastructure AWS Deep Learning AMI GPU (P3 Instances) MobileCPU IoT (Greengrass) Vision: Rekognition Image Rekognition Video Speech: Polly Transcribe Language: Lex Translate Comprehend Apache MXNet PyTorch Cognitive Toolkit Keras Caffe2 & Caffe TensorFlow Gluon Application AI Services Managed Platform Services Amazon Machine Learning Mechanical Turk Spark & EMR Amazon SageMaker AWS DeepLens AWS ML Stack
- 7. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. How do we enable enterprises to leverage ML and learn from Amazon’s experience?
- 8. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Machine Learning Solution Lab Brainstorming & Education Modeling Operationalizing A collaboration and education program that connects Amazon machine learning experts with AWS customers and partners
- 9. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon ML Solution Lab Customers
- 10. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Vision Speech Language Amazon Machine Learning Mechanical TurkSpark & EMR Application AI Services Managed Platform Services Frameworks & Infrastructure AWS Deep Learning AMI GPU (P3 Instances) MobileCPU IoT (Greengrass) Apache MXNet PyTorch Cognitive Toolkit Keras Caffe2 & Caffe TensorFlow Gluon AWS ML Stack
- 11. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 P3 Instances (O cto b er 2 0 1 7 ) • Up to eight NVIDIA Tesla V100 GPUs • 1 PetaFLOP of computational performance – 14x better than P2 • 300 GB/s GPU-to-GPU communication (NVLink) – 9X better than P2 • 16GB GPU memory with 900 GB/sec peak GPU memory bandwidth T h e f a s t e s t , m o s t p o w e r f u l G P U i n s t a n c e s i n t h e c l o u d
- 12. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. AWS Deep Learning AMI • Get started quickly with easy-to-launch tutorials • Hassle-free setup and configuration • Pay only for what you use – no additional charge for the AMI • Accelerate your model training and deployment • Support for popular deep learning frameworks
- 13. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Infrastructure GPU (P3 Instances) MobileCPU IoT (Greengrass) Vision Speech Language Frameworks AWS Deep Learning AMI Apache MXNet PyTorch Cognitive Toolkit Keras Caffe2 & Caffe TensorFlow Gluon Application AI Services Managed Platform Services Amazon Machine Learning Mechanical Turk Spark & EMR Amazon SageMaker AWS DeepLens AWS ML Stack
- 14. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Mechanical Turk • “Data is cheap; Labels are expensive” • Need human intelligence to annotate speech, vision or language data sets
- 15. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Mechanical Turk ML Customers Facebook AI Research (FAIR) DigitalGlobe | Radiant
- 16. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Machine learning process is hard… 1. Data wrangling • Setup and manage Notebook environments • Get data to notebooks securely 2. Experimentation • Setup and manage clusters • Scale/distribute ML algorithms 3. Deployment • Setup and manage inference clusters • Manage and auto scale inference APIs • Testing, versioning, and monitoring Fetch data Clean & format data Prepare & transform data Train model Evaluate model Integrate with prod Monitor/ debug/refresh
- 17. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. …and time consuming Fetch data Clean & format data Prepare & transform data Train model Evaluate model Integrate with prod Monitor/ debug/refresh 6–18 months
- 18. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Introducing: Amazon SageMaker A managed service that provides the quickest and easiest way for your data scientists and developers to get ML models from idea to production.
- 19. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker The quickest and easiest way to get ML models from idea to production End-to-End Machine Learning Platform Zero setup Flexible Model Training Pay by the second $
- 20. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Highly-optimized machine learning algorithms Amazon SageMaker AuthorBuilt-in high performance algorithmsPre-built notebook instances
- 21. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Highly-optimized machine learning algorithms Amazon SageMaker One-click training for ML, DL, and custom algorithms AuthorPre-built notebook instances Easier training with hyperparameter optimization Train
- 22. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. One-click training for ML, DL, and custom algorithms Easier training with hyperparameter optimization Highly-optimized machine learning algorithms Amazon SageMaker Deployment without engineering effort Fully-managed hosting at scale AuthorBuilt-in high performance algorithmsPre-built notebook instances Deploy Train
- 23. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker: 10x better algorithms Streaming datasets, for cheaper training Train faster, in a single pass Greater reliability on extremely large datasets Choice of several ML algorithms
- 24. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. How do we put ML in the hands of developers (literally)?
- 25. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. AWS DeepLens: A Deep Learning-Enabled Video Camera for Developers ( L i m i t e d P r e v i e w ) • Fully programmable video camera • Optimized for deep-learning on the device with Apache MXNet, Caffe, TensorFlow • Tutorials, sample code, examples and pre-built models • Integrated with Amazon IM for custom models
- 26. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Frameworks & Interfaces Infrastructure AWS Deep Learning AMI GPU (P3 Instances) MobileCPU IoT (Greengrass) Amazon Machine Learning Mechanical Turk Spark & EMR Amazon SageMaker Platform Services Apache MXNet PyTorch Cognitive Toolkit Keras Caffe2 & Caffe TensorFlow Gluon AWS ML Stack AWS DeepLens Vision: Rekognition Image Rekognition Video Speech: Polly Transcribe Application AI Services Language: Lex Translate Comprehend
- 27. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Object and Scene Detection Facial Analysis Face Comparison Facial Recognition Celebrity Recognition Image Moderation Amazon Rekognition Image: Deep learning-based image analysis service
- 28. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Results: | IT’S - 97% | | MONDAY – 99% | |but – 97% |keep – 96% | | Smiling – 99% | DetectText Rekognition: Text in Image (Nov 2017)
- 29. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Real-time face recognition against tens of millions of faces <0.5 second response time Up to 10M faces Enable Immediate response Rekognition: Real-Time Face Search
- 30. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Image Customers
- 31. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. How can we apply these powerful capabilities to video?
- 32. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Traditional solutions and limitations Temporal information lost Motion context lost
- 33. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Video Video Analysis
- 34. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Video One solution for all Stored Video Amazon S3 Video Live Stream Amazon Kinesis Video Stream Media Search Index Unsafe Video Detection Investigative Analysis Public Safety Immediate Response Home Monitoring
- 35. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Media and Entertainment Public Safety Smart Home - Search & Filter - Immediate Response - Investigative Analysis - Monitoring Amazon Rekognition Video Use Cases
- 36. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition Video: Launch Customers
- 37. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Frameworks & Interfaces Infrastructure AWS Deep Learning AMI GPU (P3 Instances) MobileCPU IoT (Greengrass) Apache MXNet PyTorch Cognitive Toolkit Keras Caffe2 & Caffe TensorFlow Gluon Platform Services Amazon Machine Learning Mechanical Turk Spark & EMR Amazon SageMaker DeepLens Vision: Rekognition Image Rekognition Video Speech: Polly Transcribe Application AI Services Language: Lex Translate Comprehend AWS ML Stack
- 38. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Polly Use Cases Content Creation Mobile & Desktop Applications Internet of Things (IoT) Education & E-Learning Telephony Game Development Key Features 52 Voices across 25 languages Lip-Syncing & Text Highlighting Fine-grained Voice Control Custom Vocabularies Available in 14 AWS regions
- 39. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Polly Customers
- 40. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. How do we enable analysis of all audio content generated?
- 41. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Transcribe: Automatic Speech Recognition (Preview) Time Stamps Support for both regular & telephony audio Punctuation & formatting § S3 Integration Recognize Multiple Speakers Custom Vocabulary
- 42. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Transcribe: Use Cases Call Centers Subtitles for VOD Transcribe meetings Broadcast closed captions
- 43. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Frameworks Infrastructure AWS Deep Learning AMI GPU (P3 Instances) MobileCPU IoT (Greengrass) Speech: Polly Transcribe Vision: Rekognition Image Rekognition Video Apache MXNet PyTorch Cognitive Toolkit Keras Caffe2 & Caffe TensorFlow Gluon Application Services Platform Services Amazon Machine Learning Mechanical Turk Spark & EMR Amazon SageMaker AWS DeepLens Language: Lex Translate Comprehend AWS ML Stack
- 44. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Lex
- 45. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Lex – Use Cases Informational Bots Chatbots for everyday consumer requests Application Bots Build powerful interfaces to mobile applications • News updates • Weather information • Game scores …. • Book tickets • Order food • Manage bank accounts …. Enterprise Productivity Bots Streamline enterprise work activities and improve efficiencies • Check sales numbers • Marketing performance • Inventory status …. Internet of Things (IoT) Bots Enable conversational interfaces for device interactions • Wearables • Appliances • Auto …. Contact Center Bots Chatbots for customer service IVR • Account inquiries • Bill payment • Service update ….
- 46. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Customers
- 47. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. How do you communicate with your global customers in the language of their choice?
- 48. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Translate: Neural Machine Translation REAL-TIME TRANSLATION POWERED BY DEEP LEARNING 12 LANGUAGE PAIRS (more to come) LANGUAGE DETECTION
- 49. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. How do you extract insights from unstructured text?
- 50. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend: Natural Language Processing Sentiment Entities LanguagesKey phrases Topic modeling Powered By Deep Learning
- 51. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend: Insights from Text N a m e d E n t i t i e s • A m a z o n . c o m : O r g a n i z a t i o n • S e a t t l e , W A : L o c a t i o n • J u l y 5 t h , 1 9 9 4 : D a t e • J e f f B e z o s : P e r s o n K e y p h r a s e s • O u r c u s t o m e r s • b o o k s • b l e n d e r s • g r e a t p r i c e s S e n t i m e n t • P o s i t i v e L a n g u a g e • E n g l i s h A m a z o n . c o m , I n c . i s l o c a t e d i n S e a t t l e , W A a n d w a s f o u n d e d J u l y 5 t h , 1 9 9 4 b y J e f f B e z o s . O u r c u s t o m e r s l o v e b u y i n g e v e r y t h i n g f r o m b o o k s t o b l e n d e r s a t g r e a t p r i c e s
- 52. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend: Topic Modeling F u l l y m a n a g e d T o p i c m o d e l i n g s e r v i c e E x t r a c t u p t o 1 0 0 t o p i c s f r o m a c o r p u s o f d o c u m e n t s A u t o m a t i c a l l y o r g a n i z e s d o c u m e n t s i n t o t h e t o p i c s
- 53. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend: Use Cases Voice of Customer Analytics Semantic Search Knowledge Management/Discovery Analyzing what customer are saying about your brand, products and services Making search smarter by searching on keyphrase, sentiment and topic Organizing documents, categorizing by topic and personalizing experiences
- 54. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. AWS ML Stack Frameworks & Infrastructure AWS Deep Learning AMI GPU (P3 Instances) MobileCPU IoT (Greengrass) Vision: Rekognition Image Rekognition Video Speech: Polly Transcribe Language: Lex Translate Comprehend Apache MXNet PyTorch Cognitive Toolkit Keras Caffe2 & Caffe TensorFlow Gluon Application Services Platform Services Amazon Machine Learning Mechanical Turk Spark & EMR Amazon SageMaker AWS DeepLens
- 55. © 2017, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. !GO BUILD!