The "AI/ML services for developers" session from the Technical Track of the AWS Startup Day Kyiv 2018

1. AI/ML services for developers
Rob De Feo, Startup Solutions Architect

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon ML

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML @ AWS: Our Mission
Put machine learning in the hands of every
developer and data scientist.

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Application
Services
Platform
Services
Frameworks
&
Infrastructure
API-driven services: Vision & Language Services, Conversational Chatbots
AWS ML Stack
Deploy machine learning models with high-performance machine learning
algorithms, broad framework support, and one-click training, tuning, and
inference.
Develop sophisticated models with any framework, create managed, auto-
scaling clusters of GPUs for large scale training, or run inference on trained
models.

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Customer Running ML on AWS Today

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Application
Services
API-driven services: Vision & Language Services, Conversational Chatbots
AWS ML Stack

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition
Deep learning-based visual analysis service

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon
Rekognition
Object and scene detection
Facial analysis
Face comparison
Celebrity recognition
Image moderation
Deep learning-based visual analysis service

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Object & Scene Detection

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Analysis

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Crowd-Mode Face Detection

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Search

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Explicit Nudity
Nudity
Graphic Male Nudity
Graphic Female Nudity
Sexual Activity
Partial Nudity
Suggestive
Female Swimwear or Underwear
Male Swimwear or Underwear
Revealing Clothes
Image Moderation

18. Celebrity Recognition

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Text in Image

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition API example
aws rekognition detect-labels
–-image '{"S3Object":{"Bucket":"adhorn-reko","Name":"horse.jpg"}}'
{
"Labels": [
{
"Confidence": 99.29136657714844,
"Name": "Human"
},
{
"Confidence": 99.29136657714844,
"Name": "People"
},
{
"Confidence": 99.29136657714844,
"Name": "Person"
},
……

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition API example
aws rekognition detect-faces
--image '{"S3Object":{"Bucket":"adhorn-reko","Name":"horse.jpg"}}'
--attributes "ALL”
{
"FaceDetails": [
{
"BoundingBox": {
"Width": 0.05462963134050369,
"Top": 0.2880098819732666,
"Left": 0.4722222089767456,
"Height": 0.07292954623699188
}, "Landmarks": [
{
"Y": 0.31606796383857727,
"X": 0.48852023482322693,
"Type": "eyeLeft"
………

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Video
Deep learning-based visual analysis service

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Video in. People, activities, and details out.
Objects, scenes, and activities
Person detection and recognition
Person tracking
Celebrity recognition
Inappropriate content detection
Amazon Rekognition Video

24. Rekognition Video Analysis Service

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.http://timescapes.org/trailers/

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.http://timescapes.org/trailers/

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition Video API example
aws rekognition start-label-detection
--video '{"S3Object":{"Bucket":"adhorn-reko","Name":"bourne.mp4"}}’
{
"JobId": "a89eeae89ec38d8579a3a0bfc2bbf522ea5a939cdf751df4b3872d04e8394496”
}
aws rekognition get-label-detection
--jobId "a89eeae89ec38d8579a3a0bfc2bbf522ea5a939cdf751df4b3872d04e8394496”

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Polly
Deep learning-based Text-to-Speech service

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Polly
Use Cases
Content Creation
Mobile & Desktop Applications
Internet of Things (IoT)
Education & E-Learning
Telephony
Game Development
Key Features
55 Voices across 27 languages
Lip-Syncing & Text Highlighting
Fine-grained Voice Control
Custom Vocabularies
Available in 14 AWS regions

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
<speak xml:lang="en-US">
The price of this book is <prosody rate="60%">€45</prosody>
</speak>
A Focus On Voice Quality & Pronunciation
Support for Speech Synthesis Markup Language (SSML) Version 1.0
https://www.w3.org/TR/speech-synthesis

31. Polly API example
aws polly synthesize-speech
--text "It was nice to live such a wonderful live show"
--output-format mp3
--voice-id Joanna
--text-type text johanna.mp3
aws polly synthesize-speech
--text-type ssml
--text file://ssml_polly
--output-format mp3
--voice-id Joanna speech.mp3

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Translate
Neural Machine Translation Service

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Hello, what’s up? Do you
want to go see a movie
tonight?”
Amazon Translate
Natural and fluent language translation
"Bonjour, quoi de neuf ? Tu
veux aller voir un film ce
soir ?"
Amazon
Translate

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Automatically translates text between languages
Real-time translation Powered by deep
learning
24 Language pairs
(more to come)
Language detection

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Translate API example
aws translate translate-text
--endpoint-url https://translate.us-east-1.amazonaws.com
--region us-east-1
--text "hello, what’s up? Do you want to go see a movie tonight?"
--source-language-code "en"
--target-language-code "fr”
{
"TargetLanguageCode": "fr”,
"TranslatedText": "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?”,
"SourceLanguageCode": "en”
}

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Translate API example
aws translate translate-text
--endpoint-url https://translate.us-east-1.amazonaws.com
--region us-east-1
--text "hello, what’s up? Do you want to go see a movie tonight?"
--source-language-code "en"
--target-language-code "fr”
{
"TargetLanguageCode": "fr”,
"TranslatedText": "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?”,
"SourceLanguageCode": "en”
}
Context Awareness

37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Translation service

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe
Automatic speech recognition service

39. “Hello, this is Allan
speaking”
Automatic speech recognition service
Amazon
Transcribe

40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Support for
telephony audio
Timestamp
generation
Intelligent
punctuation and
formatting
Recognize
multiple
speakers
Custom
vocabulary
Multiple
languages
Automatic speech recognition service

41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
Natural Language Processing

42. Fully managed natural language processing
Discover valuable insights from text
Entities
Key Phrases
Language
Sentiment
Amazon
Comprehend

43. Support for large data sets and topic modeling
STORM
WORLD SERIES
STOCK MARKET
WASHINGTON
LIBRARY OF
NEWS ARTICLES *
Amazon
Comprehend
* Integrated with Amazon S3 and AWS Glue

46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend API example
aws comprehend detect-sentiment
--text "I love you"
--language-code "en”
{
"SentimentScore":
{
"Mixed": 0.005664939060807228,
"Positive": 0.9262985587120056,
"Neutral": 0.06511948257684708,
"Negative": 0.0029170133639127016
},
"Sentiment": "POSITIVE”
}

47. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Conversational Interfaces

48. Intents
A particular goal that the
user wants to achieve
Utterances
Spoken or typed phrases
that invoke your intent
Slots
Data the user must provide to fulfill the
intent
Prompts
Questions that ask the user to input
data
Fulfillment
The business logic required to fulfill the
user’s intent
BookHotel

49. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Scale
Business Logic
SecurityAnalytics
Text to Speech
Speech to Intent
End to
End
Native support &
maintains context
One-click
deployment
Completely managed
service
Native integration
with AWS Lambda
Encrypted
data in transit
& at rest
Monitor and
improve
Amazon Polly
integrated into API
ASR + NLU integrated
into one API
Dialog Management Deployment

50. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Platform
Services
AWS ML Stack
Deploy machine learning models with high-performance machine learning
algorithms, broad framework support, and one-click training, tuning, and
inference.

51. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon SageMaker
A fully managed service to quickly and easily
build machine-learning based models

52. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
End-to-End
Machine Learning
Platform
Zero setup Flexible Model
Training
Pay by the second
$
Amazon SageMaker
Build, train, and deploy machine learning models at scale

53. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Highly-optimized
machine learning
algorithms
BuildPre-built
notebook
instances
Amazon SageMaker

54. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Highly-optimized
machine learning
algorithms
One-click training
for ML, DL, and
custom algorithms
BuildPre-built
notebook
instances
Easier training with
hyperparameter
optimization
Train
Amazon SageMaker

55. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
One-click training
for ML, DL, and
custom algorithms
Easier training with
hyperparameter
optimization
Highly-optimized
machine learning
algorithms
Deployment
without
engineering effort
Fully-managed
hosting at scale
BuildPre-built
notebook
instances
Deploy
Train
Amazon SageMaker

56. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks
&
Infrastructure
AWS ML Stack
Develop sophisticated models with any framework, create managed, auto-
scaling clusters of GPUs for large scale training, or run inference on trained
models.

57. AWS Deep Learning AMI
• Easy-to-launch tutorials
• Hassle-free setup and configuration
• Pay only for what you use
• Accelerate your model training and deployment
• Support for popular deep learning frameworks

58. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Summary

59. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Vision
D e m o c r a t i z a t i o n o f M a c h i n e L e a r n i n g
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU MobileCPU IoT (Greengrass)
Platform
Services
Application
Services
Amazon
SageMaker
AWS
DeepLens
Rekognition
Image
Rekognition
Video
Speech
Polly Transcribe
Language
Translate ComprehendLex
Amazon Machine
Learning
Spark & EMR
Amazon
Mechanical Turk
TensorFlow GluonApache MXNet Cognitive Toolkit Caffe2 & Caffe PyTorch Keras

60. G O B U I L D !