Adrian Hornsby | Technical Evangelist | AWS
May 2017
Building AI-powered apps on AWS
<demo>
Polly, Reko & more
</demo>
@adhorn

What’s coming
1. A little bit history never kills
2. AI in AWS
1. Polly
2. Reko
3. Building Mobile apps
1. Cognito
2. CodeStar
4. Putting it all together

Artificial Intelligence
At Amazon

Artificial Intelligence
At Amazon

The (60 years) rise of Artificial Intelligence

https://en.wikipedia.org/wiki/Artificial_neural_network

The Curse of Dimensionality

The Advent Of Deep
Learning
Algorithms

Data
Algorithms
The Advent Of Deep
Learning

Data
GPUs
& Acceleration
Algorithms
The Advent Of Deep
Learning

Data
GPUs
& Acceleration
Cloud
Computing
Algorithms
The Advent Of Deep
Learning

Data
GPUs
& Acceleration
Cloud
Computing
Algorithms
AWS
The Advent Of Deep
Learning

Artificial Intelligence on AWS
Polly
Text-to-Speech
Rekognition Lex
Image Analysis ASR & NLU
Deep Learning AMI
Popular Frameworks

Artificial Intelligence on AWS
Polly
Text-to-Speech
Rekognition
Image Analysis

Artificial Intelligence on AWS
Polly
Text-to-Speech

Text In, Life-like Speech Out
Amazon Polly
“Today in Seattle, WA
it’s 11°F”
“Today in Seattle Washington
it’s 11 degrees Fahrenheit”
47 lifelike voices spread across 24 languages

“Today in Seattle, WA, it’s 11°F”
‘"We live for the music" live from the Madison Square Garden.’
1. Automatic, Accurate Text Processing
A Focus On Voice Quality & Pronunciation

2. Intelligible and Easy to Understand
1. Automatic, Accurate Text Processing
A Focus On Voice Quality & Pronunciation

2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
“Richard’s number is 2122341237“
“Richard’s number is 2122341237“
Telephone Number
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing

2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
4. Customized Pronunciation
“My daughter’s name is Kaja.”
“My daughter’s name is Kaja.”
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing

A Focus On Voice Quality & Pronunciation
https://www.w3.org/TR/speech-synthesis/<speak>
The spelling of my last name is
<prosody rate='x-slow'>
<say-as interpret-as="characters">Adrian</say-as>
</prosody></speak>

Duolingo voices its language learning service Using Polly
Duolingo is a free language learning service where
users help translate the web and rate translations.
With Amazon Polly our users
benefit from the most lifelike
Text-to-Speech voices
available on the market.
Severin Hacker
CTO, Duolingo
”
“
• Spoken language crucial for
language learning
• Accurate pronunciation matters
• Faster iteration thanks to TTS
• As good as natural human speech

<demo>
Amazon Polly API
</demo>

PollyCast

<demo>
Amazon PollyCast
</demo>
James Siri
Piotr Lewalskihttps://github.com/adhorn/amazon-polly-sample

Artificial Intelligence on AWS
Rekognition
Image Analysis

Amazon Rekognition
Deep learning-based image recognition service
Search, verify, and organize millions of images
Object and Scene
Detection
Facial
Analysis
Face
Comparison
Facial
Recognition

Object & Scene Detection

Object & Scene Detection

Facial Analysis

Facial Analysis

Facial Search

Facial Search

Collections

Bynder allows you to easily create, find and use
content for branding automation and marketing
solutions.
With our new AI capabilities,
Bynder’s software… now allows
users to save hours of admin
labor when uploading and
organizing their files, adding
exponentially more value.
Chris Hall
CEO, Bynder
”
“
With Rekognition, Bynder revolutionizes marketing admin tasks with AI capabilities

<demo>
Amazon Rekognition API
</demo>

Cognito support for Identity

How it works
Username
Password
Sign In
SAML
Identity Provider
Amazon Cognito
2. Get AWS credentials
API Gateway
Your APIs
DynamoDB S3
Lambda
Cognito User Pools

AWS.config.region = 'us-east-1'; // Region
AWS.config.credentials = new AWS.CognitoIdentityCredentials(
{
IdentityPoolId: 'us-east-1:873891a7-92b8-45c2-9c25-212bb7555bc1',
});
Simple to use with the SDK

curl -X POST -H "Authorization: $(aws cognito-idp admin-initiate-auth
--user-pool-id us-east-1_1ZkFb79PI
--client-id 5q4eiv7mmb59lpg6jf9ei82r2j
--cli-input-json file:///tmp/authflow.json
--query AuthenticationResult.IdToken
--output text --region us-east-1)"
-H "search-key: building" -H "Cache-Control: no-cache"
"https://xxx.amazonaws.com/prod/picture/search/"
| native2ascii -encoding UTF-8 -reverse
Simple to use with the CLI

AWS CodeStar
New integrated
AWS console UI for
developers
Start developing
on AWS in minutes
Manage software
delivery in one
place
Work across your
team, securely

Start projects quickly
with templates

Set up secure
team access

Configure projects with
continuous delivery
toolchain

Connect your IDE &
Start Coding

Manage delivery pipeline
and track issues

<demo>
Poliko
powered by Amazon Polly & Rekognition
</demo>

C o o r d i n a t e t h e c o m p o n e n t s o f d i s t r i b u t e d a p p l i c a t i o n s
u s i n g v i s u a l w o r k f l o w s
A W S S t e p F u n c t i o n s

Start
Sequential Steps
U p l o a d R AW f i l e
D e l e t e R AW f i l e
End
A W S S t e p F u n c t i o n s

S e l e c t i m a g e
c o n v e rt e r
RA W t o J P E G RA W t o P NGRA W t o TI FF
L o a d i n Da t a b a se
Start
End
Un s u p p or te d i m a g e
t yp eParallel Steps
A W S S t e p F u n c t i o n s

P r o c e s s p h o t o
Re s i ze i m a g e
Start
End
E xt r a c t m e t a d a ta Fa c i a l r e c o g n ition
L o a d i n Da t a b a se
Branching Steps
A W S S t e p F u n c t i o n s

https://github.com/awslabs/lambda-refarch-imagerecognition

<demo>
Image Recognition and Processing Backend
Step Functions
</demo>
https://github.com/awslabs/lambda-refarch-imagerecognition

Thank You!