ZendCon/OE: Machine Leaning in the Cloud

@awsgeek lucidchart.com
MACHINE
LEARNINGIn the Cloud

Jerry Hargrove
Cloud Architect &
Evangelist
www.awsgeek.com
at Lucidchart

What’s that?

Jet?
# Doors?
T-Tail??
X
Windows Wings? B
Livery?Engines?
#
Wheels?
A
C

@awsgeek lucidchart.comlucidchart.com

Agenda
.oOo.
WhatisMachineLearning?
WhatoptionsarethereonAWS?
Whichshouldyouchoose?

“afieldofcomputersciencethatusesstatistical
techniquestogivecomputersystemstheability
to"learn"withdata,withoutbeingexplicitly
programmed” - wikipedia
MachineLearning

MachineLearning
SupervisedLearning UnsupervisedLearning
Classification Regression Clustering Association

Classification
Isitahotdog?
yes
no

ArtificialIntelligenceClassification
“a380”
“747”
“737”
“a320”
Output
Inputs
Labels
Model

@awsgeek lucidchart.com@awsgeek
Classification ArtificialIntelligence

Y=mX+b

Y=log(X)

overfit!

ArtificialIntelligencePrediction
Unlabeled image

ArtificialIntelligencePrediction
“a320”
Unlabeled image

SupervisedLearningSupervisedLearning
Existing
Observations
Future
Predictions

SupervisedLearningSupervisedLearning
Advantages:
Youdefinethelabels
Youlabeltheinputs
Youcontroltheaccuracy
Disadvantages:
Canbecomplex
Canrequirealotofeffort
Cantakealotoftime

MachineLearning
onAWS

@awsgeek lucidchart.comwww.awsgeeklucidchart.com
AWSMachineLearningfor...
✓ Noobs
✓ Geeks
✓ Gurus

MachineLearningforNoobs
Servicesthatare:
- FullManaged
- Elastic&Scalable
- HighlyAvailable
- ResilienttoFailure
- CostEffective
NOASSEMBLY
REQUIRED
Machine
learning
viaAPI

Translate
Comprehend
Transcribe
Polly
Rekognition
Lex
Texttospeech
Image&videoanalysis
Conversationalbots
Languagetranslation
Naturallanguage
Speechrecognition

AmazonRekognition
Deeplearning-basedimage
andvideoanalysis
• Object, scene, activity
detection
• Facial recognition
• Content classification
• Text detection

<?php
require 'vendor/autoload.php';
$rek = new AwsRekognitionRekognitionClient([

<?php
'version' => 'latest',

<?php
'region' => 'us-west-2',

<?php
'credentials' => [
'key' => 'AKAI ...',
'secret' => 'YiaPmET ...'
]
]);

<?php
'credentials' => [
'key' => 'AKAI ...',
'secret' => 'YiaPmET ...'
]
]);
Don’tdothis

<?php
'region' => 'us-west-2'
]);
$res = $rek->detectLabels([

<?php
]);
'Image' => [ 'Bytes' => ... ]

<?php
]);
'Image' => [ 'Bytes' => ... ],
'MaxLabels' => 5

<?php
]);
'Image' => [ 'Bytes' => ... ],
'MaxLabels' => 5,
'MinConfidence' => 80
]);

<?php
]);
'Image' => [ 'Bytes' => ... ],
'MaxLabels' => 5,
'MinConfidence' => 80
]);
Results:
Person - 99.3%
Mountain Bike - 99.1%
Outdoors - 83.1%
Crest - 83.0%
Rock - 82.8

“That’s an airplane”

MachineLearningforNoobs
Servicesthatare:
- FullManaged
- Elastic&Scalable
- HighlyAvailable
- ResilienttoFailure
- CostEffective
NOASSEMBLY
REQUIRED
Usewhen:
- Theymatchyour
requirements
- Youdon’thave
timeorskills

GeekNoob Guru
AmazonRekognition,
Polly,Comprehend,Lex,
Translate,Transcribe
Microsoft Azure

GeekNoob Guru
AmazonRekognition,
Cloud(AutoML)Vision,
NaturalLanguage,Translate
Microsoft Azure

GeekNoob Guru
AmazonRekognition,
CognitiveServices:
Vision,Speech,Language,
Knowledge,SearchMicrosoft Azure

AWSMachineLearningfor...
✓ Noobs
✓ Geeks
✓ Gurus
Geeks

MachineLearningforGeeks
SOMEASSEMBLY
REQUIRED
Knowingjust
enoughtobe
dangerous

AmazonSageMaker
Build,train,anddeploy
MLmodelsatscale
• Ad targeting
• IoT & machine learning
• Credit default prediction
• Content quality prediction

<?php
$sage = new AwsSageMakerRuntimeSageMakerRuntimeClient([

<?php

<?php
]);

<?php
]);
$res = $sage->invokeEndpoint([

<?php
]);
'Body' => [ 'Bytes' => ... ],

<?php
]);
'Body' => [ 'Bytes' => ... ],
'ContentType' => 'application/x-image',

<?php
]);
'Body' => [ 'Bytes' => ... ],
'EndpointName' => 'classify-aircraft'
]);

<?php
]);
'Body' => [ 'Bytes' => ... ],
'EndpointName' => 'classify-aircraft'
]);
Results:
Boeing 737 - 99.3%
Airbus A320 - 32.1%
Airbus A319 - 19.0%
Airbus A318 - 3.0%
Boeing 747 - 0.1%
...

MachineLearningforGeeks
SOMEASSEMBLY
REQUIRED
Knowingjust
enoughtobe
dangerous
Usewhen:
- Needmore
flexibility
- Wantproviderto
manageinfra

GeekNoob Guru
AmazonRekognition,
AmazonSageMaker
AWSDeepLens
CognitiveServices:

GeekNoob Guru
AmazonRekognition,
AmazonSageMaker
AWSDeepLens
CloudMLEngine
CognitiveServices:

GeekNoob Guru
AmazonRekognition,
AmazonSageMaker
AWSDeepLens
CloudMLEngine
AzureMLServicesCognitiveServices:

SomethingforEveryone
✓ Noobs
✓ Geeks
✓ GurusGurus

MachinelearningforGurus
Wherethe
rubbermeets
theroad
ASSEMBLY
REQUIRED

AWSDeepLearningAMIs
Pre-configured
deeplearning
environments
• MxNet
• TensorFlow
• Gluon
• Caffe
…andmore
• PyTorch
• Chainer
• Theano
• Caffe2

GeekNoob Guru
AmazonRekognition,
AmazonSageMaker
AWSDeepLens
AWSDeep
LearningAMIs
CloudMLEngine

GeekNoob Guru
AmazonRekognition,
AmazonSageMaker
AWSDeepLens
AWSDeep
LearningAMIs
CloudDeepLearning
VMImage
CloudMLEngine

GeekNoob Guru
AmazonRekognition,
AmazonSageMaker
AWSDeepLens
AWSDeep
LearningAMIs
CloudDeepLearning
VMImage
CloudMLEngine
DataScience
VirtualMachines

Whichshouldyou
choose?

@awsgeek lucidchart.comlucidchart.com
There’smore
thanoneway
toskinacat

End-to-End
Curate Train Deploy
Quality
Quantity
Organization
Scalability
Availability
Resilience
Algorithms
Scalability
Accuracy

Amazon
Rekognition
Amazon
SageMaker
DeepLearning
VMImage
Curate
Train
Deploy
Curate
Train
Deploy
Curate
Train
Deploy
AWS
You

Noobs Geeks Gurus
Application
Developers
DataScientists
&Practitioners
Machinelearningisfor...

Whichisrightforyou?
● Cost
● Team
● Time
● Complexity
● Requirements
● Management
Consider:

Aircraft
Detector
TailNumber
Detector
Model
Trainer
Aircraft
Classifier
DLQ
Model
Store
Request
Dispatcher
Request
Queue
Request
Handler
Twitter Secret
Store
Request
Webhook
Permissions TextDetector
1
2 3 4
5
6
7
8 11
9
10
13
12

Anysufficientlyadvanced
technologyis indistinguishable
from magic. - Arthur C. Clark
“ ”

ThankYou!
Read more:
lucidchart.com/blog/cloud
Follow:
@awsgeekon Twitter
See more:
awsgeek.com

ZendCon/OE: Machine Leaning in the Cloud

Recommended

Recommended

More Related Content

Similar to ZendCon/OE: Machine Leaning in the Cloud

Similar to ZendCon/OE: Machine Leaning in the Cloud (20)

Recently uploaded

Recently uploaded (20)

ZendCon/OE: Machine Leaning in the Cloud