Join us to see how Public-sector organizations and AWS Partners are combining Smart Devices and Artificial Intelligence to create flexible, secure and cost-effective solutions. Applying machine learning models to live video/audio, cameras can be transformed into flexible IoT devices that perform critical functions around public safety, security, property management, smart parking & environmental management. Learn how these solutions are architected using AWS services such as AWS IoT Core, AWS GreenGrass, AWS DeepLens, Amazon SageMaker and Amazon Alexa.
6. Fetch data
Clean &
format data
Prepare &
transform
data
Train model
Evaluate
model
The Machine Learning Process Is Hard …
7. Fetch data
Clean &
format data
Prepare &
transform
data
Train model
Evaluate
model
Integration
with prod
Monitor /
debug /
refresh
The Machine Learning Process Is Hard …
8. A fully managed service that enables data scientists and developers to quickly and easily
build machine-learning based models into production smart applications.
Amazon SageMaker
9. Amazon SageMaker
Fully managed
hosting with auto-
scaling
One-click
deployment
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
Hyperparameter
optimisation
BU IL D TR AIN D EPL O Y
DATA!!!
13. I N T HE AW S CLO UD
Application
services
Training InferenceTuning
Machine Learning in the Cloud
14. I N T HE AW S CLO UD
Inference
DE V I C E S & L A M B DA @ E D G E
Application
services
Training InferenceTuning
Machine Learning in the Cloud
And at the EDGE
15. I N T HE AW S CLO UD
Inference
DE V I C E S & L A M B DA @ E D G E
Application
services
Training InferenceTuning
Machine Learning in the Cloud
And at the EDGE
16. Sophisticated models
in the cloud
Language and
speech models
Machine Learning in the Cloud
And at the EDGE
Amazon Echo
34. Optimising A Custom Model
Optimises a custom model to CI-DNN format so it can run on the GPU
OpenVINO Toolkit
35.
36. OpenVINO / Intel
• Enables CNN-based deep learning inference on the edge
• Supports heterogeneous execution across computer vision
accelerators—CPU, GPU, Intel® Movidius™ Neural Compute Stick,
and FPGA—using a common API
• Speeds time to market via a library of functions and preoptimized
kernels
• Includes optimized calls for OpenCV and OpenVX
• IEI* Integration Corporation and AAEON developer kits
• https://github.com/intel/Edge-optimized-models
• MobileNet 1, MobileNet 5, SqueezeNet 5 for Pedestrians, Cars,
Buses, Bicycles and Motorcycles
39. Where do I want to process data?
Edge Cloud
Law of Economics
Law of Physics
Law of the Land
40. Where do I want to process data?
Edge Cloud
Law of Economics
Law of Physics
Law of the Land
41. Where do I want to process data?
I n f r a s t r u c t u r e C l o u dP o PI o T E n d p o i n t G a t e w a y A p p l i a n c e
C o m m o n P r o g r a m m i n g M o d e l
O n b o a r d
A W S
C l o u d
L a m b d a
@ E d g e
A m a z o n
F r e e R T O S
G r e e n g r a s s
42. A W S
C l o u d
G r e e n g r a s s
Where do I want to process data?
I n f r a s t r u c t u r e C l o u dP o PI o T E n d p o i n t G a t e w a y A p p l i a n c eO n b o a r d
A m a z o n
F r e e R T O S
L a m b d a
@ E d g e
43. AWS Greengrass ML Inference
Voice/sound
recognition
Collision
avoidance
Image
recognition
Anomaly
detection
More
!
Inference TrainingEdge Cloud
Some use
cases
Machine
inference
44. Lots of options…
New Features
Machine Inference
Protocol Adapters
Over the Air Updates
Local Resource Access
Works with Amazon FreeRTOS
Broader Ecosystem
more distributions
preview
coming soon
New Languages
New
New
45. We build IoT solutions through our good friends
AWS Partner Ecosystem
System Integrators
Network
Connectivity
OEM/ ODM
ISVs
Silicon / Chipset / Module
AWS IoT building blocks
Things Cloud
Intelligenc
e Gateways
46. What will you build?
https://docs.aws.amazon.com/deeplens/latest/dg/deeplens-templated-projects-overview.html
https://aws.amazon.com/deeplens/community-projects/