See how Public Sector organisations and AWS Partners are leveraging Smart Devices and Artificial Intelligence to create flexible, secure and cost-effective solutions. By integrating learning models to live video/audio, cameras can be transformed into flexible IoT devices that perform critical functions around public safety, security, property management, smart parking & environmental management. Observe how to architect these solutions using AWS services such as AWS IoT Core, AWS GreenGrass, AWS DeepLens, Amazon SageMaker and Amazon Alexas Speaker: Craig Lawton, Smart Australia & IoT Specialist, AWS

1. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Craig Lawton
IoT Specialist Architect, A/NZ Public Sector
Image Recognition: Real World
Applications

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
MACHINE LEARNING at Amazon
Personalized
recommendations
Inventing entirely
new customer
experiences
Fulfillment
automation and
inventory
management
Drones Voice driven
interactions

3. The Machine Learning Process Is Hard …

4. Fetch data
Clean &
format data
Prepare &
transform
data
The Machine Learning Process Is Hard …

5. Fetch data
Clean &
format data
Prepare &
transform
data
Train model
Evaluate
model
The Machine Learning Process Is Hard …

6. Fetch data
Clean &
format data
Prepare &
transform
data
Train model
Evaluate
model
Integration
with prod
Monitor /
debug /
refresh
The Machine Learning Process Is Hard …

7. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
A fully managed service that enables data scientists and developers to quickly and easily
build machine-learning based models into production smart applications.
Amazon SageMaker

8. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Amazon SageMaker
Fully managed
hosting with auto-
scaling
One-click
deployment
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
Hyperparameter
optimisation
BU IL D TR AIN D EPL O Y
DATA!!!

10. https://aws.amazon.com/ml-solutions-lab/

11. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
I N T HE AW S CLO UD
Application
services
Training InferenceTuning
Machine Learning in the Cloud

12. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
I N T HE AW S CLO UD
Inference
DE V I C E S & L A M B DA @ E D G E
Application
services
Training InferenceTuning
Machine Learning in the Cloud
And at the EDGE

13. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
I N T HE AW S CLO UD
Inference
DE V I C E S & L A M B DA @ E D G E
Application
services
Training InferenceTuning
Machine Learning in the Cloud
And at the EDGE

14. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Sophisticated models
in the cloud
Language and
speech models
Machine Learning in the Cloud
And at the EDGE
Amazon Echo

15. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Sophisticated models
in the cloud
Vision
Models
Machine Learning in the Cloud
And at the EDGE
AWS DeepLens

16. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DeepLens

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DeepLens Project Components

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Import Model

20. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
AWS DeepLens Artifacts
Model
AWS IoT
AWS Greengrass
Device Stream
Project Stream
(optional)
Scene
Device

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Greengrass Inference Function

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Get a Frame, Run Inference

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Inference Output (MQTT)

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Optimising A Custom Model
Optimises a custom model to CI-DNN format so it can run on the GPU

25. http://benchmark.ini.rub.de/?section=gtsrb
&subsection=dataset
• Single-image, multi-class classification
problem
• More than 40 classes
• More than 50,000 images in total
• Image sizes vary between 15x15 to
250x250 pixels

26. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
AWS DeepLens Artifacts
Model
AWS IoT
AWS Greengrass
Device Stream
Project Stream
(optional)
Scene
Device

27. AWS DeepLens runs AWS Greengrass
Edge Cloud
Machine
inference
Inference Training

28. AWS DeepLens runs AWS Greengrass
Edge Cloud
Machine
inference
Inference Training

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Optimising A Custom Model
Optimises a custom model to CI-DNN format so it can run on the GPU
OpenVINO Toolkit

30. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
OpenVINO / Intel
• CPU, GPU, Intel® Movidius™ Neural Compute Stick, and
FPGA—using a common API
• Speeds time to market
• Optimized calls for OpenCV and OpenVX
• https://github.com/intel/Edge-optimized-models
• MobileNet 1, MobileNet 5, SqueezeNet 5 for
Pedestrians, Cars, Buses, Bicycles and Motorcycles

31. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Where do I want to process data?
CloudEdge

32. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Law of Economics
Where do I want to process data?
Edge Cloud
Law of Physics
Law of the Land

33. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Law of Economics
Where do I want to process data?
Edge Cloud
Law of Physics
Law of the Land

34. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Where do I want to process data?
I n f r a s t r u c t u r e C l o u dP o PI o T E n d p o i n t G a t e w a y A p p l i a n c e
C o m m o n P r o g r a m m i n g M o d e l
O n b o a r d
A W S
C l o u d
L a m b d a
@ E d g e
A m a z o n
F r e e R T O S
G r e e n g r a s s

35. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
A W S
C l o u d
G r e e n g r a s s
Where do I want to process data?
You are here
I n f r a s t r u c t u r e C l o u dP o PI o T E n d p o i n t G a t e w a y A p p l i a n c eO n b o a r d
A m a z o n
F r e e R T O S
L a m b d a
@ E d g e

36. AWS Greengrass ML Inference
Voice/sound
recognition
Collision
avoidance
Image
recognition
Anomaly
detection
More
!
Inference TrainingEdge Cloud
Some use
cases
Machine
inference

37. Lots of options…
New Features
Machine Inference
Protocol Adapters
Over the Air Updates
Local Resource Access
Works with Amazon FreeRTOS
Broader Ecosystem
more distributions
preview
coming soon
New Languages
New
New

38. We build IoT solutions through our good friends
AWS Partner Community
System Integrators
Network
Connectivity
OEM/ ODM
ISVs
Silicon / Chipset / Module
AWS IoT
Things Cloud
Intelligence
Gateways

39. What will you build?
https://docs.aws.amazon.com/deeplens/latest/dg/deeplens-templated-projects-overview.html
https://aws.amazon.com/deeplens/community-projects/

40. Thank you