In this session, we showcase how augmented reality (AR) can be used to create a "digital twin" for use in real-time, in-field monitoring of equipment and machines. We demonstrate a hands-on experience and showcase the reference architecture of integrating AWS IoT, ML, and Amazon Sumerian. For enterprise customers, we also show the benefits of integrating AWS Amplify for security and privacy.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
IoT at the Edge: Using AR & ML to
Provide Real-Time Industrial Monitoring
Tim Wilson
Innovation Lab Product Manager
AWS WWPS
A V R 3 5 3 - R
Chris Azer
IoT Specialist Solution Architect
AWS WWPS

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Breakout repeats
Tuesday, 11/27
IoT at the Edge
4:00 p.m. – 5:00 p.m. | Venetian, Level 3, Murano 3202

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
We built this demo to show how AWS technologies can be combined to
build a 3D digital twin that can solve different use cases across industrial
automation, fleet management, maintenance, and technician training.

6. Digital twins drive the business impact of the
Internet of Things (IoT) by offering a powerful
way to monitor and control assets and
processes.
Gartner
Digital Twins

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use cases the demo addresses
• Operation and maintenance
• Operators have a real-time view into the status and state of assets and processes
• Field technicians can access an interactive digital “manual” that reacts to the state of an
asset
• Training
• Amazon Sumerian provides a platform to build “look inside” views that can be used to train
operators and technicians on the operation and maintenance of assets and processes via
augmented or virtual environments

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Main parts of the demo
• An IoT connected conveyor belt (built in our lab)
• AWS IoT service is used to control the operation of the conveyor belt and report conveyor
operational data such as rpm and vibrations for analysis and reporting
• A Sumerian application that enables a 3D “digital twin” of the conveyor
belt that provides the virtual replica of the conveyor belt
• An AWS DeepLens has been trained with a machine learning model to
detect weapons that are moving across the conveyor belt and report
via the IoT service and Sumerian application

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

11. Amazon
Sumerian
AWS IoT
Core
Amazon
FreeRTOS
AWS DeepLens
Amazon
Cognito
Amazon Polly
High-level architecture overview
Sync Shadow
Transmit Telemetry Sumerian publishes
cross-platform scene
Syncs with conveyor shadow
and updates scene based on
conveyor state

12. Sumerian Scene
Reported state
Desired state
Direction arrows (state machines)
AWS IoT Shadow

13. Digital Twin
Sumerian Scene
Reported state
Troubleshooting walkthrough (timelines)
AWS IoT Shadow

14. Sumerian Scene
Amplify (authentication and IoT policy)
Amazon
Cognito
+
User
React Hosting
on Amazon S3
AWS IoT Core

15. Sumerian Scene
IoT subscription options
React Hosting
on S3
AWS IoT Core
Sumerian Scene
AWS IoT Shadow
Sumerian Scene
AWS IoT Core
Get AWS IoT
Shadow
Subscribe to IoT
shadow and
telemetry data

16. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tim Wilson
Chris Azer

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.