This document discusses using augmented reality with ThingWorx and connecting devices through AWS IoT. It describes how IoT data can be ingested into ThingWorx from AWS IoT using a connector. This allows contextualizing the data and creating augmented reality experiences. Demos show using sensor data from devices to create AR experiences for predictive maintenance, design optimization, and service optimization.
0x01 - Newton's Third Law: Static vs. Dynamic Abusers
Augmented Reality with ThingWorx and Interconnected with Devices Through AWS IoT
1. AUGMENTED REALITY WITH THINGWORX AND INTERCONNECTED
WITH DEVICES THROUGH AWS IOT
Steve Dertien
SVP Technology
Office of the CTO
sdertien@ptc.com
April 26, 2017
Neal Hagermoser
Principal Partner Engineer
nhagermoser@ptc.com
IoT | AWS Loft Architecture Week
2. 2
Unlock the value created by the
convergence of the physical and
digital worlds
6. 66
PREDICTIVE MAINTENANCE TO REDUCE UNPLANNED DOWNTIME
Predicting alarms 24 hours in advance,
with a 91% accuracy
7. 7
ADDRESSING THE NEEDS FOR “LONG TAIL” APPLICATIONS
Level of
Usage
(Billions)
Number
of Apps
(Thousands)
• High-Volume
• Pixel-perfect
• Fast – Rapid application development
• Setting-perfect
App #1 App #N
Long Tail of B2B Apps
8. 8
• AWS IoT – Ingestion Layer
• AWS IoT Rule that forwards data to
Kinesis
• Kinesis is buffer between AWS IoT
and ThingWorx Connector
• ThingWorx Connector pulls data
from the stream and ingest into
ThingWorx platform
THINGWORX - AWS CONNECTOR
AWS IoT
AmazonKinesis
Streams
IoT
action
ThingWorx
AWS IoT
Connector
ThingWorx
Core
AWS Iot Edge
Node.js
AWS IoT ThingWorx
ThingWorx AR
Experience ServiceShadowRestAPI
Thing Shadow Format
AmazonKinesisClient
Library
Thing Model Format
9. 99
PHYSICAL/DIGITAL ORCHESTRATION
Business/IT
Systems
CAD & PLM
AEC & BIM
Digital Context
AWS IOT
Predix
Axeda
SAP Cloud
Edge/OT
Environments
Controllers Sensors
Historians
AWS IOT
Predix
Axeda
SAP Cloud
Edge/OT
Environments
Controllers Sensors
Historians
CAD & PLM
AEC & BIM
Digital Context
Business/IT
Systems
CONTEXTUALIZE
(Map Data
to Context)
SOURCE
(Data &
Context)
10. 10
• National Instruments BLE Sensor
• IOT Gateway to AWS IOT
• ThingWorx AWS Connector
• Contextualize Data
– Properties
– Services
– Events
DEMO
11. 1111
PHYSICAL/DIGITAL ORCHESTRATION
Analyze
Business/IT
Systems
CAD & PLM
AEC & BIM
Digital Context
AWS IOT
Predix
Axeda
SAP Cloud
Edge/OT
Environments
Controllers Sensors
Historians
Simulate
Analyze
Simulate
CONTEXTUALIZE
(Map Data
to Context)
SYNTHESIZE ORCHESTRATE
SOURCE
(Data &
Context)
17. 1717
AR/Wearables
TOMORROW
VR/Wearables
PHYSICAL/DIGITAL ORCHESTRATION
Desktop/Laptop
TODAY
Mobile
Analyze
Business/IT
Systems
CAD & PLM
AEC & BIM
Digital Context
AWS IOT
Predix
Axeda
SAP Cloud
Model
Digital Map
Digitize via scan, photo, or video
Simulate
AR/Wearables
TOMORROW
VR/Wearables
Model
Digital Map
Digitize via scan, photo, or video
Computer
Vision
Computer
Vision
CONTEXTUALIZE
(Map Data
to Context)
SYNTHESIZE ORCHESTRATE
ENGAGE
(Multi-Channel,
In Context
Role Based)
SOURCE
(Data &
Context)
Edge/OT
Environments
Controllers Sensors
Historians
19. 1919
CONTEXTUALIZE
(Map Data
to Context)
SYNTHESIZE ORCHESTRATE
ENGAGE
(Multi-Channel,
In Context
Role Based)
SOURCE
(Data &
Context)
SERVICE OPTIMIZATION
Mobile
Analyze
Business/IT
Systems
CAD & PLM
AEC & BIM
Digital Context
AWS IOT
Predix
Axeda
SAP Cloud
Digital Map
AR/Wearables
Computer
Vision
22. 22
INTRODUCING THE THINGWORX STUDIO SUITE
Create
Experiences
Consume
Experiences
Manage and Deliver
Experiences
ThingMark
Identify and
track Things
32. 3232
Desktop/Laptop
TODAY
Mobile
AR/Wearables
TOMORROW
VR/Wearables
PHYSICAL/DIGITAL ORCHESTRATION
Desktop/Laptop
TODAY
Mobile
Analyze
Business/IT
Systems
CAD & PLM
AEC & BIM
Digital Context
AWS IOT
Predix
Axeda
SAP Cloud
Edge/OT
Environments
Controllers Sensors
Historians
Model
Digital Map
Digitize via scan, photo, or video
Simulate
AR/Wearables
TOMORROW
VR/Wearables
AWS IOT
Predix
Axeda
SAP Cloud
Edge/OT
Environments
Controllers Sensors
Historians
CAD & PLM
AEC & BIM
Digital Context
Business/IT
Systems
Analyze
Simulate
Model
Digital Map
Digitize via scan, photo, or video
Computer
Vision
Computer
Vision
CONTEXTUALIZE
(Map Data
to Context)
SYNTHESIZE ORCHESTRATE
ENGAGE
(Multi-Channel,
In Context
Role Based)
SOURCE
(Data &
Context)
Editor's Notes
PTC is the ONLY company that can lead customers through the physical / digital convergence because of our deep domain experience in Engineering, Manufacturing and Service, combined with our industry leading technology platform to support the internet of things and augmented reality.
We are the ONLY company that can truly support a product across its entire product lifecycle.
Why - The lifecycle of a product has changed.
A product does not stop evolving once it has left the factory – the Internet of Things allows products to be enhanced once they are in the hands of the customer. No other vendor can support the lifecycle of a connected product.
IoT impacts every facet of the business…
From developing products and service offerings with connectivity and quality feedback in mind to give your products a voice…
…utilizing smart manufacturing/industry 4.0 to optimize the factory…
…marketing and selling your new products and offerings in new and exciting ways…
…driving new service models and offerings, as well as new business models (finance) that foster new levels of customer satisfaction and loyalty…
All the while delivering a strong connection to your customers because they are connected to your products and services.
And transforming IT from information tech to innovation technology! And the same can be said for OT, going from operational tech to optimization tech!
NOTE: This slide is a great cross-reference slide for the Transformational IoT Experience, the IoT Value Roadmap, and PTC Journeys of Transformation. If you want to go into more detail around use case examples, please review content related to those three assets.
ASK (or SAY): Do any of these concepts match to strategies that you are pursuing? (As you’ve mentioned, you have IoT strategies in XYZ departments).
Brilliant Factory software was used at the Grove City Pennsylvania factory to update the existing Microsoft Access based production management system with a robust, modern user interface and business logic layer. The solution is integrated with systems of record, provides exception based alerts, manages performance metrics, and facilitates collaboration.
The factory remanufacturers diesel engines for locomotives.
Scope: Visibility to job status and location
Solution: Mashup displays real-time production and schedule attainment via multiple form factors
Result: 10-20% reduction unplanned downtime
Additional reference information:
Rob Burnett https://www.linkedin.com/pulse/discrete-manufacturing-how-we-approaching-challenges-rob-burnett
As part of our pillar application simplification efforts we have implemented GE's Brilliant Manufacturing Suite in 5 plants. We offer a variety of re-manufacturing services on critical components throughout the life of a locomotive. The following challenges and lessons learned are from 3 of our plants in Kansas City, Las Vegas, and Grove City.
Problem Statement: We didn’t have information available to understand repair costs, root cause of part wear & tear, or the ability to make the best decisions on repair technologies. We needed to collect more re-manufacturing data from our shops to enable Engineering, Quality, Finance, and Operations to make the best decisions to serve our customers.
Challenge #1 - As we worked as a cross-functional team to define all the information we needed to collect, we quickly realized we would put a huge burden on our operators. So we spent weeks on the shop floor, learning how we could optimize data entry. We bar coded items, led design thinking sessions, built interfaces to our machine tools and other systems like ERP. This helped us minimize operator burden and is proof that these systems cannot be designed in a conference room... you need to get your hands dirty on the floor. This was an incredibly important part of change management for the operators.
Challenge #2 - Proving that the data we are collecting is worth the effort. We really started to get momentum when we started to demonstrate valuable data insights to our functional partners. Often times in IT projects, we plan to implement the systems then take care of the data analytics/BI as a future phase. If you're going to commit to benefits and value from the data - design it from the beginning and show it to them immediately! One great example of this is how we show progress of each line vs. production schedule. This helps the Operations leaders know exactly where they are and drive accountability. We also were able to highlight material issues and drive actions to the right support functions. We do this by displaying the metrics right on the shop floor digitally, driving accountability from the operator to the plant manager.
Challenge #3 - Demonstrating capability we've never achieved before. As part of our Digital Thread strategy we're trying new things at a rapid pace. We've deployed Fastworks methodology throughout these experiments to ensure we're truly focused on proving assumptions that will be critical to us scaling broadly. One way we're connecting our digital thread is from our service shops into our re-manufacturing plants. Our MES allows us to dynamically route parts through the shop avoiding unnecessary tear-down and repair work based on maintenance history. This enables quicker turn-around for our customers. Another way we enable the digital thread is by using data analytics on part wear & tear. This can help us make better design decisions and also substantiate investment in new repair technologies.
We're doing this through partnerships with GE Digital and leveraging the Brilliant Factory Suite. Anybody who has worked on major system implementations knows there are going to be plenty of challenges, I hope these lessons learned will help others. At GE, we've been eating our own cooking and now we would like to share our recipes with you.
Automotive Tier 1 Supplier
Processing ovens that heat condition components during manufacturing
An alarm on an oven requires a 30 minute cool down before it can be restarted causing production line stoppages resulting in thousands of dollars in productivity loss per alarm
With prediction the ability to alter the production plan to schedule in a restart can be accomplished without production stoppage and productivity losses