The document discusses how ThingLogix used Amazon Sumerian to create virtual hosts and objects for the VMworld 2018 conference. Assets like hosts were controlled dynamically using MQTT messages to trigger speech, gestures, and movements in real-time. ThingLogix Foundry was used to manage all assets as IoT devices and handle logic without cluttering the Sumerian scene. The system provided a virtual concierge to answer attendee questions about VMware and AWS services using Lex and Polly.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How ThingLogix Redefined the Conference
Experience for VMworld Attendees
Rob Rastovich
CTO
ThingLogix, Inc.
ARV355-R
Sam Rastovich
Software Engineer
ThingLogix, Inc.

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Dynamically controlling assets
Integrating ThingLogix Foundry
VMworld and use cases

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Dynamically controlling assets

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Creating assets as clients
Each Sumerian asset is an MQTT client
Hosts, objects are all clients connected via AWS IoT
Updates values in real-time, and communicates state outside scene
Dynamically control assets via messages
Keep all data in database, not stored in Sumerian
Keeps scene lightweight and easy to manipulate

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Host speech and gestures

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Hosts as assets
Sumerian hosts become assets
Speech, movement, and gestures controlled via MQTT
Trigger speech based on events and actions inside scene
Change speech on the fly—no need to hard code anything

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sample payload
{
“Asset”: “Cristine”,
“Message”: “Hello AWS ReInvent! This is Cristine!”,
“Gesture”: “wave”
}

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Orchestrating the scene

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ThingLogix Foundry
Asset management for IoT devices
Take actions based on messages coming through IoT client
Store messages and device states
Perform logic on device data
Everything is a device
Hosts, objects all stored in Foundry as devices
All logic is behind scenes to keep the scene lightweight and easy to manipulate

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use cases

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VMware

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VMware and VMworld
● Showcase new partnership between VMware and AWS
● Shown on floor at VMworld 2018
● Speak to host about various services VMware and AWS
offer
● Support Oculus Rift, HTC Vive, Oculus Go

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Architecture
● Lex
● Polly
● AWS IoT
● Orchestrated with Foundry

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Other use cases
Virtual concierge
Talk to virtual host
Recognize faces
Show floor maps
Showcase services
Answer questions about the
event

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demo/technical deep dive

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Redefining the UI

18. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Rob Rastovich
rob@thinglogix.com
Sam Rastovich
sam@thinglogix.com

19. Please complete the session
survey in the mobile app.
!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.