Electronic Caregiver has embraced the use of augmented reality, artificial intelligence, machine learning, and virtual avatars to transform how it provides health and aging services. In this session, learn how the company translated 20 years of research and clinical experience into an innovative new product line, Addison Care, built on AWS services. We provide an overview of the architecture and facilitate a discussion on selecting and integrating various services. Come prepared for a lively session.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How Avatars & AR Are Driving Innovation:
Lessons from Electronic Caregiver
Christine Morten
Sr. Design Technologist
AWS AR/VR
A R V 3 3 8 - R
Bryan Chasko
Chief Technology Officer
Electronic Caregiver
@BryanChasko

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Addison Care overview
Leveraging the web: AWS Amplify
Events: AWS Lambda & AWS Step Functions
Real world integration: Amazon Rekognition
Customers driving Amazon Sumerian innovations

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Breakout repeats
Monday, November 26th
How Avatars & AR Are Driving Innovation: Lessons from Life Support Medical
11:30 a.m. – 12:30 p.m. | MGM, Level 3, North Concourse 306, T1
Tuesday, November 27th
How Avatars & AR Are Driving Innovation: Lessons from Life Support Medical
8:30 a.m. – 9:30 a.m. | Aria East, Plaza Level, Orovada 3, T1
Friday, November 30th
How Avatars & AR Are Driving Innovation: Lessons from Life Support Medical
8:30 a.m. – 9:30 a.m. | Mirage, St. Croix A, T1

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Addison Care: Virtual caregiving
• Examine
• Observe
• Interview
• Evaluate
• Monitor
• Vitals
• Report
• Companionship
• Personal connection
• Mental health support
• Memory stimulation
• Overcome isolation
• IoT home control
• Insights
• Early intervention & status
monitoring
• Identify adverse drug reactions
• Fall assessments in real time
• Standard of care assessment
• Mood & countenance
• Results
• Identify medical conflicts
• Affordably fill gaps in care
• Reward features for adherence
• Coordinated communication
• Caregiver support and education
• Predictive capabilities

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amplify: Reducing the complexity
Creates agility in development
Deploys provisioning operations as code you can tie to your scene
“Auth” category authenticates users and secures their session
Quick to integrate due to ease of learning
Great Amplify documentation provides use cases to follow in Sumerian integrations
Lightweight modules easily allow deployment of functional features
Easy to use
Quick iteration ability of Sumerian combines with simple-to-deploy Amplify modules
Both Sumerian and Amplify give you a plug-n-play simple way of deploying features

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Plans of care

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Events: Lambda & Step Functions
Lambda: Connections to your AWS toolbox
Create limitless functionality without spending time on infrastructure
Connects to the majority of services in the AWS program
Lambda: Create operationally excellent Sumerian scenes
Create extremely lightweight Sumerian scenes
Offload computational load onto Lambda and focus your scene on UI
Step Functions allow simple orchestration of complex processes
Use Step Functions to string together Lambdas when you need them
Import securely into databases in your VPC, that is, serverless Amazon Aurora

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Medication management

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Real world integration: Amazon Rekognition
Add biometric capabilities to your user experience
High confidence rating with good training data
Adds an intuitive authentication factor for verification of identity
Create personalization
Know different users of your scene on sight
Quickly switch users/context based on who your host is talking to
Contextual awareness
Creates accessibility and context knowing where in the environment
the user is
Change host behavior based upon whether the user is interacting
with them

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Employee Amazon Rekognition
Amazon
DynamoDB

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Using hosts to customize your user experience
Procedural speech & animation
Automatic lip-synch of viseme animations to Amazon Polly phonemes
Create real-time conversations based on Amazon Lex bots without animators
Customization
Sumerian has an ever-expanding catalog of hosts, 3D models, clothes, and
movements
Gesture system allows you to create moods around interactions
Create empathy with connections
Head tracking allows the hosts to track a point of interest, that is, a user
Adding a personality to your bot interactions creates a feeling of
accountability

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

19. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Christine Morten
mortenc@amazon.com
SA Support
Vared Ram
ravarada@amazon.com
Jignesh Desai
jigned@amazon.com

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.