Graduate Studies Project

1. VR Controlled 3D City

2. Problem Statement & Solution

3. The Problem
Reality is a variable => different experience for each
individual.
Several individuals have various constraints to have a
basic experience with reality.
Constraints include => Old age, physical and mental
disability, lack of funds to travel or not enough
time.

4. The Solution
Virtual reality attempts to deliver a constant
experience to all.
Every individual, regardless of any kind of constraint
can have a virtual experience of a simulated
reality.
Virtual 3D city gives a virtual experience for all
users.
Other use cases => vision training, cognitive training

5. Architecture & Components

6. Overall Architecture
LAMBDA Server
Alexa Handler
(Node JS + Socket.io)
Node JS Chat App
AWS EC2 Server
Alexa Skill Settings
Voice to Text
Voice to Text Converted
Message Command
Voice Message

7. Data Flow Management
- Real-time 2 way communication b/w
server & client
- Using TCP Socket
- Across browser & mobile device
- 100% JavaScript based

8. Data Flow Management
- HTTP is stateless and not reliable
- Mechanism for browser-based app that
does not rely on multiple HTTP
connections
- Before socket.io …..
- Event emission on the server
- Client listeners listen in a bi-
directional manner

9. Data Flow Management
Server
Client
Client
Client
2
3
4
1

10. Data Flow Management
Server
Client
Client
Client
2
3
4
1

11. Data Flow Management
Server
Client
Client
Client
2
3
4
1

12. Data Flow Management
2
3
1
4

13. Data Flow Management
2
3
1
4

14. Data Flow Management
2
3
1
4
json
json
json
json

15. Data Flow Management

16. Data Flow Management
1
2
3

18. Unity 3D Virtual Interface
Virtual representation of a model 3D city is created.
User has a 360 degree view of his/her surroundings.
Several viewpoints included for the user.
These include => Home, Bridge, Mall etc.
Accessed using mobile assistant and voice assistant.

22. Voice Assistant

23. Mobile Assistant and Voice Assistant
Used to shift between the different locations.
Mobile Assistant => 2 input modes => Text and Voice.
Text - identifies the name of the location.
Voice - Speech recognition used to decipher location.
Voice assistant => Alexa commands.

24. Web Interface