The idea is to help users with menal health issues.

1. Be My Friend
Justin Grierson and Matt Williams
TADHack-mini London - April 9-10 2016

2. Problem
How do we
Solve Mental
Health Issues
Without a
Therapist

3. Solution
Using Tropo, Bluemix and
Javascript Libraries
To Determine
People’s Mental State

4. Demo 1

5. IVR platforms don’t generally support video

6. Architecture 2
Phone
(jsSIP)
IMS Core
(Clearwater)
App Server
(Web Browser!)
SIP
(/W
ebSocket)
SIP/W
ebSocket
WebRTC
“Server” side

7. Demo 2

11. Technology 2
● Browser itself acts as application server!
● WebRTC
● SIP.js
● Media Capture from DOM Elements API
● RecorderJS for recording to WAV file
● clmtrackr for face and emotion tracking
● three.JS and WebGL for 3D rendering
● MakeHuman (for human model)

12. Futures
● Integrated video and speech sentiment analysis
● Speech tone sentiment analysis
● RTP/WebRTC interworking using Dialogic
● Video support built into IVR platform?
● Other applications of video IVR
○ Mirroring to build trust
○ Barcode recognition
Source code at https://github.com/matt-williams/browser-app-server