This document discusses using music to engage and empower those with dementia. It proposes developing an app called "Videoke" that allows users to sing together over video chat. The app would use personalized music to decrease anxiety and increase joy. The document considers options for the app's programming and settles on using the Zoom SDK for its documentation, large user base, and cross-platform capabilities. Future work includes updating the UI design and testing a working prototype.

1. ZOOM SDK: VIDEOKE
CAPSTONE BRAIN MUSIC LAB

2. MUSIC AND MEMORY LOSS
“The number of people living with dementia worldwide is 44
million and it will triple to more than 135 million in 2050”
(Baird, 2015)
While there is no cure for dementia, therapeutic methods
are centered around:
• Decreasing agitation and anxiety
• Increasing feelings of joy and relaxation

3. MUSIC AND MEMORY LOSS
Music interventions generally fall under three categories:
1. Personalized music engagement (group or individual)
2. Music to recover memories
3. Communication and self-expression enhancement
through music
“(S)inging and listening to music can target different domains of depression symptoms in
individuals with mild to moderate dementia” (Sarkamo, 2016)

4. OUR OBJECTIVE: MUSIC INTERACTION TO EMPOWER AND
ENGAGE
Project Goals:
1. Use the powerful effects of music listening and interaction to empower and
engage people with Mild Cognitive Impairment (MCI), Alzheimer’s disease, or
dementia and loved ones involved in their care
2. Create a dynamic music technology experience that is interactive and
personalized, allowing people with dementia to connect with their peers and
make music together
“You’re always so happy when you come back from choir
practice!” – son to CEP participant

5. NAVIGATING THROUGH THE APP

6. NAVIGATING THROUGH THE APP

7. APP DRAFT – WELCOME SCREENS

8. APP DRAFT – MAIN EXPERIENCE PAGE

9. APP DRAFT – SINGING!

10. APP DRAFT – REFLECTION AND FINAL SCREEN

11. APP DRAFT – REFLECTION AND FINAL SCREEN

12. IPAD VISUAL

13. SOLVING LATENCY

14. OPTIONS FOR PROGRAMMING
Jitsi API
- Open-source and free
- Works by launching Chrome instance
- SDK available for multiple devices
Vidyo.io
- Uses Xamarin (C#)
- Real-time, professional grade
- Sadly not free, but pricing scales with
organization

15. We decided after some experimenting that the best option is
the Zoom SDK, an open-source software development kit from
the biggest video conferencing app on the market.
• Detailed documentation
• Large user base & dev forums
• Top-level features
• Cross-platform
• Xcode-friendly
• Secure by means of JWT
ZOOM.US

16. JWT.IO

17. HELLO, WORLD!

18. FUTURE OF VIDEOKE
Future Project Work:
• Updated UI Design – larger Zoom screen, scrolling
lyrics at bottom, ability to react with emojis
• Working Zoom prototype
• Reviewing Videoke prototype with CEP participants