Summer Presentation 2014

1. Gestures and Sound
By Ashley Ongsarte
July 15, 2014
Mentor: Dr.McMullen

2. Biography of Ashley Ongsarte
lElk Grove, CA
2

3. Outline
Soccer for the Visually Impaired
Gesture Coding
Gesture Study 2
3

4. Soccer Background
Paralympic
Soccer
4

5. 5
Background Continued
3D Sound Demo

6. 6
Background Continued
Sound of Football

7. System Design
7

8. My Part
Sound Experimentation
Java, OpenAL
HeadSpace
Transferring the code
8

9. Next Steps
Combine sound code and kinect
code
Make sure all of it works on the
Udoo
9

10. 10
What I learned
Python
Terminal
Try different techniques

11. Gestures Background
Supported by Cable Labs
Creating system that allows physical
gestures, seen by the Kinect, to
control a system.
11

12. 12
The First Study
Wizard of Oz setup

13. Gestures Background Continued
Analyzing the videos
Creating one gesture for a
command based off of common
elements from the videos
13

14. Coding the gestures
Recognize different parts of a
gesture
Complications
Keep gestures unique
Keep gestures from being
recognized at the wrong time
1
4

15. Gesture Validity Study
Showed participants a video of each
gesture
Participants selected which
command went with each gesture
15

16. 16
Analysis
Participants were asked which gestures
were confusing.

17. Analysis
17

18. Analysis
18

19. Conclusion
C#
Visual Studio
19

20. 20
Acknowledgements
REU group mates
Chris and Ali
Shelby Darnell
Dr. McMullen

21. Questions?
21