Download to read offline
Uploaded byMohammed Saed Haj Ali
Utilizingkinect
This document describes a project that aims to create a more immersive 3D gaming experience through the use of Kinect control and interactions beyond traditional peripherals. It allows the player to sketch levels, which are then generated in the game. Players can edit and create content using hand gestures and voice commands recognized through techniques like hidden Markov models. The goal is to involve more of the player's senses and allow for shared social experiences. Future work could enhance social aspects, test with additional hardware, and analyze immersion metrics and applications to other genres.
Utilizingkinect
- 1. Utilizing Kinect controlfor a more immersive interaction with 3D environments Supervised by Dr. Ammar Joukhadar Dr. Noor Shaker Eng. Mohammad Shaker Designed, Implemented and Tested by Mohammed Saed Haj Ali Marah Halawa Kinda Tarboush F.I.T.E of Damascus, Syria – AI Department 2014
- 2. Content • Motivation • TheProblem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
- 3. Content • Motivation • TheProblem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
- 4. “Why using a styluswhen God gave us ten fingers!” Steve Jobs when introducing the first iPhone, 2010
- 6. Good design looksgreat, yes,
- 7. Good design looksgreat, yes, but
- 8. smell great andsound great? Good design looks great, yes, but why shouldn't it also feel great,
- 9. smell great andsound great? Good design looks great, yes, but why shouldn't it also feel great,
- 10. Jinsop Lee “Design forall 5 senses” The Concept of
- 11. Content • Motivation • TheProblem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
- 12. The player mostlyhas only one method to interact with the game (most games has the same playing peripherals) like joystick or mouse
- 13. Most games don’tlet the player to create their own content worlds and share it with others.
- 14. For most gamesthere’s no direct interaction between the game and the player (only one way from the player to the game)
- 15. For most gamesthere’s no direct interaction between the game and the player (only one way from the player to the game)
- 16. A Game ForYou to Use Your Senses
- 17. Content • Motivation • TheProblem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
- 18. Sketching a Level SketchYour Level
- 19.
- 20. Interaction with theenvironment Hand Gesture
- 21. Interaction with theenvironment Voice Command
- 22. Our Game Put herea picture or a short video of the game. Just so that people know what are you talking about
- 23. The Immersion Process Player Sketch Generating basicLevel Canvas Allow Edit and Generation of Content
- 24. The Immersion Process Player Sketch Generating basicLevel Canvas Allow Edit and Generation of Content
- 25. The Immersion Process Player Sketch Generating basicLevel Canvas Allow Edit and Generation of Content
- 26. Sketching a Level Puthere a picture of a sketch and a picture of the height map of the same sketch
- 27. The Immersion Process Player Sketch Generating basicLevel Canvas Allow Edit and Generation of Content
- 28. Sketch to LevelConversion Talk about the conversion from sketch to level and the cuboid algorithm you did (with picture)
- 29. The Immersion Process Player Sketch Generating basicLevel Canvas Allow Edit and Generation of Content
- 30. Hand Gesture Interaction with Dynamic HandGesture Interaction with Static Hand Gesture
- 31. Dynamic Hand Gesture •Animated gestures
- 32. Static Hand Gesture •Comparison with reference images • Using machine learning • Rule based system
- 33.
- 34. Hand gesture inour application Dynamic Hand Gesture Static Hand Gesture
- 35. Hand gesture inour application Dynamic Hand Gesture Discrete Markov Processes Static Hand Gesture Rule based system
- 36. Hand gesture inour application
- 37. Interaction via VoiceCommands
- 38. Voice Command • Audioto text conversion
- 39. Voice Command • SpeechRecognition Hidden Markov Model
- 40. Voice Command • WordsMeaning Conceptual Grammar
- 41. Content • Motivation • TheProblem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
- 42. Our Application Generate 3Denvironment and edit it using most of your senses!
- 43. Content • Motivation • TheProblem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
- 44. Future Perspective • Enhancethe social aspect of the game • Multiple player playing at the same time at the same level • Assess the game immersions metrics • Allow for more immersive and enhanced gestures • Analyze the applicability of the approach on other hardware (like Oculus Rift) • Analyze the applicability of the approach on other game genres
- 45. Content • Motivation • TheProblem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
- 46.