This document describes a project that aims to create a more immersive 3D gaming experience through the use of Kinect control and interactions beyond traditional peripherals. It allows the player to sketch levels, which are then generated in the game. Players can edit and create content using hand gestures and voice commands recognized through techniques like hidden Markov models. The goal is to involve more of the player's senses and allow for shared social experiences. Future work could enhance social aspects, test with additional hardware, and analyze immersion metrics and applications to other genres.
1. Utilizing Kinect control for a more
immersive interaction with 3D
environments
Supervised by
Dr. Ammar Joukhadar Dr. Noor Shaker Eng. Mohammad Shaker
Designed, Implemented and Tested by
Mohammed Saed Haj Ali Marah Halawa Kinda Tarboush
F.I.T.E of Damascus, Syria – AI Department 2014
2. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
3. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
4. “Why using a
stylus when God
gave us ten
fingers!”
Steve Jobs when introducing
the first iPhone, 2010
11. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
12. The player mostly has only one method to interact with the
game (most games has the same playing peripherals) like
joystick or mouse
13. Most games don’t let the player to create their own
content worlds and share it with others.
14. For most games there’s no direct interaction between the game
and the player (only one way from the player to the game)
15. For most games there’s no direct interaction between the game
and the player (only one way from the player to the game)
17. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
41. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
43. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
44. Future Perspective
• Enhance the social aspect of the game
• Multiple player playing at the same time at the same
level
• Assess the game immersions metrics
• Allow for more immersive and enhanced gestures
• Analyze the applicability of the approach on other
hardware (like Oculus Rift)
• Analyze the applicability of the approach on other game
genres
45. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo