Implement an editor for 3D environment using Unity3D, Kinect and voice commands. The system enables the designer/gamer to design her own 3D world with own hands and own voice.
Immersive 3D Environment Using Kinect and Voice Commands
1. Utilizing Kinect control for a more
immersive interaction with 3D
environments
Supervised by
Dr. Ammar Joukhadar Dr. Noor Shaker Eng. Mohammad Shaker
Designed, Implemented and Tested by
Mohammed Saed Haj Ali Marah Halawa Kinda Tarboush
F.I.T.E of Damascus, Syria – AI Department 2014
2. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
3. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
4. “Why using a
stylus when God
gave us ten
fingers!”
Steve Jobs when introducing
the first iPhone, 2010
11. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
12. The player mostly has only one method to interact with the
game (most games has the same playing peripherals) like
joystick or mouse
13. Most games don’t let the player to create their own
content worlds and share it with others.
14. For most games there’s no direct interaction between the game
and the player (only one way from the player to the game)
15. For most games there’s no direct interaction between the game
and the player (only one way from the player to the game)
17. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
41. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
43. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo
44. Future Perspective
• Enhance the social aspect of the game
• Multiple player playing at the same time at the same
level
• Assess the game immersions metrics
• Allow for more immersive and enhanced gestures
• Analyze the applicability of the approach on other
hardware (like Oculus Rift)
• Analyze the applicability of the approach on other game
genres
45. Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structure
• Allow Edit and Creation on Content through in-game
Interactions
• Hand Gesture
• Voice Command
• Our Application
• Future Perspectives
• Demo