Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Utilizing Kinect Control for a More
Immersive Interaction with 3D
Environments
Supervised by
Dr. Noor Shaker Dr. Ammar Jou...
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structur...
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structur...
“Why using a
stylus when God
gave us ten
fingers!”
Steve Jobs when introducing
the first iPhone, 2010
Good design looks great, yes,
Good design looks great, yes,
but
smell great and sound great?
Good design looks great, yes,
but
why shouldn't it also feel great,
smell great and sound great?
Good design looks great, yes,
but
why shouldn't it also feel great,
Jinsop Lee
“Design for all 5 senses”
The Concept of
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structur...
The player mostly has only one method to interact with the
game (most games has the same playing peripherals) like
joystic...
Most games don’t let the player to create their own
content worlds and share it with others.
For most games there’s no direct interaction between the game
and the player (only one way from the player to the game)
For most games there’s no direct interaction between the game
and the player (only one way from the player to the game)
A Game For You to Use
Your Senses
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structur...
Sketching a Level
Sketch Your Level
Using Kinect
Interaction with the environment
Hand Gesture
Interaction with the environment
Voice Command
Our Game
Put here a picture or a short video of the
game. Just so that people know what are
you talking about
The Immersion Process
Player
Sketch
Generating
basic Level
Canvas
Allow Edit and
Generation of
Content
The Immersion Process
Player
Sketch
Generating
basic Level
Canvas
Allow Edit and
Generation of
Content
Hand Gesture
Interaction with
Dynamic
Hand Gesture
Interaction with
Static
Hand Gesture
Dynamic Hand Gesture
• Animated gestures
Static Hand Gesture
• Comparison with reference images
• Using machine learning
• Rule based system
Select
Rotate
Delete
Move
The gestures
that we will use
Hand gesture in our application
Dynamic
Hand Gesture
Static
Hand Gesture
Hand gesture in our application
Dynamic Hand Gesture
Discrete Markov
Processes
Static Hand Gesture
Rule based
system
Hand gesture in our application
Interaction via Voice Commands
Voice Command
• Audio to text conversion
Voice Command
• Speech Recognition
 Hidden Markov Model
Voice Command
• Words Meaning
 Conceptual Grammar
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structur...
Our Application
Generate 3D environment and edit it using most of your senses!
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structur...
Future Perspective
• Enhance the social aspect of the game
• Multiple player playing at the same time at the same
level
• ...
Content
• Motivation
• The Problem with Today’s Games
• Modeling
• Sketching a Level
• Generating the Basic Level Structur...
Thanx for listening!
Utilizing Kinect Control for a More Immersive Interaction with 3D Environment
Upcoming SlideShare
Loading in …5
×
Upcoming SlideShare
C# Starter L07-Objects Cloning
Next
Download to read offline and view in fullscreen.

1

Share

Download to read offline

Utilizing Kinect Control for a More Immersive Interaction with 3D Environment

Download to read offline

Utilizing Kinect Control for a More Immersive Interaction with 3D Environment. Implemented by Saed Haj Ali, Kinda Tarboush and Marah Halawah and Supervised by me, Dr. Noor Shaker and Dr. Ammar Joukhadar.

Related Books

Free with a 30 day trial from Scribd

See all

Utilizing Kinect Control for a More Immersive Interaction with 3D Environment

  1. 1. Utilizing Kinect Control for a More Immersive Interaction with 3D Environments Supervised by Dr. Noor Shaker Dr. Ammar Joukhadar Eng. Mohammad Shaker Designed, Implemented and Tested by Mohammed Saed Haj Ali Marah Halawa Kinda Tarboush F.I.T.E of Damascus, Syria – AI Department 2014
  2. 2. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  3. 3. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  4. 4. “Why using a stylus when God gave us ten fingers!” Steve Jobs when introducing the first iPhone, 2010
  5. 5. Good design looks great, yes,
  6. 6. Good design looks great, yes, but
  7. 7. smell great and sound great? Good design looks great, yes, but why shouldn't it also feel great,
  8. 8. smell great and sound great? Good design looks great, yes, but why shouldn't it also feel great,
  9. 9. Jinsop Lee “Design for all 5 senses” The Concept of
  10. 10. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  11. 11. The player mostly has only one method to interact with the game (most games has the same playing peripherals) like joystick or mouse
  12. 12. Most games don’t let the player to create their own content worlds and share it with others.
  13. 13. For most games there’s no direct interaction between the game and the player (only one way from the player to the game)
  14. 14. For most games there’s no direct interaction between the game and the player (only one way from the player to the game)
  15. 15. A Game For You to Use Your Senses
  16. 16. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  17. 17. Sketching a Level Sketch Your Level
  18. 18. Using Kinect
  19. 19. Interaction with the environment Hand Gesture
  20. 20. Interaction with the environment Voice Command
  21. 21. Our Game Put here a picture or a short video of the game. Just so that people know what are you talking about
  22. 22. The Immersion Process Player Sketch Generating basic Level Canvas Allow Edit and Generation of Content
  23. 23. The Immersion Process Player Sketch Generating basic Level Canvas Allow Edit and Generation of Content
  24. 24. Hand Gesture Interaction with Dynamic Hand Gesture Interaction with Static Hand Gesture
  25. 25. Dynamic Hand Gesture • Animated gestures
  26. 26. Static Hand Gesture • Comparison with reference images • Using machine learning • Rule based system
  27. 27. Select Rotate Delete Move The gestures that we will use
  28. 28. Hand gesture in our application Dynamic Hand Gesture Static Hand Gesture
  29. 29. Hand gesture in our application Dynamic Hand Gesture Discrete Markov Processes Static Hand Gesture Rule based system
  30. 30. Hand gesture in our application
  31. 31. Interaction via Voice Commands
  32. 32. Voice Command • Audio to text conversion
  33. 33. Voice Command • Speech Recognition  Hidden Markov Model
  34. 34. Voice Command • Words Meaning  Conceptual Grammar
  35. 35. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  36. 36. Our Application Generate 3D environment and edit it using most of your senses!
  37. 37. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  38. 38. Future Perspective • Enhance the social aspect of the game • Multiple player playing at the same time at the same level • Assess the game immersions metrics • Allow for more immersive and enhanced gestures • Analyze the applicability of the approach on other hardware (like Oculus Rift) • Analyze the applicability of the approach on other game genres
  39. 39. Content • Motivation • The Problem with Today’s Games • Modeling • Sketching a Level • Generating the Basic Level Structure • Allow Edit and Creation on Content through in-game Interactions • Hand Gesture • Voice Command • Our Application • Future Perspectives • Demo
  40. 40. Thanx for listening!
  • AntoinePron

    Feb. 26, 2015

Utilizing Kinect Control for a More Immersive Interaction with 3D Environment. Implemented by Saed Haj Ali, Kinda Tarboush and Marah Halawah and Supervised by me, Dr. Noor Shaker and Dr. Ammar Joukhadar.

Views

Total views

1,057

On Slideshare

0

From embeds

0

Number of embeds

10

Actions

Downloads

20

Shares

0

Comments

0

Likes

1

×