Project Presentation
On
A VISION BASED APPLICATION FOR
VIRTUAL MOUSE INTERFACE USING
FINGER TIP
Group No:21

Group Members...
Project objective
The objective is to manage computers and other devices
with gestures rather than pointing and clicking a...
Problem Statement
To design vision based mouse which detects hand
gestures patterns instead of physical mouse.
Basically w...
Introduction
• As computer technology continues to develop, people have
smaller and smaller electronic devices.
• Increasi...
Application and Future work
• control of cursor and clicking action in various devices.
•In the future, we plan to add mor...
Flow chart

DEPARTMENT OF ELECTRONICS &
COMMUNICATION
Detailed flow chart

DEPARTMENT OF ELECTRONICS &
COMMUNICATION
1.Image Resize
Map camera coordinates to screen
coordinates.

2.Segmentation
Separate the hand area from a complex
backgro...
3.Denoise
Need to delete noisy pixels from the image.
We use an image morphology algorithm
that performs image erosion and...
5.Finding finger tip
The convex hull algorithm is used to solve
the problem of finding the biggest polygon
including all v...
6.Controlling Mouse
Weighted speed cursor control. We get a
difference of the finger of the current
image and the previous...
Hardware And Software Requirements
• Web cam at least 30 frames/second, 640x480 resolution

• MATLAB(DIP tool )

DEPARTMEN...
Conclusion
• We are developing a system to control the mouse cursor
using a real-time camera.
• This system is based on co...
Advantages
•The main advantage of using hand gestures is to interact
with computer as a non-contact human computer input m...
DEPARTMENT OF ELECTRONICS &
COMMUNICATION
Upcoming SlideShare
Loading in …5
×

project presentation on mouse simulation using finger tip detection

1,731 views

Published on

Published in: Education, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,731
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
126
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

project presentation on mouse simulation using finger tip detection

  1. 1. Project Presentation On A VISION BASED APPLICATION FOR VIRTUAL MOUSE INTERFACE USING FINGER TIP Group No:21 Group Members with Roll No 1.Sumit Varshney(1109131911) 2.Bhuvnesh Gaur(1109131905) 3.Yatendra Kumar(1009131118) DEPARTMENT OF ELECTRONICS ENGINEERING DEPARTMENT OF ELECTRONICS & COMMUNICATION
  2. 2. Project objective The objective is to manage computers and other devices with gestures rather than pointing and clicking a mouse or touching a display directly. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  3. 3. Problem Statement To design vision based mouse which detects hand gestures patterns instead of physical mouse. Basically we use detection of finger tip which are captured by webcam. The camera is positioned such that it recognizes the motion of finger tips and performs the operations of mouse. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  4. 4. Introduction • As computer technology continues to develop, people have smaller and smaller electronic devices. • Increasingly we are recognizing the importance of human computing interaction (HCI), and inparticular vision-based gesture and object recognition. • In our project, we propose a novel approach that uses a video device to control the mouse system(Mouse tasks). • We employ several image processing algorithms to implement this. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  5. 5. Application and Future work • control of cursor and clicking action in various devices. •In the future, we plan to add more features such as enlarging and shrinking windows, closing window, etc. by using the palm and multiple fingers. We can also open the browser or any drives (C: /D:/E: etc)with the help of hand gestures instead of moving the cursor. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  6. 6. Flow chart DEPARTMENT OF ELECTRONICS & COMMUNICATION
  7. 7. Detailed flow chart DEPARTMENT OF ELECTRONICS & COMMUNICATION
  8. 8. 1.Image Resize Map camera coordinates to screen coordinates. 2.Segmentation Separate the hand area from a complex background. we converted from RGB color space to YCbCr color space, and then to binary image. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  9. 9. 3.Denoise Need to delete noisy pixels from the image. We use an image morphology algorithm that performs image erosion and image dilation to eliminate noise. Erosion trims down the image area where the hand is not present. Dilation expands the area of the Image pixels which are not eroded. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  10. 10. 5.Finding finger tip The convex hull algorithm is used to solve the problem of finding the biggest polygon including all vertices. we can detect finger tips on the hand. We used this algorithm to recognize if a finger is folded or not. Check the distance between the center and a pixel which is in convex hull set. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  11. 11. 6.Controlling Mouse Weighted speed cursor control. We get a difference of the finger of the current image and the previous image and compute the distance between the two. Next, we move the mouse cursor if the gap between the two finger images (current and previous frame) is far then the mouse cursor moves fast or, if the gap is close then the cursor moves slow. clicking Scrolling. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  12. 12. Hardware And Software Requirements • Web cam at least 30 frames/second, 640x480 resolution • MATLAB(DIP tool ) DEPARTMENT OF ELECTRONICS & COMMUNICATION
  13. 13. Conclusion • We are developing a system to control the mouse cursor using a real-time camera. • This system is based on computer vision algorithms and can do all mouse tasks. • However, it is difficult to get stable results because of the variety of lighting and skin colors of human races. • This system could be useful in presentations and to reduce work space. •Features such as enlarging and shrinking windows, closing window, etc. by using the palm and multiple fingers. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  14. 14. Advantages •The main advantage of using hand gestures is to interact with computer as a non-contact human computer input modality. • Reduce hardware cost by eliminating use of mouse. • Convenient for users not comfortable with touchpad. • The framework may be useful for controlling different types of games and other applications dependent on the controlled through user defined gestures. DEPARTMENT OF ELECTRONICS & COMMUNICATION
  15. 15. DEPARTMENT OF ELECTRONICS & COMMUNICATION

×