This document describes a gesture recognition system (GRS) created by a group of students. The GRS allows users to control applications and files on a computer through hand gestures detected by a webcam. It works by capturing images of the user's hand, processing the images to identify gestures, and triggering corresponding computer actions. The system was tested across different operating systems and environments. While providing a more natural interface, gesture recognition systems also have limitations including high development costs and requiring specific lighting and gesture conditions.

1. GESTURE RECOGNITION
SYSTEM (GRS)
Group Partners:
Zain Bohri
Gargee Hiray
Gitesh Jethwa
Ashok Choudhary

2. Overview
• Introduction
• Problem Statement
• System Functional Requirement
• Project Design
• Testing
• Costing
• Applications and Limitations
• Advantage and disadvantage
• Future Enhancement

3. Introduction
• Gestures are a major form of human
communication. Hence gestures are found to
be an appealing way to interact with
computers, as they are already a natural part of
how we communicate.

4. Conceptual Diagram

5. Problem Statement
• The user needs to go under a long process to
open any Application, Folder & Files which
user uses frequently.
E.g. Opening WORD
• The any Application, Folder & Files which
user require frequently which under goes this
lengthy steps takes time

6. Principle Of Project
• The principle of our project is to provide a new
• Graphical User Interface (GUI)
• Make the system work efficiently

7. System Functional Requirements
• Software Requirements:
1. Java Development Kit
2. Java Media Framework
3. Operating System- Windows 9x onwards
• Hardware Requirements:
1. Web Camera
2. RAM- 512 MB(minimum)

8. System Level Diagram
Perform Action
«extend»
User
Capture Image
Transmit Image to System Web Cam
Normal User Physically Challenged
User
Locate Hand in Picture
Check for Errors
Conversion to Grayscale Image
Conversion to Binary Image
Gesture Recognition
System
Noise Removal
«extend»
Crop Image
Zooming in Binary Picture
Resizing Picture
«include»
Identify Gesture Update Background Picture

9. Important Modules Diagram
Image
width : integer 1..*
height : integer
size : integer
«powertype»
imagetype
Grayscale Binary
captures name: String name : String
Convert_grayscale() Convert_binary()
recognizes
User «interface»
1..* uses 1 Web Cam
name : String
Capture_image()
Capture_background()
perform_action()
«powertype»
UserType 1 Background
Gesture Recognition
name : String
System Updates
Physically Challenged type : String
1..*
Normal User
User
Module Name
Gesture Identification Image capture Error Checking Filter
no_of_fingures : integer image_name : String
Calculate_total_fingers() update_background() Check_errors() perform_noise_reduction()
Identify_gesture() validate_picture() check_noisy_pixels()
validate_no_of_hands() set_intensities()

10. Image Designing
• Our project is based totally on IMAGE PROCESSING.
• Java Media Framework is used for image and video processing by java.
Fig:- Image processing using JAVA MEDIA FRAMEWORK

11. Image Designing (contd..)
• Algorithm used: EDGE CUTTING ALGORITHM
• ZOOMING IN THE BINARY PICTURE.
•i.e. Converting Image 320*240 pixel size
• RECOGNIZING WHETHER THE HAND IS RIGHT OR LEFT.
• DETECTING WHETHER THE THUMB IS UP OR NOT.

12. Image Designing (contd..)
• EDGE COUNTING ANAYASIS .
• STORING THE IMAGE AT BACKEND.
• PERFORMING THE EVENT RELATED TO THE NUMBER OF EDGES
OF IMAGE.

13. Input/output Design
WebCamInterface
USER
USB PORT
PC
JMFInterface

14. User Interface

15. Testing
Different White Box Testing Methods Are Used Such As:
1.Unit Testing
The unit testing is performed for following modules:
• image capturing module.
• image processing module.
• gesture recognize module.
• event handling module.
Re-engineering of following two modules was required.
• Binary conversion of image.
• Noise removal from image.

16. Testing (contd..)
• Functional Testing for event handling module.
Measures Expected Results Observed Results
Check number of fingers. Execution of appropriate Execution of appropriate
action. action.
• Compatibility Testing
Measures Expected Results Observed Results
Windows XP Should Runs Properly Runs Properly
Windows 7 Should Run Properly Runs Properly
32-bit
Windows 7
64-bit Should run Properly Error of JMF
Re-engineering
• JMF patches for Windows 7 (64-bit) is required

17. COSTING
Number of Person = 4
Number of Computer = 2
Total Number of Hours of per person = 100 hr *4 = 400
Total Number of Hours of per Computer = 100 hr *2 = 200
Cost of per Hours of person = 10Rs
Cost of per Hours of Computer = 10Rs
Total Cost of Person Hours = Cost per Hours * Total Hours of Person
= 10 * 400
Total = 4000
Cost of Computer Hours = 10 * 200 = 2000Rs
Cost of Camera = 1*1000= 1000Rs
Total Cost of Software = Total Cost Of Human Hour + Total Use of Computer
Hours + Cost Of Camera + Extra cost
= 4,000+ 2,000 + 1000 +200
= 7,200Rs/-
Total Cost Of Module = Rs7,200/- .

18. Application
•Opening all basic applications merely on
gesture.
• E.g. Paint, Word, PowerPoint
• Performing basic operations such as
Refresh, Back, Enter
•Performing Cut, Copy & Paste operations
on folders and files.

19. Limitations
• Such systems are difficult to develop because
of the complexity and the cost of
implementation.
• Image Background should be kept black or of
any constant color while running the
application for proper functioning
• The gesture must be a hand gesture
• There should be a reference point to recognize
the gesture

20. Advantage
• Provides a natural way of interfacing with the
computers hence it is more users friendly.
• There is less wear and tear of the computer .
• Carpal-tunnel syndrome is increasing because
of the repetitive use keyboard and mouse.
Since this system does not use either of these
as input device, it improves to be healthier way
of interacting with the computers

21. Disadvantages
• The cost of implementation
• Such systems are difficult to develop as each
gesture is assigned a specific control
command, this system is not platform
independent since certain control commands
vary as the operating system varies.
• Eg windows7 open library where as xp opens
my computer

22. Future Enhancement
• This system could further be used effectively
and independently for different purposes such as
follows :
• Control of consumer electronics
• Interaction with visualization systems
• Control of mechanical systems
• Computer games
• Security System
• Television
• In ATM’s

23. CONCLUSION
• Gesture Recognition System is a research and
development project which performs the basic
operations of the computer by detecting the
human generated hand gestures and wit
• Finally we conclude that , This project has
given us tremendous exposure to the industry
working standards, which will definitely be
useful in the future as working could be done
without using any external equipments.

24. Web References
• http://www.javaworld.com
• http://www.java.sun.com
• http://sourceforge.net/projects/javaipl/
• http://www.products.sun.com
• http://www.javaguru.com
• http://www.sunmicrosystems.com

25. Book References
• Taming Java Threads:
• The Complete Reference : Java
• Java Black Book :
• Matthew T. Nelson “ Java Foundation Classes “ ,
McGraw-Hill Publication.

26. Any Questions??.

27. Thank You !