3D POINTING GESTURE RECOGNITION FOR HUMAN-ROBOT INTERACTION

1. 3D POINTING GESTURE
RECOGNITION FOR HUMAN-
ROBOT INTERACTION

2. ABSTRACT
• In this project, a pointing gesture recognition method is
proposed for human-robot interaction.
• The pointing direction of the human partner is obtained
by extracting the joint coordinates and computing through
vector calculations.
• Using this method, robot is able to interpret the human
partner’s 3D pointing gesture based on the coordinate
information of his/her shoulder and hand.
• Real time home automation is to be achieved by adjusting
the position of the human’s hand relative to the head.
• The recognition performance and viability of the system
are tested through quantitative experiments.

3. EXISTING SYSTEM
• In existing system, only two dimensional gestures are used
• Having high error angle
• Speed control was not possible
• Less reliable and system performance is low

4. 12/21/2022
Sr.
No.
Name of author Name of Paper Publication Name Technique Used
1
Mr. Vichare Abhishek , Ms
Verma Shilpa
Embedded Web Server for
Home Appliances
(IJERA) (VNCET-30
Mar’12).
Server application
2
Kumar Sandeep and Qadeer
Mohammed Abdul
Application of AI in Home
Automation
(IACSIT) (Vol. 4, No. 6,
December 2012).
Artificial Intelligence
3 Javale Deepali
Home Automation and
Security System Using
Android ADK
(IJECCT), (March 2013) ,
Volume 3.
Android based system
4 Shukl Arti , Yadav Priyanka
Smart Homes-Based On
Mobile IP
(IJRITCC), Volume: 1 Issue: 4
, MAR 2013
Mobile IP technic
5
Tadimeti Hari Charan ,
Pulipati Manas
Overview of Automation
Systems and Home
Appliances Control using PC
and Microcontroller
(IJSR) , Volume 2 Issue 4,
April 2013.
PC and Microcontroller
4/22
Literature Review

5. PROPOSED SYSTEM
• In this system, it enables a robot to understand 3D human
pointing gestures in real time
• Achieving an acceptable average error angle between the
direction interpreted by the robot and the expected direction
• Speed control was introduced to improve the system
performance.
• Applications like guiding a vacuum to clean certain areas,
navigating a trolley in a grocery store etc.,

6. BLOCK DIAGRAM

7. Micro
Controller
Receiver
MAX
MAX
232
Power supply
Relay
Driver
Relay
Relay
LIGHT
1
LIGHT
2
BLOCK DIAGRAM

8. The aim of the project is to control home appliances like
Television, Refrigerator, and Lights and other home electrical
appliances using a 3d vision capturing system.
In this project a 3d vision capturing system is interfaced with a
PC and micro-controller and it is connected to relays to which
the appliances which are to be controlled are connected.
The micro-controller controls the relays for switching the
appliances, ON or OFF.
MAIN APPLICATION OF PROJECT

9. Home automation deals with providing a network in
the house which links
 computers & peripheral equipment.
 smart chip bearing household appliances like
dish washers, washing machines, microwaves
and other electrical appliances.
 sub-systems like Heating, Ventilation, Air-
conditioning (HVAC), and security systems.
What Is Home Automation

10. HARDWARE REQUIREMENTS
• AT89s52 MICROCONTROLLER
• 3D IMAGE PROCESSING SYSTEM
• 3D IMAGE CAPTURING CAMERA
• WIRELESS TRANSMITTER AND RECEIVER
• ROBO RELAY
• ROBOT MODEL
• USB

11. SOFTWARE REQUIREMENTS
• KEIL IDE
• EMBEDDED C

12. PIN Diagram Of Micro Controller Of AT89S8252

13. AT89S52
• VCC: pin 40-power supply.
• GND: pin 20-grounded.
• Port 0,port 1,port 2, port 3 are 8-bit bi-directional I/O ports.
• RST: pin 9 is reset pin. It is active high.
• ALE/prog: It is an output pin and is active high.
• PSEN: Program Store Enable is the read strobe to external
program memory.
• EA/VPP: Enables the device to fetch code from external
device.
• XTAL1 & XTAL2 are input and output of oscillator
amplifier.

14. LCD
• Features
– 16 Characters x 2 Lines
– 5x7 Dot Matrix Character + Cursor
– HD44780 Equivalent LCD Controller/driver Built-In
– 4-bit or 8-bit MPU Interface
– Standard Type
– Works with almost any Microcontroller
– Great Value Pricing

15. MOTOR DRIVER(L293D) :
Features:
• Wide supply-voltage range: 4.5V to 36V
• Separate input- logic supply & TTL compatible
• High-Noise-Immunity input
• Output current 1A per channel (600 mA for L293D)
• Peak output current 2 A per channel (1.2 A for
L293D)

16. DC MOTORS :
 Operation is based on simple electromagnetism
 Two 45 r.p.m DC motors
 Requires 12 volts of DC supply
BATTERY :
 1.5*4 volts battery for transmitter
 6*2 volts battery for receiver

17. Motor driver :

18. ADVANTAGES OF HOME AUTOMATION
 Flexibility & Convenience
 Security
 Cost Saving
 Remote Control

19. Circuit diagram
12/21/2022 19/22

20.  Flexibility & Convenience
 Cost Saving
 Remote Control
 Controlling number of devices.
 Easy working mechanism could be easily understood.
 It is able to know the status of device to be controlled.
 Highly reliable, accurate and time saving system.
Advantages
12/21/2022 20/22

21. Applications
• This system used for computerization of office.
• This system used for computerization of home.
• This system used for computerization of industrial application.
12/21/2022 21/22

22. Conclusion
Necessity of automation is part of our day to day life. The
automated household things which are controlled by remotely
when plugged into a mains supply are in demand.
12/21/2022 22/22

23. References
[1] Mr. Vichare Abhishek , Ms Verma Shilpa ,“Embedded Web Server for Home
Appliances”, International Journal of Engineering Research and Applications (IJERA)
National Conference on Emerging Trends in Engineering & Technology (VNCET-30
Mar’12).
[2] Kumar Sandeep and Qadeer Mohammed Abdul , “ Application of AI in Home
Automation”, IACSIT International Journal of Engineering and Technology, Vol. 4, No. 6,
December 2012.
[3] Javale Deepali , “ Home Automation and Security System Using Android ADK”,
International Journal of Electronics Communication and Computer Technology (IJECCT) ,
(March 2013) , Volume 3.
[4] Shukl Arti , Yadav Priyanka , “ Smart Homes-Based On Mobile IP”, International
Journal on Recent and Innovation Trends in Computing and Communication, (IJRITCC),
Volume: 1 Issue: 4 , MAR 2013
12/21/2022 23/22

24. 12/21/2022 24/22