This document describes a final year project to develop a gesture controlled robotic arm. A team of 4 students will build the robotic arm and a wearable hand glove controller. Sensors in the glove will detect hand gestures which will wirelessly control the motion of the robotic arm. The aim is to allow intuitive human-machine interaction. The robotic arm will use servos for motion and the glove will use flex sensors and an accelerometer to detect gestures. An Arduino microcontroller will process the glove sensor data and send commands to the arm over Bluetooth. Potential applications include industrial tasks like assembly and materials handling.
Gesture Controlled Car is a robot which can be controlled by simple human gestures. The user just needs to wear a gesture device in which a sensor is included. The sensor will record the movement of hand in a specific direction which will result in the motion of the robot in the respective directions. The robot and the Gesture instrument are connected wirelessly through radio waves. User can interact with the robot in a more friendly way due to the wireless communication. We can control the car using accelerometer sensors connected to a hand glove. The sensors are intended to replace the remote control that is generally used to run the car. It will allow user to control the forward, backward, leftward and rightward movements, while using the same accelerometer sensor to control the throttle of the car. Movement of car is controlled by the differential mechanism. The mechanism involves the rotation of both forth & rear wheels of left or right side to move in the anticlockwise direction and the other pair to rotate in the clockwise direction which makes the car to rotate about its own axis without any kind of forward or backward motion. The main advantage of this mechanism is the car with this mechanism can take sharp turn without any difficulty. The design and implementation of a gesture control robotic arm using flex sensor is proposed. The robotic arm is designed in such a way that it consists of four movable fingers, each with three linkages, an opposing thumb, a rotating wrist and an elbow. The robotic arm is made to imitate the human hand movements using a hand glove. by Mr. Juber Salgar, Mr. Siddharam Koli and Manasi Kulkarni 2019. Gerture controlled Robot . International Journal on Integrated Education. 2, 5 (May 2019), 222-229. DOI:https://doi.org/10.31149/ijie.v2i5.776. https://journals.researchparks.org/index.php/IJIE/article/view/776/746 https://journals.researchparks.org/index.php/IJIE/article/view/776
Gesture Controlled Car is a robot which can be controlled by simple human gestures. The user just needs to wear a gesture device in which a sensor is included. The sensor will record the movement of hand in a specific direction which will result in the motion of the robot in the respective directions. The robot and the Gesture instrument are connected wirelessly through radio waves. User can interact with the robot in a more friendly way due to the wireless communication. We can control the car using accelerometer sensors connected to a hand glove. The sensors are intended to replace the remote control that is generally used to run the car. It will allow user to control the forward, backward, leftward and rightward movements, while using the same accelerometer sensor to control the throttle of the car. Movement of car is controlled by the differential mechanism. The mechanism involves the rotation of both forth & rear wheels of left or right side to move in the anticlockwise direction and the other pair to rotate in the clockwise direction which makes the car to rotate about its own axis without any kind of forward or backward motion. The main advantage of this mechanism is the car with this mechanism can take sharp turn without any difficulty. The design and implementation of a gesture control robotic arm using flex sensor is proposed. The robotic arm is designed in such a way that it consists of four movable fingers, each with three linkages, an opposing thumb, a rotating wrist and an elbow. The robotic arm is made to imitate the human hand movements using a hand glove. by Mr. Juber Salgar, Mr. Siddharam Koli and Manasi Kulkarni 2019. Gerture controlled Robot . International Journal on Integrated Education. 2, 5 (May 2019), 222-229. DOI:https://doi.org/10.31149/ijie.v2i5.776. https://journals.researchparks.org/index.php/IJIE/article/view/776/746 https://journals.researchparks.org/index.php/IJIE/article/view/776
Technology, is today, imbibed for accomplishment of several tasks of varied complexity, in almost all walks of life. The society as a whole is exquisitely dependent on science and technology. Technology has played a very significant role in improving the quality of life. One way through which this is done is by automating several tasks using complex logic to simplify the work.Gesture recognition has been a research area which received much attention from many research communities such as human computer interaction and image processing The keyboard and mouse are currently the main interfaces between man and computer. In other areas where 3D information is required, such as computer games, robotics and design, other mechanical devices such as roller-balls, joysticks and data-gloves are used. The main motto of this project is to make robot realize the human gesture, thereby it bridge the gap between robot and human. Human gesture enhances human-robot interaction by making it independent from input devices. Robotic system can be controlled manually, or it may be autonomous. Robotic hand can be controlled remotely by hand gesture. Research in this field has taken place, sensing hand movements and controlling robotic arm has been developed.
The project aims to design and implement a cost effective and an affordable prototype model of robotic hand for telesurgery using haptic technology. The movements of the robotic palmare controlled by moving the user’s fingers using the Flex sensors.
The reason for our innovation and exploration is to give more easier and engineered way of controlling a robot. This basic engineered circuitry base robotic is an additionally valuable for instructive application in anotomy, since understudies can fabricate their own robots with ease and utilize them as stage for tests in a few courses. The motivation behind this venture is to build up a hand remote system to control a robot by means of hand movement.
The Internet of Things and AI is a developing trend in technology that is already changing the world in
which we live by interconnecting physical objects that can collect or transmit information to us and to each
other. In this work, an application of the use of the IoT is presented by the development of a semiautonomous Robot using off-the-shelf home automation(smart) components. The system is composed of
hardware and software elements that are integrated into a self-propelled scaled down version of robotic
vehicle various applets in the application were enabled to be triggered using the self made voice assistant
The robot can be controlled through voice commands and is capable of basic activities. The ultrasonic
sensors installed on the robot proved their reliability by stopping the vehicle at an average distance of 7.3
cm away from different obstacles. This work contributes to existing knowledge on the Internet of Things
and AI by providing a demonstration of a semi-autonomous robot capable of cloud-based control both
with voice commands and cloud-based activities.
Design and implementation of Arduino based robotic armIJECEIAES
This study presents the model, design, and construction of the Arduino based robotic arm, which functions across a distance as it is controlled through a mobile application. A six degree of freedom robotic arm has been designed and implemented for the purpose of this research. The design controlled by the Arduino platform receives orders from the user’s mobile application through wireless controlling signals, that is Bluetooth. The arm is made up of five rotary joints and an end effector, where rotary motion is provided by the servomotor. Each link has been first designed using solid works and then printed by 3D printer. The assembly of the parts of the robot and the motor’s mechanical shapes produce the final prototype of the arm. The Arduino has been programmed to provide rotation to each corresponding servo motor to the sliders in the designed mobile application for usage from distance.
ARENA - Young adults in the workplace (Knight Moves).pdfKnight Moves
Presentations of Bavo Raeymaekers (Project lead youth unemployment at the City of Antwerp), Suzan Martens (Service designer at Knight Moves) and Adriaan De Keersmaeker (Community manager at Talk to C)
during the 'Arena • Young adults in the workplace' conference hosted by Knight Moves.
Technology, is today, imbibed for accomplishment of several tasks of varied complexity, in almost all walks of life. The society as a whole is exquisitely dependent on science and technology. Technology has played a very significant role in improving the quality of life. One way through which this is done is by automating several tasks using complex logic to simplify the work.Gesture recognition has been a research area which received much attention from many research communities such as human computer interaction and image processing The keyboard and mouse are currently the main interfaces between man and computer. In other areas where 3D information is required, such as computer games, robotics and design, other mechanical devices such as roller-balls, joysticks and data-gloves are used. The main motto of this project is to make robot realize the human gesture, thereby it bridge the gap between robot and human. Human gesture enhances human-robot interaction by making it independent from input devices. Robotic system can be controlled manually, or it may be autonomous. Robotic hand can be controlled remotely by hand gesture. Research in this field has taken place, sensing hand movements and controlling robotic arm has been developed.
The project aims to design and implement a cost effective and an affordable prototype model of robotic hand for telesurgery using haptic technology. The movements of the robotic palmare controlled by moving the user’s fingers using the Flex sensors.
The reason for our innovation and exploration is to give more easier and engineered way of controlling a robot. This basic engineered circuitry base robotic is an additionally valuable for instructive application in anotomy, since understudies can fabricate their own robots with ease and utilize them as stage for tests in a few courses. The motivation behind this venture is to build up a hand remote system to control a robot by means of hand movement.
The Internet of Things and AI is a developing trend in technology that is already changing the world in
which we live by interconnecting physical objects that can collect or transmit information to us and to each
other. In this work, an application of the use of the IoT is presented by the development of a semiautonomous Robot using off-the-shelf home automation(smart) components. The system is composed of
hardware and software elements that are integrated into a self-propelled scaled down version of robotic
vehicle various applets in the application were enabled to be triggered using the self made voice assistant
The robot can be controlled through voice commands and is capable of basic activities. The ultrasonic
sensors installed on the robot proved their reliability by stopping the vehicle at an average distance of 7.3
cm away from different obstacles. This work contributes to existing knowledge on the Internet of Things
and AI by providing a demonstration of a semi-autonomous robot capable of cloud-based control both
with voice commands and cloud-based activities.
Design and implementation of Arduino based robotic armIJECEIAES
This study presents the model, design, and construction of the Arduino based robotic arm, which functions across a distance as it is controlled through a mobile application. A six degree of freedom robotic arm has been designed and implemented for the purpose of this research. The design controlled by the Arduino platform receives orders from the user’s mobile application through wireless controlling signals, that is Bluetooth. The arm is made up of five rotary joints and an end effector, where rotary motion is provided by the servomotor. Each link has been first designed using solid works and then printed by 3D printer. The assembly of the parts of the robot and the motor’s mechanical shapes produce the final prototype of the arm. The Arduino has been programmed to provide rotation to each corresponding servo motor to the sliders in the designed mobile application for usage from distance.
ARENA - Young adults in the workplace (Knight Moves).pdfKnight Moves
Presentations of Bavo Raeymaekers (Project lead youth unemployment at the City of Antwerp), Suzan Martens (Service designer at Knight Moves) and Adriaan De Keersmaeker (Community manager at Talk to C)
during the 'Arena • Young adults in the workplace' conference hosted by Knight Moves.
PDF SubmissionDigital Marketing Institute in NoidaPoojaSaini954651
https://www.safalta.com/online-digital-marketing/advance-digital-marketing-training-in-noidaTop Digital Marketing Institute in Noida: Boost Your Career Fast
[3:29 am, 30/05/2024] +91 83818 43552: Safalta Digital Marketing Institute in Noida also provides advanced classes for individuals seeking to develop their expertise and skills in this field. These classes, led by industry experts with vast experience, focus on specific aspects of digital marketing such as advanced SEO strategies, sophisticated content creation techniques, and data-driven analytics.
White wonder, Work developed by Eva TschoppMansi Shah
White Wonder by Eva Tschopp
A tale about our culture around the use of fertilizers and pesticides visiting small farms around Ahmedabad in Matar and Shilaj.
Can AI do good? at 'offtheCanvas' India HCI preludeAlan Dix
Invited talk at 'offtheCanvas' IndiaHCI prelude, 29th June 2024.
https://www.alandix.com/academic/talks/offtheCanvas-IndiaHCI2024/
The world is being changed fundamentally by AI and we are constantly faced with newspaper headlines about its harmful effects. However, there is also the potential to both ameliorate theses harms and use the new abilities of AI to transform society for the good. Can you make the difference?
Between Filth and Fortune- Urban Cattle Foraging Realities by Devi S Nair, An...Mansi Shah
This study examines cattle rearing in urban and rural settings, focusing on milk production and consumption. By exploring a case in Ahmedabad, it highlights the challenges and processes in dairy farming across different environments, emphasising the need for sustainable practices and the essential role of milk in daily consumption.
Explore the essential graphic design tools and software that can elevate your creative projects. Discover industry favorites and innovative solutions for stunning design results.
2. Project Guide : POOJA MISHRA
Team ID : PEC 1.13
Team Members:
FAHEED KHAN (1900270310061)
ABHISHEK VISHWAKARMA (1900270310008)
AASTHA MISHRA (1900270310002)
ARYAN SINGH (1900270310039)
3. Problem Statement
The traditional wired buttons controlled robot becomes very
bulgy and it also limits the distance the robot goes.
The Wireless Hand controlled Robot will function by a wearable
hand glove from which the movements of the hand can be used
as the input for the movement of the robot.
The basic idea of our project is to develop a system (Robot)
which can recognize the Human Interaction with it to accomplish
the certain tasks assigned to it.
In our project we will design a wearable Hand Glove which will
contain the sensors mounted on it to capture the movement of
the hand and convert the raw mechanical data into electrical
form.
4. Objective:
The aim of the project is to develop a human machine
interface used for control robot arm.
Our objective is to make this device simple as well as cheap
so it can be produced and used for number of purposes. The
objective of this project is to build a arm that can be
controlled by gesture wirelessly.
In this project user is also able to control motions of the
arm by wearing controller glove and performing predefined
gestures.
5. Introduction:
Currently there are many industrial applications which
use the rigid, manually operated or programmed robotic
systems. But the area of application still remains
narrow. The task of handling manual robotic arm is
considered tedious as the operations of all the motors
should be synchronized. Hence automatic robotic
motions are emphasized for industrial applications.
Trying to develop the system that would make the
existing system more intuitive and user friendly. So the
aim of the system design is to explore various possible
areas of applications where the human-like robotic arm
will prove helpful overcoming strength, speed and
robustness limitations. The applications would typically
involve imitation of human-arm motion, pick-and-drop
action, throwing of object.
6. BLOCK DIAGRAM:
START
1. Supply Power to the
robot and interfacing
Circuits.
2. Initialize joints.
3. Initialize robot.
Idle
User Switch
ON?
Generate PWM
Actuate the
Corresponding Server.
YES
Proximity
sensor
Pressed?
Group
Stop the
server
NO
Implementation
done?
NO
YES
YES
9. FEATURES
6 Axis Rotation
Portable
Control the Robot with Human Gestures
Can Be pre-programmed to carry out basic functions
Can be controlled wirelessly from a range
Can hold a load weight 600g (Max Load 1kg)
10. PARTS: ROBOTIC ARM
1) 6 x Servo Motor – MG966R Series
2) Servo Driver, PCA9685
3) Battery Pack (5V, 2200 mAh)
4) Arduino Uno
5) Arduino HC-05(Bluetooth)
6) Breadboard
7) Jumper Wires
8) NEMA 17 Stepper Motor
9) A4988 Stepper Motor Driver
10) LiPo 11.1V, 2200mAh, 3s
11. PARTS : hand glove
1) 3 x Flex Sensor
2) 2 x MPU6050 (Accelerometer)
3) Arduino Nano
4) 3 x Resistors (10K)
5) Resistors (220R)
6) Builders Glove
7) 9V Battery
8) 9V Battery Clip
9) 3 x Capacitor (100nF)
10) Arduino HC-05
11) Braided Cable Sleeve
11
14. Flex Sensor – Based on the bend of the finger, the current changes
which we could use to send a signal to the Motor
Accelerometer (MPU6050) – We can control the Motor by mapping
human gestures from X, Y, Z plane
LED – The LED will light up when a human gesture control has been
sent to the Arduino
Bluetooth (HC-05) Module – Sending data to Robotic Arm HC-05
Receiver
Arduino Nano – This microcontroller would perform as the brains of
the Robotic Glove
Other Components Required:
15. WORKING:
Overall, we’re sending a signal (over Bluetooth) from the Robotic Glove
to the servo motor. When a value has been received, the servo driver
will send a signal to a specific servo motor moving the Robotic Arm.
Now, if we add multiple servos and more sensors, we can control each
Motor. `
If we think of a Robotic Arm as a series of servo motors coordinating
with each other to perform a function, we can create a robotic arm
controlled by a Robotic glove.
The Robotic Glove’s Arduino uses sensors to communicate with the
Robotic Arm Arduino and sends data to move a Servo to the desired
angle.
16. For glove, we would be using Flex Sensors and an accelerometer (MPU6050)
Flex Sensors – Based on the degree of bend of this plastic piece, the
resistance changes, affecting the current. This measurement is then used to
detect hand movement changes.
Accelerometers – For more natural gestures, an accelerometer can
detect a change in the arms and wrist rotation.
We are using these sensors to detect a change in a gesture. We can then send
a specific value mapped of a gesture to the Robotic Arm to control a servo
motor via Bluetooth. And With enough gestures, the robotic arm comes to
life!
18. OMNI WHEELS
Omni wheels or poly wheels, are
wheels with small discs (called rollers)
around the circumference which are
perpendicular to the turning direction.
The effect is that the wheel can be
driven with full force, but will also slide
laterally with great ease. These wheels
are often employed in holonomic drive
systems.
19. Software: Arduino IDE
The Arduino Integrated Development Environment - or
Arduino Software (IDE) - contains a text editor for
writing code, a message area, a text console, a toolbar
with buttons for common functions and a series of
menus. It connects to the Arduino hardware to upload
programs and communicate with them. The Arduino
integrated development environment (IDE) is a cross-
platform application (for Microsoft Windows, macOS, and
Linux) that is written in the Java programming language.
It It includes a code editor with features such as text
cutting and pasting, searching and replacing text,
automatic indenting, brace matching, and syntax
highlighting, and provides simple one-click mechanisms
to compile and upload programs to an Arduino.
21. Advantages:
• Improved safety. Robotic arms help keep workers safe by operating
in environments that are hazardous and executing tasks that present
high risk of injury to humans.
• Improved efficiency and productivity. Robotic arms can operate 24
hours a day, seven days a week without fatiguing, allowing
businesses to keep production, inspections, or other tasks going
continuously to increase output.
• Enhanced precision. By their very nature, robotic arms perform
more consistently and accurately than humans for tasks that require
extreme precision or consistency.
• Greater flexibility. As business priorities change, robotic arms can
easily be repurposed for new activities or mounted onto different
platforms, such as autonomous mobile robots (AMR), a stationary
assembly line platform, or wall or shelf, as needed.
22. Conclusion:
Even after many years of research, the applications of robotic arm
are restricted to the industries and primarily used in
manufacturing units for increasing productivity. These arms are
very sophisticated and can manage to make extremely precise
movements.
Cost is the main constraint on robotic arms and to bring it down is
a challenging issue. High torque servos with high precision are
necessary for building these machines. These are the main
components which cause the motion of the arm, and are most
expensive. Finding alternatives to these motors to bring down the
cost is the necessity. Also the material which will be used for the
body should be light and durable.
The light weight body can improve the performance of the
motors and the torque. The shapes and size of the components
and parts varies widely depending on the applications
23. Future Scope
Robotic Arms has a wide scope of development. In the near future
the arms will be able to perform every task as humans and in
much better way. Imagination is the limit for its future
applications.
The arm can be trained to listen to the command from a human
and perform that task. A Precise gesture controlled system is also
possible. Wearable devices can be used to send the command and
control the movements of the arm.
Voice controls can be added for differently abled people.
Brain Computer Interface (BCI) is an immerging field of research.
BCI can be used to acquire signals from the human brain and
control the arm. The system can work in the same way as human
arm. A person who may have lost his hand in any accident can
resume his life like previous by such artificial arms. Robotic arms
are versatile and have enormous ways of implementations.
24. References:
[1] F. Arce, J. M. G. Valdez,” Accelerometer-Based Hand Gesture
Recognition Using Artificial Neural Networks” in Soft Computing for
Intelligent Control and Mobile Robotics Studies in Computational
Intelligence, vol. 318, pp 67-77, 2011
[2] A. Pandit , D. Dand , S. Mehta , S. Sabesan , A. Daftery,” A Simple
Wearable Hand Gesture Recognition Device using iMEMS,” International
Conference of Soft Computing and Pattern Recognition , pp 592-
597,2009
[3] R. Wang, J. Popovic, ”Real-time hand-tracking with a color glove,”
ACM Transactions on Graphics, vol. 28 , pp 461- 482, 2009
[4] “Luigi Lamberti1 and Francesco Camastra”, RealTime Hand
Gesture Recognition using a Color Glove,” Depart ment of Applied
Science, University of Naples Parthenope, 2010, pp.321-344
[5] J.S. Kim, C.S. Lee, K.J. Song, B. Min, Z. Bien, “Real -time hand
gesture recognition for avatar motion control,” Proceedings of HCI'97,
pp. 96-101,February 1997