A 2019 update on the current role of robotics and simulation in neurosurgery with updates from the recent edition of Youman and Winn's Textbook of Neurosurgery. Videos in the presentation cannot be uploaded but can be viewed from youtube.
Robotics is the Engineering science and technology of robots, and their design, manufacture, application, and Structural disposition.
Robotics is related to Electronics, Mechanics, and Software.
The term “Robotics” was coined by Isaac Asimov in his 1941 science fiction Short story “Liar”.
A 2019 update on the current role of robotics and simulation in neurosurgery with updates from the recent edition of Youman and Winn's Textbook of Neurosurgery. Videos in the presentation cannot be uploaded but can be viewed from youtube.
Robotics is the Engineering science and technology of robots, and their design, manufacture, application, and Structural disposition.
Robotics is related to Electronics, Mechanics, and Software.
The term “Robotics” was coined by Isaac Asimov in his 1941 science fiction Short story “Liar”.
This project is to develop a wheel chair for physically disabled people
The wheel chair is controlled by hand movement/hand gestures
The gestures are recognized by an accelerometer sensor
An ultrasonic sensor is used to detect the obstacles in front of the chair
The signals from the sensors are processed, and the wheel chair is controlled by Atmega-328 micro controller
Implementation of A Multifunctional Smart WheelchairIJERDJOURNAL
ABSTRACT:- The project presents a multifunctional smart wheelchair for movement of disabled people along with patient monitoring using Arduino. The wheelchair can move in left, right, forward and backward directions. The movement is controlled by voice. Here voice is given to the mobile phone and it transmits the corresponding data to microcontroller using bluetooth module. Microcontroller controls the movement of wheelchair by controlling the DC motors interfaced with motor drivers. Patient monitoring is achieved by temperature sensor and data is given to microcontroller. Whenever the temperature rises above the threshold value, an alert message is sent to doctor’s phone using GSM module. Along with this, obstacle detection is also implemented using Ultrasonic sensors.
New development in sensors, radar and ultrasonic technologies has proved to be a boon for electronics
travelling aids (ETAs). These devices are widely used by blind and physically challenged peoples. C5 laser
cane, Mowat sensor, belt and binaural sonic aid, NAV guide cane are among popular electronic travelling
aids used by blind peoples. For physically challenged person electric wheel chairs controlled by joystick,
eye movement and voice recognition are also available but they have their own limitation in terms of
operating complexity, noise environment and cost. Our paper proposes an automated innovative
wheelchair controlled by neck position of person. It uses simple LEDs, photo sensor, motor and
microcontroller to control the movement of wheelchair
IJRET : International Journal of Research in Engineering and Technology is an international peer reviewed, online journal published by eSAT Publishing House for the enhancement of research in various disciplines of Engineering and Technology. The aim and scope of the journal is to provide an academic medium and an important reference for the advancement and dissemination of research results that support high-level learning, teaching and research in the fields of Engineering and Technology. We bring together Scientists, Academician, Field Engineers, Scholars and Students of related fields of Engineering and Technology
IJRET : International Journal of Research in Engineering and Technology is an international peer reviewed, online journal published by eSAT Publishing House for the enhancement of research in various disciplines of Engineering and Technology. The aim and scope of the journal is to provide an academic medium and an important reference for the advancement and dissemination of research results that support high-level learning, teaching and research in the fields of Engineering and Technology. We bring together Scientists, Academician, Field Engineers, Scholars and Students of related fields of Engineering and Technology
The CFD Analysis of Turbulence Characteristics in Combustion Chamber with Non...IOSR Journals
Abstract : Co-Axial jets have applications in areas where the mixing of two fluid jets are necessary, the two
fluid jets can be effectively mixed by producing the turbulence flow. Turbulence is a chaotic behavior of the fluid
particles that comes in to picture when the inertia force of the flow dominates the viscous force and it is
characterized by the Reynolds Number. Co-axial jets are effective in producing the turbulence. In the present
study the free compressible turbulent coaxial jet problem will be computed using CFD, and compare with
different non circular coaxial jets based on constant hydraulic diameter and mass flow rate. Turbulence
characteristics of combustion chamber with circular coaxial and non circular coaxial jets are determined and
compared.
Keywords: Coaxial Jet, Turbulence Modeling, Fuel injector, Combustion chamber.
This project is to develop a wheel chair for physically disabled people
The wheel chair is controlled by hand movement/hand gestures
The gestures are recognized by an accelerometer sensor
An ultrasonic sensor is used to detect the obstacles in front of the chair
The signals from the sensors are processed, and the wheel chair is controlled by Atmega-328 micro controller
Implementation of A Multifunctional Smart WheelchairIJERDJOURNAL
ABSTRACT:- The project presents a multifunctional smart wheelchair for movement of disabled people along with patient monitoring using Arduino. The wheelchair can move in left, right, forward and backward directions. The movement is controlled by voice. Here voice is given to the mobile phone and it transmits the corresponding data to microcontroller using bluetooth module. Microcontroller controls the movement of wheelchair by controlling the DC motors interfaced with motor drivers. Patient monitoring is achieved by temperature sensor and data is given to microcontroller. Whenever the temperature rises above the threshold value, an alert message is sent to doctor’s phone using GSM module. Along with this, obstacle detection is also implemented using Ultrasonic sensors.
New development in sensors, radar and ultrasonic technologies has proved to be a boon for electronics
travelling aids (ETAs). These devices are widely used by blind and physically challenged peoples. C5 laser
cane, Mowat sensor, belt and binaural sonic aid, NAV guide cane are among popular electronic travelling
aids used by blind peoples. For physically challenged person electric wheel chairs controlled by joystick,
eye movement and voice recognition are also available but they have their own limitation in terms of
operating complexity, noise environment and cost. Our paper proposes an automated innovative
wheelchair controlled by neck position of person. It uses simple LEDs, photo sensor, motor and
microcontroller to control the movement of wheelchair
IJRET : International Journal of Research in Engineering and Technology is an international peer reviewed, online journal published by eSAT Publishing House for the enhancement of research in various disciplines of Engineering and Technology. The aim and scope of the journal is to provide an academic medium and an important reference for the advancement and dissemination of research results that support high-level learning, teaching and research in the fields of Engineering and Technology. We bring together Scientists, Academician, Field Engineers, Scholars and Students of related fields of Engineering and Technology
IJRET : International Journal of Research in Engineering and Technology is an international peer reviewed, online journal published by eSAT Publishing House for the enhancement of research in various disciplines of Engineering and Technology. The aim and scope of the journal is to provide an academic medium and an important reference for the advancement and dissemination of research results that support high-level learning, teaching and research in the fields of Engineering and Technology. We bring together Scientists, Academician, Field Engineers, Scholars and Students of related fields of Engineering and Technology
The CFD Analysis of Turbulence Characteristics in Combustion Chamber with Non...IOSR Journals
Abstract : Co-Axial jets have applications in areas where the mixing of two fluid jets are necessary, the two
fluid jets can be effectively mixed by producing the turbulence flow. Turbulence is a chaotic behavior of the fluid
particles that comes in to picture when the inertia force of the flow dominates the viscous force and it is
characterized by the Reynolds Number. Co-axial jets are effective in producing the turbulence. In the present
study the free compressible turbulent coaxial jet problem will be computed using CFD, and compare with
different non circular coaxial jets based on constant hydraulic diameter and mass flow rate. Turbulence
characteristics of combustion chamber with circular coaxial and non circular coaxial jets are determined and
compared.
Keywords: Coaxial Jet, Turbulence Modeling, Fuel injector, Combustion chamber.
Implementation of XOR Based Pad Generation Mutual Authentication Protocol for...IOSR Journals
In RF link, without security the messages exchange between the two devices are monitoring by an
eavesdropper. So the exclusive-OR (XOR) based pad generation protocol is used to safely transfer the data to
the other point with necessary security and it maintaining confidentiality. This protocol produce the cover
coding pad to mask the access password before the datas are transmitted. A specially designed pad generation
will be implemented in digital domain to solve the insecurity problem in data communication RF link. This
protocol developed under regulation of ISO 18000 – 6 type C protocol also known as EPC C1G2 RFID
protocol. The linear feed back shift register (LFSR) generate the pseudo random binary sequence (PRBS) and it
is used as data source to the pad generation function. The Xilinx 13.x software is used for synthesize and
modelsim SE6.0 is used for simulating the result. The pad generation algorithm has been implemented in FPGA
Spartan 3 PQ208-4 board to verify the result
Telemedicine is a new and hopeful application in the field of medical science. Medical consulting and remote medical procedures or examinations became more successful with the development of interactive audiovisual systems and distant movable robotic platforms. Tele-presence requires real time video communication. Fixed mounting of video device on mobile robotic platform limits the video projection at positive vision angle, thus restricting the remote doctor in obtaining the better and correct visual information of the patient. To avoid the problem, this paper presents a flexible robotic arm with vision system. A thirteen degree of freedom robotic arm with extending and retracting quality enables the remote doctor to clear the attached video device on robotic arm to object area on patient. The rising necessity for robotic applications in dynamic unstructured environments is inspiring the need for dexterous end-effectors which have the wide variety of tasks and objects encountered in these environments. The human hand is a very complex grasping tool that can handle objects of different sizes and shapes. This hand gripper is the wide working space compared with its physical dimensions and the capability to deal with objects in working environment conditions. This capability is achieved by using force/torque sensor and by properly controlling and coordinating the gripper and the carrying arm Note that with this control structure, it is also very simple to connect the arm/gripper system using Internet to other computational resources or robotic devices, for example to emulate tele-operation tasks.
Autonomous Camera Movement for Robotic-Assisted Surgery: A SurveyIJAEMSJORNAL
In the past decade, Robotic-Assisted Surgery (RAS) has become a widely accepted technique as an alternative to traditional open surgery procedures. The best robotic assistant system should combine both human and robot capabilities under the human control. As a matter of fact robot should collaborate with surgeons in a natural and autonomous way, thus requiring less of the surgeons’ attention. In this survey, we provide a comprehensive and structured review of the robotic-assisted surgery and autonomous camera movement for RAS operation. We also discuss several topics, including but not limited to task and gesture recognition, that are closely related to robotic-assisted surgery automation and illustrate several successful applications in various real-world application domains. We hope that this paper will provide a more thorough understanding of the recent advances in camera automation in RSA and offer some future research directions.
Observer based dynamic control model for bilaterally controlled MU-LapaRobot:...IJECEIAES
During laparoscopic surgeries, primary surgical tool insertion is the demanding and strenuous task. As the surgeon is unaware of the type of the tissue and associated parameters to conduct the insertion, therefore, to ease the procedure, the movement of the surgical tool needs to be controlled. It’s the operational capabilities that are to be manipulated to perform a smooth surgery even from a distant location. In this study, a robot system is being introduced for laparoscopic primary surgical tool insertion. It will incorporate a novel observer based dynamic control along with robot assisted bilateral control. Moreover, a virtual spring damper force lock system is introduced through which the slave system will notify the master regarding the target achieved and excessive force. The validation of the proposed control system is experimented with bilaterally controlled MU-LapaRobot. The experiment is comprising 3 cases of bilateral control criteria which are non-contact motion, contact motion, and limit force locking. The results defined the same value for contact and non-contact motion by 0.3N. The results depicted a force error of 3.6% and a position error of 5.8% which validated the proposed algorithm.
Hand gesture recognition using ultrasonic sensor and atmega128 microcontrollereSAT Publishing House
IJRET : International Journal of Research in Engineering and Technology is an international peer reviewed, online journal published by eSAT Publishing House for the enhancement of research in various disciplines of Engineering and Technology. The aim and scope of the journal is to provide an academic medium and an important reference for the advancement and dissemination of research results that support high-level learning, teaching and research in the fields of Engineering and Technology. We bring together Scientists, Academician, Field Engineers, Scholars and Students of related fields of Engineering and Technology.
A haptic feedback system based on leap motion controller for prosthetic hand ...IJECEIAES
Leap motion controller (LMC) is a gesture sensor consists of three infrared light emitters and two infrared stereo cameras as tracking sensors. LMC translates hand movements into graphical data that are used in a variety of applications such as virtual/augmented reality and object movements control. In this work, we intend to control the movements of a prosthetic hand via (LMC) in which fingers are flexed or extended in response to hand movements. This will be carried out by passing in the data from the Leap Motion to a processing unit that processes the raw data by an opensource package (Processing i3) in order to control five servo motors using a microcontroller board. In addition, haptic setup is proposed using force sensors (FSR) and vibro-motors in which the speed of these motors is proportional to the amount of the grasp force exerted by the prosthetic hand. Investigation for optimal placement of the FSRs on a prosthetic hand to obtain convenient haptic feedback has been carried out. The results show the effect of object shape and weight on the obtained response of the FSR and how they influence the locations of the sensors.
Design and Development ofa Mirror Effect Control Prosthetic Hand with Force S...TELKOMNIKA JOURNAL
Some of the already available prosthetic hands in the market are operated in open loop, without
any feedback and expensive. This system counters those by having the prosthetic hand printed using 3D
printer and consist of a feedback sensor to make it a closed loop system. The system generally consists of
two sections, mainly Finger Input and Prosthetic Output. The two sections communicate wirelessly for data
transferring. The main purpose of the system is to control the prosthetic hand wirelessly using the Mirror
Glove by performing a mirror effect that will translate movement from the glove onto the prosthetic hand.
The Mirror Glove monitors the movements/bending of each fingers using force sensitive sensor. The
prosthetic hand also has a sensor known as force sensitive resistor. The sensors will feedback the
pressure on the prosthetic hand during object grasping, allowing the prosthetic hand to grasp delicate
object without damaging it. Overall, the system will imitate the flex and relaxing of fingers inside the Mirror
Glove and wirelessly control distant prosthetic hand to imitate the human hand.
Prosthesis is an artificial device that replaces a missing body part. In medicine,prosthesis is an artificial device that replaces a missing body part, which may be lost
through trauma, disease, or congenital conditions. Prosthetic amputee rehabilitation
is primarily coordinated by a prosthetist and an inter-disciplinary team of health care
professionals including psychiatrists, surgeons, physical therapists, and occupational
therapists. A person's prosthetics should be designed and assembled according to the
patient's appearance and functional needs.
For instance, a patient may need transradial prosthesis, but need to choose
between an aesthetic functional device, a myoelectric device, a body-powered device,
and an activity specific device. The patient's future goals and economical capabilitiesmay help them choose between one or more devices.
Voice Controlled Wheel chair is a mobile wheel chair whose motions can be controlled by the user by giving specific voice commands. The speech recognition software running on a PC is capable of identifying the 5 voice commands ‘Run’, ‘Stop’, ‘Left’, ’Right’ and ‘Back’ issued by a particular User. This system controls the wheel chair as well as read the parameters of patient.
Wearable sensor network for lower limb angle estimation in robotics applicationsTELKOMNIKA JOURNAL
In human-robot interaction, sensors are relevant in guaranteeing stability and high performance in real-time applications. Nonetheless, accuracy and portable sensors for robots usually have high costs and little flexibility to process signals with free software. Therefore, we propose a wearable sensor network to measure lower limb angular position in human-robot interaction systems. The methodology employed to achieve the aim consisted in implementing a wireless network using low-cost devices, verifying design requirements, and making a validation via a proof of concept. The requirements to design the network include low loss of information, real-time communication, and sensor fusion to estimate the angular position using a gyroscope and accelerometer. Hence, the sensor network developed has a client-server architecture based on ESP8266 microcontrollers. In addition, this network uses the standard 802.11 b/g/n to transmit angular velocity and acceleration measures. Furthermore, we implement the user datagram protocol (UDP) protocol to operate in real-time with a sample time of 10 ms. Finally, we implement a proof of concept to show the system’s effectiveness. Thus, we use the Kalman filter to estimate the angular position of the foot, shin, thigh, and hip. Results indicate that the implemented sensor network is suitable for real-time robotic applications.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
I010145860
1. IOSR Journal of Electrical and Electronics Engineering (IOSR-JEEE)
e-ISSN: 2278-1676,p-ISSN: 2320-3331, Volume 10, Issue 1 Ver. IV (Jan – Feb. 2015), PP 58-60
www.iosrjournals.org
DOI: 10.9790/1676-10145860 www.iosrjournals.org 58 | Page
Hand gesture actuated robotic arm’s motion with haptic feedback
for surgical applications
1
Ritesh Kumar, 2
Shubham Jha, 3
Manish Thigale, 4
Akriti Chadda, 5
Neha Thakur
(Department of Biomedical Engineering, Vellore Institute of Technology, Vellore)
Abstract: Human-robot symbiotic systems have been studied extensively in recent years, considering that
robots will play an important role in the future. Similarly robotic surgery has seen a lot of advancement in the
past decade. They are based on either a pre-programmed instruction for a particular surgical method or a
manually controlled system where the surgeon gives the robot instructions during the surgery. These systems
possesses the limitations of poor judgment, limited hand-eye co-ordination, it’s rather limited to simple
procedures only and really expensive. This paper proposes a simple gyroscopic and force sensitive based
robotic arm apparatus which is controlled by hand gestures. Innate hand gestures can be used as a discerning
and robust method to interact with the surgical robot. The movement of fingers and wrists of the surgeon
procures a signal which is used by the motors of the robotic arm. This unique methodology can be implemented
as a resilient telesurgical system for low cost and high accuracy surgical demands.
Keywords: Robotic surgery, Accelerometers, Robotic arm
I. Introduction
Surgical condition is generally defined as any condition that requires suture, incision, excision,
manipulation, or other invasive procedure that may or may not require local, regional or general anesthesia.
Approximately, there are around 234 million major surgeries performed each year all over the world. That
means one out of 25 people will have a major surgery in a given year [1]. Traditional surgical methods facade
postoperative infection, pain and prolonged time to complete recovery. One of the obstructive problems with
microsurgery is the physiologic tremor while holding the surgical instruments. The surgeon’s physiologic
tremor of about 40µm can be reduced to 4µm by the use of a robot interface. Moreover, the robot-assisted
surgery is highly précised, miniaturized, and with smaller incisions required, grounding reduced pain, reduced
blood loss and less operative time that relieve the patient from all the risks accompanying prolonged stay under
anesthesia and provides quicker healing time. The robotic arm has a very high perception power. It mimics the
movement of glove worn by the user, when the glove is tilted in the forward direction or any such direction, the
arm will spontaneously follow the suit. The algorithms for the robotic arm make them capable of direct, safe and
effective interaction with humans. The ultimate motive of robot assisted hand gestures based surgery is to give
the surgeon unprecedented control in a minimally invasive environment and to allow surgeons to leapfrog the
contemporary tedious and tiring surgical procedures. A gesture is a form of non-verbal communication. Hand
gesture recognition acts as a highly adaptive interface between the user and the robotic arm, allowing an ease of
operation by using a series of fingers and hand movements. Robotic surgeries have the potential to expand
surgical treatment modalities beyond the limits of human ability [2].
But the current preprogrammed instruction based robotic surgery is restricted to basic tasks, with the
surgeon providing detailed preoperative commands or exact move-for-move instructions to complete the task.
Besides inexplicably high cost, such an approach of the system poses the limitations of poor verdict, limited
dexterity, inadequate and fragile hand-eye coordination that consequently restricts surgical efficiency [3]. The
large size of the system using cumbersome procedures becomes difficult to operate over relatively smaller
patients. As the preprogrammed instructions given to such system becomes more and more complicated, there is
an increasing need for more complex hardware and software components for better and faster response. This in
turn increases the possibility of error exponentially. Therefore, these systems are rather limited to relatively
simple procedures. One of the major issues in the current surgical systems is the absence of haptic feedback
which can be very helpful in dire circumstances [4].
To overcome these limitations, in this paper, we present a surgeon-robot hand gesture recognition
based cooperative system. The form and level of anthropomorphism and the simplicity of the design are the key
features of this system. This includes a OWI-360 robotic arm that is operated and controlled wirelessly with the
help of hand gestures which transmit signals to the robot through an auto device that is, the Hand Gesture
Control Device (HGCD) fixed on the gloves being worn on hands by the surgeon, rather than controlling it
manually through a conventional joystick controller. The glove houses the circuitry which can control the
robotic arm. The robotic arm will move and act in the manner depending on the movement of the fingers and the
wrist of the surgeon. The robot is programmable and can move in all the directions- up, down, left, right
2. Hand gesture actuated robotic arm’s motion with haptic feedback for surgical applications
DOI: 10.9790/1676-10145860 www.iosrjournals.org 59 | Page
wherever the surgeon desires. The highly sensitive and précised accelerometer used here, acts as a compiler
between the hand gestures and robotic arm movement. It can measure acceleration in all the three orthogonal
axes. The basic principle of operation behind the accelerometer is the displacement of a small proof mass etched
into the integrated circuit and suspended by small beams. Flex sensors are used to procure signals from the
movement of wrist and finger. It can be used to control the motion of gripper for “grab and release” functions.
For generating a haptic feedback in case of tactile motions, Force Sensitive Resistors (FSRs) are used. When
there is no contact in FSRs it acts as an open circuit. With increase in force the resistivity decreases and the
circuit is closed for Miniature Vibrations Motor to receive the signals. The whole process can be done
wirelessly, adding dexterity to the user. Radio Frequency signals are preferred which can be done with the help
XBee modules. The analog signals are converted to the digital values using an analog to digital converter
embedded within a microcontroller. Since accelerometers are being used, therefore minimal hardware system is
required and hence is of low cost and smaller in size [5]. The represented system is anticipated to radically
enhance the learning curve, allowing trainees to get hold of surgical skills in a short time while improving
patient safety by reducing surgical errors.
II. Methodology
A very realistic Hand gesture control device (HGCD) is designed which can be worn by the surgeon as
a glove. The glove provides input to the robotic arm about the position and rotation of the hand using ADXL
335 3-axis accelerometer and SEN10264 Flex Sensors. It consists of a triple axis accelerometer which helps the
user to acquire the signals from HGCD when the user moves his/her hand in any axis. The OWI-360 robotic arm
provides 5 DOF’s (Degrees of Freedom). Followed by the accelerometer, there is a Control unit as well, a
ATMEGA48 microcontroller which can be used for motor unit driver as well as Encoder/Decoder for Xbee
Module. . This model is robust because of the implication of highly accurate electronic sensors and efficient
algorithms. The robotic arm has a closer interaction with the user with high capacities of perception and action.
The interaction between the user and the robotic arm becomes possible through hand gesture actuation. The
accelerometer detects the motion in the corresponding X, Y, and Z direction. The gestures like left, right,
forward, backward made by the human hand are identified and converted to electric signal that is in to an analog
voltage by the accelerometer. Received signals are sent to a compatible microcontroller which assigns the
discrete motor control commands to the individual motors of robotic arm.
The analog values are converted to digital format with the help of an analog to digital converter that
resides inside the microcontroller. Within the microcontroller memory, already exists some predefined ranges of
values that have been stored for each type of motion X, Y and Z. When a motion occurs the controller checks
the value and compares it with the predefined range of values. If the value is in that predefined range, then the
controller identifies that the motion has occurred in X or Y or Z direction. Then according to the specification of
accelerometer for one motion, two coordinate values change while the other one will remain the same. So for
the left, right, up and down movements, some values are experimentally taken and a particular range is assigned.
If the output of the analog accelerometer is in that range, then the controller will generate a particular code with
respect to each motion i.e. 01 for left, 02 for right etc. These codes are generated in any of the port as per the
program assigned. These binary signals are then used to control the individual motors of the robotic arm. The
arm consists of 5 nos. of DC motors in order to provide five degrees of freedom to the system. The lowest point
DC motors is attached in such a manner that it moves the upper base horizontally and from top to bottom
ranging from 0-180 degree depending upon the values from the controller module.
3. Hand gesture actuated robotic arm’s motion with haptic feedback for surgical applications
DOI: 10.9790/1676-10145860 www.iosrjournals.org 60 | Page
Fig.1: Block Diagram of the proposed design
There are three more motors attached for controlling the direction of the robotic arm in the Elbow,
Wrist and Gripper. Flex sensors are attached to the forefinger to facilitate the grabber function. The level of the
grip is determined by the degree of movement of the finger which helps in controlling the movement of the
grabber.
For facilitating haptic feedback Force Sensitive Resistor are used at the gripper site. When the arm
effector is in contact with a tactile source, the resistivity of the sensor decreases where it acts as a channel for
actuating the movement of Miniature Vibration Motors placed the fingers of the user. This will create a
sensation of touch which is critical during minimal invasive surgery.
For providing dexterity and comfort to the user, wireless control is implemented using RF signals.
Xbee module is used for data transmission both at the Glove and the Robotic Arm site. To match the standards
of critical wireless transmission, the delay of 120 millisecond’s is acquired. On a more industrial application,
fiber optic national grids can be used for asynchronous data transmission. This will help in reaching the rural
areas which are ill-equipped for complex surgical processes.
III. Discussion And Conclusion
The paper presents a revolutionary and customary design of a hand gesture recognition based robotic
surgery. This robotic arm is special because of its minimal hardware design that not only makes it simple but
also a low cost and effective device. It can be easily used by the surgeon during surgery with less training
period. It is an improvement on current telesurgical techniques because of its high accuracy, high efficiency and
simple electronic circuit designs. This will give a more realistic experience to surgeons while doing surgery. It
will change the existing concepts of human-machine interface and rather support biomimic of a human being by
a machine. The HGCD device controls the individual motors of the arm in accordance with the input signal
provided by the gestures of the user. It has the potential to deliver medical care services to those who cannot
have direct access to the surgeons. The implementation of haptic feedback opens new dimensions in safety and
precision. The usage of such an advanced technology is not restricted to one particular field. Many applications
can be realized with the use of acceleration sensors. It also has major military and industrial applications which
are yet to be exploited.
References
[1]. "The role of surgery in global health: analysis of United States inpatient procedure frequency by condition using the global burden
of disease 2010 framework. Rose, John, et al. " PloS one 9.2 (2014): e89693.
[2]. Hand gesture guided robot-assisted surgery on a direct augmented reality interface. Ron Wen, Wei-Liang Tay, Binh P. Nguyen,
Chin-Boon Chng, Chee-Kong Chui.
[3]. Distance metric learning for large margin nearest neighbor classification. K.Q. Weinberger, L.K. The Journal of Machine Learning
Research, 10 (2009)
[4]. Gesture spotting with body-worn inertial sensors to detect user activities Pattern Recognition., Junker et al., 2008 H. Junker, O.
Amft, P. Lukowicz, G. Tröster 41 (6) (2008)
[5]. Context-based hand gesture recognition for the operating room Mithun George Jacob, Juan Pablo Wachs.