SlideShare a Scribd company logo
1 of 7
Download to read offline
Intuitive and Adaptive Robotic Arm Manipulation using the Leap
Motion Controller
D. Bassily, C. Georgoulas, J. Güttler, T. Linner, T. Bock, TU München, Germany
Abstract
Robotics provide an efficient approach in the development of assistive devices, due to their enhanced functionality. Sta-
tistics predict that by 2035, half of the population in Germany is going to be older than fifty, every third person even
over 60. These ageing societies face numerous challenges in performing simple tasks in Activities of Daily Living
“ADLs”. Increasingly, a lot of research is being focused on Ambient Assisted Living “AAL” which presents a new ap-
proach that promises to address the needs of elderly people. An important goal of AAL is to contribute to the quality of
life of the elderly and handicapped people and help them to maintain an independent lifestyle. The introduction of ro-
botics and technology-supported environments will play a huge role in allowing elderly and physically impaired people
to keep living a self-determined, independent life in their familiar surroundings. In this paper, the implementation of a
novel intuitive and adaptive manipulation scheme is proposed, by developing a human-machine communication inter-
face between the Leap Motion controller and the 6-DOF Jaco robotic arm. An algorithm is developed to allow an opti-
mum mapping between the user hand movement, tracked by the Leap Motion controller, and the Jaco arm. The system
should allow for a more natural human-computer interaction and a smooth manipulation of the robotic arm, by con-
stantly adapting to the user hand tremor or shake. The implementation would specially enhance the quality of living,
especially for people with upper limb problems, and would support them in performing some of the essential Activities
of Daily Living “ADLs”. The applications of this human-robot interaction will be discussed in relation with Ambient
Assisted Living, where some use case scenarios will be introduced.
1 Introduction
Impaired or aged individuals require novel approaches for
placing mechatronics and robotic assisted services in their
living environments. The development of such systems
should be focused on cost effectiveness, ease of control,
and safe operation, in order to enhance the autonomy and
independence of such individuals, minimizing at the same
time the necessity for a caregiver. Already in early devel-
opment phases, knowledge at least from the robotic,
medical and ergonomic field is necessary.
Ageing society faces numerous challenges in performing
simple tasks in Activities of Daily Living (ADLs), [1].
ADLs represent the everyday tasks people usually need to
be able to independently accomplish. Nowadays caring of
elderly people becomes more and more important. Indi-
viduals with upper limb impairments, also face difficulties
to perform ADLs, especially in cases where the impair-
ments have resulted from spinal cord injuries, neuromus-
cular diseases, etc. Many technical aids have been devel-
oped to assist in impairments in the home environment.
However these assistive devices provide limited function-
ality and cannot address in an efficient way independence
and autonomy [2, 3].
Some researchers already evaluated the efficiency of ro-
botic systems and more specifically robotic arms, used by
disabled individuals in performing ADLs [4, 5]. An im-
portant parameter when concerning the efficiency of as-
sistive devices for disabled individuals is the economic
benefit in terms of comparing the robotic system cost with
the total cost required for a caregiver, in a long term
scheme. The Jaco robotic arm, can efficiently substitute
caregivers as a cost saving alternative [6, 7].
In the last few years, different optical sensors have been
developed, which allow the mapping and acquisition of 3-
D information. Various applications also have been intro-
duced, which exploit the increasing accuracy and robust-
ness, and the decreasing cost over time of 3-D sensors [8].
The applications range from industrial use, object track-
ing, motion detection and analysis, to 3-D scene recon-
struction and gesture-based human machine interfaces [9].
These applications have different requirements in terms of
resolution, frame-rate throughput, and operating distance.
Especially for gesture-based user interfaces, the accuracy
of the sensor is greatly considered a challenging task [8,
10]. The Leap Motion controller introduces a new novel
gesture and position tracking system with sub-millimeter
accuracy [11]. The controller operation is based on infra-
red optics and cameras instead of depth sensors. Its mo-
tion sensing precision is unmatched by any depth camera
currently available, to the best of the authors knowledge
so far. It can track all 10 of the human fingers simultane-
ously. As stated by the manufacturer, the accuracy in the
detection of each fingertip position is approximately
0.01mm, with a frame rate of up to 300 fps.
In the proposed paper the authors develop a human-
machine interface which offers intuitive and adaptive ma-
nipulation in ADLs, using the Leap Motion controller and
the Jaco arm.
2 Gesture-based Human-Robot In-
teraction
Since the introduction of computers to our world, we have
been witnessing creative inventions in the science of hu-
Conference ISR ROBOTIK 2014
78
ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
man-computer interaction. For many years, the term “in-
put device" evoked mainly two specific devices: the key-
board and the mouse - the main instruments used to pro-
vide user input to a personal computer. Nowadays, with
the evolution of computers, and the increasing research on
human-computer interaction technologies, we have a
large set of input devices that changed the way of interac-
tion. The new approaches of human-computer interfaces
will facilitate a more natural, intuitive communication be-
tween people and all kinds of sensor-based input devices,
thus more closely mimicking the human-human commu-
nication [12]. Innovative technologies empower users to
be more natural and spontaneous when dealing with them.
Also, the systems adopting these technologies show in-
creased efficiency, speed, power, and realism. However,
many users feel comfortable with traditional interaction
methods like mice and keyboards to the extent that they
are often unwilling to embrace new, alternative interfaces.
A possible reason for that might be the complexity of
these new technologies, where very often users find it dis-
turbing to spend a lot of time learning and adapting to
these new devices. Gesture-based human-computer inter-
action could represent a potential solution for this prob-
lem since they are the most primary and expressive form
of human communication [12]. Two successful examples
of 3-D optical sensors are: the Nintendo Wii and the Mi-
crosoft's Xbox Kinect. Each of the two examples have its
own operating principle. The Wii operates by means of a
remote which the user has to keep holding during the en-
tire operation time. The Kinect was initially developed to
allow the user to interact with the Xbox without any con-
trollers, however it was used further as a vision platform
in many different applications. An analysis of the Kinect
controller showed that it has an approximately 1.5 cm
standard deviation in depth accuracy [8].
The Leap Motion Controller is considered a breakthrough
device in the field of hand gesture controlled human-
computer interface. The new, consumer-grade controller
introduces a new novel gesture and position tracking sys-
tem with sub-millimeter accuracy. The controller opera-
tion is based on infrared optics and cameras instead of
depth sensors. Its motion sensing precision is unmatched
by any depth camera currently available, to the best of the
author’s knowledge so far. It can track all 10 of the hu-
man fingers simultaneously. As stated by the manufac-
turer, the accuracy in the detection of each fingertip posi-
tion is approximately 0.01mm, with a frame rate of up to
300 fps [13].
Figure 1 The Leap Motion Controller
The controller is considered to be an optical tracking sys-
tem based on stereo vision. Within its surface area of 24
cm², the controller has three IR (Infrared Light) emitters
and two IR cameras [11]. The field of view of the control-
ler is very wide, up to 150° [13], which gives the user the
opportunity to move his hand in 3D, just like in real
world.
Figure 2 The schematic view of the Leap Motion Con-
troller.
The Software Development Kit (SDK) supplied by the
manufacturer delivers information about Cartesian space
of predefined objects such as the finger tips, pen tip, hand
palm position, etc. Also, information about the rotations
of the hand (e.g. Roll, Pitch, and Yaw) are available as
well. All delivered positions are relative to the Leap Mo-
tion Controller’s center point, which lies between the two
IR cameras, just above the second IR emitter.
3 Proposed Concept
3.1 Supporting elderly and disabled people
in home environments
After discussing about the demographic changes that the
world is experiencing and will continue to experience dur-
ing at least the next few decades, after seeing the chal-
lenges that elderly and impaired people face in order to
perform simple ADLs, and after recognizing the potential
role that robotics could perform in the AAL field, a novel
implementation is proposed in this paper.
The most common human-robot interaction is achieved
via a keyboard or a joystick, which according to the com-
plexity of the robotic arm, require a series of configura-
tions and mode selection routines by pressing a series of
buttons, in order to select an operating mode, or to per-
form a specific trajectory path. After performing research
on new ways of operating such devices, in order to reduce
the involved operation complexity, a new human-robot
interaction scheme is proposed.
The proposed concept depends on what is so called a
more “natural” human-robot interaction. The Leap Mo-
tion Controller is used to operate the 6-DOF Jaco Robot
to perform ADLs in a more intuitive way. Instead of using
the original joystick “Kinova Joystick” of the Jaco arm
and thus having to switch between different modes of
control, the joystick is replaced with the Leap Motion
controller. The controller monitors the user’s hand/hands,
fingers, and all the accompanied positions and angles. All
information regarding the user palm Cartesian position is
retrieved from the controller and fed to the algorithm. The
Conference ISR ROBOTIK 2014
79
ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
algorithm uses the current and previous information sup-
plied by the controller and achieves an optimum realistic
mapping between the user’s real arm and the Jaco arm.
Additionally the arm’s angular features such as roll, pitch,
and yaw angles are considered to the mapping procedure,
enabling a more realistic imitation of the human arm. The
Jaco arm fingers were also programmed to follow all
grasp and release operations performed by the user fin-
gers. To address safety requirements between the user and
the arm, safe zones were considered according to the op-
erating workspace of the robot, in order to ensure safety
in case of unintentional user commands. The adaptive be-
haviour of the proposed system is achieved by continu-
ously monitoring the user hand movement patters, and
estimating oscillation data readings in real-time, which
then according to the detected percentage allows the on-
line reconfiguration of the mapping parameters upon run-
time, in order to filter out the unwanted oscillation. The
resulting implementation is already applied to different
research projects, e.g. the BMBF project USA² (Ubiq-
uitäres und Selbstbestimmtes Arbeiten im Alter).
3.2 Virtual-Operation (Tele-operation)
Another use for such a system could be in Tele-operated
applications. Tele-operation is a method to operate a ro-
bot, while still being at a distance from it. This technique
is specially used in dangerous and risky application areas
(e.g. space exploration, surveillance, surgery, nuclear
plants, and underwater operations). Nowadays, the use of
tele-operation systems is spreading to include non-
hazardous environments as well. The systems are widely
used all around the world in various applications from
space applications to entertainment applications [14].
Also the business sector has been positively affected by
the introduction of such systems. The operating costs are
being lowered, as the real-operator’s share on the control
process is reduced, and the virtual-operator’s share is in-
creased instead. Moreover, work from home for disabled
people is now being possible.
3.3 Tremor Detection
The enhanced precision of the of the Leap Motion con-
troller, is considered a disadvantage for the robotic arm
manipulation on the one hand, due to the fact that any
hand tremor patterns are directly translated to unwanted
oscillation on the robotic arm side, i.e. when operated by
a patient with Parkinson disease. On the other hand, the
sub-millimeter accuracy of the controller could be seen as
an opportunity for detecting symptoms related to hand
tremor, which can indicate an abnormal disorder. A spe-
cial part in the proposed algorithm is designed to take care
of this problem. The system can detect and process the
user palm displacements according to the user hand
tremor patterns, adapting in run-time the output data sent
to the robotic arm, in order to filter out unwanted oscilla-
tion and to enable smooth operation to allow for grab,
pick and place tasks.
In Parkinson disease cases, people suffer apart from the
tremor, also from rigidity and bradykinesia [15], mostly
essential, but also posture [16]. There are already previous
studies on how to measure tremor and bradykinesia in the
home environment [17, 18], by using acceleration sensors
(accelerometers) and gyroscopes. The Leap Motion Con-
troller can be used in the same sense to validate and quan-
tify the tremor and bradykinesia, once it is possible to cal-
culate acceleration in all axes. Also studies were made on
quantifying tremor according to displacements using laser
[19], which required a specific laser grid arrangement in-
frastructure. The authors believe that Leap Motion Con-
troller can be efficiently used as an alternative to devices
such as accelerometers, gyroscopes, laser grids, etc, for
measuring tremor and bradykinesia, in a much more dis-
creet and robust way, due to its compact size, which en-
ables it to be easier introduced to the user vicinity.
4 Implementation
4.1 Steps of Development
4.1.1 Coordinate system transformation
The Leap Motion Controller and the Jaco arm operate on
two different coordinate systems. It was very important at
the very beginning to relate the two systems together, by
performing some rotations. As illustrated in Figure 3, the
transformation from the Leap Motion Controller reference
system to the Jaco arm reference system resulted in a 90
degrees rotation about the x-axis, followed by 180 de-
grees rotation about the z-axis.
Figure 3 Coordinate system transformation
4.1.2 The Mapping Algorithm
The algorithm represented in Figure 4 is developed to
control each motion type of the Jaco arm i.e. Cartesian
motion (X, Y, and Z), and Angular motion (roll, pitch,
and yaw). Every time a new frame is received from the
Leap Motion controller, the algorithm compares the read-
ing with the previous one (which is saved from the previ-
ous frame), and accordingly decides on the next steps that
need to be followed. If the absolute difference between
the two readings is higher than a threshold value (calcu-
lated in advance for each user during the calibration proc-
ess), this means that the arm will react moving either in
the positive or negative direction according to the value of
the readings. In case of having an absolute difference that
Conference ISR ROBOTIK 2014
80
ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
is less than the threshold value, the arm will neglect this
motion. Different delay times were tested in order to find
the optimum delay that allows the Jaco arm to react to the
commands received from the algorithm. This process
keeps going on with a high frequency rate allowing an
optimum imitation of the user’s hand. To efficiently ne-
glect hand tremor patterns caused by health problems (e.g.
Parkinson’s disease), a threshold value for each motion
type is extracted during a calibration process.
Figure 4 The mapping Algorithm
4.1.3 The Calibration procedure
Before starting the operation, the user perform a specific
gesture with his hand or fingers (a clockwise circular ges-
ture) which triggers the calibration process. During this
process the user is prompted to fix his hand for a short
period of time (10-15 secs). During this period all read-
ings from the Leap Motion controller are stored in data
arrays, to be later processed by the calibration algorithm.
By applying a conventional filtering technique (the mov-
ing average filter) to the readings, the extreme noisy sig-
nals are filtered out, hand tremor patterns can be recog-
nized and threshold values can be set accordingly.
Threshold values ensure that hand tremor is not reflected
to the robotic arm movement.
4.1.4 Palm Cartesian operation
In the first phase of development, all information regard-
ing the user’s Palm Cartesian positions (X, Y, and Z)
were retrieved from the Leap Motion Controller and fed
to the mapping algorithm, implemented using the Jaco
API and the Leap Motion Controller SDK files. The algo-
rithm uses the current and previous information supplied
by the Leap Controller and achieves an optimum realistic
mapping between the user’s real palm position and Jaco’s
palm position. Figure 5 illustrates the operation of the al-
gorithm in the Z-direction of the Jaco arm.
Figure 5 Operation in the arm’s Z-direction
4.1.5 Grasp and Release operations
In the second phase of development, the three fingers of
Jaco were programmed to follow all grasp and release op-
erations performed by the user. Figure 6 depicts a demon-
stration of a grasp and release routine. After that, the
hand’s angular characteristics such as roll, pitch, and yaw
angles were considered in the mapping procedure, ena-
bling a more realistic imitation of the human arm.
Figure 6 Grasp and Release Operation
4.1.6 Connection with Arduino micro-controller
To enhance the functionality of the system, an interface is
established between the developed software and the Ardu-
ino Uno micro-controller. This connection allows for the
possibility of interfacing any additional sensors, actuators,
and display systems (e.g. LEDs, push buttons, display
systems, etc.).
4.2 Overall Information Flow Diagram
The diagram below illustrates how information flows be-
tween the different entities of the overall system. The
user’s hand movements are captured by the Leap Motion
Controller and sent to the computer. The implemented
software algorithm performs all necessary computations,
and sends control commands to the Jaco arm. At the same
time, information is received-from/sent-to, additional sen-
sors, actuators, and display systems via a microcontroller
board.
Z direction
Release Grasp
Conference ISR ROBOTIK 2014
81
ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
Figure 7 The information flow diagram
5 Application to the USA² Project
5.1 General Overview
The USA² project is focused on decentralized fabrication
in modular micro factories, based on the concept of Cloud
Manufacturing. The main goal of the project is to offer
possibilities for elderly people to work at their home envi-
ronment and thus contribute to the society. The topic in-
cludes research in different areas such as robotics, tech-
nology, health, society, and change management. The
project aims at offering different work place scenarios
(use cases) and a mock-up/demonstrator (to visualize an
exemplary working place for testing), Figure 8.
Figure 8 The USA² project demonstrator.
5.2 The Schematic Diagram of the system
Figure 9 The schematic diagram of the system
As shown in Figure 9, the user directly interacts with the
Graphical User Interface (GUI), which is considered the
main control unit of the whole system. In case of having
the Leap Control active, the Leap Motion Controller
tracks the user’s hand and fingers, and send this informa-
tion to the PC. The PC receives information from both the
GUI and the Leap Motion Controller and accordingly de-
cides on the suitable information to be sent to the Jaco
arm.
5.3 GUI
A GUI was developed in order to control the complex
functionality of the Jaco arm in a user friendly way (see
Figure 10). The GUI has several push buttons allowing
both, automated and manual operation of the arm. Some
buttons are responsible for moving the arm to certain
fixed positions within the workspace. Additionally, an
emergency exit button, stops the arm immediately and
closes all running communications. There are two buttons
responsible for starting and stopping the Leap control,
“Start Leap” enables the control priority to the Leap Mo-
tion Controller, while “Stop Leap” disables the Leap con-
trol even if the sensor is still tracking the user’s hand.
Grasp and release operations could be performed by
pressing the Grasp and Release buttons respectively. The
user is given the option to save a fixed number of tempo-
rary positions during operation, thus having the possibil-
ity of accessing them later. The interface allows the user
to explore all the different functionality of the system
with just a series of button presses. This application could
run on desktop computers, laptops, or touch screens.
Figure 10 The implemented graphical user interface
(GUI)
6 Application to an AAL flat
As mentioned in the earlier in this paper, the main con-
cern of AAL research is to contribute to the quality of liv-
ing of the ageing society and impaired people, and assist
them in maintaining an independent lifestyle in their
home environment, as long as possible. The main idea
here is to introduce the implemented system of the Jaco
arm and the Leap Motion controller to different smart-
terminals within the authors experimental AAL flat, and
also to mobility aids such as wheelchairs, rollators, etc.
A common problem that elderly people often face when
living alone in their home environment is related to medi-
cation. Occasionally, they forget to take their medication
on time, or maybe face difficulties in preparing it. Some
other times, due to mental or sight illnesses, they take the
Conference ISR ROBOTIK 2014
82
ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
wrong medication at wrong times. These scenarios very
often cause serious problems that could risk their lives.
Robotic arms could assist in such cases. The Jaco arm
could possibly be mounted in the bed terminal, and sup-
ply the user with required items. Figure 11 demonstrates
such a system concept. The arm could move along the
back of the terminal, where it could easily access all the
modules of the terminal as well as, the user’s personal
space.
Figure 11 The bedroom terminal
The Lisa Smart Wall comprises a robotic service wall de-
veloped under a research project in the area of AAL [20].
The service wall was prefabricated offsite and then deliv-
ered as a plug and play terminal. The design is modular
and customizable according to the special needs of each
user. Different devices and modules could be easily added
to or exchanged from the terminal. The Jaco arm could
benefit the functionality of the Lisa Smart Wall by offer-
ing more assistance to the user. By attaching the Jaco arm
and the Leap Motion Controller to the smart wall, the user
can intuitively interact via the proposed Jaco arm manipu-
lation algorithm, Figure 12.
Figure 12 The Lisa Smart Wall
Figure 13 The kitchen terminal
Because of the fact that elderly people spend a large por-
tion of their time in the kitchen, equipping kitchens with
assistive mechatronic and robotic systems is essential.
The Jaco arm could work along with the user and perform
tasks that seem to be difficult for the user to independ-
ently accomplish. One very important advantage for the
Jaco arm in the kitchen environment is being waterproof
according to the IPX2 standard [21], this ensures a safe
and efficient operation. Tasks could range from preparing
the utensils, raw materials, and the workspace for the
user, to a higher level of performing the cooking process
itself. A user friendly interface could be designed to allow
an easy control of the whole system. A possible scenario
for such a kitchen is illustrated in Figure 13.
7 Conclusion
A novel human machine interface is proposed dealing
with the intuitive manipulation of a robotic arm for im-
plementing ADLs, using a new gesture and position track-
ing system with sub-millimeter accuracy. The main objec-
tive of this study is to introduce a simple and straightfor-
ward robotic arm manipulation scheme, in order to enable
the incorporation of robotic systems into the home envi-
ronment, to enhance the independence and autonomy of
individuals with severe mobility impairments, and to al-
low at the same the monitoring and prevention of abnor-
mal disorders such as hand tremor patterns i.e. Parkin-
son’s disease. The use of the implementation in tele-
operated applications has also been discussed. It could
serve operations going on in risk environments, as well as
a wide variety of non-hazardous applications.
The authors believe that the Leap Motion Controller tech-
nology would be undoubtedly benefit and enable the re-
alization of various human-machine interaction applica-
tion in the field of AAL and ADLs, due to its compact
size, enhanced precision, and low purchase cost.
8 Acknowledgements
The work is supported by the BMBF funded project USA²
(Ubiquitäres und Selbstbestimmtes Arbeiten im Alter).
Conference ISR ROBOTIK 2014
83
ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
9 References
[1] Wiener, J.M., Hanley, R.J., Clark, R., Van Nostra JF,
Measuring the activities of daily living: comparisons
across national surveys, Journal of Gerontology,
Social Sciences, 46 (1990) 229-237.
[2] Atkins M.S., et al., Mobile arm supports: evidence
based benefits and criteria for use, Journal of Spinal
Cord Medicine, 31 (2008) 388-393.
[3] Garber, S.L., Gregorio, T. L., Upper extremity
assistive devices: assessment of use by spinal cord
injured patients with quadriplegia, American Journal
of Occupational Therapy, 44 (1990) 126-131.
[4] Romer, G.R.B.E., et al., Cost-savings and economic
benefits due to the assistive robotic manipulator
(ARM), Proceedings of the 9th International Confe-
rence on Rehabilitation Robotics, 2005, pp. 201-204.
[5] Stanger, C.A., et al., Devices for assisting manipula-
tion: a summary of user task priorities, IEEE Trans-
actions on Rehabilitation Engineering, 2 (1994) 256-
265.
[6] Maheu, V., Frappier, J., Archambault, P.S.,
Routhier, F. , Evaluation of the JACO robotic arm:
Clinico-economic study for powered wheelchair
users with upper-extremity disabilities, Proceedings
of the 2011 IEEE Int. Conf. on Rehabilitation
Robotics (ICORR), 2011, pp. 1–5.
[7] Routhier F., Archambault, P. S., Usability of a
wheelchair-mounted six degree-of-freedom robotic
manipulator, RESNA 2010.
[8] Khoshelham, K., Elberink, S.O., Accuracy and reso-
lution of kinect depth data for indoor mapping appli-
cations, Sensors, 12 (2012) 1437–1454.
[9] Biswas, K.K., Basu, S., Gesture Recognition using
Microsoft Kinect, Proceedings of the IEEE Interna-
tional Conference on Automation, Robotics and
Applications (ICARA), Delhi, India, 6–8 December
2011.
[10] Stoyanov, T., Louloudi, A., Andreasson, H., Lilien-
thal, A.J., Comparative Evaluation of Range Sensor
Accuracy in Indoor Environments, Proceedings of
the European Conference on Mobile Robots
(ECMR), Sweden, September 2011. pp. 19-24.
[11] Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.,
Analysis of the accuracy and robustness of the leap
motion controller, Sensors, 13(5) (2013) 6380–6393.
[12] Wachs, J.P., Kölsch, M., Stern, H., Edan, Y., Vision-
Based Hand-Gesture Applications. Communications
of the acm, 54 (2) (2011) 60-71.
[13] Leap Motion | Mac & PC Motion Controller for
Games, Design, & More. 2014. Available at:
http://www.leapmotion.com. [Accessed January
2014].
[14] Pala, M., Lorencik, D., Sincak, P., Towards the
robotic teleoperation systems in education. ICETA
2012, 10th
IEEE International Conference on Emer-
ging eLearning Technologies and Applications, No-
vember 2012, pp. 241-246.
[15] Salarian, A. , Russmann, H., Vingerhoets, F.J.G.P.,
Burkhard, R., Blanc, Y., Dehollain, C., An
Ambulatory System to Quantify Bradykinesia and
Tremor in Parkinson’s Disease, Proceedings of the
IEEE Conference on Information Technology App-
lications in Biomedicine, 2003, pp. 35–38.
[16] Jankovic, J., Schwartz, K.S., Ondo, W., Re-
emergent tremor of Parkinson’s diesease, Journal of
Neurol Neurosurg Psychiatry, 67 (1999) 646–650.
[17] Salarian, A., Russmann, H., Wider, C., Burkhard,
P.R., Vingerhoets, F.J.G., Aminian, K.,
Quantification of Tremor and Bradykinesia in Par-
kinson’s Disease Using a Noval Ambulatory
Monitoring System, IEEE Transaction on Biomedi-
cal Engineering, 54 (2) (2007) 313–322.
[18] Lo, G., Suresh, A.R., Stocco, L., González-
Valenzuela, S., Leung, F.C.M., A Wireless Sensor
System for Motion Analysis of Parkinson’s Disease
Patients, Work in Progress workshop at PerCom,
February 2011, pp. 372–375.
[19] Beuter, A., Geoffroy, A., Cordo, P., The measure-
ment of tremor using simple laser systems, Journal
of Neuroscience Methods, 53 (2014) 47–54.
[20] Georgoulas, C., Linner, T., Kasatkin, A., Bock, T.,
An AmI Environment Implementation: Embedding
TurtleBot into a novel Robotic Service Wall,
Proceedings of the 7th German Conference on
Robotics (ROBOTIK 2012), Munich, Germany,
May 2012, pp. 117-122.
[21] Kinova | Reach your potential. 2014. Available at:
http://www.kinovarobotics.com. [Accessed
December 2013].
Conference ISR ROBOTIK 2014
84
ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach

More Related Content

Similar to using the Leap.pdf

CLASSIFICATION OF SMART ENVIRONMENT SCENARIOS IN COMBINATION WITH A HUMANWEAR...
CLASSIFICATION OF SMART ENVIRONMENT SCENARIOS IN COMBINATION WITH A HUMANWEAR...CLASSIFICATION OF SMART ENVIRONMENT SCENARIOS IN COMBINATION WITH A HUMANWEAR...
CLASSIFICATION OF SMART ENVIRONMENT SCENARIOS IN COMBINATION WITH A HUMANWEAR...csandit
 
Gesture recognition document
Gesture recognition documentGesture recognition document
Gesture recognition documentNikhil Jha
 
Follow Me Robot Technology
Follow Me Robot TechnologyFollow Me Robot Technology
Follow Me Robot Technologyijsrd.com
 
Wearable sensor network for lower limb angle estimation in robotics applications
Wearable sensor network for lower limb angle estimation in robotics applicationsWearable sensor network for lower limb angle estimation in robotics applications
Wearable sensor network for lower limb angle estimation in robotics applicationsTELKOMNIKA JOURNAL
 
A Survey Paper on Controlling Computer using Hand Gestures
A Survey Paper on Controlling Computer using Hand GesturesA Survey Paper on Controlling Computer using Hand Gestures
A Survey Paper on Controlling Computer using Hand GesturesIRJET Journal
 
Gesture recognition
Gesture recognitionGesture recognition
Gesture recognitionMariya Khan
 
The Internet-of-Things based hand gestures using wearable sensors for human m...
The Internet-of-Things based hand gestures using wearable sensors for human m...The Internet-of-Things based hand gestures using wearable sensors for human m...
The Internet-of-Things based hand gestures using wearable sensors for human m...CloudTechnologies
 
IRJET- Human Hand Movement Training with Exoskeleton ARM
IRJET- Human Hand Movement Training with Exoskeleton ARMIRJET- Human Hand Movement Training with Exoskeleton ARM
IRJET- Human Hand Movement Training with Exoskeleton ARMIRJET Journal
 
Gesture Based Interface Using Motion and Image Comparison
Gesture Based Interface Using Motion and Image ComparisonGesture Based Interface Using Motion and Image Comparison
Gesture Based Interface Using Motion and Image Comparisonijait
 
Robotic Hand in Motion Final Paper
Robotic Hand in Motion Final PaperRobotic Hand in Motion Final Paper
Robotic Hand in Motion Final PaperLauren Wellons
 
IRJET- Human Activity Recognition using Flex Sensors
IRJET- Human Activity Recognition using Flex SensorsIRJET- Human Activity Recognition using Flex Sensors
IRJET- Human Activity Recognition using Flex SensorsIRJET Journal
 
EVALUATION & TRENDS OF SURVEILLANCE SYSTEM NETWORK IN UBIQUITOUS COMPUTING EN...
EVALUATION & TRENDS OF SURVEILLANCE SYSTEM NETWORK IN UBIQUITOUS COMPUTING EN...EVALUATION & TRENDS OF SURVEILLANCE SYSTEM NETWORK IN UBIQUITOUS COMPUTING EN...
EVALUATION & TRENDS OF SURVEILLANCE SYSTEM NETWORK IN UBIQUITOUS COMPUTING EN...Eswar Publications
 
IRJET- Design and Implementation of Gesture Controlled Robot with a Robotic ARM
IRJET- Design and Implementation of Gesture Controlled Robot with a Robotic ARMIRJET- Design and Implementation of Gesture Controlled Robot with a Robotic ARM
IRJET- Design and Implementation of Gesture Controlled Robot with a Robotic ARMIRJET Journal
 
Medical Handsfree System - Project Paper
Medical Handsfree System - Project PaperMedical Handsfree System - Project Paper
Medical Handsfree System - Project PaperGuy Peleg
 
Tele-Robotic Surgical Arm System with Efficient Tactile Sensors in the Manipu...
Tele-Robotic Surgical Arm System with Efficient Tactile Sensors in the Manipu...Tele-Robotic Surgical Arm System with Efficient Tactile Sensors in the Manipu...
Tele-Robotic Surgical Arm System with Efficient Tactile Sensors in the Manipu...Associate Professor in VSB Coimbatore
 

Similar to using the Leap.pdf (20)

CLASSIFICATION OF SMART ENVIRONMENT SCENARIOS IN COMBINATION WITH A HUMANWEAR...
CLASSIFICATION OF SMART ENVIRONMENT SCENARIOS IN COMBINATION WITH A HUMANWEAR...CLASSIFICATION OF SMART ENVIRONMENT SCENARIOS IN COMBINATION WITH A HUMANWEAR...
CLASSIFICATION OF SMART ENVIRONMENT SCENARIOS IN COMBINATION WITH A HUMANWEAR...
 
Smart Built-Environments for People Living with Dementia_Crimson Publishers
Smart Built-Environments for People Living with Dementia_Crimson PublishersSmart Built-Environments for People Living with Dementia_Crimson Publishers
Smart Built-Environments for People Living with Dementia_Crimson Publishers
 
Gesture recognition document
Gesture recognition documentGesture recognition document
Gesture recognition document
 
Myo armband project
Myo armband projectMyo armband project
Myo armband project
 
Follow Me Robot Technology
Follow Me Robot TechnologyFollow Me Robot Technology
Follow Me Robot Technology
 
Gerture controlled Robot
Gerture controlled RobotGerture controlled Robot
Gerture controlled Robot
 
Wearable sensor network for lower limb angle estimation in robotics applications
Wearable sensor network for lower limb angle estimation in robotics applicationsWearable sensor network for lower limb angle estimation in robotics applications
Wearable sensor network for lower limb angle estimation in robotics applications
 
A Survey Paper on Controlling Computer using Hand Gestures
A Survey Paper on Controlling Computer using Hand GesturesA Survey Paper on Controlling Computer using Hand Gestures
A Survey Paper on Controlling Computer using Hand Gestures
 
Gesture recognition
Gesture recognitionGesture recognition
Gesture recognition
 
The Internet-of-Things based hand gestures using wearable sensors for human m...
The Internet-of-Things based hand gestures using wearable sensors for human m...The Internet-of-Things based hand gestures using wearable sensors for human m...
The Internet-of-Things based hand gestures using wearable sensors for human m...
 
IRJET- Human Hand Movement Training with Exoskeleton ARM
IRJET- Human Hand Movement Training with Exoskeleton ARMIRJET- Human Hand Movement Training with Exoskeleton ARM
IRJET- Human Hand Movement Training with Exoskeleton ARM
 
Gesture Based Interface Using Motion and Image Comparison
Gesture Based Interface Using Motion and Image ComparisonGesture Based Interface Using Motion and Image Comparison
Gesture Based Interface Using Motion and Image Comparison
 
Robotic Hand in Motion Final Paper
Robotic Hand in Motion Final PaperRobotic Hand in Motion Final Paper
Robotic Hand in Motion Final Paper
 
IRJET- Human Activity Recognition using Flex Sensors
IRJET- Human Activity Recognition using Flex SensorsIRJET- Human Activity Recognition using Flex Sensors
IRJET- Human Activity Recognition using Flex Sensors
 
14 561
14 56114 561
14 561
 
EVALUATION & TRENDS OF SURVEILLANCE SYSTEM NETWORK IN UBIQUITOUS COMPUTING EN...
EVALUATION & TRENDS OF SURVEILLANCE SYSTEM NETWORK IN UBIQUITOUS COMPUTING EN...EVALUATION & TRENDS OF SURVEILLANCE SYSTEM NETWORK IN UBIQUITOUS COMPUTING EN...
EVALUATION & TRENDS OF SURVEILLANCE SYSTEM NETWORK IN UBIQUITOUS COMPUTING EN...
 
IRJET- Design and Implementation of Gesture Controlled Robot with a Robotic ARM
IRJET- Design and Implementation of Gesture Controlled Robot with a Robotic ARMIRJET- Design and Implementation of Gesture Controlled Robot with a Robotic ARM
IRJET- Design and Implementation of Gesture Controlled Robot with a Robotic ARM
 
Medical Handsfree System - Project Paper
Medical Handsfree System - Project PaperMedical Handsfree System - Project Paper
Medical Handsfree System - Project Paper
 
delna's journal
delna's journaldelna's journal
delna's journal
 
Tele-Robotic Surgical Arm System with Efficient Tactile Sensors in the Manipu...
Tele-Robotic Surgical Arm System with Efficient Tactile Sensors in the Manipu...Tele-Robotic Surgical Arm System with Efficient Tactile Sensors in the Manipu...
Tele-Robotic Surgical Arm System with Efficient Tactile Sensors in the Manipu...
 

Recently uploaded

Pallawi 9167673311 Call Girls in Thane , Independent Escort Service Thane
Pallawi 9167673311  Call Girls in Thane , Independent Escort Service ThanePallawi 9167673311  Call Girls in Thane , Independent Escort Service Thane
Pallawi 9167673311 Call Girls in Thane , Independent Escort Service ThanePooja Nehwal
 
定制(UI学位证)爱达荷大学毕业证成绩单原版一比一
定制(UI学位证)爱达荷大学毕业证成绩单原版一比一定制(UI学位证)爱达荷大学毕业证成绩单原版一比一
定制(UI学位证)爱达荷大学毕业证成绩单原版一比一ss ss
 
Kalyan callg Girls, { 07738631006 } || Call Girl In Kalyan Women Seeking Men ...
Kalyan callg Girls, { 07738631006 } || Call Girl In Kalyan Women Seeking Men ...Kalyan callg Girls, { 07738631006 } || Call Girl In Kalyan Women Seeking Men ...
Kalyan callg Girls, { 07738631006 } || Call Girl In Kalyan Women Seeking Men ...Pooja Nehwal
 
High Profile Call Girls In Andheri 7738631006 Call girls in mumbai Mumbai ...
High Profile Call Girls In Andheri 7738631006 Call girls in mumbai  Mumbai ...High Profile Call Girls In Andheri 7738631006 Call girls in mumbai  Mumbai ...
High Profile Call Girls In Andheri 7738631006 Call girls in mumbai Mumbai ...Pooja Nehwal
 
原版制作美国天普大学毕业证(本硕)tu毕业证明原版一模一样
原版制作美国天普大学毕业证(本硕)tu毕业证明原版一模一样原版制作美国天普大学毕业证(本硕)tu毕业证明原版一模一样
原版制作美国天普大学毕业证(本硕)tu毕业证明原版一模一样qaffana
 
FULL ENJOY - 8264348440 Call Girls in Hauz Khas | Delhi
FULL ENJOY - 8264348440 Call Girls in Hauz Khas | DelhiFULL ENJOY - 8264348440 Call Girls in Hauz Khas | Delhi
FULL ENJOY - 8264348440 Call Girls in Hauz Khas | Delhisoniya singh
 
如何办理(Adelaide毕业证)阿德莱德大学毕业证成绩单Adelaide学历认证真实可查
如何办理(Adelaide毕业证)阿德莱德大学毕业证成绩单Adelaide学历认证真实可查如何办理(Adelaide毕业证)阿德莱德大学毕业证成绩单Adelaide学历认证真实可查
如何办理(Adelaide毕业证)阿德莱德大学毕业证成绩单Adelaide学历认证真实可查awo24iot
 
Call Girls in Dwarka Sub City 💯Call Us 🔝8264348440🔝
Call Girls in Dwarka Sub City 💯Call Us 🔝8264348440🔝Call Girls in Dwarka Sub City 💯Call Us 🔝8264348440🔝
Call Girls in Dwarka Sub City 💯Call Us 🔝8264348440🔝soniya singh
 
Call Girls in Nagpur Bhavna Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Bhavna Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Bhavna Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Bhavna Call 7001035870 Meet With Nagpur Escortsranjana rawat
 
(ZARA) Call Girls Jejuri ( 7001035870 ) HI-Fi Pune Escorts Service
(ZARA) Call Girls Jejuri ( 7001035870 ) HI-Fi Pune Escorts Service(ZARA) Call Girls Jejuri ( 7001035870 ) HI-Fi Pune Escorts Service
(ZARA) Call Girls Jejuri ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
Call Girls Delhi {Rohini} 9711199012 high profile service
Call Girls Delhi {Rohini} 9711199012 high profile serviceCall Girls Delhi {Rohini} 9711199012 high profile service
Call Girls Delhi {Rohini} 9711199012 high profile servicerehmti665
 
Call Girls In Andheri East Call 9892124323 Book Hot And Sexy Girls,
Call Girls In Andheri East Call 9892124323 Book Hot And Sexy Girls,Call Girls In Andheri East Call 9892124323 Book Hot And Sexy Girls,
Call Girls In Andheri East Call 9892124323 Book Hot And Sexy Girls,Pooja Nehwal
 
定制(USF学位证)旧金山大学毕业证成绩单原版一比一
定制(USF学位证)旧金山大学毕业证成绩单原版一比一定制(USF学位证)旧金山大学毕业证成绩单原版一比一
定制(USF学位证)旧金山大学毕业证成绩单原版一比一ss ss
 
VIP Call Girl Saharanpur Aashi 8250192130 Independent Escort Service Saharanpur
VIP Call Girl Saharanpur Aashi 8250192130 Independent Escort Service SaharanpurVIP Call Girl Saharanpur Aashi 8250192130 Independent Escort Service Saharanpur
VIP Call Girl Saharanpur Aashi 8250192130 Independent Escort Service SaharanpurSuhani Kapoor
 
Thane Escorts, (Pooja 09892124323), Thane Call Girls
Thane Escorts, (Pooja 09892124323), Thane Call GirlsThane Escorts, (Pooja 09892124323), Thane Call Girls
Thane Escorts, (Pooja 09892124323), Thane Call GirlsPooja Nehwal
 
Call Girls Delhi {Rs-10000 Laxmi Nagar] 9711199012 Whats Up Number
Call Girls Delhi {Rs-10000 Laxmi Nagar] 9711199012 Whats Up NumberCall Girls Delhi {Rs-10000 Laxmi Nagar] 9711199012 Whats Up Number
Call Girls Delhi {Rs-10000 Laxmi Nagar] 9711199012 Whats Up NumberMs Riya
 
(SANA) Call Girls Landewadi ( 7001035870 ) HI-Fi Pune Escorts Service
(SANA) Call Girls Landewadi ( 7001035870 ) HI-Fi Pune Escorts Service(SANA) Call Girls Landewadi ( 7001035870 ) HI-Fi Pune Escorts Service
(SANA) Call Girls Landewadi ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
Lucknow 💋 Call Girls Adil Nagar | ₹,9500 Pay Cash 8923113531 Free Home Delive...
Lucknow 💋 Call Girls Adil Nagar | ₹,9500 Pay Cash 8923113531 Free Home Delive...Lucknow 💋 Call Girls Adil Nagar | ₹,9500 Pay Cash 8923113531 Free Home Delive...
Lucknow 💋 Call Girls Adil Nagar | ₹,9500 Pay Cash 8923113531 Free Home Delive...anilsa9823
 
定制宾州州立大学毕业证(PSU毕业证) 成绩单留信学历认证原版一比一
定制宾州州立大学毕业证(PSU毕业证) 成绩单留信学历认证原版一比一定制宾州州立大学毕业证(PSU毕业证) 成绩单留信学历认证原版一比一
定制宾州州立大学毕业证(PSU毕业证) 成绩单留信学历认证原版一比一ga6c6bdl
 

Recently uploaded (20)

Pallawi 9167673311 Call Girls in Thane , Independent Escort Service Thane
Pallawi 9167673311  Call Girls in Thane , Independent Escort Service ThanePallawi 9167673311  Call Girls in Thane , Independent Escort Service Thane
Pallawi 9167673311 Call Girls in Thane , Independent Escort Service Thane
 
定制(UI学位证)爱达荷大学毕业证成绩单原版一比一
定制(UI学位证)爱达荷大学毕业证成绩单原版一比一定制(UI学位证)爱达荷大学毕业证成绩单原版一比一
定制(UI学位证)爱达荷大学毕业证成绩单原版一比一
 
Kalyan callg Girls, { 07738631006 } || Call Girl In Kalyan Women Seeking Men ...
Kalyan callg Girls, { 07738631006 } || Call Girl In Kalyan Women Seeking Men ...Kalyan callg Girls, { 07738631006 } || Call Girl In Kalyan Women Seeking Men ...
Kalyan callg Girls, { 07738631006 } || Call Girl In Kalyan Women Seeking Men ...
 
High Profile Call Girls In Andheri 7738631006 Call girls in mumbai Mumbai ...
High Profile Call Girls In Andheri 7738631006 Call girls in mumbai  Mumbai ...High Profile Call Girls In Andheri 7738631006 Call girls in mumbai  Mumbai ...
High Profile Call Girls In Andheri 7738631006 Call girls in mumbai Mumbai ...
 
原版制作美国天普大学毕业证(本硕)tu毕业证明原版一模一样
原版制作美国天普大学毕业证(本硕)tu毕业证明原版一模一样原版制作美国天普大学毕业证(本硕)tu毕业证明原版一模一样
原版制作美国天普大学毕业证(本硕)tu毕业证明原版一模一样
 
FULL ENJOY - 8264348440 Call Girls in Hauz Khas | Delhi
FULL ENJOY - 8264348440 Call Girls in Hauz Khas | DelhiFULL ENJOY - 8264348440 Call Girls in Hauz Khas | Delhi
FULL ENJOY - 8264348440 Call Girls in Hauz Khas | Delhi
 
如何办理(Adelaide毕业证)阿德莱德大学毕业证成绩单Adelaide学历认证真实可查
如何办理(Adelaide毕业证)阿德莱德大学毕业证成绩单Adelaide学历认证真实可查如何办理(Adelaide毕业证)阿德莱德大学毕业证成绩单Adelaide学历认证真实可查
如何办理(Adelaide毕业证)阿德莱德大学毕业证成绩单Adelaide学历认证真实可查
 
Call Girls in Dwarka Sub City 💯Call Us 🔝8264348440🔝
Call Girls in Dwarka Sub City 💯Call Us 🔝8264348440🔝Call Girls in Dwarka Sub City 💯Call Us 🔝8264348440🔝
Call Girls in Dwarka Sub City 💯Call Us 🔝8264348440🔝
 
Call Girls in Nagpur Bhavna Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Bhavna Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Bhavna Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Bhavna Call 7001035870 Meet With Nagpur Escorts
 
(ZARA) Call Girls Jejuri ( 7001035870 ) HI-Fi Pune Escorts Service
(ZARA) Call Girls Jejuri ( 7001035870 ) HI-Fi Pune Escorts Service(ZARA) Call Girls Jejuri ( 7001035870 ) HI-Fi Pune Escorts Service
(ZARA) Call Girls Jejuri ( 7001035870 ) HI-Fi Pune Escorts Service
 
Call Girls Delhi {Rohini} 9711199012 high profile service
Call Girls Delhi {Rohini} 9711199012 high profile serviceCall Girls Delhi {Rohini} 9711199012 high profile service
Call Girls Delhi {Rohini} 9711199012 high profile service
 
Call Girls In Andheri East Call 9892124323 Book Hot And Sexy Girls,
Call Girls In Andheri East Call 9892124323 Book Hot And Sexy Girls,Call Girls In Andheri East Call 9892124323 Book Hot And Sexy Girls,
Call Girls In Andheri East Call 9892124323 Book Hot And Sexy Girls,
 
定制(USF学位证)旧金山大学毕业证成绩单原版一比一
定制(USF学位证)旧金山大学毕业证成绩单原版一比一定制(USF学位证)旧金山大学毕业证成绩单原版一比一
定制(USF学位证)旧金山大学毕业证成绩单原版一比一
 
VIP Call Girl Saharanpur Aashi 8250192130 Independent Escort Service Saharanpur
VIP Call Girl Saharanpur Aashi 8250192130 Independent Escort Service SaharanpurVIP Call Girl Saharanpur Aashi 8250192130 Independent Escort Service Saharanpur
VIP Call Girl Saharanpur Aashi 8250192130 Independent Escort Service Saharanpur
 
Low rate Call girls in Delhi Justdial | 9953330565
Low rate Call girls in Delhi Justdial | 9953330565Low rate Call girls in Delhi Justdial | 9953330565
Low rate Call girls in Delhi Justdial | 9953330565
 
Thane Escorts, (Pooja 09892124323), Thane Call Girls
Thane Escorts, (Pooja 09892124323), Thane Call GirlsThane Escorts, (Pooja 09892124323), Thane Call Girls
Thane Escorts, (Pooja 09892124323), Thane Call Girls
 
Call Girls Delhi {Rs-10000 Laxmi Nagar] 9711199012 Whats Up Number
Call Girls Delhi {Rs-10000 Laxmi Nagar] 9711199012 Whats Up NumberCall Girls Delhi {Rs-10000 Laxmi Nagar] 9711199012 Whats Up Number
Call Girls Delhi {Rs-10000 Laxmi Nagar] 9711199012 Whats Up Number
 
(SANA) Call Girls Landewadi ( 7001035870 ) HI-Fi Pune Escorts Service
(SANA) Call Girls Landewadi ( 7001035870 ) HI-Fi Pune Escorts Service(SANA) Call Girls Landewadi ( 7001035870 ) HI-Fi Pune Escorts Service
(SANA) Call Girls Landewadi ( 7001035870 ) HI-Fi Pune Escorts Service
 
Lucknow 💋 Call Girls Adil Nagar | ₹,9500 Pay Cash 8923113531 Free Home Delive...
Lucknow 💋 Call Girls Adil Nagar | ₹,9500 Pay Cash 8923113531 Free Home Delive...Lucknow 💋 Call Girls Adil Nagar | ₹,9500 Pay Cash 8923113531 Free Home Delive...
Lucknow 💋 Call Girls Adil Nagar | ₹,9500 Pay Cash 8923113531 Free Home Delive...
 
定制宾州州立大学毕业证(PSU毕业证) 成绩单留信学历认证原版一比一
定制宾州州立大学毕业证(PSU毕业证) 成绩单留信学历认证原版一比一定制宾州州立大学毕业证(PSU毕业证) 成绩单留信学历认证原版一比一
定制宾州州立大学毕业证(PSU毕业证) 成绩单留信学历认证原版一比一
 

using the Leap.pdf

  • 1. Intuitive and Adaptive Robotic Arm Manipulation using the Leap Motion Controller D. Bassily, C. Georgoulas, J. Güttler, T. Linner, T. Bock, TU München, Germany Abstract Robotics provide an efficient approach in the development of assistive devices, due to their enhanced functionality. Sta- tistics predict that by 2035, half of the population in Germany is going to be older than fifty, every third person even over 60. These ageing societies face numerous challenges in performing simple tasks in Activities of Daily Living “ADLs”. Increasingly, a lot of research is being focused on Ambient Assisted Living “AAL” which presents a new ap- proach that promises to address the needs of elderly people. An important goal of AAL is to contribute to the quality of life of the elderly and handicapped people and help them to maintain an independent lifestyle. The introduction of ro- botics and technology-supported environments will play a huge role in allowing elderly and physically impaired people to keep living a self-determined, independent life in their familiar surroundings. In this paper, the implementation of a novel intuitive and adaptive manipulation scheme is proposed, by developing a human-machine communication inter- face between the Leap Motion controller and the 6-DOF Jaco robotic arm. An algorithm is developed to allow an opti- mum mapping between the user hand movement, tracked by the Leap Motion controller, and the Jaco arm. The system should allow for a more natural human-computer interaction and a smooth manipulation of the robotic arm, by con- stantly adapting to the user hand tremor or shake. The implementation would specially enhance the quality of living, especially for people with upper limb problems, and would support them in performing some of the essential Activities of Daily Living “ADLs”. The applications of this human-robot interaction will be discussed in relation with Ambient Assisted Living, where some use case scenarios will be introduced. 1 Introduction Impaired or aged individuals require novel approaches for placing mechatronics and robotic assisted services in their living environments. The development of such systems should be focused on cost effectiveness, ease of control, and safe operation, in order to enhance the autonomy and independence of such individuals, minimizing at the same time the necessity for a caregiver. Already in early devel- opment phases, knowledge at least from the robotic, medical and ergonomic field is necessary. Ageing society faces numerous challenges in performing simple tasks in Activities of Daily Living (ADLs), [1]. ADLs represent the everyday tasks people usually need to be able to independently accomplish. Nowadays caring of elderly people becomes more and more important. Indi- viduals with upper limb impairments, also face difficulties to perform ADLs, especially in cases where the impair- ments have resulted from spinal cord injuries, neuromus- cular diseases, etc. Many technical aids have been devel- oped to assist in impairments in the home environment. However these assistive devices provide limited function- ality and cannot address in an efficient way independence and autonomy [2, 3]. Some researchers already evaluated the efficiency of ro- botic systems and more specifically robotic arms, used by disabled individuals in performing ADLs [4, 5]. An im- portant parameter when concerning the efficiency of as- sistive devices for disabled individuals is the economic benefit in terms of comparing the robotic system cost with the total cost required for a caregiver, in a long term scheme. The Jaco robotic arm, can efficiently substitute caregivers as a cost saving alternative [6, 7]. In the last few years, different optical sensors have been developed, which allow the mapping and acquisition of 3- D information. Various applications also have been intro- duced, which exploit the increasing accuracy and robust- ness, and the decreasing cost over time of 3-D sensors [8]. The applications range from industrial use, object track- ing, motion detection and analysis, to 3-D scene recon- struction and gesture-based human machine interfaces [9]. These applications have different requirements in terms of resolution, frame-rate throughput, and operating distance. Especially for gesture-based user interfaces, the accuracy of the sensor is greatly considered a challenging task [8, 10]. The Leap Motion controller introduces a new novel gesture and position tracking system with sub-millimeter accuracy [11]. The controller operation is based on infra- red optics and cameras instead of depth sensors. Its mo- tion sensing precision is unmatched by any depth camera currently available, to the best of the authors knowledge so far. It can track all 10 of the human fingers simultane- ously. As stated by the manufacturer, the accuracy in the detection of each fingertip position is approximately 0.01mm, with a frame rate of up to 300 fps. In the proposed paper the authors develop a human- machine interface which offers intuitive and adaptive ma- nipulation in ADLs, using the Leap Motion controller and the Jaco arm. 2 Gesture-based Human-Robot In- teraction Since the introduction of computers to our world, we have been witnessing creative inventions in the science of hu- Conference ISR ROBOTIK 2014 78 ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
  • 2. man-computer interaction. For many years, the term “in- put device" evoked mainly two specific devices: the key- board and the mouse - the main instruments used to pro- vide user input to a personal computer. Nowadays, with the evolution of computers, and the increasing research on human-computer interaction technologies, we have a large set of input devices that changed the way of interac- tion. The new approaches of human-computer interfaces will facilitate a more natural, intuitive communication be- tween people and all kinds of sensor-based input devices, thus more closely mimicking the human-human commu- nication [12]. Innovative technologies empower users to be more natural and spontaneous when dealing with them. Also, the systems adopting these technologies show in- creased efficiency, speed, power, and realism. However, many users feel comfortable with traditional interaction methods like mice and keyboards to the extent that they are often unwilling to embrace new, alternative interfaces. A possible reason for that might be the complexity of these new technologies, where very often users find it dis- turbing to spend a lot of time learning and adapting to these new devices. Gesture-based human-computer inter- action could represent a potential solution for this prob- lem since they are the most primary and expressive form of human communication [12]. Two successful examples of 3-D optical sensors are: the Nintendo Wii and the Mi- crosoft's Xbox Kinect. Each of the two examples have its own operating principle. The Wii operates by means of a remote which the user has to keep holding during the en- tire operation time. The Kinect was initially developed to allow the user to interact with the Xbox without any con- trollers, however it was used further as a vision platform in many different applications. An analysis of the Kinect controller showed that it has an approximately 1.5 cm standard deviation in depth accuracy [8]. The Leap Motion Controller is considered a breakthrough device in the field of hand gesture controlled human- computer interface. The new, consumer-grade controller introduces a new novel gesture and position tracking sys- tem with sub-millimeter accuracy. The controller opera- tion is based on infrared optics and cameras instead of depth sensors. Its motion sensing precision is unmatched by any depth camera currently available, to the best of the author’s knowledge so far. It can track all 10 of the hu- man fingers simultaneously. As stated by the manufac- turer, the accuracy in the detection of each fingertip posi- tion is approximately 0.01mm, with a frame rate of up to 300 fps [13]. Figure 1 The Leap Motion Controller The controller is considered to be an optical tracking sys- tem based on stereo vision. Within its surface area of 24 cm², the controller has three IR (Infrared Light) emitters and two IR cameras [11]. The field of view of the control- ler is very wide, up to 150° [13], which gives the user the opportunity to move his hand in 3D, just like in real world. Figure 2 The schematic view of the Leap Motion Con- troller. The Software Development Kit (SDK) supplied by the manufacturer delivers information about Cartesian space of predefined objects such as the finger tips, pen tip, hand palm position, etc. Also, information about the rotations of the hand (e.g. Roll, Pitch, and Yaw) are available as well. All delivered positions are relative to the Leap Mo- tion Controller’s center point, which lies between the two IR cameras, just above the second IR emitter. 3 Proposed Concept 3.1 Supporting elderly and disabled people in home environments After discussing about the demographic changes that the world is experiencing and will continue to experience dur- ing at least the next few decades, after seeing the chal- lenges that elderly and impaired people face in order to perform simple ADLs, and after recognizing the potential role that robotics could perform in the AAL field, a novel implementation is proposed in this paper. The most common human-robot interaction is achieved via a keyboard or a joystick, which according to the com- plexity of the robotic arm, require a series of configura- tions and mode selection routines by pressing a series of buttons, in order to select an operating mode, or to per- form a specific trajectory path. After performing research on new ways of operating such devices, in order to reduce the involved operation complexity, a new human-robot interaction scheme is proposed. The proposed concept depends on what is so called a more “natural” human-robot interaction. The Leap Mo- tion Controller is used to operate the 6-DOF Jaco Robot to perform ADLs in a more intuitive way. Instead of using the original joystick “Kinova Joystick” of the Jaco arm and thus having to switch between different modes of control, the joystick is replaced with the Leap Motion controller. The controller monitors the user’s hand/hands, fingers, and all the accompanied positions and angles. All information regarding the user palm Cartesian position is retrieved from the controller and fed to the algorithm. The Conference ISR ROBOTIK 2014 79 ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
  • 3. algorithm uses the current and previous information sup- plied by the controller and achieves an optimum realistic mapping between the user’s real arm and the Jaco arm. Additionally the arm’s angular features such as roll, pitch, and yaw angles are considered to the mapping procedure, enabling a more realistic imitation of the human arm. The Jaco arm fingers were also programmed to follow all grasp and release operations performed by the user fin- gers. To address safety requirements between the user and the arm, safe zones were considered according to the op- erating workspace of the robot, in order to ensure safety in case of unintentional user commands. The adaptive be- haviour of the proposed system is achieved by continu- ously monitoring the user hand movement patters, and estimating oscillation data readings in real-time, which then according to the detected percentage allows the on- line reconfiguration of the mapping parameters upon run- time, in order to filter out the unwanted oscillation. The resulting implementation is already applied to different research projects, e.g. the BMBF project USA² (Ubiq- uitäres und Selbstbestimmtes Arbeiten im Alter). 3.2 Virtual-Operation (Tele-operation) Another use for such a system could be in Tele-operated applications. Tele-operation is a method to operate a ro- bot, while still being at a distance from it. This technique is specially used in dangerous and risky application areas (e.g. space exploration, surveillance, surgery, nuclear plants, and underwater operations). Nowadays, the use of tele-operation systems is spreading to include non- hazardous environments as well. The systems are widely used all around the world in various applications from space applications to entertainment applications [14]. Also the business sector has been positively affected by the introduction of such systems. The operating costs are being lowered, as the real-operator’s share on the control process is reduced, and the virtual-operator’s share is in- creased instead. Moreover, work from home for disabled people is now being possible. 3.3 Tremor Detection The enhanced precision of the of the Leap Motion con- troller, is considered a disadvantage for the robotic arm manipulation on the one hand, due to the fact that any hand tremor patterns are directly translated to unwanted oscillation on the robotic arm side, i.e. when operated by a patient with Parkinson disease. On the other hand, the sub-millimeter accuracy of the controller could be seen as an opportunity for detecting symptoms related to hand tremor, which can indicate an abnormal disorder. A spe- cial part in the proposed algorithm is designed to take care of this problem. The system can detect and process the user palm displacements according to the user hand tremor patterns, adapting in run-time the output data sent to the robotic arm, in order to filter out unwanted oscilla- tion and to enable smooth operation to allow for grab, pick and place tasks. In Parkinson disease cases, people suffer apart from the tremor, also from rigidity and bradykinesia [15], mostly essential, but also posture [16]. There are already previous studies on how to measure tremor and bradykinesia in the home environment [17, 18], by using acceleration sensors (accelerometers) and gyroscopes. The Leap Motion Con- troller can be used in the same sense to validate and quan- tify the tremor and bradykinesia, once it is possible to cal- culate acceleration in all axes. Also studies were made on quantifying tremor according to displacements using laser [19], which required a specific laser grid arrangement in- frastructure. The authors believe that Leap Motion Con- troller can be efficiently used as an alternative to devices such as accelerometers, gyroscopes, laser grids, etc, for measuring tremor and bradykinesia, in a much more dis- creet and robust way, due to its compact size, which en- ables it to be easier introduced to the user vicinity. 4 Implementation 4.1 Steps of Development 4.1.1 Coordinate system transformation The Leap Motion Controller and the Jaco arm operate on two different coordinate systems. It was very important at the very beginning to relate the two systems together, by performing some rotations. As illustrated in Figure 3, the transformation from the Leap Motion Controller reference system to the Jaco arm reference system resulted in a 90 degrees rotation about the x-axis, followed by 180 de- grees rotation about the z-axis. Figure 3 Coordinate system transformation 4.1.2 The Mapping Algorithm The algorithm represented in Figure 4 is developed to control each motion type of the Jaco arm i.e. Cartesian motion (X, Y, and Z), and Angular motion (roll, pitch, and yaw). Every time a new frame is received from the Leap Motion controller, the algorithm compares the read- ing with the previous one (which is saved from the previ- ous frame), and accordingly decides on the next steps that need to be followed. If the absolute difference between the two readings is higher than a threshold value (calcu- lated in advance for each user during the calibration proc- ess), this means that the arm will react moving either in the positive or negative direction according to the value of the readings. In case of having an absolute difference that Conference ISR ROBOTIK 2014 80 ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
  • 4. is less than the threshold value, the arm will neglect this motion. Different delay times were tested in order to find the optimum delay that allows the Jaco arm to react to the commands received from the algorithm. This process keeps going on with a high frequency rate allowing an optimum imitation of the user’s hand. To efficiently ne- glect hand tremor patterns caused by health problems (e.g. Parkinson’s disease), a threshold value for each motion type is extracted during a calibration process. Figure 4 The mapping Algorithm 4.1.3 The Calibration procedure Before starting the operation, the user perform a specific gesture with his hand or fingers (a clockwise circular ges- ture) which triggers the calibration process. During this process the user is prompted to fix his hand for a short period of time (10-15 secs). During this period all read- ings from the Leap Motion controller are stored in data arrays, to be later processed by the calibration algorithm. By applying a conventional filtering technique (the mov- ing average filter) to the readings, the extreme noisy sig- nals are filtered out, hand tremor patterns can be recog- nized and threshold values can be set accordingly. Threshold values ensure that hand tremor is not reflected to the robotic arm movement. 4.1.4 Palm Cartesian operation In the first phase of development, all information regard- ing the user’s Palm Cartesian positions (X, Y, and Z) were retrieved from the Leap Motion Controller and fed to the mapping algorithm, implemented using the Jaco API and the Leap Motion Controller SDK files. The algo- rithm uses the current and previous information supplied by the Leap Controller and achieves an optimum realistic mapping between the user’s real palm position and Jaco’s palm position. Figure 5 illustrates the operation of the al- gorithm in the Z-direction of the Jaco arm. Figure 5 Operation in the arm’s Z-direction 4.1.5 Grasp and Release operations In the second phase of development, the three fingers of Jaco were programmed to follow all grasp and release op- erations performed by the user. Figure 6 depicts a demon- stration of a grasp and release routine. After that, the hand’s angular characteristics such as roll, pitch, and yaw angles were considered in the mapping procedure, ena- bling a more realistic imitation of the human arm. Figure 6 Grasp and Release Operation 4.1.6 Connection with Arduino micro-controller To enhance the functionality of the system, an interface is established between the developed software and the Ardu- ino Uno micro-controller. This connection allows for the possibility of interfacing any additional sensors, actuators, and display systems (e.g. LEDs, push buttons, display systems, etc.). 4.2 Overall Information Flow Diagram The diagram below illustrates how information flows be- tween the different entities of the overall system. The user’s hand movements are captured by the Leap Motion Controller and sent to the computer. The implemented software algorithm performs all necessary computations, and sends control commands to the Jaco arm. At the same time, information is received-from/sent-to, additional sen- sors, actuators, and display systems via a microcontroller board. Z direction Release Grasp Conference ISR ROBOTIK 2014 81 ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
  • 5. Figure 7 The information flow diagram 5 Application to the USA² Project 5.1 General Overview The USA² project is focused on decentralized fabrication in modular micro factories, based on the concept of Cloud Manufacturing. The main goal of the project is to offer possibilities for elderly people to work at their home envi- ronment and thus contribute to the society. The topic in- cludes research in different areas such as robotics, tech- nology, health, society, and change management. The project aims at offering different work place scenarios (use cases) and a mock-up/demonstrator (to visualize an exemplary working place for testing), Figure 8. Figure 8 The USA² project demonstrator. 5.2 The Schematic Diagram of the system Figure 9 The schematic diagram of the system As shown in Figure 9, the user directly interacts with the Graphical User Interface (GUI), which is considered the main control unit of the whole system. In case of having the Leap Control active, the Leap Motion Controller tracks the user’s hand and fingers, and send this informa- tion to the PC. The PC receives information from both the GUI and the Leap Motion Controller and accordingly de- cides on the suitable information to be sent to the Jaco arm. 5.3 GUI A GUI was developed in order to control the complex functionality of the Jaco arm in a user friendly way (see Figure 10). The GUI has several push buttons allowing both, automated and manual operation of the arm. Some buttons are responsible for moving the arm to certain fixed positions within the workspace. Additionally, an emergency exit button, stops the arm immediately and closes all running communications. There are two buttons responsible for starting and stopping the Leap control, “Start Leap” enables the control priority to the Leap Mo- tion Controller, while “Stop Leap” disables the Leap con- trol even if the sensor is still tracking the user’s hand. Grasp and release operations could be performed by pressing the Grasp and Release buttons respectively. The user is given the option to save a fixed number of tempo- rary positions during operation, thus having the possibil- ity of accessing them later. The interface allows the user to explore all the different functionality of the system with just a series of button presses. This application could run on desktop computers, laptops, or touch screens. Figure 10 The implemented graphical user interface (GUI) 6 Application to an AAL flat As mentioned in the earlier in this paper, the main con- cern of AAL research is to contribute to the quality of liv- ing of the ageing society and impaired people, and assist them in maintaining an independent lifestyle in their home environment, as long as possible. The main idea here is to introduce the implemented system of the Jaco arm and the Leap Motion controller to different smart- terminals within the authors experimental AAL flat, and also to mobility aids such as wheelchairs, rollators, etc. A common problem that elderly people often face when living alone in their home environment is related to medi- cation. Occasionally, they forget to take their medication on time, or maybe face difficulties in preparing it. Some other times, due to mental or sight illnesses, they take the Conference ISR ROBOTIK 2014 82 ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
  • 6. wrong medication at wrong times. These scenarios very often cause serious problems that could risk their lives. Robotic arms could assist in such cases. The Jaco arm could possibly be mounted in the bed terminal, and sup- ply the user with required items. Figure 11 demonstrates such a system concept. The arm could move along the back of the terminal, where it could easily access all the modules of the terminal as well as, the user’s personal space. Figure 11 The bedroom terminal The Lisa Smart Wall comprises a robotic service wall de- veloped under a research project in the area of AAL [20]. The service wall was prefabricated offsite and then deliv- ered as a plug and play terminal. The design is modular and customizable according to the special needs of each user. Different devices and modules could be easily added to or exchanged from the terminal. The Jaco arm could benefit the functionality of the Lisa Smart Wall by offer- ing more assistance to the user. By attaching the Jaco arm and the Leap Motion Controller to the smart wall, the user can intuitively interact via the proposed Jaco arm manipu- lation algorithm, Figure 12. Figure 12 The Lisa Smart Wall Figure 13 The kitchen terminal Because of the fact that elderly people spend a large por- tion of their time in the kitchen, equipping kitchens with assistive mechatronic and robotic systems is essential. The Jaco arm could work along with the user and perform tasks that seem to be difficult for the user to independ- ently accomplish. One very important advantage for the Jaco arm in the kitchen environment is being waterproof according to the IPX2 standard [21], this ensures a safe and efficient operation. Tasks could range from preparing the utensils, raw materials, and the workspace for the user, to a higher level of performing the cooking process itself. A user friendly interface could be designed to allow an easy control of the whole system. A possible scenario for such a kitchen is illustrated in Figure 13. 7 Conclusion A novel human machine interface is proposed dealing with the intuitive manipulation of a robotic arm for im- plementing ADLs, using a new gesture and position track- ing system with sub-millimeter accuracy. The main objec- tive of this study is to introduce a simple and straightfor- ward robotic arm manipulation scheme, in order to enable the incorporation of robotic systems into the home envi- ronment, to enhance the independence and autonomy of individuals with severe mobility impairments, and to al- low at the same the monitoring and prevention of abnor- mal disorders such as hand tremor patterns i.e. Parkin- son’s disease. The use of the implementation in tele- operated applications has also been discussed. It could serve operations going on in risk environments, as well as a wide variety of non-hazardous applications. The authors believe that the Leap Motion Controller tech- nology would be undoubtedly benefit and enable the re- alization of various human-machine interaction applica- tion in the field of AAL and ADLs, due to its compact size, enhanced precision, and low purchase cost. 8 Acknowledgements The work is supported by the BMBF funded project USA² (Ubiquitäres und Selbstbestimmtes Arbeiten im Alter). Conference ISR ROBOTIK 2014 83 ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach
  • 7. 9 References [1] Wiener, J.M., Hanley, R.J., Clark, R., Van Nostra JF, Measuring the activities of daily living: comparisons across national surveys, Journal of Gerontology, Social Sciences, 46 (1990) 229-237. [2] Atkins M.S., et al., Mobile arm supports: evidence based benefits and criteria for use, Journal of Spinal Cord Medicine, 31 (2008) 388-393. [3] Garber, S.L., Gregorio, T. L., Upper extremity assistive devices: assessment of use by spinal cord injured patients with quadriplegia, American Journal of Occupational Therapy, 44 (1990) 126-131. [4] Romer, G.R.B.E., et al., Cost-savings and economic benefits due to the assistive robotic manipulator (ARM), Proceedings of the 9th International Confe- rence on Rehabilitation Robotics, 2005, pp. 201-204. [5] Stanger, C.A., et al., Devices for assisting manipula- tion: a summary of user task priorities, IEEE Trans- actions on Rehabilitation Engineering, 2 (1994) 256- 265. [6] Maheu, V., Frappier, J., Archambault, P.S., Routhier, F. , Evaluation of the JACO robotic arm: Clinico-economic study for powered wheelchair users with upper-extremity disabilities, Proceedings of the 2011 IEEE Int. Conf. on Rehabilitation Robotics (ICORR), 2011, pp. 1–5. [7] Routhier F., Archambault, P. S., Usability of a wheelchair-mounted six degree-of-freedom robotic manipulator, RESNA 2010. [8] Khoshelham, K., Elberink, S.O., Accuracy and reso- lution of kinect depth data for indoor mapping appli- cations, Sensors, 12 (2012) 1437–1454. [9] Biswas, K.K., Basu, S., Gesture Recognition using Microsoft Kinect, Proceedings of the IEEE Interna- tional Conference on Automation, Robotics and Applications (ICARA), Delhi, India, 6–8 December 2011. [10] Stoyanov, T., Louloudi, A., Andreasson, H., Lilien- thal, A.J., Comparative Evaluation of Range Sensor Accuracy in Indoor Environments, Proceedings of the European Conference on Mobile Robots (ECMR), Sweden, September 2011. pp. 19-24. [11] Weichert, F., Bachmann, D., Rudak, B., Fisseler, D., Analysis of the accuracy and robustness of the leap motion controller, Sensors, 13(5) (2013) 6380–6393. [12] Wachs, J.P., Kölsch, M., Stern, H., Edan, Y., Vision- Based Hand-Gesture Applications. Communications of the acm, 54 (2) (2011) 60-71. [13] Leap Motion | Mac & PC Motion Controller for Games, Design, & More. 2014. Available at: http://www.leapmotion.com. [Accessed January 2014]. [14] Pala, M., Lorencik, D., Sincak, P., Towards the robotic teleoperation systems in education. ICETA 2012, 10th IEEE International Conference on Emer- ging eLearning Technologies and Applications, No- vember 2012, pp. 241-246. [15] Salarian, A. , Russmann, H., Vingerhoets, F.J.G.P., Burkhard, R., Blanc, Y., Dehollain, C., An Ambulatory System to Quantify Bradykinesia and Tremor in Parkinson’s Disease, Proceedings of the IEEE Conference on Information Technology App- lications in Biomedicine, 2003, pp. 35–38. [16] Jankovic, J., Schwartz, K.S., Ondo, W., Re- emergent tremor of Parkinson’s diesease, Journal of Neurol Neurosurg Psychiatry, 67 (1999) 646–650. [17] Salarian, A., Russmann, H., Wider, C., Burkhard, P.R., Vingerhoets, F.J.G., Aminian, K., Quantification of Tremor and Bradykinesia in Par- kinson’s Disease Using a Noval Ambulatory Monitoring System, IEEE Transaction on Biomedi- cal Engineering, 54 (2) (2007) 313–322. [18] Lo, G., Suresh, A.R., Stocco, L., González- Valenzuela, S., Leung, F.C.M., A Wireless Sensor System for Motion Analysis of Parkinson’s Disease Patients, Work in Progress workshop at PerCom, February 2011, pp. 372–375. [19] Beuter, A., Geoffroy, A., Cordo, P., The measure- ment of tremor using simple laser systems, Journal of Neuroscience Methods, 53 (2014) 47–54. [20] Georgoulas, C., Linner, T., Kasatkin, A., Bock, T., An AmI Environment Implementation: Embedding TurtleBot into a novel Robotic Service Wall, Proceedings of the 7th German Conference on Robotics (ROBOTIK 2012), Munich, Germany, May 2012, pp. 117-122. [21] Kinova | Reach your potential. 2014. Available at: http://www.kinovarobotics.com. [Accessed December 2013]. Conference ISR ROBOTIK 2014 84 ISBN 978-3-8007-3601-0 © VDE VERLAG GMBH · Berlin · Offenbach