This document presents a Kinect-controlled robotic arm project. It summarizes the qualifications of the three-person staff, the struggles encountered with the original motion sensor glove idea and transitioning to use the Kinect instead. It describes the successes achieved after overcoming difficulties with programming the Kinect interface. The composition of the arm using a Kinect, laptop, Arduino Uno and servo motors is outlined. Potential uses of the arm are discussed as well as objectives and accomplishments of the project. Deliverables including functioning limbs and a working Kinect-Arduino interface are highlighted.
Robot which can be controlled remotely by an Android smartphone.
The robot works through a “AC Robot” android app. The app is designed by us and made available to open source. The app and source code can be downloaded from the url (http://tinyurl.com/kh7zgex).
Al giorno d'oggi, l'utilizzo di NUI (Natural User Interface) rendono possibili nuove modalità di interazione tra utente e dispositivo. Vediamo come Microsoft Kinect e Intel Realsense ed I relastivi SDK rendono possibile l’implementazione di queste tecnologie nelle nostre applicazioni, nonche’ le recenti applicazioni di autenticazione biometrica introdotte in Windows 10.
this presentation covers the very aspects of creating the virtual environments and also gives a small tutorial on how to create AR apps to create custom synthetic environments.
Robot which can be controlled remotely by an Android smartphone.
The robot works through a “AC Robot” android app. The app is designed by us and made available to open source. The app and source code can be downloaded from the url (http://tinyurl.com/kh7zgex).
Al giorno d'oggi, l'utilizzo di NUI (Natural User Interface) rendono possibili nuove modalità di interazione tra utente e dispositivo. Vediamo come Microsoft Kinect e Intel Realsense ed I relastivi SDK rendono possibile l’implementazione di queste tecnologie nelle nostre applicazioni, nonche’ le recenti applicazioni di autenticazione biometrica introdotte in Windows 10.
this presentation covers the very aspects of creating the virtual environments and also gives a small tutorial on how to create AR apps to create custom synthetic environments.
Speed and agility are the most expected in today’s analytics tools. The quicker you get from idea to insights, the more you can innovate & perform ad-hoc data analysis. I will be talking about how we can use AWS serverless architecture to stream IoT data, managed by python. We can be up and running in minutes―starting small, but able to easily grow to millions of devices and billions of messages.
NUX Presentation from TechMixer Birmingham 2011Michael Heydt
Variant of the NUX deck given at this specific events. Covers concepts in natural user interfaces. Project and some contact info not valid as of 2016, but still some good concepts in there for those learning.
Community Day 2013 - The Power of KinectTom Kerkhove
The power of Kinect is underestimated. It’s more than a toy used for gaming, it’s a piece of technology that can make our life easier and is evolving fast. This session will try to convince you about the power of Kinect and why developers should look into it. Next to that I’ll explain what the ‘difference’ is between Kinect and Oculus Rift & Leap Motion and why we need to brace ourselves for Kinect 2.0.
Dino2 - the Amazing Evolution of the VA Smalltalk Virtual MachineESUG
Dino2 - the Amazing Evolution of the VA Smalltalk Virtual Machine
First Name: John
Last Name: O'Keefe
Type: Talk
Video1: https://www.youtube.com/watch?v=Ii8Dwq1b6YI
Video2: https://www.youtube.com/watch?v=30L7fWvtddU
Over the last 18 months we have evolved the VA Smalltalk VM from a Smalltalk model-based 32-bit VM to a C-based 32/64-bit VM. During this talk I will tell the story of our journey along this evolutionary path, describe some of the innovative techniques and approaches we took to reach our goal, and demonstrate the running 64-bit VM.
Bio:
I have been developing software for over 45 years. I joined the original IBM Smalltalk prototype team in 1990 and was a founding member of the IBM VisualAge Smalltalk development team. I was Team Lead and Chief Architect of IBM VisualAge Smalltalk from 1997 to 2007. In February 2007, I joined Instantiations to lead the VA Smalltalk development team. I am currently the CTO and Principal Smalltalk Architect focusing on future product architecture and development. I live in Durham, NC and work in Raleigh, NC.
[API World 2021 ] - Understanding Cloud Native DeploymentWSO2
Microservices and APIs built for digital transformation products require agile, reliable, and scalable cloud native infrastructure to truly meet customer expectations for a great "always there" user experience. Whether deployed on-premises or hosted in a public cloud, understanding and leveraging the right approach is key to success. This session takes up where the development process leaves off, tracking the standardization of containers and container orchestration for automated deployment, including current and future platform trends WSO2 and others are following.
Building Applications with the Microsoft Kinect SDKDataLeader.io
David Silverlight's powerpoint presentation on the Kinect for Windows SDK. Feb. 29, 2012
NUI = Natural User Interface: it's an invisible interface, the content is the interface, removing the proxy, direct manipulation, gestural interfaces
Kinect for Windows SDK:
1. Kinect explorer
2. Installing & using the Kinect sensor
3. Setting up your dev environment
4. Skeletal tracking fundamentals
5. Working with depth data
6. Audio fundamentals
7. Camera fundamentals
Kinect for Xbox 360: the world's first viral 3D technologykamutef
Exploring the technology behind Kinect for Xbox 360.
How it works and the multiplicity of ways the technology is being applied to solve problems, assist research and transform lives around the world.
Vertex Perspectives | AI Optimized Chipsets | Part IVVertex Holdings
In this instalment, we delve into other emerging technologies including neuromorphic chips and quantum computing systems, to examine their promise as alternative AI-optimized chipsets.
Speed and agility are the most expected in today’s analytics tools. The quicker you get from idea to insights, the more you can innovate & perform ad-hoc data analysis. I will be talking about how we can use AWS serverless architecture to stream IoT data, managed by python. We can be up and running in minutes―starting small, but able to easily grow to millions of devices and billions of messages.
NUX Presentation from TechMixer Birmingham 2011Michael Heydt
Variant of the NUX deck given at this specific events. Covers concepts in natural user interfaces. Project and some contact info not valid as of 2016, but still some good concepts in there for those learning.
Community Day 2013 - The Power of KinectTom Kerkhove
The power of Kinect is underestimated. It’s more than a toy used for gaming, it’s a piece of technology that can make our life easier and is evolving fast. This session will try to convince you about the power of Kinect and why developers should look into it. Next to that I’ll explain what the ‘difference’ is between Kinect and Oculus Rift & Leap Motion and why we need to brace ourselves for Kinect 2.0.
Dino2 - the Amazing Evolution of the VA Smalltalk Virtual MachineESUG
Dino2 - the Amazing Evolution of the VA Smalltalk Virtual Machine
First Name: John
Last Name: O'Keefe
Type: Talk
Video1: https://www.youtube.com/watch?v=Ii8Dwq1b6YI
Video2: https://www.youtube.com/watch?v=30L7fWvtddU
Over the last 18 months we have evolved the VA Smalltalk VM from a Smalltalk model-based 32-bit VM to a C-based 32/64-bit VM. During this talk I will tell the story of our journey along this evolutionary path, describe some of the innovative techniques and approaches we took to reach our goal, and demonstrate the running 64-bit VM.
Bio:
I have been developing software for over 45 years. I joined the original IBM Smalltalk prototype team in 1990 and was a founding member of the IBM VisualAge Smalltalk development team. I was Team Lead and Chief Architect of IBM VisualAge Smalltalk from 1997 to 2007. In February 2007, I joined Instantiations to lead the VA Smalltalk development team. I am currently the CTO and Principal Smalltalk Architect focusing on future product architecture and development. I live in Durham, NC and work in Raleigh, NC.
[API World 2021 ] - Understanding Cloud Native DeploymentWSO2
Microservices and APIs built for digital transformation products require agile, reliable, and scalable cloud native infrastructure to truly meet customer expectations for a great "always there" user experience. Whether deployed on-premises or hosted in a public cloud, understanding and leveraging the right approach is key to success. This session takes up where the development process leaves off, tracking the standardization of containers and container orchestration for automated deployment, including current and future platform trends WSO2 and others are following.
Building Applications with the Microsoft Kinect SDKDataLeader.io
David Silverlight's powerpoint presentation on the Kinect for Windows SDK. Feb. 29, 2012
NUI = Natural User Interface: it's an invisible interface, the content is the interface, removing the proxy, direct manipulation, gestural interfaces
Kinect for Windows SDK:
1. Kinect explorer
2. Installing & using the Kinect sensor
3. Setting up your dev environment
4. Skeletal tracking fundamentals
5. Working with depth data
6. Audio fundamentals
7. Camera fundamentals
Kinect for Xbox 360: the world's first viral 3D technologykamutef
Exploring the technology behind Kinect for Xbox 360.
How it works and the multiplicity of ways the technology is being applied to solve problems, assist research and transform lives around the world.
Vertex Perspectives | AI Optimized Chipsets | Part IVVertex Holdings
In this instalment, we delve into other emerging technologies including neuromorphic chips and quantum computing systems, to examine their promise as alternative AI-optimized chipsets.
2. Table Of Contents
• Staff qualifications
• Struggles of the Kinect
• Success of the Kinect
• Composition of the Kinect
• The uses of the Kinect Arm
• Deliverables
• The Gantt Chart
• Final Thoughts
• Q&A
3. Staff Qualifications
• Steve Scriver
• James McNamara
• Tristan Orlowski
James McNamara
Steve Scriver
Tristan Orlowski
X N T P
E S F J
E N T P
4. Struggles of the Kinect
• The original idea of the Kinect was a
motion sensor glove.
• The glove would have Data logged
the actions alongside a Gyroscope,
Accelerometer, SD Data Logger, and
a set of 6 flex sensors.
• Due to the Chinese post office being
on strike, time constraints hindered
the project.
• Alongside the cost of reliable flex
sensors, the project was scrapped
and our project was re-scoped.
5. Struggles of the Kinect
• With the discovery of using the Kinect
as a sensor we had a new perspective
on the project.
• Thus began the struggles of
completing a proper interfacing system
with the Kinect.
• Microsoft Visual Basic and SDK studio,
which at the time seemed like a saving
grace turned out to be a difficult over
complicated battle.
• Going through this once again caused
frustration and confusion, but through
perseverance we found some old posts
that directed us to some abandoned
programs.
6. Struggles of the Kinect
• Struggles and success was the
rollercoaster ride of this project, the
final struggle being the ScorBotVII.
• We became very excited at the chance
to work with a real robotic arm with
our program, the only problem was
that it was an analog motor system.
• Many circuits from many classes were
made to attempt to have a DC motor
act like a servo, signal driven.
• Though we do have a circuit, the
Scorbot was left out and somebody
tampered with the machine ruining a
few pins on the RS232 cables bringing
our working motor count from 3 out
of 6 to 2 out of 6.
• Deeming this unacceptable and less
impressive of a project we once again
re-scoped and set ourselves up for
success!
7. The Success of the Kinect
• Though there were many
setback on the road to
completion success was had!
• After using old programs such
as “Processing” an old port of
the Arduino program.
• The use of outdated java
settings, and poorly
translated links dawned the
birth of our Kinect controlled
arm.
8. Composition of the Kinect Arm
• The Kinect arm consists of only a few
items, much found around the house
to show that a professional project
can be created from perseverance
and creativity.
• The Kinect itself is of course a main
component.
• The laptop we are using is also very
much needed. This acts as a
communicator between the Kinect
and Arduino Uno.
• The Arduino Uno, the device that
communicate to our servo motors.
• Servo motors, these move our
robotic arm via a PWM signal from
the Arduino Uno.
• Foam core, the body of the arm. As a
prototype, it can easily be
substituted for a heavier chassis if
the proper servo motors are present.
9. The uses of the Kinect Arm
• The thoughts surrounding the arm,
is the practicality of the machine.
Where would it be used?
• In or near radiation
• Inaccessible areas for a human
• Situations in which a humans
strength is not useful.
• Space
• The evolution of the hands free
robot could also be built upon and
in the near future be used in a
more intricate or challenging
situation.
• Our second thoughts on the
project was, with a sensor that is
so powerful would we one day be
able to mimic the use of hand via
motion tracking.
• Household applications in which a
robot could have preprogrammed
regiments for the average person
is also a thought.
10. The Objectives of the Kinect Arm
• Objective 1: Interfacing
• Objective 2: Reaching desired results
• Objective 3: Creating the proper schematic for the arm
• Objective 4: Assembling the arm
• Objective 5: Having a demonstrable prototype
11. Accomplishments of the Kinect
• Something to call our own: when the heats died down
and the smoke clears, we have indeed created a
functioning robotic arm.
• The gratification of not only completing our first real
tangible and home made arm, but the ability to use it for
recognition by employers.
• Knowing that some day the Kinect arm may indeed
become practical and useful in harsh work environments.
• The ability to enjoy small successes, and bounce back
from temporary failures.
12. Deliverables
• Functioning limbs to represent robotic movement
• Working interface between the Arduino and Kinect
• Synchronized movements of servos
13. Team Gantt Chart
The Gantt chart shows our teams action plan, meetings, and reliances on situations to
advance to the next stage of our project.
14. Final Thoughts
• Though the path was long and
full of difficulties, the project
was complete. At the end of it,
it wasn’t really about the final
product more the journey.
We’ve all learned how to work a
little better with a team, know
our role and in certain situations
go above and beyond your own
area of expertise or experience.
• I wish you all very much luck in
your careers and endeavors,
with that said I myself look
forward to a career full of
challenges and success that was
much learned in this Robotics
Project class.