1
SKINPUT: APPROPRIATING THE
BODY AS AN INPUT SURFACE
By
ALEENA ANNA ANDREWS
S7-IT
Roll No:5
2
3
•Smaller screens are more common, touch
screen is everywhere.
•Provides only limited interaction area.
•Cannot simply make buttons and screens
larger.
•Microsoft puts forward a new flesh-control
input technology called “SKINPUT”.
INTRODUCTION
4
 Human body for acoustic transmission.
 Surface of the skin - input device.
 A wearable armband that is non-invasive
and easily removable.
 Makes computing more natural.
 Uses the concept of proprioception
WHAT IS SKINPUT?
5
 Large interaction space
 User simply taps his skin in order to control
audio devices, play games and make phone
calls .
 Developed by Chris Harrison, Densely Tan,
and Dan Morris of the Microsoft Research's
Group.
 First public appearance at Microsoft's Tech
Fest 2010
6
Touch Screen vs. Skinput Technology
7
•Listens to vibrations in the body.
•Also responds to the various hand gestures.
•Arm band detects the acoustic signals and
converts them to electronic signals.
•Browsing through a mobile phone menu,
making calls, controlling portable music players,
etc..
PRINCIPLE OF SKINPUT
Technology Used
 Skinput, the system is a combination of two
technologies:
1. Pico projector applies the use of projector in a
hand held device.
2. An acoustic detector detects the ultra low
frequency.
8
9
10
11
 Very small projector, basically used in gadgets.
Also known as pocket projector or mobile
projector.
 Provides a direct manipulation, graphical user
interface on the body.
 The system comprises three main parts:
 The Laser light source
 The Combiner optics
 The Scanning mirror
PICO PROJECTOR
•Study of sound waves inside living body.
•When a finger taps the skin, several distinct
forms of acoustic energy are produced.
•Whole concept of skinput is based on the
following waves:
1. Transverse Waves
2. Longitudinal Waves
12
BIO ACOUSTICS
 Created by the displacement of the skin
(ripples).
 Sensors are activated by the waves moving
underneath it.
 Moves outward from the point of contact.
 Tapping on soft part of the arm creates higher
amplitude than tapping on bony areas.
Transverse waves
13
14
Longitudinal waves
 Some energy is transmitted inwards, towards
the skeleton; excites the bone.
 This excitation vibrates soft tissues
surrounding the entire length of the bone,
resulting in new longitudinal waves that
propagate outward to the skin.
15
16
•An array of highly tuned vibration sensors are
used.
•Employed with small, cantilevered piezo films.
•Cantilever is adjusted by adding weight in the
resonating frequency.
•Irresponsive to forces parallel to the skin.
•Sensor design-inexpensive
SENSING
17
•Has two arrays of five sensing elements
•Each sensor array is sensible to particular set of
frequencies:
1. Upper – fleshy bicep.
2. Lower – denser parts of arm.
ARMBAND PROTOTYPE
18
19
•A keypad, menu, or other graphics are beamed
onto a user's palm and forearm from a Pico
projector .
•An acoustic detector then determines part of
the display that is activated by the touch.
•The software matches sound frequencies to
specific skin locations, allowing the system to
determine which “skin button” the user pressed.
20
HOW SKINPUT WORKS?
•Mackie Onyx 1200F audio interface to
digitally capture data from the ten sensors.
•Connected via Bluetooth to a conventional
desktop computer , where a thin client written
in C interfaced with the device using the Audio
Stream I/O protocol.
•Each channel is sampled at 5.5 kHz.
•Data is then sent from thin client over a local
socket to the primary application, written in
Java.
21
Three key functions of this program :
1. Live visualization of the data
2. Segmentation of inputs from the data stream
3. Classification of input instances.
•The audio stream is segmented into individual taps
using an exponential average of all ten channels.
22
23
Computing
device
Armband
24
APPLICATIONS
 Mobile
 Gaming
 I-pods
 An aid to paralyzed
persons.
25
26
ADVANTAGES
27
 No need to interact with the gadget directly.
 Don’t have to worry about keypad.
 People with larger fingers get trouble in navigating
tiny buttons and keypads on mobile phones.
 The body is portable and always available, and
fingers are a natural input device.
DISADVANTAGES
28
•Difficulty in wearing a very big band around their
arm for the day.
•Not sure about the possible skin diseases or types of
cancer, one can get from using this product.
•Initial cost is very high which will not be affordable
for the common man.
29
•The most important achievement of Skinput is that the
human body can be used as an input interface.
•A person taps his palm to unlock the door and then tap
some virtual buttons on his arms to turn on the TV and start
flipping through channels.
•Extensive Research is going on currently on Skinput to
make the armband more smaller.
Incorporate More Devices with this system.
Extend accuracy level.
SKINPUT IN FUTURE
30
•Skinput allows the human body as an input
surface.
•It describes an armband used to detect and
localize finger taps on the forearm and hand.
•This system performs well even when the
body is in motion.
CONCLUSION
31
32
 Advanced Graphics Technology , Kasik , David J.Computer
Graphics and Applications, IEEE Volume: 31 , Issue: 3
DOI: 10.1109/MCG.2011.35 ,Publication Year: 2011
 http://www.chrisharrison.net/projects/skinput
 Ahmad, F., and Musilek, P. A Keystroke and Pointer Control
Input Interface for Wearable Computers. In Proc. IEEE
PERCOM ’06, 2-11.
 Amento, B., Hill, W., and Terveen , L. The Sound of One Hand:
A Wrist-mounted Bio-acoustic Fingertip Gesture Interface. In
CHI ‘02 Ext. Abstracts, 724-725.
 Argyros, A.A., and Lourakis, M.I.A. Vision-based Interpretation
of Hand Gestures for Remote Control of a Computer Mouse. In
Proc. ECCV 2006 Workshop on Computer Vision in HCI, LNCS
3979, 40-51.
REFERENCES
33
QUESTIONS???
34

Skinput technology

  • 1.
    1 SKINPUT: APPROPRIATING THE BODYAS AN INPUT SURFACE By ALEENA ANNA ANDREWS S7-IT Roll No:5
  • 2.
  • 3.
    3 •Smaller screens aremore common, touch screen is everywhere. •Provides only limited interaction area. •Cannot simply make buttons and screens larger. •Microsoft puts forward a new flesh-control input technology called “SKINPUT”. INTRODUCTION
  • 4.
    4  Human bodyfor acoustic transmission.  Surface of the skin - input device.  A wearable armband that is non-invasive and easily removable.  Makes computing more natural.  Uses the concept of proprioception WHAT IS SKINPUT?
  • 5.
    5  Large interactionspace  User simply taps his skin in order to control audio devices, play games and make phone calls .  Developed by Chris Harrison, Densely Tan, and Dan Morris of the Microsoft Research's Group.  First public appearance at Microsoft's Tech Fest 2010
  • 6.
    6 Touch Screen vs.Skinput Technology
  • 7.
    7 •Listens to vibrationsin the body. •Also responds to the various hand gestures. •Arm band detects the acoustic signals and converts them to electronic signals. •Browsing through a mobile phone menu, making calls, controlling portable music players, etc.. PRINCIPLE OF SKINPUT
  • 8.
    Technology Used  Skinput,the system is a combination of two technologies: 1. Pico projector applies the use of projector in a hand held device. 2. An acoustic detector detects the ultra low frequency. 8
  • 9.
  • 10.
  • 11.
    11  Very smallprojector, basically used in gadgets. Also known as pocket projector or mobile projector.  Provides a direct manipulation, graphical user interface on the body.  The system comprises three main parts:  The Laser light source  The Combiner optics  The Scanning mirror PICO PROJECTOR
  • 12.
    •Study of soundwaves inside living body. •When a finger taps the skin, several distinct forms of acoustic energy are produced. •Whole concept of skinput is based on the following waves: 1. Transverse Waves 2. Longitudinal Waves 12 BIO ACOUSTICS
  • 13.
     Created bythe displacement of the skin (ripples).  Sensors are activated by the waves moving underneath it.  Moves outward from the point of contact.  Tapping on soft part of the arm creates higher amplitude than tapping on bony areas. Transverse waves 13
  • 14.
  • 15.
    Longitudinal waves  Someenergy is transmitted inwards, towards the skeleton; excites the bone.  This excitation vibrates soft tissues surrounding the entire length of the bone, resulting in new longitudinal waves that propagate outward to the skin. 15
  • 16.
  • 17.
    •An array ofhighly tuned vibration sensors are used. •Employed with small, cantilevered piezo films. •Cantilever is adjusted by adding weight in the resonating frequency. •Irresponsive to forces parallel to the skin. •Sensor design-inexpensive SENSING 17
  • 18.
    •Has two arraysof five sensing elements •Each sensor array is sensible to particular set of frequencies: 1. Upper – fleshy bicep. 2. Lower – denser parts of arm. ARMBAND PROTOTYPE 18
  • 19.
  • 20.
    •A keypad, menu,or other graphics are beamed onto a user's palm and forearm from a Pico projector . •An acoustic detector then determines part of the display that is activated by the touch. •The software matches sound frequencies to specific skin locations, allowing the system to determine which “skin button” the user pressed. 20 HOW SKINPUT WORKS?
  • 21.
    •Mackie Onyx 1200Faudio interface to digitally capture data from the ten sensors. •Connected via Bluetooth to a conventional desktop computer , where a thin client written in C interfaced with the device using the Audio Stream I/O protocol. •Each channel is sampled at 5.5 kHz. •Data is then sent from thin client over a local socket to the primary application, written in Java. 21
  • 22.
    Three key functionsof this program : 1. Live visualization of the data 2. Segmentation of inputs from the data stream 3. Classification of input instances. •The audio stream is segmented into individual taps using an exponential average of all ten channels. 22
  • 23.
  • 24.
  • 25.
    APPLICATIONS  Mobile  Gaming I-pods  An aid to paralyzed persons. 25
  • 26.
  • 27.
    ADVANTAGES 27  No needto interact with the gadget directly.  Don’t have to worry about keypad.  People with larger fingers get trouble in navigating tiny buttons and keypads on mobile phones.  The body is portable and always available, and fingers are a natural input device.
  • 28.
    DISADVANTAGES 28 •Difficulty in wearinga very big band around their arm for the day. •Not sure about the possible skin diseases or types of cancer, one can get from using this product. •Initial cost is very high which will not be affordable for the common man.
  • 29.
    29 •The most importantachievement of Skinput is that the human body can be used as an input interface. •A person taps his palm to unlock the door and then tap some virtual buttons on his arms to turn on the TV and start flipping through channels. •Extensive Research is going on currently on Skinput to make the armband more smaller. Incorporate More Devices with this system. Extend accuracy level. SKINPUT IN FUTURE
  • 30.
    30 •Skinput allows thehuman body as an input surface. •It describes an armband used to detect and localize finger taps on the forearm and hand. •This system performs well even when the body is in motion. CONCLUSION
  • 31.
  • 32.
    32  Advanced GraphicsTechnology , Kasik , David J.Computer Graphics and Applications, IEEE Volume: 31 , Issue: 3 DOI: 10.1109/MCG.2011.35 ,Publication Year: 2011  http://www.chrisharrison.net/projects/skinput  Ahmad, F., and Musilek, P. A Keystroke and Pointer Control Input Interface for Wearable Computers. In Proc. IEEE PERCOM ’06, 2-11.  Amento, B., Hill, W., and Terveen , L. The Sound of One Hand: A Wrist-mounted Bio-acoustic Fingertip Gesture Interface. In CHI ‘02 Ext. Abstracts, 724-725.  Argyros, A.A., and Lourakis, M.I.A. Vision-based Interpretation of Hand Gestures for Remote Control of a Computer Mouse. In Proc. ECCV 2006 Workshop on Computer Vision in HCI, LNCS 3979, 40-51. REFERENCES
  • 33.
  • 34.

Editor's Notes

  • #6 Project is under active development and it is not available commercially.
  • #19 Upper array -more sensitive to lower frequency signals.