UbiComp full paper presentation

1. HIPPO: Pervasive Hand-Grip
Estimation from Everyday
Interactions
1
Zhigang Yin, Mohan Liyanage,
Abdul-rasheed Ottun, Agustin Zuniga, Petteri
Nurmi and Huber Flores

2. Importance: hand-grip strength
• Hand-grip strength is extremely important. It can be an early
indicator of many health conditions.
2
Muscle
loss:
Cognitive impairment:
Diabetes:

3. Current solutions
3
Dynamometer
Pressure
based
Drawback
• unable for everyday
interactions
• requiring interactions
with delicated objects
• Mainly for medical use
• Information needed:
gender, age
• Hand-grip strength (kg)
• Hand-grip category
(weak, normal, strong)
Pervasive hand-grip estimation is
required

4. HIPPO solution
4
Pervasive and Ubiquitous
interactions with daily objects
for hand-grip strength estimation
• Portable and non-invasive
• Continuous health monitoring

5. HIPPO: Contributions
• Novel system: We present HIPPO, a
new system and architecture for
pervasive hand-grip strength estimation
• Novel insights: HIPPO integrates a
low-cost and low-power sensing
solution that uses off-the-shelf red light
sensors
• Extensive benchmarks: HIPPO
provides better performance than
existing sensing modalities
5

6. HIPPO: Overview
6
(a) Light sensing deployment
and available fingers
(b) Hand-grip
relax state
(c) Hand-grip applied
strength state
Light changes from (b) to (c)
to capture hand-grip strength
Position-1: little
Position-2: middle
Position-3: index

7. HIPPO: Pipeline
7
Weak
Normal
Strong

8. HIPPO: Experiment setup
8
HIPPO
prototype
Dynamometer
(DYNA) -
gold standard
Pressure
Wooden ball
(W-BALL)
Pressure
plate
(PLATES)
Baselines
• 24 participants (equal
genders, age)
• 2 random trials for each
• one type of object
• ruler to measure hand
dimensions
• post interview

9. HIPPO: Gender Effect
Result: Gender characteristics can affect the physical strength
9
Hand-grip analysis divided by genders
Litter finger Index finger

10. HIPPO: Hand Size Effect
Result: The little finger can achieve the best hand-grip strength
estimation according to gender and hand-size
10
Estimated pressure on the object captured by
the light senor in little finger

11. HIPPO: Hand-grip Strength Estimation
Result: hand-grip strength can be accurately estimated using HIPPO
and especially when the sensor is worn closely to the little finger
11
Features: light changes (L), gender (G)
and hand size (S), age (A).
Categories classification
by L-G-S-A:
Best performance of hand-grip strength by L-G-S
Little finger: 86%
Middle finger: 79%
Index finger: 84%
Little finger Middle finger Index finger

12. HIPPO: Comfort in Capturing Hand-grip Strength
Result: HIPPO provides the least intrusive and easiest-to-use solution
and is preferred by the user.
12
Ranking of the device (the most comfortable–4, the least comfortable–1)
HIPPO

13. Questions?
Thank you! (Do not hesitate to reach us)
13
Zhigang Yin (zhigang.yin@ut.ee)
Mohan Liyanage (mohan.liyanage@ut.ee)
Abdul-Rasheed Ottun (rasheed.ottun@ut.ee)
Agustin Zuniga (agustin.zuniga@helsinki.fi)
Petteri Nurmi (petteri.nurmi@helsinki.fi)
Huber Flores (huber.flores@ut.ee)