Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
SoPhy: A Wearable Technology
for Lower Limb Assessment
in Video Consultations of
Physiotherapy
Deepti Aggarwal, Weiyi Zhan...
Video Consultations of Physiotherapy
van Dyk 2014; Yellowlees 2005
Wednesday, 10 May 17
Bodily Communication in Physiotherapy
Wednesday, 10 May 17
ACM DIS 2016
Wednesday, 10 May 17
Lower Body
Movements
Wednesday, 10 May 17
Limited Understanding of Subtle Differences
Weight Distribution Range of Movement
Wednesday, 10 May 17
Focused on the Upper Torso
Wednesday, 10 May 17
Focusing Camera Removes the Context
Wednesday, 10 May 17
Reduced confidence in
assessment
Less effective treatment
Aggarwal et al. 2016
Wednesday, 10 May 17
Research Aim
How can we design technologies
to enhance diagnostic confidence
of physiotherapists for assessing
lower limb ...
What to capture?
Wednesday, 10 May 17
Key aspects of lower body movements
Weight
Distribution
Range of
Movements
Foot
Orientation
Wednesday, 10 May 17
How to capture?
Wednesday, 10 May 17
SoPhy
SOcks for PHYsiotherapy
Socks with sensors Web interface
Wednesday, 10 May 17
SoPhy socks
IMU
Pressure
Sensors
Bluetooth
Shield
Arduino
Pro Mini
Wednesday, 10 May 17
SoPhy web-interface
Wednesday, 10 May 17
Short video available at:
https://vimeo.com/188358214
Wednesday, 10 May 17
Lab study
Clinician’s room
10 physiotherapists & 1 actor (patient)
Patient’s room
Wednesday, 10 May 17
Study Design (2x2)
Extreme pain Low pain
Factors: Consultation Technology & Pain Levels
Wednesday, 10 May 17
Study Design (2X2)
Independent
Variables
Consultation Technology - with
SoPhy & without SoPhy
Pain Levels - extreme and lo...
Tasks for
Participants
Assess the patient’s exercises
Organize 4 video sessions
Fill in a questionnaire (total 4)
Wednesda...
Tasks for Actor
Dorsiflexion &
Plantarflexion
1-leg tip-toes &
2-leg tip-toes
Squats
Wednesday, 10 May 17
Increase in Confidence
The sock system offered confirmation to my
hypothesis. I used the strategy of first seeing
the vide...
Fewer Repetitions of Exercises
Exercises with SoPhy
without
SoPhy
Dorsiflexion
F(1,36) = 6.99, p<.05
M = 8.10,
SD = 3.21
M...
Fewer Repetitions of Exercises
Over video, I can see the person only from
one direction. [...] The sock system provides
me...
Deeper Insights on Weight Distribution
It’s always challenging to understand weight
bearing because the pressure points ar...
Design Considerations
Wednesday, 10 May 17
Revealing Foot Contours
Wednesday, 10 May 17
Opportunities for
Other Media
Wednesday, 10 May 17
Conclusion
Extension of video consultations beyond audio-
visual medium
First exploration to enhance the ability of
physio...
Deployments at the Hospital
Wednesday, 10 May 17
Deepti Aggarwal
daggarwal@student.unimelb.edu.au
Wednesday, 10 May 17
Upcoming SlideShare
Loading in …5
×

SoPhy: A wearable Technology for Lower Limb Assessment in Video Consultations of Physiotherapy

160 views

Published on

This paper is in the proceedings of ACM CHI 2017.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

SoPhy: A wearable Technology for Lower Limb Assessment in Video Consultations of Physiotherapy

  1. 1. SoPhy: A Wearable Technology for Lower Limb Assessment in Video Consultations of Physiotherapy Deepti Aggarwal, Weiyi Zhang, Thuong Hoang, Bernd Ploderer, Frank Vetere, Mark Bradford Wednesday, 10 May 17
  2. 2. Video Consultations of Physiotherapy van Dyk 2014; Yellowlees 2005 Wednesday, 10 May 17
  3. 3. Bodily Communication in Physiotherapy Wednesday, 10 May 17
  4. 4. ACM DIS 2016 Wednesday, 10 May 17
  5. 5. Lower Body Movements Wednesday, 10 May 17
  6. 6. Limited Understanding of Subtle Differences Weight Distribution Range of Movement Wednesday, 10 May 17
  7. 7. Focused on the Upper Torso Wednesday, 10 May 17
  8. 8. Focusing Camera Removes the Context Wednesday, 10 May 17
  9. 9. Reduced confidence in assessment Less effective treatment Aggarwal et al. 2016 Wednesday, 10 May 17
  10. 10. Research Aim How can we design technologies to enhance diagnostic confidence of physiotherapists for assessing lower limb movements during video consultations? Wednesday, 10 May 17
  11. 11. What to capture? Wednesday, 10 May 17
  12. 12. Key aspects of lower body movements Weight Distribution Range of Movements Foot Orientation Wednesday, 10 May 17
  13. 13. How to capture? Wednesday, 10 May 17
  14. 14. SoPhy SOcks for PHYsiotherapy Socks with sensors Web interface Wednesday, 10 May 17
  15. 15. SoPhy socks IMU Pressure Sensors Bluetooth Shield Arduino Pro Mini Wednesday, 10 May 17
  16. 16. SoPhy web-interface Wednesday, 10 May 17
  17. 17. Short video available at: https://vimeo.com/188358214 Wednesday, 10 May 17
  18. 18. Lab study Clinician’s room 10 physiotherapists & 1 actor (patient) Patient’s room Wednesday, 10 May 17
  19. 19. Study Design (2x2) Extreme pain Low pain Factors: Consultation Technology & Pain Levels Wednesday, 10 May 17
  20. 20. Study Design (2X2) Independent Variables Consultation Technology - with SoPhy & without SoPhy Pain Levels - extreme and low Dependent Variables Weight Distribution, Range of Movement, Foot Orientation, Confidence, #Repetitions Data Collection Interviews, Questionnaire, Video Recording Wednesday, 10 May 17
  21. 21. Tasks for Participants Assess the patient’s exercises Organize 4 video sessions Fill in a questionnaire (total 4) Wednesday, 10 May 17
  22. 22. Tasks for Actor Dorsiflexion & Plantarflexion 1-leg tip-toes & 2-leg tip-toes Squats Wednesday, 10 May 17
  23. 23. Increase in Confidence The sock system offered confirmation to my hypothesis. I used the strategy of first seeing the video and then form an assessment. After a couple of repetitions with video, I used the interface to confirm my assessment. (P8) Exercises with SoPhy without SoPhy Squats F(1,36) = 10.97, p<.01 M = 5.75, SD = 1.06 M = 4.17, SD = 1.13 Wednesday, 10 May 17
  24. 24. Fewer Repetitions of Exercises Exercises with SoPhy without SoPhy Dorsiflexion F(1,36) = 6.99, p<.05 M = 8.10, SD = 3.21 M = 11.25, SD = 4.54 Plantarflexion F(1,36) = 6.14, p<.05 M = 7.45, SD = 3.88 M = 10.60, SD = 4.24 Squats F(1,36) = 8.36, p<.01 M = 6.05, SD = 2.48 M = 8.05, SD = 3.18 Wednesday, 10 May 17
  25. 25. Fewer Repetitions of Exercises Over video, I can see the person only from one direction. [...] The sock system provides me this detailed information irrespective of how the person is standing or sitting. I did not ask the patient to turn backwards or sideways when I had the sock data - the system was already doing it for me. (P3) Wednesday, 10 May 17
  26. 26. Deeper Insights on Weight Distribution It’s always challenging to understand weight bearing because the pressure points are not visible. It’s easy in cases when the person is putting more weight on one foot than other. But it is difficult to understand how the pressure is distributed across the foot, is it on the heels, or on the balls. (P8) Wednesday, 10 May 17
  27. 27. Design Considerations Wednesday, 10 May 17
  28. 28. Revealing Foot Contours Wednesday, 10 May 17
  29. 29. Opportunities for Other Media Wednesday, 10 May 17
  30. 30. Conclusion Extension of video consultations beyond audio- visual medium First exploration to enhance the ability of physiotherapists during video consultations Wednesday, 10 May 17
  31. 31. Deployments at the Hospital Wednesday, 10 May 17
  32. 32. Deepti Aggarwal daggarwal@student.unimelb.edu.au Wednesday, 10 May 17

×