SlideShare a Scribd company logo
1 of 26
Download to read offline
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                       Technische Universität München




                          GymSkill:
           A Personal Trainer for Physical Exercises

     Andreas Möller, Luis Roalter,                                Nils Hammerla, Patrick Olivier,
   Stefan Diewald, Johannes Scherr,                                       Thomas Plötz
            Matthias Kranz
   Technische Universität München,                                    Newcastle University,
              Germany                                                   United Kingdom


                                                      March 22
                                            PerCom 2012, Lugano, Switzerland
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Outline

•     Motivation

•     Automatic Assessment of Physical Exercises

•     Case Study

•     Conclusion




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    2
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Motivation

•     Physical activity is required for healthy lifestyle
•     Problem: people do not exercise enough
       –  Lack of knowledge of correct exercise execution for fast improvement
       –  High level of long-term motivation needed
•     Advantages of a personal trainer:
       –  Continuous supervision and professional feedback
       –  Individualized advice and motivation
       –  Minimization of injury risk
•     Disadvantages of a personal trainer:
       –  Expensive
       –  Privacy




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    3
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Related Work

•     Scientific focus on
       –  Activity recognition
       –  Wearable sensors
•     Health and Fitness Systems
       –  Heart rate monitor, foot pod, GPS watch, …
           •  No skill assessment




        –  Fixed activity tracking (Wii balance board, Kinect)
             •  Gaming aspect
             •  Dedicated hardware




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    4
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



GymSkill

•     Smartphone-based personal trainer
•     Monitoring and assessment of physical exercises
       –  Based on phone sensor data
       –  No need for additional sensors




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    5
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Outline

•     Motivation

•     Personal Health and Fitness Systems

•     Automatic Assessment of Physical Exercises

•     Case Study

•     Conclusion




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    6
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



GymSkill: Automatic Assessment of Physical Exercises

•     We look at rocker board exercises
•     Example use case for equipment-based training
•     Defined quality criteria:
      tilt angles, speed, smoothness of movement, touching the ground…
•     Phone is attached to the board
•     During exercise: Basic situated feedback
•     After exercise: Fine-grained analysis of exercise quality and reasons for
      quality differences




  move back and forth                                       move left and right                      balance on the center

04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    7
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                                 Technische Universität München



Skill Assessment Principle
                                    Smartphone                                                     Server
                                                                                                  “Cloud“


                             Sensor Data Recording


                                                                 Log File
                            Sensor Data Processing                                             PCBA Analysis

                                   Simple Analysis

                              Real-Time Feedback                                           Skill Assessment

                                                                   HTTP
                                Skill Level (Score)

                                                                   AJAX
                               Detailed Skill Report                                       Output Rendering



                                                                  User Feedback




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                              8
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Direct Feedback While Training

•     Repetition count
•     Visual feedback of board movement
•     Warning when tilted too far
•     Optional acoustic feedback




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    9
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Post-Exercise Analysis

•     Performed for each exercise run (e.g.: 10 repetitions of tilting back and forth)

•     Global Analysis
       –  Smoothness and continuity of movement
       –  Global motion quality
       –  Usage of board‘s degrees of freedom

•     Local Analysis
       –  Identify „interesting portions“ of sensor data
       –  What is „interesting“?
          In recurrent data, this means unusual data compared to the rest
       –  E.g. participant hesitates or gets stuck




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    10
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Global Analysis

•     Estimation of motion axis (providing the dominant signal)
•     Comparison of the empirical distribution
      to ideal distribution function („gold standard“)
•     Usage of normalized and un-normalized functions to determine
      smoothness and utilization of board‘s degrees of freedom
•     Transformation into a performance quality metric between 0 and 1




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    11
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Local Analysis

•     Assumption: sensor data of a movement shares (unknown) statistical
      properties
•     Unusual portions of a sequence violate this assumption and can be identified
•     Extension to PCA: Principal Component Breakdown Analysis
•     PCA model is learned from local neighborhood
      (using sliding window technique)
•     Frames are projected to lower-dimensional subspace using PCA
•     Reconstruction errors used as a measure for motion quality
•     Problem: ideal window size not known
•     Solution: multi-scale comparison (iteratively growing window)




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    12
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                                    Technische Universität München



User Feedback                                                                                               
                                                                                                            
                                                                                                            
                                                                                                            




                                                                                               
•     Visual feedback                                                                                       
                                                                                                            

       –  PCA-based assessment diagram                                                                      
                                                                                                            

          (red and yellow parts contain irregularities)                                                     

                                                                                                                                    
                                                                                                                        



•     Textual feedback
       –  Based on global and local metrics                                                                      Try	
  to	
  be	
  more	
  
       –  Rule-based combination of aspects trigger                                                               continuous	
  in	
  
          textual cues                                                                                             your	
  motion!     	
  


•     “Thumb” feedback
       –  Overall assessment at a glance




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                                               13
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Outline

•     Motivation

•     Automatic Assessment of Physical Exercises

•     Case Study

•     Conclusion




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    14
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Case Study

•     Set of 20 exercises
      developed by sports medicine specialist
•     6 participants, 5 days of training
      (20 different exercises twice a day)
•     1200 exercise records



•     Goal 1: Collection of training data
       –  Identification of criteria and assessment
          by physician
•     Goal 2: Qualitative evaluation of prototype
       –  Questionnaire study




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    15
Fachgebiet Verteilte Multimodale Informationsverarbeitung
             Prof. Dr. Matthias Kranz                                                                                     Technische Universität München



             Case Study: Trial Assessment Example 1
                                                                                 PCBA: Continuity




                                                  5                              10                          15                              20
                                                                                    Time [s]
                            General motion                                        Angle usage
             0.2                                                         0.25                                     Try to be more continuous in your motion!
                                           observed                                                               You touched the ground 3 times.
                                           ideal                          0.2
            0.15                                                                                                  Your movement is not ideal.
frequency




                                                             frequency




                                                                         0.15                                     − Move back and forth in a continuous motion.
             0.1
                                                                          0.1                                     Try to move similarly to both sides of the board.
            0.05                                                                                                  − You do not utilise the full range of angles!
                                                                         0.05
                                                                                                                  − You lean towards the front!
               0                                                           0
               −2        −1       0       1             2                 −max          0             +max
                          displacement [std]                                     displacement [°]




             04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                                     16
Fachgebiet Verteilte Multimodale Informationsverarbeitung
             Prof. Dr. Matthias Kranz                                                                                Technische Universität München



             Case Study: Trial Assessment Example 2
                                                                                 PCBA: Continuity




                                                         5                                   10                                15
                                                                                    Time [s]
                            General motion                                        Angle usage
             0.2                                                          0.2                                Your movement is continuous, nice!
                                           observed                                                          You did not touch the ground!
            0.15                           ideal                         0.15                                Overall you perform the movement nicely!
frequency




                                                             frequency




                                                                                                             Try to move similarly to both sides of the board.
             0.1                                                          0.1
                                                                                                             − You do not utilise the full range of angles!
            0.05                                                         0.05                                − You lean towards the front!

               0                                                           0
               −2        −1       0       1             2                 −max          0             +max
                          displacement [std]                                     displacement [°]




             04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                                17
Fachgebiet Verteilte Multimodale Informationsverarbeitung
     Prof. Dr. Matthias Kranz                                                                       Technische Universität München



     Qualitative Feedback



Fully agree




Not agree at all




     04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    18
Fachgebiet Verteilte Multimodale Informationsverarbeitung
     Prof. Dr. Matthias Kranz                                                                       Technische Universität München



     Qualitative Feedback

     •     Feature wishlist


   Fully agree




Not agree at all




     04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    19
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Outline

•     Motivation

•     Automatic Assessment of Physical Exercises

•     Case Study

•     Conclusion




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    20
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Summary

•     Mobile skill assessment of overall exercise quality
•     Identification of typical exercising errors
•     “Personal trainer”
•     Participant feedback indicates potential for long-term exercising motivation

Further work:
•  Long-term study on training progress
•  Assessment and feedback entirely on mobile phone
•  Generalization of assessment model




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    21
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



GymSkill in Google Play




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    22
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München




                                           Thank you for your attention!
                                                  Questions?




                                                               ?
                                                               ?
                                andreas.moeller@tum.de
                       www.vmi.ei.tum.de/team/andreas-moeller.html

04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    23
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Paper Reference

•     Please find the associated paper at:
      https://vmi.lmt.ei.tum.de/publications/2012/percom2012-preprint.pdf

•     Please cite this work as follows:
•     Andreas Möller, Luis Roalter, Stefan Diewald, Johannes Scherr, Matthias
      Kranz, Nils Hammerla, Patrick Olivier, Thomas Plötz
      GymSkill: A Personal Trainer for Physical Exercises
      In: 2012 IEEE International Conference on Pervasive Computing and
      Communications (PerCom2012), Lugano, Switzerland, March 2012, pp.
      213-220




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    24
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



If you use BibTex, please use the following entry
to cite this work:



 @INPROCEEDINGS{6199869,
 author={M"{o}ller, Andreas and Roalter, Luis and Diewald, Stefan and Scherr,
 Johannes and Kranz, Matthias and Hammerla, Nils and Olivier, Patrick and
 Pl"{o}tz, Thomas},
 booktitle={Pervasive Computing and Communications (PerCom), 2012 IEEE
 International Conference on}, title={GymSkill: A personal trainer for
 physical exercises},
 year={2012},
 month={march},
 volume={},
 number={},
 pages={213 -220},
 doi={10.1109/PerCom.2012.6199869},
 ISSN={},}




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    25
Fachgebiet Verteilte Multimodale Informationsverarbeitung
Prof. Dr. Matthias Kranz                                                                       Technische Universität München



Image Sources
•     Slide 5
       –  gpsreview.net
       –  amazon.com
       –  spieleradar.de
       –  golem.de




04.01.13         Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises                                    26

More Related Content

Similar to GymSkill - A Personal Trainer for Physical Exercises

1115 wyatt wheres the science in hi for christchurch nz oct 2015
1115 wyatt wheres the science in hi   for christchurch nz oct 20151115 wyatt wheres the science in hi   for christchurch nz oct 2015
1115 wyatt wheres the science in hi for christchurch nz oct 2015
Health Informatics New Zealand
 
HUMAN PERFORMANCE MEASUREMENT, MODELING AND SIMULATION FOR AN ASSE.docx
HUMAN PERFORMANCE MEASUREMENT, MODELING AND SIMULATION FOR AN ASSE.docxHUMAN PERFORMANCE MEASUREMENT, MODELING AND SIMULATION FOR AN ASSE.docx
HUMAN PERFORMANCE MEASUREMENT, MODELING AND SIMULATION FOR AN ASSE.docx
wellesleyterresa
 
Context driven, prescription-based personal activity classification methodolo...
Context driven, prescription-based personal activity classification methodolo...Context driven, prescription-based personal activity classification methodolo...
Context driven, prescription-based personal activity classification methodolo...
JPINFOTECH JAYAPRAKASH
 
Classification of physiological signals for wheel loader operators using Mult...
Classification of physiological signals for wheel loader operators using Mult...Classification of physiological signals for wheel loader operators using Mult...
Classification of physiological signals for wheel loader operators using Mult...
Reno Filla
 

Similar to GymSkill - A Personal Trainer for Physical Exercises (20)

Tues m3 johannes_magenheim
Tues m3 johannes_magenheimTues m3 johannes_magenheim
Tues m3 johannes_magenheim
 
María Martínez - Decision support system for health continuous vigilance in i...
María Martínez - Decision support system for health continuous vigilance in i...María Martínez - Decision support system for health continuous vigilance in i...
María Martínez - Decision support system for health continuous vigilance in i...
 
MobiMed: Comparing Object Identification Techniques on Smartphones
MobiMed: Comparing Object Identification Techniques on SmartphonesMobiMed: Comparing Object Identification Techniques on Smartphones
MobiMed: Comparing Object Identification Techniques on Smartphones
 
Report out: SMART Emergency Medical Teams
Report out: SMART Emergency Medical TeamsReport out: SMART Emergency Medical Teams
Report out: SMART Emergency Medical Teams
 
Tool Support for Prototyping Interfaces
Tool Support for Prototyping InterfacesTool Support for Prototyping Interfaces
Tool Support for Prototyping Interfaces
 
Cognitive Engineering
Cognitive EngineeringCognitive Engineering
Cognitive Engineering
 
1115 wyatt wheres the science in hi for christchurch nz oct 2015
1115 wyatt wheres the science in hi   for christchurch nz oct 20151115 wyatt wheres the science in hi   for christchurch nz oct 2015
1115 wyatt wheres the science in hi for christchurch nz oct 2015
 
Update Behavior in App Markets and Security Implications: A Case Study in Goo...
Update Behavior in App Markets and Security Implications: A Case Study in Goo...Update Behavior in App Markets and Security Implications: A Case Study in Goo...
Update Behavior in App Markets and Security Implications: A Case Study in Goo...
 
Live Sims for First Responder Training
Live Sims for First Responder TrainingLive Sims for First Responder Training
Live Sims for First Responder Training
 
Iotswc2016 - Microsoft - Healthcare track - lombardi - KHARE
Iotswc2016 - Microsoft - Healthcare track - lombardi - KHAREIotswc2016 - Microsoft - Healthcare track - lombardi - KHARE
Iotswc2016 - Microsoft - Healthcare track - lombardi - KHARE
 
Advanced technology in Rehabilitation
Advanced technology in RehabilitationAdvanced technology in Rehabilitation
Advanced technology in Rehabilitation
 
User centered design
User centered designUser centered design
User centered design
 
Medical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructuresMedical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructures
 
Dance Movement Therapy in the Metaverse: A New Frontier for Mental Health
Dance Movement Therapy in the Metaverse: A New Frontier for Mental HealthDance Movement Therapy in the Metaverse: A New Frontier for Mental Health
Dance Movement Therapy in the Metaverse: A New Frontier for Mental Health
 
HUMAN PERFORMANCE MEASUREMENT, MODELING AND SIMULATION FOR AN ASSE.docx
HUMAN PERFORMANCE MEASUREMENT, MODELING AND SIMULATION FOR AN ASSE.docxHUMAN PERFORMANCE MEASUREMENT, MODELING AND SIMULATION FOR AN ASSE.docx
HUMAN PERFORMANCE MEASUREMENT, MODELING AND SIMULATION FOR AN ASSE.docx
 
Accelerator Innovation Network Event: Session 2
Accelerator Innovation Network Event: Session 2 Accelerator Innovation Network Event: Session 2
Accelerator Innovation Network Event: Session 2
 
Brownie v1.0
Brownie v1.0Brownie v1.0
Brownie v1.0
 
Context driven, prescription-based personal activity classification methodolo...
Context driven, prescription-based personal activity classification methodolo...Context driven, prescription-based personal activity classification methodolo...
Context driven, prescription-based personal activity classification methodolo...
 
Lab 06-sol
Lab 06-solLab 06-sol
Lab 06-sol
 
Classification of physiological signals for wheel loader operators using Mult...
Classification of physiological signals for wheel loader operators using Mult...Classification of physiological signals for wheel loader operators using Mult...
Classification of physiological signals for wheel loader operators using Mult...
 

More from Distributed Multimodal Information Processing Group

Towards a Holistic Approach for Mobile Application Development in Intelligent...
Towards a Holistic Approach for Mobile Application Development in Intelligent...Towards a Holistic Approach for Mobile Application Development in Intelligent...
Towards a Holistic Approach for Mobile Application Development in Intelligent...
Distributed Multimodal Information Processing Group
 
MobiDics: Cooperative Mobile e-Learning for Teachers
MobiDics: Cooperative Mobile e-Learning for TeachersMobiDics: Cooperative Mobile e-Learning for Teachers
MobiDics: Cooperative Mobile e-Learning for Teachers
Distributed Multimodal Information Processing Group
 

More from Distributed Multimodal Information Processing Group (14)

Experimental Evaluation of User Interfaces for Visual Indoor Navigation
Experimental Evaluation of User Interfaces for Visual Indoor NavigationExperimental Evaluation of User Interfaces for Visual Indoor Navigation
Experimental Evaluation of User Interfaces for Visual Indoor Navigation
 
Visual Authentication - A Secure Single Step Authentication for User Authoriz...
Visual Authentication - A Secure Single Step Authentication for User Authoriz...Visual Authentication - A Secure Single Step Authentication for User Authoriz...
Visual Authentication - A Secure Single Step Authentication for User Authoriz...
 
Mit mobilem Lernen zur erweiterten Methodenkompetenz
Mit mobilem Lernen zur erweiterten MethodenkompetenzMit mobilem Lernen zur erweiterten Methodenkompetenz
Mit mobilem Lernen zur erweiterten Methodenkompetenz
 
Investigating Self-Reporting Behavior in Long-Term Studies
Investigating Self-Reporting Behavior in Long-Term StudiesInvestigating Self-Reporting Behavior in Long-Term Studies
Investigating Self-Reporting Behavior in Long-Term Studies
 
Decision-Point Panorama-Based Indoor Navigation
Decision-Point Panorama-Based Indoor NavigationDecision-Point Panorama-Based Indoor Navigation
Decision-Point Panorama-Based Indoor Navigation
 
The Smartphone as Mobile Authorization Proxy
The Smartphone as Mobile Authorization ProxyThe Smartphone as Mobile Authorization Proxy
The Smartphone as Mobile Authorization Proxy
 
Towards a Holistic Approach for Mobile Application Development in Intelligent...
Towards a Holistic Approach for Mobile Application Development in Intelligent...Towards a Holistic Approach for Mobile Application Development in Intelligent...
Towards a Holistic Approach for Mobile Application Development in Intelligent...
 
The Healthcare and Motivation Seat - A Survey with the GewoS Chair
The Healthcare and Motivation Seat - A Survey with the GewoS ChairThe Healthcare and Motivation Seat - A Survey with the GewoS Chair
The Healthcare and Motivation Seat - A Survey with the GewoS Chair
 
DriveAssist – A V2X-Based Driver Assistance System for Android
DriveAssist – A V2X-Based Driver Assistance System for Android DriveAssist – A V2X-Based Driver Assistance System for Android
DriveAssist – A V2X-Based Driver Assistance System for Android
 
Distributed Networks within ROS: Challenges and Possibilities
Distributed Networks within ROS: Challenges and PossibilitiesDistributed Networks within ROS: Challenges and Possibilities
Distributed Networks within ROS: Challenges and Possibilities
 
MobiliNet: A Social Network for Optimized Mobility
MobiliNet: A Social Network for Optimized MobilityMobiliNet: A Social Network for Optimized Mobility
MobiliNet: A Social Network for Optimized Mobility
 
Gamification-supported Exploration of Natural User Interfaces
Gamification-supported Exploration of Natural User InterfacesGamification-supported Exploration of Natural User Interfaces
Gamification-supported Exploration of Natural User Interfaces
 
MobiDics: Cooperative Mobile e-Learning for Teachers
MobiDics: Cooperative Mobile e-Learning for TeachersMobiDics: Cooperative Mobile e-Learning for Teachers
MobiDics: Cooperative Mobile e-Learning for Teachers
 
A Mobile Indoor Navigation System Interface Adapted to Vision-Based Localization
A Mobile Indoor Navigation System Interface Adapted to Vision-Based LocalizationA Mobile Indoor Navigation System Interface Adapted to Vision-Based Localization
A Mobile Indoor Navigation System Interface Adapted to Vision-Based Localization
 

Recently uploaded

CAS 110-63-4 BDO Liquid 1,4-Butanediol 1 4 BDO Warehouse Supply For Excellent...
CAS 110-63-4 BDO Liquid 1,4-Butanediol 1 4 BDO Warehouse Supply For Excellent...CAS 110-63-4 BDO Liquid 1,4-Butanediol 1 4 BDO Warehouse Supply For Excellent...
CAS 110-63-4 BDO Liquid 1,4-Butanediol 1 4 BDO Warehouse Supply For Excellent...
ocean4396
 

Recently uploaded (20)

CAS 110-63-4 BDO Liquid 1,4-Butanediol 1 4 BDO Warehouse Supply For Excellent...
CAS 110-63-4 BDO Liquid 1,4-Butanediol 1 4 BDO Warehouse Supply For Excellent...CAS 110-63-4 BDO Liquid 1,4-Butanediol 1 4 BDO Warehouse Supply For Excellent...
CAS 110-63-4 BDO Liquid 1,4-Butanediol 1 4 BDO Warehouse Supply For Excellent...
 
The Orbit & its contents by Dr. Rabia I. Gandapore.pptx
The Orbit & its contents by Dr. Rabia I. Gandapore.pptxThe Orbit & its contents by Dr. Rabia I. Gandapore.pptx
The Orbit & its contents by Dr. Rabia I. Gandapore.pptx
 
Denture base resins materials and its mechanism of action
Denture base resins materials and its mechanism of actionDenture base resins materials and its mechanism of action
Denture base resins materials and its mechanism of action
 
Cervical screening – taking care of your health flipchart (Vietnamese)
Cervical screening – taking care of your health flipchart (Vietnamese)Cervical screening – taking care of your health flipchart (Vietnamese)
Cervical screening – taking care of your health flipchart (Vietnamese)
 
5CL-ADB powder supplier 5cl adb 5cladba 5cl raw materials vendor on sale now
5CL-ADB powder supplier 5cl adb 5cladba 5cl raw materials vendor on sale now5CL-ADB powder supplier 5cl adb 5cladba 5cl raw materials vendor on sale now
5CL-ADB powder supplier 5cl adb 5cladba 5cl raw materials vendor on sale now
 
5Cladba ADBB 5cladba buy 6cl adbb powder 5cl ADBB precursor materials
5Cladba ADBB 5cladba buy 6cl adbb powder 5cl ADBB precursor materials5Cladba ADBB 5cladba buy 6cl adbb powder 5cl ADBB precursor materials
5Cladba ADBB 5cladba buy 6cl adbb powder 5cl ADBB precursor materials
 
ROSE CASE SPINAL SBRT BY DR KANHU CHARAN PATRO
ROSE  CASE SPINAL SBRT BY DR KANHU CHARAN PATROROSE  CASE SPINAL SBRT BY DR KANHU CHARAN PATRO
ROSE CASE SPINAL SBRT BY DR KANHU CHARAN PATRO
 
TEST BANK For Huether and McCance's Understanding Pathophysiology, Canadian 2...
TEST BANK For Huether and McCance's Understanding Pathophysiology, Canadian 2...TEST BANK For Huether and McCance's Understanding Pathophysiology, Canadian 2...
TEST BANK For Huether and McCance's Understanding Pathophysiology, Canadian 2...
 
VVIP Yelahanka ℂall Girls 6350482085 Heat-immolating { Bangalore } Coveted Gi...
VVIP Yelahanka ℂall Girls 6350482085 Heat-immolating { Bangalore } Coveted Gi...VVIP Yelahanka ℂall Girls 6350482085 Heat-immolating { Bangalore } Coveted Gi...
VVIP Yelahanka ℂall Girls 6350482085 Heat-immolating { Bangalore } Coveted Gi...
 
Mgr university bsc nursing adult health previous question paper with answers
Mgr university  bsc nursing adult health previous question paper with answersMgr university  bsc nursing adult health previous question paper with answers
Mgr university bsc nursing adult health previous question paper with answers
 
Making Patient-Centric Immunotherapy a Reality in Lung Cancer: Best Practices...
Making Patient-Centric Immunotherapy a Reality in Lung Cancer: Best Practices...Making Patient-Centric Immunotherapy a Reality in Lung Cancer: Best Practices...
Making Patient-Centric Immunotherapy a Reality in Lung Cancer: Best Practices...
 
Results For Love Spell Is Guaranteed In 1 Day +27834335081 [BACK LOST LOVE SP...
Results For Love Spell Is Guaranteed In 1 Day +27834335081 [BACK LOST LOVE SP...Results For Love Spell Is Guaranteed In 1 Day +27834335081 [BACK LOST LOVE SP...
Results For Love Spell Is Guaranteed In 1 Day +27834335081 [BACK LOST LOVE SP...
 
Unveiling Alcohol Withdrawal Syndrome: exploring it's hidden depths
Unveiling Alcohol Withdrawal Syndrome: exploring it's hidden depthsUnveiling Alcohol Withdrawal Syndrome: exploring it's hidden depths
Unveiling Alcohol Withdrawal Syndrome: exploring it's hidden depths
 
Premium ℂall Girls In Mumbai👉 Dail ℂALL ME: 📞9833325238 📲 ℂall Richa VIP ℂall...
Premium ℂall Girls In Mumbai👉 Dail ℂALL ME: 📞9833325238 📲 ℂall Richa VIP ℂall...Premium ℂall Girls In Mumbai👉 Dail ℂALL ME: 📞9833325238 📲 ℂall Richa VIP ℂall...
Premium ℂall Girls In Mumbai👉 Dail ℂALL ME: 📞9833325238 📲 ℂall Richa VIP ℂall...
 
Tips and tricks to pass the cardiovascular station for PACES exam
Tips and tricks to pass the cardiovascular station for PACES examTips and tricks to pass the cardiovascular station for PACES exam
Tips and tricks to pass the cardiovascular station for PACES exam
 
A thorough review of supernormal conduction.pptx
A thorough review of supernormal conduction.pptxA thorough review of supernormal conduction.pptx
A thorough review of supernormal conduction.pptx
 
World Hypertension Day 17th may 2024 ppt
World Hypertension Day 17th may 2024 pptWorld Hypertension Day 17th may 2024 ppt
World Hypertension Day 17th may 2024 ppt
 
Vip ℂall Girls Shalimar Bagh Phone No 9999965857 High Profile ℂall Girl Delhi...
Vip ℂall Girls Shalimar Bagh Phone No 9999965857 High Profile ℂall Girl Delhi...Vip ℂall Girls Shalimar Bagh Phone No 9999965857 High Profile ℂall Girl Delhi...
Vip ℂall Girls Shalimar Bagh Phone No 9999965857 High Profile ℂall Girl Delhi...
 
Integrated Neuromuscular Inhibition Technique (INIT)
Integrated Neuromuscular Inhibition Technique (INIT)Integrated Neuromuscular Inhibition Technique (INIT)
Integrated Neuromuscular Inhibition Technique (INIT)
 
Renal Replacement Therapy in Acute Kidney Injury -time modality -Dr Ayman Se...
Renal Replacement Therapy in Acute Kidney Injury -time  modality -Dr Ayman Se...Renal Replacement Therapy in Acute Kidney Injury -time  modality -Dr Ayman Se...
Renal Replacement Therapy in Acute Kidney Injury -time modality -Dr Ayman Se...
 

GymSkill - A Personal Trainer for Physical Exercises

  • 1. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München GymSkill: A Personal Trainer for Physical Exercises Andreas Möller, Luis Roalter, Nils Hammerla, Patrick Olivier, Stefan Diewald, Johannes Scherr, Thomas Plötz Matthias Kranz Technische Universität München, Newcastle University, Germany United Kingdom March 22 PerCom 2012, Lugano, Switzerland
  • 2. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Outline •  Motivation •  Automatic Assessment of Physical Exercises •  Case Study •  Conclusion 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 2
  • 3. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Motivation •  Physical activity is required for healthy lifestyle •  Problem: people do not exercise enough –  Lack of knowledge of correct exercise execution for fast improvement –  High level of long-term motivation needed •  Advantages of a personal trainer: –  Continuous supervision and professional feedback –  Individualized advice and motivation –  Minimization of injury risk •  Disadvantages of a personal trainer: –  Expensive –  Privacy 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 3
  • 4. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Related Work •  Scientific focus on –  Activity recognition –  Wearable sensors •  Health and Fitness Systems –  Heart rate monitor, foot pod, GPS watch, … •  No skill assessment –  Fixed activity tracking (Wii balance board, Kinect) •  Gaming aspect •  Dedicated hardware 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 4
  • 5. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München GymSkill •  Smartphone-based personal trainer •  Monitoring and assessment of physical exercises –  Based on phone sensor data –  No need for additional sensors 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 5
  • 6. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Outline •  Motivation •  Personal Health and Fitness Systems •  Automatic Assessment of Physical Exercises •  Case Study •  Conclusion 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 6
  • 7. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München GymSkill: Automatic Assessment of Physical Exercises •  We look at rocker board exercises •  Example use case for equipment-based training •  Defined quality criteria: tilt angles, speed, smoothness of movement, touching the ground… •  Phone is attached to the board •  During exercise: Basic situated feedback •  After exercise: Fine-grained analysis of exercise quality and reasons for quality differences move back and forth move left and right balance on the center 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 7
  • 8. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Skill Assessment Principle Smartphone Server “Cloud“ Sensor Data Recording Log File Sensor Data Processing PCBA Analysis Simple Analysis Real-Time Feedback Skill Assessment HTTP Skill Level (Score) AJAX Detailed Skill Report Output Rendering User Feedback 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 8
  • 9. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Direct Feedback While Training •  Repetition count •  Visual feedback of board movement •  Warning when tilted too far •  Optional acoustic feedback 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 9
  • 10. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Post-Exercise Analysis •  Performed for each exercise run (e.g.: 10 repetitions of tilting back and forth) •  Global Analysis –  Smoothness and continuity of movement –  Global motion quality –  Usage of board‘s degrees of freedom •  Local Analysis –  Identify „interesting portions“ of sensor data –  What is „interesting“? In recurrent data, this means unusual data compared to the rest –  E.g. participant hesitates or gets stuck 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 10
  • 11. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Global Analysis •  Estimation of motion axis (providing the dominant signal) •  Comparison of the empirical distribution to ideal distribution function („gold standard“) •  Usage of normalized and un-normalized functions to determine smoothness and utilization of board‘s degrees of freedom •  Transformation into a performance quality metric between 0 and 1 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 11
  • 12. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Local Analysis •  Assumption: sensor data of a movement shares (unknown) statistical properties •  Unusual portions of a sequence violate this assumption and can be identified •  Extension to PCA: Principal Component Breakdown Analysis •  PCA model is learned from local neighborhood (using sliding window technique) •  Frames are projected to lower-dimensional subspace using PCA •  Reconstruction errors used as a measure for motion quality •  Problem: ideal window size not known •  Solution: multi-scale comparison (iteratively growing window) 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 12
  • 13. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München User Feedback      •  Visual feedback   –  PCA-based assessment diagram   (red and yellow parts contain irregularities)          •  Textual feedback –  Based on global and local metrics Try  to  be  more   –  Rule-based combination of aspects trigger continuous  in   textual cues your  motion!   •  “Thumb” feedback –  Overall assessment at a glance 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 13
  • 14. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Outline •  Motivation •  Automatic Assessment of Physical Exercises •  Case Study •  Conclusion 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 14
  • 15. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Case Study •  Set of 20 exercises developed by sports medicine specialist •  6 participants, 5 days of training (20 different exercises twice a day) •  1200 exercise records •  Goal 1: Collection of training data –  Identification of criteria and assessment by physician •  Goal 2: Qualitative evaluation of prototype –  Questionnaire study 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 15
  • 16. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Case Study: Trial Assessment Example 1 PCBA: Continuity 5 10 15 20 Time [s] General motion Angle usage 0.2 0.25 Try to be more continuous in your motion! observed You touched the ground 3 times. ideal 0.2 0.15 Your movement is not ideal. frequency frequency 0.15 − Move back and forth in a continuous motion. 0.1 0.1 Try to move similarly to both sides of the board. 0.05 − You do not utilise the full range of angles! 0.05 − You lean towards the front! 0 0 −2 −1 0 1 2 −max 0 +max displacement [std] displacement [°] 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 16
  • 17. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Case Study: Trial Assessment Example 2 PCBA: Continuity 5 10 15 Time [s] General motion Angle usage 0.2 0.2 Your movement is continuous, nice! observed You did not touch the ground! 0.15 ideal 0.15 Overall you perform the movement nicely! frequency frequency Try to move similarly to both sides of the board. 0.1 0.1 − You do not utilise the full range of angles! 0.05 0.05 − You lean towards the front! 0 0 −2 −1 0 1 2 −max 0 +max displacement [std] displacement [°] 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 17
  • 18. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Qualitative Feedback Fully agree Not agree at all 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 18
  • 19. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Qualitative Feedback •  Feature wishlist Fully agree Not agree at all 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 19
  • 20. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Outline •  Motivation •  Automatic Assessment of Physical Exercises •  Case Study •  Conclusion 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 20
  • 21. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Summary •  Mobile skill assessment of overall exercise quality •  Identification of typical exercising errors •  “Personal trainer” •  Participant feedback indicates potential for long-term exercising motivation Further work: •  Long-term study on training progress •  Assessment and feedback entirely on mobile phone •  Generalization of assessment model 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 21
  • 22. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München GymSkill in Google Play 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 22
  • 23. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Thank you for your attention! Questions? ? ? andreas.moeller@tum.de www.vmi.ei.tum.de/team/andreas-moeller.html 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 23
  • 24. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Paper Reference •  Please find the associated paper at: https://vmi.lmt.ei.tum.de/publications/2012/percom2012-preprint.pdf •  Please cite this work as follows: •  Andreas Möller, Luis Roalter, Stefan Diewald, Johannes Scherr, Matthias Kranz, Nils Hammerla, Patrick Olivier, Thomas Plötz GymSkill: A Personal Trainer for Physical Exercises In: 2012 IEEE International Conference on Pervasive Computing and Communications (PerCom2012), Lugano, Switzerland, March 2012, pp. 213-220 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 24
  • 25. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München If you use BibTex, please use the following entry to cite this work: @INPROCEEDINGS{6199869, author={M"{o}ller, Andreas and Roalter, Luis and Diewald, Stefan and Scherr, Johannes and Kranz, Matthias and Hammerla, Nils and Olivier, Patrick and Pl"{o}tz, Thomas}, booktitle={Pervasive Computing and Communications (PerCom), 2012 IEEE International Conference on}, title={GymSkill: A personal trainer for physical exercises}, year={2012}, month={march}, volume={}, number={}, pages={213 -220}, doi={10.1109/PerCom.2012.6199869}, ISSN={},} 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 25
  • 26. Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz Technische Universität München Image Sources •  Slide 5 –  gpsreview.net –  amazon.com –  spieleradar.de –  golem.de 04.01.13 Andreas Möller et al. - GymSkill: A Personal Trainer for Physical Exercises 26