SlideShare a Scribd company logo

Video-Based Hand Tracking for Screening Cervical Myelopathy (ISVC2021)

ISVC2021 presentation

1 of 21
Download to read offline
Video-Based Hand Tracking
for Screening Cervical Myelopathy
16th International Symposium on Visual Computing (ISVC 2021)
October 6th, 2021
Ryota Matsui1, Takafumi Koyama 2,
Koji Fujita2, Hideo Saito 1, and Yuta Sugiura 1
1 Keio University
2 Tokyo Medical and Dental University
• Spinal cord: a part of central
nervous system
• CM: pathology of compressed
cervical spinal cord
• Cause various symptoms
• Upper limb disorders
• Gait disturbance
2
[1] OrthoInfo: Spine Basics. https://orthoinfo.aaos.org/en/diseases--conditions/spine-basics/. (accessed Sep. 26th, 2021)
[2] Cook, C., et al.: Reliability and diagnostic accuracy of clinical special tests for myelopathy in patients seen for cervical dysfunction. The Journal of Orthopaedic and Sports Physical Therapy 39(3), 172–178 (2009).
Cervical Myelopathy (CM)
Human spine [1] Compressed spinal cord [2]
• A common screening method for CM
• Repeat gripping/releasing one’s hand
as quickly as possible for 10 sec
• Be screened as a CM patient if the
repetition count is approx. less than 20
• The simplicity is a big advantage.
3
[3] Ono, K., et al.: Myelopathy hand. New clinical signs of cervical cord damage. The Journal of Bone and Joint Surgery, British Volume 69(2), 215–219 (1987).
10-sec Grip and Release (G&R) Test [3]
Image of G&R movement
• Track the G&R movement to screen
CM automatically
• Non-contact hand tracking with a
Leap Motion Controller (LMC) [4]
• A random forest classifier
• A glove-like sensing device [5]
• Fluctuation of sensor values
• Cycle of the G&R movement
4
[4] Watanabe, M., et al.: Detection of cervical myelopathy with Leap Motion Sensor by random forests. IEEE LifeTech 2020, 214–216 (2020).
[5] Su, X.J., et al.: Clinical application of a new assessment tool for myelopathy hand using virtual reality. Spine 45(24), E1645–E1652 (2020).
Expansion of G&R Test
Track G&R movement with an LMC [4]
Track G&R movement with the glove-like device [5]
• Screen symptoms of various
diseases with a camera
• Parkinson’s disease (PD) [6]
• Changes in the ability to move face
• Amyotrophic lateral sclerosis (ALS) [7]
• Use a depth camera
• Facial movements affected by ALS
5
[6] Gomez, L.F., et al.: Improving Parkinson detection using dynamic features from evoked expressions in video. CVPR 2021, 1562–1570 (2021).
[7] Bandini, A., et al.: Automatic detection of amyotrophic lateral sclerosis (ALS) from video-based analysis of facial movements: Speech and non-speech tasks. FG 2018, 150–157 (2018).
Video-Based Screening Methods
Flow of screening PD [6]
Feature points obtained to screen ALS [7]
• An automatic CM screening method
with a camera
• The main contributions
• Achieve high screening performance
• Machine learning-based classification
without any qualitative indexes
6
Overview of This Work
Record G&R test with a camera
Image processing for hand tracking
Flow of our method

Recommended

Cervical Spine Range of Motion Measurement Utilizing Image Analysis - VISAPP2022
Cervical Spine Range of Motion Measurement Utilizing Image Analysis - VISAPP2022Cervical Spine Range of Motion Measurement Utilizing Image Analysis - VISAPP2022
Cervical Spine Range of Motion Measurement Utilizing Image Analysis - VISAPP2022sugiuralab
 
FacialPen: Using Facial Detection to Augment Pen-Based Interaction - Asian CH...
FacialPen: Using Facial Detection to Augment Pen-Based Interaction - Asian CH...FacialPen: Using Facial Detection to Augment Pen-Based Interaction - Asian CH...
FacialPen: Using Facial Detection to Augment Pen-Based Interaction - Asian CH...sugiuralab
 
Brain tumor detection and localization in magnetic resonance imaging
Brain tumor detection and localization in magnetic resonance imagingBrain tumor detection and localization in magnetic resonance imaging
Brain tumor detection and localization in magnetic resonance imagingijitcs
 
Breast Lesion Segmentation in Ultrasound Images
Breast Lesion Segmentation in Ultrasound ImagesBreast Lesion Segmentation in Ultrasound Images
Breast Lesion Segmentation in Ultrasound ImagesMohamed Elawady
 
BREAST TUMOR DETECTION USING HAAR-LIKE FEATURE METHOD ON ULTRASONOGRAPHY (USG...
BREAST TUMOR DETECTION USING HAAR-LIKE FEATURE METHOD ON ULTRASONOGRAPHY (USG...BREAST TUMOR DETECTION USING HAAR-LIKE FEATURE METHOD ON ULTRASONOGRAPHY (USG...
BREAST TUMOR DETECTION USING HAAR-LIKE FEATURE METHOD ON ULTRASONOGRAPHY (USG...AM Publications
 
IRJET- Brain Tumor Segmentation and Detection using F-Transform
IRJET- Brain Tumor Segmentation and Detection using F-TransformIRJET- Brain Tumor Segmentation and Detection using F-Transform
IRJET- Brain Tumor Segmentation and Detection using F-TransformIRJET Journal
 

More Related Content

What's hot

Medical image processing
Medical image processingMedical image processing
Medical image processingDr G R Sinha
 
ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...
ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...
ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...Mohamed Elawady
 
Medical image processing studies
Medical image processing studiesMedical image processing studies
Medical image processing studiesBằng Nguyễn Kim
 
Neutrosophic sets and fuzzy c means clustering for improving ct liver image s...
Neutrosophic sets and fuzzy c means clustering for improving ct liver image s...Neutrosophic sets and fuzzy c means clustering for improving ct liver image s...
Neutrosophic sets and fuzzy c means clustering for improving ct liver image s...Aboul Ella Hassanien
 
Model guided therapy and the role of dicom in surgery
Model guided therapy and the role of dicom in surgeryModel guided therapy and the role of dicom in surgery
Model guided therapy and the role of dicom in surgeryKlaus19
 
Grip Strength Rehabilitation Using a Monocular Camera(AsianCHI2020)
Grip Strength Rehabilitation Using a Monocular Camera(AsianCHI2020)Grip Strength Rehabilitation Using a Monocular Camera(AsianCHI2020)
Grip Strength Rehabilitation Using a Monocular Camera(AsianCHI2020)sugiuralab
 
Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...
Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...
Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...sugiuralab
 
Detection of Prostate Cancer Using Radial/Axial Scanning of 2D Trans-rectal U...
Detection of Prostate Cancer Using Radial/Axial Scanning of 2D Trans-rectal U...Detection of Prostate Cancer Using Radial/Axial Scanning of 2D Trans-rectal U...
Detection of Prostate Cancer Using Radial/Axial Scanning of 2D Trans-rectal U...journalBEEI
 
An automated 3D cup planning in total hip arthroplasty from a standard X‑ray ...
An automated 3D cup planning in total hip arthroplasty from a standard X‑ray ...An automated 3D cup planning in total hip arthroplasty from a standard X‑ray ...
An automated 3D cup planning in total hip arthroplasty from a standard X‑ray ...AutoImPlan team
 
Imageprocessinginbraintumordetection 190316110830
Imageprocessinginbraintumordetection 190316110830Imageprocessinginbraintumordetection 190316110830
Imageprocessinginbraintumordetection 19031611083003446940736
 
IRJET - Classification of Cancer Images using Deep Learning
IRJET -  	  Classification of Cancer Images using Deep LearningIRJET -  	  Classification of Cancer Images using Deep Learning
IRJET - Classification of Cancer Images using Deep LearningIRJET Journal
 
IRJET- Detection and Classification of Skin Diseases using Different Colo...
IRJET-  	  Detection and Classification of Skin Diseases using Different Colo...IRJET-  	  Detection and Classification of Skin Diseases using Different Colo...
IRJET- Detection and Classification of Skin Diseases using Different Colo...IRJET Journal
 
Design of Modified Bio-Inspired Algorithm for Identification and Segmentation...
Design of Modified Bio-Inspired Algorithm for Identification and Segmentation...Design of Modified Bio-Inspired Algorithm for Identification and Segmentation...
Design of Modified Bio-Inspired Algorithm for Identification and Segmentation...yudhveersingh18
 
Skin Cancer Detection and Classification
Skin Cancer Detection and ClassificationSkin Cancer Detection and Classification
Skin Cancer Detection and ClassificationDr. Amarjeet Singh
 
Medical Imaging: 8 Opportunities for technology entrepreneurs and investors
Medical Imaging: 8 Opportunities for technology entrepreneurs and investorsMedical Imaging: 8 Opportunities for technology entrepreneurs and investors
Medical Imaging: 8 Opportunities for technology entrepreneurs and investorsHealthstartup
 
Automatic Skin Lesion Segmentation and Melanoma Detection: Transfer Learning ...
Automatic Skin Lesion Segmentation and Melanoma Detection: Transfer Learning ...Automatic Skin Lesion Segmentation and Melanoma Detection: Transfer Learning ...
Automatic Skin Lesion Segmentation and Melanoma Detection: Transfer Learning ...Zabir Al Nazi Nabil
 
2018 KOSRO-Oral presentation-Wonjoong Cheon
2018 KOSRO-Oral presentation-Wonjoong Cheon2018 KOSRO-Oral presentation-Wonjoong Cheon
2018 KOSRO-Oral presentation-Wonjoong CheonWonjoongCheon
 

What's hot (20)

Medical image processing
Medical image processingMedical image processing
Medical image processing
 
ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...
ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...
ICIAR 2016 Poster: Automatic Nonlinear Filtering and Segmentation for Breast ...
 
Medical image processing studies
Medical image processing studiesMedical image processing studies
Medical image processing studies
 
Neutrosophic sets and fuzzy c means clustering for improving ct liver image s...
Neutrosophic sets and fuzzy c means clustering for improving ct liver image s...Neutrosophic sets and fuzzy c means clustering for improving ct liver image s...
Neutrosophic sets and fuzzy c means clustering for improving ct liver image s...
 
Model guided therapy and the role of dicom in surgery
Model guided therapy and the role of dicom in surgeryModel guided therapy and the role of dicom in surgery
Model guided therapy and the role of dicom in surgery
 
Grip Strength Rehabilitation Using a Monocular Camera(AsianCHI2020)
Grip Strength Rehabilitation Using a Monocular Camera(AsianCHI2020)Grip Strength Rehabilitation Using a Monocular Camera(AsianCHI2020)
Grip Strength Rehabilitation Using a Monocular Camera(AsianCHI2020)
 
Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...
Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...
Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...
 
Detection of Prostate Cancer Using Radial/Axial Scanning of 2D Trans-rectal U...
Detection of Prostate Cancer Using Radial/Axial Scanning of 2D Trans-rectal U...Detection of Prostate Cancer Using Radial/Axial Scanning of 2D Trans-rectal U...
Detection of Prostate Cancer Using Radial/Axial Scanning of 2D Trans-rectal U...
 
An automated 3D cup planning in total hip arthroplasty from a standard X‑ray ...
An automated 3D cup planning in total hip arthroplasty from a standard X‑ray ...An automated 3D cup planning in total hip arthroplasty from a standard X‑ray ...
An automated 3D cup planning in total hip arthroplasty from a standard X‑ray ...
 
Imageprocessinginbraintumordetection 190316110830
Imageprocessinginbraintumordetection 190316110830Imageprocessinginbraintumordetection 190316110830
Imageprocessinginbraintumordetection 190316110830
 
IRJET - Classification of Cancer Images using Deep Learning
IRJET -  	  Classification of Cancer Images using Deep LearningIRJET -  	  Classification of Cancer Images using Deep Learning
IRJET - Classification of Cancer Images using Deep Learning
 
IRJET- Detection and Classification of Skin Diseases using Different Colo...
IRJET-  	  Detection and Classification of Skin Diseases using Different Colo...IRJET-  	  Detection and Classification of Skin Diseases using Different Colo...
IRJET- Detection and Classification of Skin Diseases using Different Colo...
 
Design of Modified Bio-Inspired Algorithm for Identification and Segmentation...
Design of Modified Bio-Inspired Algorithm for Identification and Segmentation...Design of Modified Bio-Inspired Algorithm for Identification and Segmentation...
Design of Modified Bio-Inspired Algorithm for Identification and Segmentation...
 
Skin Cancer Detection and Classification
Skin Cancer Detection and ClassificationSkin Cancer Detection and Classification
Skin Cancer Detection and Classification
 
Medical Imaging: 8 Opportunities for technology entrepreneurs and investors
Medical Imaging: 8 Opportunities for technology entrepreneurs and investorsMedical Imaging: 8 Opportunities for technology entrepreneurs and investors
Medical Imaging: 8 Opportunities for technology entrepreneurs and investors
 
Automatic Skin Lesion Segmentation and Melanoma Detection: Transfer Learning ...
Automatic Skin Lesion Segmentation and Melanoma Detection: Transfer Learning ...Automatic Skin Lesion Segmentation and Melanoma Detection: Transfer Learning ...
Automatic Skin Lesion Segmentation and Melanoma Detection: Transfer Learning ...
 
Medical Image Processing
Medical Image ProcessingMedical Image Processing
Medical Image Processing
 
Kx2418461851
Kx2418461851Kx2418461851
Kx2418461851
 
J044055256
J044055256J044055256
J044055256
 
2018 KOSRO-Oral presentation-Wonjoong Cheon
2018 KOSRO-Oral presentation-Wonjoong Cheon2018 KOSRO-Oral presentation-Wonjoong Cheon
2018 KOSRO-Oral presentation-Wonjoong Cheon
 

Similar to Video-Based Hand Tracking for Screening Cervical Myelopathy (ISVC2021)

Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...
Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...
Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...sugiuralab
 
Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...
Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...
Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...sugiuralab
 
Care expert assistant for Medicare system using Machine learning
Care expert assistant for Medicare system using Machine learningCare expert assistant for Medicare system using Machine learning
Care expert assistant for Medicare system using Machine learningIRJET Journal
 
Lung Conditions Prognosis Using CNN Model.pptx
Lung Conditions Prognosis Using CNN Model.pptxLung Conditions Prognosis Using CNN Model.pptx
Lung Conditions Prognosis Using CNN Model.pptxDrIndrajeetKumar
 
Digital Biomarkers for Huntington Disease
Digital Biomarkers for Huntington DiseaseDigital Biomarkers for Huntington Disease
Digital Biomarkers for Huntington DiseaseHuntington Study Group
 
Measurement Straight Leg Raise for Low Back Pain Based Grayscale Depth
Measurement Straight Leg Raise for Low Back Pain Based Grayscale DepthMeasurement Straight Leg Raise for Low Back Pain Based Grayscale Depth
Measurement Straight Leg Raise for Low Back Pain Based Grayscale DepthTELKOMNIKA JOURNAL
 
AxioMed Technology 2014 vFinale
AxioMed Technology 2014 vFinaleAxioMed Technology 2014 vFinale
AxioMed Technology 2014 vFinaleJames Kuras
 
Estimation of Walking rate in Complex activity recognition
Estimation of Walking rate in Complex activity recognitionEstimation of Walking rate in Complex activity recognition
Estimation of Walking rate in Complex activity recognitionEditor IJCATR
 
A Study of Wearable Accelerometers Layout for Human Activity Recognition(Asia...
A Study of Wearable Accelerometers Layout for Human Activity Recognition(Asia...A Study of Wearable Accelerometers Layout for Human Activity Recognition(Asia...
A Study of Wearable Accelerometers Layout for Human Activity Recognition(Asia...sugiuralab
 
A systematic approach towards designing low-cost motor and cognitive rehabili...
A systematic approach towards designing low-cost motor and cognitive rehabili...A systematic approach towards designing low-cost motor and cognitive rehabili...
A systematic approach towards designing low-cost motor and cognitive rehabili...Sergi Bermudez i Badia
 
Measuring the Drop Vertical Jump using the Microsoft Kinect
Measuring the Drop Vertical Jump using the Microsoft KinectMeasuring the Drop Vertical Jump using the Microsoft Kinect
Measuring the Drop Vertical Jump using the Microsoft Kinectthegraymatters
 
Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorSoma Boubou
 
Development and evaluation of a head controlled human-computer interface with...
Development and evaluation of a head controlled human-computer interface with...Development and evaluation of a head controlled human-computer interface with...
Development and evaluation of a head controlled human-computer interface with...Minor33
 
Development and evaluation of a head-controlled human-computer interface with...
Development and evaluation of a head-controlled human-computer interface with...Development and evaluation of a head-controlled human-computer interface with...
Development and evaluation of a head-controlled human-computer interface with...Minor33
 
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”IRJET Journal
 

Similar to Video-Based Hand Tracking for Screening Cervical Myelopathy (ISVC2021) (20)

Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...
Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...
Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...
 
Enhancing the measurement of clinical outcomes using Microsoft Kinect choices...
Enhancing the measurement of clinical outcomes using Microsoft Kinect choices...Enhancing the measurement of clinical outcomes using Microsoft Kinect choices...
Enhancing the measurement of clinical outcomes using Microsoft Kinect choices...
 
Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...
Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...
Knee Osteoarthritis Classification System Examination on Wearable Daily-Use I...
 
Care expert assistant for Medicare system using Machine learning
Care expert assistant for Medicare system using Machine learningCare expert assistant for Medicare system using Machine learning
Care expert assistant for Medicare system using Machine learning
 
Lung Conditions Prognosis Using CNN Model.pptx
Lung Conditions Prognosis Using CNN Model.pptxLung Conditions Prognosis Using CNN Model.pptx
Lung Conditions Prognosis Using CNN Model.pptx
 
Digital Biomarkers for Huntington Disease
Digital Biomarkers for Huntington DiseaseDigital Biomarkers for Huntington Disease
Digital Biomarkers for Huntington Disease
 
Clinical Prediction Rules
Clinical Prediction RulesClinical Prediction Rules
Clinical Prediction Rules
 
Measurement Straight Leg Raise for Low Back Pain Based Grayscale Depth
Measurement Straight Leg Raise for Low Back Pain Based Grayscale DepthMeasurement Straight Leg Raise for Low Back Pain Based Grayscale Depth
Measurement Straight Leg Raise for Low Back Pain Based Grayscale Depth
 
AxioMed Technology 2014 vFinale
AxioMed Technology 2014 vFinaleAxioMed Technology 2014 vFinale
AxioMed Technology 2014 vFinale
 
Estimation of Walking rate in Complex activity recognition
Estimation of Walking rate in Complex activity recognitionEstimation of Walking rate in Complex activity recognition
Estimation of Walking rate in Complex activity recognition
 
A Study of Wearable Accelerometers Layout for Human Activity Recognition(Asia...
A Study of Wearable Accelerometers Layout for Human Activity Recognition(Asia...A Study of Wearable Accelerometers Layout for Human Activity Recognition(Asia...
A Study of Wearable Accelerometers Layout for Human Activity Recognition(Asia...
 
A systematic approach towards designing low-cost motor and cognitive rehabili...
A systematic approach towards designing low-cost motor and cognitive rehabili...A systematic approach towards designing low-cost motor and cognitive rehabili...
A systematic approach towards designing low-cost motor and cognitive rehabili...
 
Measuring the Drop Vertical Jump using the Microsoft Kinect
Measuring the Drop Vertical Jump using the Microsoft KinectMeasuring the Drop Vertical Jump using the Microsoft Kinect
Measuring the Drop Vertical Jump using the Microsoft Kinect
 
STO prediction in Orthodontics by almuzian
STO prediction in Orthodontics by almuzianSTO prediction in Orthodontics by almuzian
STO prediction in Orthodontics by almuzian
 
Surgical Treatment Objective by Almuzian
Surgical Treatment Objective by AlmuzianSurgical Treatment Objective by Almuzian
Surgical Treatment Objective by Almuzian
 
Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptor
 
Image Guided Radiotherapy
Image Guided RadiotherapyImage Guided Radiotherapy
Image Guided Radiotherapy
 
Development and evaluation of a head controlled human-computer interface with...
Development and evaluation of a head controlled human-computer interface with...Development and evaluation of a head controlled human-computer interface with...
Development and evaluation of a head controlled human-computer interface with...
 
Development and evaluation of a head-controlled human-computer interface with...
Development and evaluation of a head-controlled human-computer interface with...Development and evaluation of a head-controlled human-computer interface with...
Development and evaluation of a head-controlled human-computer interface with...
 
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
Pose Trainer: “An Exercise Guide and Assessment in Physiotherapy”
 

More from sugiuralab

Converting Tatamis into Touch Sensors by Measuring Capacitance
Converting Tatamis into Touch Sensors by Measuring CapacitanceConverting Tatamis into Touch Sensors by Measuring Capacitance
Converting Tatamis into Touch Sensors by Measuring Capacitancesugiuralab
 
Pinch Force Measurement Using a Geomagnetic Sensor
Pinch Force Measurement Using a Geomagnetic SensorPinch Force Measurement Using a Geomagnetic Sensor
Pinch Force Measurement Using a Geomagnetic Sensorsugiuralab
 
Smartphone-Based Teaching System for Neonate Soothing Motions
Smartphone-Based Teaching System for Neonate Soothing MotionsSmartphone-Based Teaching System for Neonate Soothing Motions
Smartphone-Based Teaching System for Neonate Soothing Motionssugiuralab
 
Tactile Presentation of Orchestral Conductor's Motion Trajectory
Tactile Presentation of Orchestral Conductor's Motion TrajectoryTactile Presentation of Orchestral Conductor's Motion Trajectory
Tactile Presentation of Orchestral Conductor's Motion Trajectorysugiuralab
 
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensorssugiuralab
 
Seeing the Wind: An Interactive Mist Interface for Airflow Input
Seeing the Wind: An Interactive Mist Interface for Airflow InputSeeing the Wind: An Interactive Mist Interface for Airflow Input
Seeing the Wind: An Interactive Mist Interface for Airflow Inputsugiuralab
 
Identification and Authentication Using Clavicles
Identification and Authentication Using ClaviclesIdentification and Authentication Using Clavicles
Identification and Authentication Using Claviclessugiuralab
 
Estimation of Violin Bow Pressure Using Photo-Reflective Sensors
Estimation of Violin Bow Pressure Using Photo-Reflective SensorsEstimation of Violin Bow Pressure Using Photo-Reflective Sensors
Estimation of Violin Bow Pressure Using Photo-Reflective Sensorssugiuralab
 
バウンサーを動かす外付けデバイス
バウンサーを動かす外付けデバイスバウンサーを動かす外付けデバイス
バウンサーを動かす外付けデバイスsugiuralab
 
A Virtual Window Using Curtains and Image Projection
A Virtual Window Using Curtains and Image ProjectionA Virtual Window Using Curtains and Image Projection
A Virtual Window Using Curtains and Image Projectionsugiuralab
 
スマートフォンを用いた新生児あやし動作の教示システム
スマートフォンを用いた新生児あやし動作の教示システムスマートフォンを用いた新生児あやし動作の教示システム
スマートフォンを用いた新生児あやし動作の教示システムsugiuralab
 
指側面を入力インタフェース化するリング型デバイス
指側面を入力インタフェース化するリング型デバイス指側面を入力インタフェース化するリング型デバイス
指側面を入力インタフェース化するリング型デバイスsugiuralab
 
ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識sugiuralab
 
磁石内臓イヤリングによる磁力変化を利用したジェスチャ識別
磁石内臓イヤリングによる磁力変化を利用したジェスチャ識別磁石内臓イヤリングによる磁力変化を利用したジェスチャ識別
磁石内臓イヤリングによる磁力変化を利用したジェスチャ識別sugiuralab
 
Maintenance-Free Smart Hand Dynamometer.pdf
Maintenance-Free Smart Hand Dynamometer.pdfMaintenance-Free Smart Hand Dynamometer.pdf
Maintenance-Free Smart Hand Dynamometer.pdfsugiuralab
 
Augmented Sports of Badminton by Changing Opening Status of Shuttle’s Feathers
Augmented Sports of Badminton by Changing Opening Status of Shuttle’s FeathersAugmented Sports of Badminton by Changing Opening Status of Shuttle’s Feathers
Augmented Sports of Badminton by Changing Opening Status of Shuttle’s Featherssugiuralab
 
指腹開放型入力デバイス における文字ジェスチャ識別
指腹開放型入力デバイス における文字ジェスチャ識別指腹開放型入力デバイス における文字ジェスチャ識別
指腹開放型入力デバイス における文字ジェスチャ識別sugiuralab
 
Carpal Tunnel Syndrome Estimation through Median Nerve Segmentation in Ultr...
Carpal Tunnel Syndrome Estimation  through Median Nerve Segmentation  in Ultr...Carpal Tunnel Syndrome Estimation  through Median Nerve Segmentation  in Ultr...
Carpal Tunnel Syndrome Estimation through Median Nerve Segmentation in Ultr...sugiuralab
 
静電容量の測定による畳のタッチセンサ化手法の提案
静電容量の測定による畳のタッチセンサ化手法の提案静電容量の測定による畳のタッチセンサ化手法の提案
静電容量の測定による畳のタッチセンサ化手法の提案sugiuralab
 
Virtual IMU Data Augmentation by Spring-Joint Model for Motion Exercises Reco...
Virtual IMU Data Augmentation by Spring-Joint Model for Motion Exercises Reco...Virtual IMU Data Augmentation by Spring-Joint Model for Motion Exercises Reco...
Virtual IMU Data Augmentation by Spring-Joint Model for Motion Exercises Reco...sugiuralab
 

More from sugiuralab (20)

Converting Tatamis into Touch Sensors by Measuring Capacitance
Converting Tatamis into Touch Sensors by Measuring CapacitanceConverting Tatamis into Touch Sensors by Measuring Capacitance
Converting Tatamis into Touch Sensors by Measuring Capacitance
 
Pinch Force Measurement Using a Geomagnetic Sensor
Pinch Force Measurement Using a Geomagnetic SensorPinch Force Measurement Using a Geomagnetic Sensor
Pinch Force Measurement Using a Geomagnetic Sensor
 
Smartphone-Based Teaching System for Neonate Soothing Motions
Smartphone-Based Teaching System for Neonate Soothing MotionsSmartphone-Based Teaching System for Neonate Soothing Motions
Smartphone-Based Teaching System for Neonate Soothing Motions
 
Tactile Presentation of Orchestral Conductor's Motion Trajectory
Tactile Presentation of Orchestral Conductor's Motion TrajectoryTactile Presentation of Orchestral Conductor's Motion Trajectory
Tactile Presentation of Orchestral Conductor's Motion Trajectory
 
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
 
Seeing the Wind: An Interactive Mist Interface for Airflow Input
Seeing the Wind: An Interactive Mist Interface for Airflow InputSeeing the Wind: An Interactive Mist Interface for Airflow Input
Seeing the Wind: An Interactive Mist Interface for Airflow Input
 
Identification and Authentication Using Clavicles
Identification and Authentication Using ClaviclesIdentification and Authentication Using Clavicles
Identification and Authentication Using Clavicles
 
Estimation of Violin Bow Pressure Using Photo-Reflective Sensors
Estimation of Violin Bow Pressure Using Photo-Reflective SensorsEstimation of Violin Bow Pressure Using Photo-Reflective Sensors
Estimation of Violin Bow Pressure Using Photo-Reflective Sensors
 
バウンサーを動かす外付けデバイス
バウンサーを動かす外付けデバイスバウンサーを動かす外付けデバイス
バウンサーを動かす外付けデバイス
 
A Virtual Window Using Curtains and Image Projection
A Virtual Window Using Curtains and Image ProjectionA Virtual Window Using Curtains and Image Projection
A Virtual Window Using Curtains and Image Projection
 
スマートフォンを用いた新生児あやし動作の教示システム
スマートフォンを用いた新生児あやし動作の教示システムスマートフォンを用いた新生児あやし動作の教示システム
スマートフォンを用いた新生児あやし動作の教示システム
 
指側面を入力インタフェース化するリング型デバイス
指側面を入力インタフェース化するリング型デバイス指側面を入力インタフェース化するリング型デバイス
指側面を入力インタフェース化するリング型デバイス
 
ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
 
磁石内臓イヤリングによる磁力変化を利用したジェスチャ識別
磁石内臓イヤリングによる磁力変化を利用したジェスチャ識別磁石内臓イヤリングによる磁力変化を利用したジェスチャ識別
磁石内臓イヤリングによる磁力変化を利用したジェスチャ識別
 
Maintenance-Free Smart Hand Dynamometer.pdf
Maintenance-Free Smart Hand Dynamometer.pdfMaintenance-Free Smart Hand Dynamometer.pdf
Maintenance-Free Smart Hand Dynamometer.pdf
 
Augmented Sports of Badminton by Changing Opening Status of Shuttle’s Feathers
Augmented Sports of Badminton by Changing Opening Status of Shuttle’s FeathersAugmented Sports of Badminton by Changing Opening Status of Shuttle’s Feathers
Augmented Sports of Badminton by Changing Opening Status of Shuttle’s Feathers
 
指腹開放型入力デバイス における文字ジェスチャ識別
指腹開放型入力デバイス における文字ジェスチャ識別指腹開放型入力デバイス における文字ジェスチャ識別
指腹開放型入力デバイス における文字ジェスチャ識別
 
Carpal Tunnel Syndrome Estimation through Median Nerve Segmentation in Ultr...
Carpal Tunnel Syndrome Estimation  through Median Nerve Segmentation  in Ultr...Carpal Tunnel Syndrome Estimation  through Median Nerve Segmentation  in Ultr...
Carpal Tunnel Syndrome Estimation through Median Nerve Segmentation in Ultr...
 
静電容量の測定による畳のタッチセンサ化手法の提案
静電容量の測定による畳のタッチセンサ化手法の提案静電容量の測定による畳のタッチセンサ化手法の提案
静電容量の測定による畳のタッチセンサ化手法の提案
 
Virtual IMU Data Augmentation by Spring-Joint Model for Motion Exercises Reco...
Virtual IMU Data Augmentation by Spring-Joint Model for Motion Exercises Reco...Virtual IMU Data Augmentation by Spring-Joint Model for Motion Exercises Reco...
Virtual IMU Data Augmentation by Spring-Joint Model for Motion Exercises Reco...
 

Recently uploaded

Microservices: Benefits, drawbacks and are they for me?
Microservices: Benefits, drawbacks and are they for me?Microservices: Benefits, drawbacks and are they for me?
Microservices: Benefits, drawbacks and are they for me?Marian Marinov
 
S. Kim, NeurIPS 2023, MLILAB, KAISTAI
S. Kim,  NeurIPS 2023,  MLILAB,  KAISTAIS. Kim,  NeurIPS 2023,  MLILAB,  KAISTAI
S. Kim, NeurIPS 2023, MLILAB, KAISTAIMLILAB
 
Model Approved Food/ sanitary Grade Flow Meter
Model Approved Food/ sanitary Grade Flow MeterModel Approved Food/ sanitary Grade Flow Meter
Model Approved Food/ sanitary Grade Flow MeterManasMicrosystems
 
chap. 3. lipid deterioration oil and fat processign
chap. 3. lipid deterioration oil and fat processignchap. 3. lipid deterioration oil and fat processign
chap. 3. lipid deterioration oil and fat processignteddymebratie
 
Nexus - Final Day 12th February 2024.pptx
Nexus - Final Day 12th February 2024.pptxNexus - Final Day 12th February 2024.pptx
Nexus - Final Day 12th February 2024.pptxRohanAgarwal340656
 
Series of training sessions by our experts for you to provide necessary insig...
Series of training sessions by our experts for you to provide necessary insig...Series of training sessions by our experts for you to provide necessary insig...
Series of training sessions by our experts for you to provide necessary insig...AshishChanchal1
 
POST HARVEST Threshing equipment PPT 2.pptx
POST HARVEST Threshing equipment PPT 2.pptxPOST HARVEST Threshing equipment PPT 2.pptx
POST HARVEST Threshing equipment PPT 2.pptxARUL S
 
PM24_Oral_Presentation_Template_Guidelines.pptx
PM24_Oral_Presentation_Template_Guidelines.pptxPM24_Oral_Presentation_Template_Guidelines.pptx
PM24_Oral_Presentation_Template_Guidelines.pptxnissamant
 
Robust, Precise, Fast - Chose Two for Radiated EMC Measurements!
Robust, Precise, Fast - Chose Two for Radiated EMC Measurements!Robust, Precise, Fast - Chose Two for Radiated EMC Measurements!
Robust, Precise, Fast - Chose Two for Radiated EMC Measurements!Mathias Magdowski
 
Paper Machine Troubleshooting manual for paper makers
Paper Machine Troubleshooting manual for paper makersPaper Machine Troubleshooting manual for paper makers
Paper Machine Troubleshooting manual for paper makersNomanKhan691800
 
Pointers and Array, pointer and String.pptx
Pointers and Array, pointer and String.pptxPointers and Array, pointer and String.pptx
Pointers and Array, pointer and String.pptxAnanthi Palanisamy
 
MedTech R&D - Tamer Emara - resume @2024
MedTech R&D - Tamer Emara - resume @2024MedTech R&D - Tamer Emara - resume @2024
MedTech R&D - Tamer Emara - resume @2024Tamer Emara
 
Microstructure of Hadfield Steels (Robert Hadfield)
Microstructure of Hadfield Steels (Robert Hadfield)Microstructure of Hadfield Steels (Robert Hadfield)
Microstructure of Hadfield Steels (Robert Hadfield)MANICKAVASAHAM G
 
Beyond Words: Journey into Large Language Models(LLMs) - Day-1
Beyond Words: Journey into Large Language Models(LLMs) - Day-1Beyond Words: Journey into Large Language Models(LLMs) - Day-1
Beyond Words: Journey into Large Language Models(LLMs) - Day-1SahithiGurlinka
 
Checklist to troubleshoot CD moisture profiles.docx
Checklist to troubleshoot CD moisture profiles.docxChecklist to troubleshoot CD moisture profiles.docx
Checklist to troubleshoot CD moisture profiles.docxNomanKhan691800
 
ExtraordinAIre Monthly Newsletter Jan 2024
ExtraordinAIre Monthly Newsletter Jan 2024ExtraordinAIre Monthly Newsletter Jan 2024
ExtraordinAIre Monthly Newsletter Jan 2024Savipriya Raghavendra
 
Introduction and replication to DragonflyDB
Introduction and replication to DragonflyDBIntroduction and replication to DragonflyDB
Introduction and replication to DragonflyDBMarian Marinov
 
Introduction to Machine Learning Unit-1 Notes for II-II Mechanical Engineerin...
Introduction to Machine Learning Unit-1 Notes for II-II Mechanical Engineerin...Introduction to Machine Learning Unit-1 Notes for II-II Mechanical Engineerin...
Introduction to Machine Learning Unit-1 Notes for II-II Mechanical Engineerin...C Sai Kiran
 
INTERACTIVE AQUATIC MUSEUM AT BAGH IBN QASIM CLIFTON KARACHI
INTERACTIVE AQUATIC MUSEUM AT BAGH IBN QASIM CLIFTON KARACHIINTERACTIVE AQUATIC MUSEUM AT BAGH IBN QASIM CLIFTON KARACHI
INTERACTIVE AQUATIC MUSEUM AT BAGH IBN QASIM CLIFTON KARACHIKiranKandhro1
 

Recently uploaded (20)

Microservices: Benefits, drawbacks and are they for me?
Microservices: Benefits, drawbacks and are they for me?Microservices: Benefits, drawbacks and are they for me?
Microservices: Benefits, drawbacks and are they for me?
 
S. Kim, NeurIPS 2023, MLILAB, KAISTAI
S. Kim,  NeurIPS 2023,  MLILAB,  KAISTAIS. Kim,  NeurIPS 2023,  MLILAB,  KAISTAI
S. Kim, NeurIPS 2023, MLILAB, KAISTAI
 
Model Approved Food/ sanitary Grade Flow Meter
Model Approved Food/ sanitary Grade Flow MeterModel Approved Food/ sanitary Grade Flow Meter
Model Approved Food/ sanitary Grade Flow Meter
 
chap. 3. lipid deterioration oil and fat processign
chap. 3. lipid deterioration oil and fat processignchap. 3. lipid deterioration oil and fat processign
chap. 3. lipid deterioration oil and fat processign
 
Nexus - Final Day 12th February 2024.pptx
Nexus - Final Day 12th February 2024.pptxNexus - Final Day 12th February 2024.pptx
Nexus - Final Day 12th February 2024.pptx
 
Series of training sessions by our experts for you to provide necessary insig...
Series of training sessions by our experts for you to provide necessary insig...Series of training sessions by our experts for you to provide necessary insig...
Series of training sessions by our experts for you to provide necessary insig...
 
Présentation de F. Joudelat Congrès IIRB février 2024
Présentation de F. Joudelat Congrès IIRB février 2024Présentation de F. Joudelat Congrès IIRB février 2024
Présentation de F. Joudelat Congrès IIRB février 2024
 
POST HARVEST Threshing equipment PPT 2.pptx
POST HARVEST Threshing equipment PPT 2.pptxPOST HARVEST Threshing equipment PPT 2.pptx
POST HARVEST Threshing equipment PPT 2.pptx
 
PM24_Oral_Presentation_Template_Guidelines.pptx
PM24_Oral_Presentation_Template_Guidelines.pptxPM24_Oral_Presentation_Template_Guidelines.pptx
PM24_Oral_Presentation_Template_Guidelines.pptx
 
Robust, Precise, Fast - Chose Two for Radiated EMC Measurements!
Robust, Precise, Fast - Chose Two for Radiated EMC Measurements!Robust, Precise, Fast - Chose Two for Radiated EMC Measurements!
Robust, Precise, Fast - Chose Two for Radiated EMC Measurements!
 
Paper Machine Troubleshooting manual for paper makers
Paper Machine Troubleshooting manual for paper makersPaper Machine Troubleshooting manual for paper makers
Paper Machine Troubleshooting manual for paper makers
 
Pointers and Array, pointer and String.pptx
Pointers and Array, pointer and String.pptxPointers and Array, pointer and String.pptx
Pointers and Array, pointer and String.pptx
 
MedTech R&D - Tamer Emara - resume @2024
MedTech R&D - Tamer Emara - resume @2024MedTech R&D - Tamer Emara - resume @2024
MedTech R&D - Tamer Emara - resume @2024
 
Microstructure of Hadfield Steels (Robert Hadfield)
Microstructure of Hadfield Steels (Robert Hadfield)Microstructure of Hadfield Steels (Robert Hadfield)
Microstructure of Hadfield Steels (Robert Hadfield)
 
Beyond Words: Journey into Large Language Models(LLMs) - Day-1
Beyond Words: Journey into Large Language Models(LLMs) - Day-1Beyond Words: Journey into Large Language Models(LLMs) - Day-1
Beyond Words: Journey into Large Language Models(LLMs) - Day-1
 
Checklist to troubleshoot CD moisture profiles.docx
Checklist to troubleshoot CD moisture profiles.docxChecklist to troubleshoot CD moisture profiles.docx
Checklist to troubleshoot CD moisture profiles.docx
 
ExtraordinAIre Monthly Newsletter Jan 2024
ExtraordinAIre Monthly Newsletter Jan 2024ExtraordinAIre Monthly Newsletter Jan 2024
ExtraordinAIre Monthly Newsletter Jan 2024
 
Introduction and replication to DragonflyDB
Introduction and replication to DragonflyDBIntroduction and replication to DragonflyDB
Introduction and replication to DragonflyDB
 
Introduction to Machine Learning Unit-1 Notes for II-II Mechanical Engineerin...
Introduction to Machine Learning Unit-1 Notes for II-II Mechanical Engineerin...Introduction to Machine Learning Unit-1 Notes for II-II Mechanical Engineerin...
Introduction to Machine Learning Unit-1 Notes for II-II Mechanical Engineerin...
 
INTERACTIVE AQUATIC MUSEUM AT BAGH IBN QASIM CLIFTON KARACHI
INTERACTIVE AQUATIC MUSEUM AT BAGH IBN QASIM CLIFTON KARACHIINTERACTIVE AQUATIC MUSEUM AT BAGH IBN QASIM CLIFTON KARACHI
INTERACTIVE AQUATIC MUSEUM AT BAGH IBN QASIM CLIFTON KARACHI
 

Video-Based Hand Tracking for Screening Cervical Myelopathy (ISVC2021)

  • 1. Video-Based Hand Tracking for Screening Cervical Myelopathy 16th International Symposium on Visual Computing (ISVC 2021) October 6th, 2021 Ryota Matsui1, Takafumi Koyama 2, Koji Fujita2, Hideo Saito 1, and Yuta Sugiura 1 1 Keio University 2 Tokyo Medical and Dental University
  • 2. • Spinal cord: a part of central nervous system • CM: pathology of compressed cervical spinal cord • Cause various symptoms • Upper limb disorders • Gait disturbance 2 [1] OrthoInfo: Spine Basics. https://orthoinfo.aaos.org/en/diseases--conditions/spine-basics/. (accessed Sep. 26th, 2021) [2] Cook, C., et al.: Reliability and diagnostic accuracy of clinical special tests for myelopathy in patients seen for cervical dysfunction. The Journal of Orthopaedic and Sports Physical Therapy 39(3), 172–178 (2009). Cervical Myelopathy (CM) Human spine [1] Compressed spinal cord [2]
  • 3. • A common screening method for CM • Repeat gripping/releasing one’s hand as quickly as possible for 10 sec • Be screened as a CM patient if the repetition count is approx. less than 20 • The simplicity is a big advantage. 3 [3] Ono, K., et al.: Myelopathy hand. New clinical signs of cervical cord damage. The Journal of Bone and Joint Surgery, British Volume 69(2), 215–219 (1987). 10-sec Grip and Release (G&R) Test [3] Image of G&R movement
  • 4. • Track the G&R movement to screen CM automatically • Non-contact hand tracking with a Leap Motion Controller (LMC) [4] • A random forest classifier • A glove-like sensing device [5] • Fluctuation of sensor values • Cycle of the G&R movement 4 [4] Watanabe, M., et al.: Detection of cervical myelopathy with Leap Motion Sensor by random forests. IEEE LifeTech 2020, 214–216 (2020). [5] Su, X.J., et al.: Clinical application of a new assessment tool for myelopathy hand using virtual reality. Spine 45(24), E1645–E1652 (2020). Expansion of G&R Test Track G&R movement with an LMC [4] Track G&R movement with the glove-like device [5]
  • 5. • Screen symptoms of various diseases with a camera • Parkinson’s disease (PD) [6] • Changes in the ability to move face • Amyotrophic lateral sclerosis (ALS) [7] • Use a depth camera • Facial movements affected by ALS 5 [6] Gomez, L.F., et al.: Improving Parkinson detection using dynamic features from evoked expressions in video. CVPR 2021, 1562–1570 (2021). [7] Bandini, A., et al.: Automatic detection of amyotrophic lateral sclerosis (ALS) from video-based analysis of facial movements: Speech and non-speech tasks. FG 2018, 150–157 (2018). Video-Based Screening Methods Flow of screening PD [6] Feature points obtained to screen ALS [7]
  • 6. • An automatic CM screening method with a camera • The main contributions • Achieve high screening performance • Machine learning-based classification without any qualitative indexes 6 Overview of This Work Record G&R test with a camera Image processing for hand tracking Flow of our method
  • 7. • The front camera of a smartphone is used. • Frame rate of the videos: 30 fps • Flow of the recording • Hold a hand above the smartphone • Start the G&R test • It is recorded as a video until the following two conditions are met: • The repetition count reaches 20. • The recording time exceeds 10 sec. 7 Record G&R Test with Camera Video of recording G&R test
  • 8. • MediaPipe Hands [8] is used to track the recorded G&R movement. • MediaPipe: an image-processing framework provided by Google • Estimate 21 three-dimensional positions as the feature values • 3 × 21 = 63 dimensions 8 Image Processing for Hand Tracking – Estimation Image processing with MediaPipe [8] [8] Google: MediaPipe. https://mediapipe.dev/. (accessed Sep. 26th, 2021) Estimated 21 positions
  • 9. • Change the coordinate system • Before: camera coordinate system (𝑥, 𝑦) • After: hand-based (𝑥’, 𝑦’) • Improve the robustness against the relative direction of cameras and hands • Introduce the velocity components • The difference of the positions between the adjacent video frames • 63 + 63 = 126 dimensions 9 Image Processing for Hand Tracking – Adjustment Change of coordinate system
  • 10. • Divide the time-series data into 20 segments • To align the length of each data • The length of each segment is approx. 2 sec. • The adjacent segments may be overlapped if the data is short. • To obtain segments of the stabilized length 10 Pre-processing – Data Segmentation Segmentation of time-series data
  • 11. • Conversion to frequency components for each dimension • The G&R movement can be regarded as a periodic movement. • 32 frequency components • 32 components × 126 dimensions = 4,032 elements for each segment 11 Pre-processing – Fast Fourier Transform Flow of fast Fourier transform
  • 12. • Merge segments of the multiple G&R trials • If we take multiple trials to screen CM • Each of 20 segments are distinguished. • Use these 20 segments as the inputs to the screening classifier 12 Pre-processing – Merging Data Image of merging data
  • 13. • A support vector machine classifier to classify each segment • CM patient group • Control group • Each of 20 segments is classified independently each other. • The average of the 20 classifications is used as the screening result. 13 Two-Class Classification Image of two-class classification
  • 14. • Record the G&R tests of 35 participants • Each participant was recorded twice: the right hand and the left hand. • 2 × 35 = 70 videos • All participants were right-handed. • 10-fold cross-validation with these 70 videos • The split was per participant. 14 CM patient group Male CM patient group Female Control group Male Control group Female Number of participants 10 10 8 7 Mean age 66.8 71.6 57.9 64.9 SD of age 7.9 11.1 14.4 12.2 Overview of Experiments Participant information
  • 15. • Sensitivity • 𝑇𝑃 𝑇𝑃+𝐹𝑁 • Specificity • 𝑇𝑁 𝑇𝑁+𝐹𝑃 • AUC (area under the curve) • ROC curve: relationship between sensitivity and specificity expressed as a graph • AUC: area under the ROC curve 15 Evaluation Indexes Positive / Patient True positive (𝑇𝑃) False positive (𝐹𝑃) Negative / Control False negative (𝐹𝑁) True negative (𝑇𝑁) Positive / Patient Negative / Control Actual label Predicted label Confusion matrix ROC curve and AUC
  • 16. • Validate the evaluation indexes for the selected combinations of feature values • To select mainly contributed feature values for the classification • Four points of each finger • Fingertip and each joint of five fingers • Fingertip • DIP joint • PIP joint • MCP joint 16 [9] Bullock, I.M., et al.: Assessing assumptions in kinematic hand models: A review. IEEE BioRob 2012, 139–146 (2012). Validation for Each Feature Value – Overview Estimated 21 positions Finger joints [9]
  • 17. • The tendency to show relatively high AUC • Fingers of the thumb side • Joints of the wrist side • Same sensitivity and specificity for all combinations • Sensitivity: 0.900 • Specificity: 0.867 • Select feature values for high AUC • Thumb and index finger • PIP and MCP joints 17 Validation for Each Feature Value – Results AUC Thumb 0.907 Index finger 0.900 Middle finger 0.877 Ring finger 0.853 Little finger 0.870 AUC Fingertip 0.880 DIP joint 0.867 PIP joint 0.910 MCP joint 0.930 AUC for each finger AUC for fingertip and each joint [9] Bullock, I.M., et al.: Assessing assumptions in kinematic hand models: A review. IEEE BioRob 2012, 139–146 (2012). Finger joints [9]
  • 18. • Validate under the following three conditions • Use videos of both hands • Use video of right/left hand • Validation with right hands showed relatively high performance. • C.f. all participants were right-handed. 18 Validation for Selected Feature Values Sensitivity, specificity, and AUCs ROC curve for right hand ROC curve for left hand
  • 19. • Higher than other CM screening methods • Potential to be used in actual medical settings as the new CM screening method 19 [5] Su, X.J., et al.: Clinical application of a new assessment tool for myelopathy hand using virtual reality. Spine 45(24), E1645–E1652 (2020). [10] Machino, M., et al.: : Cut off value in each gender and decade of 10-s grip and release and 10-s step test: A comparative study between 454 patients with cervical spondylotic myelopathy and 818 healthy subjects. Clinical Neurology and Neurosurgery (2019). Comparison with Other Screening Methods Screening Method Sensitivity Specificity AUC The 10-s G&R test [10] 0.703–0.821 0.429–0.740 0.647–0.890 The glove-like device [5] 0.8673 0.86 0.929 Our method 0.900 0.933 0.947 Comparison of screening performance G&R test Glove-like device [5] Our method
  • 20. Limitations • Focus only on hand disorders, a symptom of CM • Do not take other pathologies/diseases into account Future work • Apply to other pathologies/diseases which cause hand disorders • E.g., carpal tunnel syndrome • Apply to actual medical settings • As the initial screening method used by local doctors and care workers 20 Limitations and Future Work
  • 21. 21 Summary Background The 10-sec G&R test to screen cervical myelopathy (CM) Related work Track the G&R movement to screen CM automatically Suggestion Use videos of the G&R movement to screen CM Method Classify feature values of the G&R movement Evaluation Cross-validation with videos of 35 participants Results Sensitivity: 0.900 Specificity: 0.933 AUC: 0.947 Limitations Focus only on hand disorders, a symptom of CM Future works Apply our method to the actual medical settings