SlideShare a Scribd company logo
Building the NINAPRO Database:
A Resource for the Biorobotics Community
           1Manfredo Atzori, 2Arjan Gijsberts, 3Simone Heynen,
 3Anne-Gabrielle Mittaz Hager, 4Olivier Deriaz, 5Patrick van der Smagt,
      5Claudio Castellini, 2Barbara Caputo, and 1Henning Müller




            1Dept.     Business Information Systems, HES-SO Valais, Switzerland
                              2 Institute de Recherche Idiap, Switzerland
                 3 Department of Physical Therapy, HES-SO Valais, Switzerland
                  4 Institut de recherche en réadaptation, Suvacare, Switzerland
    5 Institute of Robotics and Mechatronics, DLR (German Aerospace Centre), Germany
1. Introduction: what is electromyography
Electromyography (EMG) is the measurement of electrical activity
that creates muscle contractions


The signal path:

•  Originates in a motor neuron

•  Travels to the target muscle(s)

•  Starts a series of electrochemical changes that leads to an
   action potential

•  Is detected by one or more electrodes


(Jessica Zarndt, The Muscle Physiology of Electromyography, UNLV)   2
1. Introduction: electromyography controlled prosthetics
•    2-3 degrees of freedom
•    Few programmed movements
•    Very coarse force control
•    No dexterous control
•    No natural Control
•    Long training times



In contrast to recent advances in
mechatronics



                                                       3
1. Introduction: sEMG Data Bases



•  NO large scale public sEMG databases, only private ones
  (Fukuda, 2003; Tsuji 1993; Ferguson, 2002; Zecca, 2002; Chan, 2005; Sebelius, 2005;
  Castellini, 2008; Jiang, 2009; Tenore, 2009; Castellini, 2009)


•  NO common sEMG acquisition protocol

•  NO common sEMG storage protocol




                                                                                   4
1. Introduction: project motivations & goals
•  Creation and refinement of the acquisition protocol

•  Acquisition of the database

•  Public release of the database

•  Worldwide test of classification algorithms




  •  Augment dexterity of sEMG prostheses

  •  Reduce training time
                                                         5
2. Database: acquisition setup (1)

         Laptop: Dell Latitude E5520
    !




         Digital Acquisition Card: National Instruments 6023E

         sEMG Electrodes: 10 double-differential Otto Bock 13E200
     !




         Printed Circuit Board, Cables & Connectors
     !




         Data Glove 22 sensors Cyberglove II (Cyberglove Systems)

         Inclinometer: Kübler 8.IS40.2341
                                                                6
2. Database: acquisition setup (2)
1.  8 equally spaced electrodes
2.  2 electrodes on finger flexor and extensor muscles
3.  Two axes inclinometer

4.  Data glove




                                                         7
3. Methods: acquisition procedure
Intact subjects:
•  The subject is asked to repeat what is shown on the screen
   with the right hand.

Amputated subjects:
•  The subject is asked to think to repeat what is shown on the
   screen with both hands.
•  In the meanwhile the subject needs to do the same movement
   with remaining hand.




                                                             8
2. Database: movements
Exercise 1                                                                                                                     Hato, 2004
12 movements       !               !                   !               !                   !               !                   Sebelius, 2005
                                                                                                                               Farrel, 2008
                   !               !                   !               !                   !               !
                                                                                                                               Crawford, 2005
                                                                                                                               Feix, 2008
Exercise 2
17 movements   !               !           !               !               !           !       !               !
                                                                                                                               DASH Score



                   !               !               !                   !




                   !               !               !                   !                   !



Exercise 3
23 movements
                           !                   !                   !               !                   !           !       !                    !




                       !               !                           !           !                       !               !
                                                                                                                                                !



                       !               !                       !               !                   !               !       !
                                                                                                                                            !       9
2. Database: data
Data stored for each subject:
•  One XML file with clinical and experimental information
•  Unprocessed data (sEMG, Cyberglove, Inclinometer, Movie)
•  One preview picture for each exercise
•  One picture of the arm without the acquisition setup
•  One picture of the arm with the acquisition setup on

Subjects:
•  Currently stored: 27 intact subjects
•  To be acquired: ~100 intact subjects
                   ~40 amputated subjects

                                                              10
2. Database: public, with web interface
url: http://ninapro.hevs.ch




                                          11
3. Analysis: evaluation of the acquisition protocol
•  Principal Component Analysis
   data that is easily separable visually will often also be easy to
   classify

•  Classification
   idea of how discriminative the sEMG signals are for
   movements and subjects


•  Groups of subjects: 1, 8, 27 subject


•  Sets of movements: 3, 11, 52 movements


                                                                 12
3. Analysis: preprocessing
1.  Synchronization: linear interpolation of all data at 100Hz
2.  Filtering of sEMG signals: Butterworth, zero-phase, 1Hz,
    second order
3.  Segmenting: each movement (including rest) is divided into
    three equal parts
4.  The data contained in the central segment is averaged for
    each electrode




    1        2                3                 4
                                                                 13
3. Analysis: Principal Component Analysis
Two principal components for each of the nine cases considered

•  Movements are easy to distinguish in cases with few subjects
   and few movements.
•  Overlap increases combining data from multiple subjects
•  Overlap increases increasing the number of movements.




                                                             14
3. Analysis: Quantitative classification performance
Intra-subject classification:
•  Multi-class LS-SVM with RBF kernel is trained for each subject
•  Training: 5 movement repetitions
•  Test: 5 movement repetitions
•  Experiment repeated 25 times with different random splits

Inter-subject classification:
•  Multi-class LS-SVM with RBF kernel is trained for each subject
•  Training: 5 movement repetitions of one subject
•  Test: 5 movement repetitions of each of all the other subjects
•  Experiment repeated 25 times with different random splits

                                                               15
3. Analysis: LS-SVM Results
Intra-subject classification:
•  Errors from 7.5% to 20%
•  High standard deviation (performance variability among
   different subjects)
Inter-subject classification:
•  Only marginally above chance level




                                                            16
5. Conclusions:
Database
•  Acquisition setup: portable, based on scientific research and
   industrial application needs
•  Acquisition protocol: complete and easy to be reproduced
•  Movements: 52, selected from the scientific literature
•  Data: currently 27 intact subjects are stored

Data Analysis & Evaluation
•  PCA: movements are easy to distinguish in cases with few
   movements and few subjects
•  Intra-subject classification: results comparable to those found
   in the literature with the same number of movements
•  Inter-subject classification: classification slightly above chance
   level
                                                                  17
5. Future Work:
•  Establishing a standard benchmark

•  Collecting data from a large number of movements

Add a custom-built force-sensing device to acquire dynamic
finger/hand/wrist data.


•  Collecting data from a large number subjects

Further releases of the database will contain data recorded from a
larger number of subjects.


                                                               18
THANKS FOR THE ATTENTION
Please, cite:
Manfredo Atzori, Arjan Gijsberts, Simone Heynen, Anne-Gabrielle Mittaz
Hager, Olivier Deriaz, Patrick Vand der Smagt, Claudio Castellini, Barbara
Caputo and Henning Müller, Building the NINAPRO Database: A Resource
for the Biorobotics Community, in: Proceedings of the IEEE International
Conference on Biomedical Robotics and Biomechatronics, Rome, 2012

Full publication:
http://publications.hevs.ch/index.php/publications/show/1172


                            For more information:
                    http://www.idiap.ch/project/ninapro/
                            http://ninapro.hevs.ch

                                Contacts:
                         manfredo.atzori@hevs.ch

More Related Content

Similar to Building the NINAPRO Database: A Resource for the Biorobotics Community

Classification of indoor actions through deep neural networks
Classification of indoor actions through deep neural networksClassification of indoor actions through deep neural networks
Classification of indoor actions through deep neural networks
Cognitive Robotics and Social Sensing Lab - CNR - ICAR
 
Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...
Dr. Vinayak Bharadi
 
PiP Poster PDF
PiP Poster PDFPiP Poster PDF
PiP Poster PDF
Bijan Mohazab
 
Bci
BciBci
Bci
BciBci
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGSEVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
Aksw Group
 
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
InsideScientific
 
Too good to be true? How validate your data
Too good to be true? How validate your dataToo good to be true? How validate your data
Too good to be true? How validate your data
Alex Henderson
 
Brain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and ProjectsBrain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and Projects
stephen whitmarsh
 
Smart Room Gesture Control
Smart Room Gesture ControlSmart Room Gesture Control
Smart Room Gesture Control
Giwrgos Paraskevopoulos
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with R
Akira Murakami
 
Cshl minseqe 2013_ouellette
Cshl minseqe 2013_ouelletteCshl minseqe 2013_ouellette
Cshl minseqe 2013_ouellette
Functional Genomics Data Society
 
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
huguk
 
Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptor
Soma Boubou
 
Digitizing documents to provide a public spectroscopy database
Digitizing documents to provide a public spectroscopy databaseDigitizing documents to provide a public spectroscopy database
Digitizing documents to provide a public spectroscopy database
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
Neuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis WorkshopNeuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis Workshop
MBF Bioscience
 
กระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศกระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศ
ABELE Snvip
 
OpenRepGrid and Friends
OpenRepGrid and FriendsOpenRepGrid and Friends
OpenRepGrid and Friends
Mark Heckmann
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with R
Akira Murakami
 
Wits presentation 6_28072015
Wits presentation 6_28072015Wits presentation 6_28072015
Wits presentation 6_28072015
Beatrice van Eden
 

Similar to Building the NINAPRO Database: A Resource for the Biorobotics Community (20)

Classification of indoor actions through deep neural networks
Classification of indoor actions through deep neural networksClassification of indoor actions through deep neural networks
Classification of indoor actions through deep neural networks
 
Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...
 
PiP Poster PDF
PiP Poster PDFPiP Poster PDF
PiP Poster PDF
 
Bci
BciBci
Bci
 
Bci
BciBci
Bci
 
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGSEVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
 
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
 
Too good to be true? How validate your data
Too good to be true? How validate your dataToo good to be true? How validate your data
Too good to be true? How validate your data
 
Brain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and ProjectsBrain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and Projects
 
Smart Room Gesture Control
Smart Room Gesture ControlSmart Room Gesture Control
Smart Room Gesture Control
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with R
 
Cshl minseqe 2013_ouellette
Cshl minseqe 2013_ouelletteCshl minseqe 2013_ouellette
Cshl minseqe 2013_ouellette
 
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
 
Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptor
 
Digitizing documents to provide a public spectroscopy database
Digitizing documents to provide a public spectroscopy databaseDigitizing documents to provide a public spectroscopy database
Digitizing documents to provide a public spectroscopy database
 
Neuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis WorkshopNeuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis Workshop
 
กระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศกระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศ
 
OpenRepGrid and Friends
OpenRepGrid and FriendsOpenRepGrid and Friends
OpenRepGrid and Friends
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with R
 
Wits presentation 6_28072015
Wits presentation 6_28072015Wits presentation 6_28072015
Wits presentation 6_28072015
 

More from Institute of Information Systems (HES-SO)

MIE20232.pptx
MIE20232.pptxMIE20232.pptx
Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...
Institute of Information Systems (HES-SO)
 
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Institute of Information Systems (HES-SO)
 
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Institute of Information Systems (HES-SO)
 
L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?
Institute of Information Systems (HES-SO)
 
Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...
Institute of Information Systems (HES-SO)
 
Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...
Institute of Information Systems (HES-SO)
 
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Institute of Information Systems (HES-SO)
 
Le système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesLe système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodes
Institute of Information Systems (HES-SO)
 
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair AccessibilityCrowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
Institute of Information Systems (HES-SO)
 
Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?
Institute of Information Systems (HES-SO)
 
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
Institute of Information Systems (HES-SO)
 
Challenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL modelChallenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL model
Institute of Information Systems (HES-SO)
 
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesNOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
Institute of Information Systems (HES-SO)
 
Medical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructuresMedical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructures
Institute of Information Systems (HES-SO)
 
Medical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructuresMedical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructures
Institute of Information Systems (HES-SO)
 
How to detect soft falls on devices
How to detect soft falls on devicesHow to detect soft falls on devices
How to detect soft falls on devices
Institute of Information Systems (HES-SO)
 
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSISFUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
Institute of Information Systems (HES-SO)
 
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLSMOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
Institute of Information Systems (HES-SO)
 
Enhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET projectEnhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET project
Institute of Information Systems (HES-SO)
 

More from Institute of Information Systems (HES-SO) (20)

MIE20232.pptx
MIE20232.pptxMIE20232.pptx
MIE20232.pptx
 
Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...
 
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
 
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
 
L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?
 
Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...
 
Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...
 
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
 
Le système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesLe système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodes
 
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair AccessibilityCrowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
 
Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?
 
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
 
Challenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL modelChallenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL model
 
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesNOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
 
Medical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructuresMedical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructures
 
Medical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructuresMedical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructures
 
How to detect soft falls on devices
How to detect soft falls on devicesHow to detect soft falls on devices
How to detect soft falls on devices
 
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSISFUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
 
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLSMOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
 
Enhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET projectEnhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET project
 

Recently uploaded

PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Zilliz
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 

Recently uploaded (20)

PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 

Building the NINAPRO Database: A Resource for the Biorobotics Community

  • 1. Building the NINAPRO Database: A Resource for the Biorobotics Community 1Manfredo Atzori, 2Arjan Gijsberts, 3Simone Heynen, 3Anne-Gabrielle Mittaz Hager, 4Olivier Deriaz, 5Patrick van der Smagt, 5Claudio Castellini, 2Barbara Caputo, and 1Henning Müller 1Dept. Business Information Systems, HES-SO Valais, Switzerland 2 Institute de Recherche Idiap, Switzerland 3 Department of Physical Therapy, HES-SO Valais, Switzerland 4 Institut de recherche en réadaptation, Suvacare, Switzerland 5 Institute of Robotics and Mechatronics, DLR (German Aerospace Centre), Germany
  • 2. 1. Introduction: what is electromyography Electromyography (EMG) is the measurement of electrical activity that creates muscle contractions The signal path: •  Originates in a motor neuron •  Travels to the target muscle(s) •  Starts a series of electrochemical changes that leads to an action potential •  Is detected by one or more electrodes (Jessica Zarndt, The Muscle Physiology of Electromyography, UNLV) 2
  • 3. 1. Introduction: electromyography controlled prosthetics •  2-3 degrees of freedom •  Few programmed movements •  Very coarse force control •  No dexterous control •  No natural Control •  Long training times In contrast to recent advances in mechatronics 3
  • 4. 1. Introduction: sEMG Data Bases •  NO large scale public sEMG databases, only private ones (Fukuda, 2003; Tsuji 1993; Ferguson, 2002; Zecca, 2002; Chan, 2005; Sebelius, 2005; Castellini, 2008; Jiang, 2009; Tenore, 2009; Castellini, 2009) •  NO common sEMG acquisition protocol •  NO common sEMG storage protocol 4
  • 5. 1. Introduction: project motivations & goals •  Creation and refinement of the acquisition protocol •  Acquisition of the database •  Public release of the database •  Worldwide test of classification algorithms •  Augment dexterity of sEMG prostheses •  Reduce training time 5
  • 6. 2. Database: acquisition setup (1) Laptop: Dell Latitude E5520 ! Digital Acquisition Card: National Instruments 6023E sEMG Electrodes: 10 double-differential Otto Bock 13E200 ! Printed Circuit Board, Cables & Connectors ! Data Glove 22 sensors Cyberglove II (Cyberglove Systems) Inclinometer: Kübler 8.IS40.2341 6
  • 7. 2. Database: acquisition setup (2) 1.  8 equally spaced electrodes 2.  2 electrodes on finger flexor and extensor muscles 3.  Two axes inclinometer 4.  Data glove 7
  • 8. 3. Methods: acquisition procedure Intact subjects: •  The subject is asked to repeat what is shown on the screen with the right hand. Amputated subjects: •  The subject is asked to think to repeat what is shown on the screen with both hands. •  In the meanwhile the subject needs to do the same movement with remaining hand. 8
  • 9. 2. Database: movements Exercise 1 Hato, 2004 12 movements ! ! ! ! ! ! Sebelius, 2005 Farrel, 2008 ! ! ! ! ! ! Crawford, 2005 Feix, 2008 Exercise 2 17 movements ! ! ! ! ! ! ! ! DASH Score ! ! ! ! ! ! ! ! ! Exercise 3 23 movements ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! 9
  • 10. 2. Database: data Data stored for each subject: •  One XML file with clinical and experimental information •  Unprocessed data (sEMG, Cyberglove, Inclinometer, Movie) •  One preview picture for each exercise •  One picture of the arm without the acquisition setup •  One picture of the arm with the acquisition setup on Subjects: •  Currently stored: 27 intact subjects •  To be acquired: ~100 intact subjects ~40 amputated subjects 10
  • 11. 2. Database: public, with web interface url: http://ninapro.hevs.ch 11
  • 12. 3. Analysis: evaluation of the acquisition protocol •  Principal Component Analysis data that is easily separable visually will often also be easy to classify •  Classification idea of how discriminative the sEMG signals are for movements and subjects •  Groups of subjects: 1, 8, 27 subject •  Sets of movements: 3, 11, 52 movements 12
  • 13. 3. Analysis: preprocessing 1.  Synchronization: linear interpolation of all data at 100Hz 2.  Filtering of sEMG signals: Butterworth, zero-phase, 1Hz, second order 3.  Segmenting: each movement (including rest) is divided into three equal parts 4.  The data contained in the central segment is averaged for each electrode 1 2 3 4 13
  • 14. 3. Analysis: Principal Component Analysis Two principal components for each of the nine cases considered •  Movements are easy to distinguish in cases with few subjects and few movements. •  Overlap increases combining data from multiple subjects •  Overlap increases increasing the number of movements. 14
  • 15. 3. Analysis: Quantitative classification performance Intra-subject classification: •  Multi-class LS-SVM with RBF kernel is trained for each subject •  Training: 5 movement repetitions •  Test: 5 movement repetitions •  Experiment repeated 25 times with different random splits Inter-subject classification: •  Multi-class LS-SVM with RBF kernel is trained for each subject •  Training: 5 movement repetitions of one subject •  Test: 5 movement repetitions of each of all the other subjects •  Experiment repeated 25 times with different random splits 15
  • 16. 3. Analysis: LS-SVM Results Intra-subject classification: •  Errors from 7.5% to 20% •  High standard deviation (performance variability among different subjects) Inter-subject classification: •  Only marginally above chance level 16
  • 17. 5. Conclusions: Database •  Acquisition setup: portable, based on scientific research and industrial application needs •  Acquisition protocol: complete and easy to be reproduced •  Movements: 52, selected from the scientific literature •  Data: currently 27 intact subjects are stored Data Analysis & Evaluation •  PCA: movements are easy to distinguish in cases with few movements and few subjects •  Intra-subject classification: results comparable to those found in the literature with the same number of movements •  Inter-subject classification: classification slightly above chance level 17
  • 18. 5. Future Work: •  Establishing a standard benchmark •  Collecting data from a large number of movements Add a custom-built force-sensing device to acquire dynamic finger/hand/wrist data. •  Collecting data from a large number subjects Further releases of the database will contain data recorded from a larger number of subjects. 18
  • 19. THANKS FOR THE ATTENTION Please, cite: Manfredo Atzori, Arjan Gijsberts, Simone Heynen, Anne-Gabrielle Mittaz Hager, Olivier Deriaz, Patrick Vand der Smagt, Claudio Castellini, Barbara Caputo and Henning Müller, Building the NINAPRO Database: A Resource for the Biorobotics Community, in: Proceedings of the IEEE International Conference on Biomedical Robotics and Biomechatronics, Rome, 2012 Full publication: http://publications.hevs.ch/index.php/publications/show/1172 For more information: http://www.idiap.ch/project/ninapro/ http://ninapro.hevs.ch Contacts: manfredo.atzori@hevs.ch