SlideShare a Scribd company logo
1 of 19
Download to read offline
Building the NINAPRO Database:
A Resource for the Biorobotics Community
           1Manfredo Atzori, 2Arjan Gijsberts, 3Simone Heynen,
 3Anne-Gabrielle Mittaz Hager, 4Olivier Deriaz, 5Patrick van der Smagt,
      5Claudio Castellini, 2Barbara Caputo, and 1Henning Müller




            1Dept.     Business Information Systems, HES-SO Valais, Switzerland
                              2 Institute de Recherche Idiap, Switzerland
                 3 Department of Physical Therapy, HES-SO Valais, Switzerland
                  4 Institut de recherche en réadaptation, Suvacare, Switzerland
    5 Institute of Robotics and Mechatronics, DLR (German Aerospace Centre), Germany
1. Introduction: what is electromyography
Electromyography (EMG) is the measurement of electrical activity
that creates muscle contractions


The signal path:

•  Originates in a motor neuron

•  Travels to the target muscle(s)

•  Starts a series of electrochemical changes that leads to an
   action potential

•  Is detected by one or more electrodes


(Jessica Zarndt, The Muscle Physiology of Electromyography, UNLV)   2
1. Introduction: electromyography controlled prosthetics
•    2-3 degrees of freedom
•    Few programmed movements
•    Very coarse force control
•    No dexterous control
•    No natural Control
•    Long training times



In contrast to recent advances in
mechatronics



                                                       3
1. Introduction: sEMG Data Bases



•  NO large scale public sEMG databases, only private ones
  (Fukuda, 2003; Tsuji 1993; Ferguson, 2002; Zecca, 2002; Chan, 2005; Sebelius, 2005;
  Castellini, 2008; Jiang, 2009; Tenore, 2009; Castellini, 2009)


•  NO common sEMG acquisition protocol

•  NO common sEMG storage protocol




                                                                                   4
1. Introduction: project motivations & goals
•  Creation and refinement of the acquisition protocol

•  Acquisition of the database

•  Public release of the database

•  Worldwide test of classification algorithms




  •  Augment dexterity of sEMG prostheses

  •  Reduce training time
                                                         5
2. Database: acquisition setup (1)

         Laptop: Dell Latitude E5520
    !




         Digital Acquisition Card: National Instruments 6023E

         sEMG Electrodes: 10 double-differential Otto Bock 13E200
     !




         Printed Circuit Board, Cables & Connectors
     !




         Data Glove 22 sensors Cyberglove II (Cyberglove Systems)

         Inclinometer: Kübler 8.IS40.2341
                                                                6
2. Database: acquisition setup (2)
1.  8 equally spaced electrodes
2.  2 electrodes on finger flexor and extensor muscles
3.  Two axes inclinometer

4.  Data glove




                                                         7
3. Methods: acquisition procedure
Intact subjects:
•  The subject is asked to repeat what is shown on the screen
   with the right hand.

Amputated subjects:
•  The subject is asked to think to repeat what is shown on the
   screen with both hands.
•  In the meanwhile the subject needs to do the same movement
   with remaining hand.




                                                             8
2. Database: movements
Exercise 1                                                                                                                     Hato, 2004
12 movements       !               !                   !               !                   !               !                   Sebelius, 2005
                                                                                                                               Farrel, 2008
                   !               !                   !               !                   !               !
                                                                                                                               Crawford, 2005
                                                                                                                               Feix, 2008
Exercise 2
17 movements   !               !           !               !               !           !       !               !
                                                                                                                               DASH Score



                   !               !               !                   !




                   !               !               !                   !                   !



Exercise 3
23 movements
                           !                   !                   !               !                   !           !       !                    !




                       !               !                           !           !                       !               !
                                                                                                                                                !



                       !               !                       !               !                   !               !       !
                                                                                                                                            !       9
2. Database: data
Data stored for each subject:
•  One XML file with clinical and experimental information
•  Unprocessed data (sEMG, Cyberglove, Inclinometer, Movie)
•  One preview picture for each exercise
•  One picture of the arm without the acquisition setup
•  One picture of the arm with the acquisition setup on

Subjects:
•  Currently stored: 27 intact subjects
•  To be acquired: ~100 intact subjects
                   ~40 amputated subjects

                                                              10
2. Database: public, with web interface
url: http://ninapro.hevs.ch




                                          11
3. Analysis: evaluation of the acquisition protocol
•  Principal Component Analysis
   data that is easily separable visually will often also be easy to
   classify

•  Classification
   idea of how discriminative the sEMG signals are for
   movements and subjects


•  Groups of subjects: 1, 8, 27 subject


•  Sets of movements: 3, 11, 52 movements


                                                                 12
3. Analysis: preprocessing
1.  Synchronization: linear interpolation of all data at 100Hz
2.  Filtering of sEMG signals: Butterworth, zero-phase, 1Hz,
    second order
3.  Segmenting: each movement (including rest) is divided into
    three equal parts
4.  The data contained in the central segment is averaged for
    each electrode




    1        2                3                 4
                                                                 13
3. Analysis: Principal Component Analysis
Two principal components for each of the nine cases considered

•  Movements are easy to distinguish in cases with few subjects
   and few movements.
•  Overlap increases combining data from multiple subjects
•  Overlap increases increasing the number of movements.




                                                             14
3. Analysis: Quantitative classification performance
Intra-subject classification:
•  Multi-class LS-SVM with RBF kernel is trained for each subject
•  Training: 5 movement repetitions
•  Test: 5 movement repetitions
•  Experiment repeated 25 times with different random splits

Inter-subject classification:
•  Multi-class LS-SVM with RBF kernel is trained for each subject
•  Training: 5 movement repetitions of one subject
•  Test: 5 movement repetitions of each of all the other subjects
•  Experiment repeated 25 times with different random splits

                                                               15
3. Analysis: LS-SVM Results
Intra-subject classification:
•  Errors from 7.5% to 20%
•  High standard deviation (performance variability among
   different subjects)
Inter-subject classification:
•  Only marginally above chance level




                                                            16
5. Conclusions:
Database
•  Acquisition setup: portable, based on scientific research and
   industrial application needs
•  Acquisition protocol: complete and easy to be reproduced
•  Movements: 52, selected from the scientific literature
•  Data: currently 27 intact subjects are stored

Data Analysis & Evaluation
•  PCA: movements are easy to distinguish in cases with few
   movements and few subjects
•  Intra-subject classification: results comparable to those found
   in the literature with the same number of movements
•  Inter-subject classification: classification slightly above chance
   level
                                                                  17
5. Future Work:
•  Establishing a standard benchmark

•  Collecting data from a large number of movements

Add a custom-built force-sensing device to acquire dynamic
finger/hand/wrist data.


•  Collecting data from a large number subjects

Further releases of the database will contain data recorded from a
larger number of subjects.


                                                               18
THANKS FOR THE ATTENTION
Please, cite:
Manfredo Atzori, Arjan Gijsberts, Simone Heynen, Anne-Gabrielle Mittaz
Hager, Olivier Deriaz, Patrick Vand der Smagt, Claudio Castellini, Barbara
Caputo and Henning Müller, Building the NINAPRO Database: A Resource
for the Biorobotics Community, in: Proceedings of the IEEE International
Conference on Biomedical Robotics and Biomechatronics, Rome, 2012

Full publication:
http://publications.hevs.ch/index.php/publications/show/1172


                            For more information:
                    http://www.idiap.ch/project/ninapro/
                            http://ninapro.hevs.ch

                                Contacts:
                         manfredo.atzori@hevs.ch

More Related Content

Similar to Building the NINAPRO Database: A Resource for the Biorobotics Community

Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...Dr. Vinayak Bharadi
 
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGSEVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGSAksw Group
 
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...InsideScientific
 
Too good to be true? How validate your data
Too good to be true? How validate your dataToo good to be true? How validate your data
Too good to be true? How validate your dataAlex Henderson
 
Brain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and ProjectsBrain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and Projectsstephen whitmarsh
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with RAkira Murakami
 
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...huguk
 
Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorSoma Boubou
 
Neuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis WorkshopNeuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis WorkshopMBF Bioscience
 
กระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศกระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศABELE Snvip
 
OpenRepGrid and Friends
OpenRepGrid and FriendsOpenRepGrid and Friends
OpenRepGrid and FriendsMark Heckmann
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with RAkira Murakami
 
Wits presentation 6_28072015
Wits presentation 6_28072015Wits presentation 6_28072015
Wits presentation 6_28072015Beatrice van Eden
 

Similar to Building the NINAPRO Database: A Resource for the Biorobotics Community (20)

Classification of indoor actions through deep neural networks
Classification of indoor actions through deep neural networksClassification of indoor actions through deep neural networks
Classification of indoor actions through deep neural networks
 
Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...
 
PiP Poster PDF
PiP Poster PDFPiP Poster PDF
PiP Poster PDF
 
Bci
BciBci
Bci
 
Bci
BciBci
Bci
 
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGSEVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
 
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
 
Too good to be true? How validate your data
Too good to be true? How validate your dataToo good to be true? How validate your data
Too good to be true? How validate your data
 
Brain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and ProjectsBrain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and Projects
 
Smart Room Gesture Control
Smart Room Gesture ControlSmart Room Gesture Control
Smart Room Gesture Control
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with R
 
Cshl minseqe 2013_ouellette
Cshl minseqe 2013_ouelletteCshl minseqe 2013_ouellette
Cshl minseqe 2013_ouellette
 
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
 
Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptor
 
Digitizing documents to provide a public spectroscopy database
Digitizing documents to provide a public spectroscopy databaseDigitizing documents to provide a public spectroscopy database
Digitizing documents to provide a public spectroscopy database
 
Neuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis WorkshopNeuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis Workshop
 
กระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศกระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศ
 
OpenRepGrid and Friends
OpenRepGrid and FriendsOpenRepGrid and Friends
OpenRepGrid and Friends
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with R
 
Wits presentation 6_28072015
Wits presentation 6_28072015Wits presentation 6_28072015
Wits presentation 6_28072015
 

More from Institute of Information Systems (HES-SO)

Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Institute of Information Systems (HES-SO)
 
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Institute of Information Systems (HES-SO)
 
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Institute of Information Systems (HES-SO)
 
Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Institute of Information Systems (HES-SO)
 
Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Institute of Information Systems (HES-SO)
 
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Institute of Information Systems (HES-SO)
 
Le système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesLe système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesInstitute of Information Systems (HES-SO)
 
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...Institute of Information Systems (HES-SO)
 
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesNOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesInstitute of Information Systems (HES-SO)
 

More from Institute of Information Systems (HES-SO) (20)

MIE20232.pptx
MIE20232.pptxMIE20232.pptx
MIE20232.pptx
 
Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...
 
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
 
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
 
L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?
 
Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...
 
Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...
 
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
 
Le système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesLe système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodes
 
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair AccessibilityCrowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
 
Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?
 
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
 
Challenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL modelChallenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL model
 
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesNOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
 
Medical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructuresMedical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructures
 
Medical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructuresMedical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructures
 
How to detect soft falls on devices
How to detect soft falls on devicesHow to detect soft falls on devices
How to detect soft falls on devices
 
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSISFUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
 
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLSMOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
 
Enhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET projectEnhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET project
 

Recently uploaded

Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 

Recently uploaded (20)

Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 

Building the NINAPRO Database: A Resource for the Biorobotics Community

  • 1. Building the NINAPRO Database: A Resource for the Biorobotics Community 1Manfredo Atzori, 2Arjan Gijsberts, 3Simone Heynen, 3Anne-Gabrielle Mittaz Hager, 4Olivier Deriaz, 5Patrick van der Smagt, 5Claudio Castellini, 2Barbara Caputo, and 1Henning Müller 1Dept. Business Information Systems, HES-SO Valais, Switzerland 2 Institute de Recherche Idiap, Switzerland 3 Department of Physical Therapy, HES-SO Valais, Switzerland 4 Institut de recherche en réadaptation, Suvacare, Switzerland 5 Institute of Robotics and Mechatronics, DLR (German Aerospace Centre), Germany
  • 2. 1. Introduction: what is electromyography Electromyography (EMG) is the measurement of electrical activity that creates muscle contractions The signal path: •  Originates in a motor neuron •  Travels to the target muscle(s) •  Starts a series of electrochemical changes that leads to an action potential •  Is detected by one or more electrodes (Jessica Zarndt, The Muscle Physiology of Electromyography, UNLV) 2
  • 3. 1. Introduction: electromyography controlled prosthetics •  2-3 degrees of freedom •  Few programmed movements •  Very coarse force control •  No dexterous control •  No natural Control •  Long training times In contrast to recent advances in mechatronics 3
  • 4. 1. Introduction: sEMG Data Bases •  NO large scale public sEMG databases, only private ones (Fukuda, 2003; Tsuji 1993; Ferguson, 2002; Zecca, 2002; Chan, 2005; Sebelius, 2005; Castellini, 2008; Jiang, 2009; Tenore, 2009; Castellini, 2009) •  NO common sEMG acquisition protocol •  NO common sEMG storage protocol 4
  • 5. 1. Introduction: project motivations & goals •  Creation and refinement of the acquisition protocol •  Acquisition of the database •  Public release of the database •  Worldwide test of classification algorithms •  Augment dexterity of sEMG prostheses •  Reduce training time 5
  • 6. 2. Database: acquisition setup (1) Laptop: Dell Latitude E5520 ! Digital Acquisition Card: National Instruments 6023E sEMG Electrodes: 10 double-differential Otto Bock 13E200 ! Printed Circuit Board, Cables & Connectors ! Data Glove 22 sensors Cyberglove II (Cyberglove Systems) Inclinometer: Kübler 8.IS40.2341 6
  • 7. 2. Database: acquisition setup (2) 1.  8 equally spaced electrodes 2.  2 electrodes on finger flexor and extensor muscles 3.  Two axes inclinometer 4.  Data glove 7
  • 8. 3. Methods: acquisition procedure Intact subjects: •  The subject is asked to repeat what is shown on the screen with the right hand. Amputated subjects: •  The subject is asked to think to repeat what is shown on the screen with both hands. •  In the meanwhile the subject needs to do the same movement with remaining hand. 8
  • 9. 2. Database: movements Exercise 1 Hato, 2004 12 movements ! ! ! ! ! ! Sebelius, 2005 Farrel, 2008 ! ! ! ! ! ! Crawford, 2005 Feix, 2008 Exercise 2 17 movements ! ! ! ! ! ! ! ! DASH Score ! ! ! ! ! ! ! ! ! Exercise 3 23 movements ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! 9
  • 10. 2. Database: data Data stored for each subject: •  One XML file with clinical and experimental information •  Unprocessed data (sEMG, Cyberglove, Inclinometer, Movie) •  One preview picture for each exercise •  One picture of the arm without the acquisition setup •  One picture of the arm with the acquisition setup on Subjects: •  Currently stored: 27 intact subjects •  To be acquired: ~100 intact subjects ~40 amputated subjects 10
  • 11. 2. Database: public, with web interface url: http://ninapro.hevs.ch 11
  • 12. 3. Analysis: evaluation of the acquisition protocol •  Principal Component Analysis data that is easily separable visually will often also be easy to classify •  Classification idea of how discriminative the sEMG signals are for movements and subjects •  Groups of subjects: 1, 8, 27 subject •  Sets of movements: 3, 11, 52 movements 12
  • 13. 3. Analysis: preprocessing 1.  Synchronization: linear interpolation of all data at 100Hz 2.  Filtering of sEMG signals: Butterworth, zero-phase, 1Hz, second order 3.  Segmenting: each movement (including rest) is divided into three equal parts 4.  The data contained in the central segment is averaged for each electrode 1 2 3 4 13
  • 14. 3. Analysis: Principal Component Analysis Two principal components for each of the nine cases considered •  Movements are easy to distinguish in cases with few subjects and few movements. •  Overlap increases combining data from multiple subjects •  Overlap increases increasing the number of movements. 14
  • 15. 3. Analysis: Quantitative classification performance Intra-subject classification: •  Multi-class LS-SVM with RBF kernel is trained for each subject •  Training: 5 movement repetitions •  Test: 5 movement repetitions •  Experiment repeated 25 times with different random splits Inter-subject classification: •  Multi-class LS-SVM with RBF kernel is trained for each subject •  Training: 5 movement repetitions of one subject •  Test: 5 movement repetitions of each of all the other subjects •  Experiment repeated 25 times with different random splits 15
  • 16. 3. Analysis: LS-SVM Results Intra-subject classification: •  Errors from 7.5% to 20% •  High standard deviation (performance variability among different subjects) Inter-subject classification: •  Only marginally above chance level 16
  • 17. 5. Conclusions: Database •  Acquisition setup: portable, based on scientific research and industrial application needs •  Acquisition protocol: complete and easy to be reproduced •  Movements: 52, selected from the scientific literature •  Data: currently 27 intact subjects are stored Data Analysis & Evaluation •  PCA: movements are easy to distinguish in cases with few movements and few subjects •  Intra-subject classification: results comparable to those found in the literature with the same number of movements •  Inter-subject classification: classification slightly above chance level 17
  • 18. 5. Future Work: •  Establishing a standard benchmark •  Collecting data from a large number of movements Add a custom-built force-sensing device to acquire dynamic finger/hand/wrist data. •  Collecting data from a large number subjects Further releases of the database will contain data recorded from a larger number of subjects. 18
  • 19. THANKS FOR THE ATTENTION Please, cite: Manfredo Atzori, Arjan Gijsberts, Simone Heynen, Anne-Gabrielle Mittaz Hager, Olivier Deriaz, Patrick Vand der Smagt, Claudio Castellini, Barbara Caputo and Henning Müller, Building the NINAPRO Database: A Resource for the Biorobotics Community, in: Proceedings of the IEEE International Conference on Biomedical Robotics and Biomechatronics, Rome, 2012 Full publication: http://publications.hevs.ch/index.php/publications/show/1172 For more information: http://www.idiap.ch/project/ninapro/ http://ninapro.hevs.ch Contacts: manfredo.atzori@hevs.ch