BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation...
BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation...
BIOMETRIC TESTING  • Traditional biometric testing     – Algorithm testing        • Well established metrics        • Well...
TESTING AND EVALUATION  • Essentially trying to understand how a    system performs    – Maybe more fundamentally – who or...
BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation...
GAPS IN BIOMETRIC TESTING   • There have been several papers on the     contribution of individual error on     performanc...
GAPS IN BIOMETRIC TESTING   • Training     – How do users get accustomed to devices     – Can they remember how to use the...
GAPS IN BIOMETRIC TESTING   • Accessibility      – How many people know people (!) who have        problems with interacti...
GAPS IN BIOMETRIC TESTING   • Human Factors     – Testing and evaluating biometric systems by       looking at how the use...
GAPS IN BIOMETRIC TESTING   • It the error always subject centric?      – The role of the device?      – The role of the o...
BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation...
WORK IN PROGRESS  • Interaction methodologies such as HBSI    have been addressing issues such as    interaction errors fr...
INTERACTION
AND MY TIME IS UP…   • An additional presentation on the     Evolution of the HBSI model is tomorrow.
Upcoming SlideShare
Loading in...5
×

(2012) Whats missing in biometric testing

850

Published on

Panel presentation on "What is missing in Biometric Testing". Other panel presentations are available on the NIST IBPC website.

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
850
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

(2012) Whats missing in biometric testing

  1. 1. BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation BIOMETRIC TESTING – PANEL DISCUSSION STEPHEN ELLIOTT IPBC 2012 – 3/7/2012
  2. 2. BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation WHAT IS MISSING IN BIOMETRIC TESTING
  3. 3. BIOMETRIC TESTING • Traditional biometric testing – Algorithm testing • Well established metrics • Well understood testing methodologies • Operational testing – Harder to do • Access to environments • Test methodologies dependent in some cases on the test
  4. 4. TESTING AND EVALUATION • Essentially trying to understand how a system performs – Maybe more fundamentally – who or what is causing the errors
  5. 5. BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation PROBABLY NOT MISSING, BUT HARD TO DO
  6. 6. GAPS IN BIOMETRIC TESTING • There have been several papers on the contribution of individual error on performance – What causes these errors? • There are some papers that examine meta-data and the contribution of variables (age) and examines the training of algorithms
  7. 7. GAPS IN BIOMETRIC TESTING • Training – How do users get accustomed to devices – Can they remember how to use them – How do we provide good training to the users that has a consistent message
  8. 8. GAPS IN BIOMETRIC TESTING • Accessibility – How many people know people (!) who have problems with interacting with a biometric systems – How do we deal with accessibility and usability issues • Hearing and sight issues
  9. 9. GAPS IN BIOMETRIC TESTING • Human Factors – Testing and evaluating biometric systems by looking at how the users interact with the system • Are performance results different in an operational environment than collect in a lab? • Are these performance results due to the environment?
  10. 10. GAPS IN BIOMETRIC TESTING • It the error always subject centric? – The role of the device? – The role of the operator?
  11. 11. BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation FILLING IN THOSE GAPS
  12. 12. WORK IN PROGRESS • Interaction methodologies such as HBSI have been addressing issues such as interaction errors from the subject perspective • Developed a framework for the establishment of metrics • Continual work on defining those metrics • Evaluation methodology
  13. 13. INTERACTION
  14. 14. AND MY TIME IS UP… • An additional presentation on the Evolution of the HBSI model is tomorrow.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×