Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

(2012) Whats missing in biometric testing

989 views

Published on

Panel presentation on "What is missing in Biometric Testing". Other panel presentations are available on the NIST IBPC website.

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

(2012) Whats missing in biometric testing

  1. 1. BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation BIOMETRIC TESTING – PANEL DISCUSSION STEPHEN ELLIOTT IPBC 2012 – 3/7/2012
  2. 2. BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation WHAT IS MISSING IN BIOMETRIC TESTING
  3. 3. BIOMETRIC TESTING • Traditional biometric testing – Algorithm testing • Well established metrics • Well understood testing methodologies • Operational testing – Harder to do • Access to environments • Test methodologies dependent in some cases on the test
  4. 4. TESTING AND EVALUATION • Essentially trying to understand how a system performs – Maybe more fundamentally – who or what is causing the errors
  5. 5. BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation PROBABLY NOT MISSING, BUT HARD TO DO
  6. 6. GAPS IN BIOMETRIC TESTING • There have been several papers on the contribution of individual error on performance – What causes these errors? • There are some papers that examine meta-data and the contribution of variables (age) and examines the training of algorithms
  7. 7. GAPS IN BIOMETRIC TESTING • Training – How do users get accustomed to devices – Can they remember how to use them – How do we provide good training to the users that has a consistent message
  8. 8. GAPS IN BIOMETRIC TESTING • Accessibility – How many people know people (!) who have problems with interacting with a biometric systems – How do we deal with accessibility and usability issues • Hearing and sight issues
  9. 9. GAPS IN BIOMETRIC TESTING • Human Factors – Testing and evaluating biometric systems by looking at how the users interact with the system • Are performance results different in an operational environment than collect in a lab? • Are these performance results due to the environment?
  10. 10. GAPS IN BIOMETRIC TESTING • It the error always subject centric? – The role of the device? – The role of the operator?
  11. 11. BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation FILLING IN THOSE GAPS
  12. 12. WORK IN PROGRESS • Interaction methodologies such as HBSI have been addressing issues such as interaction errors from the subject perspective • Developed a framework for the establishment of metrics • Continual work on defining those metrics • Evaluation methodology
  13. 13. INTERACTION
  14. 14. AND MY TIME IS UP… • An additional presentation on the Evolution of the HBSI model is tomorrow.

×