SlideShare a Scribd company logo
Picturesque

CAPTCHA for Mobile Devices
Design Problem




CAPTCHAs are difficult to interpret

                                      And they are difficult to type
Design Problem


                 Mobile internet users are
                 prompted to solve the same
                 text-based CAPTCHAs used
                 on desktop computers, but it
                 has been found that mobile
                 devices are poorly suited for
                 solving these text-based
                 CAPTCHA tests
Solution



           An image based CAPTCHA that does
            not require keyboard based input
User Needs


   “..should be
   easy to
   understand”
User Needs


   “..should be
   easy to
   understand”
Goals
  Typing on mobile
devices is hard, so no
more keyboard based
        input


                         Design
                         Goals
Goals
    Typing on mobile
  devices is hard, so no
  more keyboard based
          input


                                    Design
                                    Goals




Should take less than a minute to
              solve
Goals
    Typing on mobile
  devices is hard, so no
  more keyboard based
          input


                                    Design   Must be highly secure
                                    Goals     to avoid any SPAM
                                                     attack




Should take less than a minute to
              solve
Contextual Inquiry & Sketches
We chose few representative tasks in which CAPTCHAs are
generally encountered (for example user registration) and
asked our test users to complete those tasks
Contextual Inquiry & Sketches
We chose few representative tasks in which CAPTCHAs are
generally encountered (for example user registration) and
asked our test users to complete those tasks




 As a result of contextual inquiry, we conducted a brainstorming session to
 sketch three concepts for our design
Paper Prototypes
Evaluated all the three sketches rigorously keeping in mind the
design goals & user needs and as a result of evaluation one of
the three concepts was chosen for paper prototypes



                                      Design for our paper prototype
                                        consisted of two steps, first
                                       users had to identify images
                                       from specific category and
                                          then they had trace the
                                       outline of identified image
Design Iteration
Based on the results from user studies, we realized image
tracing is neither fast nor obvious




           Choosing images is much more easier from user standpoint
Interactive Prototype: Design



                        Two grids of 9 images in
                            3-by-3 format
Interactive Prototype: Design

User is asked to select
images from a specific
category, such as Eiffel
                           Two grids of 9 images in
Tower, Lions, or Shoes
                               3-by-3 format
Interactive Prototype: Design

User is asked to select
images from a specific
category, such as Eiffel
                            Two grids of 9 images in
Tower, Lions, or Shoes
                                3-by-3 format




User has to select images
   that are related to
chosen category to pass
         the test
User Studies




                             Extensive study with 61
                             subjects using Amazon
 An in-person study with 6      Mechanical Turk
           users




                                            Image: http://www.flickr.com/photos/leeander/4132537169/
User Study Results
Both studies compared our Picturesque
technique to reCAPTCHA, a common text-
based CAPTCHA

Based on the results, we observed that time
completion rate for a task of Picturesque was
better than reCAPTCHA task in most of the
cases
Picturesque: Final Design
                        # of images that needs to
                          be selected in a grid is
                         randomly chosen to be
                               either 4 or 5
Picturesque: Final Design
                        # of images that needs to
                          be selected in a grid is
                         randomly chosen to be
                               either 4 or 5




                        Placement of the images
                              is random
Picturesque: Final Design
                                                         # of images that needs to
                                                           be selected in a grid is
                                                          randomly chosen to be
                                                                either 4 or 5




                                                         Placement of the images
                                                               is random




Two grids of nine images are necessary from security perspective
Thank You!




Team Members: Dhawal Mujumdar | Alex Smolen | Becky Hurwitz

More Related Content

Similar to Picturesque

Rapid object detection using boosted cascade of simple features
Rapid object detection using boosted  cascade of simple featuresRapid object detection using boosted  cascade of simple features
Rapid object detection using boosted cascade of simple features
Hirantha Pradeep
 
"How To Race Squirrels" at Develop Conference in Brighton, 21st July 2011
"How To Race Squirrels" at Develop Conference in Brighton, 21st July 2011"How To Race Squirrels" at Develop Conference in Brighton, 21st July 2011
"How To Race Squirrels" at Develop Conference in Brighton, 21st July 2011
Playniac
 
16 OpenCV Functions to Start your Computer Vision journey.docx
16 OpenCV Functions to Start your Computer Vision journey.docx16 OpenCV Functions to Start your Computer Vision journey.docx
16 OpenCV Functions to Start your Computer Vision journey.docx
ssuser90e017
 
Robust face name graph matching for movie character identification - Final PPT
 Robust face name graph matching for movie character identification - Final PPT Robust face name graph matching for movie character identification - Final PPT
Robust face name graph matching for movie character identification - Final PPT
Priyadarshini Dasarathan
 
PhotoSketch: Internet Image Montage
PhotoSketch: Internet Image MontagePhotoSketch: Internet Image Montage
PhotoSketch: Internet Image Montage
diTii
 
PhotoSketch: Internet Image Montage
PhotoSketch: Internet Image MontagePhotoSketch: Internet Image Montage
PhotoSketch: Internet Image Montage
diTii
 
19BCS1815_PresentationAutomatic Number Plate Recognition(ANPR)P.pptx
19BCS1815_PresentationAutomatic Number Plate Recognition(ANPR)P.pptx19BCS1815_PresentationAutomatic Number Plate Recognition(ANPR)P.pptx
19BCS1815_PresentationAutomatic Number Plate Recognition(ANPR)P.pptx
SamridhGarg
 

Similar to Picturesque (20)

Computer Vision - Real Time Face Recognition using Open CV and Python
Computer Vision - Real Time Face Recognition using Open CV and PythonComputer Vision - Real Time Face Recognition using Open CV and Python
Computer Vision - Real Time Face Recognition using Open CV and Python
 
AISF19 - Unleash Computer Vision at the Edge
AISF19 - Unleash Computer Vision at the EdgeAISF19 - Unleash Computer Vision at the Edge
AISF19 - Unleash Computer Vision at the Edge
 
Rapid object detection using boosted cascade of simple features
Rapid object detection using boosted  cascade of simple featuresRapid object detection using boosted  cascade of simple features
Rapid object detection using boosted cascade of simple features
 
ppt 20BET1024.pptx
ppt 20BET1024.pptxppt 20BET1024.pptx
ppt 20BET1024.pptx
 
Final Report on Optical Character Recognition
Final Report on Optical Character Recognition Final Report on Optical Character Recognition
Final Report on Optical Character Recognition
 
Graphical password authentication
Graphical password authenticationGraphical password authentication
Graphical password authentication
 
"How To Race Squirrels" at Develop Conference in Brighton, 21st July 2011
"How To Race Squirrels" at Develop Conference in Brighton, 21st July 2011"How To Race Squirrels" at Develop Conference in Brighton, 21st July 2011
"How To Race Squirrels" at Develop Conference in Brighton, 21st July 2011
 
Computer vision-nit-silchar-hackathon
Computer vision-nit-silchar-hackathonComputer vision-nit-silchar-hackathon
Computer vision-nit-silchar-hackathon
 
Scalable image recognition model with deep embedding
Scalable image recognition model with deep embeddingScalable image recognition model with deep embedding
Scalable image recognition model with deep embedding
 
Automated_attendance_system_project.pptx
Automated_attendance_system_project.pptxAutomated_attendance_system_project.pptx
Automated_attendance_system_project.pptx
 
16 OpenCV Functions to Start your Computer Vision journey.docx
16 OpenCV Functions to Start your Computer Vision journey.docx16 OpenCV Functions to Start your Computer Vision journey.docx
16 OpenCV Functions to Start your Computer Vision journey.docx
 
Robust face name graph matching for movie character identification - Final PPT
 Robust face name graph matching for movie character identification - Final PPT Robust face name graph matching for movie character identification - Final PPT
Robust face name graph matching for movie character identification - Final PPT
 
PhotoSketch: Internet Image Montage
PhotoSketch: Internet Image MontagePhotoSketch: Internet Image Montage
PhotoSketch: Internet Image Montage
 
PhotoSketch: Internet Image Montage
PhotoSketch: Internet Image MontagePhotoSketch: Internet Image Montage
PhotoSketch: Internet Image Montage
 
SeRanet introduction
SeRanet introductionSeRanet introduction
SeRanet introduction
 
19BCS1815_PresentationAutomatic Number Plate Recognition(ANPR)P.pptx
19BCS1815_PresentationAutomatic Number Plate Recognition(ANPR)P.pptx19BCS1815_PresentationAutomatic Number Plate Recognition(ANPR)P.pptx
19BCS1815_PresentationAutomatic Number Plate Recognition(ANPR)P.pptx
 
basics-of-computer-graphics-ppt.pdf
basics-of-computer-graphics-ppt.pdfbasics-of-computer-graphics-ppt.pdf
basics-of-computer-graphics-ppt.pdf
 
Final year ppt
Final year pptFinal year ppt
Final year ppt
 
Automated Face Detection System
Automated Face Detection SystemAutomated Face Detection System
Automated Face Detection System
 
Depth estimation using deep learning
Depth estimation using deep learningDepth estimation using deep learning
Depth estimation using deep learning
 

Recently uploaded

Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
UXDXConf
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 

Recently uploaded (20)

Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System Strategy
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
 
Strategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering TeamsStrategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering Teams
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty Secure
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 

Picturesque

  • 2. Design Problem CAPTCHAs are difficult to interpret And they are difficult to type
  • 3. Design Problem Mobile internet users are prompted to solve the same text-based CAPTCHAs used on desktop computers, but it has been found that mobile devices are poorly suited for solving these text-based CAPTCHA tests
  • 4. Solution An image based CAPTCHA that does not require keyboard based input
  • 5. User Needs “..should be easy to understand”
  • 6. User Needs “..should be easy to understand”
  • 7. Goals Typing on mobile devices is hard, so no more keyboard based input Design Goals
  • 8. Goals Typing on mobile devices is hard, so no more keyboard based input Design Goals Should take less than a minute to solve
  • 9. Goals Typing on mobile devices is hard, so no more keyboard based input Design Must be highly secure Goals to avoid any SPAM attack Should take less than a minute to solve
  • 10. Contextual Inquiry & Sketches We chose few representative tasks in which CAPTCHAs are generally encountered (for example user registration) and asked our test users to complete those tasks
  • 11. Contextual Inquiry & Sketches We chose few representative tasks in which CAPTCHAs are generally encountered (for example user registration) and asked our test users to complete those tasks As a result of contextual inquiry, we conducted a brainstorming session to sketch three concepts for our design
  • 12. Paper Prototypes Evaluated all the three sketches rigorously keeping in mind the design goals & user needs and as a result of evaluation one of the three concepts was chosen for paper prototypes Design for our paper prototype consisted of two steps, first users had to identify images from specific category and then they had trace the outline of identified image
  • 13. Design Iteration Based on the results from user studies, we realized image tracing is neither fast nor obvious Choosing images is much more easier from user standpoint
  • 14. Interactive Prototype: Design Two grids of 9 images in 3-by-3 format
  • 15. Interactive Prototype: Design User is asked to select images from a specific category, such as Eiffel Two grids of 9 images in Tower, Lions, or Shoes 3-by-3 format
  • 16. Interactive Prototype: Design User is asked to select images from a specific category, such as Eiffel Two grids of 9 images in Tower, Lions, or Shoes 3-by-3 format User has to select images that are related to chosen category to pass the test
  • 17. User Studies Extensive study with 61 subjects using Amazon An in-person study with 6 Mechanical Turk users Image: http://www.flickr.com/photos/leeander/4132537169/
  • 18. User Study Results Both studies compared our Picturesque technique to reCAPTCHA, a common text- based CAPTCHA Based on the results, we observed that time completion rate for a task of Picturesque was better than reCAPTCHA task in most of the cases
  • 19. Picturesque: Final Design # of images that needs to be selected in a grid is randomly chosen to be either 4 or 5
  • 20. Picturesque: Final Design # of images that needs to be selected in a grid is randomly chosen to be either 4 or 5 Placement of the images is random
  • 21. Picturesque: Final Design # of images that needs to be selected in a grid is randomly chosen to be either 4 or 5 Placement of the images is random Two grids of nine images are necessary from security perspective
  • 22. Thank You! Team Members: Dhawal Mujumdar | Alex Smolen | Becky Hurwitz