SlideShare a Scribd company logo
1 of 22
Download to read offline
1




What is a usability test?
2




                Sit next to someone.
                    Watch. Listen.
Dana Chisnell
3




                  When
                  something
                  changes
                  Take
                  constraints
                  into account
Complement to     Reveal
  best practice   remedies
4




                   Hesitating
                   Comments
                   Questions
                   Body
                   language
What to look for   Behaviors
5




Ballot testing.



Dana Chisnell
The question
               6
7




The question
               How
               successfully
               do voters
               vote?
The plan
           8
9




                1 day
Dana Chisnell
10




             a ballot and instructions
Nancy Frishberg
11




                voter participants
Dana Chisnell
12




                observers
Dana Chisnell
13




results due: today
14
15
16




How we got value


 Used the ballots and instructions at hand

 Focused on one thing at a time

 Had participants generate and collect
  data

 Drafted observers and debriefed
17




                      1. Plan, minimally

                      2. Get the team on
                         board

                      3. Use the LEO Kit

                      4. Recruit
                         participants

                      5. Conduct
                         sessions


Follow these steps:   6. Debrief and
                         decide
18



Conduct
sessions
 Rehearse (P1)

 Checklist of tasks

 Short, focused sessions

 Adjust what you’re doing, if you
  need to




                                     Dana Chisnell
19




                  Greet the
                  participant

                  Explain the test,
                  your role, and
                  their role

                  Watch the voter
                  vote

                  Ask follow-up
                  questions

                  Debrief with
                  participant

Session outline   Debrief with
                  observers
20




                           Impartial,
                           unbiased
                           observing

                           No teaching!

                           Listen and watch

                           Ask open-ended
                           questions: Why?
Moderating, not training   How? What?
21



Debrief and
decide
 What could cause a recount?

 What could make it difficult to
  tell intent?

 What could draw unwanted
  attention?

 What could cost money if it is
  not fixed?


                                    Dana Chisnell
22




Resources

   • Usability Professionals’
     Association:
     www.usabilityprofessionals.org/

   • LEO Usability Testing Kit:
     www.usabilityprofessionals.org/
     civiclife/voting/leo_testing.html

   • Ballot Usability and Accessibility
     Blog: ballotusability.blogspot.com/

More Related Content

Similar to Chisnell Pew Ballot Testing 120908.Key

The Voice: Inspiring Peer-to-Peer Participants to Take Action BBCon 2012
The Voice: Inspiring Peer-to-Peer Participants to Take Action BBCon 2012The Voice: Inspiring Peer-to-Peer Participants to Take Action BBCon 2012
The Voice: Inspiring Peer-to-Peer Participants to Take Action BBCon 2012Charity Dynamics
 
Positive Deviance, Presentation at DwD by Erika Bailey
Positive Deviance, Presentation at DwD by Erika BaileyPositive Deviance, Presentation at DwD by Erika Bailey
Positive Deviance, Presentation at DwD by Erika BaileyThe Moment
 
Narejohr counselling_british council_feb-2012
Narejohr counselling_british council_feb-2012Narejohr counselling_british council_feb-2012
Narejohr counselling_british council_feb-2012Rahila Narejo
 
Nerd, Geek and Gear Herding: Technical Management Techniques for Managers v 2.0
Nerd, Geek and Gear Herding: Technical Management Techniques for Managers v 2.0Nerd, Geek and Gear Herding: Technical Management Techniques for Managers v 2.0
Nerd, Geek and Gear Herding: Technical Management Techniques for Managers v 2.0NTEN
 
Consulting 101
Consulting 101Consulting 101
Consulting 101skipangel
 
Visitor studies certificate 2011
Visitor studies certificate 2011Visitor studies certificate 2011
Visitor studies certificate 2011drealcohen
 
Neurocoaching Institute Behavior Based Safety Culture
Neurocoaching Institute Behavior Based Safety CultureNeurocoaching Institute Behavior Based Safety Culture
Neurocoaching Institute Behavior Based Safety CultureLuis Gaviria
 
Phystec Conference: The Gentle Art of Questioning. Writing Great Clicker Qu...
Phystec Conference:  The Gentle Art of Questioning.  Writing Great Clicker Qu...Phystec Conference:  The Gentle Art of Questioning.  Writing Great Clicker Qu...
Phystec Conference: The Gentle Art of Questioning. Writing Great Clicker Qu...Stephanie Chasteen
 
Eis simulation v2-team3-AFTI
Eis simulation v2-team3-AFTIEis simulation v2-team3-AFTI
Eis simulation v2-team3-AFTIteam3AFTI
 
Mindful social media final
Mindful social media finalMindful social media final
Mindful social media finalBeth Kanter
 
Complexity, Collaboration and Unconferencing
Complexity, Collaboration and UnconferencingComplexity, Collaboration and Unconferencing
Complexity, Collaboration and UnconferencingGeoff Brown
 
Writing great clicker questions
Writing great clicker questionsWriting great clicker questions
Writing great clicker questionsStephanie Chasteen
 
Actions first boosting impact of community health programs. september 26, 2012
Actions first boosting impact of community health programs. september 26, 2012Actions first boosting impact of community health programs. september 26, 2012
Actions first boosting impact of community health programs. september 26, 2012GHPN
 
Оксана Шатабилова. Предубеждения в тестировании. DataArt
Оксана Шатабилова. Предубеждения в тестировании. DataArtОксана Шатабилова. Предубеждения в тестировании. DataArt
Оксана Шатабилова. Предубеждения в тестировании. DataArtJuliaSmeshkova
 
Team development presentation
Team development presentationTeam development presentation
Team development presentationPhilip Corsano
 

Similar to Chisnell Pew Ballot Testing 120908.Key (20)

The Voice: Inspiring Peer-to-Peer Participants to Take Action BBCon 2012
The Voice: Inspiring Peer-to-Peer Participants to Take Action BBCon 2012The Voice: Inspiring Peer-to-Peer Participants to Take Action BBCon 2012
The Voice: Inspiring Peer-to-Peer Participants to Take Action BBCon 2012
 
Positive Deviance, Presentation at DwD by Erika Bailey
Positive Deviance, Presentation at DwD by Erika BaileyPositive Deviance, Presentation at DwD by Erika Bailey
Positive Deviance, Presentation at DwD by Erika Bailey
 
Narejohr counselling_british council_feb-2012
Narejohr counselling_british council_feb-2012Narejohr counselling_british council_feb-2012
Narejohr counselling_british council_feb-2012
 
Eye Tracking & Design
Eye Tracking & DesignEye Tracking & Design
Eye Tracking & Design
 
Nerd Herding v2
Nerd Herding  v2Nerd Herding  v2
Nerd Herding v2
 
Nerd, Geek and Gear Herding: Technical Management Techniques for Managers v 2.0
Nerd, Geek and Gear Herding: Technical Management Techniques for Managers v 2.0Nerd, Geek and Gear Herding: Technical Management Techniques for Managers v 2.0
Nerd, Geek and Gear Herding: Technical Management Techniques for Managers v 2.0
 
Consulting 101
Consulting 101Consulting 101
Consulting 101
 
Need a little usability?
Need a little usability?Need a little usability?
Need a little usability?
 
Visitor studies certificate 2011
Visitor studies certificate 2011Visitor studies certificate 2011
Visitor studies certificate 2011
 
Neurocoaching Institute Behavior Based Safety Culture
Neurocoaching Institute Behavior Based Safety CultureNeurocoaching Institute Behavior Based Safety Culture
Neurocoaching Institute Behavior Based Safety Culture
 
Phystec Conference: The Gentle Art of Questioning. Writing Great Clicker Qu...
Phystec Conference:  The Gentle Art of Questioning.  Writing Great Clicker Qu...Phystec Conference:  The Gentle Art of Questioning.  Writing Great Clicker Qu...
Phystec Conference: The Gentle Art of Questioning. Writing Great Clicker Qu...
 
Eis simulation v2-team3-AFTI
Eis simulation v2-team3-AFTIEis simulation v2-team3-AFTI
Eis simulation v2-team3-AFTI
 
Mindful social media final
Mindful social media finalMindful social media final
Mindful social media final
 
Complexity, Collaboration and Unconferencing
Complexity, Collaboration and UnconferencingComplexity, Collaboration and Unconferencing
Complexity, Collaboration and Unconferencing
 
Train the Trainer
Train the TrainerTrain the Trainer
Train the Trainer
 
Writing great clicker questions
Writing great clicker questionsWriting great clicker questions
Writing great clicker questions
 
Actions first boosting impact of community health programs. september 26, 2012
Actions first boosting impact of community health programs. september 26, 2012Actions first boosting impact of community health programs. september 26, 2012
Actions first boosting impact of community health programs. september 26, 2012
 
Оксана Шатабилова. Предубеждения в тестировании. DataArt
Оксана Шатабилова. Предубеждения в тестировании. DataArtОксана Шатабилова. Предубеждения в тестировании. DataArt
Оксана Шатабилова. Предубеждения в тестировании. DataArt
 
TIPS:observing peers teaching
TIPS:observing peers teachingTIPS:observing peers teaching
TIPS:observing peers teaching
 
Team development presentation
Team development presentationTeam development presentation
Team development presentation
 

More from Dana Chisnell

Next generation of civic designers
Next generation of civic designersNext generation of civic designers
Next generation of civic designersDana Chisnell
 
Making Voting Accessible
Making Voting Accessible Making Voting Accessible
Making Voting Accessible Dana Chisnell
 
Answering voters' questions at county election websites
Answering voters' questions at county election websites Answering voters' questions at county election websites
Answering voters' questions at county election websites Dana Chisnell
 
Fooled by best practice
Fooled by best practiceFooled by best practice
Fooled by best practiceDana Chisnell
 
Don't make me read! Less is more in information for voters
Don't make me read! Less is more in information for votersDon't make me read! Less is more in information for voters
Don't make me read! Less is more in information for votersDana Chisnell
 
I can't find what i'm looking for
I can't find what i'm looking forI can't find what i'm looking for
I can't find what i'm looking forDana Chisnell
 
Usability and security in future voting systems
Usability and security in future voting systemsUsability and security in future voting systems
Usability and security in future voting systemsDana Chisnell
 
Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants Dana Chisnell
 
Looking across the voter experience
Looking across the voter experienceLooking across the voter experience
Looking across the voter experienceDana Chisnell
 
Anywhere Ballot iterations
Anywhere Ballot iterationsAnywhere Ballot iterations
Anywhere Ballot iterationsDana Chisnell
 
Iterations paper prototype
Iterations   paper prototypeIterations   paper prototype
Iterations paper prototypeDana Chisnell
 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social webDana Chisnell
 
Usability of County Election Websites
Usability of County Election WebsitesUsability of County Election Websites
Usability of County Election WebsitesDana Chisnell
 
Usability and security in future voting systems
Usability and security in future voting systemsUsability and security in future voting systems
Usability and security in future voting systemsDana Chisnell
 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social webDana Chisnell
 
Making sense of the data
Making sense of the dataMaking sense of the data
Making sense of the dataDana Chisnell
 
The users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personasThe users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personasDana Chisnell
 
Democracy is a design problem
Democracy is a design problemDemocracy is a design problem
Democracy is a design problemDana Chisnell
 
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methodsCounter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methodsDana Chisnell
 

More from Dana Chisnell (20)

Next generation of civic designers
Next generation of civic designersNext generation of civic designers
Next generation of civic designers
 
Making Voting Accessible
Making Voting Accessible Making Voting Accessible
Making Voting Accessible
 
Answering voters' questions at county election websites
Answering voters' questions at county election websites Answering voters' questions at county election websites
Answering voters' questions at county election websites
 
Fooled by best practice
Fooled by best practiceFooled by best practice
Fooled by best practice
 
Don't make me read! Less is more in information for voters
Don't make me read! Less is more in information for votersDon't make me read! Less is more in information for voters
Don't make me read! Less is more in information for voters
 
I can't find what i'm looking for
I can't find what i'm looking forI can't find what i'm looking for
I can't find what i'm looking for
 
Usability and security in future voting systems
Usability and security in future voting systemsUsability and security in future voting systems
Usability and security in future voting systems
 
Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants
 
Looking across the voter experience
Looking across the voter experienceLooking across the voter experience
Looking across the voter experience
 
Anywhere Ballot iterations
Anywhere Ballot iterationsAnywhere Ballot iterations
Anywhere Ballot iterations
 
Iterations paper prototype
Iterations   paper prototypeIterations   paper prototype
Iterations paper prototype
 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social web
 
Persona modeler
Persona modelerPersona modeler
Persona modeler
 
Usability of County Election Websites
Usability of County Election WebsitesUsability of County Election Websites
Usability of County Election Websites
 
Usability and security in future voting systems
Usability and security in future voting systemsUsability and security in future voting systems
Usability and security in future voting systems
 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social web
 
Making sense of the data
Making sense of the dataMaking sense of the data
Making sense of the data
 
The users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personasThe users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personas
 
Democracy is a design problem
Democracy is a design problemDemocracy is a design problem
Democracy is a design problem
 
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methodsCounter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
 

Recently uploaded

BDSM⚡Call Girls in Greater Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Greater Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Greater Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Greater Noida Escorts >༒8448380779 Escort ServiceDelhi Call girls
 
Transformative Leadership: N Chandrababu Naidu and TDP's Vision for Innovatio...
Transformative Leadership: N Chandrababu Naidu and TDP's Vision for Innovatio...Transformative Leadership: N Chandrababu Naidu and TDP's Vision for Innovatio...
Transformative Leadership: N Chandrababu Naidu and TDP's Vision for Innovatio...srinuseo15
 
BDSM⚡Call Girls in Sector 143 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 143 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 143 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 143 Noida Escorts >༒8448380779 Escort ServiceDelhi Call girls
 
BDSM⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort ServiceDelhi Call girls
 
BDSM⚡Call Girls in Indirapuram Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Indirapuram Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Indirapuram Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Indirapuram Escorts >༒8448380779 Escort ServiceDelhi Call girls
 
04052024_First India Newspaper Jaipur.pdf
04052024_First India Newspaper Jaipur.pdf04052024_First India Newspaper Jaipur.pdf
04052024_First India Newspaper Jaipur.pdfFIRST INDIA
 
America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...
America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...
America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...Andy (Avraham) Blumenthal
 
Nurturing Families, Empowering Lives: TDP's Vision for Family Welfare in Andh...
Nurturing Families, Empowering Lives: TDP's Vision for Family Welfare in Andh...Nurturing Families, Empowering Lives: TDP's Vision for Family Welfare in Andh...
Nurturing Families, Empowering Lives: TDP's Vision for Family Welfare in Andh...narsireddynannuri1
 
Busty Desi⚡Call Girls in Sector 62 Noida Escorts >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Sector 62 Noida Escorts >༒8448380779 Escort ServiceBusty Desi⚡Call Girls in Sector 62 Noida Escorts >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Sector 62 Noida Escorts >༒8448380779 Escort ServiceDelhi Call girls
 
Group_5_US-China Trade War to understand the trade
Group_5_US-China Trade War to understand the tradeGroup_5_US-China Trade War to understand the trade
Group_5_US-China Trade War to understand the tradeRahatulAshafeen
 
{Qatar{^🚀^(+971558539980**}})Abortion Pills for Sale in Dubai. .abu dhabi, sh...
{Qatar{^🚀^(+971558539980**}})Abortion Pills for Sale in Dubai. .abu dhabi, sh...{Qatar{^🚀^(+971558539980**}})Abortion Pills for Sale in Dubai. .abu dhabi, sh...
{Qatar{^🚀^(+971558539980**}})Abortion Pills for Sale in Dubai. .abu dhabi, sh...hyt3577
 
Embed-2 (1).pdfb[k[k[[k[kkkpkdpokkdpkopko
Embed-2 (1).pdfb[k[k[[k[kkkpkdpokkdpkopkoEmbed-2 (1).pdfb[k[k[[k[kkkpkdpokkdpkopko
Embed-2 (1).pdfb[k[k[[k[kkkpkdpokkdpkopkobhavenpr
 
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 47 (Gurgaon)
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 47 (Gurgaon)Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 47 (Gurgaon)
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 47 (Gurgaon)Delhi Call girls
 
Enjoy Night⚡Call Girls Rajokri Delhi >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Rajokri Delhi >༒8448380779 Escort ServiceEnjoy Night⚡Call Girls Rajokri Delhi >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Rajokri Delhi >༒8448380779 Escort ServiceDelhi Call girls
 
AI as Research Assistant: Upscaling Content Analysis to Identify Patterns of ...
AI as Research Assistant: Upscaling Content Analysis to Identify Patterns of ...AI as Research Assistant: Upscaling Content Analysis to Identify Patterns of ...
AI as Research Assistant: Upscaling Content Analysis to Identify Patterns of ...Axel Bruns
 
Embed-4.pdf lkdiinlajeklhndklheduhuekjdh
Embed-4.pdf lkdiinlajeklhndklheduhuekjdhEmbed-4.pdf lkdiinlajeklhndklheduhuekjdh
Embed-4.pdf lkdiinlajeklhndklheduhuekjdhbhavenpr
 
05052024_First India Newspaper Jaipur.pdf
05052024_First India Newspaper Jaipur.pdf05052024_First India Newspaper Jaipur.pdf
05052024_First India Newspaper Jaipur.pdfFIRST INDIA
 
Busty Desi⚡Call Girls in Vasundhara Ghaziabad >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Vasundhara Ghaziabad >༒8448380779 Escort ServiceBusty Desi⚡Call Girls in Vasundhara Ghaziabad >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Vasundhara Ghaziabad >༒8448380779 Escort ServiceDelhi Call girls
 
Enjoy Night⚡Call Girls Iffco Chowk Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Iffco Chowk Gurgaon >༒8448380779 Escort ServiceEnjoy Night⚡Call Girls Iffco Chowk Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Iffco Chowk Gurgaon >༒8448380779 Escort ServiceDelhi Call girls
 
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 48 (Gurgaon)
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 48 (Gurgaon)Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 48 (Gurgaon)
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 48 (Gurgaon)Delhi Call girls
 

Recently uploaded (20)

BDSM⚡Call Girls in Greater Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Greater Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Greater Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Greater Noida Escorts >༒8448380779 Escort Service
 
Transformative Leadership: N Chandrababu Naidu and TDP's Vision for Innovatio...
Transformative Leadership: N Chandrababu Naidu and TDP's Vision for Innovatio...Transformative Leadership: N Chandrababu Naidu and TDP's Vision for Innovatio...
Transformative Leadership: N Chandrababu Naidu and TDP's Vision for Innovatio...
 
BDSM⚡Call Girls in Sector 143 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 143 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 143 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 143 Noida Escorts >༒8448380779 Escort Service
 
BDSM⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 135 Noida Escorts >༒8448380779 Escort Service
 
BDSM⚡Call Girls in Indirapuram Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Indirapuram Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Indirapuram Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Indirapuram Escorts >༒8448380779 Escort Service
 
04052024_First India Newspaper Jaipur.pdf
04052024_First India Newspaper Jaipur.pdf04052024_First India Newspaper Jaipur.pdf
04052024_First India Newspaper Jaipur.pdf
 
America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...
America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...
America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...
 
Nurturing Families, Empowering Lives: TDP's Vision for Family Welfare in Andh...
Nurturing Families, Empowering Lives: TDP's Vision for Family Welfare in Andh...Nurturing Families, Empowering Lives: TDP's Vision for Family Welfare in Andh...
Nurturing Families, Empowering Lives: TDP's Vision for Family Welfare in Andh...
 
Busty Desi⚡Call Girls in Sector 62 Noida Escorts >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Sector 62 Noida Escorts >༒8448380779 Escort ServiceBusty Desi⚡Call Girls in Sector 62 Noida Escorts >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Sector 62 Noida Escorts >༒8448380779 Escort Service
 
Group_5_US-China Trade War to understand the trade
Group_5_US-China Trade War to understand the tradeGroup_5_US-China Trade War to understand the trade
Group_5_US-China Trade War to understand the trade
 
{Qatar{^🚀^(+971558539980**}})Abortion Pills for Sale in Dubai. .abu dhabi, sh...
{Qatar{^🚀^(+971558539980**}})Abortion Pills for Sale in Dubai. .abu dhabi, sh...{Qatar{^🚀^(+971558539980**}})Abortion Pills for Sale in Dubai. .abu dhabi, sh...
{Qatar{^🚀^(+971558539980**}})Abortion Pills for Sale in Dubai. .abu dhabi, sh...
 
Embed-2 (1).pdfb[k[k[[k[kkkpkdpokkdpkopko
Embed-2 (1).pdfb[k[k[[k[kkkpkdpokkdpkopkoEmbed-2 (1).pdfb[k[k[[k[kkkpkdpokkdpkopko
Embed-2 (1).pdfb[k[k[[k[kkkpkdpokkdpkopko
 
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 47 (Gurgaon)
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 47 (Gurgaon)Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 47 (Gurgaon)
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 47 (Gurgaon)
 
Enjoy Night⚡Call Girls Rajokri Delhi >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Rajokri Delhi >༒8448380779 Escort ServiceEnjoy Night⚡Call Girls Rajokri Delhi >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Rajokri Delhi >༒8448380779 Escort Service
 
AI as Research Assistant: Upscaling Content Analysis to Identify Patterns of ...
AI as Research Assistant: Upscaling Content Analysis to Identify Patterns of ...AI as Research Assistant: Upscaling Content Analysis to Identify Patterns of ...
AI as Research Assistant: Upscaling Content Analysis to Identify Patterns of ...
 
Embed-4.pdf lkdiinlajeklhndklheduhuekjdh
Embed-4.pdf lkdiinlajeklhndklheduhuekjdhEmbed-4.pdf lkdiinlajeklhndklheduhuekjdh
Embed-4.pdf lkdiinlajeklhndklheduhuekjdh
 
05052024_First India Newspaper Jaipur.pdf
05052024_First India Newspaper Jaipur.pdf05052024_First India Newspaper Jaipur.pdf
05052024_First India Newspaper Jaipur.pdf
 
Busty Desi⚡Call Girls in Vasundhara Ghaziabad >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Vasundhara Ghaziabad >༒8448380779 Escort ServiceBusty Desi⚡Call Girls in Vasundhara Ghaziabad >༒8448380779 Escort Service
Busty Desi⚡Call Girls in Vasundhara Ghaziabad >༒8448380779 Escort Service
 
Enjoy Night⚡Call Girls Iffco Chowk Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Iffco Chowk Gurgaon >༒8448380779 Escort ServiceEnjoy Night⚡Call Girls Iffco Chowk Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Iffco Chowk Gurgaon >༒8448380779 Escort Service
 
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 48 (Gurgaon)
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 48 (Gurgaon)Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 48 (Gurgaon)
Enjoy Night ≽ 8448380779 ≼ Call Girls In Gurgaon Sector 48 (Gurgaon)
 

Chisnell Pew Ballot Testing 120908.Key

  • 1. 1 What is a usability test?
  • 2. 2 Sit next to someone. Watch. Listen. Dana Chisnell
  • 3. 3 When something changes Take constraints into account Complement to Reveal best practice remedies
  • 4. 4 Hesitating Comments Questions Body language What to look for Behaviors
  • 7. 7 The question How successfully do voters vote?
  • 9. 9 1 day Dana Chisnell
  • 10. 10 a ballot and instructions Nancy Frishberg
  • 11. 11 voter participants Dana Chisnell
  • 12. 12 observers Dana Chisnell
  • 14. 14
  • 15. 15
  • 16. 16 How we got value  Used the ballots and instructions at hand  Focused on one thing at a time  Had participants generate and collect data  Drafted observers and debriefed
  • 17. 17 1. Plan, minimally 2. Get the team on board 3. Use the LEO Kit 4. Recruit participants 5. Conduct sessions Follow these steps: 6. Debrief and decide
  • 18. 18 Conduct sessions  Rehearse (P1)  Checklist of tasks  Short, focused sessions  Adjust what you’re doing, if you need to Dana Chisnell
  • 19. 19 Greet the participant Explain the test, your role, and their role Watch the voter vote Ask follow-up questions Debrief with participant Session outline Debrief with observers
  • 20. 20 Impartial, unbiased observing No teaching! Listen and watch Ask open-ended questions: Why? Moderating, not training How? What?
  • 21. 21 Debrief and decide  What could cause a recount?  What could make it difficult to tell intent?  What could draw unwanted attention?  What could cost money if it is not fixed? Dana Chisnell
  • 22. 22 Resources • Usability Professionals’ Association: www.usabilityprofessionals.org/ • LEO Usability Testing Kit: www.usabilityprofessionals.org/ civiclife/voting/leo_testing.html • Ballot Usability and Accessibility Blog: ballotusability.blogspot.com/