SlideShare a Scribd company logo
1 of 101
Download to read offline
Counter to intent
Votersโ€™ mental models of
alternative counting methods

Dana Chisnell
@danachis
@ChadButter๏ฌ‚y
Not.
Ranked Choice Voting

Instant Run-off Voting

Fusion or Cumulative Voting
How are the
votes counted?
Ballot design problems are
well understood
Ballot design problems are
well understood
split contests across columns   overvoting

there are responses on both
                                overvoting
sides of names

arrows rather than bubbles      marking incorrectly

formatting is inconsistent or
                                undervoting
too consistent
instructions are complicated
                                all kinds of crazy things
or lacking
voters donโ€™t know how to
                                lost votes
correct their ballots
Ranked Choice
Voting
adds a twist
San Francisco and Oakland,
December 2011

EVN, March 2012
Portland, Maine 2011
Alameda Co. demo ballot
Minneapolis 2011
New York state demo
Voter slate
How RCV works
n=52
n=52
n=52
       Joe
What we found
Mental models


 People make inferences about how
 things work based on available
 information and context
Mental models
Mental models
            This is what we
            teach people
Mental models
Mental models




Sometimes it really is this simple -
but not in the US
Mental models




Sometimes it really is this simple -
but not in the US
Much more like signing for a mortgage
This is the ballot
we test
NIST medium complexity ballot
Mental models
Mental models

 Point system
Mental models

 Point system
 Weighted
Mental models

 Point system
 Weighted
 Reversed
Alameda Co. demo ballot
Alameda Co. demo ballot
Point / weight system
Point / weight system
Point / weight system
1. Voters develop faulty
   mental models
2. Voters donโ€™t understand the
   consequences of their actions
3. Voters vote counter to their
   intentions
Portland, Maine 2011
Top 2 primary
Top 2 primary
+ regular contests
Top 2 primary
+ regular contests
            + RCV
Top 2 primary
+ regular contests
            + RCV
+ multi-candidate
Top 2 primary
  + regular contests
              + RCV
  + multi-candidate
+ retention contests
Top 2 primary
  + regular contests
              + RCV
  + multi-candidate
+ retention contests
         + measures
Top 2 primary
  + regular contests
              + RCV
  + multi-candidate
+ retention contests
         + measures

6 different models
Weโ€™re pretty sure thereโ€™s a problem
Implications and
outcomes
Poor design and instructions
on ballots make
understanding, marking, and casting
dif๏ฌcult, time-consuming, and
complicated
Poor design and instructions
on ballots make
counting, verifying, and audits
dif๏ฌcult, time-consuming, and
complicated
Raises questions about what is being
secured.
RCV = lost votes
RCV + VBM = lost votes
RCV + multi-language = lost votes
RCV
RCV
+ VBM
RCV
           + VBM
+ multi-language
RCV
           + VBM
+ multi-language

 = thousands of
      lost votes
Lack of trust in elections

Lack of trust in of๏ฌcials

Recalls

Scrambling county boards
Security = Counted as cast
Security = Cast as intended +
           counted as cast
This moment
Voter ed is not the answer.
Next steps
Next steps
 Develop & test versions of on-ballot
 instructions
Next steps
 Develop & test versions of on-ballot
 instructions
 Develop & test versions of pre-voting
 instructions
Next steps
 Develop & test versions of on-ballot
 instructions
 Develop & test versions of pre-voting
 instructions
 Study combinations of designs with
 instructions
Next steps
 Develop & test versions of on-ballot
 instructions
 Develop & test versions of pre-voting
 instructions
 Study combinations of designs with
 instructions
 Study combinations of voting modes on the
 same ballot
If itโ€™s not usable, itโ€™s not valid.
If itโ€™s not usable, itโ€™s not countable.
If itโ€™s not usable, itโ€™s not veri๏ฌable.
If itโ€™s not usable, itโ€™s not auditable.
If itโ€™s not usable, itโ€™s not secure.
Thank you
Rick Bond         Jared Spool

Cyd Harrell       David Cary

Ethan Newby       Rebecca Sherrill

Callie Wheeler    Frank Castro

Chelsey Glasson   Sandy Olson

Sara Cambridge    Nancy Frishberg

Laura Paajanen    Yelena Nakhimovsky

Beth Lingard      Whitney Quesenbery

Beth Pickard
New tools.
Field Guides series




Research          Research          SOP and Usability   Research
commissioned by   commissioned by   and Civic Life      commissioned by
EAC               NIST              Project             NIST
Coming soon
Coming soon

Effective election
department
web sites




 Research partially
 funded by
 Kickstarter &
 MacArthur
Coming soon

Effective election Delivering useful
department         voter education
web sites




 Research partially   Research partially
 funded by            funded by
 Kickstarter &        Kickstarter &
 MacArthur            MacArthur
Coming soon

Effective election Delivering useful Effective design
department         voter education for vote-by-mail
web sites




 Research partially   Research partially   Research to be
 funded by            funded by            funded by the
 Kickstarter &        Kickstarter &        MacArthur
 MacArthur            MacArthur            Foundation
Coming soon

Effective election Delivering useful Effective design       Designing multi-
department         voter education for vote-by-mail         language ballots
web sites




 Research partially   Research partially   Research to be   Research to be
 funded by            funded by            funded by the    funded by the
 Kickstarter &        Kickstarter &        MacArthur        MacArthur
 MacArthur            MacArthur            Foundation       Foundation
Field Guides
 To Ensuring
Voter Intent


civicdesigning.org
       /๏ฌeldguides
Dana Chisnell
dana@usabilityworks.net
civicdesign@usabilityworks.net

civicdesigning.org

@danachis
@ChadButter๏ฌ‚y

More Related Content

What's hot

Looking across the voter experience
Looking across the voter experienceLooking across the voter experience
Looking across the voter experienceDana Chisnell
ย 
Usability and security in future voting systems
Usability and security in future voting systemsUsability and security in future voting systems
Usability and security in future voting systemsDana Chisnell
ย 
Plain Language: Writing so voters understand
Plain Language: Writing so voters understandPlain Language: Writing so voters understand
Plain Language: Writing so voters understandCenter for Civic Design
ย 
Don't make me read! Less is more in information for voters
Don't make me read! Less is more in information for votersDon't make me read! Less is more in information for voters
Don't make me read! Less is more in information for votersDana Chisnell
ย 
Forms that work: Understanding forms to improve their design by @cjforms
Forms that work: Understanding forms to improve their design by @cjformsForms that work: Understanding forms to improve their design by @cjforms
Forms that work: Understanding forms to improve their design by @cjformsCaroline Jarrett
ย 
Users at the end of the mouse - Persona modeler
Users at the end of the mouse - Persona modelerUsers at the end of the mouse - Persona modeler
Users at the end of the mouse - Persona modelerDana Chisnell
ย 
Defects by design: Ballots that fool voters
Defects by design: Ballots that fool votersDefects by design: Ballots that fool voters
Defects by design: Ballots that fool votersCenter for Civic Design
ย 
Better UX Surveys part 1
Better UX Surveys part 1Better UX Surveys part 1
Better UX Surveys part 1Caroline Jarrett
ย 
User Experience Design and Human Computer Interaction
User Experience Design and Human Computer InteractionUser Experience Design and Human Computer Interaction
User Experience Design and Human Computer InteractionSuci Fadhilah
ย 
Why do usability problems go unfixed?
Why do usability problems go unfixed?Why do usability problems go unfixed?
Why do usability problems go unfixed?Caroline Jarrett
ย 
Design Research Synthesis
Design Research SynthesisDesign Research Synthesis
Design Research SynthesisHJ Kwon
ย 
Designing the voting experience: Making elections easy for voters to understand
Designing the voting experience: Making elections easy for voters to understandDesigning the voting experience: Making elections easy for voters to understand
Designing the voting experience: Making elections easy for voters to understandCenter for Civic Design
ย 
Breaking Barriers: Ballot Access and Plain Language
Breaking Barriers: Ballot Access and Plain LanguageBreaking Barriers: Ballot Access and Plain Language
Breaking Barriers: Ballot Access and Plain LanguageCenter for Civic Design
ย 
Nodd.co - Quick summary v0.2.1
Nodd.co  - Quick summary v0.2.1Nodd.co  - Quick summary v0.2.1
Nodd.co - Quick summary v0.2.1Eli Holder
ย 
Diamonds in the Rough (Sentiment(al) Analysis
Diamonds in the Rough (Sentiment(al) AnalysisDiamonds in the Rough (Sentiment(al) Analysis
Diamonds in the Rough (Sentiment(al) AnalysisScott K. Wilder
ย 
Voting presentation phase2_synthesis
Voting presentation phase2_synthesisVoting presentation phase2_synthesis
Voting presentation phase2_synthesisMark Choi
ย 
Egocentric Design - Mobile UX Meetup
Egocentric Design - Mobile UX MeetupEgocentric Design - Mobile UX Meetup
Egocentric Design - Mobile UX MeetupJulie Stanford
ย 

What's hot (18)

Looking across the voter experience
Looking across the voter experienceLooking across the voter experience
Looking across the voter experience
ย 
Usability and security in future voting systems
Usability and security in future voting systemsUsability and security in future voting systems
Usability and security in future voting systems
ย 
Plain Language: Writing so voters understand
Plain Language: Writing so voters understandPlain Language: Writing so voters understand
Plain Language: Writing so voters understand
ย 
Don't make me read! Less is more in information for voters
Don't make me read! Less is more in information for votersDon't make me read! Less is more in information for voters
Don't make me read! Less is more in information for voters
ย 
Forms that work: Understanding forms to improve their design by @cjforms
Forms that work: Understanding forms to improve their design by @cjformsForms that work: Understanding forms to improve their design by @cjforms
Forms that work: Understanding forms to improve their design by @cjforms
ย 
Users at the end of the mouse - Persona modeler
Users at the end of the mouse - Persona modelerUsers at the end of the mouse - Persona modeler
Users at the end of the mouse - Persona modeler
ย 
Defects by design: Ballots that fool voters
Defects by design: Ballots that fool votersDefects by design: Ballots that fool voters
Defects by design: Ballots that fool voters
ย 
Better UX Surveys part 1
Better UX Surveys part 1Better UX Surveys part 1
Better UX Surveys part 1
ย 
User Experience Design and Human Computer Interaction
User Experience Design and Human Computer InteractionUser Experience Design and Human Computer Interaction
User Experience Design and Human Computer Interaction
ย 
Why do usability problems go unfixed?
Why do usability problems go unfixed?Why do usability problems go unfixed?
Why do usability problems go unfixed?
ย 
Design Research Synthesis
Design Research SynthesisDesign Research Synthesis
Design Research Synthesis
ย 
Designing the voting experience: Making elections easy for voters to understand
Designing the voting experience: Making elections easy for voters to understandDesigning the voting experience: Making elections easy for voters to understand
Designing the voting experience: Making elections easy for voters to understand
ย 
Breaking Barriers: Ballot Access and Plain Language
Breaking Barriers: Ballot Access and Plain LanguageBreaking Barriers: Ballot Access and Plain Language
Breaking Barriers: Ballot Access and Plain Language
ย 
Nodd.co - Quick summary v0.2.1
Nodd.co  - Quick summary v0.2.1Nodd.co  - Quick summary v0.2.1
Nodd.co - Quick summary v0.2.1
ย 
Diamonds in the Rough (Sentiment(al) Analysis
Diamonds in the Rough (Sentiment(al) AnalysisDiamonds in the Rough (Sentiment(al) Analysis
Diamonds in the Rough (Sentiment(al) Analysis
ย 
Voting presentation phase2_synthesis
Voting presentation phase2_synthesisVoting presentation phase2_synthesis
Voting presentation phase2_synthesis
ย 
Egocentric Design - Mobile UX Meetup
Egocentric Design - Mobile UX MeetupEgocentric Design - Mobile UX Meetup
Egocentric Design - Mobile UX Meetup
ย 
Designing our civic life
Designing our civic life Designing our civic life
Designing our civic life
ย 

Viewers also liked

Presentation2
Presentation2Presentation2
Presentation2Girish Patil
ย 
m-Survey from Viplav Communications
m-Survey from Viplav Communicationsm-Survey from Viplav Communications
m-Survey from Viplav Communicationsagahlot
ย 
Voter Meets the Ballot
Voter Meets the BallotVoter Meets the Ballot
Voter Meets the Ballotyvoteph
ย 
TARGET CRM
TARGET CRMTARGET CRM
TARGET CRMFreshSlides
ย 
Constituency Management Software from Viplav Communications
Constituency Management Software from Viplav CommunicationsConstituency Management Software from Viplav Communications
Constituency Management Software from Viplav Communicationsagahlot
ย 
Owen Sound Election 2014 Voters Guide - Owen Sound Hub
Owen Sound Election 2014 Voters Guide - Owen Sound HubOwen Sound Election 2014 Voters Guide - Owen Sound Hub
Owen Sound Election 2014 Voters Guide - Owen Sound HubMiranda Miller
ย 
Stranger in My Own Country
Stranger in My Own CountryStranger in My Own Country
Stranger in My Own CountryDemocracy Fund Voice
ย 
Political Campaign Planning parte2
Political Campaign Planning parte2Political Campaign Planning parte2
Political Campaign Planning parte2garneth87
ย 
Unit 2
Unit 2Unit 2
Unit 2ezasso
ย 
2008 obamas presidential campaign as a project prezi pdf
2008 obamas presidential campaign as a project prezi pdf2008 obamas presidential campaign as a project prezi pdf
2008 obamas presidential campaign as a project prezi pdfMaria Chiara Franco
ย 
Election Management Solution
Election Management SolutionElection Management Solution
Election Management SolutionTVS Next
ย 
SAP Services
SAP ServicesSAP Services
SAP ServicesTVS Next
ย 
Voting behaviour2
Voting behaviour2Voting behaviour2
Voting behaviour2aquinaspolitics
ย 
Election Constituency Management Software
Election Constituency Management SoftwareElection Constituency Management Software
Election Constituency Management SoftwareEnuke Software Pvt Ltd
ย 
UP Election 2017
UP Election 2017 UP Election 2017
UP Election 2017 Sunil Mishra
ย 
Gramny - Connecting SHG's with Corporates
Gramny - Connecting SHG's with CorporatesGramny - Connecting SHG's with Corporates
Gramny - Connecting SHG's with CorporatesTVS Next
ย 
How to Pull Your Own Trump
How to Pull Your Own TrumpHow to Pull Your Own Trump
How to Pull Your Own TrumpIris
ย 
Mcd election 2017
Mcd election 2017Mcd election 2017
Mcd election 2017Sunil Mishra
ย 
Guiding voters through the polling place
Guiding voters through the polling placeGuiding voters through the polling place
Guiding voters through the polling placeCenter for Civic Design
ย 
Voting and Elections
Voting and ElectionsVoting and Elections
Voting and ElectionsChristopher Rice
ย 

Viewers also liked (20)

Presentation2
Presentation2Presentation2
Presentation2
ย 
m-Survey from Viplav Communications
m-Survey from Viplav Communicationsm-Survey from Viplav Communications
m-Survey from Viplav Communications
ย 
Voter Meets the Ballot
Voter Meets the BallotVoter Meets the Ballot
Voter Meets the Ballot
ย 
TARGET CRM
TARGET CRMTARGET CRM
TARGET CRM
ย 
Constituency Management Software from Viplav Communications
Constituency Management Software from Viplav CommunicationsConstituency Management Software from Viplav Communications
Constituency Management Software from Viplav Communications
ย 
Owen Sound Election 2014 Voters Guide - Owen Sound Hub
Owen Sound Election 2014 Voters Guide - Owen Sound HubOwen Sound Election 2014 Voters Guide - Owen Sound Hub
Owen Sound Election 2014 Voters Guide - Owen Sound Hub
ย 
Stranger in My Own Country
Stranger in My Own CountryStranger in My Own Country
Stranger in My Own Country
ย 
Political Campaign Planning parte2
Political Campaign Planning parte2Political Campaign Planning parte2
Political Campaign Planning parte2
ย 
Unit 2
Unit 2Unit 2
Unit 2
ย 
2008 obamas presidential campaign as a project prezi pdf
2008 obamas presidential campaign as a project prezi pdf2008 obamas presidential campaign as a project prezi pdf
2008 obamas presidential campaign as a project prezi pdf
ย 
Election Management Solution
Election Management SolutionElection Management Solution
Election Management Solution
ย 
SAP Services
SAP ServicesSAP Services
SAP Services
ย 
Voting behaviour2
Voting behaviour2Voting behaviour2
Voting behaviour2
ย 
Election Constituency Management Software
Election Constituency Management SoftwareElection Constituency Management Software
Election Constituency Management Software
ย 
UP Election 2017
UP Election 2017 UP Election 2017
UP Election 2017
ย 
Gramny - Connecting SHG's with Corporates
Gramny - Connecting SHG's with CorporatesGramny - Connecting SHG's with Corporates
Gramny - Connecting SHG's with Corporates
ย 
How to Pull Your Own Trump
How to Pull Your Own TrumpHow to Pull Your Own Trump
How to Pull Your Own Trump
ย 
Mcd election 2017
Mcd election 2017Mcd election 2017
Mcd election 2017
ย 
Guiding voters through the polling place
Guiding voters through the polling placeGuiding voters through the polling place
Guiding voters through the polling place
ย 
Voting and Elections
Voting and ElectionsVoting and Elections
Voting and Elections
ย 

Similar to Counter to intent: Voters' mental models of alternative counting methods

Election portal pitch
Election portal   pitchElection portal   pitch
Election portal pitchShubhamGandhi57
ย 
Using surveys to uncover audience insights
Using surveys to uncover audience insightsUsing surveys to uncover audience insights
Using surveys to uncover audience insightsCaroline Jarrett
ย 
IACREOT - Plain language for voters and poll workers
IACREOT - Plain language for voters and poll workersIACREOT - Plain language for voters and poll workers
IACREOT - Plain language for voters and poll workersDana Chisnell
ย 
PS 101 Voting & Elections Fall 2008
PS 101 Voting & Elections Fall 2008PS 101 Voting & Elections Fall 2008
PS 101 Voting & Elections Fall 2008Christopher Rice
ย 
Predictive Analytics in Political Campaigns: Obama and Beyond
Predictive Analytics in Political Campaigns: Obama and BeyondPredictive Analytics in Political Campaigns: Obama and Beyond
Predictive Analytics in Political Campaigns: Obama and BeyondRising Media Ltd.
ย 
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...UserZoom
ย 
Surveys that work:training course for Rosenfeld Media, day 1
Surveys that work:training course for Rosenfeld Media, day 1Surveys that work:training course for Rosenfeld Media, day 1
Surveys that work:training course for Rosenfeld Media, day 1Caroline Jarrett
ย 
10 NPO Communications and Asking Techniques for Fundraising Success
10 NPO Communications and Asking Techniques for Fundraising Success10 NPO Communications and Asking Techniques for Fundraising Success
10 NPO Communications and Asking Techniques for Fundraising SuccessBloomerang
ย 
Great Ideas for Fundraising and Grants
Great Ideas for Fundraising and GrantsGreat Ideas for Fundraising and Grants
Great Ideas for Fundraising and GrantsSignUp.com
ย 
The inevitable survey 2021
The inevitable survey 2021The inevitable survey 2021
The inevitable survey 2021Caroline Jarrett
ย 
Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023Caroline Jarrett
ย 
Webinar v.5.23.11
Webinar v.5.23.11Webinar v.5.23.11
Webinar v.5.23.11healthycitychris
ย 
Voting Presentation of Phase 2 - Synthesis
Voting Presentation of Phase 2 - SynthesisVoting Presentation of Phase 2 - Synthesis
Voting Presentation of Phase 2 - SynthesisMark Choi
ย 
Wanderwell engr 245 lean launch pad stanford 2019
Wanderwell engr 245 lean launch pad stanford 2019Wanderwell engr 245 lean launch pad stanford 2019
Wanderwell engr 245 lean launch pad stanford 2019Stanford University
ย 
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Caroline Jarrett
ย 
Defects by design: Ballots that fool voters
Defects by design: Ballots that fool votersDefects by design: Ballots that fool voters
Defects by design: Ballots that fool votersCenter for Civic Design
ย 
Data Quality Concerns when Crowdsourcing Scientific Tasks
Data Quality Concerns when Crowdsourcing Scientific TasksData Quality Concerns when Crowdsourcing Scientific Tasks
Data Quality Concerns when Crowdsourcing Scientific TasksStephanie Eckman
ย 
Data Quality Concerns when Crowdsourcing Scientific Tasks
Data Quality Concerns when Crowdsourcing Scientific TasksData Quality Concerns when Crowdsourcing Scientific Tasks
Data Quality Concerns when Crowdsourcing Scientific TasksStephanie Eckman
ย 
Writing A Field Plan Part 1
Writing A Field Plan Part 1Writing A Field Plan Part 1
Writing A Field Plan Part 1DemocracyforAmerica
ย 
Wordpress Milwaukee 2013 Adventures of Project Management
Wordpress Milwaukee 2013 Adventures of Project ManagementWordpress Milwaukee 2013 Adventures of Project Management
Wordpress Milwaukee 2013 Adventures of Project ManagementJessica Dunbar
ย 

Similar to Counter to intent: Voters' mental models of alternative counting methods (20)

Election portal pitch
Election portal   pitchElection portal   pitch
Election portal pitch
ย 
Using surveys to uncover audience insights
Using surveys to uncover audience insightsUsing surveys to uncover audience insights
Using surveys to uncover audience insights
ย 
IACREOT - Plain language for voters and poll workers
IACREOT - Plain language for voters and poll workersIACREOT - Plain language for voters and poll workers
IACREOT - Plain language for voters and poll workers
ย 
PS 101 Voting & Elections Fall 2008
PS 101 Voting & Elections Fall 2008PS 101 Voting & Elections Fall 2008
PS 101 Voting & Elections Fall 2008
ย 
Predictive Analytics in Political Campaigns: Obama and Beyond
Predictive Analytics in Political Campaigns: Obama and BeyondPredictive Analytics in Political Campaigns: Obama and Beyond
Predictive Analytics in Political Campaigns: Obama and Beyond
ย 
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
ย 
Surveys that work:training course for Rosenfeld Media, day 1
Surveys that work:training course for Rosenfeld Media, day 1Surveys that work:training course for Rosenfeld Media, day 1
Surveys that work:training course for Rosenfeld Media, day 1
ย 
10 NPO Communications and Asking Techniques for Fundraising Success
10 NPO Communications and Asking Techniques for Fundraising Success10 NPO Communications and Asking Techniques for Fundraising Success
10 NPO Communications and Asking Techniques for Fundraising Success
ย 
Great Ideas for Fundraising and Grants
Great Ideas for Fundraising and GrantsGreat Ideas for Fundraising and Grants
Great Ideas for Fundraising and Grants
ย 
The inevitable survey 2021
The inevitable survey 2021The inevitable survey 2021
The inevitable survey 2021
ย 
Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023
ย 
Webinar v.5.23.11
Webinar v.5.23.11Webinar v.5.23.11
Webinar v.5.23.11
ย 
Voting Presentation of Phase 2 - Synthesis
Voting Presentation of Phase 2 - SynthesisVoting Presentation of Phase 2 - Synthesis
Voting Presentation of Phase 2 - Synthesis
ย 
Wanderwell engr 245 lean launch pad stanford 2019
Wanderwell engr 245 lean launch pad stanford 2019Wanderwell engr 245 lean launch pad stanford 2019
Wanderwell engr 245 lean launch pad stanford 2019
ย 
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
ย 
Defects by design: Ballots that fool voters
Defects by design: Ballots that fool votersDefects by design: Ballots that fool voters
Defects by design: Ballots that fool voters
ย 
Data Quality Concerns when Crowdsourcing Scientific Tasks
Data Quality Concerns when Crowdsourcing Scientific TasksData Quality Concerns when Crowdsourcing Scientific Tasks
Data Quality Concerns when Crowdsourcing Scientific Tasks
ย 
Data Quality Concerns when Crowdsourcing Scientific Tasks
Data Quality Concerns when Crowdsourcing Scientific TasksData Quality Concerns when Crowdsourcing Scientific Tasks
Data Quality Concerns when Crowdsourcing Scientific Tasks
ย 
Writing A Field Plan Part 1
Writing A Field Plan Part 1Writing A Field Plan Part 1
Writing A Field Plan Part 1
ย 
Wordpress Milwaukee 2013 Adventures of Project Management
Wordpress Milwaukee 2013 Adventures of Project ManagementWordpress Milwaukee 2013 Adventures of Project Management
Wordpress Milwaukee 2013 Adventures of Project Management
ย 

More from Dana Chisnell

Next generation of civic designers
Next generation of civic designersNext generation of civic designers
Next generation of civic designersDana Chisnell
ย 
I can't find what i'm looking for
I can't find what i'm looking forI can't find what i'm looking for
I can't find what i'm looking forDana Chisnell
ย 
Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants Dana Chisnell
ย 
Anywhere Ballot iterations
Anywhere Ballot iterationsAnywhere Ballot iterations
Anywhere Ballot iterationsDana Chisnell
ย 
Iterations paper prototype
Iterations   paper prototypeIterations   paper prototype
Iterations paper prototypeDana Chisnell
ย 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social webDana Chisnell
ย 
Persona modeler
Persona modelerPersona modeler
Persona modelerDana Chisnell
ย 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social webDana Chisnell
ย 
The users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personasThe users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personasDana Chisnell
ย 
Democracy is a design problem
Democracy is a design problemDemocracy is a design problem
Democracy is a design problemDana Chisnell
ย 
California's top lessons learned in design and language
California's top lessons learned in design and languageCalifornia's top lessons learned in design and language
California's top lessons learned in design and languageDana Chisnell
ย 
Deconstructing delight
Deconstructing delightDeconstructing delight
Deconstructing delightDana Chisnell
ย 
Character creator
Character creatorCharacter creator
Character creatorDana Chisnell
ย 
Pleasure, Flow, and Meaning in Design
Pleasure, Flow, and Meaning in DesignPleasure, Flow, and Meaning in Design
Pleasure, Flow, and Meaning in DesignDana Chisnell
ย 
Design and Critique for Challenging Problems
Design and Critique for Challenging ProblemsDesign and Critique for Challenging Problems
Design and Critique for Challenging ProblemsDana Chisnell
ย 
Super powers that could change the world
Super powers that could change the worldSuper powers that could change the world
Super powers that could change the worldDana Chisnell
ย 
Beyond frustration: 3 levels of happy design
Beyond frustration: 3 levels of happy designBeyond frustration: 3 levels of happy design
Beyond frustration: 3 levels of happy designDana Chisnell
ย 
Rethinking user research for social design
Rethinking user research for social designRethinking user research for social design
Rethinking user research for social designDana Chisnell
ย 
Usability Testing in Local Jurisdictions
Usability Testing in Local JurisdictionsUsability Testing in Local Jurisdictions
Usability Testing in Local JurisdictionsDana Chisnell
ย 

More from Dana Chisnell (19)

Next generation of civic designers
Next generation of civic designersNext generation of civic designers
Next generation of civic designers
ย 
I can't find what i'm looking for
I can't find what i'm looking forI can't find what i'm looking for
I can't find what i'm looking for
ย 
Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants Gaining design insight through recruiting research participants
Gaining design insight through recruiting research participants
ย 
Anywhere Ballot iterations
Anywhere Ballot iterationsAnywhere Ballot iterations
Anywhere Ballot iterations
ย 
Iterations paper prototype
Iterations   paper prototypeIterations   paper prototype
Iterations paper prototype
ย 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social web
ย 
Persona modeler
Persona modelerPersona modeler
Persona modeler
ย 
Rethinking user research for social web
Rethinking user research for social webRethinking user research for social web
Rethinking user research for social web
ย 
The users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personasThe users at the end of the mouse - using the 3As to model personas
The users at the end of the mouse - using the 3As to model personas
ย 
Democracy is a design problem
Democracy is a design problemDemocracy is a design problem
Democracy is a design problem
ย 
California's top lessons learned in design and language
California's top lessons learned in design and languageCalifornia's top lessons learned in design and language
California's top lessons learned in design and language
ย 
Deconstructing delight
Deconstructing delightDeconstructing delight
Deconstructing delight
ย 
Character creator
Character creatorCharacter creator
Character creator
ย 
Pleasure, Flow, and Meaning in Design
Pleasure, Flow, and Meaning in DesignPleasure, Flow, and Meaning in Design
Pleasure, Flow, and Meaning in Design
ย 
Design and Critique for Challenging Problems
Design and Critique for Challenging ProblemsDesign and Critique for Challenging Problems
Design and Critique for Challenging Problems
ย 
Super powers that could change the world
Super powers that could change the worldSuper powers that could change the world
Super powers that could change the world
ย 
Beyond frustration: 3 levels of happy design
Beyond frustration: 3 levels of happy designBeyond frustration: 3 levels of happy design
Beyond frustration: 3 levels of happy design
ย 
Rethinking user research for social design
Rethinking user research for social designRethinking user research for social design
Rethinking user research for social design
ย 
Usability Testing in Local Jurisdictions
Usability Testing in Local JurisdictionsUsability Testing in Local Jurisdictions
Usability Testing in Local Jurisdictions
ย 

Recently uploaded

VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...Call Girls in Nagpur High Profile
ย 
DragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptxDragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptxmirandajeremy200221
ย 
Peaches App development presentation deck
Peaches App development presentation deckPeaches App development presentation deck
Peaches App development presentation decktbatkhuu1
ย 
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...Call Girls in Nagpur High Profile
ย 
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...amitlee9823
ย 
Design Inspiration for College by Slidesgo.pptx
Design Inspiration for College by Slidesgo.pptxDesign Inspiration for College by Slidesgo.pptx
Design Inspiration for College by Slidesgo.pptxTusharBahuguna2
ย 
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธCall Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธsoniya singh
ย 
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779Delhi Call girls
ย 
Escorts Service Nagavara โ˜Ž 7737669865โ˜Ž Book Your One night Stand (Bangalore)
Escorts Service Nagavara โ˜Ž 7737669865โ˜Ž Book Your One night Stand (Bangalore)Escorts Service Nagavara โ˜Ž 7737669865โ˜Ž Book Your One night Stand (Bangalore)
Escorts Service Nagavara โ˜Ž 7737669865โ˜Ž Book Your One night Stand (Bangalore)amitlee9823
ย 
Government polytechnic college-1.pptxabcd
Government polytechnic college-1.pptxabcdGovernment polytechnic college-1.pptxabcd
Government polytechnic college-1.pptxabcdshivubhavv
ย 
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...amitlee9823
ย 
๐Ÿ’ซโœ…jodhpur 24ร—7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
๐Ÿ’ซโœ…jodhpur 24ร—7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...๐Ÿ’ซโœ…jodhpur 24ร—7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
๐Ÿ’ซโœ…jodhpur 24ร—7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...sonalitrivedi431
ย 
infant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptxinfant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptxsuhanimunjal27
ย 
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248 Good Looking standard Profil...kumaririma588
ย 
call girls in Kaushambi (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”...
call girls in Kaushambi (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”...call girls in Kaushambi (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”...
call girls in Kaushambi (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”...Delhi Call girls
ย 
(AISHA) Ambegaon Khurd Call Girls Just Call 7001035870 [ Cash on Delivery ] P...
(AISHA) Ambegaon Khurd Call Girls Just Call 7001035870 [ Cash on Delivery ] P...(AISHA) Ambegaon Khurd Call Girls Just Call 7001035870 [ Cash on Delivery ] P...
(AISHA) Ambegaon Khurd Call Girls Just Call 7001035870 [ Cash on Delivery ] P...ranjana rawat
ย 
The_Canvas_of_Creative_Mastery_Newsletter_April_2024_Version.pdf
The_Canvas_of_Creative_Mastery_Newsletter_April_2024_Version.pdfThe_Canvas_of_Creative_Mastery_Newsletter_April_2024_Version.pdf
The_Canvas_of_Creative_Mastery_Newsletter_April_2024_Version.pdfAmirYakdi
ย 
Top Rated Pune Call Girls Koregaon Park โŸŸ 6297143586 โŸŸ Call Me For Genuine S...
Top Rated  Pune Call Girls Koregaon Park โŸŸ 6297143586 โŸŸ Call Me For Genuine S...Top Rated  Pune Call Girls Koregaon Park โŸŸ 6297143586 โŸŸ Call Me For Genuine S...
Top Rated Pune Call Girls Koregaon Park โŸŸ 6297143586 โŸŸ Call Me For Genuine S...Call Girls in Nagpur High Profile
ย 
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...babafaisel
ย 
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service ๐Ÿงต
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service  ๐ŸงตCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service  ๐Ÿงต
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service ๐Ÿงตanilsa9823
ย 

Recently uploaded (20)

VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
ย 
DragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptxDragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptx
ย 
Peaches App development presentation deck
Peaches App development presentation deckPeaches App development presentation deck
Peaches App development presentation deck
ย 
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
ย 
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
ย 
Design Inspiration for College by Slidesgo.pptx
Design Inspiration for College by Slidesgo.pptxDesign Inspiration for College by Slidesgo.pptx
Design Inspiration for College by Slidesgo.pptx
ย 
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธCall Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
ย 
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
ย 
Escorts Service Nagavara โ˜Ž 7737669865โ˜Ž Book Your One night Stand (Bangalore)
Escorts Service Nagavara โ˜Ž 7737669865โ˜Ž Book Your One night Stand (Bangalore)Escorts Service Nagavara โ˜Ž 7737669865โ˜Ž Book Your One night Stand (Bangalore)
Escorts Service Nagavara โ˜Ž 7737669865โ˜Ž Book Your One night Stand (Bangalore)
ย 
Government polytechnic college-1.pptxabcd
Government polytechnic college-1.pptxabcdGovernment polytechnic college-1.pptxabcd
Government polytechnic college-1.pptxabcd
ย 
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
ย 
๐Ÿ’ซโœ…jodhpur 24ร—7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
๐Ÿ’ซโœ…jodhpur 24ร—7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...๐Ÿ’ซโœ…jodhpur 24ร—7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
๐Ÿ’ซโœ…jodhpur 24ร—7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
ย 
infant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptxinfant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptx
ย 
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248 Good Looking standard Profil...
ย 
call girls in Kaushambi (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”...
call girls in Kaushambi (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”...call girls in Kaushambi (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”...
call girls in Kaushambi (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”...
ย 
(AISHA) Ambegaon Khurd Call Girls Just Call 7001035870 [ Cash on Delivery ] P...
(AISHA) Ambegaon Khurd Call Girls Just Call 7001035870 [ Cash on Delivery ] P...(AISHA) Ambegaon Khurd Call Girls Just Call 7001035870 [ Cash on Delivery ] P...
(AISHA) Ambegaon Khurd Call Girls Just Call 7001035870 [ Cash on Delivery ] P...
ย 
The_Canvas_of_Creative_Mastery_Newsletter_April_2024_Version.pdf
The_Canvas_of_Creative_Mastery_Newsletter_April_2024_Version.pdfThe_Canvas_of_Creative_Mastery_Newsletter_April_2024_Version.pdf
The_Canvas_of_Creative_Mastery_Newsletter_April_2024_Version.pdf
ย 
Top Rated Pune Call Girls Koregaon Park โŸŸ 6297143586 โŸŸ Call Me For Genuine S...
Top Rated  Pune Call Girls Koregaon Park โŸŸ 6297143586 โŸŸ Call Me For Genuine S...Top Rated  Pune Call Girls Koregaon Park โŸŸ 6297143586 โŸŸ Call Me For Genuine S...
Top Rated Pune Call Girls Koregaon Park โŸŸ 6297143586 โŸŸ Call Me For Genuine S...
ย 
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
ย 
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service ๐Ÿงต
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service  ๐ŸงตCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service  ๐Ÿงต
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service ๐Ÿงต
ย 

Counter to intent: Voters' mental models of alternative counting methods