SlideShare a Scribd company logo
1 of 27
Download to read offline
Daveena Tauber Ph.D.
Oregon Unemployment Application
Heuristic Analysis
Need Statement
As of March 2020, applying for unemployment became a user experience
shared by millions of Americans.
In some situations, users may find themselves struggling with outdated
and unclear UIs that impose undue burden during this high-stakes task.
This case study from Oregon is a case in point.
State governments should incorporate UX research to make sure that
critical access to benefits are accessible by citizens at all educational and
ability levels. They should present information clearly, reduce cognitive
load, and prevent data loss.
System Status Visibility
● No initial mental map of steps involved
● No cues about where the user is in this
long process.
● Conflicting and threatening warnings
about time-outs
● References to specific days of the week
may add to confusion
● Provide a clear mental map of the steps
● Provide temporal orientation
○ How long will the process take?
○ How long do users have before
they are timed out?
● Provide progress bar or other visual
indicator of system status
OpportunitiesChallenges
POOR
Confusing messages about time-outs and order of operations
So is it 10
minutes or 30
minutes?
Why would I
cancel before I’ve
even begun the
application?
Confusing messages about days of the week
Sunday of which week?
What if I lost my job
two weeks ago?
What if today is
Friday? Do I call today
or next week?
Match Between System and Real World
● Announced as an “online” process, but
there is no signal that a critical step
involves receiving a Customer ID by mail.
What if I don’t have a current address?
● No information in the mailed form about
where to re-engage in the online process
of setting up payment
● Instructions (on where to call for help)
appear without links or phone numbers.
● Orient users to all steps, online and
offline
● Create bridges between online and
offline parts of the process
● Provide links and phone numbers for all
offices and call centers
OpportunitiesChallenges
POOR
Lack of links to real world resources
Here it says to call a local WorkSource office. Below it
says local offices are not handling claims. Are these
the same thing? Do I really need to know this? I’m
confused!
User Control and Freedom
● No data is saved until the final
submission, forcing a single high-stakes
session with a high probability of redo
● Use of browser back function will end
the session and lose all data
● Currently a few pages have an edit
ability, but low trust makes this them
risky proposition
● Over use of scare warnings create
anxiety rather than security
● Develop a back-end solution to save
sessions so that users are not in danger
of losing data
● Allow users to return, edit, and review
data
● Create clear ways to navigate in and out
of the application and payment set-up
process
OpportunitiesChallenges
POOR
Little control or freedom
Gah! This process sounds stressful.
What if I make a mistake? Do I have to
start over?
Consistency and Standards
● Low consistency in
○ design patterns
○ information hierarchy
○ warning messages
○ headings
● Information not introduced in logical
sequence
● Key terms are not defined
● Use a consistent design pattern that uses
information hierarchy and color to
express importance, reducing reliance
on scare warnings
● Introduce and reinforce information
where the user needs it
● Offer in-context definitions of important
terms
OpportunitiesChallenges
POOR
Use standards such as having buttons become active when ready
Am I really finished? This button
doesn’t give me any clues.
Define key terms
What does processed mean? Does that
happen online? Offline? How/will I know
when it’s done?
Error Prevention
● System currently presents ample
opportunities for errors that lead to
having to re-enter data
● Active “cancel transaction” and inactive
“continue” button mean users have to
actively overcome the stronger call to
action
● Little in-context help raises risk of error
from users exiting to find help
OpportunitiesChallenges
POOR
● Frontload clear information about the
process
● Save session data and allow editing and
review
● Use conventional button design
● Provide in-context help
Opportunities for error
This link looks active, so I’m likely
to click it thinking it’s the way
forward!
Recognition Rather than Recall
● Users have to remember which centers
can be called for help (confusing
information at the beginning) since links
are not always present
● Users are told not to “go back” except in
a few situation, creating tension between
recall and functionality
● Offer consistent, intuitive functionality so
that users don’t have to remember what
is ok to do and not do in the system
OpportunitiesChallenges
POOR
Need for recall
This info appears before I start the
claim, but not while I’m doing it. I don’t
remember where to go for help. I’m
also likely to have questions during the
process.
This link appears before I
start but not during the
application.
Flexibility and Efficiency of Use
● Little flexibility in the timeline for
inputting data
● Saving sessions will allow greater
flexibility
OpportunitiesChallenges
POOR
Aesthetic and Minimalist Design
● Use of single font size is minimalist but
not aesthetic or functional, resulting in
over-reliance of “scare tactics” rather
than information hierarchy
● Use of multiple patterns for attention
grabbing adds to cognitive burden
● Inconsistent use of background pattern
doesn’t add to visual clarity
● Extreme visual density reduces legibility
● Very small font size and tiny form fields
add to visual strain and reduce
accessibility
● Use information hierarchy to
communicate importance
● Reduce visual density. Where dense text
is necessary, increase white space
● Increase font size and form fields
OpportunitiesChallenges
POOR
Multiple ways of signaling importance creates attention fatigue
Dense text adds to cognitive burden
What’s important here? I can’t
tell at a glance.
Inconsistent use of background pattern
doesn’t add to visual clarity
Recognize and Fix Errors
● Because the form doesn’t save data,
users have few chances to fix errors until
after submission
● Conflicting messages about error
correction result in low system trust
● One error message doesn’t map to
actual form fields, making it difficult to
correct error
● Allow users to review data prior to
submission
OpportunitiesChallenges
POOR
Conflicting messages about error correction create
low system trust
Here I am told I can’t
go back and fix
anything
But these two forms
suggest I can. I’m too
scared of losing all my
data to try these
options.
Help Documentation
● Information is not introduced where it’s
needed
● In-context help appears in relation to
seemingly random items, rather than in
relation to high-need items
● Lacks links to help documentation
● Missing links to “real world” help
● Introduce information when and where
it is needed
● Provide in-context help where it is most
needed
● Provide clear and consistent links to help
documentation
● Provide links to “real world” help clear
throughout
OpportunitiesChallenges
POOR
In-context help isn’t attached to most important interactions
Initial Recommendations
● Provide back-end solution to save sessions once users have
entered their social security number, pin, and security
questions. Forcing a single session may result in high rates
of start-over and possible difficulty accessing benefits.
● Create a clear mental map for users of the entire workflow,
including online and offline components
● Use best practices in information hierarchy to provide clear
information and reduce reliance on “scare warnings”
● Use clear, consistent design patterns to reduce visual and
cognitive burden
Initial Recommendations
● Introduce information where it’s needed
● Online and offline components of the process should refer to each
other and set clear expectations of next steps and timelines
● Provide meaningful in-context help to reduce reliance on external
help documentation, as well as providing links to all external
documentation referenced
● Inline error validation should help users fix errors
● Use 508-compliant designs

More Related Content

Similar to Heuristic Analysis of Oregon Unemployment Application

Asq Article Kreg Kukor
Asq Article Kreg KukorAsq Article Kreg Kukor
Asq Article Kreg Kukor
kkukor
 
CommonAnalyticMistakes_v1.17_Unbranded
CommonAnalyticMistakes_v1.17_UnbrandedCommonAnalyticMistakes_v1.17_Unbranded
CommonAnalyticMistakes_v1.17_Unbranded
Jim Parnitzke
 
Ten Usability Heuristics by Jakob Nielsen.pptx
Ten Usability Heuristics by Jakob Nielsen.pptxTen Usability Heuristics by Jakob Nielsen.pptx
Ten Usability Heuristics by Jakob Nielsen.pptx
sharmiladevi941
 
UX class presentation
UX class presentationUX class presentation
UX class presentation
Theo V
 

Similar to Heuristic Analysis of Oregon Unemployment Application (20)

How Do You Know if Your Project Is Any Good?
How Do You Know if Your Project Is Any Good?How Do You Know if Your Project Is Any Good?
How Do You Know if Your Project Is Any Good?
 
Managing stakeholder relationships: The key to successful product features
Managing stakeholder relationships: The key to successful product featuresManaging stakeholder relationships: The key to successful product features
Managing stakeholder relationships: The key to successful product features
 
TechSoup Connect Texas: Creating a Tech Stack Built Around QBO
TechSoup Connect Texas: Creating a Tech Stack Built Around QBOTechSoup Connect Texas: Creating a Tech Stack Built Around QBO
TechSoup Connect Texas: Creating a Tech Stack Built Around QBO
 
Best Practices to Drive Business Intelligence User Adoption
Best Practices to Drive Business Intelligence User AdoptionBest Practices to Drive Business Intelligence User Adoption
Best Practices to Drive Business Intelligence User Adoption
 
Top 10 Tips for Smart Software Selection Success Before the Search
Top 10 Tips for Smart Software Selection Success Before the SearchTop 10 Tips for Smart Software Selection Success Before the Search
Top 10 Tips for Smart Software Selection Success Before the Search
 
Rules for great digital government
Rules for great digital governmentRules for great digital government
Rules for great digital government
 
Simplifying Analytics - by Novoniel Deb
Simplifying Analytics - by Novoniel DebSimplifying Analytics - by Novoniel Deb
Simplifying Analytics - by Novoniel Deb
 
Baby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and YouBaby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and You
 
Baby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and YouBaby Got Batch: SEVIS Batching and You
Baby Got Batch: SEVIS Batching and You
 
Story writing
Story writingStory writing
Story writing
 
Asq Article Kreg Kukor
Asq Article Kreg KukorAsq Article Kreg Kukor
Asq Article Kreg Kukor
 
Management Information System UX Case study
Management Information System UX Case studyManagement Information System UX Case study
Management Information System UX Case study
 
CommonAnalyticMistakes_v1.17_Unbranded
CommonAnalyticMistakes_v1.17_UnbrandedCommonAnalyticMistakes_v1.17_Unbranded
CommonAnalyticMistakes_v1.17_Unbranded
 
How to Run a Data Driven Product Dev Organization by Skedulo CPM
How to Run a Data Driven Product Dev Organization by Skedulo CPMHow to Run a Data Driven Product Dev Organization by Skedulo CPM
How to Run a Data Driven Product Dev Organization by Skedulo CPM
 
Create User Flow & Wireframing for an Application
Create User Flow & Wireframing for an ApplicationCreate User Flow & Wireframing for an Application
Create User Flow & Wireframing for an Application
 
Ten Usability Heuristics by Jakob Nielsen.pptx
Ten Usability Heuristics by Jakob Nielsen.pptxTen Usability Heuristics by Jakob Nielsen.pptx
Ten Usability Heuristics by Jakob Nielsen.pptx
 
Interactive workshop: how to capture and visualize business process (NYBPP Me...
Interactive workshop: how to capture and visualize business process (NYBPP Me...Interactive workshop: how to capture and visualize business process (NYBPP Me...
Interactive workshop: how to capture and visualize business process (NYBPP Me...
 
L16 Documenting Software
L16 Documenting SoftwareL16 Documenting Software
L16 Documenting Software
 
UX class presentation
UX class presentationUX class presentation
UX class presentation
 
Workflow enhances ECM adoption_LaserFicheEpower14
Workflow enhances ECM adoption_LaserFicheEpower14Workflow enhances ECM adoption_LaserFicheEpower14
Workflow enhances ECM adoption_LaserFicheEpower14
 

Recently uploaded

The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
shinachiaurasa2
 

Recently uploaded (20)

Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
 
LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456
LEVEL 5   - SESSION 1 2023 (1).pptx - PDF 123456LEVEL 5   - SESSION 1 2023 (1).pptx - PDF 123456
LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456
 
8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students
 
Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf
Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdfPayment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf
Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf
 
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
 
Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdf
 
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
 
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfThe Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
 
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionIntroducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
 
VTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learnVTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learn
 
BUS PASS MANGEMENT SYSTEM USING PHP.pptx
BUS PASS MANGEMENT SYSTEM USING PHP.pptxBUS PASS MANGEMENT SYSTEM USING PHP.pptx
BUS PASS MANGEMENT SYSTEM USING PHP.pptx
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 

Heuristic Analysis of Oregon Unemployment Application

  • 1. Daveena Tauber Ph.D. Oregon Unemployment Application Heuristic Analysis
  • 2. Need Statement As of March 2020, applying for unemployment became a user experience shared by millions of Americans. In some situations, users may find themselves struggling with outdated and unclear UIs that impose undue burden during this high-stakes task. This case study from Oregon is a case in point. State governments should incorporate UX research to make sure that critical access to benefits are accessible by citizens at all educational and ability levels. They should present information clearly, reduce cognitive load, and prevent data loss.
  • 3. System Status Visibility ● No initial mental map of steps involved ● No cues about where the user is in this long process. ● Conflicting and threatening warnings about time-outs ● References to specific days of the week may add to confusion ● Provide a clear mental map of the steps ● Provide temporal orientation ○ How long will the process take? ○ How long do users have before they are timed out? ● Provide progress bar or other visual indicator of system status OpportunitiesChallenges POOR
  • 4. Confusing messages about time-outs and order of operations So is it 10 minutes or 30 minutes? Why would I cancel before I’ve even begun the application?
  • 5. Confusing messages about days of the week Sunday of which week? What if I lost my job two weeks ago? What if today is Friday? Do I call today or next week?
  • 6. Match Between System and Real World ● Announced as an “online” process, but there is no signal that a critical step involves receiving a Customer ID by mail. What if I don’t have a current address? ● No information in the mailed form about where to re-engage in the online process of setting up payment ● Instructions (on where to call for help) appear without links or phone numbers. ● Orient users to all steps, online and offline ● Create bridges between online and offline parts of the process ● Provide links and phone numbers for all offices and call centers OpportunitiesChallenges POOR
  • 7. Lack of links to real world resources Here it says to call a local WorkSource office. Below it says local offices are not handling claims. Are these the same thing? Do I really need to know this? I’m confused!
  • 8. User Control and Freedom ● No data is saved until the final submission, forcing a single high-stakes session with a high probability of redo ● Use of browser back function will end the session and lose all data ● Currently a few pages have an edit ability, but low trust makes this them risky proposition ● Over use of scare warnings create anxiety rather than security ● Develop a back-end solution to save sessions so that users are not in danger of losing data ● Allow users to return, edit, and review data ● Create clear ways to navigate in and out of the application and payment set-up process OpportunitiesChallenges POOR
  • 9. Little control or freedom Gah! This process sounds stressful. What if I make a mistake? Do I have to start over?
  • 10. Consistency and Standards ● Low consistency in ○ design patterns ○ information hierarchy ○ warning messages ○ headings ● Information not introduced in logical sequence ● Key terms are not defined ● Use a consistent design pattern that uses information hierarchy and color to express importance, reducing reliance on scare warnings ● Introduce and reinforce information where the user needs it ● Offer in-context definitions of important terms OpportunitiesChallenges POOR
  • 11. Use standards such as having buttons become active when ready Am I really finished? This button doesn’t give me any clues.
  • 12. Define key terms What does processed mean? Does that happen online? Offline? How/will I know when it’s done?
  • 13. Error Prevention ● System currently presents ample opportunities for errors that lead to having to re-enter data ● Active “cancel transaction” and inactive “continue” button mean users have to actively overcome the stronger call to action ● Little in-context help raises risk of error from users exiting to find help OpportunitiesChallenges POOR ● Frontload clear information about the process ● Save session data and allow editing and review ● Use conventional button design ● Provide in-context help
  • 14. Opportunities for error This link looks active, so I’m likely to click it thinking it’s the way forward!
  • 15. Recognition Rather than Recall ● Users have to remember which centers can be called for help (confusing information at the beginning) since links are not always present ● Users are told not to “go back” except in a few situation, creating tension between recall and functionality ● Offer consistent, intuitive functionality so that users don’t have to remember what is ok to do and not do in the system OpportunitiesChallenges POOR
  • 16. Need for recall This info appears before I start the claim, but not while I’m doing it. I don’t remember where to go for help. I’m also likely to have questions during the process. This link appears before I start but not during the application.
  • 17. Flexibility and Efficiency of Use ● Little flexibility in the timeline for inputting data ● Saving sessions will allow greater flexibility OpportunitiesChallenges POOR
  • 18. Aesthetic and Minimalist Design ● Use of single font size is minimalist but not aesthetic or functional, resulting in over-reliance of “scare tactics” rather than information hierarchy ● Use of multiple patterns for attention grabbing adds to cognitive burden ● Inconsistent use of background pattern doesn’t add to visual clarity ● Extreme visual density reduces legibility ● Very small font size and tiny form fields add to visual strain and reduce accessibility ● Use information hierarchy to communicate importance ● Reduce visual density. Where dense text is necessary, increase white space ● Increase font size and form fields OpportunitiesChallenges POOR
  • 19. Multiple ways of signaling importance creates attention fatigue
  • 20. Dense text adds to cognitive burden What’s important here? I can’t tell at a glance.
  • 21. Inconsistent use of background pattern doesn’t add to visual clarity
  • 22. Recognize and Fix Errors ● Because the form doesn’t save data, users have few chances to fix errors until after submission ● Conflicting messages about error correction result in low system trust ● One error message doesn’t map to actual form fields, making it difficult to correct error ● Allow users to review data prior to submission OpportunitiesChallenges POOR
  • 23. Conflicting messages about error correction create low system trust Here I am told I can’t go back and fix anything But these two forms suggest I can. I’m too scared of losing all my data to try these options.
  • 24. Help Documentation ● Information is not introduced where it’s needed ● In-context help appears in relation to seemingly random items, rather than in relation to high-need items ● Lacks links to help documentation ● Missing links to “real world” help ● Introduce information when and where it is needed ● Provide in-context help where it is most needed ● Provide clear and consistent links to help documentation ● Provide links to “real world” help clear throughout OpportunitiesChallenges POOR
  • 25. In-context help isn’t attached to most important interactions
  • 26. Initial Recommendations ● Provide back-end solution to save sessions once users have entered their social security number, pin, and security questions. Forcing a single session may result in high rates of start-over and possible difficulty accessing benefits. ● Create a clear mental map for users of the entire workflow, including online and offline components ● Use best practices in information hierarchy to provide clear information and reduce reliance on “scare warnings” ● Use clear, consistent design patterns to reduce visual and cognitive burden
  • 27. Initial Recommendations ● Introduce information where it’s needed ● Online and offline components of the process should refer to each other and set clear expectations of next steps and timelines ● Provide meaningful in-context help to reduce reliance on external help documentation, as well as providing links to all external documentation referenced ● Inline error validation should help users fix errors ● Use 508-compliant designs