SlideShare a Scribd company logo
Howto.gov/firstfridays
Why the best gov sites
use User-Centered Design
Jonathan Rubin
First Fridays Usability Program
User-Centered Design Takeaways
1. UCD saves money and improves websites
2. Gov’t and top companies already use it
3. UCD = good customer service
4. Use early and often
5. First Fridays can help teach you about
UCD
Howto.gov/firstfridays
Howto.gov/firstfridays
1. What is
User-Centered
Design?
You are not your users
Howto.gov/firstfridays
You
Target
Audience
User-Centered Design =
Focusing on needs, wants, and
limitations of target audience of a
product at each stage of the design
process.
Howto.gov/firstfridays
User-Centered Design
Research Design User Testing
(Usability)
• Planning
• Requirements
• Surveys
• Focus Groups
• Personas
• Interviews
• Content
Organization
• Tasks
• Prototypes
• Usability
Testing
• Expert Eval.
• Interviews
• 508 Testing
Howto.gov/firstfridays
5 E’s of Usable Products
• Effective
• Efficient
• Engaging
• Error Tolerant
• Easy to Learn
- Whitney Quesenbery (2004) ‘Balancing the 5Es: Usability’
Howto.gov/firstfridays
Here!
Howto.gov/firstfridays
User-Centered Design:
Not a soft science
Rooted in:
• Cognitive Science - 1930s
• Human Factors and Ergonomics - WWI
• "Scientific Management" - 19th cen.
• Scientific Method
Howto.gov/firstfridays
UCD degrees at
60+ Universities
Stanford
Carnegie Mellon
Univ of Michigan
NYU
Penn State
University of
Wisconsin-Madison
Fortune 500
companies with
UCD teams
Walmart
Apple
GE
GM
Ford
Google, etc.
Howto.gov/firstfridays
From 2013 Survey: # UCD staff
Howto.gov/firstfridaysHowto.gov/firstfridays
Part Time Full Time
Had at least 1
person
86% 59%
Average # of
people
2 3
Range of
people
0-10 0-30
Howto.gov/firstfridaysHowto.gov/firstfridays
3%
19%
46%
25%
8%
0% 10% 20% 30% 40% 50%
Top to Bottom
UX
Used frequently
Occasional UX
Know but don't
practice
No one knows
UX
How widespread is UCD / UX at your
organization?
Increase
• User success on tasks
• Site visits
• Customer Satisfaction
Decrease
• Time to complete tasks
• Volume of emails / help calls
• Development Costs
Howto.gov/firstfridays
Benefits of good design
UCD = Good Customer Service
Poor design = budget overruns
Three reasons websites go over budget:
1. Requests for changes by users
2. Users can't accomplish key tasks
3. Lack of communication with users
- Lederer & Prasad, ‘Nine Management Guidelines for Better Cost
Estimating’ CACM 35 (2).
Howto.gov/firstfridays
The user is always right. If there is a
problem with the use of the system,
the system is the problem, not the
user.
- IBM usability expert Dr. Clare-Marie Karat
Howto.gov/firstfridays
For developers and manufacturers,
the advantages of creating usable
products far outweigh the costs.
The rule of thumb: Every dollar
invested in ease of use returns $10
to $100.
- IBM "On User-Centered Design"
Howto.gov/firstfridays
Howto.gov/firstfridays
2. Usability
Testing 101
User-Centered Design
Research Design User Testing
(Usability)
• Surveys
• Focus Groups
• Personas
• User
Requirements
• Interviews
• Content
Organization
• Tasks
• Prototypes
• Usability
Testing
• Expert Eval.
• Interviews
• 508 Testing
Howto.gov/firstfridays
Usability Testing (aka User Testing)
Setting a series of tasks for people to
complete and noting any problems
they encounter
– Andy Budd
Howto.gov/firstfridays
@jonathan_rubin
Usability is like oxygen - you
never notice it until it is missing
- Anonymous
What you need to do a test
1. Something to test (site, poster, service, etc.)
2. Tasks for people to do
Howto.gov/firstfridays
Top Tasks – Why they’re here
• Learn about your services
• Find your contact information
• Register for a class
• Purchase something
• Leave a comment
• Get a rate quote
Howto.gov/firstfridays
What’s on a testing script
• Give intro and ground rules
• Questions about user
• Sign release (if recording)
• Easy Tasks
• Harder tasks
• Post-test questions (optional)
• Thanks and incentive (if any)
Howto.gov/firstfridays
Active Listening / Think-Aloud Protocol
• Silent, Traditional, or Coaching (we’ll use this)
• Designed to get unbiased data
• Tester does 90% of talking
• Ask Open Ended Questions (if any)
• Be unbiased: Don’t let on if they are right or
wrong
Howto.gov/firstfridays
If… Don’t Say Say
They aren’t
talking
“Hey – we’re
paying you
here…”
“What are you
thinking?”
They get a
task wrong
“Oops – that’s
wrong!”
“Thanks for
the feedback!”
They get a
task right
“Good job!” “That’s very
helpful!”
Howto.gov/firstfridays
If… Don’t Say Say
They screw up
majorly and
get upset
“Ha ha ha..
OMG!”
“Remember,
you can’t do
anything
wrong,” or
“You’re doing
a great job!”
They criticize
your design
“Hey – we
worked really
hard on this!”
“Thanks for the
feedback!”
Howto.gov/firstfridays
If… Say
They aren’t talking
They get a task
wrong
They get a task right
Howto.gov/firstfridays
If… Say
They screw up
majorly and get upset
They criticize your
design
Howto.gov/firstfridays
Howto.gov/firstfridays
4. Website Best
Practices
Most common website problems
1. Users can't understand purpose of site
2. Top tasks difficult to complete
3. Too much text / information not prioritized
4. Confusing or obscure terms
5. Navigation not consistent
Howto.gov/firstfridays
Website Best Practices
1. Clear starting point
2. Have cream rise to the top
3. Make search simple
4. Plain Language
5. Consistent navigation
Howto.gov/firstfridays
1. Give a clear starting point
Howto.gov/firstfridays
Howto.gov/firstfridays
Howto.gov/firstfridays
2. Make cream rise to the top
Howto.gov/firstfridays
5. Difficulty with top tasks
1. Can’t find info via any means or know
where to begin
5. Difficulty with top tasks
1. Can’t find info via any means or know
where to begin
3. Use Plain Language
Howto.gov/firstfridays
Howto.gov/firstfridays
Howto.gov/firstfridays
4. Make search simple
Howto.gov/firstfridaysHowto.gov/firstfridays
Howto.gov/firstfridaysHowto.gov/firstfridays
Howto.gov/firstfridaysHowto.gov/firstfridays
Howto.gov/firstfridaysHowto.gov/firstfridays
Howto.gov/firstfridaysHowto.gov/firstfridays
Howto.gov/fiHowto.gov/f
Before: 7 text items to scan
After: 3 text items to scan
5. Consistent Navigation
Howto.gov/firstfridays
Howto.gov/firstfridays
Howto.gov/firstfridays
6 things you can do right now
1. Talk to users
2. Define top 3 target audience groups
3. Determine top tasks / Prioritize content
4. Expert Evaluation (Howto.gov/firstfridays )
5. Usability test (Rocket Surgery Made Easy)
6. Training (us or DigitalGov University)
Howto.gov/firstfridays
Howto.gov/firstfridays
6. In Conclusion
User-Centered Design Takeaways
1. UCD saves money and improves websites
2. Gov’t and top companies already use it
3. UCD = good customer service
4. Use early and often
5. First Fridays can help teach you about
UCD
Howto.gov/firstfridays
First Fridays Usability Program
Jonathan Rubin
Jonathan.rubin@gsa.gov
Twitter: @govnewmedia
www.Howto.gov/firstfridays
Howto.gov/firstfridaysHowto.gov/firstfridays

More Related Content

What's hot

Principles of Usability Testing For Historic Newspapers
Principles of Usability Testing For Historic NewspapersPrinciples of Usability Testing For Historic Newspapers
Principles of Usability Testing For Historic Newspapers
Europeana Newspapers
 
Importance of the Usability of a website
Importance of the Usability of a websiteImportance of the Usability of a website
Importance of the Usability of a website
Sherihan Anver
 
Usability Testing by Rajdeep Gupta, Misys
Usability Testing by Rajdeep Gupta, MisysUsability Testing by Rajdeep Gupta, Misys
Usability Testing by Rajdeep Gupta, Misys
STC India UX SIG
 
Predictive Analytics with UX Research Data: Yes We Can!
Predictive Analytics with UX Research Data: Yes We Can!Predictive Analytics with UX Research Data: Yes We Can!
Predictive Analytics with UX Research Data: Yes We Can!
UXPA Boston
 
Module 10: Usability Testing
Module 10: Usability TestingModule 10: Usability Testing
Module 10: Usability Testing
Daniel Drew Turner
 
The what, when, why and how of usability
The what, when, why and how of usabilityThe what, when, why and how of usability
The what, when, why and how of usabilitySimpleUsability
 
Sins of a UX Researcher
Sins of a UX ResearcherSins of a UX Researcher
Sins of a UX Researcher
Kyle Soucy
 
Putting Personas to Work at IIBA Cleveland
Putting Personas to Work at IIBA ClevelandPutting Personas to Work at IIBA Cleveland
Putting Personas to Work at IIBA Cleveland
Carol Smith
 
Improving Forms with User Experience Testing and Eye Tracking
Improving Forms with User Experience Testing and Eye TrackingImproving Forms with User Experience Testing and Eye Tracking
Improving Forms with User Experience Testing and Eye Tracking
Jennifer Romano Bergstrom
 
Introducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on DemandIntroducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on Demand
UserTesting
 
Usability Testing Basics: Remote and In-Person Studies
Usability Testing Basics: Remote and In-Person StudiesUsability Testing Basics: Remote and In-Person Studies
Usability Testing Basics: Remote and In-Person Studies
UXPA International
 
Benchmarking Usability Performance
Benchmarking Usability PerformanceBenchmarking Usability Performance
Benchmarking Usability Performance
Jennifer Romano Bergstrom
 
Unbiased Methods to Understand the User Experience
Unbiased Methods to Understand the User ExperienceUnbiased Methods to Understand the User Experience
Unbiased Methods to Understand the User Experience
Jennifer Romano Bergstrom
 
Open Plans User Testing Workshop
Open Plans User Testing WorkshopOpen Plans User Testing Workshop
Open Plans User Testing Workshop
Cyd Harrell
 
Putting Personas to Work at UX Pittsburgh
Putting Personas to Work at UX PittsburghPutting Personas to Work at UX Pittsburgh
Putting Personas to Work at UX Pittsburgh
Carol Smith
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Carol Smith
 
Intro to User eXperience
Intro to User eXperienceIntro to User eXperience
Intro to User eXperience
Mike Gallers
 
Intro to Lean UX with UserTesting
Intro to Lean UX with UserTestingIntro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
Carlos González de Villaumbrosia
 
UX 101: Making Great Human Experiences at Pittsburgh PodCamp 9
UX 101: Making Great Human Experiences at Pittsburgh PodCamp 9UX 101: Making Great Human Experiences at Pittsburgh PodCamp 9
UX 101: Making Great Human Experiences at Pittsburgh PodCamp 9
Carol Smith
 
Usability Testing Basics
Usability Testing BasicsUsability Testing Basics
Usability Testing Basics
Stephen Francoeur
 

What's hot (20)

Principles of Usability Testing For Historic Newspapers
Principles of Usability Testing For Historic NewspapersPrinciples of Usability Testing For Historic Newspapers
Principles of Usability Testing For Historic Newspapers
 
Importance of the Usability of a website
Importance of the Usability of a websiteImportance of the Usability of a website
Importance of the Usability of a website
 
Usability Testing by Rajdeep Gupta, Misys
Usability Testing by Rajdeep Gupta, MisysUsability Testing by Rajdeep Gupta, Misys
Usability Testing by Rajdeep Gupta, Misys
 
Predictive Analytics with UX Research Data: Yes We Can!
Predictive Analytics with UX Research Data: Yes We Can!Predictive Analytics with UX Research Data: Yes We Can!
Predictive Analytics with UX Research Data: Yes We Can!
 
Module 10: Usability Testing
Module 10: Usability TestingModule 10: Usability Testing
Module 10: Usability Testing
 
The what, when, why and how of usability
The what, when, why and how of usabilityThe what, when, why and how of usability
The what, when, why and how of usability
 
Sins of a UX Researcher
Sins of a UX ResearcherSins of a UX Researcher
Sins of a UX Researcher
 
Putting Personas to Work at IIBA Cleveland
Putting Personas to Work at IIBA ClevelandPutting Personas to Work at IIBA Cleveland
Putting Personas to Work at IIBA Cleveland
 
Improving Forms with User Experience Testing and Eye Tracking
Improving Forms with User Experience Testing and Eye TrackingImproving Forms with User Experience Testing and Eye Tracking
Improving Forms with User Experience Testing and Eye Tracking
 
Introducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on DemandIntroducing Live Conversation | Human Insight on Demand
Introducing Live Conversation | Human Insight on Demand
 
Usability Testing Basics: Remote and In-Person Studies
Usability Testing Basics: Remote and In-Person StudiesUsability Testing Basics: Remote and In-Person Studies
Usability Testing Basics: Remote and In-Person Studies
 
Benchmarking Usability Performance
Benchmarking Usability PerformanceBenchmarking Usability Performance
Benchmarking Usability Performance
 
Unbiased Methods to Understand the User Experience
Unbiased Methods to Understand the User ExperienceUnbiased Methods to Understand the User Experience
Unbiased Methods to Understand the User Experience
 
Open Plans User Testing Workshop
Open Plans User Testing WorkshopOpen Plans User Testing Workshop
Open Plans User Testing Workshop
 
Putting Personas to Work at UX Pittsburgh
Putting Personas to Work at UX PittsburghPutting Personas to Work at UX Pittsburgh
Putting Personas to Work at UX Pittsburgh
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
 
Intro to User eXperience
Intro to User eXperienceIntro to User eXperience
Intro to User eXperience
 
Intro to Lean UX with UserTesting
Intro to Lean UX with UserTestingIntro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
 
UX 101: Making Great Human Experiences at Pittsburgh PodCamp 9
UX 101: Making Great Human Experiences at Pittsburgh PodCamp 9UX 101: Making Great Human Experiences at Pittsburgh PodCamp 9
UX 101: Making Great Human Experiences at Pittsburgh PodCamp 9
 
Usability Testing Basics
Usability Testing BasicsUsability Testing Basics
Usability Testing Basics
 

Similar to Why the best gov sites use User-Centered Design

User Experience Design: an Overview
User Experience Design: an OverviewUser Experience Design: an Overview
User Experience Design: an Overview
Julie Grundy
 
User Research Fast & Cheap
User Research Fast & Cheap User Research Fast & Cheap
User Research Fast & Cheap
John H Douglass
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for Startups
Perfetti Media
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
VWO
 
Selling UX at CodeMash 2012
Selling UX at CodeMash 2012Selling UX at CodeMash 2012
Selling UX at CodeMash 2012
Carol Smith
 
Selling UX in Your Organization - Stir Trek 2012
Selling UX in Your Organization - Stir Trek 2012Selling UX in Your Organization - Stir Trek 2012
Selling UX in Your Organization - Stir Trek 2012
Carol Smith
 
Organizing Your First Website Usability Test - WordCamp Toronto 2016
Organizing Your First Website Usability Test - WordCamp Toronto 2016Organizing Your First Website Usability Test - WordCamp Toronto 2016
Organizing Your First Website Usability Test - WordCamp Toronto 2016
Anthony D. Paul
 
Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018
Jagriti Pande
 
Designing to save lives: Government technical documentation
Designing  to save  lives: Government technical documentation Designing  to save  lives: Government technical documentation
Designing to save lives: Government technical documentation
Laurian Vega
 
Intro to Product Management
Intro to Product Management Intro to Product Management
Intro to Product Management
Ria Sankar
 
Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4
Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4
Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4
Anthony D. Paul
 
The art of problem solving --> ensure you right the right business requiremen...
The art of problem solving --> ensure you right the right business requiremen...The art of problem solving --> ensure you right the right business requiremen...
The art of problem solving --> ensure you right the right business requiremen...
Chris Lamoureux
 
Fail Early or Fail Large - WPCampus - July 2019
Fail Early or Fail Large - WPCampus - July 2019Fail Early or Fail Large - WPCampus - July 2019
Fail Early or Fail Large - WPCampus - July 2019
Randy Earl
 
Building a wow product by @RuthlessUx
Building a wow product by @RuthlessUxBuilding a wow product by @RuthlessUx
Building a wow product by @RuthlessUx
SHAHEENA ATTARWALA
 
Web Analytics Wednesday - Session Replay Tools are Vital
Web Analytics Wednesday - Session Replay Tools are VitalWeb Analytics Wednesday - Session Replay Tools are Vital
Web Analytics Wednesday - Session Replay Tools are Vital
Craig Sullivan
 
Usability Tips And Tricks For Beginners Experience Dynamics Web Seminar
Usability Tips And Tricks For Beginners   Experience Dynamics Web SeminarUsability Tips And Tricks For Beginners   Experience Dynamics Web Seminar
Usability Tips And Tricks For Beginners Experience Dynamics Web Seminar
Experience Dynamics
 
體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達
Visual Cognition and Modeling Lab
 
Google Product Development Process
Google Product Development ProcessGoogle Product Development Process
Google Product Development ProcessAbhinav Goel
 
Walk, Don't Run: Incremental Change in Enterprise UX
Walk, Don't Run: Incremental Change in Enterprise UXWalk, Don't Run: Incremental Change in Enterprise UX
Walk, Don't Run: Incremental Change in Enterprise UX
uxpin
 
Usability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath SelvarajUsability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath SelvarajSivaprasath Selvaraj
 

Similar to Why the best gov sites use User-Centered Design (20)

User Experience Design: an Overview
User Experience Design: an OverviewUser Experience Design: an Overview
User Experience Design: an Overview
 
User Research Fast & Cheap
User Research Fast & Cheap User Research Fast & Cheap
User Research Fast & Cheap
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for Startups
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
 
Selling UX at CodeMash 2012
Selling UX at CodeMash 2012Selling UX at CodeMash 2012
Selling UX at CodeMash 2012
 
Selling UX in Your Organization - Stir Trek 2012
Selling UX in Your Organization - Stir Trek 2012Selling UX in Your Organization - Stir Trek 2012
Selling UX in Your Organization - Stir Trek 2012
 
Organizing Your First Website Usability Test - WordCamp Toronto 2016
Organizing Your First Website Usability Test - WordCamp Toronto 2016Organizing Your First Website Usability Test - WordCamp Toronto 2016
Organizing Your First Website Usability Test - WordCamp Toronto 2016
 
Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018
 
Designing to save lives: Government technical documentation
Designing  to save  lives: Government technical documentation Designing  to save  lives: Government technical documentation
Designing to save lives: Government technical documentation
 
Intro to Product Management
Intro to Product Management Intro to Product Management
Intro to Product Management
 
Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4
Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4
Organizing Your First Website Usability Test - Cornell Drupal Camp 2016 - part 4
 
The art of problem solving --> ensure you right the right business requiremen...
The art of problem solving --> ensure you right the right business requiremen...The art of problem solving --> ensure you right the right business requiremen...
The art of problem solving --> ensure you right the right business requiremen...
 
Fail Early or Fail Large - WPCampus - July 2019
Fail Early or Fail Large - WPCampus - July 2019Fail Early or Fail Large - WPCampus - July 2019
Fail Early or Fail Large - WPCampus - July 2019
 
Building a wow product by @RuthlessUx
Building a wow product by @RuthlessUxBuilding a wow product by @RuthlessUx
Building a wow product by @RuthlessUx
 
Web Analytics Wednesday - Session Replay Tools are Vital
Web Analytics Wednesday - Session Replay Tools are VitalWeb Analytics Wednesday - Session Replay Tools are Vital
Web Analytics Wednesday - Session Replay Tools are Vital
 
Usability Tips And Tricks For Beginners Experience Dynamics Web Seminar
Usability Tips And Tricks For Beginners   Experience Dynamics Web SeminarUsability Tips And Tricks For Beginners   Experience Dynamics Web Seminar
Usability Tips And Tricks For Beginners Experience Dynamics Web Seminar
 
體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達體驗劇場_1050524_W14_易用性測試_楊政達
體驗劇場_1050524_W14_易用性測試_楊政達
 
Google Product Development Process
Google Product Development ProcessGoogle Product Development Process
Google Product Development Process
 
Walk, Don't Run: Incremental Change in Enterprise UX
Walk, Don't Run: Incremental Change in Enterprise UXWalk, Don't Run: Incremental Change in Enterprise UX
Walk, Don't Run: Incremental Change in Enterprise UX
 
Usability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath SelvarajUsability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath Selvaraj
 

More from DigitalGov from General Services Administration

OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
DigitalGov from General Services Administration
 
Gifs from Government Records
Gifs from Government RecordsGifs from Government Records
Accessibility for Animated Gifs
Accessibility for Animated GifsAccessibility for Animated Gifs
Accessibility for Animated Gifs
DigitalGov from General Services Administration
 
Peace Corps and Animated Gifs
Peace Corps and Animated GifsPeace Corps and Animated Gifs
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
DigitalGov from General Services Administration
 
Collecting Customer Experience Data
Collecting Customer Experience DataCollecting Customer Experience Data
Collecting Customer Experience Data
DigitalGov from General Services Administration
 
Introduction - Equal Employment Opportunity Commission (EEOC)
Introduction - Equal Employment Opportunity Commission (EEOC)Introduction - Equal Employment Opportunity Commission (EEOC)
Introduction - Equal Employment Opportunity Commission (EEOC)
DigitalGov from General Services Administration
 
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPBWebinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
DigitalGov from General Services Administration
 
Prizes, Contracts & Grants: What Should I Do?
Prizes, Contracts & Grants: What Should I Do?Prizes, Contracts & Grants: What Should I Do?
Prizes, Contracts & Grants: What Should I Do?
DigitalGov from General Services Administration
 
Gs awebinar al
Gs awebinar alGs awebinar al
Deconstructing Challenges Webinar
Deconstructing Challenges WebinarDeconstructing Challenges Webinar
Deconstructing Challenges Webinar
DigitalGov from General Services Administration
 
Amendment to Yammer, Inc. Terms of Service (TOS)
Amendment to Yammer, Inc. Terms of Service (TOS)Amendment to Yammer, Inc. Terms of Service (TOS)
Amendment to Yammer, Inc. Terms of Service (TOS)
DigitalGov from General Services Administration
 
Hulu Content Deal Memorandum
Hulu Content Deal MemorandumHulu Content Deal Memorandum
Amendment to LinkedIn User Agreement
Amendment to LinkedIn User AgreementAmendment to LinkedIn User Agreement
Amendment to LinkedIn User Agreement
DigitalGov from General Services Administration
 
MeetUp Terms of Service (TOS) Amendment
MeetUp Terms of Service (TOS) AmendmentMeetUp Terms of Service (TOS) Amendment
MeetUp Terms of Service (TOS) Amendment
DigitalGov from General Services Administration
 
MySpace Side Letter Agreement, Execution Version
MySpace Side Letter Agreement, Execution VersionMySpace Side Letter Agreement, Execution Version
MySpace Side Letter Agreement, Execution Version
DigitalGov from General Services Administration
 

More from DigitalGov from General Services Administration (20)

OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
 
Gifs from Government Records
Gifs from Government RecordsGifs from Government Records
Gifs from Government Records
 
Accessibility for Animated Gifs
Accessibility for Animated GifsAccessibility for Animated Gifs
Accessibility for Animated Gifs
 
Peace Corps and Animated Gifs
Peace Corps and Animated GifsPeace Corps and Animated Gifs
Peace Corps and Animated Gifs
 
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
 
Collecting Customer Experience Data
Collecting Customer Experience DataCollecting Customer Experience Data
Collecting Customer Experience Data
 
Introduction - Equal Employment Opportunity Commission (EEOC)
Introduction - Equal Employment Opportunity Commission (EEOC)Introduction - Equal Employment Opportunity Commission (EEOC)
Introduction - Equal Employment Opportunity Commission (EEOC)
 
Cdc clear communication index webinar slides
Cdc clear communication index webinar slidesCdc clear communication index webinar slides
Cdc clear communication index webinar slides
 
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPBWebinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
 
Optimizing your public sector web analytics program pt3
Optimizing your public sector web analytics program pt3Optimizing your public sector web analytics program pt3
Optimizing your public sector web analytics program pt3
 
Optimizing your public sector web analytics program pt2
Optimizing your public sector web analytics program pt2Optimizing your public sector web analytics program pt2
Optimizing your public sector web analytics program pt2
 
Optimizing your public sector web analytics program pt1
Optimizing your public sector web analytics program pt1Optimizing your public sector web analytics program pt1
Optimizing your public sector web analytics program pt1
 
Prizes, Contracts & Grants: What Should I Do?
Prizes, Contracts & Grants: What Should I Do?Prizes, Contracts & Grants: What Should I Do?
Prizes, Contracts & Grants: What Should I Do?
 
Gs awebinar al
Gs awebinar alGs awebinar al
Gs awebinar al
 
Deconstructing Challenges Webinar
Deconstructing Challenges WebinarDeconstructing Challenges Webinar
Deconstructing Challenges Webinar
 
Amendment to Yammer, Inc. Terms of Service (TOS)
Amendment to Yammer, Inc. Terms of Service (TOS)Amendment to Yammer, Inc. Terms of Service (TOS)
Amendment to Yammer, Inc. Terms of Service (TOS)
 
Hulu Content Deal Memorandum
Hulu Content Deal MemorandumHulu Content Deal Memorandum
Hulu Content Deal Memorandum
 
Amendment to LinkedIn User Agreement
Amendment to LinkedIn User AgreementAmendment to LinkedIn User Agreement
Amendment to LinkedIn User Agreement
 
MeetUp Terms of Service (TOS) Amendment
MeetUp Terms of Service (TOS) AmendmentMeetUp Terms of Service (TOS) Amendment
MeetUp Terms of Service (TOS) Amendment
 
MySpace Side Letter Agreement, Execution Version
MySpace Side Letter Agreement, Execution VersionMySpace Side Letter Agreement, Execution Version
MySpace Side Letter Agreement, Execution Version
 

Recently uploaded

CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
Congressional Budget Office
 
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHOMonitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Christina Parmionova
 
A proposed request for information on LIHTC
A proposed request for information on LIHTCA proposed request for information on LIHTC
A proposed request for information on LIHTC
Roger Valdez
 
Get Government Grants and Assistance Program
Get Government Grants and Assistance ProgramGet Government Grants and Assistance Program
Get Government Grants and Assistance Program
Get Government Grants
 
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdfPNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
ClaudioTebaldi2
 
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
850fcj96
 
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
johnmarimigallon
 
State crafting: Changes and challenges for managing the public finances
State crafting: Changes and challenges for managing the public financesState crafting: Changes and challenges for managing the public finances
State crafting: Changes and challenges for managing the public finances
ResolutionFoundation
 
2024: The FAR - Federal Acquisition Regulations, Part 37
2024: The FAR - Federal Acquisition Regulations, Part 372024: The FAR - Federal Acquisition Regulations, Part 37
2024: The FAR - Federal Acquisition Regulations, Part 37
JSchaus & Associates
 
Uniform Guidance 3.0 - The New 2 CFR 200
Uniform Guidance 3.0 - The New 2 CFR 200Uniform Guidance 3.0 - The New 2 CFR 200
Uniform Guidance 3.0 - The New 2 CFR 200
GrantManagementInsti
 
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Congressional Budget Office
 
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
850fcj96
 
Invitation Letter for an alumni association
Invitation Letter for an alumni associationInvitation Letter for an alumni association
Invitation Letter for an alumni association
elmerdalida001
 
Opinions on EVs: Metro Atlanta Speaks 2023
Opinions on EVs: Metro Atlanta Speaks 2023Opinions on EVs: Metro Atlanta Speaks 2023
Opinions on EVs: Metro Atlanta Speaks 2023
ARCResearch
 
2024: The FAR - Federal Acquisition Regulations, Part 38
2024: The FAR - Federal Acquisition Regulations, Part 382024: The FAR - Federal Acquisition Regulations, Part 38
2024: The FAR - Federal Acquisition Regulations, Part 38
JSchaus & Associates
 
ZGB - The Role of Generative AI in Government transformation.pdf
ZGB - The Role of Generative AI in Government transformation.pdfZGB - The Role of Generative AI in Government transformation.pdf
ZGB - The Role of Generative AI in Government transformation.pdf
Saeed Al Dhaheri
 
2024: The FAR - Federal Acquisition Regulations, Part 39
2024: The FAR - Federal Acquisition Regulations, Part 392024: The FAR - Federal Acquisition Regulations, Part 39
2024: The FAR - Federal Acquisition Regulations, Part 39
JSchaus & Associates
 
Donate to charity during this holiday season
Donate to charity during this holiday seasonDonate to charity during this holiday season
Donate to charity during this holiday season
SERUDS INDIA
 
Preliminary findings _OECD field visits to ten regions in the TSI EU mining r...
Preliminary findings _OECD field visits to ten regions in the TSI EU mining r...Preliminary findings _OECD field visits to ten regions in the TSI EU mining r...
Preliminary findings _OECD field visits to ten regions in the TSI EU mining r...
OECDregions
 
NHAI_Under_Implementation_01-05-2024.pdf
NHAI_Under_Implementation_01-05-2024.pdfNHAI_Under_Implementation_01-05-2024.pdf
NHAI_Under_Implementation_01-05-2024.pdf
AjayVejendla3
 

Recently uploaded (20)

CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
CBO’s Outlook for U.S. Fertility Rates: 2024 to 2054
 
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHOMonitoring Health for the SDGs - Global Health Statistics 2024 - WHO
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHO
 
A proposed request for information on LIHTC
A proposed request for information on LIHTCA proposed request for information on LIHTC
A proposed request for information on LIHTC
 
Get Government Grants and Assistance Program
Get Government Grants and Assistance ProgramGet Government Grants and Assistance Program
Get Government Grants and Assistance Program
 
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdfPNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
PNRR MADRID GREENTECH FOR BROWN NETWORKS NETWORKS MUR_MUSA_TEBALDI.pdf
 
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
如何办理(uoit毕业证书)加拿大安大略理工大学毕业证文凭证书录取通知原版一模一样
 
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
 
State crafting: Changes and challenges for managing the public finances
State crafting: Changes and challenges for managing the public financesState crafting: Changes and challenges for managing the public finances
State crafting: Changes and challenges for managing the public finances
 
2024: The FAR - Federal Acquisition Regulations, Part 37
2024: The FAR - Federal Acquisition Regulations, Part 372024: The FAR - Federal Acquisition Regulations, Part 37
2024: The FAR - Federal Acquisition Regulations, Part 37
 
Uniform Guidance 3.0 - The New 2 CFR 200
Uniform Guidance 3.0 - The New 2 CFR 200Uniform Guidance 3.0 - The New 2 CFR 200
Uniform Guidance 3.0 - The New 2 CFR 200
 
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
Effects of Extreme Temperatures From Climate Change on the Medicare Populatio...
 
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
快速制作(ocad毕业证书)加拿大安大略艺术设计学院毕业证本科学历雅思成绩单原版一模一样
 
Invitation Letter for an alumni association
Invitation Letter for an alumni associationInvitation Letter for an alumni association
Invitation Letter for an alumni association
 
Opinions on EVs: Metro Atlanta Speaks 2023
Opinions on EVs: Metro Atlanta Speaks 2023Opinions on EVs: Metro Atlanta Speaks 2023
Opinions on EVs: Metro Atlanta Speaks 2023
 
2024: The FAR - Federal Acquisition Regulations, Part 38
2024: The FAR - Federal Acquisition Regulations, Part 382024: The FAR - Federal Acquisition Regulations, Part 38
2024: The FAR - Federal Acquisition Regulations, Part 38
 
ZGB - The Role of Generative AI in Government transformation.pdf
ZGB - The Role of Generative AI in Government transformation.pdfZGB - The Role of Generative AI in Government transformation.pdf
ZGB - The Role of Generative AI in Government transformation.pdf
 
2024: The FAR - Federal Acquisition Regulations, Part 39
2024: The FAR - Federal Acquisition Regulations, Part 392024: The FAR - Federal Acquisition Regulations, Part 39
2024: The FAR - Federal Acquisition Regulations, Part 39
 
Donate to charity during this holiday season
Donate to charity during this holiday seasonDonate to charity during this holiday season
Donate to charity during this holiday season
 
Preliminary findings _OECD field visits to ten regions in the TSI EU mining r...
Preliminary findings _OECD field visits to ten regions in the TSI EU mining r...Preliminary findings _OECD field visits to ten regions in the TSI EU mining r...
Preliminary findings _OECD field visits to ten regions in the TSI EU mining r...
 
NHAI_Under_Implementation_01-05-2024.pdf
NHAI_Under_Implementation_01-05-2024.pdfNHAI_Under_Implementation_01-05-2024.pdf
NHAI_Under_Implementation_01-05-2024.pdf
 

Why the best gov sites use User-Centered Design

  • 1. Howto.gov/firstfridays Why the best gov sites use User-Centered Design Jonathan Rubin First Fridays Usability Program
  • 2. User-Centered Design Takeaways 1. UCD saves money and improves websites 2. Gov’t and top companies already use it 3. UCD = good customer service 4. Use early and often 5. First Fridays can help teach you about UCD Howto.gov/firstfridays
  • 4. You are not your users Howto.gov/firstfridays You Target Audience
  • 5. User-Centered Design = Focusing on needs, wants, and limitations of target audience of a product at each stage of the design process. Howto.gov/firstfridays
  • 6. User-Centered Design Research Design User Testing (Usability) • Planning • Requirements • Surveys • Focus Groups • Personas • Interviews • Content Organization • Tasks • Prototypes • Usability Testing • Expert Eval. • Interviews • 508 Testing Howto.gov/firstfridays
  • 7. 5 E’s of Usable Products • Effective • Efficient • Engaging • Error Tolerant • Easy to Learn - Whitney Quesenbery (2004) ‘Balancing the 5Es: Usability’ Howto.gov/firstfridays
  • 8.
  • 10.
  • 12. User-Centered Design: Not a soft science Rooted in: • Cognitive Science - 1930s • Human Factors and Ergonomics - WWI • "Scientific Management" - 19th cen. • Scientific Method Howto.gov/firstfridays
  • 13. UCD degrees at 60+ Universities Stanford Carnegie Mellon Univ of Michigan NYU Penn State University of Wisconsin-Madison Fortune 500 companies with UCD teams Walmart Apple GE GM Ford Google, etc. Howto.gov/firstfridays
  • 14. From 2013 Survey: # UCD staff Howto.gov/firstfridaysHowto.gov/firstfridays Part Time Full Time Had at least 1 person 86% 59% Average # of people 2 3 Range of people 0-10 0-30
  • 15. Howto.gov/firstfridaysHowto.gov/firstfridays 3% 19% 46% 25% 8% 0% 10% 20% 30% 40% 50% Top to Bottom UX Used frequently Occasional UX Know but don't practice No one knows UX How widespread is UCD / UX at your organization?
  • 16. Increase • User success on tasks • Site visits • Customer Satisfaction Decrease • Time to complete tasks • Volume of emails / help calls • Development Costs Howto.gov/firstfridays Benefits of good design
  • 17. UCD = Good Customer Service
  • 18. Poor design = budget overruns Three reasons websites go over budget: 1. Requests for changes by users 2. Users can't accomplish key tasks 3. Lack of communication with users - Lederer & Prasad, ‘Nine Management Guidelines for Better Cost Estimating’ CACM 35 (2). Howto.gov/firstfridays
  • 19. The user is always right. If there is a problem with the use of the system, the system is the problem, not the user. - IBM usability expert Dr. Clare-Marie Karat Howto.gov/firstfridays
  • 20. For developers and manufacturers, the advantages of creating usable products far outweigh the costs. The rule of thumb: Every dollar invested in ease of use returns $10 to $100. - IBM "On User-Centered Design" Howto.gov/firstfridays
  • 22. User-Centered Design Research Design User Testing (Usability) • Surveys • Focus Groups • Personas • User Requirements • Interviews • Content Organization • Tasks • Prototypes • Usability Testing • Expert Eval. • Interviews • 508 Testing Howto.gov/firstfridays
  • 23.
  • 24. Usability Testing (aka User Testing) Setting a series of tasks for people to complete and noting any problems they encounter – Andy Budd Howto.gov/firstfridays
  • 25. @jonathan_rubin Usability is like oxygen - you never notice it until it is missing - Anonymous
  • 26. What you need to do a test 1. Something to test (site, poster, service, etc.) 2. Tasks for people to do Howto.gov/firstfridays
  • 27. Top Tasks – Why they’re here • Learn about your services • Find your contact information • Register for a class • Purchase something • Leave a comment • Get a rate quote Howto.gov/firstfridays
  • 28.
  • 29. What’s on a testing script • Give intro and ground rules • Questions about user • Sign release (if recording) • Easy Tasks • Harder tasks • Post-test questions (optional) • Thanks and incentive (if any) Howto.gov/firstfridays
  • 30. Active Listening / Think-Aloud Protocol • Silent, Traditional, or Coaching (we’ll use this) • Designed to get unbiased data • Tester does 90% of talking • Ask Open Ended Questions (if any) • Be unbiased: Don’t let on if they are right or wrong Howto.gov/firstfridays
  • 31. If… Don’t Say Say They aren’t talking “Hey – we’re paying you here…” “What are you thinking?” They get a task wrong “Oops – that’s wrong!” “Thanks for the feedback!” They get a task right “Good job!” “That’s very helpful!” Howto.gov/firstfridays
  • 32. If… Don’t Say Say They screw up majorly and get upset “Ha ha ha.. OMG!” “Remember, you can’t do anything wrong,” or “You’re doing a great job!” They criticize your design “Hey – we worked really hard on this!” “Thanks for the feedback!” Howto.gov/firstfridays
  • 33. If… Say They aren’t talking They get a task wrong They get a task right Howto.gov/firstfridays
  • 34. If… Say They screw up majorly and get upset They criticize your design Howto.gov/firstfridays
  • 36. Most common website problems 1. Users can't understand purpose of site 2. Top tasks difficult to complete 3. Too much text / information not prioritized 4. Confusing or obscure terms 5. Navigation not consistent Howto.gov/firstfridays
  • 37. Website Best Practices 1. Clear starting point 2. Have cream rise to the top 3. Make search simple 4. Plain Language 5. Consistent navigation Howto.gov/firstfridays
  • 38. 1. Give a clear starting point Howto.gov/firstfridays
  • 41. 2. Make cream rise to the top Howto.gov/firstfridays
  • 42. 5. Difficulty with top tasks 1. Can’t find info via any means or know where to begin
  • 43. 5. Difficulty with top tasks 1. Can’t find info via any means or know where to begin
  • 44.
  • 45. 3. Use Plain Language Howto.gov/firstfridays
  • 48. 4. Make search simple Howto.gov/firstfridaysHowto.gov/firstfridays
  • 53. Howto.gov/fiHowto.gov/f Before: 7 text items to scan After: 3 text items to scan
  • 57.
  • 58. 6 things you can do right now 1. Talk to users 2. Define top 3 target audience groups 3. Determine top tasks / Prioritize content 4. Expert Evaluation (Howto.gov/firstfridays ) 5. Usability test (Rocket Surgery Made Easy) 6. Training (us or DigitalGov University) Howto.gov/firstfridays
  • 59.
  • 61. User-Centered Design Takeaways 1. UCD saves money and improves websites 2. Gov’t and top companies already use it 3. UCD = good customer service 4. Use early and often 5. First Fridays can help teach you about UCD Howto.gov/firstfridays
  • 62. First Fridays Usability Program Jonathan Rubin Jonathan.rubin@gsa.gov Twitter: @govnewmedia www.Howto.gov/firstfridays Howto.gov/firstfridaysHowto.gov/firstfridays