SlideShare a Scribd company logo
1 of 9
Open Call Usability Testing
Creating an Ongoing UX
Testing Program
Silvia Inéz Salazar, MPA
Human-Centered Informatics
Laboratory Manager
Office of Communication and Education
Traditional UX in Government
• $50-$80k
• Write RFP & SOW
• OMB & IRB Approval
• Hire contractor
• Create schedule
• Assemble team
• Kickoff
• Evaluate site
• Write scenarios
• Site requirements
• Identify audience
• Begin recruitment
• Conduct testing
• Analysis & reporting
• Implementation
Open Call Usability Testing
• Every eight weeks
• Pre-test design ideas, layouts, info seeking
patterns, social media, mobile platforms, English,
Spanish
• Feedback from specific user groups
• Two to four different projects
• One hour sessions with 9 participants
• Training for observers
• Debrief, brainstorming, present findings,
implementation
Benefits
• Feedback throughout project life cycle
• UX is readily available
• Quickly address difficult questions
• Build UX culture
• Same cost as traditional usability test
Wins
• Testing of more than 120 projects in
English and Spanish
• Address and understand different user
groups
• Mutual support
• Increase institutional knowledge
Contact
Silvia Inéz Salazar
(240) 276-6631 Direct
salazarsi@mail.nih.gov

More Related Content

Similar to Open Call Usability Testing: Creating an Ongoing UX Testing Program

User Experience Service showcase lightning talks - December 2018
User Experience Service showcase lightning talks - December 2018User Experience Service showcase lightning talks - December 2018
User Experience Service showcase lightning talks - December 2018Neil Allison
 
User Research for the Web and Applications
User Research for the Web and ApplicationsUser Research for the Web and Applications
User Research for the Web and ApplicationsDani Nordin
 
1 open stack_community_india_the_future
1 open stack_community_india_the_future1 open stack_community_india_the_future
1 open stack_community_india_the_futureopenstackindia
 
FIolascon_Resume_2015_no cover
FIolascon_Resume_2015_no coverFIolascon_Resume_2015_no cover
FIolascon_Resume_2015_no coverFilomena Iolascon
 
Four Kitchens: We make BIG websites
Four Kitchens: We make BIG websitesFour Kitchens: We make BIG websites
Four Kitchens: We make BIG websitesFour Kitchens
 
Web Teaching Day 2014 - Agency ready and other things
Web Teaching Day 2014 - Agency ready and other thingsWeb Teaching Day 2014 - Agency ready and other things
Web Teaching Day 2014 - Agency ready and other thingsRichard Eskins
 
Improving success with Distributed Teams
Improving success with Distributed TeamsImproving success with Distributed Teams
Improving success with Distributed TeamsGreg Robinson
 
Redesigning the University Website: Participatory Design Case Study
Redesigning the University Website: Participatory Design Case StudyRedesigning the University Website: Participatory Design Case Study
Redesigning the University Website: Participatory Design Case StudyStefanie Panke
 
DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising
DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising
DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising Anna Perricci
 
SGCI at Earth Science Information Partners meeting
SGCI at Earth Science Information Partners meetingSGCI at Earth Science Information Partners meeting
SGCI at Earth Science Information Partners meetingNancy Wilkins-Diehr
 
Lies, Damned Lies, and Pretty Pictures
Lies, Damned Lies, and Pretty PicturesLies, Damned Lies, and Pretty Pictures
Lies, Damned Lies, and Pretty Picturesvutpakdi
 
Prototyping for web and mobile workshop
Prototyping for web and mobile workshopPrototyping for web and mobile workshop
Prototyping for web and mobile workshopSimon Phillips
 
User Research for the Web and Applications
User Research for the Web and ApplicationsUser Research for the Web and Applications
User Research for the Web and ApplicationsDani Nordin
 
OneWeek|OneTool: An Experiment in Interdisciplinary, Rapid, Open Source Softw...
OneWeek|OneTool: An Experiment in Interdisciplinary, Rapid, Open Source Softw...OneWeek|OneTool: An Experiment in Interdisciplinary, Rapid, Open Source Softw...
OneWeek|OneTool: An Experiment in Interdisciplinary, Rapid, Open Source Softw...Effie Kapsalis
 
Transforming Digital Government Services Workshop - Tuesday 21st October
Transforming Digital Government Services Workshop - Tuesday 21st OctoberTransforming Digital Government Services Workshop - Tuesday 21st October
Transforming Digital Government Services Workshop - Tuesday 21st OctoberPrecedent
 
Conducting User Research
Conducting User ResearchConducting User Research
Conducting User ResearchJeremy Horn
 

Similar to Open Call Usability Testing: Creating an Ongoing UX Testing Program (20)

Sourabh ui
Sourabh uiSourabh ui
Sourabh ui
 
Sourabh ui
Sourabh uiSourabh ui
Sourabh ui
 
User Experience Service showcase lightning talks - December 2018
User Experience Service showcase lightning talks - December 2018User Experience Service showcase lightning talks - December 2018
User Experience Service showcase lightning talks - December 2018
 
User Research for the Web and Applications
User Research for the Web and ApplicationsUser Research for the Web and Applications
User Research for the Web and Applications
 
1 open stack_community_india_the_future
1 open stack_community_india_the_future1 open stack_community_india_the_future
1 open stack_community_india_the_future
 
FIolascon_Resume_2015_no cover
FIolascon_Resume_2015_no coverFIolascon_Resume_2015_no cover
FIolascon_Resume_2015_no cover
 
Four Kitchens: We make BIG websites
Four Kitchens: We make BIG websitesFour Kitchens: We make BIG websites
Four Kitchens: We make BIG websites
 
Web Teaching Day 2014 - Agency ready and other things
Web Teaching Day 2014 - Agency ready and other thingsWeb Teaching Day 2014 - Agency ready and other things
Web Teaching Day 2014 - Agency ready and other things
 
MandiMAlexander
MandiMAlexanderMandiMAlexander
MandiMAlexander
 
Improving success with Distributed Teams
Improving success with Distributed TeamsImproving success with Distributed Teams
Improving success with Distributed Teams
 
Redesigning the University Website: Participatory Design Case Study
Redesigning the University Website: Participatory Design Case StudyRedesigning the University Website: Participatory Design Case Study
Redesigning the University Website: Participatory Design Case Study
 
DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising
DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising
DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising
 
SGCI at Earth Science Information Partners meeting
SGCI at Earth Science Information Partners meetingSGCI at Earth Science Information Partners meeting
SGCI at Earth Science Information Partners meeting
 
Lies, Damned Lies, and Pretty Pictures
Lies, Damned Lies, and Pretty PicturesLies, Damned Lies, and Pretty Pictures
Lies, Damned Lies, and Pretty Pictures
 
Prototyping for web and mobile workshop
Prototyping for web and mobile workshopPrototyping for web and mobile workshop
Prototyping for web and mobile workshop
 
User Research for the Web and Applications
User Research for the Web and ApplicationsUser Research for the Web and Applications
User Research for the Web and Applications
 
OneWeek|OneTool: An Experiment in Interdisciplinary, Rapid, Open Source Softw...
OneWeek|OneTool: An Experiment in Interdisciplinary, Rapid, Open Source Softw...OneWeek|OneTool: An Experiment in Interdisciplinary, Rapid, Open Source Softw...
OneWeek|OneTool: An Experiment in Interdisciplinary, Rapid, Open Source Softw...
 
Transforming Digital Government Services Workshop - Tuesday 21st October
Transforming Digital Government Services Workshop - Tuesday 21st OctoberTransforming Digital Government Services Workshop - Tuesday 21st October
Transforming Digital Government Services Workshop - Tuesday 21st October
 
Proyectos Investigación y Desarrollo
Proyectos Investigación y DesarrolloProyectos Investigación y Desarrollo
Proyectos Investigación y Desarrollo
 
Conducting User Research
Conducting User ResearchConducting User Research
Conducting User Research
 

More from DigitalGov from General Services Administration

More from DigitalGov from General Services Administration (20)

OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
 
Gifs from Government Records
Gifs from Government RecordsGifs from Government Records
Gifs from Government Records
 
Accessibility for Animated Gifs
Accessibility for Animated GifsAccessibility for Animated Gifs
Accessibility for Animated Gifs
 
Peace Corps and Animated Gifs
Peace Corps and Animated GifsPeace Corps and Animated Gifs
Peace Corps and Animated Gifs
 
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
 
Collecting Customer Experience Data
Collecting Customer Experience DataCollecting Customer Experience Data
Collecting Customer Experience Data
 
Introduction - Equal Employment Opportunity Commission (EEOC)
Introduction - Equal Employment Opportunity Commission (EEOC)Introduction - Equal Employment Opportunity Commission (EEOC)
Introduction - Equal Employment Opportunity Commission (EEOC)
 
Cdc clear communication index webinar slides
Cdc clear communication index webinar slidesCdc clear communication index webinar slides
Cdc clear communication index webinar slides
 
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPBWebinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
 
Optimizing your public sector web analytics program pt3
Optimizing your public sector web analytics program pt3Optimizing your public sector web analytics program pt3
Optimizing your public sector web analytics program pt3
 
Optimizing your public sector web analytics program pt2
Optimizing your public sector web analytics program pt2Optimizing your public sector web analytics program pt2
Optimizing your public sector web analytics program pt2
 
Optimizing your public sector web analytics program pt1
Optimizing your public sector web analytics program pt1Optimizing your public sector web analytics program pt1
Optimizing your public sector web analytics program pt1
 
Prizes, Contracts & Grants: What Should I Do?
Prizes, Contracts & Grants: What Should I Do?Prizes, Contracts & Grants: What Should I Do?
Prizes, Contracts & Grants: What Should I Do?
 
Gs awebinar al
Gs awebinar alGs awebinar al
Gs awebinar al
 
Deconstructing Challenges Webinar
Deconstructing Challenges WebinarDeconstructing Challenges Webinar
Deconstructing Challenges Webinar
 
Amendment to Yammer, Inc. Terms of Service (TOS)
Amendment to Yammer, Inc. Terms of Service (TOS)Amendment to Yammer, Inc. Terms of Service (TOS)
Amendment to Yammer, Inc. Terms of Service (TOS)
 
Hulu Content Deal Memorandum
Hulu Content Deal MemorandumHulu Content Deal Memorandum
Hulu Content Deal Memorandum
 
Amendment to LinkedIn User Agreement
Amendment to LinkedIn User AgreementAmendment to LinkedIn User Agreement
Amendment to LinkedIn User Agreement
 
MeetUp Terms of Service (TOS) Amendment
MeetUp Terms of Service (TOS) AmendmentMeetUp Terms of Service (TOS) Amendment
MeetUp Terms of Service (TOS) Amendment
 
MySpace Side Letter Agreement, Execution Version
MySpace Side Letter Agreement, Execution VersionMySpace Side Letter Agreement, Execution Version
MySpace Side Letter Agreement, Execution Version
 

Open Call Usability Testing: Creating an Ongoing UX Testing Program

  • 1. Open Call Usability Testing Creating an Ongoing UX Testing Program Silvia Inéz Salazar, MPA Human-Centered Informatics Laboratory Manager Office of Communication and Education
  • 2.
  • 3.
  • 4. Traditional UX in Government • $50-$80k • Write RFP & SOW • OMB & IRB Approval • Hire contractor • Create schedule • Assemble team • Kickoff • Evaluate site • Write scenarios • Site requirements • Identify audience • Begin recruitment • Conduct testing • Analysis & reporting • Implementation
  • 5.
  • 6. Open Call Usability Testing • Every eight weeks • Pre-test design ideas, layouts, info seeking patterns, social media, mobile platforms, English, Spanish • Feedback from specific user groups • Two to four different projects • One hour sessions with 9 participants • Training for observers • Debrief, brainstorming, present findings, implementation
  • 7. Benefits • Feedback throughout project life cycle • UX is readily available • Quickly address difficult questions • Build UX culture • Same cost as traditional usability test
  • 8. Wins • Testing of more than 120 projects in English and Spanish • Address and understand different user groups • Mutual support • Increase institutional knowledge
  • 9. Contact Silvia Inéz Salazar (240) 276-6631 Direct salazarsi@mail.nih.gov