SlideShare a Scribd company logo
1 of 9
Internal Message Testing
Prepared for GSA UX Summit
January 28, 2014
Background
• Frequent, on-going need to communicate clear
messages to diverse audiences
• Often no time or resources for formal testing
• Risk Communication Advisory Committee
strongly supports pretesting messages, however
informally, before they are released
2
Internal Network
• Informal testing conducted with FDA employees
to uncover basic flaws and “red flags”
• Working within PRA restrictions to get timely
feedback on draft communications
• Makes it easier for FDA to tap its own resources
3
4
High school or GED (6)
Highest Education
Some college (47)
4-year degree (139)
Advanced degree (379)
Drugs (154)
FDA Center/Office
Regulatory Affairs (102)
Devices (99)
Office of Commissioner (61)
Foods (59)
Biologics (47)
Toxicology (27)
Veterinary Medicine (18)
Tobacco (11)
Less than 1 year (81)
Years at FDA
1 to less than 4 years (167)
4 to less than 16 years (205)
16 years or more (123)
Physical Science (104)
Specific Training
Communications (86)
Social Science (70)
Engineering (51)
Physician (47)
PA, NA, Nurse (40)
Pharmacist (34)
Nutrition Science (34)
Human Factors (17)
Veterinarian (13)
1 child (111)
Caretakers of People
Multiple children (126)
Elderly or disabled (42)
Dogs (209)
Caretakers of Animals
Cats (146)
Livestock (5)
Horses (4)
Women (404)
Gender
Men (174)
29 or younger (44)
Age
30 to 39 (130)
40 to 49 (172)
50 to 59 (165)
60 or older (50)
White (380)
Race/Ethnicity
Black (83)
Asian (75)
Hispanic (27)
AIAN (9)
NHPI (3)
ESL (62)
Language
Spanish (46)
Mandarin Chinese (19)
Other (81)
Over 500 Employee Volunteers
Establishing the Network
5
• Conducted pilot tests in 2009 to demonstrate value
and gain Center Directors’ support
• Identified Center/Office liaisons and provided them
with User’s Guide
• Created electronic sign-up sheet, email account,
and intranet page
• Kicked off recruitment in 2010 with FDA-wide
announcement by Principal Deputy Commissioner
Using the Network
• FDA communicators contact coordinator to
explain testing need and request assistance
• Network volunteers screened and scheduled to
participate at their convenience
• Primarily semi-structured, face-to-face individual
interviews; Data analyzed qualitatively
6
7
Example: Tested Graphics
8
Example: Final Graphic
http://www.fda.gov/ForConsumers/ConsumerUpdates/ucm381429.htm
9
Brian Lappin
Risk Communication Staff
Office of Planning, OC
Brian.Lappin@fda.hhs.gov
(301)796-9126
Contact Information

More Related Content

Similar to Internal Message Testing

Survey analysis 28march2019_ap
Survey analysis 28march2019_apSurvey analysis 28march2019_ap
Survey analysis 28march2019_apPOSHAN
 
Avian Influenza Crisis - Know your stakeholders
Avian Influenza Crisis - Know your stakeholdersAvian Influenza Crisis - Know your stakeholders
Avian Influenza Crisis - Know your stakeholdersLesa Vold
 
Introduction to participatory epidemiology
Introduction to participatory epidemiologyIntroduction to participatory epidemiology
Introduction to participatory epidemiologyILRI
 
Research Ethics Forum 5_31_23_slide_set.pdf
Research Ethics Forum 5_31_23_slide_set.pdfResearch Ethics Forum 5_31_23_slide_set.pdf
Research Ethics Forum 5_31_23_slide_set.pdfSC CTSI at USC and CHLA
 
Competencies for Medical Librarians in Pakistan by Midrar ullah
Competencies for Medical Librarians in Pakistan by Midrar ullahCompetencies for Medical Librarians in Pakistan by Midrar ullah
Competencies for Medical Librarians in Pakistan by Midrar ullahAta Rehman
 
6. Existing Local Health Data Systems: a summary of the pre-event survey of p...
6. Existing Local Health Data Systems: a summary of the pre-event survey of p...6. Existing Local Health Data Systems: a summary of the pre-event survey of p...
6. Existing Local Health Data Systems: a summary of the pre-event survey of p...Institute of Public Health in Ireland
 
Promoting safety and health in the workplace
Promoting safety and health in the workplacePromoting safety and health in the workplace
Promoting safety and health in the workplacePrince Mello
 
Week 6 - Business Research Report
Week 6 - Business Research ReportWeek 6 - Business Research Report
Week 6 - Business Research ReportRachel Krebs
 

Similar to Internal Message Testing (10)

Survey analysis 28march2019_ap
Survey analysis 28march2019_apSurvey analysis 28march2019_ap
Survey analysis 28march2019_ap
 
Avian Influenza Crisis - Know your stakeholders
Avian Influenza Crisis - Know your stakeholdersAvian Influenza Crisis - Know your stakeholders
Avian Influenza Crisis - Know your stakeholders
 
Introduction to participatory epidemiology
Introduction to participatory epidemiologyIntroduction to participatory epidemiology
Introduction to participatory epidemiology
 
Transforming Clinical Practice through Terminology
Transforming Clinical Practice through TerminologyTransforming Clinical Practice through Terminology
Transforming Clinical Practice through Terminology
 
Research Ethics Forum 5_31_23_slide_set.pdf
Research Ethics Forum 5_31_23_slide_set.pdfResearch Ethics Forum 5_31_23_slide_set.pdf
Research Ethics Forum 5_31_23_slide_set.pdf
 
Competencies for Medical Librarians in Pakistan by Midrar ullah
Competencies for Medical Librarians in Pakistan by Midrar ullahCompetencies for Medical Librarians in Pakistan by Midrar ullah
Competencies for Medical Librarians in Pakistan by Midrar ullah
 
6. Existing Local Health Data Systems: a summary of the pre-event survey of p...
6. Existing Local Health Data Systems: a summary of the pre-event survey of p...6. Existing Local Health Data Systems: a summary of the pre-event survey of p...
6. Existing Local Health Data Systems: a summary of the pre-event survey of p...
 
Promoting safety and health in the workplace
Promoting safety and health in the workplacePromoting safety and health in the workplace
Promoting safety and health in the workplace
 
Week 6 - Business Research Report
Week 6 - Business Research ReportWeek 6 - Business Research Report
Week 6 - Business Research Report
 
ICOWHI IPV Poster_1
ICOWHI IPV Poster_1ICOWHI IPV Poster_1
ICOWHI IPV Poster_1
 

More from DigitalGov from General Services Administration

More from DigitalGov from General Services Administration (20)

OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
OMB M 15-13, Policy to Require Secure Connections across Federal Websites and...
 
Gifs from Government Records
Gifs from Government RecordsGifs from Government Records
Gifs from Government Records
 
Accessibility for Animated Gifs
Accessibility for Animated GifsAccessibility for Animated Gifs
Accessibility for Animated Gifs
 
Peace Corps and Animated Gifs
Peace Corps and Animated GifsPeace Corps and Animated Gifs
Peace Corps and Animated Gifs
 
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
USA.gov Contact Center Case Study: JD Power Assessment & Customer Satisfactio...
 
Collecting Customer Experience Data
Collecting Customer Experience DataCollecting Customer Experience Data
Collecting Customer Experience Data
 
Introduction - Equal Employment Opportunity Commission (EEOC)
Introduction - Equal Employment Opportunity Commission (EEOC)Introduction - Equal Employment Opportunity Commission (EEOC)
Introduction - Equal Employment Opportunity Commission (EEOC)
 
Cdc clear communication index webinar slides
Cdc clear communication index webinar slidesCdc clear communication index webinar slides
Cdc clear communication index webinar slides
 
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPBWebinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
Webinar: IdeaBox: An Open Source Internal Ideation Tool from CFPB
 
Optimizing your public sector web analytics program pt3
Optimizing your public sector web analytics program pt3Optimizing your public sector web analytics program pt3
Optimizing your public sector web analytics program pt3
 
Optimizing your public sector web analytics program pt2
Optimizing your public sector web analytics program pt2Optimizing your public sector web analytics program pt2
Optimizing your public sector web analytics program pt2
 
Optimizing your public sector web analytics program pt1
Optimizing your public sector web analytics program pt1Optimizing your public sector web analytics program pt1
Optimizing your public sector web analytics program pt1
 
Prizes, Contracts & Grants: What Should I Do?
Prizes, Contracts & Grants: What Should I Do?Prizes, Contracts & Grants: What Should I Do?
Prizes, Contracts & Grants: What Should I Do?
 
Gs awebinar al
Gs awebinar alGs awebinar al
Gs awebinar al
 
Deconstructing Challenges Webinar
Deconstructing Challenges WebinarDeconstructing Challenges Webinar
Deconstructing Challenges Webinar
 
Amendment to Yammer, Inc. Terms of Service (TOS)
Amendment to Yammer, Inc. Terms of Service (TOS)Amendment to Yammer, Inc. Terms of Service (TOS)
Amendment to Yammer, Inc. Terms of Service (TOS)
 
Hulu Content Deal Memorandum
Hulu Content Deal MemorandumHulu Content Deal Memorandum
Hulu Content Deal Memorandum
 
Amendment to LinkedIn User Agreement
Amendment to LinkedIn User AgreementAmendment to LinkedIn User Agreement
Amendment to LinkedIn User Agreement
 
MeetUp Terms of Service (TOS) Amendment
MeetUp Terms of Service (TOS) AmendmentMeetUp Terms of Service (TOS) Amendment
MeetUp Terms of Service (TOS) Amendment
 
MySpace Side Letter Agreement, Execution Version
MySpace Side Letter Agreement, Execution VersionMySpace Side Letter Agreement, Execution Version
MySpace Side Letter Agreement, Execution Version
 

Recently uploaded

Call Girls Service Race Course Road Just Call 7001305949 Enjoy College Girls ...
Call Girls Service Race Course Road Just Call 7001305949 Enjoy College Girls ...Call Girls Service Race Course Road Just Call 7001305949 Enjoy College Girls ...
Call Girls Service Race Course Road Just Call 7001305949 Enjoy College Girls ...narwatsonia7
 
Madurai Call Girls 7001305949 WhatsApp Number 24x7 Best Services
Madurai Call Girls 7001305949 WhatsApp Number 24x7 Best ServicesMadurai Call Girls 7001305949 WhatsApp Number 24x7 Best Services
Madurai Call Girls 7001305949 WhatsApp Number 24x7 Best Servicesnajka9823
 
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...narwatsonia7
 
Take action for a healthier planet and brighter future.
Take action for a healthier planet and brighter future.Take action for a healthier planet and brighter future.
Take action for a healthier planet and brighter future.Christina Parmionova
 
WORLD CREATIVITY AND INNOVATION DAY 2024.
WORLD CREATIVITY AND INNOVATION DAY 2024.WORLD CREATIVITY AND INNOVATION DAY 2024.
WORLD CREATIVITY AND INNOVATION DAY 2024.Christina Parmionova
 
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012rehmti665
 
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...narwatsonia7
 
Building the Commons: Community Archiving & Decentralized Storage
Building the Commons: Community Archiving & Decentralized StorageBuilding the Commons: Community Archiving & Decentralized Storage
Building the Commons: Community Archiving & Decentralized StorageTechSoup
 
Start Donating your Old Clothes to Poor People kurnool
Start Donating your Old Clothes to Poor People kurnoolStart Donating your Old Clothes to Poor People kurnool
Start Donating your Old Clothes to Poor People kurnoolSERUDS INDIA
 
VIP Call Girls Service Bikaner Aishwarya 8250192130 Independent Escort Servic...
VIP Call Girls Service Bikaner Aishwarya 8250192130 Independent Escort Servic...VIP Call Girls Service Bikaner Aishwarya 8250192130 Independent Escort Servic...
VIP Call Girls Service Bikaner Aishwarya 8250192130 Independent Escort Servic...Suhani Kapoor
 
(官方原版办理)BU毕业证国外大学毕业证样本
(官方原版办理)BU毕业证国外大学毕业证样本(官方原版办理)BU毕业证国外大学毕业证样本
(官方原版办理)BU毕业证国外大学毕业证样本mbetknu
 
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service BangaloreCall Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalorenarwatsonia7
 
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdfYHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdfyalehistoricalreview
 
Call Girls Service AECS Layout Just Call 7001305949 Enjoy College Girls Service
Call Girls Service AECS Layout Just Call 7001305949 Enjoy College Girls ServiceCall Girls Service AECS Layout Just Call 7001305949 Enjoy College Girls Service
Call Girls Service AECS Layout Just Call 7001305949 Enjoy College Girls Servicenarwatsonia7
 
Goa Escorts WhatsApp Number South Goa Call Girl … 8588052666…
Goa Escorts WhatsApp Number South Goa Call Girl … 8588052666…Goa Escorts WhatsApp Number South Goa Call Girl … 8588052666…
Goa Escorts WhatsApp Number South Goa Call Girl … 8588052666…nishakur201
 
(怎样办)Sherbrooke毕业证本科/硕士学位证书
(怎样办)Sherbrooke毕业证本科/硕士学位证书(怎样办)Sherbrooke毕业证本科/硕士学位证书
(怎样办)Sherbrooke毕业证本科/硕士学位证书mbetknu
 
productionpost-productiondiary-240320114322-5004daf6.pptx
productionpost-productiondiary-240320114322-5004daf6.pptxproductionpost-productiondiary-240320114322-5004daf6.pptx
productionpost-productiondiary-240320114322-5004daf6.pptxHenryBriggs2
 
Powering Britain: Can we decarbonise electricity without disadvantaging poore...
Powering Britain: Can we decarbonise electricity without disadvantaging poore...Powering Britain: Can we decarbonise electricity without disadvantaging poore...
Powering Britain: Can we decarbonise electricity without disadvantaging poore...ResolutionFoundation
 

Recently uploaded (20)

Call Girls Service Race Course Road Just Call 7001305949 Enjoy College Girls ...
Call Girls Service Race Course Road Just Call 7001305949 Enjoy College Girls ...Call Girls Service Race Course Road Just Call 7001305949 Enjoy College Girls ...
Call Girls Service Race Course Road Just Call 7001305949 Enjoy College Girls ...
 
Madurai Call Girls 7001305949 WhatsApp Number 24x7 Best Services
Madurai Call Girls 7001305949 WhatsApp Number 24x7 Best ServicesMadurai Call Girls 7001305949 WhatsApp Number 24x7 Best Services
Madurai Call Girls 7001305949 WhatsApp Number 24x7 Best Services
 
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
 
Take action for a healthier planet and brighter future.
Take action for a healthier planet and brighter future.Take action for a healthier planet and brighter future.
Take action for a healthier planet and brighter future.
 
WORLD CREATIVITY AND INNOVATION DAY 2024.
WORLD CREATIVITY AND INNOVATION DAY 2024.WORLD CREATIVITY AND INNOVATION DAY 2024.
WORLD CREATIVITY AND INNOVATION DAY 2024.
 
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
 
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
 
Building the Commons: Community Archiving & Decentralized Storage
Building the Commons: Community Archiving & Decentralized StorageBuilding the Commons: Community Archiving & Decentralized Storage
Building the Commons: Community Archiving & Decentralized Storage
 
The Federal Budget and Health Care Policy
The Federal Budget and Health Care PolicyThe Federal Budget and Health Care Policy
The Federal Budget and Health Care Policy
 
Start Donating your Old Clothes to Poor People kurnool
Start Donating your Old Clothes to Poor People kurnoolStart Donating your Old Clothes to Poor People kurnool
Start Donating your Old Clothes to Poor People kurnool
 
VIP Call Girls Service Bikaner Aishwarya 8250192130 Independent Escort Servic...
VIP Call Girls Service Bikaner Aishwarya 8250192130 Independent Escort Servic...VIP Call Girls Service Bikaner Aishwarya 8250192130 Independent Escort Servic...
VIP Call Girls Service Bikaner Aishwarya 8250192130 Independent Escort Servic...
 
(官方原版办理)BU毕业证国外大学毕业证样本
(官方原版办理)BU毕业证国外大学毕业证样本(官方原版办理)BU毕业证国外大学毕业证样本
(官方原版办理)BU毕业证国外大学毕业证样本
 
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service BangaloreCall Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
 
9953330565 Low Rate Call Girls In Adarsh Nagar Delhi NCR
9953330565 Low Rate Call Girls In Adarsh Nagar Delhi NCR9953330565 Low Rate Call Girls In Adarsh Nagar Delhi NCR
9953330565 Low Rate Call Girls In Adarsh Nagar Delhi NCR
 
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdfYHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
 
Call Girls Service AECS Layout Just Call 7001305949 Enjoy College Girls Service
Call Girls Service AECS Layout Just Call 7001305949 Enjoy College Girls ServiceCall Girls Service AECS Layout Just Call 7001305949 Enjoy College Girls Service
Call Girls Service AECS Layout Just Call 7001305949 Enjoy College Girls Service
 
Goa Escorts WhatsApp Number South Goa Call Girl … 8588052666…
Goa Escorts WhatsApp Number South Goa Call Girl … 8588052666…Goa Escorts WhatsApp Number South Goa Call Girl … 8588052666…
Goa Escorts WhatsApp Number South Goa Call Girl … 8588052666…
 
(怎样办)Sherbrooke毕业证本科/硕士学位证书
(怎样办)Sherbrooke毕业证本科/硕士学位证书(怎样办)Sherbrooke毕业证本科/硕士学位证书
(怎样办)Sherbrooke毕业证本科/硕士学位证书
 
productionpost-productiondiary-240320114322-5004daf6.pptx
productionpost-productiondiary-240320114322-5004daf6.pptxproductionpost-productiondiary-240320114322-5004daf6.pptx
productionpost-productiondiary-240320114322-5004daf6.pptx
 
Powering Britain: Can we decarbonise electricity without disadvantaging poore...
Powering Britain: Can we decarbonise electricity without disadvantaging poore...Powering Britain: Can we decarbonise electricity without disadvantaging poore...
Powering Britain: Can we decarbonise electricity without disadvantaging poore...
 

Internal Message Testing

  • 1. Internal Message Testing Prepared for GSA UX Summit January 28, 2014
  • 2. Background • Frequent, on-going need to communicate clear messages to diverse audiences • Often no time or resources for formal testing • Risk Communication Advisory Committee strongly supports pretesting messages, however informally, before they are released 2
  • 3. Internal Network • Informal testing conducted with FDA employees to uncover basic flaws and “red flags” • Working within PRA restrictions to get timely feedback on draft communications • Makes it easier for FDA to tap its own resources 3
  • 4. 4 High school or GED (6) Highest Education Some college (47) 4-year degree (139) Advanced degree (379) Drugs (154) FDA Center/Office Regulatory Affairs (102) Devices (99) Office of Commissioner (61) Foods (59) Biologics (47) Toxicology (27) Veterinary Medicine (18) Tobacco (11) Less than 1 year (81) Years at FDA 1 to less than 4 years (167) 4 to less than 16 years (205) 16 years or more (123) Physical Science (104) Specific Training Communications (86) Social Science (70) Engineering (51) Physician (47) PA, NA, Nurse (40) Pharmacist (34) Nutrition Science (34) Human Factors (17) Veterinarian (13) 1 child (111) Caretakers of People Multiple children (126) Elderly or disabled (42) Dogs (209) Caretakers of Animals Cats (146) Livestock (5) Horses (4) Women (404) Gender Men (174) 29 or younger (44) Age 30 to 39 (130) 40 to 49 (172) 50 to 59 (165) 60 or older (50) White (380) Race/Ethnicity Black (83) Asian (75) Hispanic (27) AIAN (9) NHPI (3) ESL (62) Language Spanish (46) Mandarin Chinese (19) Other (81) Over 500 Employee Volunteers
  • 5. Establishing the Network 5 • Conducted pilot tests in 2009 to demonstrate value and gain Center Directors’ support • Identified Center/Office liaisons and provided them with User’s Guide • Created electronic sign-up sheet, email account, and intranet page • Kicked off recruitment in 2010 with FDA-wide announcement by Principal Deputy Commissioner
  • 6. Using the Network • FDA communicators contact coordinator to explain testing need and request assistance • Network volunteers screened and scheduled to participate at their convenience • Primarily semi-structured, face-to-face individual interviews; Data analyzed qualitatively 6
  • 9. 9 Brian Lappin Risk Communication Staff Office of Planning, OC Brian.Lappin@fda.hhs.gov (301)796-9126 Contact Information