Internal Message Testing
Prepared for GSA UX Summit
January 28, 2014
Background
• Frequent, on-going need to communicate clear
messages to diverse audiences
• Often no time or resources for formal testing
• Risk Communication Advisory Committee
strongly supports pretesting messages, however
informally, before they are released
2
Internal Network
• Informal testing conducted with FDA employees
to uncover basic flaws and “red flags”
• Working within PRA restrictions to get timely
feedback on draft communications
• Makes it easier for FDA to tap its own resources
3
4
High school or GED (6)
Highest Education
Some college (47)
4-year degree (139)
Advanced degree (379)
Drugs (154)
FDA Center/Office
Regulatory Affairs (102)
Devices (99)
Office of Commissioner (61)
Foods (59)
Biologics (47)
Toxicology (27)
Veterinary Medicine (18)
Tobacco (11)
Less than 1 year (81)
Years at FDA
1 to less than 4 years (167)
4 to less than 16 years (205)
16 years or more (123)
Physical Science (104)
Specific Training
Communications (86)
Social Science (70)
Engineering (51)
Physician (47)
PA, NA, Nurse (40)
Pharmacist (34)
Nutrition Science (34)
Human Factors (17)
Veterinarian (13)
1 child (111)
Caretakers of People
Multiple children (126)
Elderly or disabled (42)
Dogs (209)
Caretakers of Animals
Cats (146)
Livestock (5)
Horses (4)
Women (404)
Gender
Men (174)
29 or younger (44)
Age
30 to 39 (130)
40 to 49 (172)
50 to 59 (165)
60 or older (50)
White (380)
Race/Ethnicity
Black (83)
Asian (75)
Hispanic (27)
AIAN (9)
NHPI (3)
ESL (62)
Language
Spanish (46)
Mandarin Chinese (19)
Other (81)
Over 500 Employee Volunteers
Establishing the Network
5
• Conducted pilot tests in 2009 to demonstrate value
and gain Center Directors’ support
• Identified Center/Office liaisons and provided them
with User’s Guide
• Created electronic sign-up sheet, email account,
and intranet page
• Kicked off recruitment in 2010 with FDA-wide
announcement by Principal Deputy Commissioner
Using the Network
• FDA communicators contact coordinator to
explain testing need and request assistance
• Network volunteers screened and scheduled to
participate at their convenience
• Primarily semi-structured, face-to-face individual
interviews; Data analyzed qualitatively
6
7
Example: Tested Graphics
8
Example: Final Graphic
http://www.fda.gov/ForConsumers/ConsumerUpdates/ucm381429.htm
9
Brian Lappin
Risk Communication Staff
Office of Planning, OC
Brian.Lappin@fda.hhs.gov
(301)796-9126
Contact Information

Internal Message Testing

  • 1.
    Internal Message Testing Preparedfor GSA UX Summit January 28, 2014
  • 2.
    Background • Frequent, on-goingneed to communicate clear messages to diverse audiences • Often no time or resources for formal testing • Risk Communication Advisory Committee strongly supports pretesting messages, however informally, before they are released 2
  • 3.
    Internal Network • Informaltesting conducted with FDA employees to uncover basic flaws and “red flags” • Working within PRA restrictions to get timely feedback on draft communications • Makes it easier for FDA to tap its own resources 3
  • 4.
    4 High school orGED (6) Highest Education Some college (47) 4-year degree (139) Advanced degree (379) Drugs (154) FDA Center/Office Regulatory Affairs (102) Devices (99) Office of Commissioner (61) Foods (59) Biologics (47) Toxicology (27) Veterinary Medicine (18) Tobacco (11) Less than 1 year (81) Years at FDA 1 to less than 4 years (167) 4 to less than 16 years (205) 16 years or more (123) Physical Science (104) Specific Training Communications (86) Social Science (70) Engineering (51) Physician (47) PA, NA, Nurse (40) Pharmacist (34) Nutrition Science (34) Human Factors (17) Veterinarian (13) 1 child (111) Caretakers of People Multiple children (126) Elderly or disabled (42) Dogs (209) Caretakers of Animals Cats (146) Livestock (5) Horses (4) Women (404) Gender Men (174) 29 or younger (44) Age 30 to 39 (130) 40 to 49 (172) 50 to 59 (165) 60 or older (50) White (380) Race/Ethnicity Black (83) Asian (75) Hispanic (27) AIAN (9) NHPI (3) ESL (62) Language Spanish (46) Mandarin Chinese (19) Other (81) Over 500 Employee Volunteers
  • 5.
    Establishing the Network 5 •Conducted pilot tests in 2009 to demonstrate value and gain Center Directors’ support • Identified Center/Office liaisons and provided them with User’s Guide • Created electronic sign-up sheet, email account, and intranet page • Kicked off recruitment in 2010 with FDA-wide announcement by Principal Deputy Commissioner
  • 6.
    Using the Network •FDA communicators contact coordinator to explain testing need and request assistance • Network volunteers screened and scheduled to participate at their convenience • Primarily semi-structured, face-to-face individual interviews; Data analyzed qualitatively 6
  • 7.
  • 8.
  • 9.
    9 Brian Lappin Risk CommunicationStaff Office of Planning, OC Brian.Lappin@fda.hhs.gov (301)796-9126 Contact Information