SlideShare a Scribd company logo
1 of 227
Download to read offline
Content & Comprehension Survey
ANALYSIS
January 2018
produced by
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 2
 Overview ‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 3
• Key Insights & Findings
• Conclusions & Recommendations
 Survey Design ‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 29
• Logic Flow
• Methodology
 Analysis Parameters ‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 35
• Fieldwork Report
• Final Quota Counts
• Analysis Considerations
 Respondent Demographics ‐‐‐‐‐‐‐‐‐‐‐‐ pg. 39
• Age Group
• Race / Ethnicity
• Gender Identify
• Sexual Orientation
• Education
• Household Income
• Residence Location
 Survey Analysis / Section 1 ‐‐‐‐‐‐‐‐‐‐‐‐ pg. 49
• Creative Testing
o Q1 – Ad Creative
o Q2 – Poster Creative
 Persona Matching / Section 1 ‐‐‐‐‐‐‐‐‐ pg. 79
• Edgar
• Tallulah
• Chris
• Lorraine
• Miguel
• Non‐Classified
 Survey Analysis / Section 2 ‐‐‐‐‐‐‐‐‐‐‐‐ pg. 87
• Video Inspiration Testing
o Q3 – Anthem Video
CONTENT
 Survey Analysis / Section 3 ‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 94
• Persona Creative Testing
o Q4 – Ad Creative
 Survey Analysis / Section 4 ‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 137
• Social Media Use Testing
o Q5 – Survey Polling
 Survey Analysis / Section 5 ‐‐‐‐‐‐‐‐‐‐‐‐ pg.144
• Website Content Exposure
o Website Heatmapping
o Q6 – Comprehension Testing
• Animation Video Exposure
o Q7A – Inspiration Testing
o Q7B – Comprehension Testing
 Survey Analysis / Section 6 ‐‐‐‐‐‐‐‐‐‐‐ pg. 207
• Comprehension Re‐Testing
o Program Description
o Q8 – Comprehension
 Survey Analysis / Section 7 ‐‐‐‐‐‐‐‐‐‐‐ pg. 214
• Pre‐Close Conversion Testing
o Q9 – Program Concerns
o Q9 – Enrollment Inclination
o Q9 ‐‐ Feedback
 Appendices
(available as separate files)
• Sub‐Population Views
o African‐American
o Hispanic‐Latino
o Asian‐American
o Caucasian
• Creative Assets
• Master Data Tables
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 3
OVERVIEW
(sample size: 11,811)
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 4
Survey Section 1 / Questions 1 ‐ 2: Creative Testing ‐ Persona Self‐Identification Classification
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Aggregate Total Population Preference by Creative Asset (Gender + Age)
Creative Asset Variation Preference Gender Age Group
Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+
What’s In It for Me?
One‐of‐a‐kind is kind of our thing.
1 26% 23% 29% 38% 29% 23% 13%
Finding Cures
Our health is our wealth.
2 17% 16% 18% 12% 16% 17% 23%
Community, Tribe, Family, Legacy
An inheritance they can actually use.
3 15% 17% 13% 11% 16% 18% 15%
Empower, Control Righting Wrongs
Power to the patient.
4 15% 15% 14% 14% 16% 15% 15%
Altruism
A healthier future. Pass it on.
5 14% 18% 11% 13% 13% 13% 18%
Innovation, New Research
One size does not fit all.
6 13% 11% 15% 12% 11% 15% 15%
‐ 100% 100% 100% 100% 100% 100% 100%
Aggregate Total Population Preference by Creative Asset (Gender + Age)
Creative Asset Variation Preference Gender Age Group
Digital Posters Rank Percent Male Female 18‐24 25‐34 35‐54 55+
Empower, Control Righting Wrongs
Not all research is created equal
(that’s why we’re here).
1 28% 26% 29% 35% 29% 25% 20%
What’s In It for Me?
What’s good for you is good for us.
2 20% 19% 20% 16% 22% 23% 18%
Finding Cures
Fighting disease just got one million times easier.
3 17% 15% 18% 16% 15% 16% 19%
Community, Tribe, Family, Legacy
Legacies aren’t just ones you can spend.
4 13% 15% 11% 10% 10% 13% 21%
Innovation, New Research
The next big thing in health is here.
5 13% 13% 13% 11% 14% 14% 14%
Altruism
We can win the game as soon as we all get in it.
6 10% 11% 9% 12% 10% 9% 9%
‐ 100% 100% 100% 100% 100% 100% 100%
Overview Recap
D
i
g
i
t
a
l
A
d
s
P
o
s
t
e
r
s
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Observations & Findings for A/B Testing:
Matrices reveal certain message persona themes resonate at varying levels depending on gender and age.
Although the creative and headlines were developed based on individual persona motivations, we can see
creative+messaging when delivered to test populations, have distinct preference nuances that can be identified by
gender and age groupings – and which can be initially used for testing and optimizing future media and
communications.
A series of questions were designed to test message (motivation) and visual cues aligned by race/ethnicity to have
respondents self‐identify themselves into 1 of 5 possible persona classifications with added insights into personal
creative design composition appeal.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 5
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Aggregate Total Population Preference by Creative Asset (Sub‐Population)
Creative Asset Variation Overall Preference Race / Ethnicity Preferences
Digital Ads Rank Percent
African‐
American
Hispanic‐
Latino
Asian‐
American
Caucasian
What’s In It for Me?
One‐of‐a‐kind is kind of our thing.
1 26% 29% 23% 26% 25%
Finding Cures
Our health is our wealth.
2 17% 25% 14% 18% 11%
Community, Tribe, Family, Legacy
An inheritance they can actually use.
3 15% 11% 17% 10% 22%
Empower, Control Righting Wrongs
Power to the patient.
4 15% 8% 20% 17% 16%
Altruism
A healthier future. Pass it on.
5 14% 14% 14% 9% 17%
Innovation, New Research
One size does not fit all.
6 13% 13% 11% 20% 10%
‐ 100% 100% 100% 100% 100%
Overview Recap
D
i
g
i
t
a
l
A
d
s
P
o
s
t
e
r
s
* Red denotes highest preference across the sub‐population demographics.
Aggregate Total Population Preference by Creative Asset (Sub‐Population)
Creative Asset Variation Overall Preference Race / Ethnicity Preferences
Digital Posters Rank Percent
African‐
American
Hispanic‐
Latino
Asian‐
American
Caucasian
Empower, Control Righting Wrongs
Not all research is created equal
(that’s why we’re here).
1 28% 33% 27% 25% 25%
What’s In It for Me?
What’s good for you is good for us.
2 20% 24% 25% 14% 15%
Finding Cures
Fighting disease just got one million times easier.
3 17% 16% 14% 27% 13%
Community, Tribe, Family, Legacy
Legacies aren’t just ones you can spend.
4 13% 10% 19% 14% 11%
Innovation, New Research
The next big thing in health is here.
5 13% 12% 9% 13% 18%
Altruism
We can win the game as soon as we all get in it.
6 10% 5% 6% 7% 18%
‐ 100% 100% 100% 100% 100%
Observations & Findings for A/B Testing:
As with gender and age, matrices reveal certain message persona themes resonate at varying levels depending on
respondent’s race / ethnicity.
Distinct preference nuances exist that can be identified by race / ethnicity – and which can be initially used for
testing and optimizing future media and communications
Survey Section 1 / Questions 1 ‐ 2: Creative Testing ‐ Persona Self‐Identification Classification
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 6
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Aggregate Total Population Preference by Creative Asset
Creative Asset Variation Preference Gender Age Group
Ads + Posters Rank Percent Male Female 18‐24 25‐34 35‐54 55+
What’s In It for Me? 1 23% 21% 24% 27% 25% 23% 16%
Empower, Control Righting Wrongs 2 21% 21% 22% 25% 22% 20% 18%
Finding Cures 3 17% 15% 18% 14% 15% 16% 21%
Community, Tribe, Family, Legacy 4 14% 16% 12% 10% 13% 15% 18%
Innovation, New Research 5 13% 12% 14% 11% 12% 14% 14%
Altruism 6 12% 14% 10% 12% 11% 11% 13%
‐ 100% 100% 100% 100% 100% 100% 100%
A
g
g
r
e
g
a
t
e
d
R
e
s
u
l
t
s
Aggregate Total Population Preference by Creative Asset
Creative
Variation
Altruism Finding Cures
Community,
Tribe, Legacy,
Family
Innovation, New
Research
Empowerment,
Control, Righting
Wrongs
What’s In It for
Me?
Ad Rank
Preference
5 2 3 6 4 1
Poster Rank
Preference
6 3 4 5 1 2
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Creative
Rankings
Illustration bias may exist over alternative photo
choices. (Survey presented only one illustration against
photo variations. Note: ranking #1 for ad and poster –
each are illustrations.)
Correlation for gender and age self‐identification is
evident in varying degrees for single person
photography.
Illustrations may appeal more to younger audiences
(18‐24) + (25‐34) compared to older audiences.
Group photos may work better if they represent larger
multi‐cultural groups of people.
Younger generations may gravitate to images, older
generations headlines.
Males may be more inclined to gravitate to images with
females leaning towards headlines.
55+ age groups are more inclined to gravitate to
headlines over images.
Ambiguous creative headlines (tags) may be less
appealing or less understood across both gender and
age.
Appeal for each headline (tag) skews either younger or
older and may map to personal life stage (age values)
relevance.
For a modest portion of the sub‐population which
didn’t find any ads appealing, there were two primary
and common reoccurring themes:
– lacks appeal / doesn’t create interest
– didn’t provide enough information to understand
what the ad was about (further validating creative
headlines may need to be easily understood)
Ads and other creative assets should always have brief
explainer body copy to pass along a quick program
comprehension message takeaway.
Observations & Findings for A/B Testing:
Overview Recap
Survey Section 1 / Questions 1 ‐ 2: Creative Testing ‐ Persona Self‐Identification Classification
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 7
Survey Section 1 / Persona Matching ‐ Self‐Identification Classification
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Overview Recap
Observations & Findings for A/B Testing:
Chart and matrix reveals persona matching groupings can be of different population sizes aligned to potential race /
ethnicity differences in motivational behaviors and personal values. Based on these findings ‐‐ creative design,
strategic execution and budgets can all be tested, verified and optimized in alignment with and targeted to each sub‐
population.
From the aggregate population, we can see different persona groups rise above and fall below the aggregate average.
Within each sub‐population, different personas will have degrees of varying influence.
Population Group Edgar Tallulah Chris Lorraine Miguel Non‐Classified
Aggregate 13% 19% 15% 21% 28% 5%
African‐American 9% 23% 17% 18% 29% 4%
Hispanic‐Latino 9% 16% 14% 25% 32% 4%
Asian‐American 10% 27% 12% 20% 27% 4%
Caucasian 19% 13% 15% 20% 25% 8%
Self Identification Questions were designed to have a respondent self‐ identify their dominant persona into (5)
‘positive’ persona types. Persona matching has taken into consideration respondents may have multiple dominant and
secondary motivations.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 8
Survey Section 1 / Persona Matching ‐ Self‐Identification Classification
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Overview Recap
Edgar | Ready to go
Characteristics
• Altruistic
• Skews older
• Has free and/or flexible time
• Likely volunteers
• Tends to trust doctors and
government
• Could have disease or not have
disease
• May want deeper engagement
after joining (e.g. recruit others)
Observations & Findings:
Optimized Demo:
[ Male (all ages) + F (55+) ]
[ HS Graduate thru College Degree ]
[ <100K HHI ]
Tallulah | Determined
Characteristics
• Newly diagnosed with chronic
disease
• Skews younger
• Committed to beating own
disease
• Tends to trust doctors ad
government
• Likely to track health
• Wants to help self, but also others
withy disease
• May engage more deeply after
joining (e.g. citizen science)
Observations & Findings:
Optimized Demo:
[ Female (all ages) + M (55+) ]
[ HS Graduate thru College Degree ]
[ <100K HHI ]
Chris|Curiousbutdistracted
Characteristics
• Health‐oriented, not likely to have
chronic disease
• Skews younger
• Likely to track health; unlikely to
share socially
• Many things compete for
attention
• Influenced by social network
• Requires convenience; All of Us
must fit in with flow of life
• Wants to use All of Us results in
daily life
Observations & Findings:
Optimized Demo:
[ (M + F) + (18‐24) + (25‐34) + (35‐54) ]
[ HS Graduate thru College Degree ]
[ <100K HHI ]
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 9
Survey Section 1 / Persona Matching ‐ Self‐Identification Classification
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Overview Recap
Lorraine|Community‐centric
Characteristics
• Distrusts doctors/medical
profession
• Sees doctors infrequently
• Skeptical that All of Us would be
equitable
• Needs proof that community
matters
• Requires multiple touchpoints
before joining
• Requires face‐to‐face interactions,
to build trust
Observations & Findings:
Optimized Demo:
[ (M + F) + all ages)]
[ HS Graduate thru College Degree ]
[ <100K HHI ]
Miguel|Suspiciousbutpositive
Characteristics
• Sees doctors infrequently; uses
free clinics/ER for care
• Likely does not have chronic
disease
• Distrusts government (“it’s
malevolent”)
• Unlikely to donate DNA
• Concerned All of Us could harm
people
• Wants to protect
self/family/others
• Wants to help humanity in
substantive ways
Observations & Findings:
Optimized Demo:
[(M + F) + (18‐24) + (25‐34) + (35‐54) ]
[ HS Graduate thru College Degree ]
[ <100K HHI ]
Gen Pop|Non‐Classified
Characteristics
• A mashup of all persona
characteristics without any single
behavioral attribute being
dominant.
• A high percentage of these
individuals (those people who
may be more complex in their
thinking and values) are over 55
years of age.
Observations & Findings:
Optimized Demo:
[ M (55+) + F (55+) ]
[ HS Graduate thru College Degree ]
[ <75K HHI ]
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 10
Survey Section 2 / Questions 3: Anthem Video Inspiration Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Overview Recap
Yes
82%
No
18%
Gender + Age Segment Group
differences within + 2 percentage
points.
After watching the video, do you want to learn more about the program?
Observations & Findings for A/B Testing:
A high percentage of those watching the Anthem inspirational video were inspired to learn more. Very little
differentiation was discovered by gender or age.
People were inspired by the video from two core recurring themes: 1) diversity of people shown in the video, and
2) the underlying storyline and message.
Of those who were not inspired, which a reasonably large percentage, recurring themes surrounding the video
content were 1) video didn’t provide sufficient information to understand program, and 2) message takeaway was
not easy to understand or it was unclear.
Of note, the video tested was the inspirational video, and therefore, it was designed to inspire people to want to
learn more without explaining the program or its intended benefits at length. A consideration may be to distill or
refine the messaging within the video for a bit more clarity to help people better understand the core premise of
the program.
“It didn't give me enough information about the organization to be even interested. Just a lot of nice pictures.”
“It seemed like a very generic commercial that spreads itself too thin by trying to appeal to every demographic
possible. I learned nothing about what it was actually trying to advertise.”
Quick test to see if the Anthem video inspires viewers with added insights into why or why not.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 11
EDGAR
PERSONA
Altruism,
Innovation,
Legacy
and
Family
Body Copy: The more researchers know about what makes each of us unique, the
more tailored our health care can become. Join a research effort with one million
people nationwide to create a healthier future for all of us.
Survey Section 3 / Question 4: EDGAR Persona Creative Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 1,479)
Aggregate Total Population Preference by Creative Variation
Creative Asset Variation Preference Gender Age Group
Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+
Diversity, meet data. 1 29% 28% 30% 36% 33% 30% 18%
The future of health begins with you. 2 26% 25% 28% 15% 22% 24% 40%
Transform your life... and theirs. 3 15% 16% 14% 14% 18% 17% 13%
When we’re all present, we all win. 4 12% 12% 11% 11% 10% 12% 14%
Your data saves life even after yours is over. 5 12% 11% 12% 15% 10% 11% 10%
Join like there is a tomorrow. 6 6% 7% 5% 9% 7% 5% 4%
‐ 100% 100% 100% 100% 100% 100% 100%
Overview Recap
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Observations & Findings for
A/B :
 Persona Match: Edgar ‐
13% of total aggregate
population.
 Top ranked choice had
appeal across age groups
and gender suggests
persona appeal for both
message and image.
 Skews younger (albeit high
across all age groups).
 There are distinct appeal
nuances associated with
each ad variation across
gender and age.
 In aggregate, top 2 ranked
choices have a high degree
of resonance across gender
and age.
Male, 59% Female, 41%
* Illustration bias may exist over presented photography alternatives.
Persona Gender Demographic
Creative test to measure appeal and resonance matched against persona archetype.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 12
Observations & Findings for
A/B Testing:
 Persona Match: Tallulah ‐
19% of total aggregate
population.
 Top ranked choice had
appeal across age groups
and gender suggests
persona appeal for both
message and image.
 Skews younger and with
females.
 As with all personas,
distinct nuances exist for
each ad variation across
gender and age.
 In aggregate, top 2 ranked
choices have a high degree
of resonance across
gender and age.
Body Copy: The more researchers know about what makes each of us unique, the
more tailored our health care can become. Join a research effort with one million
people nationwide to create a healthier future for all of us.
TALLULAH
PERSONA
Finding
cures,
Empowerment,
What’s
in
it
for
me
Survey Section 3 / Question 4: TALLULAH Persona Creative Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,231)
Aggregate Total Population Preference by Creative Variation
Creative Asset Variation Preference Gender Age Group
Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+
Treatments as unique as you. 1 22% 16% 27% 30% 20% 19% 19%
The right treatment, for the right person,
at the right time.
2 22% 21% 22% 19% 20% 23% 24%
The future of health begins with you 3 20% 22% 19% 14% 18% 22% 26%
The future is happening you want in? 4 17% 19% 16% 17% 19% 19% 15%
It's less about illness more about people. 5 9% 11% 8% 10% 12% 9% 7%
Medical research could use an update. 6 9% 11% 8% 9% 11% 8% 9%
‐ 100% 100% 100% 100% 100% 100% 100%
Overview Recap
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
* Illustration bias may exist over presented photography alternatives.
Male, 47% Female, 53% Persona Gender Demographic
Creative test to measure appeal and resonance matched against persona archetype.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 13
Survey Section 3 / Question 4: CHRIS Persona Creative Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 1,756)
Aggregate Total Population Preference by Creative Variation
Creative Asset Variation Preference Gender Age Group
Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+
It takes a village to beat disease. 1 32% 27% 36% 39% 33% 29% 26%
There's only one condition: The human
condition.
2 27% 28% 26% 23% 24% 30% 34%
We 're putting the ease in disease research. 3 12% 14% 11% 11% 14% 11% 12%
Progress. In real time. 4 11% 10% 12% 10% 12% 13% 10%
The future of health begins with you. 5 10% 11% 9% 9% 9% 11% 13%
One million people. Now that's strength in
numbers.
6 8% 10% 6% 9% 8% 7% 6%
‐ 100% 100% 100% 100% 100% 100% 100%
Overview Recap
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Body Copy: The more researchers know about what makes each of us unique, the
more tailored our health care can become. Join a research effort with one million
people nationwide to create a healthier future for all of us.
CHRIS
PERSONA
Innovation,
Community
and
Tribe,
What’s
in
it
for
me
Observations & Findings for
A/B Testing:
 Persona Match: Chris ‐
15% of total aggregate
population.
 Top ranked choice had
preference across most
age groups and gender
reinforces persona appeal
for message and image.
 Skews younger and more
to females over males.
 In aggregate, top 4 ranked
choices have a high or
modest degrees of
resonance across gender
and age.
* Illustration bias may exist over presented photography alternatives.
Male, 47% Female, 53% Persona Gender Demographic
Creative test to measure appeal and resonance matched against persona archetype.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 14
Body Copy: The more researchers know about what makes each of us unique, the
more tailored our health care can become. Join a research effort with one million
people nationwide to create a healthier future for all of us.
LORRAINE
PERSONA
Community
and
Tribe,
Righting
Wrongs,
Altruism
Survey Section 3 / Question 4: LORRAINE Persona Creative Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,437)
Aggregate Total Population Preference by Creative Variation
Creative Asset Variation Preference Gender Age Group
Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+
It will take all of us to make history.
Are you in?
1 33% 32% 35% 36% 32% 34% 32%
The future of health begins with you. 2 24% 22% 27% 18% 27% 27% 23%
Your data can save lives, and not just yours. 3 14% 15% 12% 15% 14% 13% 13%
Health for everybody. 4 10% 9% 10% 7% 8% 10% 14%
Research shows research could be better. 5 10% 12% 7% 10% 10% 8% 11%
We can't see you if you don't raise your hand. 6 10% 10% 9% 14% 10% 8% 7%
‐ 100% 100% 100% 100% 100% 100% 100%
Overview Recap
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Observations & Findings for
A/B Testing:
 Persona Match: Lorraine ‐
21% of total aggregate
population.
 Top preference across all
age groups and gender
reinforcing persona appeal
for message and image.
 Skews slightly more to
females over males.
 Group photo also has high
appeal across gender and
age groups.
 In aggregate, top 3 ranked
choices have a high or
modest degrees of
resonance across gender
and age.
* Illustration bias may exist over presented photography alternatives.
Male, 51% Female, 49% Persona Gender Demographic
Creative test to measure appeal and resonance matched against persona archetype.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 15
Survey Section 3 / Question 4: MIGUEL Persona Creative Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 3,288)
Aggregate Total Population Preference by Creative Variation
Creative Asset Variation Preference Gender Age Group
Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+
It's our differences that make all the
difference.
1 43% 43% 43% 34% 45% 50% 45%
The future of health begins with you 2 30% 30% 29% 37% 29% 25% 26%
Diversity, meet data. 3 12% 12% 12% 15% 13% 11% 8%
Health isn't a sideline sport. 4 5% 7% 4% 4% 5% 5% 9%
Give. Learn. Cure. 5 5% 4% 6% 6% 5% 4% 4%
It's time everyone had a seat at the table. 6 5% 4% 5% 5% 3% 5% 8%
‐ 100% 100% 100% 100% 100% 100% 100%
Overview Recap
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Body Copy: The more researchers know about what makes each of us unique, the
more tailored our health care can become. Join a research effort with one million people
nationwide to create a healthier future for all of us.
MIGUEL
PERSONA
Righting
Wrongs,
Legacy
and
Family,
Altruism
Observations & Findings for
A/B Testing:
 Persona Match: Miguel ‐
28% of total aggregate
population.
 Top preference across all
age groups and gender
reinforcing persona appeal
for message and image.
 Large group photo works
better than smaller group
photos.
 Skews evenly across
gender with a slight uptick
with age.
 In aggregate, top 2 ranked
choices have a high
degrees of resonance
across gender and age.
* Illustration bias may exist over presented photography alternatives.
Male, 47% Female, 53% Persona Gender Demographic
Creative test to measure appeal and resonance matched against persona archetype.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 16
Observations & Findings for
A/B :
 Persona Match: Non‐
Classified ‐ 5% of total
aggregate population.
 Top two ranks ‐ preference
across all age groups and
gender reinforcing persona
appeal for message and
image.
 Soldier image resonates
with males over females in
greater percentages as may
be expected.
 Remaining choices sample
size too small to predict
appeal.
Survey Section 3 / Question 4: NON‐CLASSIFIED / GEN POP Persona Creative Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 620)
Aggregate Total Population Preference by Creative Variation
Creative Asset Variation Preference Gender Age Group
Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+
1 ‐ The future of health begins with you v3 1 33% 41% 23% 39% 25% 25% 38%
2 ‐ The future of health begins with you v4 2 33% 30% 36% 21% 44% 38% 31%
3 ‐ The future of health begins with you v6 3 21% 15% 28% 26% 19% 27% 15%
4 ‐ The future of health begins with you v1 4 6% 7% 4% 0% 9% 4% 10%
5 ‐ The future of health begins with you v2 5 6% 4% 7% 11% 4% 4% 4%
6 ‐ The future of health begins with you v5 6 2% 2% 1% 3% 0% 2% 2%
‐ 100% 100% 100% 100% 100% 100% 100%
Overview Recap
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Body Copy: The more researchers know about what makes each of us unique, the
more tailored our health care can become. Join a research effort with one million
people nationwide to create a healthier future for all of us.
NON-CLASSIFIED
Non‐Classified
Motivational
Behaviors
Male, 57% Female, 43% Persona Gender Demographic
Creative test to measure appeal and resonance matched against persona archetype.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 17
Survey Section 4 / Question 4: NON‐CLASSIFIED / Social Media Use Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Overview Recap
What social media platforms do you currently use and have a personal profile?
83%
50%
44%
32%
62%
12%
32%
7%
Facebook Instagram Twitter SnapChat YouTube Tumblr Google+ None
Observations & Findings for A/B Testing:
 Expected core social media platforms (Facebook, Twitter, Instagram, YouTube) are channels of
preferred choice.
 Other channels (SnapChat, Tumblr, Google+) are significant in use, which warrant future consideration
and expansion of long‐term social media campaigning.
 Test populations are more inclined to follow companies and brands they like than they are to follow
health oriented or charitable causes. This simply means message testing for resonance should be an
ongoing process.
 Social media use is high within the test population with more than 75% active and engaged on a daily
basis. This bodes well for the AOU program. The challenge will be continually producing fresh content
that is both engaging and sharable.
 Image posts and infographics with large visuals are the most desirable form of content. This maps to
universal social media user habits. However, other forms of content will (and should) have a purpose
and use within the overall campaign strategy.
Survey polling designed to help steer the social content strategy and to identify where test populations are congregating
across social media.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 18
Survey Section 5 / WEBSITE HEAT MAPPING – Content Appeal & Resonance
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Overview Recap
About, 4.38
Program
Overview, 3.69
Privacy
Safeguards, 2.77
Who's Involved,
2.65
FAQ, 7.05
How to Join, 0.45
Who Can Join,
0.36
What You
Need to Do, 0.45
Benefits of
Taking Part, 0.34
How Your Data
Will Be Used, 0.47
0.00
1.00
2.00
3.00
4.00
5.00
6.00
7.00
8.00
AVERAGE LANDING PAGE
CLICKS PER SURVEY RESPONDENT
Observations & Findings for A/B Testing:
When comparing how many average clicks a respondent made on each lading page (which demonstrates content of
interest or high appeal), we can see The About Landing pages and sub‐domains received far greater attention and
interest than The How To Join landing page and sub‐domains.
At this early advance national enrollment stage, and without respondents having been exposed to the program prior
to the survey, this can be expected that the majority of respondents would spend more time gathering information on
the background of the program versus information for what’s involved with enrolling.
Of special note and significance, is the average number of clicks for the FAQ sub‐domain. We can make a logical
conclusion that the information and content contained within this site section will be the leading area of interest for
much of the general population as they embark on their personal user discovery journey.
Designed to gather respondent insights into website content resonance and overall program understanding.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 19
Survey Section 5 / Question 6: Program Comprehension Testing (Part 1)
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Overview Recap
1%
2%
4%
8%
16%
70%
Other
A blood bank program with centers across the U.S.
A program that does genetic testing for people in
the U.S.
A program that provides me with personalized
healthcare.
A health insurance program for people in the U.S.
A national research program to improve health.
Based on the website you just looked at, which statement best describes what
the program is?
Observations & Findings for A/B Testing:
After respondent visited the website and spent time with our content, and after they had been exposed to a series of
creative assets, the survey tested program comprehension.
The results reveal that 70 percent of the total population respondents were able to pick the correct response.
What this may tell us is that messaging within all assets (creative and web) may need to be more simplified and
distilled into an easier to understand explanatory program benefit statement which is memorable.
Although there are some nuances in the results, there were very little significant differentiation across sub‐populations
(race/ethnicity, gender, age) as well as with education and income levels.
67%
66%
74%
72%
African‐American
Hispanic‐Latino
Asian‐American
Caucasian 66%
73%
Male Female
63% 63% 70% 83%
18‐24 25‐34 35‐54 55+
Designed to help determine ease of program understanding and benefit after initial exposure to website content.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 20
Survey Section 5 / Question 7: Animation Video Testing & Program Comprehension Testing (Part 2)
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811)
Overview Recap
Observations & Findings for A/B Testing:
 A high percentage of the respondents were further inspired for learning more about the program after watching
the animation video. That’s good news.
 However, of peculiar note, the second testing for program comprehension actually went down by two percentage
points, where it would have been expected to increase on the second comprehension test.
 Possibly, the word choice and inclusion of ‘precision medicine’ in the correct description may in itself (the phrase)
be not clear for many in the general population. It is somewhat a technical, insider phrase without mass
awareness.
 As with other observations after the first comprehension test, it may be beneficial to work on a more simplified
program description to ensure at every touchpoint, clarity is provided for those early in the discovery journey.
 And, as with the first test, there are subtle nuances associated within the sub‐population segments. (see Section 5:
Program Comprehension detail)
After watching the video, do you want to learn more about
the program?
Yes
85%
No
15%
Based on the video you just watched, which
statement best describes what the program is?
1%
1%
7%
11%
13%
68%
Other
A natiowide blood donation
program.
A program thyat collects DNA frm
everyone in the U.S.
A new type of health insurance
program for people in the U.S.
A program that will provide
personal medical care specifically…
A national research program to
improve precision medicine.
Designed to test video content for ease of program comprehension and general understanding.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 21
Survey Section 6 / Question 8: Program Comprehension Re‐Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,369)
Overview Recap
Observations & Findings for A/B Testing:
 In aggregate, across both comprehension testing questions, a reasonably high percentage of the respondents
were unable to choose the correct response for either question (2,369 respondents or 20% of total surveyed
population).
 As with the other observations after the first two comprehension tests, it may be beneficial to work on a more
simplified program description to ensure at every touchpoint, greater clarity is provided for those early in the
discovery journey.
Tracking logic was applied to move respondents to the pre‐close stage for measuring impact and influence of site
information and creative video content.
20%
80%
INCORRECT Response
CORRECT Response
Designed to move respondents either into a pre‐close conversion test or to give them one last opportunity for
understanding the program and its benefit.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 22
Survey Section 6 / Question 8: Program Comprehension Re‐Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,369)
Overview Recap
Please read the following program description.
The All of Us Research Program is a large research program. The goal
is to help researchers understand more about why people get sick or
stay healthy. All of Us is part of the Precision Medicine Initiative.
We hope that more than a million people will join All of Us. People who
join will give us information about their health, habits, and what it’s like
where they live. By looking for patterns, researchers may learn more
about what affects people’s health.
The All of Us Research Program will last for many years. This will allow
us to study health over time.
If you decide to join the All of Us Research Program, you will be
contributing to an effort to improve the health of generations to come.
You also may learn about your own health.
What is the All of Us Research Program?
One last opportunity was provided to these survey respondents to choose the correct response for the program
description by having them read a full program description and then to correctly pick the most appropriate answer.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 23
Survey Section 6 / Question 8: Program Comprehension Re‐Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,369)
Overview Recap
Observations & Findings for A/B Testing:
 Based on this population audience who struggled with understanding the program, two out of every three
individuals in this population subset still have trouble grasping the understanding and key benefit of the
program. – even though 91 percent of this population subset stated our program description was easy to
understand.
 This audience, who still had an incorrect response after three attempts to the comprehension question, and
which represents approximately 14 percent of the total survey population, likely will never be a candidate for
the program for a myriad of reasons.
 We must assume a sizeable portion of the national general population will never appeal to the program, or to
our communications, and marketing should optimize to find population pools who are much more receptive to
learning more about the program.
 However, of note as a recurring theme, refining the core message into a simplified and quickly understandable
benefit statement, and without the use of medical or industry jargon, may reach and influence a portion of this
classified audience‐type as represented in this survey with future communications.
 Recurring themes for those individuals who were not able to choose the correct response is sampled below.
Based on the program description you just read, which statement best describes
what the program is?
6%
15%
18%
29%
32%
A programs that tests your genes and DNA.
A blood donation program with centers across the U.S.
A program that provides me with information about
my personal health.
A program that provides health insurance for
individuals and families.
A large research program to advance the practice of
medicine.
What is it about our program description which is not clear?
“At first I was under the impression that it was a health care program. I feel like the website makes it
seem as if a participant will receive a direct benefit from entering the program, but the program itself is
just to collect research.”
“Seems like a lot of info to take in. The description is clear, but it's not really explained properly.”
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 24
Designed to test phrases which would resonate with targeted audiences.
Survey Section 7 / Question 9A: Pre‐Close Conversion Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 9,442)
Overview Recap
Observations & Findings for A/B Testing:
 Based on the polling conducted, there are clear winners and losers in the choices provided.
 Since some tags were already tested earlier in the survey, if we compare previous testing with this polling
question, we can see there are differences in appeal and preference. What this tells us is that preference for
creative compositions are a combination of both image and tag, although one strong element could be the
deciding factor for how well content resonates with an individual.
 The top 3 choices in the poll do align with previous tested rankings, so it’s a logical conclusion that these tags in
particular would perform well in creative assets.
2%
4%
5%
8%
9%
10%
11%
15%
16%
20%
Doctor will see you now
One‐of‐a‐Kind is kind of our thing
Takes a village to beast disease
30,000 diseases…let's get to work
Diversity, meet data
Your future, my legacy
Everybody has a story
Our differences make the difference
There's only one condition, the human condition
Fighting disease just got 1M times easier
Please rank the following phrases which would make you want to learn more
about the program?
Tags Previously Tested Polling Rank Tested Rank Test Section / Question
Fighting disease 1 #3 Q2 (Motivation) / Finding Cures
Only one condition… 2 #2 Q4 (Persona) / Chris
Our differences… 3 #1 Q4 (Persona) / Miguel
Diversity, meet data. 6 #1 Q4 (Persona) / Edgar
Diversity, meet data. 6 #3 Q4 (Persona) / Miguel
Takes a village… 8 #1 Q4 (Persona) / Chris
One‐of‐a‐kind… 9 #1 Q1 (Motivation) / What’s in it for me
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 25
Designed to test whether individuals would have enrollment concerns after exposure to program via this survey.
Survey Section 7 / Question 9B, 9C: Pre‐Close Conversion Testing
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 9,442)
Overview Recap
Observations & Findings for A/B Testing:
 Based on the survey question, a sizeable percentage of all survey respondents do have concerns about enrolling
in the program.
 Asian‐Americans are significantly more concerned over other sub‐population groups. Of note, the African‐
American and Hispanic‐Latino sub‐populations are below Caucasians as a group with greater concerns.
 Overall, data security and privacy are the top two concerns with other choices presented staggered behind
(although each concern is of significant size.)
Do you have any concerns about joining the program?
Yes
30%
No
70%
What are your concerns?
25%
34%
36%
39%
47%
67%
68%
Loss of status
Time
Data types
Government
Research ethics
Privacy
Data security
27%
27%
38%
30%
African‐American
Hispanic‐Latino
Asian‐American
Caucasian
YES Response
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 26
Section 7 / Survey Question 9D: Pre‐Close Conversion Testing
We appreciate your concerns.
Would you still be interested in joining the program?
 Yes (advance to Q9F)
 No (advance to Q9G)
NO - WOULD NOT JOIN Review by Sub-Population
60% 66% 63% 58%
40% 34% 37% 42%
African‐American Hispanic‐Latino Asian‐American Caucasian
Join Inclination x Sub‐Population
Yes No
Yes, 61% No, 39%
Overview Recap
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,845)
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 27
Section 7 / Survey Question 9G: Pre‐Close Conversion Testing
Why would you not want to join the program?
Advance to survey termination
Thank you for your time and for sharing your opinions.
Your thoughts are very important to us. Have a great day!
Observations & Findings for A/B Testing:
 For the small sample base population who would not want to join the program, recurring themes included
expected responses as identified in the previous question.
 Several new concerns identified which are just as critical to address for long‐term program success are: TRUST,
CREDIBILITY and RISK.
Overview Recap
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 1,097)
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 28
Section 7 / Survey Question 9F: Pre‐Close Conversion Testing
What are your main reasons for wanting to join the program?
Advance to survey termination
Thank you for your time and for sharing your opinions.
Your thoughts are very important to us. Have a great day!
Observations & Findings for A/B Testing:
 For those expressing an interest in joining the program, sentiments were all very positive. A sampling of those
are above.
 All of the ecology model persona motivations showed up in the comment findings: altruistic, advancing
healthcare, making a difference, a better future, finding cures and more.
“The program seems very promising. I believe this program could change the whole world and help many
that in need and after I watch this video I never realize there was an organization that cared about people
other then money unlike the rest so in the future I will probably join the program.”
“It can help other people in the future. 2. Like the video said,
not everyone is the same so meds and treatments should be
tailored to the person's issues.”
“Anything that helps enlighten
us about new age medicine to
fight various illnesses and
preserve healthy lives is a no
brainer to me.”
“As a healthcare provider, I would love to be a part of a life changing organization where research is the
priority to figuring out the behind the scenes of unexplainable illnesses.”
“As someone who is fascinated by the health and wellness industry, I think this is a revolutionary
approach to better serving the people who truly matter in this interaction: the patients. I'm also interested
to see how far the research will take the healthcare industry in my lifetime and how the data that is
accrued will be implemented/used in actual practice Also, it is so very important to recognize diversity,
especially in healthcare.”
“I'm fully
aware that
there are no
"one size fits
all" diagnoses
and treatment
options, I
believe the
more data we
have the
more tools
we have to
fight
disease”.
“An opportunity to contribute to the
human race and make a difference for
healthcare outcomes. An opportunity to
contribute to precision medicine, which
sounds like a potentially groundbreaking
approach to medicine.”
Besides being
part of a project
that has the
prospect of
helping so many
people and my
loved ones, I
think it would be
so important to
be part of
something that
could benefit
millions of people
in the future.
Overview Recap
KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 6,628)
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 29
SURVEY DESIGN
(Logic Flow and Methodology)
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 30
Advance to Q3A
Advance to Q2A
Self Identification Logic Applied
Match Applied Based on Persona Coded Responses
Branching Question Follow in Section 3 Based on Matched Coded Persona
Persona Pre‐Qualifier ‐ Self Identification Questions
Persona 1
Edgar ‐
Ready to Go
Persona 2
Tallulah ‐
Determined
Persona 3
Chris ‐ Curious But
Distracted
Persona 4
Lorraine ‐ Community
Centric
Persona 5
Miguel ‐ Suspicious
But Positive
Section
1:
Persona
Self
Identification
Classification
Photo
Image
Headline
(large text)
Both
Photo
Image
Headline
(large text)
Both
Separate African‐
American, Hispanic,
Asian, Caucasian ad
set groups to be
presented based on
targeting.
Self Identification
Questions are designed
to have a respondent
self‐ identify their
dominant persona into
(5) ‘positive’ persona
types.
Persona matching has
taken into
consideration
respondents may have
multiple dominant and
secondary motivations.
Question choices will
be randomized
multiple choice with
one optional open
ended choice.
Which ad makes you
want to click to learn
more about the
program?
What about the ad
did you like?
Which poster makes
you want to learn more
about the program?
What about the poster
did you like?
Q1A
Q2A
Q1B
Q2B
Display
Ad 1
Altruism
Display
Ad 2
Finding
Cures
Display
Ad 3
Community
& Family
Display
Ad 4
Innovation
Display
Ad 5
Righting
Wrongs
None
Forced
Open
Ended
Display
Ad 6
What’s In
It For Me
Poster 1
Altruism
Poster 2
Finding
Cures
Poster 3
Community
& Tribe
Poster 4
Innovation
Poster 5
Righting
Wrongs
Poster 6
What’s In
It For Me
None
Forced
Open
Ended
Section
2:
Video
Inspiration
Testing
Were you inspired by the video?
Why were you not
inspired?
(open‐ended)
Why were you
inspired?
(open‐ended)
Q3A
VIDEO SEGUE
Now, please watch the following video.
Present Anthem Video
Yes No
Q3B
Q3 specifically tests the
Anthem video’s
inspirational value for
learning more about
the program.
After watching the video, do you want to
learn more about the program?
Yes No
Q3C Q3D
Branching Yes/No
Logic Flow.
Section
3:
Persona
Match
Creative
Testing
Which poster makes you want to learn
more about the program?
(Persona Match Branching Question)
Persona 1
Edgar ‐
Ready to Go
Persona 2
Tallulah ‐
Determined
Persona 3
Chris ‐ Curious,
Distracted
Persona 4
Lorraine ‐
Community
Centric
Persona 5
Miguel ‐
Suspicious,
Positive
Non‐Classified
General
Population
Q4A Each of the (5) Persona
Groups is served a
unique set of creative
content matched to
the respondent’s self‐
identified dominant
persona type category
to test resonance and
appeal for creative
composition +
messaging.
5 x Option
Creative +
Message
(randomized
multiple choice)
5 x Option
Creative +
Message
(randomized
multiple choice)
5 x Option
Creative +
Message
(randomized
multiple choice)
5 x Option
Creative +
Message
(randomized
multiple choice)
5 x
Creative +
Message
(randomized
multiple choice)
What about the poster did you like?
3x Option Single Pick
Q4B
Photo/Image
Large Text
Headline
Both
5 x Option
Creative +
Message
(randomized
multiple choice)
If none selected, Advance to Q5A
SURVEY LOGIC FLOW
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 31
Q5 series of questions
tests social media use
and likely inclination to
follow and engage with
an AoU‐oriented
program with the
objective to help steer
content strategy.
Section
4:
Social
Media
Use
Testing
On social media, do you follow (like)
companies and brands?
Yes No
On social media, do you follow (like) any
medical or healthcare organizations?
Yes No
Q5D
On social media, do you engage with
stories and content shared from companies
and organizations you may follow?
Yes No
What social media platforms do you
currently use? (Multi‐Pick List)
Facebook Instagram Twitter SnapChat YouTube Tumblr Google+
Q5A
Q5B On social media, do you follow (like)
any community causes?
Yes No
Q5C
Q5E
How often do you use your social
media accounts? (Single‐Pick List)
Once a day
More than
once a day
Several times
per week
Once a week
Monthly or
infrequently
It depends,
all of above
Q5F
Section
5:
Site
&
Video
Program
Comprehension
Testing
Incorrect
Understanding
Incorrect
Understanding
WEBSITE SEGUE
Thanks! Now we’d like to show you a website.
There are two parts to the website. Take your
time to look at parts 1 and 2.
Each part has sections within it. To reach those
sections, click the (navigation menu) buttons at
the top of the pages as you would with
other websites…
About Landing Page
(Nav Bar Selectable)
Program Overview
(Nav Bar Selectable)
Privacy Safeguards
(Nav Bar Selectable)
Who’s Involved
(Nav Bar Selectable)
FAQ
(Nav Bar Selectable)
Website pages interactivity is limited to a clickable menu navigation bar. Respondents will be able to scroll and click on
areas of interest within the static page formats.
Please review carefully the following website sections and
CLICK on the content areas you would explore if you had
discovered the website on your own and wanted to learn more.
PLEASE TAKE ALL THE TIME YOU NEED.
CLICK AS MANY TIMES AS YOU LIKE.
How to Join
(Nav Bar Selectable)
Who Can Join?
(Nav Bar Selectable)
What You Need to Do
(Nav Bar Selectable)
Benefits of Taking Part
(Nav Bar Selectable)
How Data Will Be Used
(Nav Bar Selectable)
Based on the website you just looked
at, which statement best describes
what the program is?
A health insurance
program for people
in the U.S.
A blood bank
program with
centers across
the U.S.
A national research
program to improve
health.
A program that does
genetic testing for
people in the U.S.
A program that
provides me with
personalized
healthcare.
Other
Forced Open Ended
Response
Q6
Correct
Optional (incorrect) descriptions represent
the most common likely misinterpretations
for the AoU program with one open ended
option to allow a respondent to share an
unrepresented choice.
This section with Q7 tests website
content which would likely be
reviewed and read based on personal
appeal, motivations and interests.
SURVEY LOGIC FLOW
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 32
Based on the video, which statement
best describes what the program is?
A program that
collects DNA from
everyone in the U.S.
A new type of
health insurance
program for people
in the U.S.
A national research
program to improve
precision medicine.
A nationwide blood
donation program.
A program that
provides information
about my personal
health.
Other
Forced Open Ended
Response
Incorrect
Understanding Correct
Incorrect
Understanding
Optional (incorrect) descriptions
represent the most common
likely misinterpretations for the
AoU program with one open
ended option to allow a
respondent to share an
unrepresented choice.
Q7A
VIDEO SEGUE
Great! Lastly, please watch one more video.
Present Animation Video
Yes
No, why would you
not want to learn
more?
Q7B
After watching the video, do you want to
learn more about the program?
Section
5:
Site
&
Video
Program
Comprehension
Testing
If Respondent Had Incorrect Program Description Responses for Testing Questions (Q6 & Q7B)
Continue to Section 5, Questions 8
If Respondent Had At Least One Correct Program Description Response for Testing Questions (Q67 & Q7B)
Continue to Section 6, Questions 9
Q8 further tests respondent’s
inspiration and
comprehension linked to
specifically the Animation
video.
Section
6:
Program
Comprehension
Re‐Testing
Now, which statement best describes
what the program is?
4 x Option Single Pick
(randomized ‐ multiple choice)
A blood donation program
with centers across the U.S.
A program that provides
health insurance for
individuals and families.
A large health research
program to advance the
practice of medicine.
A program that tests
your genes and DNA.
A program that provides me
with information about my
personal health.
Please read the following program description.
The All of Us Research Program is a large research
program. The goal is to help researchers understand
more about why people get sick or stay healthy. All of Us
is part of the Precision Medicine Initiative…
Q8A
Q8B
Do you think our program description is
easy to understand?
What is it about our
program description
which is not clear?
Q8C
Forced Open‐Ended
Response.
Branching Yes/No
Logic Flow.
Yes No
Thank Respondent
& Terminate Survey
SURVEY LOGIC FLOW
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 33
If Respondent Had At Least One Correct Program Description Response for Testing Questions (Q6 & Q7B)
Q9E Q9F
This section and the series of
Q8 questions is designed to
gather deeper insights into
motivations and concerns
which can be mapped to
persona classifications.
Branch Back to “No” Answer Flow
Q9C with Modified Language
If a Correct Response was recorded in
either the Previous Q6A, Q7B Question…
Do you have any concerns about joining
the program?
(yes / no radial button)
If Yes Response
What are Your Concerns?
(randomized ‐ multi‐pick 6 x multiple choice
+ None option)
Privacy
Concerns
DNA Sharing
Concerns
Data Security
Concerns
Health Insurance
Insurability Concerns
If No Response
Would you
join the program?
(yes/no radial button)
We appreciate your
concerns. Would you still
be interested in joining
the program?
(yes/no radial button)
Section
7:
Pre‐Close
Conversion
Testing
Branching Yes/No
Logic Flow.
Q9A
If Yes Answer If No Answer
Why would you not
want to join the
program?
Forced Open Ended
Thank Respondent
& Terminate Survey
Branching
Flow.
What are your main
reasons for wanting to
join the program?
Forced Open Ended
Research Ethics
Concerns
Time Commitment
Concerns
Other, Open Ended
Too Much Government
Concerns
Q9B Q9D Q9C
Branch From
Original Yes
Response
SURVEY LOGIC FLOW
‐ end ‐
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 34
Target Audiences & Survey Size
Respondents for the survey will be recruited from within four‐
core identified test population audiences with deeper
segmentation based on gender and age to represent a
comprehensive view across all demographics and as aligned to
UBR and diversity program goals.
We have determined a statistical valid survey sample size is 400
completed surveys for each test population segment. Based on
the desired insights to be collected across all demographics, we
have designed the survey to include 32 distinct test population
segments with a goal to complete 12,800 surveys.
Demographics Collection
Baseline demographics will also be collected across all survey
respondents, which will allow us to conduct deeper qualitative
persona and demographic analyses based on specific population
groups. Throughout the final analysis, we will be able to filter and
triangulate our insights including:
 Gender
 Sexual Orientation (Straight, LGBTQ, prefer not to say)
 Age Grouping
 Race / Ethnicity
 Location (Full address: street, city, state, zip)
 Education Level
 HH Income
Survey Language
We have considered offering the survey in two languages
(English and Spanish), but have determined, and through the
advice of our platform vendor, the use of English language only
will streamline and shorten the analysis phase of the project
without impacting the results we will collect.
Survey Analysis
Final analysis will gather insights collected across all test
population groupings with deeper analyses conducted to capture
trends and nuances associated with filtered and segmented test
population demographic and persona characteristics.
Of special note; this survey was conducted online and therefore
does not represent population groups without access to a
personal computer, or with populations that are not computer
proficient. This is a limitation of the online survey vehicle.
Test
Populations
&
Survey
Counts
‐
(12,800
Competed
Surveys)
African
American
(3200)
Male
(1600)
18‐24 (400)
25‐34 (400)
35‐54 (400)
55+ (400)
Female
(1600)
18‐24 (400)
25‐34 (400)
35‐54 (400)
55+ (400)
Hispanic
(3200)
Male
(1600)
18‐24 (400)
25‐34 (400)
35‐54 (400)
55+ (400)
Female
(1600)
18‐24 (400)
25‐43 (400)
35‐54 (400)
55+ (400)
Asian
American
(3200)
Male
(1600)
18‐24 (400)
25‐34 (400)
35‐54 (400)
55+ (400)
Female
(1600)
18‐24 (400)
25‐34 (400)
35‐54 (400)
55+ (400)
Caucasian
(3200)
Male
(1600)
18‐24 (400)
25‐34 (400)
35‐54 (400)
55+ (400)
Female
(1600)
18‐24 (400)
25‐43 (400)
35‐54 (400)
55+ (400)
Objective
Test content and creative among core UBR test populations and persona types for personal resonance,
appeal, and influence – as well as program understanding to aid in future content development and
content marketing directions.
SURVEY METHODOLOGY
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 35
ANALYSIS PARAMETERS
(Fieldwork Report & Filtering)
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 36
1483048‐US
Survey Start Date: Oct 17, 2017
Survey Close Date: Nov 22, 2017
FOOTNOTES: The starting objective was to complete 12,800 surveys based on pre‐identified demographic target goal
thresholds (as represented on the following page). However, over the course of the fieldwork, the survey platform
exhausted survey community resources (including third‐party resources) to meet this overall goal within a desired and
suitable timeline. This was direct consequence for incorporating a special built‐in survey component (heatmapping) within
the design of the survey, which prevented us for serving the survey to mobile‐only consumers.1
Although we did not anticipate the heatmapping component would prevent us for reaching our target threshold goals, we
did understand from the outset the survey would not be delivered to mobile devices using this survey component.
Furthermore, we did acknowledge at the forefront, the survey results would be somewhat biased insofar there would be a
missing general population segment (7% of U.S. adults), which include those individuals who depend on smart mobile
devices for Internet access.
We did consider this ramification and collectively determined the use of the heatmapping component outweighed the
missing population segment within this first survey measurement. Follow‐on surveys (as needed and based on future
defined objectives) will take this execution nuance into consideration on a case by case basis. As additional program
measurement projects are identified, we can design and conduct separate program surveys with this consideration in mind
to gauge and measure added consumer feedback.
Of special note: terminate counts were a result of designed pre‐screening and QA/QC conditions. Overall, we did reach
92% of our overall target goal and we have verified the sample sizes for all demographics are statistically valid.
1 Pew Research, April 2015
RESPONDENTS STATUS SUMMARY COUNTS
started 34,153
incomplete 14,267
complete 11,817
quota full 0
terminate all 8,057
TERMINATES COUNTS
Terminate ‐ ID or Email exists 20
Terminate ‐ time based 907
Terminate 8 ‐ Age ‐ cq1 287
Terminate 10 ‐ Ethnicity ‐ cq2 1,509
Duplicate completes 5
INCIDENCE RATES (*)
"Net Effective Incidence" 100.00%
"Net Incidence" 100.00%
OTHER
"Average Interview Duration" 27min 25sec
"Median Interview Duration" 18min 11sec
FIELDWORK REPORT
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 37
Demo Age Target Goal Completed ∆ Delta Difference
African‐
American
Males age 18‐24 400 201 199
Males age 25‐34 400 278 122
Males age 35‐54 400 366 34
Males age 55+ 400 178 222
Females age 18‐24 400 508 (108)
Females age 25‐34 400 553 (153)
Females age 35‐54 400 647 (247)
Females age 55+ 400 493 (93)
Total 3,200 3,224 (24)
Demo Age Target Goal Completed ∆ Delta Difference
Hispanic‐
Latino
Males age 18‐24 400 232 168
Males age 25‐34 400 376 24
Males age 35‐54 400 380 20
Males age 55+ 400 98 302
Females age 18‐24 400 526 (126)
Females age 25‐34 400 596 (196)
Females age 35‐54 400 578 (178)
Females age 55+ 400 189 211
Total 3,200 2,975 225
Demo Age Target Goal Completed ∆ Delta Difference
Asian‐
American
Males age 18‐24 400 171 229
Males age 25‐34 400 254 146
Males age 35‐54 400 322 78
Males age 55+ 400 110 290
Females age 18‐24 400 407 (7)
Females age 25‐34 400 643 (243)
Females age 35‐54 400 554 (154)
Females age 55+ 400 133 267
Total 3,200 2,594 606
Demo Age Target Goal Completed ∆ Delta Difference
Caucasian
Males age 18‐24 400 419 (19)
Males age 25‐34 400 418 (18)
Males age 35‐54 400 432 (32)
Males age 55+ 400 443 (43)
Females age 18‐24 400 400 0
Females age 25‐34 400 411 (11)
Females age 35‐54 400 407 (7)
Females age 55+ 400 421 (21)
Total 3,200 3,351 (151)
3,223 2,846 2,392 3,350
African‐American Hispanic‐Latino Asian‐American Caucasian‐American
FINAL QUOTA COUNTS
28% 24% 20% 28%
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 38
Weighting + Balancing
The analysis uses a standard analytics weighting methodology to equally balance respondent
responses to original target population thresholds defined in the original survey design.
This was done to more equitably analyze creative preferences from unequal gender and age
responses found in each race/ethnicity sub‐population across gender and age as a result of final
quota survey counts.
RIM (Random Iterative Method) weighting is a standard methodology in market research used when
the results collected in a survey do not match the target population. The main idea is that rather
than each variable in the data contributing equally to the final result, some data is artificially
adjusted to contribute more than others.
This approach has been used to provide greater and more accurate insights when analyzing
preferences by percentages based on gender and age.
Filtering
Within the analysis and for select survey questions, filtering has been applied to gain greater insights
leveraging demographics collected. Filters (in singular or combination) that were available for data
triangulation include:
 Age
 Gender
 Sexual Orientation
 Race / Ethnicity
 Education
 HHI
 State + National Regions
ANALYSIS CONSIDERATIONS
Heatmapping
The analysis uses heatmapping to gauge website content appeal and resonance. Respondents were
asked to review a number of All Of Us website pages and then read and click on content elements
they would have interest if they were to visit the website on their own. This was done as an aid to
help survey respondents understand the program and its benefit and to test ease of program
comprehension.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 39
DEMOGRAPHICS
(Data Collection: sample size: 11,811)
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 40
Self ID Q:1 – Demographic & Pre-Screening Questions (sample size: 11,811)
What best describes your age group? (select one answer)
 Less than 18 (terminate survey)
 18-24
 25-34
 35-54
 55+
Objective: A series of questions were designed to have respondents provide personal
demographic data to align the survey to target thresholds as well as to capture additional
insights to be used in the overall analysis.
23%
29%
31%
17%
18‐24
25‐34
35‐54
55+
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 41
What best describes your race/ethnicity? (select one answer)
 African American
 Hispanic
 Asian American
 Caucasian
 Two or more races/ethnicities (terminate survey)
 Prefer not to answer (terminate survey)
Self ID Q:2 – Demographic & Pre-Screening Questions (sample size 11,811)
27%
24%
20%
28%
African‐American
Hispanic‐Latino
Asian‐American
Caucasian
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 42
Self ID Q:3 – Demographic & Pre-Screening Questions (sample size 11,811)
To which gender identity do you most identify? (select one answer)
 Male
 Female
Male
38%
Female
62%
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 43
What best describes your sexual orientation? (select one answer)
 Heterosexual (“straight”)
 LGBTQ
 Prefer not to answer
Self ID Q:4 – Demographic & Pre-Screening Questions (sample size 11,811)
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 44
What best describes your sexual orientation? (select one answer)
 Heterosexual (“straight”)
 LGBTQ
 Prefer not to answer
Self ID Q:4 – Demographic & Pre-Screening Questions (sample size 1,711)
Objective: A hidden tracking mechanism to identify a count for Caucasian LGBTQ males to
verify UBR diversity within the Caucasian sub‐population.
Caucasian, White Males
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 45
What is the highest level of schooling that you have completed?
(select one answer)
 Completed some high school
 High school graduate
 Completed some college
 College degree
 Completed some postgraduate
 Master’s degree
 Doctorate, law or professional degree
Self ID Q:5 – Demographic & Pre-Screening Questions (sample size 11,811)
2%
18%
26%
34%
4%
12%
3%
Completed some high school
High school graduate
Completed some college
College degree
Completed some postgraduate
Master's degree
Doctorate, law or professional degree
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 46
What is your annual household income before taxes? (select one answer)
 Less than $25,000
 $25,000−$49,999
 $50,000−$74,999
 $75,000−$99,999
 $100,000−$124,999
 $125,000 or more
 Prefer not to answer
Self ID Q:6 – Demographic & Pre-Screening Questions (sample size 11,811)
18%
23%
20%
14%
8%
8%
5%
Less than $25,000
$25,000‐‐$49,999
$50,000‐‐$74,999
$75,000‐‐$99,999
$100,000‐‐$124,000
$125,000 or more
Prefer not to answer
0.00% 5.00% 10.00% 15.00% 20.00% 25.00%
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 47
Self ID Q:7 – Demographic & Pre-Screening Questions (sample size 11,811)
Which state do you live in? (select one answer)
 Pull down option menu (all 50 states + District of Columbia)
State Percent Count
Alabama 1.36% 161
Alaska 0.08% 9
Arizona 1.98% 234
Arkansas 0.65% 77
California 15.15% 1,789
Colorado 1.52% 179
Connecticut 1.05% 124
Delaware 0.4% 47
District of Columbia 0.39% 46
Florida 8.2% 968
Georgia 3.65% 431
Hawaii 0.73% 86
Iowa 0.44% 52
Idaho 0.27% 32
Illinois 4.22% 499
Indiana 1.41% 167
Kansas 0.61% 72
Kentucky 1.12% 132
Louisiana 1.22% 144
Maine 0.23% 27
Maryland 2.17% 256
Massachusetts 1.79% 211
Michigan 2.63% 311
Minnesota 1.08% 128
Mississippi 0.69% 82
Missouri 1.36% 161
State Percent Count
Montana 0.13% 15
Nebraska 0.3% 36
Nevada 1.03% 122
New Hampshire 0.2% 24
New Jersey 3.19% 377
New Mexico 0.52% 61
New York 8.31% 981
North Carolina 3.64% 430
North Dakota 0.11% 13
Ohio 3.24% 383
Oklahoma 0.69% 81
Oregon 0.91% 108
Pennsylvania 3.91% 462
Rhode Island 0.29% 34
South Carolina 1.63% 193
South Dakota 0.12% 14
Tennessee 1.67% 197
Texas 8.42% 995
Utah 0.58% 68
Vermont 0.14% 17
Virginia 2.79% 330
Washington 1.97% 233
West Virginia 0.37% 44
Wisconsin 1.35% 159
Wyoming 0.08% 9
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 48
Self ID Q:7 – Demographic & Pre-Screening Questions (sample size 11,811)
Which state do you live in?
sample size representation validation:
Survey quota counts vs. National population densities
Map based on Longitude (generated) and Latitude (generated). Size shows sum of Count.
Details are shown for State. Map coloring shows 2018 Caucasian Population by State.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 49
CREATIVE TESTING
(Section 1: sample size: 11,811)
gender + age
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 50
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification
Which ad makes you want to click on
it to learn more about the program?
Objective:
Gather insights into respondent core motivations by
testing creative for appeal and resonance.
gender + age
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 51
Objective:
A series of questions were designed to test message (motivation) and visual cues aligned by
race/ethnicity to have respondents self‐identify themselves into 1 of 5 possible persona classifications
with added insights into personal creative design composition appeal.
The questions were structured to have a respondent self‐identify their dominant and underlying
motivations and values matched to a specific persona group to better gauge personal appeal and
resonance for content which would be tested (developed specifically for persona appeal) later in the
survey.
Persona Group Classification was based on a respondent choosing a coded matched response for two
SELF‐IDENTIFICATION questions.
Logic Check: if a respondent was not matched to a persona type by selecting “none” for each of the
two self‐identification questions … a respondent was then segmented into a special [general
population] test group.
Section 1 / Survey Questions 1 - 2: Persona Self-Identification Classification
Persona 1
Edgar
Ready to Go
Persona 2
Tallulah
Determined
Persona 3
Chris
Curious But Distracted
Persona 4
Lorraine
Community Centric
Persona 5
Miguel
Suspicious But Positive
Legend: Altruism (ALT) Finding Cures (EC) Community & Family (COMM) Innovation (INN)
What’s in It for Me (ME) Right the Wrongs (RIGHT)
Example:
If someone selects the Altruism message for both Q1 and Q2, they would receive the Edgar persona
creative. If someone selects the Altruism message for Q1 and Finding Cures message for Q2, they
would receive the Tallulah creative.
If a respondent selects none for each of the two self‐identification questions, the respondent was then
grouped into a general population test segment.
Combination Possibilities for Persona Mapping
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 52
Which ad makes you want to click on it to learn more about the program?
 A healthier future, Pass it on.
 Our health is our wealth.
 An inheritance they can actually use.
 One size does not fit at all.
 Power to the patient.
 One-of-a-kind is kind of our thing.
 None, what don’t you like about the ads?
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 11,811)
−
−
−
−
−
randomized
−
−
−
−
−
14% 17% 15% 13% 15%
26%
altruism finding cures
community, tribe,
legacy, family
innovation, new
research
empower, control,
righting wrongs
what’s in it
for me
r a n k b y p r e f e r e n c e
975
0 200 400 600 800 1000
NONE : Respondents who did not like any choice.
8.3% of survey sub‐population audience
African‐American Creative set represented: served to respondents who self‐identified themselves as African‐American
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 53
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 10,758)
Which
ad
makes
you
want
to
click
on
it
to
learn
more
about
the
program?
MOTIVATION MATCH Sub-Population Review by Gender + Age
RANK
Preference Gender Age Group
Rank Percent Male Female 18‐24 25‐34 35‐54 55+
1 26% 23% 29% 38% 29% 23% 13%
2 17% 16% 18% 12% 16% 17% 23%
3 15% 17% 13% 11% 16% 18% 15%
4 15% 15% 14% 14% 16% 15% 15%
5 14% 18% 11% 13% 13% 13% 18%
6 13% 11% 15% 12% 11% 15% 15%
‐ 100% 100% 100% 100% 100% 100% 100%
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
r a n k b y p r e f e r e n c e
altruism
finding cures community, tribe,
legacy, family
innovation, new
research
empower, control,
righting wrongs
what’s in it
for me
Observations & Findings for A/B Testing:
 Rank #1 ‐ What’s in it for me Ad choice was inclusively an illustration. Skews younger and with
females over males. A false/positive may exist from image bias over alternative photo‐only choices.
 Rank #2 – Finding Cures Ad choice used exclusively single person photography. Gender and age
self‐identification may exist from visuals. Appeal greatest with 55+ age group.
 Rank #3 ‐ Community, Tribe, Legacy, Family Ad choice used group photos. When larger groups of
people were used showing richer diversity (identified trend), the Ads performed better. Skews male
and older.
 Rank #4 – Empowerment, Control, Righting Wrongs Ad choice used exclusively single person
photography. Gender and age self‐identification may have been present in some sub‐populations
from the visuals.
 Rank #5 – Altruism Ad choice used exclusively a male headshot. Greatest appeal with 55+ age
segment. Gender self‐identification via image may have been present across all sub‐populations.
 Rank #6 – Innovation, New Research Ad choice used exclusively single person photography. Appeal
with females. Skews older with greatest appeal with 35‐54 and 55+ age segments.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 54
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 2,805)
Which
ad
makes
you
want
to
click
on
it
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
15% 22% 12% 16%
MOTIVATION MATCH AD Preference Review by Gender + Age
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
10% 12% 6% 6%
Observations & Findings for A/B Testing:
 The What’s in it for me headline motivation message ranks 1ST overall in preference (26% of total
survey respondents) across all test populations. Skews younger with females over males across all
age groups. Illustration bias may be present in results.
RANK
26.07%
Total Survey Population
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Micro‐Population
Demographics
44% 56%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 55
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,818)
Which
ad
makes
you
want
to
click
on
it
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
7% 11% 11% 13%
MOTIVATION MATCH AD Preference Review by Gender + Age
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
12% 13% 16% 17%
Observations & Findings for A/B Testing:
 The Finding Cures headline motivation message ranks 2ND overall in preference (17% of total
survey respondents) as compared against the AGGREGATE test population. Females prefer the ad
over male counterparts by slight margins. Gender image self identification may be present in
results.
16.90%
Total Survey Population
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Micro‐Population
Demographics
RANK
46% 54%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 56
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,617)
Which
ad
makes
you
want
to
click
on
it
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
9% 8% 15% 12%
MOTIVATION MATCH AD Preference Review by Gender + Age
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
19% 12% 14% 10%
Observations & Findings for A/B Testing:
 The Community, Tribe, Legacy, Family headline motivation message ranks 3RD overall in preference
(15% of total survey respondents) measured against the AGGREGATE test population. Male gender
preference may exist. Overall, skews in the middle with minor nuances within the outlier peripheral
age segments.
15.03%
Total Survey Population
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Micro‐Population
Demographics
RANK
57% 43%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 57
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,605)
Which
ad
makes
you
want
to
click
on
it
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
12% 12% 15% 13%
MOTIVATION MATCH AD Preference Review by Gender + Age
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
14% 11% 11% 13%
Observations & Findings for A/B Testing:
 The Empowerment and Control, Righting Wrongs headline motivation message ranks 4TH overall in
preference (15% of total survey respondents) with the AGGREGATE test population. Modest
performance overall across gender and age without significant identifiable nuances.
14.92%
Total Survey Population
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Micro‐Population
Demographics
RANK
51% 49%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 58
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,519)
Which
ad
makes
you
want
to
click
on
it
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
14% 9% 15% 8%
MOTIVATION MATCH AD Preference Review by Gender + Age
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
16% 8% 18% 13%
Observations & Findings for A/B Testing:
 The Altruism headline motivation message ranks 5TH overall in preference (14% of total survey
respondents) with the AGGREGATE test population. Older males especially, and males in general
prefer the ad over female counterparts. Gender image self identification may exist in the results.
14.12%
Total Survey Population
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Micro‐Population
Demographics
RANK
62% 38%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 59
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,394)
Which
ad
makes
you
want
to
click
on
it
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
10% 14% 8% 12%
MOTIVATION MATCH AD Preference Review by Gender + Age
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
11% 17% 11% 16%
Observations & Findings for A/B Testing:
 The Innovation, New Research headline motivation message ranks 6TH overall in preference
(13% of total survey respondents) with the AGGREGATE test population. Females clearly prefer the
ad over male counterparts by large percentages. Gender + message self identification may exist.
12.96%
Total Survey Population
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Micro‐Population
Demographics
RANK
41% 59%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 60
Observations & Findings for A/B Testing:
 Identified Trend > Ad compositions and photos tested may be too generic and similar.
 Identified Trend > May lack better defined personal self‐identification appeal at greater
scale (race, gender, age) matched to headline.
 Ad compositions using creative tags (headlines) alone without body copy may not be
adequate for click‐thru. May need more direct, less ambiguous instantaneous message
takeaways with a quick and clear program explanation.
 Identified Trend > 55+ age group may require more personalized, self‐identification
images and messages.
NONE Review by Recurring Common Theme
Which ad makes you want to click on it to learn more about the
program?
 None, what don’t you like about the ads?
Boring Messaging Generic
Photo
compositi
on
Lacks
appeal,
doesn’t
create
interest
Missing
diversity
Photo
doesn’t
match
headline
81 23 46 21 293 18 15
Doesn't
speak to
me
Not
enough
info to
under‐
stand
program
No
interest
All look
the same
Not
relevant
General
dislike
Other
26 201 101 15 38 43 50
112 80 111
240
103 106 129 164
18‐24 25‐34 35‐54 55+
Male Female Linear (Male) Linear (Female)
Sample Count Sample Percentage
975 8.3%
Common Themes for ‘What don’t you like about the Ads?
Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 10,758)
Which
ad
makes
you
want
to
click
on
it
to
learn
more
about
the
program?
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 61
What about the ad do you like?
Section 1 / Survey Question Q:1B: Persona Self-Identification Classification
Objective:
Gather additional insights into respondent preferences.
gender + age
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 62
What
about
the
ad
do
you
like?
Observations & Findings for A/B testing:
 Identified Trend > Younger generations may gravitate to more to images: older
generations headlines.
 Identified Trend > Males may be more inclined to gravitate to images with females leaning
towards headlines.
 Identified Trend > Of special note, 55+ age group significantly appeals to headlines (tags).
Section 1 / Survey Question Q:1B: Persona Self-Identification Classification (sample size 10,758)
COMPONENTS Preference Review by Gender + Age
What about the ad do you like?
 I liked the photo/image.
 I liked the headline (the larger text).
 I liked both the photo/image and headline.
(Re‐Present Respondent’s Image Choice from Previous Question)
27% 35% 38%
photo/image headline both
Total Count
39%
37%
24% 37%
34%
30%
both
headline
photo/image
Gender Preference
Female Male
15%
20%
25%
30%
35%
40%
45%
50%
Age Preference
55+ 35‐54
25‐34 18‐24
11%
46%
43%
11%
48%
41%
20%
39%
40%
29%
34%
37%
30%
34%
36%
39%
25%
35%
31%
32%
37%
39%
27%
34%
photo/image
headline
both
Female + 55+ Male + 55+ Female + 35‐54 Male + 35‐54
Female + 25‐34 Male + 25‐34 Female + 18‐24 Male + 18‐24
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 63
What
about
the
ad
do
you
like?
r a n k b y p r e f e r e n c e
altruism
finding cures community, tribe,
legacy, family
innovation, new
research
empower, control,
righting wrongs
what’s in it
for me
AD ID#
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
35‐54
MALE
35‐54
FEMALE
55+ MALE
55+
FEMALE
1 34% 42% 25% 33% 20% 25% 13% 13%
ABSTRACT ILLUSTRATION > PREFERENCE: MOST APPEALING ACROSS ALL SEGMENTS BEFORE 55+.
POTENTIAL ILLUSTRATION DIFFERENTIATION BIAS OVER PRESENTED PHOTO ALTERNATIVES.
2 11% 14% 14% 17% 15% 18% 22% 24%
YOUNGER FEMALE HEADHSOT > PREFERENCE: MODEST CONSISTENCY ACROSS GENDER + AGE.
GENDER BIAS WITH FEMALES. SLIGHT UPTICK WITH AGE FOR BOTH GENDERS.
3 12% 9% 18% 14% 21% 15% 17% 13%
FULL BODY GROUP PHOTOS > PREFERENCE: GENDER BIAS WITH MALES.
4 16% 13% 17% 14% 15% 14% 14% 16%
ENVIRONMENTAL PORTRAIT > PREFERENCE: MODEST CONSISTENCY ACROSS GENDER AND AGE.
MALE GENDER BIAS BEFORE 55+
5 17% 9% 17% 9% 17% 9% 21% 15%
OLDER MALE HEADSHOT > PREFERENCE: OLDER MALES OVER YOUTH. GENDER BIAS WITH MALES.
6 11% 13% 9% 12% 11% 18% 13% 18%
MIDDLE AGE FEMALE HEADHSOT > PREFERENCE: FEMALES WITH UPTICK WITH AGE.
POTENTIAL MESSAGE IMPACT WITH AGING FEMALE GENERATIONS.
100% 100% 100% 100% 100% 100% 100% 100%
Observations & Findings for A/B Testing:
 Identified Trend > Frequent use of illustrations may stimulate enhanced performance over
photography alone.
 Identified Trend > Gender self‐identification appeal within imagery may frequently influence
appeal. Identified Trend > Age self‐identification appeal within imagery may also frequently
influence appeal.
COMPOSITION Preference Review by Gender + Age
Section 1 / Survey Question Q:1B: Persona Self-Identification Classification (sample size 10,758)
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 64
29%
18%
13%
14%
11%
15%
23%
16%
17%
15%
18%
11%
One‐of‐a‐kind is kind of our thing.
Our health is our wealth.
An inheritance they can actually use.
Power to the patient.
A healthier future, Pass it on.
One size does not fit at all.
Female Male
r a n k b y p r e f e r e n c e
altruism
finding cures community, tribe,
legacy, family
innovation, new
research
empower, control,
righting wrongs
what’s in it
for me
Observations & Findings for A/B Testing:
 Headline (tag) impact may align to current personal life stage (age + gender values)
relevance.
MESSAGE Preference Review by Gender + Age
13%
23%
15%
15%
18%
15%
23%
17%
18%
15%
13%
15%
29%
16%
16%
16%
13%
11%
38%
12%
11%
14%
13%
12%
One‐of‐a‐kind is kind of our thing.
Our health is our wealth.
An inheritance they can actually use.
Power to the patient.
A healthier future, Pass it on.
One size does not fit at all.
55+ 35‐54 25‐34 18‐24
Section 1 / Survey Question Q:1B: Persona Self-Identification Classification (sample size 10,758)
What
about
the
ad
do
you
like?
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 65
Which poster makes you want to
learn more about the program?
Section 1 / Survey Question Q:2A: Persona Self-Identification Classification
Objective:
Gather insights into respondent core motivations by
testing a second set of creative for appeal and
resonance.
gender + age
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 66
r a n k b y p r e f e r e n c e
Which poster makes you want to learn more about the program?
 We can win the game as soon as we all get in it.
 Fighting disease just got one million times easier.
 Legacies are just one you can spend.
 The next big thing in health is here.
 Not all research is created equal (that’s why we’re here).
 What’s good for you is good for us.
 None, what don’t you like about the posters?
Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 11,811)
−
−
−
−
−
randomized
−
−
−
−
−
10%
17%
13% 13%
28%
20%
altruism finding cures
community, tribe,
legacy, family
innovation, new
research
empower, control,
righting wrongs
what’s in it
for me
943
0 200 400 600 800 1000
NONE : Respondents who did not like any choice.
8.0% of survey sub‐population audience
Hispanic‐Latino Creative set represented: served to respondents who self‐identified themselves as Hispanic‐Latino
We can win
the game as
soon as we all
get in it.
Fighting
disease just
got one
million times
easier.
Legacies are
just one you
can spend.
The next big
thing in health
is here.
Not all
research is
created equal
(that’s why
we’re here).
What’s good
for you is
good for us.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 67
We can win
the game as
soon as we
all get in it.
Fighting
disease just
got one
million times
easier.
Legacies are
just one you
can spend.
The next big
thing in
health is here.
Not all
research is
created equal
(that’s why
we’re here).
What’s good
for you is
good for us.
Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 10,868)
Which
ad
makes
you
want
to
click
on
it
to
learn
more
about
the
program?
MOTIVATION MATCH Sub-Population Review by Gender + Age
RANK
Preference Gender Age Group
Rank Percent Male Female 18‐24 25‐34 35‐54 55+
1 28% 26% 29% 35% 29% 25% 20%
2 20% 19% 20% 16% 22% 23% 18%
3 17% 15% 18% 16% 15% 16% 19%
4 13% 15% 11% 10% 10% 13% 21%
5 13% 13% 13% 11% 14% 14% 14%
6 10% 11% 9% 12% 10% 9% 9%
‐ 100% 100% 100% 100% 100% 100% 100%
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
r a n k b y p r e f e r e n c e
altruism
finding cures community, tribe,
legacy, family
innovation, new
research
empower, control,
righting wrongs
what’s in it
for me
Observations & Findings for A/B Testing:
 Rank #1 ‐ Empowerment, Control, Righting Wrongs Poster choice was inclusively an illustration.
Skews younger with female preference over males. A false/positive may exist from image bias
over alternative photo‐only choices.
 Rank #2 – What’s in it for me Poster choice used group photos. When larger groups of people
were used showing richer diversity (identified trend), the Posters performed better. Skews in the
middle.
 Rank #3 ‐ Finding Cures Poster choice used exclusively single person photography. Skews female
and older.
 Rank #4 – Community, Tribe, Legacy, Family Poster choice used exclusively single person
photography. Gender and age self‐identification may have been present. Skews male and older.
 Rank #5 – Innovation, New Research Poster choice used male headshots and group shots.
Modest preference across ages and genders.
 Rank #6 – Altruism Poster choice used exclusively single person photography. Skews male and
younger.
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 68
Body Copy:
The more researchers know about what makes each of us
unique, the more tailored our health care can become.
Join a research effort with one million people nationwide
to create a healthier future for us all.
Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 2,981)
Which
poster
makes
you
want
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
15% 18% 12% 15% 11% 12% 8% 9%
MOTIVATION MATCH Poster Preference Review by Gender + Age
Observations & Findings for A/B Testing:
 The Empowerment and Control, Righting Wrongs headline motivation message ranks 1ST overall
in preference (28% of total survey respondents) with the AGGREGATE test population. Females
prefer the poster over male counterparts by large percentages.
27.59%
Total Survey Population
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
Micro‐Population Demographics
46% 54%
Male Female
RANK
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 69
Body Copy:
The more researchers know about what makes each of us
unique, the more tailored our health care can become.
Join a research effort with one million people nationwide
to create a healthier future for us all.
Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 2,127)
Which
poster
makes
you
want
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
10% 11% 13% 15% 16% 14% 10% 11%
MOTIVATION MATCH Poster Preference Review by Gender + Age
Observations & Findings for A/B Testing:
 The What’s in it for me headline motivation message ranks 2ND overall in preference (20% of
total survey respondents) with the AGGREGATE test population. Preference skews in the middle
age groups across both genders.
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
19.69%
Total Survey Population
Micro‐Population Demographics
RANK
49% 51%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 70
Body Copy:
The more researchers know about what makes each of us
unique, the more tailored our health care can become.
Join a research effort with one million people nationwide
to create a healthier future for us all.
Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 1,785)
Which
poster
makes
you
want
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
11% 14% 11% 12% 12% 13% 12% 15%
MOTIVATION MATCH Poster Preference Review by Gender + Age
Observations & Findings for A/B Testing:
 The Finding Cures headline motivation message ranks 3RD overall in preference (17% of total
survey respondents) with the AGGREGATE test population. Females prefer the poster over male
counterparts, which may align to message appeal.
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
16.52%
Total Survey Population
Micro‐Population Demographics
RANK
46% 54%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 71
Body Copy:
The more researchers know about what makes each of us
unique, the more tailored our health care can become.
Join a research effort with one million people nationwide
to create a healthier future for us all.
Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 1,433)
Which
poster
makes
you
want
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
10% 9% 11% 9% 14% 10% 22% 15%
MOTIVATION MATCH Poster Preference Review by Gender + Age
Observations & Findings for A/B Testing:
 The Innovation, New Research headline motivation message ranks 4TH overall in preference
(13% of total survey respondents) with the AGGREGATE test population. Preference skews
older and may align with age for message appeal.
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
13.26%
Total Survey Population
Micro‐Population Demographics
RANK
57% 43%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 72
Body Copy:
The more researchers know about what makes each of us
unique, the more tailored our health care can become.
Join a research effort with one million people nationwide
to create a healthier future for us all.
Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 1,419)
Which
poster
makes
you
want
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
10% 11% 14% 13% 16% 12% 11% 14%
MOTIVATION MATCH Poster Preference Review by Gender + Age
Observations & Findings for A/B Testing:
 The Community, Tribe, Legacy, Family headline motivation message ranks 5TH overall in
preference (13% of total survey respondents) with the AGGREGATE test population. Skews in
the middle with modest preference across all genders and ages.
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
13.13%
Total Survey Population
Micro‐Population Demographics
RANK
51% 49%
Male Female
AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 73
Body Copy:
The more researchers know about what makes each of us
unique, the more tailored our health care can become.
Join a research effort with one million people nationwide
to create a healthier future for us all.
Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 1,060)
Which
poster
makes
you
want
to
learn
more
about
the
program?
18‐24
MALE
18‐24
FEMALE
25‐34
MALE
25‐34
FEMALE
35‐54
MALE
35‐54
FEMALE
55+
MALE
55+
FEMALE
15% 17% 16% 9% 13% 10% 12% 8%
MOTIVATION MATCH Poster Preference Review by Gender + Age
Observations & Findings for A/B Testing:
 The Altruism headline motivation message ranks 6TH overall in preference (10% of total survey
respondents) with the AGGREGATE test population. Preference skews younger. Also skews
generally with males across all ages which may align with sports analogy message appeal.
* Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
9.81%
Total Survey Population
Micro‐Population Demographics
56% 44%
Male Female
RANK
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing
Focus Group Creative Testing

More Related Content

Similar to Focus Group Creative Testing

Middle class population and Leaders’ attitudes and opinions towards Child Mor...
Middle class population and Leaders’ attitudes and opinions towards Child Mor...Middle class population and Leaders’ attitudes and opinions towards Child Mor...
Middle class population and Leaders’ attitudes and opinions towards Child Mor...Global Movement for Children
 
Conversation research: leveraging the power of social media
Conversation research: leveraging the power of social mediaConversation research: leveraging the power of social media
Conversation research: leveraging the power of social mediaSKIM
 
How NOT to Aggregrate Polling Data
How NOT to Aggregrate Polling DataHow NOT to Aggregrate Polling Data
How NOT to Aggregrate Polling DataDataCards
 
The Path Forward: The Digital Transformation in Social Determinants of Health
The Path Forward: The Digital Transformation in Social Determinants of HealthThe Path Forward: The Digital Transformation in Social Determinants of Health
The Path Forward: The Digital Transformation in Social Determinants of HealthCHC Connecticut
 
Root Cause Analysis: A Community Engagement Process for Identifying Social De...
Root Cause Analysis: A Community Engagement Process for Identifying Social De...Root Cause Analysis: A Community Engagement Process for Identifying Social De...
Root Cause Analysis: A Community Engagement Process for Identifying Social De...JSI
 
ThinkNow Mobile App Report 2018
ThinkNow Mobile App Report 2018ThinkNow Mobile App Report 2018
ThinkNow Mobile App Report 2018ThinkNow
 
Audience Models
Audience ModelsAudience Models
Audience Modelsrikhudson
 
Le meilleur des études Ipsos à travers le monde – Septembre 2017
Le meilleur des études Ipsos à travers le monde – Septembre 2017Le meilleur des études Ipsos à travers le monde – Septembre 2017
Le meilleur des études Ipsos à travers le monde – Septembre 2017Ipsos France
 
Advanced Needs Statements
Advanced Needs StatementsAdvanced Needs Statements
Advanced Needs StatementsFacetoFace
 
Introducing the gen-narrators - Good Rebels
Introducing thegen-narrators - Good RebelsIntroducing thegen-narrators - Good Rebels
Introducing the gen-narrators - Good RebelsGood Rebels
 
Non-probability sampling Community Medicine
Non-probability sampling Community MedicineNon-probability sampling Community Medicine
Non-probability sampling Community MedicineDoctorAhsan1
 
Marketing Health Care Conferences to Millennials
Marketing Health Care Conferences to MillennialsMarketing Health Care Conferences to Millennials
Marketing Health Care Conferences to MillennialsCharge Ahead Marketing
 
Community profiling 2 no design 1
Community profiling 2 no design 1Community profiling 2 no design 1
Community profiling 2 no design 1Tim Curtis
 
COMMUNICATIONS_STRATEGY.pdf
COMMUNICATIONS_STRATEGY.pdfCOMMUNICATIONS_STRATEGY.pdf
COMMUNICATIONS_STRATEGY.pdfpapahku123
 
Binge-Free 603: What's Your Reason? Preventing Binge Drinking in Young Adults...
Binge-Free 603: What's Your Reason? Preventing Binge Drinking in Young Adults...Binge-Free 603: What's Your Reason? Preventing Binge Drinking in Young Adults...
Binge-Free 603: What's Your Reason? Preventing Binge Drinking in Young Adults...JSI
 
eA_American_Climate_Values_2014_Insights_by_Racial_Ethnic_Groups
eA_American_Climate_Values_2014_Insights_by_Racial_Ethnic_GroupseA_American_Climate_Values_2014_Insights_by_Racial_Ethnic_Groups
eA_American_Climate_Values_2014_Insights_by_Racial_Ethnic_GroupsKirra Krygsman
 
Account Planning Portfolio (Draft) - Jason Potteiger
Account Planning Portfolio (Draft) - Jason PotteigerAccount Planning Portfolio (Draft) - Jason Potteiger
Account Planning Portfolio (Draft) - Jason PotteigerJason Potteiger
 
At yahoo genxamericasmostinfluentialgenerationfinal
At yahoo genxamericasmostinfluentialgenerationfinalAt yahoo genxamericasmostinfluentialgenerationfinal
At yahoo genxamericasmostinfluentialgenerationfinalNainjeet Ramlagan
 
Millennial segmentation research
Millennial segmentation researchMillennial segmentation research
Millennial segmentation researchEarnestine Benford
 

Similar to Focus Group Creative Testing (20)

Middle class population and Leaders’ attitudes and opinions towards Child Mor...
Middle class population and Leaders’ attitudes and opinions towards Child Mor...Middle class population and Leaders’ attitudes and opinions towards Child Mor...
Middle class population and Leaders’ attitudes and opinions towards Child Mor...
 
Conversation research: leveraging the power of social media
Conversation research: leveraging the power of social mediaConversation research: leveraging the power of social media
Conversation research: leveraging the power of social media
 
How NOT to Aggregrate Polling Data
How NOT to Aggregrate Polling DataHow NOT to Aggregrate Polling Data
How NOT to Aggregrate Polling Data
 
The Path Forward: The Digital Transformation in Social Determinants of Health
The Path Forward: The Digital Transformation in Social Determinants of HealthThe Path Forward: The Digital Transformation in Social Determinants of Health
The Path Forward: The Digital Transformation in Social Determinants of Health
 
Root Cause Analysis: A Community Engagement Process for Identifying Social De...
Root Cause Analysis: A Community Engagement Process for Identifying Social De...Root Cause Analysis: A Community Engagement Process for Identifying Social De...
Root Cause Analysis: A Community Engagement Process for Identifying Social De...
 
ThinkNow Mobile App Report 2018
ThinkNow Mobile App Report 2018ThinkNow Mobile App Report 2018
ThinkNow Mobile App Report 2018
 
Audience Models
Audience ModelsAudience Models
Audience Models
 
Le meilleur des études Ipsos à travers le monde – Septembre 2017
Le meilleur des études Ipsos à travers le monde – Septembre 2017Le meilleur des études Ipsos à travers le monde – Septembre 2017
Le meilleur des études Ipsos à travers le monde – Septembre 2017
 
Advanced Needs Statements
Advanced Needs StatementsAdvanced Needs Statements
Advanced Needs Statements
 
Introducing the gen-narrators - Good Rebels
Introducing thegen-narrators - Good RebelsIntroducing thegen-narrators - Good Rebels
Introducing the gen-narrators - Good Rebels
 
Non-probability sampling Community Medicine
Non-probability sampling Community MedicineNon-probability sampling Community Medicine
Non-probability sampling Community Medicine
 
Marketing Health Care Conferences to Millennials
Marketing Health Care Conferences to MillennialsMarketing Health Care Conferences to Millennials
Marketing Health Care Conferences to Millennials
 
CR Research Report
CR Research ReportCR Research Report
CR Research Report
 
Community profiling 2 no design 1
Community profiling 2 no design 1Community profiling 2 no design 1
Community profiling 2 no design 1
 
COMMUNICATIONS_STRATEGY.pdf
COMMUNICATIONS_STRATEGY.pdfCOMMUNICATIONS_STRATEGY.pdf
COMMUNICATIONS_STRATEGY.pdf
 
Binge-Free 603: What's Your Reason? Preventing Binge Drinking in Young Adults...
Binge-Free 603: What's Your Reason? Preventing Binge Drinking in Young Adults...Binge-Free 603: What's Your Reason? Preventing Binge Drinking in Young Adults...
Binge-Free 603: What's Your Reason? Preventing Binge Drinking in Young Adults...
 
eA_American_Climate_Values_2014_Insights_by_Racial_Ethnic_Groups
eA_American_Climate_Values_2014_Insights_by_Racial_Ethnic_GroupseA_American_Climate_Values_2014_Insights_by_Racial_Ethnic_Groups
eA_American_Climate_Values_2014_Insights_by_Racial_Ethnic_Groups
 
Account Planning Portfolio (Draft) - Jason Potteiger
Account Planning Portfolio (Draft) - Jason PotteigerAccount Planning Portfolio (Draft) - Jason Potteiger
Account Planning Portfolio (Draft) - Jason Potteiger
 
At yahoo genxamericasmostinfluentialgenerationfinal
At yahoo genxamericasmostinfluentialgenerationfinalAt yahoo genxamericasmostinfluentialgenerationfinal
At yahoo genxamericasmostinfluentialgenerationfinal
 
Millennial segmentation research
Millennial segmentation researchMillennial segmentation research
Millennial segmentation research
 

More from Daniel McKean

Data Framework Design: A Practical Guide
Data Framework Design: A Practical GuideData Framework Design: A Practical Guide
Data Framework Design: A Practical GuideDaniel McKean
 
MASTERING DIGITAL TRANSFORMATION IN THE NEW BUSINESS ERA
MASTERING DIGITAL TRANSFORMATION IN THE NEW BUSINESS ERAMASTERING DIGITAL TRANSFORMATION IN THE NEW BUSINESS ERA
MASTERING DIGITAL TRANSFORMATION IN THE NEW BUSINESS ERADaniel McKean
 
Go-To Market Strategy Framework
Go-To Market Strategy FrameworkGo-To Market Strategy Framework
Go-To Market Strategy FrameworkDaniel McKean
 
Harnessing the Power of Predictive Models for Marketing Campaign Optimization...
Harnessing the Power of Predictive Models for Marketing Campaign Optimization...Harnessing the Power of Predictive Models for Marketing Campaign Optimization...
Harnessing the Power of Predictive Models for Marketing Campaign Optimization...Daniel McKean
 
Unlocking Growth: Full-Funnel Marketing
Unlocking Growth: Full-Funnel MarketingUnlocking Growth: Full-Funnel Marketing
Unlocking Growth: Full-Funnel MarketingDaniel McKean
 
Maximizing Business ROI
Maximizing Business ROIMaximizing Business ROI
Maximizing Business ROIDaniel McKean
 
Attribution Analysis
Attribution AnalysisAttribution Analysis
Attribution AnalysisDaniel McKean
 
Data Model Architecture
Data Model ArchitectureData Model Architecture
Data Model ArchitectureDaniel McKean
 
Media Campaign Reporting
Media Campaign ReportingMedia Campaign Reporting
Media Campaign ReportingDaniel McKean
 
Website Journey Flow Analysis
Website Journey Flow AnalysisWebsite Journey Flow Analysis
Website Journey Flow AnalysisDaniel McKean
 
Community Activation
Community ActivationCommunity Activation
Community ActivationDaniel McKean
 
Value-Added Services
Value-Added ServicesValue-Added Services
Value-Added ServicesDaniel McKean
 
Topic + Influencer Research
Topic + Influencer ResearchTopic + Influencer Research
Topic + Influencer ResearchDaniel McKean
 
Performance Metrics Reporting
Performance Metrics ReportingPerformance Metrics Reporting
Performance Metrics ReportingDaniel McKean
 
Target Audience Research
Target Audience ResearchTarget Audience Research
Target Audience ResearchDaniel McKean
 
Content Marketing Plan
Content Marketing PlanContent Marketing Plan
Content Marketing PlanDaniel McKean
 
Audit Scope and Process
Audit Scope and ProcessAudit Scope and Process
Audit Scope and ProcessDaniel McKean
 

More from Daniel McKean (20)

Data Framework Design: A Practical Guide
Data Framework Design: A Practical GuideData Framework Design: A Practical Guide
Data Framework Design: A Practical Guide
 
MASTERING DIGITAL TRANSFORMATION IN THE NEW BUSINESS ERA
MASTERING DIGITAL TRANSFORMATION IN THE NEW BUSINESS ERAMASTERING DIGITAL TRANSFORMATION IN THE NEW BUSINESS ERA
MASTERING DIGITAL TRANSFORMATION IN THE NEW BUSINESS ERA
 
Go-To Market Strategy Framework
Go-To Market Strategy FrameworkGo-To Market Strategy Framework
Go-To Market Strategy Framework
 
Harnessing the Power of Predictive Models for Marketing Campaign Optimization...
Harnessing the Power of Predictive Models for Marketing Campaign Optimization...Harnessing the Power of Predictive Models for Marketing Campaign Optimization...
Harnessing the Power of Predictive Models for Marketing Campaign Optimization...
 
Unlocking Growth: Full-Funnel Marketing
Unlocking Growth: Full-Funnel MarketingUnlocking Growth: Full-Funnel Marketing
Unlocking Growth: Full-Funnel Marketing
 
Maximizing Business ROI
Maximizing Business ROIMaximizing Business ROI
Maximizing Business ROI
 
Paid Media Analysis
Paid Media AnalysisPaid Media Analysis
Paid Media Analysis
 
Attribution Analysis
Attribution AnalysisAttribution Analysis
Attribution Analysis
 
Data Model Architecture
Data Model ArchitectureData Model Architecture
Data Model Architecture
 
Media Campaign Reporting
Media Campaign ReportingMedia Campaign Reporting
Media Campaign Reporting
 
Website Journey Flow Analysis
Website Journey Flow AnalysisWebsite Journey Flow Analysis
Website Journey Flow Analysis
 
Brand Intel Audit
Brand Intel AuditBrand Intel Audit
Brand Intel Audit
 
Community Activation
Community ActivationCommunity Activation
Community Activation
 
Value-Added Services
Value-Added ServicesValue-Added Services
Value-Added Services
 
Business ROI Impact
Business ROI ImpactBusiness ROI Impact
Business ROI Impact
 
Topic + Influencer Research
Topic + Influencer ResearchTopic + Influencer Research
Topic + Influencer Research
 
Performance Metrics Reporting
Performance Metrics ReportingPerformance Metrics Reporting
Performance Metrics Reporting
 
Target Audience Research
Target Audience ResearchTarget Audience Research
Target Audience Research
 
Content Marketing Plan
Content Marketing PlanContent Marketing Plan
Content Marketing Plan
 
Audit Scope and Process
Audit Scope and ProcessAudit Scope and Process
Audit Scope and Process
 

Recently uploaded

Local SEO Domination: Put your business at the forefront of local searches!
Local SEO Domination:  Put your business at the forefront of local searches!Local SEO Domination:  Put your business at the forefront of local searches!
Local SEO Domination: Put your business at the forefront of local searches!dstvtechnician
 
Storyboards for my Final Major Project Video
Storyboards for my Final Major Project VideoStoryboards for my Final Major Project Video
Storyboards for my Final Major Project VideoSineadBidwell
 
Call Girls in Lajpat Nagar Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Lajpat Nagar Delhi 💯Call Us 🔝8264348440🔝Call Girls in Lajpat Nagar Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Lajpat Nagar Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Forecast of Content Marketing through AI
Forecast of Content Marketing through AIForecast of Content Marketing through AI
Forecast of Content Marketing through AIRinky
 
The Pitfalls of Keyword Stuffing in SEO Copywriting
The Pitfalls of Keyword Stuffing in SEO CopywritingThe Pitfalls of Keyword Stuffing in SEO Copywriting
The Pitfalls of Keyword Stuffing in SEO CopywritingJuan Pineda
 
Influencer Marketing Power point presentation
Influencer Marketing  Power point presentationInfluencer Marketing  Power point presentation
Influencer Marketing Power point presentationdgtivemarketingagenc
 
Word Count for Writers: Examples of Word Counts for Sample Genres
Word Count for Writers: Examples of Word Counts for Sample GenresWord Count for Writers: Examples of Word Counts for Sample Genres
Word Count for Writers: Examples of Word Counts for Sample GenresLisa M. Masiello
 
What are the 4 characteristics of CTAs that convert?
What are the 4 characteristics of CTAs that convert?What are the 4 characteristics of CTAs that convert?
What are the 4 characteristics of CTAs that convert?Juan Pineda
 
DGR_Digital Advertising Strategies for a Cookieless World_Presentation.pdf
DGR_Digital Advertising Strategies for a Cookieless World_Presentation.pdfDGR_Digital Advertising Strategies for a Cookieless World_Presentation.pdf
DGR_Digital Advertising Strategies for a Cookieless World_Presentation.pdfDemandbase
 
Best Persuasive selling skills presentation.pptx
Best Persuasive selling skills  presentation.pptxBest Persuasive selling skills  presentation.pptx
Best Persuasive selling skills presentation.pptxMasterPhil1
 
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdfDIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdfmayanksharma0441
 
How To Utilize Calculated Properties in your HubSpot Setup
How To Utilize Calculated Properties in your HubSpot SetupHow To Utilize Calculated Properties in your HubSpot Setup
How To Utilize Calculated Properties in your HubSpot Setupssuser4571da
 
Do More with Less: Navigating Customer Acquisition Challenges for Today's Ent...
Do More with Less: Navigating Customer Acquisition Challenges for Today's Ent...Do More with Less: Navigating Customer Acquisition Challenges for Today's Ent...
Do More with Less: Navigating Customer Acquisition Challenges for Today's Ent...Search Engine Journal
 
2024 SEO Trends for Business Success (WSA)
2024 SEO Trends for Business Success (WSA)2024 SEO Trends for Business Success (WSA)
2024 SEO Trends for Business Success (WSA)Jomer Gregorio
 
Jai Institute for Parenting Program Guide
Jai Institute for Parenting Program GuideJai Institute for Parenting Program Guide
Jai Institute for Parenting Program Guidekiva6
 
Cost-effective tactics for navigating CPC surges
Cost-effective tactics for navigating CPC surgesCost-effective tactics for navigating CPC surges
Cost-effective tactics for navigating CPC surgesPushON Ltd
 
Common Culture: Paul Willis Symbolic Creativity
Common Culture: Paul Willis Symbolic CreativityCommon Culture: Paul Willis Symbolic Creativity
Common Culture: Paul Willis Symbolic CreativityMonishka Adhikari
 
How videos can elevate your Google rankings and improve your EEAT - Benjamin ...
How videos can elevate your Google rankings and improve your EEAT - Benjamin ...How videos can elevate your Google rankings and improve your EEAT - Benjamin ...
How videos can elevate your Google rankings and improve your EEAT - Benjamin ...Benjamin Szturmaj
 
pptx.marketing strategy of tanishq. pptx
pptx.marketing strategy of tanishq. pptxpptx.marketing strategy of tanishq. pptx
pptx.marketing strategy of tanishq. pptxarsathsahil
 
定制(ULV毕业证书)拉文大学毕业证成绩单原版一比一
定制(ULV毕业证书)拉文大学毕业证成绩单原版一比一定制(ULV毕业证书)拉文大学毕业证成绩单原版一比一
定制(ULV毕业证书)拉文大学毕业证成绩单原版一比一s SS
 

Recently uploaded (20)

Local SEO Domination: Put your business at the forefront of local searches!
Local SEO Domination:  Put your business at the forefront of local searches!Local SEO Domination:  Put your business at the forefront of local searches!
Local SEO Domination: Put your business at the forefront of local searches!
 
Storyboards for my Final Major Project Video
Storyboards for my Final Major Project VideoStoryboards for my Final Major Project Video
Storyboards for my Final Major Project Video
 
Call Girls in Lajpat Nagar Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Lajpat Nagar Delhi 💯Call Us 🔝8264348440🔝Call Girls in Lajpat Nagar Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Lajpat Nagar Delhi 💯Call Us 🔝8264348440🔝
 
Forecast of Content Marketing through AI
Forecast of Content Marketing through AIForecast of Content Marketing through AI
Forecast of Content Marketing through AI
 
The Pitfalls of Keyword Stuffing in SEO Copywriting
The Pitfalls of Keyword Stuffing in SEO CopywritingThe Pitfalls of Keyword Stuffing in SEO Copywriting
The Pitfalls of Keyword Stuffing in SEO Copywriting
 
Influencer Marketing Power point presentation
Influencer Marketing  Power point presentationInfluencer Marketing  Power point presentation
Influencer Marketing Power point presentation
 
Word Count for Writers: Examples of Word Counts for Sample Genres
Word Count for Writers: Examples of Word Counts for Sample GenresWord Count for Writers: Examples of Word Counts for Sample Genres
Word Count for Writers: Examples of Word Counts for Sample Genres
 
What are the 4 characteristics of CTAs that convert?
What are the 4 characteristics of CTAs that convert?What are the 4 characteristics of CTAs that convert?
What are the 4 characteristics of CTAs that convert?
 
DGR_Digital Advertising Strategies for a Cookieless World_Presentation.pdf
DGR_Digital Advertising Strategies for a Cookieless World_Presentation.pdfDGR_Digital Advertising Strategies for a Cookieless World_Presentation.pdf
DGR_Digital Advertising Strategies for a Cookieless World_Presentation.pdf
 
Best Persuasive selling skills presentation.pptx
Best Persuasive selling skills  presentation.pptxBest Persuasive selling skills  presentation.pptx
Best Persuasive selling skills presentation.pptx
 
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdfDIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
 
How To Utilize Calculated Properties in your HubSpot Setup
How To Utilize Calculated Properties in your HubSpot SetupHow To Utilize Calculated Properties in your HubSpot Setup
How To Utilize Calculated Properties in your HubSpot Setup
 
Do More with Less: Navigating Customer Acquisition Challenges for Today's Ent...
Do More with Less: Navigating Customer Acquisition Challenges for Today's Ent...Do More with Less: Navigating Customer Acquisition Challenges for Today's Ent...
Do More with Less: Navigating Customer Acquisition Challenges for Today's Ent...
 
2024 SEO Trends for Business Success (WSA)
2024 SEO Trends for Business Success (WSA)2024 SEO Trends for Business Success (WSA)
2024 SEO Trends for Business Success (WSA)
 
Jai Institute for Parenting Program Guide
Jai Institute for Parenting Program GuideJai Institute for Parenting Program Guide
Jai Institute for Parenting Program Guide
 
Cost-effective tactics for navigating CPC surges
Cost-effective tactics for navigating CPC surgesCost-effective tactics for navigating CPC surges
Cost-effective tactics for navigating CPC surges
 
Common Culture: Paul Willis Symbolic Creativity
Common Culture: Paul Willis Symbolic CreativityCommon Culture: Paul Willis Symbolic Creativity
Common Culture: Paul Willis Symbolic Creativity
 
How videos can elevate your Google rankings and improve your EEAT - Benjamin ...
How videos can elevate your Google rankings and improve your EEAT - Benjamin ...How videos can elevate your Google rankings and improve your EEAT - Benjamin ...
How videos can elevate your Google rankings and improve your EEAT - Benjamin ...
 
pptx.marketing strategy of tanishq. pptx
pptx.marketing strategy of tanishq. pptxpptx.marketing strategy of tanishq. pptx
pptx.marketing strategy of tanishq. pptx
 
定制(ULV毕业证书)拉文大学毕业证成绩单原版一比一
定制(ULV毕业证书)拉文大学毕业证成绩单原版一比一定制(ULV毕业证书)拉文大学毕业证成绩单原版一比一
定制(ULV毕业证书)拉文大学毕业证成绩单原版一比一
 

Focus Group Creative Testing

  • 1. Content & Comprehension Survey ANALYSIS January 2018 produced by
  • 2. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 2  Overview ‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 3 • Key Insights & Findings • Conclusions & Recommendations  Survey Design ‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 29 • Logic Flow • Methodology  Analysis Parameters ‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 35 • Fieldwork Report • Final Quota Counts • Analysis Considerations  Respondent Demographics ‐‐‐‐‐‐‐‐‐‐‐‐ pg. 39 • Age Group • Race / Ethnicity • Gender Identify • Sexual Orientation • Education • Household Income • Residence Location  Survey Analysis / Section 1 ‐‐‐‐‐‐‐‐‐‐‐‐ pg. 49 • Creative Testing o Q1 – Ad Creative o Q2 – Poster Creative  Persona Matching / Section 1 ‐‐‐‐‐‐‐‐‐ pg. 79 • Edgar • Tallulah • Chris • Lorraine • Miguel • Non‐Classified  Survey Analysis / Section 2 ‐‐‐‐‐‐‐‐‐‐‐‐ pg. 87 • Video Inspiration Testing o Q3 – Anthem Video CONTENT  Survey Analysis / Section 3 ‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 94 • Persona Creative Testing o Q4 – Ad Creative  Survey Analysis / Section 4 ‐‐‐‐‐‐‐‐‐‐‐‐‐ pg. 137 • Social Media Use Testing o Q5 – Survey Polling  Survey Analysis / Section 5 ‐‐‐‐‐‐‐‐‐‐‐‐ pg.144 • Website Content Exposure o Website Heatmapping o Q6 – Comprehension Testing • Animation Video Exposure o Q7A – Inspiration Testing o Q7B – Comprehension Testing  Survey Analysis / Section 6 ‐‐‐‐‐‐‐‐‐‐‐ pg. 207 • Comprehension Re‐Testing o Program Description o Q8 – Comprehension  Survey Analysis / Section 7 ‐‐‐‐‐‐‐‐‐‐‐ pg. 214 • Pre‐Close Conversion Testing o Q9 – Program Concerns o Q9 – Enrollment Inclination o Q9 ‐‐ Feedback  Appendices (available as separate files) • Sub‐Population Views o African‐American o Hispanic‐Latino o Asian‐American o Caucasian • Creative Assets • Master Data Tables
  • 3. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 3 OVERVIEW (sample size: 11,811)
  • 4. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 4 Survey Section 1 / Questions 1 ‐ 2: Creative Testing ‐ Persona Self‐Identification Classification KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Aggregate Total Population Preference by Creative Asset (Gender + Age) Creative Asset Variation Preference Gender Age Group Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+ What’s In It for Me? One‐of‐a‐kind is kind of our thing. 1 26% 23% 29% 38% 29% 23% 13% Finding Cures Our health is our wealth. 2 17% 16% 18% 12% 16% 17% 23% Community, Tribe, Family, Legacy An inheritance they can actually use. 3 15% 17% 13% 11% 16% 18% 15% Empower, Control Righting Wrongs Power to the patient. 4 15% 15% 14% 14% 16% 15% 15% Altruism A healthier future. Pass it on. 5 14% 18% 11% 13% 13% 13% 18% Innovation, New Research One size does not fit all. 6 13% 11% 15% 12% 11% 15% 15% ‐ 100% 100% 100% 100% 100% 100% 100% Aggregate Total Population Preference by Creative Asset (Gender + Age) Creative Asset Variation Preference Gender Age Group Digital Posters Rank Percent Male Female 18‐24 25‐34 35‐54 55+ Empower, Control Righting Wrongs Not all research is created equal (that’s why we’re here). 1 28% 26% 29% 35% 29% 25% 20% What’s In It for Me? What’s good for you is good for us. 2 20% 19% 20% 16% 22% 23% 18% Finding Cures Fighting disease just got one million times easier. 3 17% 15% 18% 16% 15% 16% 19% Community, Tribe, Family, Legacy Legacies aren’t just ones you can spend. 4 13% 15% 11% 10% 10% 13% 21% Innovation, New Research The next big thing in health is here. 5 13% 13% 13% 11% 14% 14% 14% Altruism We can win the game as soon as we all get in it. 6 10% 11% 9% 12% 10% 9% 9% ‐ 100% 100% 100% 100% 100% 100% 100% Overview Recap D i g i t a l A d s P o s t e r s * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Observations & Findings for A/B Testing: Matrices reveal certain message persona themes resonate at varying levels depending on gender and age. Although the creative and headlines were developed based on individual persona motivations, we can see creative+messaging when delivered to test populations, have distinct preference nuances that can be identified by gender and age groupings – and which can be initially used for testing and optimizing future media and communications. A series of questions were designed to test message (motivation) and visual cues aligned by race/ethnicity to have respondents self‐identify themselves into 1 of 5 possible persona classifications with added insights into personal creative design composition appeal.
  • 5. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 5 KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Aggregate Total Population Preference by Creative Asset (Sub‐Population) Creative Asset Variation Overall Preference Race / Ethnicity Preferences Digital Ads Rank Percent African‐ American Hispanic‐ Latino Asian‐ American Caucasian What’s In It for Me? One‐of‐a‐kind is kind of our thing. 1 26% 29% 23% 26% 25% Finding Cures Our health is our wealth. 2 17% 25% 14% 18% 11% Community, Tribe, Family, Legacy An inheritance they can actually use. 3 15% 11% 17% 10% 22% Empower, Control Righting Wrongs Power to the patient. 4 15% 8% 20% 17% 16% Altruism A healthier future. Pass it on. 5 14% 14% 14% 9% 17% Innovation, New Research One size does not fit all. 6 13% 13% 11% 20% 10% ‐ 100% 100% 100% 100% 100% Overview Recap D i g i t a l A d s P o s t e r s * Red denotes highest preference across the sub‐population demographics. Aggregate Total Population Preference by Creative Asset (Sub‐Population) Creative Asset Variation Overall Preference Race / Ethnicity Preferences Digital Posters Rank Percent African‐ American Hispanic‐ Latino Asian‐ American Caucasian Empower, Control Righting Wrongs Not all research is created equal (that’s why we’re here). 1 28% 33% 27% 25% 25% What’s In It for Me? What’s good for you is good for us. 2 20% 24% 25% 14% 15% Finding Cures Fighting disease just got one million times easier. 3 17% 16% 14% 27% 13% Community, Tribe, Family, Legacy Legacies aren’t just ones you can spend. 4 13% 10% 19% 14% 11% Innovation, New Research The next big thing in health is here. 5 13% 12% 9% 13% 18% Altruism We can win the game as soon as we all get in it. 6 10% 5% 6% 7% 18% ‐ 100% 100% 100% 100% 100% Observations & Findings for A/B Testing: As with gender and age, matrices reveal certain message persona themes resonate at varying levels depending on respondent’s race / ethnicity. Distinct preference nuances exist that can be identified by race / ethnicity – and which can be initially used for testing and optimizing future media and communications Survey Section 1 / Questions 1 ‐ 2: Creative Testing ‐ Persona Self‐Identification Classification
  • 6. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 6 KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Aggregate Total Population Preference by Creative Asset Creative Asset Variation Preference Gender Age Group Ads + Posters Rank Percent Male Female 18‐24 25‐34 35‐54 55+ What’s In It for Me? 1 23% 21% 24% 27% 25% 23% 16% Empower, Control Righting Wrongs 2 21% 21% 22% 25% 22% 20% 18% Finding Cures 3 17% 15% 18% 14% 15% 16% 21% Community, Tribe, Family, Legacy 4 14% 16% 12% 10% 13% 15% 18% Innovation, New Research 5 13% 12% 14% 11% 12% 14% 14% Altruism 6 12% 14% 10% 12% 11% 11% 13% ‐ 100% 100% 100% 100% 100% 100% 100% A g g r e g a t e d R e s u l t s Aggregate Total Population Preference by Creative Asset Creative Variation Altruism Finding Cures Community, Tribe, Legacy, Family Innovation, New Research Empowerment, Control, Righting Wrongs What’s In It for Me? Ad Rank Preference 5 2 3 6 4 1 Poster Rank Preference 6 3 4 5 1 2 * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Creative Rankings Illustration bias may exist over alternative photo choices. (Survey presented only one illustration against photo variations. Note: ranking #1 for ad and poster – each are illustrations.) Correlation for gender and age self‐identification is evident in varying degrees for single person photography. Illustrations may appeal more to younger audiences (18‐24) + (25‐34) compared to older audiences. Group photos may work better if they represent larger multi‐cultural groups of people. Younger generations may gravitate to images, older generations headlines. Males may be more inclined to gravitate to images with females leaning towards headlines. 55+ age groups are more inclined to gravitate to headlines over images. Ambiguous creative headlines (tags) may be less appealing or less understood across both gender and age. Appeal for each headline (tag) skews either younger or older and may map to personal life stage (age values) relevance. For a modest portion of the sub‐population which didn’t find any ads appealing, there were two primary and common reoccurring themes: – lacks appeal / doesn’t create interest – didn’t provide enough information to understand what the ad was about (further validating creative headlines may need to be easily understood) Ads and other creative assets should always have brief explainer body copy to pass along a quick program comprehension message takeaway. Observations & Findings for A/B Testing: Overview Recap Survey Section 1 / Questions 1 ‐ 2: Creative Testing ‐ Persona Self‐Identification Classification
  • 7. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 7 Survey Section 1 / Persona Matching ‐ Self‐Identification Classification KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Overview Recap Observations & Findings for A/B Testing: Chart and matrix reveals persona matching groupings can be of different population sizes aligned to potential race / ethnicity differences in motivational behaviors and personal values. Based on these findings ‐‐ creative design, strategic execution and budgets can all be tested, verified and optimized in alignment with and targeted to each sub‐ population. From the aggregate population, we can see different persona groups rise above and fall below the aggregate average. Within each sub‐population, different personas will have degrees of varying influence. Population Group Edgar Tallulah Chris Lorraine Miguel Non‐Classified Aggregate 13% 19% 15% 21% 28% 5% African‐American 9% 23% 17% 18% 29% 4% Hispanic‐Latino 9% 16% 14% 25% 32% 4% Asian‐American 10% 27% 12% 20% 27% 4% Caucasian 19% 13% 15% 20% 25% 8% Self Identification Questions were designed to have a respondent self‐ identify their dominant persona into (5) ‘positive’ persona types. Persona matching has taken into consideration respondents may have multiple dominant and secondary motivations.
  • 8. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 8 Survey Section 1 / Persona Matching ‐ Self‐Identification Classification KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Overview Recap Edgar | Ready to go Characteristics • Altruistic • Skews older • Has free and/or flexible time • Likely volunteers • Tends to trust doctors and government • Could have disease or not have disease • May want deeper engagement after joining (e.g. recruit others) Observations & Findings: Optimized Demo: [ Male (all ages) + F (55+) ] [ HS Graduate thru College Degree ] [ <100K HHI ] Tallulah | Determined Characteristics • Newly diagnosed with chronic disease • Skews younger • Committed to beating own disease • Tends to trust doctors ad government • Likely to track health • Wants to help self, but also others withy disease • May engage more deeply after joining (e.g. citizen science) Observations & Findings: Optimized Demo: [ Female (all ages) + M (55+) ] [ HS Graduate thru College Degree ] [ <100K HHI ] Chris|Curiousbutdistracted Characteristics • Health‐oriented, not likely to have chronic disease • Skews younger • Likely to track health; unlikely to share socially • Many things compete for attention • Influenced by social network • Requires convenience; All of Us must fit in with flow of life • Wants to use All of Us results in daily life Observations & Findings: Optimized Demo: [ (M + F) + (18‐24) + (25‐34) + (35‐54) ] [ HS Graduate thru College Degree ] [ <100K HHI ]
  • 9. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 9 Survey Section 1 / Persona Matching ‐ Self‐Identification Classification KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Overview Recap Lorraine|Community‐centric Characteristics • Distrusts doctors/medical profession • Sees doctors infrequently • Skeptical that All of Us would be equitable • Needs proof that community matters • Requires multiple touchpoints before joining • Requires face‐to‐face interactions, to build trust Observations & Findings: Optimized Demo: [ (M + F) + all ages)] [ HS Graduate thru College Degree ] [ <100K HHI ] Miguel|Suspiciousbutpositive Characteristics • Sees doctors infrequently; uses free clinics/ER for care • Likely does not have chronic disease • Distrusts government (“it’s malevolent”) • Unlikely to donate DNA • Concerned All of Us could harm people • Wants to protect self/family/others • Wants to help humanity in substantive ways Observations & Findings: Optimized Demo: [(M + F) + (18‐24) + (25‐34) + (35‐54) ] [ HS Graduate thru College Degree ] [ <100K HHI ] Gen Pop|Non‐Classified Characteristics • A mashup of all persona characteristics without any single behavioral attribute being dominant. • A high percentage of these individuals (those people who may be more complex in their thinking and values) are over 55 years of age. Observations & Findings: Optimized Demo: [ M (55+) + F (55+) ] [ HS Graduate thru College Degree ] [ <75K HHI ]
  • 10. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 10 Survey Section 2 / Questions 3: Anthem Video Inspiration Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Overview Recap Yes 82% No 18% Gender + Age Segment Group differences within + 2 percentage points. After watching the video, do you want to learn more about the program? Observations & Findings for A/B Testing: A high percentage of those watching the Anthem inspirational video were inspired to learn more. Very little differentiation was discovered by gender or age. People were inspired by the video from two core recurring themes: 1) diversity of people shown in the video, and 2) the underlying storyline and message. Of those who were not inspired, which a reasonably large percentage, recurring themes surrounding the video content were 1) video didn’t provide sufficient information to understand program, and 2) message takeaway was not easy to understand or it was unclear. Of note, the video tested was the inspirational video, and therefore, it was designed to inspire people to want to learn more without explaining the program or its intended benefits at length. A consideration may be to distill or refine the messaging within the video for a bit more clarity to help people better understand the core premise of the program. “It didn't give me enough information about the organization to be even interested. Just a lot of nice pictures.” “It seemed like a very generic commercial that spreads itself too thin by trying to appeal to every demographic possible. I learned nothing about what it was actually trying to advertise.” Quick test to see if the Anthem video inspires viewers with added insights into why or why not.
  • 11. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 11 EDGAR PERSONA Altruism, Innovation, Legacy and Family Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for all of us. Survey Section 3 / Question 4: EDGAR Persona Creative Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 1,479) Aggregate Total Population Preference by Creative Variation Creative Asset Variation Preference Gender Age Group Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+ Diversity, meet data. 1 29% 28% 30% 36% 33% 30% 18% The future of health begins with you. 2 26% 25% 28% 15% 22% 24% 40% Transform your life... and theirs. 3 15% 16% 14% 14% 18% 17% 13% When we’re all present, we all win. 4 12% 12% 11% 11% 10% 12% 14% Your data saves life even after yours is over. 5 12% 11% 12% 15% 10% 11% 10% Join like there is a tomorrow. 6 6% 7% 5% 9% 7% 5% 4% ‐ 100% 100% 100% 100% 100% 100% 100% Overview Recap * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Observations & Findings for A/B :  Persona Match: Edgar ‐ 13% of total aggregate population.  Top ranked choice had appeal across age groups and gender suggests persona appeal for both message and image.  Skews younger (albeit high across all age groups).  There are distinct appeal nuances associated with each ad variation across gender and age.  In aggregate, top 2 ranked choices have a high degree of resonance across gender and age. Male, 59% Female, 41% * Illustration bias may exist over presented photography alternatives. Persona Gender Demographic Creative test to measure appeal and resonance matched against persona archetype.
  • 12. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 12 Observations & Findings for A/B Testing:  Persona Match: Tallulah ‐ 19% of total aggregate population.  Top ranked choice had appeal across age groups and gender suggests persona appeal for both message and image.  Skews younger and with females.  As with all personas, distinct nuances exist for each ad variation across gender and age.  In aggregate, top 2 ranked choices have a high degree of resonance across gender and age. Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for all of us. TALLULAH PERSONA Finding cures, Empowerment, What’s in it for me Survey Section 3 / Question 4: TALLULAH Persona Creative Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,231) Aggregate Total Population Preference by Creative Variation Creative Asset Variation Preference Gender Age Group Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+ Treatments as unique as you. 1 22% 16% 27% 30% 20% 19% 19% The right treatment, for the right person, at the right time. 2 22% 21% 22% 19% 20% 23% 24% The future of health begins with you 3 20% 22% 19% 14% 18% 22% 26% The future is happening you want in? 4 17% 19% 16% 17% 19% 19% 15% It's less about illness more about people. 5 9% 11% 8% 10% 12% 9% 7% Medical research could use an update. 6 9% 11% 8% 9% 11% 8% 9% ‐ 100% 100% 100% 100% 100% 100% 100% Overview Recap * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. * Illustration bias may exist over presented photography alternatives. Male, 47% Female, 53% Persona Gender Demographic Creative test to measure appeal and resonance matched against persona archetype.
  • 13. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 13 Survey Section 3 / Question 4: CHRIS Persona Creative Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 1,756) Aggregate Total Population Preference by Creative Variation Creative Asset Variation Preference Gender Age Group Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+ It takes a village to beat disease. 1 32% 27% 36% 39% 33% 29% 26% There's only one condition: The human condition. 2 27% 28% 26% 23% 24% 30% 34% We 're putting the ease in disease research. 3 12% 14% 11% 11% 14% 11% 12% Progress. In real time. 4 11% 10% 12% 10% 12% 13% 10% The future of health begins with you. 5 10% 11% 9% 9% 9% 11% 13% One million people. Now that's strength in numbers. 6 8% 10% 6% 9% 8% 7% 6% ‐ 100% 100% 100% 100% 100% 100% 100% Overview Recap * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for all of us. CHRIS PERSONA Innovation, Community and Tribe, What’s in it for me Observations & Findings for A/B Testing:  Persona Match: Chris ‐ 15% of total aggregate population.  Top ranked choice had preference across most age groups and gender reinforces persona appeal for message and image.  Skews younger and more to females over males.  In aggregate, top 4 ranked choices have a high or modest degrees of resonance across gender and age. * Illustration bias may exist over presented photography alternatives. Male, 47% Female, 53% Persona Gender Demographic Creative test to measure appeal and resonance matched against persona archetype.
  • 14. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 14 Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for all of us. LORRAINE PERSONA Community and Tribe, Righting Wrongs, Altruism Survey Section 3 / Question 4: LORRAINE Persona Creative Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,437) Aggregate Total Population Preference by Creative Variation Creative Asset Variation Preference Gender Age Group Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+ It will take all of us to make history. Are you in? 1 33% 32% 35% 36% 32% 34% 32% The future of health begins with you. 2 24% 22% 27% 18% 27% 27% 23% Your data can save lives, and not just yours. 3 14% 15% 12% 15% 14% 13% 13% Health for everybody. 4 10% 9% 10% 7% 8% 10% 14% Research shows research could be better. 5 10% 12% 7% 10% 10% 8% 11% We can't see you if you don't raise your hand. 6 10% 10% 9% 14% 10% 8% 7% ‐ 100% 100% 100% 100% 100% 100% 100% Overview Recap * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Observations & Findings for A/B Testing:  Persona Match: Lorraine ‐ 21% of total aggregate population.  Top preference across all age groups and gender reinforcing persona appeal for message and image.  Skews slightly more to females over males.  Group photo also has high appeal across gender and age groups.  In aggregate, top 3 ranked choices have a high or modest degrees of resonance across gender and age. * Illustration bias may exist over presented photography alternatives. Male, 51% Female, 49% Persona Gender Demographic Creative test to measure appeal and resonance matched against persona archetype.
  • 15. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 15 Survey Section 3 / Question 4: MIGUEL Persona Creative Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 3,288) Aggregate Total Population Preference by Creative Variation Creative Asset Variation Preference Gender Age Group Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+ It's our differences that make all the difference. 1 43% 43% 43% 34% 45% 50% 45% The future of health begins with you 2 30% 30% 29% 37% 29% 25% 26% Diversity, meet data. 3 12% 12% 12% 15% 13% 11% 8% Health isn't a sideline sport. 4 5% 7% 4% 4% 5% 5% 9% Give. Learn. Cure. 5 5% 4% 6% 6% 5% 4% 4% It's time everyone had a seat at the table. 6 5% 4% 5% 5% 3% 5% 8% ‐ 100% 100% 100% 100% 100% 100% 100% Overview Recap * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for all of us. MIGUEL PERSONA Righting Wrongs, Legacy and Family, Altruism Observations & Findings for A/B Testing:  Persona Match: Miguel ‐ 28% of total aggregate population.  Top preference across all age groups and gender reinforcing persona appeal for message and image.  Large group photo works better than smaller group photos.  Skews evenly across gender with a slight uptick with age.  In aggregate, top 2 ranked choices have a high degrees of resonance across gender and age. * Illustration bias may exist over presented photography alternatives. Male, 47% Female, 53% Persona Gender Demographic Creative test to measure appeal and resonance matched against persona archetype.
  • 16. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 16 Observations & Findings for A/B :  Persona Match: Non‐ Classified ‐ 5% of total aggregate population.  Top two ranks ‐ preference across all age groups and gender reinforcing persona appeal for message and image.  Soldier image resonates with males over females in greater percentages as may be expected.  Remaining choices sample size too small to predict appeal. Survey Section 3 / Question 4: NON‐CLASSIFIED / GEN POP Persona Creative Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 620) Aggregate Total Population Preference by Creative Variation Creative Asset Variation Preference Gender Age Group Digital Ads Rank Percent Male Female 18‐24 25‐34 35‐54 55+ 1 ‐ The future of health begins with you v3 1 33% 41% 23% 39% 25% 25% 38% 2 ‐ The future of health begins with you v4 2 33% 30% 36% 21% 44% 38% 31% 3 ‐ The future of health begins with you v6 3 21% 15% 28% 26% 19% 27% 15% 4 ‐ The future of health begins with you v1 4 6% 7% 4% 0% 9% 4% 10% 5 ‐ The future of health begins with you v2 5 6% 4% 7% 11% 4% 4% 4% 6 ‐ The future of health begins with you v5 6 2% 2% 1% 3% 0% 2% 2% ‐ 100% 100% 100% 100% 100% 100% 100% Overview Recap * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for all of us. NON-CLASSIFIED Non‐Classified Motivational Behaviors Male, 57% Female, 43% Persona Gender Demographic Creative test to measure appeal and resonance matched against persona archetype.
  • 17. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 17 Survey Section 4 / Question 4: NON‐CLASSIFIED / Social Media Use Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Overview Recap What social media platforms do you currently use and have a personal profile? 83% 50% 44% 32% 62% 12% 32% 7% Facebook Instagram Twitter SnapChat YouTube Tumblr Google+ None Observations & Findings for A/B Testing:  Expected core social media platforms (Facebook, Twitter, Instagram, YouTube) are channels of preferred choice.  Other channels (SnapChat, Tumblr, Google+) are significant in use, which warrant future consideration and expansion of long‐term social media campaigning.  Test populations are more inclined to follow companies and brands they like than they are to follow health oriented or charitable causes. This simply means message testing for resonance should be an ongoing process.  Social media use is high within the test population with more than 75% active and engaged on a daily basis. This bodes well for the AOU program. The challenge will be continually producing fresh content that is both engaging and sharable.  Image posts and infographics with large visuals are the most desirable form of content. This maps to universal social media user habits. However, other forms of content will (and should) have a purpose and use within the overall campaign strategy. Survey polling designed to help steer the social content strategy and to identify where test populations are congregating across social media.
  • 18. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 18 Survey Section 5 / WEBSITE HEAT MAPPING – Content Appeal & Resonance KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Overview Recap About, 4.38 Program Overview, 3.69 Privacy Safeguards, 2.77 Who's Involved, 2.65 FAQ, 7.05 How to Join, 0.45 Who Can Join, 0.36 What You Need to Do, 0.45 Benefits of Taking Part, 0.34 How Your Data Will Be Used, 0.47 0.00 1.00 2.00 3.00 4.00 5.00 6.00 7.00 8.00 AVERAGE LANDING PAGE CLICKS PER SURVEY RESPONDENT Observations & Findings for A/B Testing: When comparing how many average clicks a respondent made on each lading page (which demonstrates content of interest or high appeal), we can see The About Landing pages and sub‐domains received far greater attention and interest than The How To Join landing page and sub‐domains. At this early advance national enrollment stage, and without respondents having been exposed to the program prior to the survey, this can be expected that the majority of respondents would spend more time gathering information on the background of the program versus information for what’s involved with enrolling. Of special note and significance, is the average number of clicks for the FAQ sub‐domain. We can make a logical conclusion that the information and content contained within this site section will be the leading area of interest for much of the general population as they embark on their personal user discovery journey. Designed to gather respondent insights into website content resonance and overall program understanding.
  • 19. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 19 Survey Section 5 / Question 6: Program Comprehension Testing (Part 1) KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Overview Recap 1% 2% 4% 8% 16% 70% Other A blood bank program with centers across the U.S. A program that does genetic testing for people in the U.S. A program that provides me with personalized healthcare. A health insurance program for people in the U.S. A national research program to improve health. Based on the website you just looked at, which statement best describes what the program is? Observations & Findings for A/B Testing: After respondent visited the website and spent time with our content, and after they had been exposed to a series of creative assets, the survey tested program comprehension. The results reveal that 70 percent of the total population respondents were able to pick the correct response. What this may tell us is that messaging within all assets (creative and web) may need to be more simplified and distilled into an easier to understand explanatory program benefit statement which is memorable. Although there are some nuances in the results, there were very little significant differentiation across sub‐populations (race/ethnicity, gender, age) as well as with education and income levels. 67% 66% 74% 72% African‐American Hispanic‐Latino Asian‐American Caucasian 66% 73% Male Female 63% 63% 70% 83% 18‐24 25‐34 35‐54 55+ Designed to help determine ease of program understanding and benefit after initial exposure to website content.
  • 20. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 20 Survey Section 5 / Question 7: Animation Video Testing & Program Comprehension Testing (Part 2) KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 11,811) Overview Recap Observations & Findings for A/B Testing:  A high percentage of the respondents were further inspired for learning more about the program after watching the animation video. That’s good news.  However, of peculiar note, the second testing for program comprehension actually went down by two percentage points, where it would have been expected to increase on the second comprehension test.  Possibly, the word choice and inclusion of ‘precision medicine’ in the correct description may in itself (the phrase) be not clear for many in the general population. It is somewhat a technical, insider phrase without mass awareness.  As with other observations after the first comprehension test, it may be beneficial to work on a more simplified program description to ensure at every touchpoint, clarity is provided for those early in the discovery journey.  And, as with the first test, there are subtle nuances associated within the sub‐population segments. (see Section 5: Program Comprehension detail) After watching the video, do you want to learn more about the program? Yes 85% No 15% Based on the video you just watched, which statement best describes what the program is? 1% 1% 7% 11% 13% 68% Other A natiowide blood donation program. A program thyat collects DNA frm everyone in the U.S. A new type of health insurance program for people in the U.S. A program that will provide personal medical care specifically… A national research program to improve precision medicine. Designed to test video content for ease of program comprehension and general understanding.
  • 21. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 21 Survey Section 6 / Question 8: Program Comprehension Re‐Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,369) Overview Recap Observations & Findings for A/B Testing:  In aggregate, across both comprehension testing questions, a reasonably high percentage of the respondents were unable to choose the correct response for either question (2,369 respondents or 20% of total surveyed population).  As with the other observations after the first two comprehension tests, it may be beneficial to work on a more simplified program description to ensure at every touchpoint, greater clarity is provided for those early in the discovery journey. Tracking logic was applied to move respondents to the pre‐close stage for measuring impact and influence of site information and creative video content. 20% 80% INCORRECT Response CORRECT Response Designed to move respondents either into a pre‐close conversion test or to give them one last opportunity for understanding the program and its benefit.
  • 22. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 22 Survey Section 6 / Question 8: Program Comprehension Re‐Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,369) Overview Recap Please read the following program description. The All of Us Research Program is a large research program. The goal is to help researchers understand more about why people get sick or stay healthy. All of Us is part of the Precision Medicine Initiative. We hope that more than a million people will join All of Us. People who join will give us information about their health, habits, and what it’s like where they live. By looking for patterns, researchers may learn more about what affects people’s health. The All of Us Research Program will last for many years. This will allow us to study health over time. If you decide to join the All of Us Research Program, you will be contributing to an effort to improve the health of generations to come. You also may learn about your own health. What is the All of Us Research Program? One last opportunity was provided to these survey respondents to choose the correct response for the program description by having them read a full program description and then to correctly pick the most appropriate answer.
  • 23. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 23 Survey Section 6 / Question 8: Program Comprehension Re‐Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,369) Overview Recap Observations & Findings for A/B Testing:  Based on this population audience who struggled with understanding the program, two out of every three individuals in this population subset still have trouble grasping the understanding and key benefit of the program. – even though 91 percent of this population subset stated our program description was easy to understand.  This audience, who still had an incorrect response after three attempts to the comprehension question, and which represents approximately 14 percent of the total survey population, likely will never be a candidate for the program for a myriad of reasons.  We must assume a sizeable portion of the national general population will never appeal to the program, or to our communications, and marketing should optimize to find population pools who are much more receptive to learning more about the program.  However, of note as a recurring theme, refining the core message into a simplified and quickly understandable benefit statement, and without the use of medical or industry jargon, may reach and influence a portion of this classified audience‐type as represented in this survey with future communications.  Recurring themes for those individuals who were not able to choose the correct response is sampled below. Based on the program description you just read, which statement best describes what the program is? 6% 15% 18% 29% 32% A programs that tests your genes and DNA. A blood donation program with centers across the U.S. A program that provides me with information about my personal health. A program that provides health insurance for individuals and families. A large research program to advance the practice of medicine. What is it about our program description which is not clear? “At first I was under the impression that it was a health care program. I feel like the website makes it seem as if a participant will receive a direct benefit from entering the program, but the program itself is just to collect research.” “Seems like a lot of info to take in. The description is clear, but it's not really explained properly.”
  • 24. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 24 Designed to test phrases which would resonate with targeted audiences. Survey Section 7 / Question 9A: Pre‐Close Conversion Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 9,442) Overview Recap Observations & Findings for A/B Testing:  Based on the polling conducted, there are clear winners and losers in the choices provided.  Since some tags were already tested earlier in the survey, if we compare previous testing with this polling question, we can see there are differences in appeal and preference. What this tells us is that preference for creative compositions are a combination of both image and tag, although one strong element could be the deciding factor for how well content resonates with an individual.  The top 3 choices in the poll do align with previous tested rankings, so it’s a logical conclusion that these tags in particular would perform well in creative assets. 2% 4% 5% 8% 9% 10% 11% 15% 16% 20% Doctor will see you now One‐of‐a‐Kind is kind of our thing Takes a village to beast disease 30,000 diseases…let's get to work Diversity, meet data Your future, my legacy Everybody has a story Our differences make the difference There's only one condition, the human condition Fighting disease just got 1M times easier Please rank the following phrases which would make you want to learn more about the program? Tags Previously Tested Polling Rank Tested Rank Test Section / Question Fighting disease 1 #3 Q2 (Motivation) / Finding Cures Only one condition… 2 #2 Q4 (Persona) / Chris Our differences… 3 #1 Q4 (Persona) / Miguel Diversity, meet data. 6 #1 Q4 (Persona) / Edgar Diversity, meet data. 6 #3 Q4 (Persona) / Miguel Takes a village… 8 #1 Q4 (Persona) / Chris One‐of‐a‐kind… 9 #1 Q1 (Motivation) / What’s in it for me
  • 25. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 25 Designed to test whether individuals would have enrollment concerns after exposure to program via this survey. Survey Section 7 / Question 9B, 9C: Pre‐Close Conversion Testing KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 9,442) Overview Recap Observations & Findings for A/B Testing:  Based on the survey question, a sizeable percentage of all survey respondents do have concerns about enrolling in the program.  Asian‐Americans are significantly more concerned over other sub‐population groups. Of note, the African‐ American and Hispanic‐Latino sub‐populations are below Caucasians as a group with greater concerns.  Overall, data security and privacy are the top two concerns with other choices presented staggered behind (although each concern is of significant size.) Do you have any concerns about joining the program? Yes 30% No 70% What are your concerns? 25% 34% 36% 39% 47% 67% 68% Loss of status Time Data types Government Research ethics Privacy Data security 27% 27% 38% 30% African‐American Hispanic‐Latino Asian‐American Caucasian YES Response
  • 26. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 26 Section 7 / Survey Question 9D: Pre‐Close Conversion Testing We appreciate your concerns. Would you still be interested in joining the program?  Yes (advance to Q9F)  No (advance to Q9G) NO - WOULD NOT JOIN Review by Sub-Population 60% 66% 63% 58% 40% 34% 37% 42% African‐American Hispanic‐Latino Asian‐American Caucasian Join Inclination x Sub‐Population Yes No Yes, 61% No, 39% Overview Recap KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 2,845)
  • 27. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 27 Section 7 / Survey Question 9G: Pre‐Close Conversion Testing Why would you not want to join the program? Advance to survey termination Thank you for your time and for sharing your opinions. Your thoughts are very important to us. Have a great day! Observations & Findings for A/B Testing:  For the small sample base population who would not want to join the program, recurring themes included expected responses as identified in the previous question.  Several new concerns identified which are just as critical to address for long‐term program success are: TRUST, CREDIBILITY and RISK. Overview Recap KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 1,097)
  • 28. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 28 Section 7 / Survey Question 9F: Pre‐Close Conversion Testing What are your main reasons for wanting to join the program? Advance to survey termination Thank you for your time and for sharing your opinions. Your thoughts are very important to us. Have a great day! Observations & Findings for A/B Testing:  For those expressing an interest in joining the program, sentiments were all very positive. A sampling of those are above.  All of the ecology model persona motivations showed up in the comment findings: altruistic, advancing healthcare, making a difference, a better future, finding cures and more. “The program seems very promising. I believe this program could change the whole world and help many that in need and after I watch this video I never realize there was an organization that cared about people other then money unlike the rest so in the future I will probably join the program.” “It can help other people in the future. 2. Like the video said, not everyone is the same so meds and treatments should be tailored to the person's issues.” “Anything that helps enlighten us about new age medicine to fight various illnesses and preserve healthy lives is a no brainer to me.” “As a healthcare provider, I would love to be a part of a life changing organization where research is the priority to figuring out the behind the scenes of unexplainable illnesses.” “As someone who is fascinated by the health and wellness industry, I think this is a revolutionary approach to better serving the people who truly matter in this interaction: the patients. I'm also interested to see how far the research will take the healthcare industry in my lifetime and how the data that is accrued will be implemented/used in actual practice Also, it is so very important to recognize diversity, especially in healthcare.” “I'm fully aware that there are no "one size fits all" diagnoses and treatment options, I believe the more data we have the more tools we have to fight disease”. “An opportunity to contribute to the human race and make a difference for healthcare outcomes. An opportunity to contribute to precision medicine, which sounds like a potentially groundbreaking approach to medicine.” Besides being part of a project that has the prospect of helping so many people and my loved ones, I think it would be so important to be part of something that could benefit millions of people in the future. Overview Recap KEY INSIGHTS & FINDINGS: Aggregate Total Population Group (sample size: 6,628)
  • 29. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 29 SURVEY DESIGN (Logic Flow and Methodology)
  • 30. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 30 Advance to Q3A Advance to Q2A Self Identification Logic Applied Match Applied Based on Persona Coded Responses Branching Question Follow in Section 3 Based on Matched Coded Persona Persona Pre‐Qualifier ‐ Self Identification Questions Persona 1 Edgar ‐ Ready to Go Persona 2 Tallulah ‐ Determined Persona 3 Chris ‐ Curious But Distracted Persona 4 Lorraine ‐ Community Centric Persona 5 Miguel ‐ Suspicious But Positive Section 1: Persona Self Identification Classification Photo Image Headline (large text) Both Photo Image Headline (large text) Both Separate African‐ American, Hispanic, Asian, Caucasian ad set groups to be presented based on targeting. Self Identification Questions are designed to have a respondent self‐ identify their dominant persona into (5) ‘positive’ persona types. Persona matching has taken into consideration respondents may have multiple dominant and secondary motivations. Question choices will be randomized multiple choice with one optional open ended choice. Which ad makes you want to click to learn more about the program? What about the ad did you like? Which poster makes you want to learn more about the program? What about the poster did you like? Q1A Q2A Q1B Q2B Display Ad 1 Altruism Display Ad 2 Finding Cures Display Ad 3 Community & Family Display Ad 4 Innovation Display Ad 5 Righting Wrongs None Forced Open Ended Display Ad 6 What’s In It For Me Poster 1 Altruism Poster 2 Finding Cures Poster 3 Community & Tribe Poster 4 Innovation Poster 5 Righting Wrongs Poster 6 What’s In It For Me None Forced Open Ended Section 2: Video Inspiration Testing Were you inspired by the video? Why were you not inspired? (open‐ended) Why were you inspired? (open‐ended) Q3A VIDEO SEGUE Now, please watch the following video. Present Anthem Video Yes No Q3B Q3 specifically tests the Anthem video’s inspirational value for learning more about the program. After watching the video, do you want to learn more about the program? Yes No Q3C Q3D Branching Yes/No Logic Flow. Section 3: Persona Match Creative Testing Which poster makes you want to learn more about the program? (Persona Match Branching Question) Persona 1 Edgar ‐ Ready to Go Persona 2 Tallulah ‐ Determined Persona 3 Chris ‐ Curious, Distracted Persona 4 Lorraine ‐ Community Centric Persona 5 Miguel ‐ Suspicious, Positive Non‐Classified General Population Q4A Each of the (5) Persona Groups is served a unique set of creative content matched to the respondent’s self‐ identified dominant persona type category to test resonance and appeal for creative composition + messaging. 5 x Option Creative + Message (randomized multiple choice) 5 x Option Creative + Message (randomized multiple choice) 5 x Option Creative + Message (randomized multiple choice) 5 x Option Creative + Message (randomized multiple choice) 5 x Creative + Message (randomized multiple choice) What about the poster did you like? 3x Option Single Pick Q4B Photo/Image Large Text Headline Both 5 x Option Creative + Message (randomized multiple choice) If none selected, Advance to Q5A SURVEY LOGIC FLOW
  • 31. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 31 Q5 series of questions tests social media use and likely inclination to follow and engage with an AoU‐oriented program with the objective to help steer content strategy. Section 4: Social Media Use Testing On social media, do you follow (like) companies and brands? Yes No On social media, do you follow (like) any medical or healthcare organizations? Yes No Q5D On social media, do you engage with stories and content shared from companies and organizations you may follow? Yes No What social media platforms do you currently use? (Multi‐Pick List) Facebook Instagram Twitter SnapChat YouTube Tumblr Google+ Q5A Q5B On social media, do you follow (like) any community causes? Yes No Q5C Q5E How often do you use your social media accounts? (Single‐Pick List) Once a day More than once a day Several times per week Once a week Monthly or infrequently It depends, all of above Q5F Section 5: Site & Video Program Comprehension Testing Incorrect Understanding Incorrect Understanding WEBSITE SEGUE Thanks! Now we’d like to show you a website. There are two parts to the website. Take your time to look at parts 1 and 2. Each part has sections within it. To reach those sections, click the (navigation menu) buttons at the top of the pages as you would with other websites… About Landing Page (Nav Bar Selectable) Program Overview (Nav Bar Selectable) Privacy Safeguards (Nav Bar Selectable) Who’s Involved (Nav Bar Selectable) FAQ (Nav Bar Selectable) Website pages interactivity is limited to a clickable menu navigation bar. Respondents will be able to scroll and click on areas of interest within the static page formats. Please review carefully the following website sections and CLICK on the content areas you would explore if you had discovered the website on your own and wanted to learn more. PLEASE TAKE ALL THE TIME YOU NEED. CLICK AS MANY TIMES AS YOU LIKE. How to Join (Nav Bar Selectable) Who Can Join? (Nav Bar Selectable) What You Need to Do (Nav Bar Selectable) Benefits of Taking Part (Nav Bar Selectable) How Data Will Be Used (Nav Bar Selectable) Based on the website you just looked at, which statement best describes what the program is? A health insurance program for people in the U.S. A blood bank program with centers across the U.S. A national research program to improve health. A program that does genetic testing for people in the U.S. A program that provides me with personalized healthcare. Other Forced Open Ended Response Q6 Correct Optional (incorrect) descriptions represent the most common likely misinterpretations for the AoU program with one open ended option to allow a respondent to share an unrepresented choice. This section with Q7 tests website content which would likely be reviewed and read based on personal appeal, motivations and interests. SURVEY LOGIC FLOW
  • 32. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 32 Based on the video, which statement best describes what the program is? A program that collects DNA from everyone in the U.S. A new type of health insurance program for people in the U.S. A national research program to improve precision medicine. A nationwide blood donation program. A program that provides information about my personal health. Other Forced Open Ended Response Incorrect Understanding Correct Incorrect Understanding Optional (incorrect) descriptions represent the most common likely misinterpretations for the AoU program with one open ended option to allow a respondent to share an unrepresented choice. Q7A VIDEO SEGUE Great! Lastly, please watch one more video. Present Animation Video Yes No, why would you not want to learn more? Q7B After watching the video, do you want to learn more about the program? Section 5: Site & Video Program Comprehension Testing If Respondent Had Incorrect Program Description Responses for Testing Questions (Q6 & Q7B) Continue to Section 5, Questions 8 If Respondent Had At Least One Correct Program Description Response for Testing Questions (Q67 & Q7B) Continue to Section 6, Questions 9 Q8 further tests respondent’s inspiration and comprehension linked to specifically the Animation video. Section 6: Program Comprehension Re‐Testing Now, which statement best describes what the program is? 4 x Option Single Pick (randomized ‐ multiple choice) A blood donation program with centers across the U.S. A program that provides health insurance for individuals and families. A large health research program to advance the practice of medicine. A program that tests your genes and DNA. A program that provides me with information about my personal health. Please read the following program description. The All of Us Research Program is a large research program. The goal is to help researchers understand more about why people get sick or stay healthy. All of Us is part of the Precision Medicine Initiative… Q8A Q8B Do you think our program description is easy to understand? What is it about our program description which is not clear? Q8C Forced Open‐Ended Response. Branching Yes/No Logic Flow. Yes No Thank Respondent & Terminate Survey SURVEY LOGIC FLOW
  • 33. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 33 If Respondent Had At Least One Correct Program Description Response for Testing Questions (Q6 & Q7B) Q9E Q9F This section and the series of Q8 questions is designed to gather deeper insights into motivations and concerns which can be mapped to persona classifications. Branch Back to “No” Answer Flow Q9C with Modified Language If a Correct Response was recorded in either the Previous Q6A, Q7B Question… Do you have any concerns about joining the program? (yes / no radial button) If Yes Response What are Your Concerns? (randomized ‐ multi‐pick 6 x multiple choice + None option) Privacy Concerns DNA Sharing Concerns Data Security Concerns Health Insurance Insurability Concerns If No Response Would you join the program? (yes/no radial button) We appreciate your concerns. Would you still be interested in joining the program? (yes/no radial button) Section 7: Pre‐Close Conversion Testing Branching Yes/No Logic Flow. Q9A If Yes Answer If No Answer Why would you not want to join the program? Forced Open Ended Thank Respondent & Terminate Survey Branching Flow. What are your main reasons for wanting to join the program? Forced Open Ended Research Ethics Concerns Time Commitment Concerns Other, Open Ended Too Much Government Concerns Q9B Q9D Q9C Branch From Original Yes Response SURVEY LOGIC FLOW ‐ end ‐
  • 34. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 34 Target Audiences & Survey Size Respondents for the survey will be recruited from within four‐ core identified test population audiences with deeper segmentation based on gender and age to represent a comprehensive view across all demographics and as aligned to UBR and diversity program goals. We have determined a statistical valid survey sample size is 400 completed surveys for each test population segment. Based on the desired insights to be collected across all demographics, we have designed the survey to include 32 distinct test population segments with a goal to complete 12,800 surveys. Demographics Collection Baseline demographics will also be collected across all survey respondents, which will allow us to conduct deeper qualitative persona and demographic analyses based on specific population groups. Throughout the final analysis, we will be able to filter and triangulate our insights including:  Gender  Sexual Orientation (Straight, LGBTQ, prefer not to say)  Age Grouping  Race / Ethnicity  Location (Full address: street, city, state, zip)  Education Level  HH Income Survey Language We have considered offering the survey in two languages (English and Spanish), but have determined, and through the advice of our platform vendor, the use of English language only will streamline and shorten the analysis phase of the project without impacting the results we will collect. Survey Analysis Final analysis will gather insights collected across all test population groupings with deeper analyses conducted to capture trends and nuances associated with filtered and segmented test population demographic and persona characteristics. Of special note; this survey was conducted online and therefore does not represent population groups without access to a personal computer, or with populations that are not computer proficient. This is a limitation of the online survey vehicle. Test Populations & Survey Counts ‐ (12,800 Competed Surveys) African American (3200) Male (1600) 18‐24 (400) 25‐34 (400) 35‐54 (400) 55+ (400) Female (1600) 18‐24 (400) 25‐34 (400) 35‐54 (400) 55+ (400) Hispanic (3200) Male (1600) 18‐24 (400) 25‐34 (400) 35‐54 (400) 55+ (400) Female (1600) 18‐24 (400) 25‐43 (400) 35‐54 (400) 55+ (400) Asian American (3200) Male (1600) 18‐24 (400) 25‐34 (400) 35‐54 (400) 55+ (400) Female (1600) 18‐24 (400) 25‐34 (400) 35‐54 (400) 55+ (400) Caucasian (3200) Male (1600) 18‐24 (400) 25‐34 (400) 35‐54 (400) 55+ (400) Female (1600) 18‐24 (400) 25‐43 (400) 35‐54 (400) 55+ (400) Objective Test content and creative among core UBR test populations and persona types for personal resonance, appeal, and influence – as well as program understanding to aid in future content development and content marketing directions. SURVEY METHODOLOGY
  • 35. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 35 ANALYSIS PARAMETERS (Fieldwork Report & Filtering)
  • 36. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 36 1483048‐US Survey Start Date: Oct 17, 2017 Survey Close Date: Nov 22, 2017 FOOTNOTES: The starting objective was to complete 12,800 surveys based on pre‐identified demographic target goal thresholds (as represented on the following page). However, over the course of the fieldwork, the survey platform exhausted survey community resources (including third‐party resources) to meet this overall goal within a desired and suitable timeline. This was direct consequence for incorporating a special built‐in survey component (heatmapping) within the design of the survey, which prevented us for serving the survey to mobile‐only consumers.1 Although we did not anticipate the heatmapping component would prevent us for reaching our target threshold goals, we did understand from the outset the survey would not be delivered to mobile devices using this survey component. Furthermore, we did acknowledge at the forefront, the survey results would be somewhat biased insofar there would be a missing general population segment (7% of U.S. adults), which include those individuals who depend on smart mobile devices for Internet access. We did consider this ramification and collectively determined the use of the heatmapping component outweighed the missing population segment within this first survey measurement. Follow‐on surveys (as needed and based on future defined objectives) will take this execution nuance into consideration on a case by case basis. As additional program measurement projects are identified, we can design and conduct separate program surveys with this consideration in mind to gauge and measure added consumer feedback. Of special note: terminate counts were a result of designed pre‐screening and QA/QC conditions. Overall, we did reach 92% of our overall target goal and we have verified the sample sizes for all demographics are statistically valid. 1 Pew Research, April 2015 RESPONDENTS STATUS SUMMARY COUNTS started 34,153 incomplete 14,267 complete 11,817 quota full 0 terminate all 8,057 TERMINATES COUNTS Terminate ‐ ID or Email exists 20 Terminate ‐ time based 907 Terminate 8 ‐ Age ‐ cq1 287 Terminate 10 ‐ Ethnicity ‐ cq2 1,509 Duplicate completes 5 INCIDENCE RATES (*) "Net Effective Incidence" 100.00% "Net Incidence" 100.00% OTHER "Average Interview Duration" 27min 25sec "Median Interview Duration" 18min 11sec FIELDWORK REPORT
  • 37. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 37 Demo Age Target Goal Completed ∆ Delta Difference African‐ American Males age 18‐24 400 201 199 Males age 25‐34 400 278 122 Males age 35‐54 400 366 34 Males age 55+ 400 178 222 Females age 18‐24 400 508 (108) Females age 25‐34 400 553 (153) Females age 35‐54 400 647 (247) Females age 55+ 400 493 (93) Total 3,200 3,224 (24) Demo Age Target Goal Completed ∆ Delta Difference Hispanic‐ Latino Males age 18‐24 400 232 168 Males age 25‐34 400 376 24 Males age 35‐54 400 380 20 Males age 55+ 400 98 302 Females age 18‐24 400 526 (126) Females age 25‐34 400 596 (196) Females age 35‐54 400 578 (178) Females age 55+ 400 189 211 Total 3,200 2,975 225 Demo Age Target Goal Completed ∆ Delta Difference Asian‐ American Males age 18‐24 400 171 229 Males age 25‐34 400 254 146 Males age 35‐54 400 322 78 Males age 55+ 400 110 290 Females age 18‐24 400 407 (7) Females age 25‐34 400 643 (243) Females age 35‐54 400 554 (154) Females age 55+ 400 133 267 Total 3,200 2,594 606 Demo Age Target Goal Completed ∆ Delta Difference Caucasian Males age 18‐24 400 419 (19) Males age 25‐34 400 418 (18) Males age 35‐54 400 432 (32) Males age 55+ 400 443 (43) Females age 18‐24 400 400 0 Females age 25‐34 400 411 (11) Females age 35‐54 400 407 (7) Females age 55+ 400 421 (21) Total 3,200 3,351 (151) 3,223 2,846 2,392 3,350 African‐American Hispanic‐Latino Asian‐American Caucasian‐American FINAL QUOTA COUNTS 28% 24% 20% 28%
  • 38. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 38 Weighting + Balancing The analysis uses a standard analytics weighting methodology to equally balance respondent responses to original target population thresholds defined in the original survey design. This was done to more equitably analyze creative preferences from unequal gender and age responses found in each race/ethnicity sub‐population across gender and age as a result of final quota survey counts. RIM (Random Iterative Method) weighting is a standard methodology in market research used when the results collected in a survey do not match the target population. The main idea is that rather than each variable in the data contributing equally to the final result, some data is artificially adjusted to contribute more than others. This approach has been used to provide greater and more accurate insights when analyzing preferences by percentages based on gender and age. Filtering Within the analysis and for select survey questions, filtering has been applied to gain greater insights leveraging demographics collected. Filters (in singular or combination) that were available for data triangulation include:  Age  Gender  Sexual Orientation  Race / Ethnicity  Education  HHI  State + National Regions ANALYSIS CONSIDERATIONS Heatmapping The analysis uses heatmapping to gauge website content appeal and resonance. Respondents were asked to review a number of All Of Us website pages and then read and click on content elements they would have interest if they were to visit the website on their own. This was done as an aid to help survey respondents understand the program and its benefit and to test ease of program comprehension.
  • 39. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 39 DEMOGRAPHICS (Data Collection: sample size: 11,811)
  • 40. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 40 Self ID Q:1 – Demographic & Pre-Screening Questions (sample size: 11,811) What best describes your age group? (select one answer)  Less than 18 (terminate survey)  18-24  25-34  35-54  55+ Objective: A series of questions were designed to have respondents provide personal demographic data to align the survey to target thresholds as well as to capture additional insights to be used in the overall analysis. 23% 29% 31% 17% 18‐24 25‐34 35‐54 55+
  • 41. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 41 What best describes your race/ethnicity? (select one answer)  African American  Hispanic  Asian American  Caucasian  Two or more races/ethnicities (terminate survey)  Prefer not to answer (terminate survey) Self ID Q:2 – Demographic & Pre-Screening Questions (sample size 11,811) 27% 24% 20% 28% African‐American Hispanic‐Latino Asian‐American Caucasian
  • 42. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 42 Self ID Q:3 – Demographic & Pre-Screening Questions (sample size 11,811) To which gender identity do you most identify? (select one answer)  Male  Female Male 38% Female 62%
  • 43. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 43 What best describes your sexual orientation? (select one answer)  Heterosexual (“straight”)  LGBTQ  Prefer not to answer Self ID Q:4 – Demographic & Pre-Screening Questions (sample size 11,811)
  • 44. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 44 What best describes your sexual orientation? (select one answer)  Heterosexual (“straight”)  LGBTQ  Prefer not to answer Self ID Q:4 – Demographic & Pre-Screening Questions (sample size 1,711) Objective: A hidden tracking mechanism to identify a count for Caucasian LGBTQ males to verify UBR diversity within the Caucasian sub‐population. Caucasian, White Males
  • 45. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 45 What is the highest level of schooling that you have completed? (select one answer)  Completed some high school  High school graduate  Completed some college  College degree  Completed some postgraduate  Master’s degree  Doctorate, law or professional degree Self ID Q:5 – Demographic & Pre-Screening Questions (sample size 11,811) 2% 18% 26% 34% 4% 12% 3% Completed some high school High school graduate Completed some college College degree Completed some postgraduate Master's degree Doctorate, law or professional degree
  • 46. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 46 What is your annual household income before taxes? (select one answer)  Less than $25,000  $25,000−$49,999  $50,000−$74,999  $75,000−$99,999  $100,000−$124,999  $125,000 or more  Prefer not to answer Self ID Q:6 – Demographic & Pre-Screening Questions (sample size 11,811) 18% 23% 20% 14% 8% 8% 5% Less than $25,000 $25,000‐‐$49,999 $50,000‐‐$74,999 $75,000‐‐$99,999 $100,000‐‐$124,000 $125,000 or more Prefer not to answer 0.00% 5.00% 10.00% 15.00% 20.00% 25.00%
  • 47. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 47 Self ID Q:7 – Demographic & Pre-Screening Questions (sample size 11,811) Which state do you live in? (select one answer)  Pull down option menu (all 50 states + District of Columbia) State Percent Count Alabama 1.36% 161 Alaska 0.08% 9 Arizona 1.98% 234 Arkansas 0.65% 77 California 15.15% 1,789 Colorado 1.52% 179 Connecticut 1.05% 124 Delaware 0.4% 47 District of Columbia 0.39% 46 Florida 8.2% 968 Georgia 3.65% 431 Hawaii 0.73% 86 Iowa 0.44% 52 Idaho 0.27% 32 Illinois 4.22% 499 Indiana 1.41% 167 Kansas 0.61% 72 Kentucky 1.12% 132 Louisiana 1.22% 144 Maine 0.23% 27 Maryland 2.17% 256 Massachusetts 1.79% 211 Michigan 2.63% 311 Minnesota 1.08% 128 Mississippi 0.69% 82 Missouri 1.36% 161 State Percent Count Montana 0.13% 15 Nebraska 0.3% 36 Nevada 1.03% 122 New Hampshire 0.2% 24 New Jersey 3.19% 377 New Mexico 0.52% 61 New York 8.31% 981 North Carolina 3.64% 430 North Dakota 0.11% 13 Ohio 3.24% 383 Oklahoma 0.69% 81 Oregon 0.91% 108 Pennsylvania 3.91% 462 Rhode Island 0.29% 34 South Carolina 1.63% 193 South Dakota 0.12% 14 Tennessee 1.67% 197 Texas 8.42% 995 Utah 0.58% 68 Vermont 0.14% 17 Virginia 2.79% 330 Washington 1.97% 233 West Virginia 0.37% 44 Wisconsin 1.35% 159 Wyoming 0.08% 9
  • 48. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 48 Self ID Q:7 – Demographic & Pre-Screening Questions (sample size 11,811) Which state do you live in? sample size representation validation: Survey quota counts vs. National population densities Map based on Longitude (generated) and Latitude (generated). Size shows sum of Count. Details are shown for State. Map coloring shows 2018 Caucasian Population by State.
  • 49. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 49 CREATIVE TESTING (Section 1: sample size: 11,811) gender + age
  • 50. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 50 Section 1 / Survey Question Q:1A: Persona Self-Identification Classification Which ad makes you want to click on it to learn more about the program? Objective: Gather insights into respondent core motivations by testing creative for appeal and resonance. gender + age
  • 51. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 51 Objective: A series of questions were designed to test message (motivation) and visual cues aligned by race/ethnicity to have respondents self‐identify themselves into 1 of 5 possible persona classifications with added insights into personal creative design composition appeal. The questions were structured to have a respondent self‐identify their dominant and underlying motivations and values matched to a specific persona group to better gauge personal appeal and resonance for content which would be tested (developed specifically for persona appeal) later in the survey. Persona Group Classification was based on a respondent choosing a coded matched response for two SELF‐IDENTIFICATION questions. Logic Check: if a respondent was not matched to a persona type by selecting “none” for each of the two self‐identification questions … a respondent was then segmented into a special [general population] test group. Section 1 / Survey Questions 1 - 2: Persona Self-Identification Classification Persona 1 Edgar Ready to Go Persona 2 Tallulah Determined Persona 3 Chris Curious But Distracted Persona 4 Lorraine Community Centric Persona 5 Miguel Suspicious But Positive Legend: Altruism (ALT) Finding Cures (EC) Community & Family (COMM) Innovation (INN) What’s in It for Me (ME) Right the Wrongs (RIGHT) Example: If someone selects the Altruism message for both Q1 and Q2, they would receive the Edgar persona creative. If someone selects the Altruism message for Q1 and Finding Cures message for Q2, they would receive the Tallulah creative. If a respondent selects none for each of the two self‐identification questions, the respondent was then grouped into a general population test segment. Combination Possibilities for Persona Mapping
  • 52. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 52 Which ad makes you want to click on it to learn more about the program?  A healthier future, Pass it on.  Our health is our wealth.  An inheritance they can actually use.  One size does not fit at all.  Power to the patient.  One-of-a-kind is kind of our thing.  None, what don’t you like about the ads? Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 11,811) − − − − − randomized − − − − − 14% 17% 15% 13% 15% 26% altruism finding cures community, tribe, legacy, family innovation, new research empower, control, righting wrongs what’s in it for me r a n k b y p r e f e r e n c e 975 0 200 400 600 800 1000 NONE : Respondents who did not like any choice. 8.3% of survey sub‐population audience African‐American Creative set represented: served to respondents who self‐identified themselves as African‐American
  • 53. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 53 Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 10,758) Which ad makes you want to click on it to learn more about the program? MOTIVATION MATCH Sub-Population Review by Gender + Age RANK Preference Gender Age Group Rank Percent Male Female 18‐24 25‐34 35‐54 55+ 1 26% 23% 29% 38% 29% 23% 13% 2 17% 16% 18% 12% 16% 17% 23% 3 15% 17% 13% 11% 16% 18% 15% 4 15% 15% 14% 14% 16% 15% 15% 5 14% 18% 11% 13% 13% 13% 18% 6 13% 11% 15% 12% 11% 15% 15% ‐ 100% 100% 100% 100% 100% 100% 100% * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. r a n k b y p r e f e r e n c e altruism finding cures community, tribe, legacy, family innovation, new research empower, control, righting wrongs what’s in it for me Observations & Findings for A/B Testing:  Rank #1 ‐ What’s in it for me Ad choice was inclusively an illustration. Skews younger and with females over males. A false/positive may exist from image bias over alternative photo‐only choices.  Rank #2 – Finding Cures Ad choice used exclusively single person photography. Gender and age self‐identification may exist from visuals. Appeal greatest with 55+ age group.  Rank #3 ‐ Community, Tribe, Legacy, Family Ad choice used group photos. When larger groups of people were used showing richer diversity (identified trend), the Ads performed better. Skews male and older.  Rank #4 – Empowerment, Control, Righting Wrongs Ad choice used exclusively single person photography. Gender and age self‐identification may have been present in some sub‐populations from the visuals.  Rank #5 – Altruism Ad choice used exclusively a male headshot. Greatest appeal with 55+ age segment. Gender self‐identification via image may have been present across all sub‐populations.  Rank #6 – Innovation, New Research Ad choice used exclusively single person photography. Appeal with females. Skews older with greatest appeal with 35‐54 and 55+ age segments.
  • 54. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 54 Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 2,805) Which ad makes you want to click on it to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 15% 22% 12% 16% MOTIVATION MATCH AD Preference Review by Gender + Age 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 10% 12% 6% 6% Observations & Findings for A/B Testing:  The What’s in it for me headline motivation message ranks 1ST overall in preference (26% of total survey respondents) across all test populations. Skews younger with females over males across all age groups. Illustration bias may be present in results. RANK 26.07% Total Survey Population * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Micro‐Population Demographics 44% 56% Male Female
  • 55. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 55 Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,818) Which ad makes you want to click on it to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 7% 11% 11% 13% MOTIVATION MATCH AD Preference Review by Gender + Age 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 12% 13% 16% 17% Observations & Findings for A/B Testing:  The Finding Cures headline motivation message ranks 2ND overall in preference (17% of total survey respondents) as compared against the AGGREGATE test population. Females prefer the ad over male counterparts by slight margins. Gender image self identification may be present in results. 16.90% Total Survey Population * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Micro‐Population Demographics RANK 46% 54% Male Female
  • 56. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 56 Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,617) Which ad makes you want to click on it to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 9% 8% 15% 12% MOTIVATION MATCH AD Preference Review by Gender + Age 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 19% 12% 14% 10% Observations & Findings for A/B Testing:  The Community, Tribe, Legacy, Family headline motivation message ranks 3RD overall in preference (15% of total survey respondents) measured against the AGGREGATE test population. Male gender preference may exist. Overall, skews in the middle with minor nuances within the outlier peripheral age segments. 15.03% Total Survey Population * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Micro‐Population Demographics RANK 57% 43% Male Female
  • 57. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 57 Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,605) Which ad makes you want to click on it to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 12% 12% 15% 13% MOTIVATION MATCH AD Preference Review by Gender + Age 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 14% 11% 11% 13% Observations & Findings for A/B Testing:  The Empowerment and Control, Righting Wrongs headline motivation message ranks 4TH overall in preference (15% of total survey respondents) with the AGGREGATE test population. Modest performance overall across gender and age without significant identifiable nuances. 14.92% Total Survey Population * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Micro‐Population Demographics RANK 51% 49% Male Female
  • 58. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 58 Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,519) Which ad makes you want to click on it to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 14% 9% 15% 8% MOTIVATION MATCH AD Preference Review by Gender + Age 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 16% 8% 18% 13% Observations & Findings for A/B Testing:  The Altruism headline motivation message ranks 5TH overall in preference (14% of total survey respondents) with the AGGREGATE test population. Older males especially, and males in general prefer the ad over female counterparts. Gender image self identification may exist in the results. 14.12% Total Survey Population * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Micro‐Population Demographics RANK 62% 38% Male Female
  • 59. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 59 Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 1,394) Which ad makes you want to click on it to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 10% 14% 8% 12% MOTIVATION MATCH AD Preference Review by Gender + Age 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 11% 17% 11% 16% Observations & Findings for A/B Testing:  The Innovation, New Research headline motivation message ranks 6TH overall in preference (13% of total survey respondents) with the AGGREGATE test population. Females clearly prefer the ad over male counterparts by large percentages. Gender + message self identification may exist. 12.96% Total Survey Population * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Micro‐Population Demographics RANK 41% 59% Male Female
  • 60. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 60 Observations & Findings for A/B Testing:  Identified Trend > Ad compositions and photos tested may be too generic and similar.  Identified Trend > May lack better defined personal self‐identification appeal at greater scale (race, gender, age) matched to headline.  Ad compositions using creative tags (headlines) alone without body copy may not be adequate for click‐thru. May need more direct, less ambiguous instantaneous message takeaways with a quick and clear program explanation.  Identified Trend > 55+ age group may require more personalized, self‐identification images and messages. NONE Review by Recurring Common Theme Which ad makes you want to click on it to learn more about the program?  None, what don’t you like about the ads? Boring Messaging Generic Photo compositi on Lacks appeal, doesn’t create interest Missing diversity Photo doesn’t match headline 81 23 46 21 293 18 15 Doesn't speak to me Not enough info to under‐ stand program No interest All look the same Not relevant General dislike Other 26 201 101 15 38 43 50 112 80 111 240 103 106 129 164 18‐24 25‐34 35‐54 55+ Male Female Linear (Male) Linear (Female) Sample Count Sample Percentage 975 8.3% Common Themes for ‘What don’t you like about the Ads? Section 1 / Survey Question Q:1A: Persona Self-Identification Classification (sample size 10,758) Which ad makes you want to click on it to learn more about the program?
  • 61. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 61 What about the ad do you like? Section 1 / Survey Question Q:1B: Persona Self-Identification Classification Objective: Gather additional insights into respondent preferences. gender + age
  • 62. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 62 What about the ad do you like? Observations & Findings for A/B testing:  Identified Trend > Younger generations may gravitate to more to images: older generations headlines.  Identified Trend > Males may be more inclined to gravitate to images with females leaning towards headlines.  Identified Trend > Of special note, 55+ age group significantly appeals to headlines (tags). Section 1 / Survey Question Q:1B: Persona Self-Identification Classification (sample size 10,758) COMPONENTS Preference Review by Gender + Age What about the ad do you like?  I liked the photo/image.  I liked the headline (the larger text).  I liked both the photo/image and headline. (Re‐Present Respondent’s Image Choice from Previous Question) 27% 35% 38% photo/image headline both Total Count 39% 37% 24% 37% 34% 30% both headline photo/image Gender Preference Female Male 15% 20% 25% 30% 35% 40% 45% 50% Age Preference 55+ 35‐54 25‐34 18‐24 11% 46% 43% 11% 48% 41% 20% 39% 40% 29% 34% 37% 30% 34% 36% 39% 25% 35% 31% 32% 37% 39% 27% 34% photo/image headline both Female + 55+ Male + 55+ Female + 35‐54 Male + 35‐54 Female + 25‐34 Male + 25‐34 Female + 18‐24 Male + 18‐24
  • 63. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 63 What about the ad do you like? r a n k b y p r e f e r e n c e altruism finding cures community, tribe, legacy, family innovation, new research empower, control, righting wrongs what’s in it for me AD ID# 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 1 34% 42% 25% 33% 20% 25% 13% 13% ABSTRACT ILLUSTRATION > PREFERENCE: MOST APPEALING ACROSS ALL SEGMENTS BEFORE 55+. POTENTIAL ILLUSTRATION DIFFERENTIATION BIAS OVER PRESENTED PHOTO ALTERNATIVES. 2 11% 14% 14% 17% 15% 18% 22% 24% YOUNGER FEMALE HEADHSOT > PREFERENCE: MODEST CONSISTENCY ACROSS GENDER + AGE. GENDER BIAS WITH FEMALES. SLIGHT UPTICK WITH AGE FOR BOTH GENDERS. 3 12% 9% 18% 14% 21% 15% 17% 13% FULL BODY GROUP PHOTOS > PREFERENCE: GENDER BIAS WITH MALES. 4 16% 13% 17% 14% 15% 14% 14% 16% ENVIRONMENTAL PORTRAIT > PREFERENCE: MODEST CONSISTENCY ACROSS GENDER AND AGE. MALE GENDER BIAS BEFORE 55+ 5 17% 9% 17% 9% 17% 9% 21% 15% OLDER MALE HEADSHOT > PREFERENCE: OLDER MALES OVER YOUTH. GENDER BIAS WITH MALES. 6 11% 13% 9% 12% 11% 18% 13% 18% MIDDLE AGE FEMALE HEADHSOT > PREFERENCE: FEMALES WITH UPTICK WITH AGE. POTENTIAL MESSAGE IMPACT WITH AGING FEMALE GENERATIONS. 100% 100% 100% 100% 100% 100% 100% 100% Observations & Findings for A/B Testing:  Identified Trend > Frequent use of illustrations may stimulate enhanced performance over photography alone.  Identified Trend > Gender self‐identification appeal within imagery may frequently influence appeal. Identified Trend > Age self‐identification appeal within imagery may also frequently influence appeal. COMPOSITION Preference Review by Gender + Age Section 1 / Survey Question Q:1B: Persona Self-Identification Classification (sample size 10,758) * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic.
  • 64. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 64 29% 18% 13% 14% 11% 15% 23% 16% 17% 15% 18% 11% One‐of‐a‐kind is kind of our thing. Our health is our wealth. An inheritance they can actually use. Power to the patient. A healthier future, Pass it on. One size does not fit at all. Female Male r a n k b y p r e f e r e n c e altruism finding cures community, tribe, legacy, family innovation, new research empower, control, righting wrongs what’s in it for me Observations & Findings for A/B Testing:  Headline (tag) impact may align to current personal life stage (age + gender values) relevance. MESSAGE Preference Review by Gender + Age 13% 23% 15% 15% 18% 15% 23% 17% 18% 15% 13% 15% 29% 16% 16% 16% 13% 11% 38% 12% 11% 14% 13% 12% One‐of‐a‐kind is kind of our thing. Our health is our wealth. An inheritance they can actually use. Power to the patient. A healthier future, Pass it on. One size does not fit at all. 55+ 35‐54 25‐34 18‐24 Section 1 / Survey Question Q:1B: Persona Self-Identification Classification (sample size 10,758) What about the ad do you like?
  • 65. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 65 Which poster makes you want to learn more about the program? Section 1 / Survey Question Q:2A: Persona Self-Identification Classification Objective: Gather insights into respondent core motivations by testing a second set of creative for appeal and resonance. gender + age
  • 66. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 66 r a n k b y p r e f e r e n c e Which poster makes you want to learn more about the program?  We can win the game as soon as we all get in it.  Fighting disease just got one million times easier.  Legacies are just one you can spend.  The next big thing in health is here.  Not all research is created equal (that’s why we’re here).  What’s good for you is good for us.  None, what don’t you like about the posters? Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 11,811) − − − − − randomized − − − − − 10% 17% 13% 13% 28% 20% altruism finding cures community, tribe, legacy, family innovation, new research empower, control, righting wrongs what’s in it for me 943 0 200 400 600 800 1000 NONE : Respondents who did not like any choice. 8.0% of survey sub‐population audience Hispanic‐Latino Creative set represented: served to respondents who self‐identified themselves as Hispanic‐Latino We can win the game as soon as we all get in it. Fighting disease just got one million times easier. Legacies are just one you can spend. The next big thing in health is here. Not all research is created equal (that’s why we’re here). What’s good for you is good for us.
  • 67. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 67 We can win the game as soon as we all get in it. Fighting disease just got one million times easier. Legacies are just one you can spend. The next big thing in health is here. Not all research is created equal (that’s why we’re here). What’s good for you is good for us. Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 10,868) Which ad makes you want to click on it to learn more about the program? MOTIVATION MATCH Sub-Population Review by Gender + Age RANK Preference Gender Age Group Rank Percent Male Female 18‐24 25‐34 35‐54 55+ 1 28% 26% 29% 35% 29% 25% 20% 2 20% 19% 20% 16% 22% 23% 18% 3 17% 15% 18% 16% 15% 16% 19% 4 13% 15% 11% 10% 10% 13% 21% 5 13% 13% 13% 11% 14% 14% 14% 6 10% 11% 9% 12% 10% 9% 9% ‐ 100% 100% 100% 100% 100% 100% 100% * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. r a n k b y p r e f e r e n c e altruism finding cures community, tribe, legacy, family innovation, new research empower, control, righting wrongs what’s in it for me Observations & Findings for A/B Testing:  Rank #1 ‐ Empowerment, Control, Righting Wrongs Poster choice was inclusively an illustration. Skews younger with female preference over males. A false/positive may exist from image bias over alternative photo‐only choices.  Rank #2 – What’s in it for me Poster choice used group photos. When larger groups of people were used showing richer diversity (identified trend), the Posters performed better. Skews in the middle.  Rank #3 ‐ Finding Cures Poster choice used exclusively single person photography. Skews female and older.  Rank #4 – Community, Tribe, Legacy, Family Poster choice used exclusively single person photography. Gender and age self‐identification may have been present. Skews male and older.  Rank #5 – Innovation, New Research Poster choice used male headshots and group shots. Modest preference across ages and genders.  Rank #6 – Altruism Poster choice used exclusively single person photography. Skews male and younger.
  • 68. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 68 Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for us all. Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 2,981) Which poster makes you want to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 15% 18% 12% 15% 11% 12% 8% 9% MOTIVATION MATCH Poster Preference Review by Gender + Age Observations & Findings for A/B Testing:  The Empowerment and Control, Righting Wrongs headline motivation message ranks 1ST overall in preference (28% of total survey respondents) with the AGGREGATE test population. Females prefer the poster over male counterparts by large percentages. 27.59% Total Survey Population * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. Micro‐Population Demographics 46% 54% Male Female RANK
  • 69. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 69 Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for us all. Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 2,127) Which poster makes you want to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 10% 11% 13% 15% 16% 14% 10% 11% MOTIVATION MATCH Poster Preference Review by Gender + Age Observations & Findings for A/B Testing:  The What’s in it for me headline motivation message ranks 2ND overall in preference (20% of total survey respondents) with the AGGREGATE test population. Preference skews in the middle age groups across both genders. * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. 19.69% Total Survey Population Micro‐Population Demographics RANK 49% 51% Male Female
  • 70. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 70 Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for us all. Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 1,785) Which poster makes you want to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 11% 14% 11% 12% 12% 13% 12% 15% MOTIVATION MATCH Poster Preference Review by Gender + Age Observations & Findings for A/B Testing:  The Finding Cures headline motivation message ranks 3RD overall in preference (17% of total survey respondents) with the AGGREGATE test population. Females prefer the poster over male counterparts, which may align to message appeal. * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. 16.52% Total Survey Population Micro‐Population Demographics RANK 46% 54% Male Female
  • 71. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 71 Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for us all. Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 1,433) Which poster makes you want to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 10% 9% 11% 9% 14% 10% 22% 15% MOTIVATION MATCH Poster Preference Review by Gender + Age Observations & Findings for A/B Testing:  The Innovation, New Research headline motivation message ranks 4TH overall in preference (13% of total survey respondents) with the AGGREGATE test population. Preference skews older and may align with age for message appeal. * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. 13.26% Total Survey Population Micro‐Population Demographics RANK 57% 43% Male Female
  • 72. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 72 Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for us all. Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 1,419) Which poster makes you want to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 10% 11% 14% 13% 16% 12% 11% 14% MOTIVATION MATCH Poster Preference Review by Gender + Age Observations & Findings for A/B Testing:  The Community, Tribe, Legacy, Family headline motivation message ranks 5TH overall in preference (13% of total survey respondents) with the AGGREGATE test population. Skews in the middle with modest preference across all genders and ages. * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. 13.13% Total Survey Population Micro‐Population Demographics RANK 51% 49% Male Female
  • 73. AoU Program & Content UBR Population Testing Analysis ‐ January 2017 Page 73 Body Copy: The more researchers know about what makes each of us unique, the more tailored our health care can become. Join a research effort with one million people nationwide to create a healthier future for us all. Section 1 / Survey Question Q:2A: Persona Self-Identification Classification (sample size 1,060) Which poster makes you want to learn more about the program? 18‐24 MALE 18‐24 FEMALE 25‐34 MALE 25‐34 FEMALE 35‐54 MALE 35‐54 FEMALE 55+ MALE 55+ FEMALE 15% 17% 16% 9% 13% 10% 12% 8% MOTIVATION MATCH Poster Preference Review by Gender + Age Observations & Findings for A/B Testing:  The Altruism headline motivation message ranks 6TH overall in preference (10% of total survey respondents) with the AGGREGATE test population. Preference skews younger. Also skews generally with males across all ages which may align with sports analogy message appeal. * Highlight denotes optimal sub‐population segments. Red denotes highest preference in the sub‐population demographic. 9.81% Total Survey Population Micro‐Population Demographics 56% 44% Male Female RANK