1. All of Us, the All of Us logo, and "The Future of Health Begins with You"
are service marks of the U.S. Department of Health and Human Services.
DOMO
Visual Dashboard Reporting
Getting Started User Guide
November 2018
2. Welcome
2
Welcome to the DOMO All of Us Research Program visual reporting dashboard.
Within this dashboard, you will find marketing performance attribution for the program's HPO partners. Your individual HPO
organization will have its own separate page for you and your your colleagues to monitor your local campaign activity, as well as to
monitor the national campaign support provided for your HPO region.
Within this first build cycle, you will find attribution performance for the National Media Campaign support underway.
In the coming months, we are planning to work with each of you to begin tagging your local campaigns for deeper tracking
capabilities, which will allow us to integrate all (if not most) of your own marketing campaign activity (advertising, email, social,
offline, et al) into your organizational dashboard page so that you have a real-time (or near-real-time) central location to monitor and
share performance insights across your organization.
Of note, this is a Consortium-wide public space across all HPO partners. Although you will have access to your own marketing
performance dashboard page, you will also have access to peer HPO organizational pages as well.
We do this for a policy of transparency that allows each Consortium and HPO to benchmark their own marketing activities against
peer efforts; this helps you and your team better understand how your Consortium or HPO organization is performing as part of the
larger All of Us Research Program.
3. Contact Resources
3
Direct contact resources are listed below. Please use them at any time when you need assistance with the dashboard
or have questions.
In the coming months, we will schedule a personal one-on-one training session for you and your team to help you better
get acquainted with the dashboard. In the interim, to get you started, we have provided the following DOMO Getting
Started User Guide.
If at any time you have questions, would like to make recommendations for the design and use of this platform, need
assistance or help, or have a special need, please feel free to reach out to us. We are here to help. Keep these
contacts handy in times of need.
For any special requests, please contact:
Brad Tolley (brad@wondros.com)
For any need or questions on any
marketing performance views, please contact:
Daniel McKean (daniel@wondros.com)
Trung Nguyen (trung@wondros.com)
And in closing, thank you for being part of the All of Us Research Program. We are on the path to being One Million
Strong and you are a vital part of the program's growing success.
4. Content
4
• Preface
• National Media Support
• Dashboard Design & Architecture
• What Initial Insights Are Available
• Getting Started
• Rules of Engagement & Logins
• User Navigation & Quick Tips
1. Viewing Cards
2. User Interface
3. Filtering Views
4. Interactive Charts
5. Drill Paths
6. Data Insights
7. Chat Collaboration
• Reference Glossary
• Feedback & Request Form
5. Preface
5
The National Media Campaign has been active since launch supporting a holistic national
effort across both national and local HPO regions and markets.
The first media buy in support of the HPOs ran in staged phases from May 7 through July
31, 2018. Due to the phased rollout, individual campaigns start/end dates may be different
and should be noted when reviewing the results.
All local HPO Campaigns were reactivated on September 1 and continue as of this posting.
In support of local media buying and the HPOs, the media planning was structured by us
working directly with each HPO to collect ZIP Codes from each Consortium and their
individual HPO medical centers within their defined regional geographies.
This list of ZIP Codes we collected was (and has been) used as the single consideration to
target and place the digital advertising throughout the duration of the early media campaigns
without any other targeting considerations.
Initial budgets were established for each Consortium and region based on population
densities, and further broken down as a reserved percentage from the overall allocated
national media campaign budget.
As budgets were applied for specific HPO regions, population densities determined how
much budget was reserved for each Consortium.
As a key note, some Consortiums received more budget than others based on this
allocation model.
Overall, our budget-planning objective was based on pre-planning estimations for delivering
the widest possible national reach and influence for the program.
As the Campaign is further executed, we will begin to apply digital advertising optimization
techniques to adjust budgets aligned with the most efficient spends and results.
Depending on your regional population influence and the resulting program conversions,
this may increase or decrease specific local budgets in support of the national objectives
and efforts.
When reviewing the National Media Campaign performance, please keep in mind how the
campaign was planned and structured. What follows is a quick explanation and overview for
how the Campaign was planned in support for the HPO Consortiums.
7. Design & Architecture (Build Phase #1)
7
Insights available within the dashboard design include the following:
National Media Campaign Performance x HPO Consortium
(Filters Available: Date, HPO, Channel)
INSIGHTS
VIEWS
(Reported Metrics)
Impressions
to Date
Impressions
x Month
Clicks
to Date
Click-thru-Rate
(CTR)
Conversions
to Date
Conversion Rate or
Click-to-Conversion
Rate (CVR)
Cost per Acquisition
(CPA)
Quality
Ratio
Performance Table
(Geo-Targeting)
Performance Table
(Conversions + CPA)
CLICKABLE
DEEPER VIEWS
(Drill Paths Available)
Drill Path
x Channel Placement
(Display or Facebook)
Drill Path
x Channel Placement +
Drill Path x Week + Day
Drill Path
x Channel Placement
(Display or Facebook)
Drill Path x Channel +
Month
Drill Path
x Channel Placement
(Display or Facebook)
Drill Path x Channel +
Month
Drill Path
x Channel Placement
(Display or Facebook)
Drill Path x Channel +
Month
Drill Path
x Channel Placement
(Display or Facebook)
Drill Path x Channel +
Month
Drill Path
x Channel Placement
(Display or Facebook)
Drill Path x Channel +
Month
Drill Path
x Channel Placement
(Display or Facebook)
Drill Path x Channel +
Month
Dimensions:
Metro, HPO
Metrics:
Impressions, clicks,
CTR, accounts created,
consent completions,
quality ratio, CVR
Dimensions:
Metro, HPO
Metrics:
Account +
Consent conversions,
quality ratio,
CPA
REFERENCE GLOSSARY ON PAGE 26
9. Getting Started
9
As the next step, we encourage you to reference, download, and/or save this Getting Started User
Guide tutorial for learning how to navigate and use the platform. We will try to keep the design and
use of the platform as simple as possible.
There are essentially seven (7) core user tips that will allow you to quickly gain the benefit of the
platform. That's it. Understand these seven fundamental tips, and you will have the skills to navigate
and use the platform while reaping all the benefits we hope it will deliver to you and your HPO
organization.
A quick note about terminology. All visual insights are contained in what we call “Cards.” A card may
be a chart, gauge, map, text, or any other graphical visual element to convey marketing performance.
To help you with terminology, we have provided a Reference Glossary at the end of this document to
explain any terms you may not be familiar and which we may use throughout this document or which
you may encounter with the use of the DOMO All of Us Research Program dashboard.
10. Rules of Engagement
10
Of special note: the use of the DOMO dashboard is a shared resource. We have assigned three master
logins for use and sharing across the HPO Consortium Partners. Over time, we will evaluate the use of
the platform by all of the HPO Partners and assess whether more logins are required.
If it is deemed we need more logins in the future due to how frequently the dashboard is used, we will
secure additional logins to make sure the dashboard remains a value-added destination to gather and
review your marketing insights.
In the interim, if you attempt to log in but find an assigned login is busy, please be patient for one of your
peers to exit the platform. And on that note, please be courteous to other users. We do encourage all
users to efficiently use the platform and log out when not in use.
If you do find an extensive delay for access due to assigned logins being in use, you can reach out to us
and we will try to help expedite your login requirement.
11. Dashboard Logins
11
As previously mentioned, we are rolling out the All of Us marketing dashboard with three (3) general assigned logins for the
Consortiums and their HPO medical centers.
These logins should be used exclusively for the purpose of reviewing All of Us marketing activities and should not be shared
with anyone outside of your organization. It should further be noted that any information contained within the dashboard is for
official All of Us program use and cannot be shared with anyone who is not officially affiliated with the program.
Please feel free to use any one of the following three logins when you have a need to review program marketing performance.
If a login is already in use and it does not permit you access to the dashboard, try another login. If all three logins are in use,
please be patient and revisit the dashboard later in the day. If you continue to experience problems, you may reach out to us
as provided and we will review the situation to find a resolution.
The three available logins are listed below:
Username Password
HPO Partner 1 (email TBD) TBD
HPO Partner 2 (email TBD) TBD
HPO Partner 2 (email TBD) TBD
13. User Navigation & Quick Tips
13
DOMO GETTING STARTED QUICK TIPS
#1 Viewing Cards
CLICK on any visual graph or chart (card) to expand
images and/or visual views.
14. User Navigation & Quick Tips
14
DOMO GETTING STARTED QUICK TIPS
#2 User Interface
NAVIGATE CARDS with an understanding
of the basic user interface layout.
15. User Navigation & Quick Tips
15
DOMO GETTING STARTED QUICK TIPS
#3 Filtering Views
FILTER visual graphs (cards) by clicking on the available filters located
on the right side of each visual view.
(Filters may differ by card, but common filters include date, campaign
target, and campaign channel. Please note, some cards may not have
filters.)
16. User Navigation & Quick Tips
16
DOMO GETTING STARTED QUICK TIPS
#3 Filtering Views (Cont’d)
If filters are available and are not visible, click on the farthest right
icon on the Nav Bar located above the graphical card to access the
filters.
17. User Navigation & Quick Tips
17
DOMO GETTING STARTED QUICK TIPS
#4 Interactive Charts
HOVERING YOUR MOUSE over graph and chart elements, including the
legend if available, will change the graphical view and, as applicable, reveal
chart plot numbers.
In the chart shown on this slide, hovering the cursor on the Legend and on
Display isolates Display Impressions in the graphical view and reveals the
Display Impressions counts by month. (This can also be done by hovering
the mouse over any of the graphical chart elements.)
18. User Navigation & Quick Tips
18
DOMO GETTING STARTED QUICK TIPS
#5 Drill Paths
YOU CAN SEE DEEPER VISUAL VIEWS by clicking on different clickable
points in the graph or chart you are viewing. Where applicable, this will reveal
new graphs and/or cards.
The drill path is exactly as it sounds. Where we have implemented it, you can
gain added deeper insights on each new card presented.
19. User Navigation & Quick Tips
19
DOMO GETTING STARTED QUICK TIPS
#5 Drill Paths (Cont’d)
As an example, the drill path for the Impressions x Month card is as follows:
Therefore, upon clicking on the main Impressions x Month visual card, a new card—
Impressions x Week—will appear. This linear path approach is designed to provide
you with deeper insights depending on each metric and the data being plotted.
The drill down paths have all been designed in a logical linear sequence to give you
as much detail as you may need for greater insights and information (as desired),
and which are specifically relevant to the initial card you were reviewing.
As you click into deeper drill paths, the new graphical views may represent the
metric view by time period (e.g., month, week, day), or by any other defined filter
where we feel it may add value to your performance review.
Reference the Dashboard Design & Architecture page presented earlier in this
document for a ready reference to the drill paths setup.
20. User Navigation & Quick Tips
20
DOMO GETTING STARTED QUICK TIPS
#5 Drill Paths (Cont’d)
As a user tip, you may click on unique graphical elements within a chart or
card (as represented with the cross-hair symbols).
The new view delivered will represent only the selected filtered dimension
clicked (e.g,. a specific dimension within the plotted graph, such as Display
Performance).
Of note, many clickable locations on chart views are located on the x-axis
usually representing the dateline. A click on the dateline x-axis will provide
a monthly view for the specific month clicked in greater detail.
You will know there is a deeper clickable drill path available for your review
by moving your mouse cursor around on the card you are viewing, and
when your mouse icon changes into its clickable icon image form.
21. User Navigation & Quick Tips
21
DOMO GETTING STARTED QUICK TIPS
#5 Drill Paths (Cont’d)
For gauges, text cards, or other non-plotted chart-performance data
images, you may click anywhere on the card where the mouse icon
changes into its clickable icon image form.
Give it a try. With a little experimentation, you will quickly become an expert
clicking into deeper views.
22. User Navigation & Quick Tips
22
DOMO GETTING STARTED QUICK TIPS
#6 Data Insights
AUTOMATED INSIGHTS are available for quick review based on data
points captured within the master dataset. Feel free to click into the
Insights for added informational value.
The Insights tab is located next to the Filters tab. If Insights for the card or
chart view is available and not visible, click on the farthest right icon on the
Nav Bar located above the graphical view in the card to access the
Insights.
Not all cards will have Insights. The DOMO platform Insights feature is in
beta and may not always provide value-added information. Use at your
own discretion and feel free to give a thumbs up or down on the info
provided.
23. User Navigation & Quick Tips
23
DOMO GETTING STARTED QUICK TIPS
#7 Chat Collaboration
YOU CAN COLLABORATE with us and members of your team by asking
a question or sharing personal thoughts or insights for others to see using
the Buzz Chat Collaboration feature.
For example, if you need further explanation on a graph and/or card, or
simply want to add a comment for team members to see and respond, the
platform offers a Chat Collaboration feature to communicate with others.
If a balloon with a counter is over the chat icon, it represents new
messages waiting for a response or review as part of any past
communication thread started either by yourself or someone else.
Locate the Chat Collaboration icon located on the top-most NavBar as
represented.
24. User Navigation & Quick Tips
24
DOMO GETTING STARTED QUICK TIPS
#7 Chat Collaboration (Cont’d)
Once you click on the chat icon, a chat window opens to start a new
message and/or comment thread, or you may respond to a continuing
message thread.
The goal is to be able to collaborate with others either in real-time or near-
real-time to share insights and to drive strategic directions.
PRO TIP: When sending a message
or question to us (the
administrators),
use the ‘@’ sign and we will get an
email alert, and we will be able to
respond much quicker.
26. Reference Glossary
26
DOMO Dashboard Terms
Dashboard The overall physical destination location for the marketing performance insights
Page
A hosting location within the dashboard for subsets of data and marketing performance insights, e.g.,
the Wisconsin page
Card Any graphical or text element to display performance data as part of a Dashboard Page
Buzz
The platform’s Chat Collaboration feature, which allows message threads to be posted and sent via
email alerts
Drill Path
The sequential series of cards that are found underneath a top-level card to provide deeper insights;
retrievable and viewable via clicking on each card presented in the drill path
Message, Message Thread The public or private communications using the Buzz Collaboration feature
Quick Filters, Filters
The elements within a chart or graphical view, which can be isolated or sorted for new insights and
graphical views
Insights
The platform’s automated performance evaluations based on the card in view presented in text and
graph formats
27. Reference Glossary
27
Media (Advertising) Terms
Metrics Units of measurement to gauge performance
Dimensions Categories or classifications of grouped metrics to analyze performance
Channel
Destination for where the ad impression was served; channels in use include: Display (any third-
party) website, Facebook, Instagram, Twitter
Impressions The number of times an advertisement has been seen or delivered
Clicks The number of times a viewer of an advertisement acted by clicking on the ad
CTR (Click-thru-Rate)
The percentage of people clicking on an advertisement
[formula: CTR = clicks / impressions]
Conversions
The number of people who have clicked on an ad and then consequently completed the Account
Creation process
CVR (Conversion Rate) or
Click-to-Conversion Ratio
The percentage of people clicking on an advertisement and then completing the Account Creation
process
[formula: CVR = accounts created / clicks]
CPA (Cost per Acquisition)
The budget cost or budget spend to create a single Account Creation conversion
[formula: CPA = accounts created / budget spend]
Quality Ratio
The percentage of people who have completed the Consent process after signing up thru the
Account Creation process; measures quality of initial campaign lead
[formula: Quality Ratio = Consent Completions / Accounts Created]
29. Feedback & Request Form
29
Name
Email
Phone
Organizational Affiliation
Submission Date
Please print, save, and submit this form via email attachment to:
brad@wondros.com, daniel@wondros.com or trung@wondros.com
Need, Request, or Feedback:
Hi, my name is Kelli and I lead the design research efforts at Wondros for AoURP. Within Wondros, my team and I are known as the participant police. Meaning, we are constantly assessing and critiquing everything through the participants’ lens.
Today I’m going to do a quick overview of our research process, and how we got to that lens, introducing you to the Program’s personas and touch on some of main findings to come out of the research, particularly as they relate to the return of results.