NCCMT Webinar: Infectious Disease-Focused Methods and Tools to Support Evidence-Informed Decision-Making

Follow us @nccmt Suivez-nous @ccnmo
Funded by the Public Health Agency of Canada | Affiliated with McMaster University
The views expressed here do not necessarily reflect the views of the Public Health Agency of Canada.
Infectious Disease-Focused
Methods and Tools to Support
Evidence-Informed Decision-Making
Susan Snelling, PhD
Senior Knowledge Translation Specialist, NCCMT
Margaret Haworth-Brockman, MSc
Senior Program Manager, NCCID
June 9, 2016

@centreinfection
Poll Question #1
2
How many people are watching today’s
webinar with you?
a) Just me
b) 1 to 3
c) 4 to 5
d) 6 to 10
e) More than 10

@centreinfection
Housekeeping
• TC line will be muted during the webinar
Use Q&A to post comments / questions during
the webinar
• ‘Send’ questions to All (not privately to
‘Host’)
Connection issues
• Recommend using a wired Internet
connection (vs. wireless),
• WebEx 24/7 help line: 1-866-229-3239
Q&A
3

@centreinfection
Housekeeping
Experiencing feedback?
• Click Audio Broadcast at the bottom of the
Participants panel to join or leave the audio
broadcast.
4

@centreinfection
Poll Question #2
5
Where are you connecting from today?
a) BC
b) AB
c) SK
d) MB
e) ON
f) QC
g) NB
h) NS
i) PEI
j) NL
k) YK
l) NWT
m) NU
n) Outside
Canada

@centreinfection
6
Outline of Today’s Webinar
• Introduction to
NCCMT and NCCID
• A model for
evidence-informed
decision making
• Steps in the process
of evidence-informed
public health
With reference to
methods & tools
relevant for infectious
diseases public
health practitioners,
including approaches
that work for social
determinants &
tuberculosis

@centreinfection
National Collaborating Centre for
Methods and Tools (NCCMT)
Vision
• The effectiveness and efficiency of Canada’s public
health system will be guided by the production,
sharing and use of high quality evidence.
Mission
• The NCCMT will enhance evidence-informed public
health practice and policy in Canada by providing
leadership and expertise in supporting the uptake of
what works in public health into practice.
7

@centreinfection
What is
Evidence-Informed Public Health?
… the process of distilling and disseminating
the best available evidence from research, context
and experience, and using that evidence to inform
and improve public health policy and practice.
8

@centreinfection
Poll Question #3
9
What sector are you from?
a) Public Health Practitioner
b) Health Practitioner (Other)
c) Education
d) Research
e) Federal/Provincial/Territorial Government
f) Municipality
g) Non-Governmental Organization
h) Other

@centreinfection
NCCMT Registry of Methods and Tools
Resources to support use of research evidence in
public health
http://www.nccmt.ca/resources/registry
A free, searchable, online collection of knowledge
translation methods and tools for public health
• Summary statements
• Web links (when available) to Methods and Tools
10

NCCMT Registry of Methods of Tools
for Knowledge Translation
11

@centreinfection
What are methods and tools?
A process or series
of steps to organize
a Knowledge
Translation activity
Dissemination
framework
Method
An instrument to
carry out the steps
of a Knowledge
Translation activity
Dissemination
checklist
Tool
12

@centreinfection
National Collaborating Centre for
Infectious Diseases
We help public health practitioners find,
understand and use infectious disease
research and evidence.
Integration of evidence and other information to
improve public health policy & practice
Connections & collaborations for improved
exchange
13

@centreinfection
A Model for Evidence-Informed
Decision-Making in Public Health
14

@centreinfection
Stages in the process of
Evidence-Informed Public Health
15

@centreinfection
Scenario: Setting the Stage for
Evidence Use on an Infectious Disease
• Understanding the dynamics of
TB in the inner-city &
appropriate screening
• Outreach to at-risk populations
How can the steps of Evidence-
Informed Public Health be applied
to this scenario?
16

@centreinfection
17
Clearly define the question or
problem

@centreinfection
Define the question
PICO
P population
I intervention
C comparison
O outcome
18

@centreinfection
Define the question: Apply our scenario
PICO
P population: inner-city residents
I intervention: screening
C comparison: no intervention or usual
care
O outcome: diagnosed patients in care
19

@centreinfection
Recommended Tool: Define
Developing an Efficient Search Strategy Using
PICO
http://www.nccmt.ca/resources/search/138
Use it to develop an evidence-search question
using the PICO format.
20

Follow us @nccmt Suivez-nous @ccnmo 21

@centreinfection
22
Efficiently search for research
evidence

@centreinfection
Recommended Tool: Search
NCCMT Search Pyramids
http://www.nccmt.ca/learningcentre/EN/index.php
• Pre-populated with good sites for finding
evidence in public health, and for certain specific
topics.
• Start at the top for the most synthesized
evidence.
• Saves time
• Systematic approach to searching
23

27
Recommended Tool: Search
www.healthevidence.org

@centreinfection
Tips for “Search”
• Choose the highest possible level on the Pyramid
• Pre-appraised sources make your search more
efficient
• NCCMT online module on Searching through
Learning Centre
32

@centreinfection
33
Critically and efficiently appraise
the research methods

@centreinfection
Recommended Tools: Appraise
34
Critically Appraising Practice
Guidelines: The AGREE II
Instrument
http://www.nccmt.ca/registry/view/eng/100
Tools to Assess the Methodological
Quality of Systematic Reviews:
AMSTAR
http://www.nccmt.ca/registry/view/eng/97
Critical Appraisal Skills Programme:
Checklists
Considering Sex and Gender in
Research and Practice
http://sgba-resource.ca/en/
http://pwhce.ca/risingToTheChallenge.htm

@centreinfection
Tips for “Appraise”
• Appraise is a filtering step, looking for sources
of bias
• Answers the question: is this research/review of
good enough quality that I should read further?
• All research has flaws! But some flaws are
more serious than others.
35

@centreinfection
Additional Resources
• Refer to NCCMT’s online learning modules for
additional practice:
http://www.nccmt.ca/professional-development/modules
• Week-long course at McMaster University: “What
is Evidence-Informed Decision Making (EIDM)?”
http://ccebn.mcmaster.ca/workshop
36

@centreinfection
37
Interpret information;
understand how to prioritize
conflicting results

@centreinfection
Recommended Tool: Synthesize
Briefing Note: Decisions, Rationale and Key Findings
Summary
Use it to create briefing notes to inform decision-
makers. Use ‘actionable messages’ to inform program
and policy development.
38

@centreinfection
Tips for “Synthesize”
• Bring good quality evidence together to
determine results and implications
• If results ‘conflict’, prefer sources that are
highest quality, most recent, most relevant to
your question
• Identify actionable findings that can guide
decisions
40

@centreinfection
41
Adapt the information
to the local community

@centreinfection
A Model for Evidence-Informed
Decision-Making in Public Health
42

Recommended Tools: Adapt
- Applicability and Transferability of Evidence
43

@centreinfection
Online Learning Module
Assessing the Applicability and Transferability
of Evidence
44

@centreinfection
Tips for “Adapt”
45
• In developing a local approach, consider:
• Research evidence
• Stakeholder perspectives
• Media coverage – what’s going on in community
• Political context
• Local and regional data reports
• Financial and human resources
• How can you adapt potential interventions to be
appropriate for your community?

@centreinfection
46
Decide whether
(and plan how) to implement
the change in practice or policy

Recommended Tool: Implement
Outreach Planning Checklist
Get the app: http://bit.ly/1UfwcrU
47

@centreinfection
48
Assess the effectiveness
of the change in
practice or policy

@centreinfection
Recommended Tool: Evaluate
Improving Future Decisions: Optimizing the
Decision Process from Lessons Learned
Use it to evaluate your use of evidence in
making decisions.
A reflective practice tool.
49

@centreinfection
Tips for “Evaluate”
Determine how effective you were at using an
evidence-informed approach:
• What process did you follow?
• What can you learn from your process?
• How could you improve your use of evidence?
• How will you know if people are using the
evidence? Have they changed their practice?
• Was the intervention adapted effectively at your
local level?
You may need to gather baseline data before you start
if you want to assess change.
51

@centreinfection
52

@centreinfection
Poll Question #4
53
How familiar are you with the methods
and tools described today?
a) I am not familiar with any of the
methods/tools
b) I have heard of one or more of the
methods/tools
c) I have used one or more of the methods/tools

@centreinfection
Recommended tool: Evidence-
Informed Decision Making Checklist
54
 EIDM Phases & Steps
File Path / Link to
Saved Location on:
(insert name of your
network here)
 1. Define question
 Was a clear answerable search question developed?
What was the question?
P
I
C
O

2. Search for relevant evidence
 Was a comprehensive search strategy employed to find the best available evidence to
address this question?
PICO search terms table (See: Developing an Efficient Search Strategy Using PICO)
 Years searched:
Pyramid results (See: Levels & Sources of Public Health Evidence)
Search results (See: Keeping Track of Search Results: A Flowchart)
References saved in reference management software database (e.g. Reference Manager / RefWorks)
What relevance criteria were used to determine evidence for quality assessment:
Primary
Titles and abstracts as found in reference management database
 Save as separate reference management database.
Secondary
Relevance assessment of full document versions
 Save as separate reference management database.
How many papers remained following relevance assessment(s)? (See: Flowchart, above)
 3. Appraise
 Was quality assessment conducted on relevant evidence?
How many papers remained after quality assessment? (See: Flowchart, above)
 4. Synthesize
 What were the results of the review of the evidence?
What were the actionable messages from the evidence?
 5. Adapt.
 NCCMT’s Applicability and Transferability tool;
 AHRQ’s Will It Work Here? A Decisionmaker's Guide to Adopting Innovations
 6. Implement.
 7. Evaluate.

@centreinfection
Poll Question #5
55
To what extent will the methods or tools
described today be useful in your
practice?
a) Very useful
b) Somewhat useful
c) Not at all useful
d) Don’t know

@centreinfection
• Use Q&A to post comments
and/or questions
• ‘Send’ questions to All (not
privately to ‘Host’)
Q&A
Your Comments/Questions
56

@centreinfection
Poll Question #6
57
What are your next steps? (Check all that
apply)
a) Access a method/tool referenced in the
presentation
b) Read an NCCMT summary about a
method/tool described today
c) Consider using the methods/tools in
practice
d) Tell a colleague about the methods/tools

@centreinfection
Availability of the Slides and Audio
Recording
• The PowerPoint presentation (in English and
French) and English audio recording will be
available at:
• PowerPoint: http://www.slideshare.net/nccmt
• Audio Recording:
https://www.youtube.com/user/nccmt
58

@centreinfection
Your Feedback is Important
Please take a few minutes to share your thoughts
on today’s webinar.
https://nccmt.co1.qualtrics.com/SE/?SID=SV_8vlZ
Fs7Dme2pwm9
59

@centreinfection
Join NCCMT for our next webinar
Topic-Specific Methods and Tools to Support Evidence-Informed
Decision-Making: Resources for Practitioners Working in Injury
Prevention
PRESENTER: Susan Snelling, Senior Knowledge Translation
Specialist, NCCMT
DATE: Wednesday, June 22 2016
TIME: 1:00-2:30 pm
https://health-evidence.webex.com/health-
evidence/onstage/g.php?MTID=e5709e2b84fb3c8d00298494
074d1b533
Do you work in the injury prevention field?
Join us for a webinar to learn about a process for evidence-
informed decision-making, and methods and tools that are
specific to injury prevention. Remember to share information
about this webinar with your colleagues who work in the injury
prevention field!
60

For more information about the
National Collaborating Centre
for Methods and Tools:
61
NCCMT website www.nccmt.ca
Contact: nccmt@mcmaster.ca
For more information about the
National Collaborating Centre
for Infectious Diseases:
www.nccid.ca
nccid@umanitoba.ca

NCCMT Webinar: Infectious Disease-Focused Methods and Tools to Support Evidence-Informed Decision-Making

More Related Content

What's hot

Viewers also liked

Similar to NCCMT Webinar: Infectious Disease-Focused Methods and Tools to Support Evidence-Informed Decision-Making

More from The National Collaborating Centre for Methods and Tools

Recently uploaded

NCCMT Webinar: Infectious Disease-Focused Methods and Tools to Support Evidence-Informed Decision-Making

Editor's Notes