SlideShare a Scribd company logo
1 of 75
SAFTINet Kick-Off
Friday, December 10, 2010
Welcome!
ā€¢ Thank you for attending!
ā€¢ Goals and objectives
ā–« Outlining project vision and aims
ā–« Meeting SAFTINet collaborators
ā–« Starting the process
ā–« Clarifying concerns and questions
ā€¢ Agenda
ā€¢ Meeting materials
ā–« Research strategy
ā–« SAFTINet commonly used acronyms
Agenda
Agenda Item Time Presenter
Welcome and agenda
SAFTINetContext and Overview
10 mins
20 mins
Bethany Kwan
Lisa Schilling
Introductions and RollCall
Project teams and investigators
AAFP
CINA
University of Utah CHPC
DHHA
Cherokee Health Systems
Intermountain Healthcare
CCMCN/CACHIE
10 mins Bethany Kwan
Comparative Effectiveness Research 10 mins Marion Sills
Partner Engagement Community 10 mins Debbie Graham
TechnicalTeam Presentation 10 mins Michael Kahn
Getting started 5 mins Bethany Kwan
Wrap-up and Questions 15 mins Lisa Schilling
IOM Roundtable onValue & Science-
Driven Health Care
ā€¢ Goal: by the year 2020, 90 percent of clinical
decisions will be supported by accurate, timely, and
up-to-date clinical information, and will reflect the
best available evidence
ā€¢ Learning Healthcare System series
IOM Roundtable onValue & Science-
Driven Health Care
ā€¢ The Learning Healthcare System (2006)
ā€¢ Judging the Evidence: Standards for DeterminingClinical Effectiveness (2007)
ā€¢ Leadership Commitments to ImproveValue in Healthcare:Toward Common
Ground (2007)
ā€¢ Redesigning the Clinical Effectiveness Research Paradigm: Innovation and
Practice-Based Approaches (2007)
ā€¢ Clinical Data as the Basic Staple of Health Learning: Creating and Protecting a
PublicGood (2008)
ā€¢ Engineering a Learning Healthcare System:A Look to the Future (2008)
ā€¢ LearningWhat Works: Infrastructure Required for Learning Which Care Is Best
(2008)
ā€¢ Value in Health Care: Accounting for Cost, Quality, Safety, Outcomes and
Innovation (2008)
Comparative Effectiveness Milestones
ā€¢ 2003 - MMA Section 1013 authorizes AHRQ to conduct and
support research with a focus on ā€œoutcomes, comparative
clinical effectiveness, and appropriateness of health care
items and services (including prescription drugs)ā€
ā€¢ 2007- IOM Report - LearningWhatWorks Best:The Nationā€™s
Need for Evidence on Comparative Effectiveness In Health
Care
ā€¢ 2009 - ARRA provides $1.1 Billion to NIH/HHS/AHRQ
ā€¢ 2010 - Patient Protection and Affordable Care Act
ā€¢ Need for substantially improved understanding of the
comparative clinical effectiveness of healthcare
interventions.
ā€¢ Strengths of the randomized controlled trial muted by
constraints in time, cost, and limited applicability.
ā€¢ Opportunities presented by the size and expansion of
potentially interoperable administrative and clinical datasets.
ā€¢ Opportunities presented by innovative study designs and
statistical tools.
ā€¢ Need for innovative approaches leading to a more practical
and reliable clinical research paradigm.
ā€¢ Need to build a system in which clinical effectiveness
research is a more natural by-product of the care process.
Redesigning the Clinical
Effectiveness Research Paradigm
ā€¢ Address current limitations in applicability of research results
ā€¢ Counter inefficiencies in timeliness, costs, and volume
ā€¢ Define a more strategic use to the clinical experimental model
ā€¢ Provide stimulus to new research designs, tools, and analytics
ā€¢ Encourage innovation in clinical effectiveness research conduct
ā€¢ Promote the notion of effectiveness research as a routine part of practice
ā€¢ Improve access and use of clinical data as a knowledge resource
ā€¢ Foster the transformational research potential of information technology
ā€¢ Engage patients as full partners in the learning culture
ā€¢ Build toward continuous learning in all aspects of care
ā€¢ resulting research paradigm, with randomized
controlled double blind trials at the pinnacle, has
often left important evidence needs unmet when
combined with the costs, complexity, and lack of
generalizability of RCTs.
ā€¢ Geisinger example of the power of proper EHR use
ā€¢ (pg 28 ā€“ Redesigning)
Why distributed?
ā€¢ Minimize security risks by allowing the data
repositories of multiple parties to remain separately
owned and controlled.
ā€¢ These models also provide an interface to these
stores of highly useful data that allows them to
function as a large combined dataset.
ā€¢ Patient preferences and perspectives.What
approaches might help
ā€¢ to refine practical instruments to determine patient
preferencesā€”
ā€¢ such as NIHā€™s PROMIS (Patient-Reported Outcomes
Measurement
ā€¢ Information System)ā€”and apply them as central
elements of outcome
ā€¢ measurement?
Evidence gaps
Patient Protection and Affordable Care
Act- Public Law 111-148 :Subtitle D
ā€¢ Patient-Centered Outcomes Research
ā–« Comparative Clinical Effectiveness Research
ā€¢ Defined Comparative Clinical Effectiveness Research
ā–« The terms ā€˜comparative clinical effectiveness
researchā€™ and ā€˜researchā€™ mean research evaluating and
comparing health outcomes and the clinical
effectiveness, risks, and benefits of 2 or more medical
treatments, services..ā€ as describedā€¦
Patient Protection and Affordable Care
Act- Public Law 111-148 :Subtitle D
ā€¢ Medical treatments, services, and items described in
this subparagraph are health care interventions,
protocols for treatment, care management, and
delivery, procedures, medical devices, diagnostic
tools, pharmaceuticals (including drugs and
biologicals), integrative health practices, and any
other strategies or items being used in the
treatment, management, and diagnosis of, or
prevention of illness or injury in, individuals.
Patient Protection and Affordable Care
Act- thereā€™s more
ā€¢ Established Patient-Centered Outcomes Research
Institute (PCORI), a non-profit corporation with
duties including:
ā–« Identifying national research priorities
ā–« Establish a research agenda to address these priorities
ā–« Carry out the research agenda (systematic reviews,
primary research, funding)
ā–« Disseminate
SAFTINet Overview
ā€¢ AHRQ ARRA OS: Recovery Act 2009: Scalable Distributed
Research Networks forComparative Effectiveness Research
(R01)
ā€¢ Goal: enhance the capability and capacity of electronic
health networks designed for distributed research to conduct
prospective, comparative effectiveness research on
outcomes of clinical interventions.
ā€¢ These distributed research network projects will:
ļ‚– Build on and expand existing electronic health infrastructure
ļ‚– Broad, scalable and sustainable systems
ļ‚– Enable the collection of longitudinal and comprehensive data across
diverse healthcare delivery settings
ļ‚– Evaluate effectiveness of clinical interventions for a diverse set of
clinical conditions.
$1.1 Billion -ARRA Allocations
ā€¢ Research
ā€¢ Data Infrastructure
ā€¢ Dissemination and Adoption
ā€¢ Administrative support,
inventory, evaluation
ā€¢ $681 M (62%)
ā€¢ $268 M (24%)
ā€¢ $132 M (12%)
ā€¢ $ 19 M ( 2%)
Federal Coordinating Council for Comparative
Effectiveness and Research (FCC)
ā€¢ FCC-CER IOM ā€¢ Data infrastructure ā€¢ Dissemination and translation ā€¢ Human
and scientific capital ā€¢ Real-world settings for subpopulations, priority
conditions and interventions ā€¢ 100 top priority CER topics ā€“ 50% focus on
health care delivery systems ā€“ Only three of the topics are narrowly focused on
drug vs. drug ā€¢ Enhanced State Data for Analysis andTracking of Comparative
Effectiveness Impact: Improved ClinicalContent and Race-Ethnicity Data ā€¢
Registry of Patient Registries
ā€¢ Select examples of AHRQ funding ā€¢ Electronic Data Methods (EDM) Forum
for Comparative Effectiveness Researchā€¢ Enhanced Registries for Quality
Improvement and Comparative Effectiveness Research Select examples of OS
funding
AHRQ Support of Actionable Evidence
ā€¢ 15 Evidence-based Practice Centers (EPCs),
ā€¢ 13 Developing Evidence to Inform Decisions
about Effectiveness (DEcIDE) Network,
ā€¢ 14 Centers for Education and Research on
Therapeutics (CERTs),
AHRQ Support of CER
ā€¢ CER Methodology - 19 funded projects -****
ā€¢ Laurer, Collins JAMA 2010:303;2182
Why CER
Physicians, health insurers, & patients need information
about the CE and safety of drugs, devices, therapies
and processes of care.
Non-randomized studies using data collected primarily
for care (or billing) can supplement the evidence of
RCT.
Improving the value of CER means improving: data
collection & use, data availability and access, CER
methodology (design, analysis) and reporting.
Cart before horse
ā€¢ 1904 first radical prostectomy
ā€¢ Jan 2010 1st US RCT active survelleince vs RP for
localized prostate Ca
ā€¢ 100 years of action without evidence
Project Requirements
ā€¢ Primary focus
ā–« Develop an electronic health network that collects and
links data from multiple and different healthcare delivery
settings
ļ‚– Capability for near-real time data extraction of de-identified
patient-level data, data analysis, and new data collection at
the POC
ā–« Demonstrate capabilities for conducting methodologically
rigorous Comparative Effectiveness Research (CER)
ļ‚– Capability for collecting HRQoL measures, other patient-
reported outcomes at the POC
Funded Projects
ā€¢ Scalable Architecture for FederatedTherapeutic
Inquiries Network (SAFTINet)
ā–« Lisa M. Schilling, University of Colorado Denver (R01
HS19908-01)
ā€¢ SCANNER: Scalable National Network for Effectiveness
Research
ā–« Lucila Ohno-Machado, University of California San Diego
(R01 HS19913-01)
ā€¢ Scalable PArtnering Network for CER: Across Lifespan,
Conditions, and Settings
ā–« John F. Steiner, Kaiser Foundation Research Institute (R01
HS19912-01)
SAFTINet Governance
AHRQProjectOfficer
Lisa Schilling, MD, MSPH
Principal Investigator
David West, PhD
Co-investigator
Project Oversight
Michael Kahn, MD, PhD
Co-investigator
DARTNet/SAFTINet Informatics
Cathy Bryan, RN, MHA
QED Clinical, Inc. d/b/a CINA
Julio Facelli, PhD
Univ of Utah Center for High
Performance Computing
SAFTINetTechnical Team
Wison Pace, MD
Co-investigator
DARTNet/SAFTINet Informatics
Art Davidson, MD, MSPH
Co-investigator
DH Informatics,
Medicaid Relationships
Marion Sills, MD, MPH
Co-investigator
CER, Cohort Development
SAFTINet Comparative
Effectiveness ResearchTeam
DebbieGraham, MSPH
AAFP/NRN
Partner Engagement Community
SAFTINet Partner Engagement
Community Group
Bethany Kwan, PhD, MSPH
Project Manager
Research Partnership and
LearningCommunity
ā€¢ Specific Aim 1: Establish a broad, safety-net focused,
research partnership and learning community to govern
relationships, establish priorities, provide data quality
oversight, and evaluate the purpose and value of the
communityā€™s effort that leverages the established
governance structure of DARTNet.
ā€¢ Overall Goal: Create a trusted, valued multi-state
community of safety net stakeholders and researchers
to lead and participate in a learning community to
address evidence-gaps relevant to the safety net
populations ā€“ with special emphasis upon those
populations served by Medicaid and State Child Health
Insurance Program (SCHIP).
Technology Development
ā€¢ Specific Aim 2: Extend the DARTNet framework to
build, deploy and assess a safety-net focused
distributed research network which combines
ambulatory and inpatient clinical data and Medicaid
claims and eligibility data for clinical and research
purposes
ā€¢ Overall Goal: Build the technology necessary to support
a valued, virtual organization that securely federates
clinical EHR and Medicaid/CHIP+ data, (consistent with
Medicaid agency efforts to develop Medicaid
InformationTechnologyArchitecture plans and systems)
to promote quality care and provide enhanced data for
comparative effectiveness research.
Comparative Effectiveness Research
ā€¢ The conduct and synthesis of research comparing the
benefits and harms of different interventions and strategies
to prevent, diagnose, treat and monitor health conditions in
ā€œreal worldā€ settings.
ā–« Including delivery system strategies
ā€¢ Specific Aim 3: Develop and enhance four sentinel cohort
pairs of patients with asthma (pediatric and adult),
hypertension, and hypercholesterolemia distinguished by
their care delivery characteristics which can support
comparative effectiveness research.
ā–« System-level factors
ļ‚– Patient-Centered Medical Home
ļ‚– Integrated Mental Health care
ā–« Enhanced data collection at point-of-care
Introductions
ā€¢ BRIEF organizational descriptions, roles and
personnel
ā€¢ Roll Call
ā€¢ Investigator bios and full research strategy posted
on SharePoint site
Project team investigators
Partner Engagement Community TechnicalTeam Investigators
ā€¢ Debbie Graham (AAFP)
ā€¢ Jeanne Rozwadowski (DHHA)
ā€¢ Lucy Savitz (IMH)
ā€¢ Parinda Khatri (CHS)
ā€¢ Heather Stocker (CCMCN)
ā€¢ Bethany Kwan (UCD)
ā€¢ Lisa Schilling (UCD)
ā€¢ Michael Kahn (UCD)
ā€¢ Wilson Pace (UCD)
ā€¢ Julio Facelli (Utah)
ā€¢ Cathy Bryan (CINA)
ā€¢ Ron Price (Utah)
ā€¢ Jim May (CINA)
ā€¢ Art Davidson (DHHA)
ā€¢ Nathan Hulse (IMH)
ā€¢ Lisa Schilling (UCD)
Project team investigators
CERTeam Investigators
ā€¢ Marion Sills (UCD)
ā€¢ Elaine Morrato (UCD)
ā€¢ Lisa Schilling (UCD)
ā€¢ Karl Hammermeister (UCD)
ā€¢ Monica Federico (UCD)
ā€¢ Ben Miller (UCD)
ā€¢ RobValuck (UCD)
ā€¢ Diane Fairclough (UCD)
ā€¢ Bethany Kwan (UCD)
ā€¢ BarbaraYawn (consultant)
ā€¢ Lucy Savitz (IMH)
ā€¢ Brian Sauer (Utah)
SAFTINet CERTeam
CER
Methodology
Experts
Health Outcomes
Content Experts
Health Care
Delivery
System and
Process Experts
AmericanAcademy of Family Physicians (AAFP)
National Research Network (NRN)
ā€¢ Personnel:
ā–« DebbieGraham, MSPH, AAFP Site PI
ā–« Elias Brandt, Research SystemsAnalyst
ā–« Project Manager, to be hired
ā€¢ Established in 1999 to conduct, support, promote, and
advocate for primary care research in practice-based
settings.
ā€¢ Role in project:
ā–« Coordination with CINA activities
ā–« Partner EngagementCommunity leadership
QED Clinical, Inc. d/b/a CINA
ā€¢ Personnel
ā–« Cathy Bryan, MHA, BSN, RN, Chief ClinicalOfficer
ā–« Jim May, MBA, Chief Executive Officer
ā–« Project Manager, to be named
ā€¢ CINA provides innovative technology solutions that support quality
focused, evidence-based health care.
ā€¢ CINA technology can be used for discrete, validated data extraction
virtually real-time from ambulatory clinical records for research purposes.
ā€¢ CINA also provides tools for Point of Care decision support, Population
reporting, and Disease Registries http://cina-us.com/
ā€¢ Project Role
ā–« Data extraction, standardization, reporting processes (Cherokee)
ā–« Data aggregation across sources (Cherokee, Medicaid) and sharing with
SAFTINet , as applicable
ā–« Contributing to technological development for scalable, distributed
networking
University of Utah
Center for High Performance Computing
(CHPC) and Biomedical Informatics (BMI)
ā€¢ Personnel andTechnicalTeam:
ā–« Julio Facelli, PhD, CHPC Director, BMIVice Chair, PI of UtahTeam
ā–« Ron Price, Sr. Software Engineer/Architect and Project Manager
ā–« Derick Huth, Jr. Software Engineer
ā–« Jody Smith, DatabaseAdministrator
ā–« Walter Scott, DatabaseAdministrator
ā–« Steve Harper, SystemAdministrator
ā€¢ Project role
ā–« Build the Grid
Cherokee Health Systems, Inc.
ā€¢ Personnel
ā–« Parinda Khatri, PhD,CHS Director of Integrated Care, CHS Site PI
ā–« Jeff Howard, CPA, CHS Chief FinancialOfficer
ā–« Bob Franko, MBA, CHS training and marketing
ā–« Monty Bryant, BS, Programmer/Analyst
ā–« Jennifer Poling, MBA, DataAnalyst
ā€¢ Cherokee Health Systems is a network of 20 clinical sites in 14
counties inTennessee, with strategic emphases on integration of
behavioral health and primary care, outreach to underserved
populations, and safety net preservation
(http://www.cherokeehealth.com )
ā€¢ Project role
ā–« Collaboration on technical and Partner EngagementCommunity
teams
ā–« Supporting participatingCherokee practices for data sharing, point of
care data collection, and data use
Intermountain Healthcare
ā€¢ Personnel
ā–« Lucy Savitz, PhD, MBA, Director of Research and Education, Institute
for Health Care Delivery Research, Intermountain site PI
ā–« Nathan Hulse, PhD, Intermountain informaticist
ā–« Brian Sauer, PhD,CER methodology expert
ā–« AmyWuthrich, MS, Project Manager
ā€¢ Non-for-profit integrated health care delivery network of 24
hospitals, more than 130 outpatient clinics, a 1,000 member
employed physician group with 2,000+ affiliated physicians, and
associated care delivery support functions located in Utah and
southeastern Idaho.
ā€¢ Project roles
ā–« Collaboration on technical, CER, and Partner EngagementCommunity
teams
ā–« Supporting participating Intermountain practices for data sharing,
point of care data collection, and data use
CCMCN/CACHIE
ā€¢ Personnel
ā–« JasonGreer, CACHIE Director
ā–« DanTuteur, CCMCN Executive Director
ā–« Heather Stocker, CCMCN Director of Clinical Programs & Development
ā€¢ ColoradoCommunity ManagedCare Network (CCMCN)
ā–« A non-profit Network of 15 Federally Qualified Health Centers (FQHCs)
providing primary health care services to the medically underserved
throughout Colorado.
ā€¢ ColoradoAssociated Community Health Information Enterprise (CACHIE)
ā–« Built and maintains a shared data warehouse on behalf of CCMCN health
centers
ā€¢ Project Role
ā–« Collaboration on technical and Partner EngagementCommunity teams
ā–« Supporting two participatingColoradoCommunity Health Centers for
data sharing, point of care data collection, and data use
Denver Health & Hospital Authority
(DHHA)
ā€¢ Personnel
ā–« Art Davidson, MD, MSPH, SAFTINet Co-Investigator
ā–« Jeanne Rozwadowski, MD, DHHA Site Co-investigator
ā–« Dean McEwen, MS, Informatics
ā€¢ Vertically integrated, public urban safety net health care
system
ā–« Eight federally qualified community health centers, twelve
school-based clinics in the Denver public school system
ā€¢ Project roles
ā–« Collaboration on technical and Partner Engagement
Community teams
ā–« Supporting participating DHHA FQHCs for data sharing,
point of care data collection, and data use
Project teams
ā€¢ Partner Engagement Community
ā€¢ Technical team
ā€¢ Comparative effectiveness research team
Partner Engagement Community
ā€¢ Mission
ā€¢ Culture of collaboration
ā€¢ Community-based participatory research
ā€¢ Objectives
ā€¢ Vehicle for communications between partners
ā€¢ Decision making (e.g., POC data collection)
ā€¢ Encouraging members to identify topics, bring value to stakeholders,
prioritize future CER questions
ā€¢ LearningCommunity
ā€¢ Membership
ā€¢ Meet monthly ā€“ 1st Wednesday at 12:00 MT/1:00CT/2:00 ET
ā€¢ Listserv
TechnicalTeam Presentations
ā€¢ Aims and objectives
ā€¢ Process
ā–« Technical requirements
ā€¢ Milestones and timeline
ā–« Build the grid
ā–« Set up the nodes
ā–« End of year 1 goal:Two entities with nodes on the grid
Informatics Objectives:
Starting with the End Objectives
ā€¢ What we need to accomplish:
ļ‚– A way for local participants to control what data are and are not
available for collaborative projects - what is ā€œon the gridā€
ļ‚– A way to control who/what/where/when/why for all data access
ļ‚– A way to ensure patient confidentiality
ļ‚– A way to include patient-reported data
ļ‚– A way to include State Medicaid data
ā€¢ Not all of the technical details are completely
determined
ļ‚– Some ā€œgivensā€; others open for negotiation
ļ‚– Need to engage the various technical teams
EHR
Color code:
ā€¢ Blue = A given
ā€¢Yellow = Optional
ā€¢Red = Still in analysis
ā€¢ EHR: Electronic Health Record
CER/CDS
DM
Other
EHR
Color code:
ā€¢ Blue = A given
ā€¢Yellow = Optional
ā€¢Red = Still in analysis
In SAFTINet participants, we have:
ā€¢CINA CDR
ā€¢Local data warehouse
ā€¢ EHR: Electronic Health Record
ā€¢ Other data sources include: claims, hospital, and third party databases
ā€¢ CER/CDS DM: Comparative effectiveness research/Clinical decision
support data mart
PE
CER/CDS
DM
Other
EHR
Guideline
protocols
Patient
specific
report
Practice
provider
reports
Color code:
ā€¢ Blue = A given
ā€¢Yellow = Optional
ā€¢Red = Still in analysis
ā€¢ EHR: Electronic Health Record
ā€¢ Other data sources include: claims, hospital, and third party databases
ā€¢ CER/CDS DM: Comparative effectiveness research/Clinical decision
support data mart
ā€¢ PE: Protocol Engine
PE
CER/CDS
DM
Other
EHR
Guideline
protocols
Patient
specific
report
Practice
provider
reports
Color code:
ā€¢ Blue = A given
ā€¢Yellow = Optional
ā€¢Red = Still in analysis
Shared Data
w/ PHI
Shared Data
Encrypted
Developed and Supported by SAFTINet
ā€¢ EHR: Electronic Health Record
ā€¢ Other data sources include: claims, hospital, and third party databases
ā€¢ CER/CDS DM: Comparative effectiveness research/Clinical decision
support data mart
ā€¢ PE: Protocol Engine
PE
CER/CDS
DM
Other
EHR
Guideline
protocols
Patient
specific
report
Practice
provider
reports
ā€¢ EHR: Electronic Health Record
ā€¢ Other data sources include: claims, hospital, and third party databases
ā€¢ CER/CDS DM: Comparative effectiveness research/Clinical decision
support data mart
ā€¢ PE: Protocol Engine
ā€¢ TRIAD: Translational Informatics and Data management
Color code:
ā€¢ Blue = A given
ā€¢Yellow = Optional
ā€¢Red = Still in analysis
Shared Data
w/ PHI
Shared Data
Encrypted
Developed and Supported by SAFTINet
Saftinet
Portal
TRIAD
Node
Web Services
Queries and Data Transfers
CER/CDS
DM
Other
EHR
Color code:
ā€¢ Blue = A given
ā€¢Yellow = Optional
ā€¢Red = Still in analysis
Shared Data
w/ PHI
Shared Data
Encrypted
Developed and Supported by SAFTINet
Saftinet
Portal
TRIAD
Node
Web Services
Queries and Data Transfers
The Trickier Bitsā€¦..
Medicaid
Data
? ?
?
Uni-directional
Or Bi-directional?
CER/CDS
DM
Other
EHR
Color code:
ā€¢ Blue = A given
ā€¢Yellow = Optional
ā€¢Red = Still in analysis
Shared Data
w/ PHI
Shared Data
Encrypted
Developed and Supported by SAFTINet
Saftinet
Portal
TRIAD
Node
Web Services
Queries and Data Transfers
The Trickier Bitsā€¦..
Medicaid
Data
? ?
?
Patient
Reported
Data
?
?
Whatā€™s been happening
ā€¢ Creating the use cases
ā–« What types of actions do we need to support?
ļ‚– Types of questions to be answered
ļ‚– Types of security and access controls
ā€¢ Use cases drives data elements and database
ā–« What do we need to extract from each CER/CDS?
ā€¢ Pilot implementations ofTRIAD technology
ā–« Kicking the technology tires with large data sets to
discover the warts and ā€œgotchasā€
Whatā€™s next?
ā€¢ Engage all of the technical contacts
ā–« Share use cases to understand data availability and
gaps
ā–« Discuss how best to develop data extracts
ā–« Develop data quality procedures
ā–« Develop technology deployment and support plans
ļ‚– Including validation, acceptance, and training
Comparative Effectiveness Research
ā€¢ Aims
ā€¢ Process
Comparative Effectiveness Research
ā€¢ The conduct and synthesis of research comparing
the benefits and harms of different interventions
and strategies to prevent, diagnose, treat and
monitor health conditions in ā€œreal worldā€ settings.
ā–« Including delivery system strategies
CER Aim
ā€¢ Specific Aim Related to CER (Aim 3): Develop and
enhance four sentinel cohort pairs of patients with
asthma (pediatric and adult), hypertension, and
hypercholesterolemia distinguished by their care
delivery characteristics which can support
comparative effectiveness research.
CER Goals
ā€¢ Demonstrate the capability of SAFTINet to collect
and accurately link patient-level data necessary for
CER of delivery systems
ā€¢ Lay the groundwork to conduct prospective
observational studies and clinical trials
CER Hypothesis
ā€¢ Health care delivery system factors, such as the
patient-centered medical homeā€¦
PROCESSES OF
CARE
(clinician factors)
+
STRUCTURES OF
CARE
(system factors)
+ PATIENT FACTORS ā†’
OUTCOMES
(chronic disease
control)
CER Hypothesis
ā€¢ Health care delivery system factors, such as the
patient-centered medical home,
PROCESSES OF
CARE
(clinician factors)
+
STRUCTURES OF
CARE
(system factors)
+ PATIENT FACTORS ā†’
OUTCOMES
(chronic disease
control)
outweigh clinician factors, patient factors, and
medication effectivenessā€¦
CER Hypothesis
ā€¢ Health care delivery system factors, such as the
patient-centered medical home,
PROCESSES OF
CARE
(clinician factors)
+
STRUCTURES OF
CARE
(system factors)
+ PATIENT FACTORS ā†’
OUTCOMES
(chronic disease
control)
outweigh clinician factors, patient factors, and
medication effectiveness in the control of asthma,
high blood pressure and hypercholesterolemia.
CER Conceptual Model
Relatively
Mutable
Clinical inertia
Counseling
Drug selection
Dosage selection
Concomitant meds
Follow-up
Decision support
Patient-Centered
Medical Home
Integrated Mental
Health Care
Disease-specific case
management
Access to care
Outcomes feedback
Therapy adherence
Therapy persistence
Mental health status
Health knowledge
Perceived need for
care
Symptoms
Drug side effects
Patient-centered
outcomes
Health-related
quality of life
Clinical outcomes
Process
PROCESSES OF
CARE
(clinician
factors)
+
STRUCTURES OF
CARE
(system factors)
+ PATIENT FACTORS ā†’ OUTCOMES
Relatively
immutable
Appointment time
Patient load
Physical facilities
Practice type
Support personnel
Generalist vs.
specialist
Age
Gender
Race/ethnicity
SES
Marital status
Religious/cultural
beliefs
Comorbidity
Comparative Effectiveness Research
ā€¢ Aims
ā€¢ Process
CER Process:TheTeam
Marion Sills
Co-investigator
SAFTINet Comparative
Effectiveness Research
Team
Measures experts
Cohort experts
Brian Sauer
Diane Fairclough
RobValuck
Elaine Morrato
PCMH:
Lisa Schilling
IMHC:
Ben Miller
Pediatric asthma:
Monica Federico
Adult asthma:
BarbaraYawn
HTN,
Hypercholesterolemia:
Karl Hammermeister
CER methods experts
CER Process: Sources of Data
ā€¢ Electronic health records
ā€¢ Medicaid claims
ā€¢ Enhanced point-of-care data collection
ā€¢ Organizational or practice-level survey
CER/CDS
DM
Other
EHR
Medicaid
Data
Org.
Survey
Patient
Reported
Data
CER/CDS DM:
Comparative
effectiveness
research/Clinical
decision support
data mart
CER Process
ā€¢ Establish data dictionary
ā€¢ Develop CER-specific technology use cases
ā€¢ Review data profiling and quality reports to improve
data quality (ongoing)
ā€¢ Analytical plan
CER Process
ā€¢ Establish data dictionary
ā€¢ Develop CER-specific technology use cases
ā€¢ Review data profiling and quality reports to improve
data quality (ongoing)
ā€¢ Analytical plan
CER Process
ā€¢ Hypothesis generation
CER Process
ā€¢ Hypothesis generation
ā€¢ Cohort identification
ā–« Clinical/demographic parameters
ā–« Eligibility
CER/CDS
DM
EHR
Medicaid
Data
CER Process
ā€¢ Hypothesis generation
ā€¢ Cohort identification
ā€¢ Measures
ā–« Outcome measures
ā–« Explanatory measures
ā–« Covariates
PROCESSES OF
CARE
(clinician factors)
+
STRUCTURES OF
CARE
(system factors)
+ PATIENT FACTORS ā†’
OUTCOMES
(chronic disease
control)
CER/CDS
DM
EHR
Medicaid
Data
CER Process
ā€¢ Hypothesis generation
ā€¢ Cohort identification
ā€¢ Measures
ā€¢ Enhanced data collection
ā–« Patient-reported outcomes
ā–« Quality of life
ā–« PCMH
ā–« IMHC
CER/CDS
DM
Org.
Survey
Patient
Reported
Data
CER Process
ā€¢ Hypothesis generation
ā€¢ Cohort identification
ā€¢ Measures
ā€¢ Enhanced data collection
CER/CDS
DM
Other
EHR
Medicaid
Data
Org.
Survey
Patient
Reported
Data
CER Process
ā€¢ Establish data dictionary
ā€¢ Develop CER-specific technology use cases
ā€¢ Review data profiling and quality reports to improve
data quality (ongoing)
ā€¢ Analytical plan
Next stepsā€¦
ā€¢ Getting started
ā€¢ Wrap-up
Getting Started
ā€¢ Subcontracts
ā€¢ SharePoint
ā–« Shared Documents
ā–« Calendar
ā–« Announcements
ā–« Discussions
ā€¢ Upcoming events and meetings
ā–« Partner Engagement Community (Scheduling in progress)
ā–« Technical team (Thursdays @ 2pm MT starting 12/16)
ā–« CER team (Mondays @ 1:30pm MT)
ā€¢ Quarterly SAFTINet Update meetings
Wrap-Up
ā€œKnowing is not enough; we must apply.Willing is not
enough; we must do.ā€ ā€”Goethe
Questions/Comments --

More Related Content

What's hot

Adaptive pathways intro_ispor_second_plenary_nov14
Adaptive pathways intro_ispor_second_plenary_nov14Adaptive pathways intro_ispor_second_plenary_nov14
Adaptive pathways intro_ispor_second_plenary_nov14Office of Health Economics
Ā 
Predictive analytics for personalized healthcare
Predictive analytics for personalized healthcarePredictive analytics for personalized healthcare
Predictive analytics for personalized healthcareJohn Cai
Ā 
Building a National Data Infrastructure to Advance Patient-Centered Comparati...
Building a National Data Infrastructure to Advance Patient-Centered Comparati...Building a National Data Infrastructure to Advance Patient-Centered Comparati...
Building a National Data Infrastructure to Advance Patient-Centered Comparati...Patient-Centered Outcomes Research Institute
Ā 
Ispor workshop value-based_assess_nice_kks_nov2014
Ispor workshop value-based_assess_nice_kks_nov2014Ispor workshop value-based_assess_nice_kks_nov2014
Ispor workshop value-based_assess_nice_kks_nov2014Office of Health Economics
Ā 
Increased Ethical Demands for Patient Empowerment in Personalised Medicine
Increased Ethical Demands for Patient Empowerment in Personalised MedicineIncreased Ethical Demands for Patient Empowerment in Personalised Medicine
Increased Ethical Demands for Patient Empowerment in Personalised MedicineWolfgang Kuchinke
Ā 
Health technology assessment- Dr. Saraswathy MD, PGIMER
Health technology assessment- Dr. Saraswathy MD, PGIMERHealth technology assessment- Dr. Saraswathy MD, PGIMER
Health technology assessment- Dr. Saraswathy MD, PGIMERYogesh Arora
Ā 
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...MEASURE Evaluation
Ā 
Main Presentation UK Diagnostic Summit 2018
Main Presentation UK Diagnostic Summit 2018Main Presentation UK Diagnostic Summit 2018
Main Presentation UK Diagnostic Summit 2018Walt Whitman
Ā 
Newhouse arkansas 4-7-14(v2)
Newhouse arkansas 4-7-14(v2)Newhouse arkansas 4-7-14(v2)
Newhouse arkansas 4-7-14(v2)TRIuams
Ā 
NIH Data Sharing Plan Workshop - Slides
NIH Data Sharing Plan Workshop - SlidesNIH Data Sharing Plan Workshop - Slides
NIH Data Sharing Plan Workshop - SlidesIUPUI
Ā 
Getting evidence from economic evaluation into healthcare practice
Getting evidence from economic evaluation into healthcare practiceGetting evidence from economic evaluation into healthcare practice
Getting evidence from economic evaluation into healthcare practicecheweb1
Ā 
Using alternative scholarly metrics to showcase the impact of your research: ...
Using alternative scholarly metrics to showcase the impact of your research: ...Using alternative scholarly metrics to showcase the impact of your research: ...
Using alternative scholarly metrics to showcase the impact of your research: ...SC CTSI at USC and CHLA
Ā 
Machine Learning applied to heart failure readmissions
Machine Learning applied to heart failure readmissionsMachine Learning applied to heart failure readmissions
Machine Learning applied to heart failure readmissionsJohn Frias Morales, DrBA, MS
Ā 
Multi criteria decision analysis for healthcare
Multi criteria decision analysis for healthcareMulti criteria decision analysis for healthcare
Multi criteria decision analysis for healthcareSunhong Kwon
Ā 
Methods for Observational Comparative Effectiveness Research on Healthcare De...
Methods for Observational Comparative Effectiveness Research on Healthcare De...Methods for Observational Comparative Effectiveness Research on Healthcare De...
Methods for Observational Comparative Effectiveness Research on Healthcare De...Marion Sills
Ā 
Routine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceRoutine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceMEASURE Evaluation
Ā 
Ronan Herlihy on Engaging Clinicians with data on their ordering practices
Ronan Herlihy on Engaging Clinicians with data on their ordering practicesRonan Herlihy on Engaging Clinicians with data on their ordering practices
Ronan Herlihy on Engaging Clinicians with data on their ordering practicesCirdan
Ā 

What's hot (20)

Adaptive pathways intro_ispor_second_plenary_nov14
Adaptive pathways intro_ispor_second_plenary_nov14Adaptive pathways intro_ispor_second_plenary_nov14
Adaptive pathways intro_ispor_second_plenary_nov14
Ā 
The EQ-5D and Its Use Internationally
The EQ-5D and Its Use InternationallyThe EQ-5D and Its Use Internationally
The EQ-5D and Its Use Internationally
Ā 
MCDA for orphan_medicines_mg_dec2014
MCDA for orphan_medicines_mg_dec2014MCDA for orphan_medicines_mg_dec2014
MCDA for orphan_medicines_mg_dec2014
Ā 
Predictive analytics for personalized healthcare
Predictive analytics for personalized healthcarePredictive analytics for personalized healthcare
Predictive analytics for personalized healthcare
Ā 
Markham2009
Markham2009Markham2009
Markham2009
Ā 
Building a National Data Infrastructure to Advance Patient-Centered Comparati...
Building a National Data Infrastructure to Advance Patient-Centered Comparati...Building a National Data Infrastructure to Advance Patient-Centered Comparati...
Building a National Data Infrastructure to Advance Patient-Centered Comparati...
Ā 
Ispor workshop value-based_assess_nice_kks_nov2014
Ispor workshop value-based_assess_nice_kks_nov2014Ispor workshop value-based_assess_nice_kks_nov2014
Ispor workshop value-based_assess_nice_kks_nov2014
Ā 
Increased Ethical Demands for Patient Empowerment in Personalised Medicine
Increased Ethical Demands for Patient Empowerment in Personalised MedicineIncreased Ethical Demands for Patient Empowerment in Personalised Medicine
Increased Ethical Demands for Patient Empowerment in Personalised Medicine
Ā 
Health technology assessment- Dr. Saraswathy MD, PGIMER
Health technology assessment- Dr. Saraswathy MD, PGIMERHealth technology assessment- Dr. Saraswathy MD, PGIMER
Health technology assessment- Dr. Saraswathy MD, PGIMER
Ā 
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Ā 
Main Presentation UK Diagnostic Summit 2018
Main Presentation UK Diagnostic Summit 2018Main Presentation UK Diagnostic Summit 2018
Main Presentation UK Diagnostic Summit 2018
Ā 
Newhouse arkansas 4-7-14(v2)
Newhouse arkansas 4-7-14(v2)Newhouse arkansas 4-7-14(v2)
Newhouse arkansas 4-7-14(v2)
Ā 
NIH Data Sharing Plan Workshop - Slides
NIH Data Sharing Plan Workshop - SlidesNIH Data Sharing Plan Workshop - Slides
NIH Data Sharing Plan Workshop - Slides
Ā 
Getting evidence from economic evaluation into healthcare practice
Getting evidence from economic evaluation into healthcare practiceGetting evidence from economic evaluation into healthcare practice
Getting evidence from economic evaluation into healthcare practice
Ā 
Using alternative scholarly metrics to showcase the impact of your research: ...
Using alternative scholarly metrics to showcase the impact of your research: ...Using alternative scholarly metrics to showcase the impact of your research: ...
Using alternative scholarly metrics to showcase the impact of your research: ...
Ā 
Machine Learning applied to heart failure readmissions
Machine Learning applied to heart failure readmissionsMachine Learning applied to heart failure readmissions
Machine Learning applied to heart failure readmissions
Ā 
Multi criteria decision analysis for healthcare
Multi criteria decision analysis for healthcareMulti criteria decision analysis for healthcare
Multi criteria decision analysis for healthcare
Ā 
Methods for Observational Comparative Effectiveness Research on Healthcare De...
Methods for Observational Comparative Effectiveness Research on Healthcare De...Methods for Observational Comparative Effectiveness Research on Healthcare De...
Methods for Observational Comparative Effectiveness Research on Healthcare De...
Ā 
Routine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceRoutine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidance
Ā 
Ronan Herlihy on Engaging Clinicians with data on their ordering practices
Ronan Herlihy on Engaging Clinicians with data on their ordering practicesRonan Herlihy on Engaging Clinicians with data on their ordering practices
Ronan Herlihy on Engaging Clinicians with data on their ordering practices
Ā 

Similar to Safti net kick off 12092010-mrs

SAFTINet Overview for EDRC
SAFTINet Overview for EDRCSAFTINet Overview for EDRC
SAFTINet Overview for EDRCMarion Sills
Ā 
Patient Centered Care | Unit 9b Lecture
Patient Centered Care | Unit 9b LecturePatient Centered Care | Unit 9b Lecture
Patient Centered Care | Unit 9b LectureCMDLMS
Ā 
PCORI: Engaging Patients in Clinical Trials & Outcomes Research
PCORI: Engaging Patients in Clinical Trials & Outcomes ResearchPCORI: Engaging Patients in Clinical Trials & Outcomes Research
PCORI: Engaging Patients in Clinical Trials & Outcomes ResearchNational Alopecia Areata Foundation
Ā 
Clinical Analytics
Clinical AnalyticsClinical Analytics
Clinical AnalyticsMichael Bice
Ā 
Sharing and standards christopher hart - clinical innovation and partnering...
Sharing and standards   christopher hart - clinical innovation and partnering...Sharing and standards   christopher hart - clinical innovation and partnering...
Sharing and standards christopher hart - clinical innovation and partnering...Christopher Hart
Ā 
Nursing Role and scope.docx
Nursing Role and scope.docxNursing Role and scope.docx
Nursing Role and scope.docxwrite30
Ā 
The Role of Data Lakes in Healthcare
The Role of Data Lakes in HealthcareThe Role of Data Lakes in Healthcare
The Role of Data Lakes in HealthcarePerficient, Inc.
Ā 
Data Standards and Interoperability in Clinical Research and Data Management
Data Standards and Interoperability in Clinical Research and Data ManagementData Standards and Interoperability in Clinical Research and Data Management
Data Standards and Interoperability in Clinical Research and Data ManagementClinosolIndia
Ā 
Chapter 6
Chapter 6Chapter 6
Chapter 6TNUOnline
Ā 
Powering Medical Research With Data: The Research Analytics Adoption Model
Powering Medical Research With Data: The Research Analytics Adoption ModelPowering Medical Research With Data: The Research Analytics Adoption Model
Powering Medical Research With Data: The Research Analytics Adoption ModelHealth Catalyst
Ā 
Evaluation of a Clinical Information System
Evaluation of a Clinical Information SystemEvaluation of a Clinical Information System
Evaluation of a Clinical Information Systemnrodrock
Ā 
Computer System Validation with privacy zones, e-source and clinical trials b...
Computer System Validation with privacy zones, e-source and clinical trials b...Computer System Validation with privacy zones, e-source and clinical trials b...
Computer System Validation with privacy zones, e-source and clinical trials b...Wolfgang Kuchinke
Ā 
Computer validation of e-source and EHR in clinical trials-Kuchinke
Computer validation of e-source and EHR in clinical trials-KuchinkeComputer validation of e-source and EHR in clinical trials-Kuchinke
Computer validation of e-source and EHR in clinical trials-KuchinkeWolfgang Kuchinke
Ā 
Computer System Validation - privacy zones, eSource and EHR data in clinical ...
Computer System Validation - privacy zones, eSource and EHR data in clinical ...Computer System Validation - privacy zones, eSource and EHR data in clinical ...
Computer System Validation - privacy zones, eSource and EHR data in clinical ...Wolfgang Kuchinke
Ā 
Deborah Schaler - EHPR 2014 - Patient Feedback Research
Deborah Schaler - EHPR 2014 - Patient Feedback ResearchDeborah Schaler - EHPR 2014 - Patient Feedback Research
Deborah Schaler - EHPR 2014 - Patient Feedback ResearchDeborah Schaler
Ā 
Brad Doebbeling Slides for AHRQ Kick-Off Event
Brad Doebbeling Slides for AHRQ Kick-Off EventBrad Doebbeling Slides for AHRQ Kick-Off Event
Brad Doebbeling Slides for AHRQ Kick-Off EventShawnHoke
Ā 
Microsoft: A Waking Giant In Healthcare Analytics and Big Data
Microsoft: A Waking Giant In Healthcare Analytics and Big DataMicrosoft: A Waking Giant In Healthcare Analytics and Big Data
Microsoft: A Waking Giant In Healthcare Analytics and Big DataHealth Catalyst
Ā 
Digital transformation to enable a FAIR approach for health data science
Digital transformation to enable a FAIR approach for health data scienceDigital transformation to enable a FAIR approach for health data science
Digital transformation to enable a FAIR approach for health data scienceVarsha Khodiyar
Ā 
Microsoft: A Waking Giant in Healthcare Analytics and Big Data
Microsoft: A Waking Giant in Healthcare Analytics and Big DataMicrosoft: A Waking Giant in Healthcare Analytics and Big Data
Microsoft: A Waking Giant in Healthcare Analytics and Big DataDale Sanders
Ā 
Chapter 25
Chapter 25Chapter 25
Chapter 25bodo-con
Ā 

Similar to Safti net kick off 12092010-mrs (20)

SAFTINet Overview for EDRC
SAFTINet Overview for EDRCSAFTINet Overview for EDRC
SAFTINet Overview for EDRC
Ā 
Patient Centered Care | Unit 9b Lecture
Patient Centered Care | Unit 9b LecturePatient Centered Care | Unit 9b Lecture
Patient Centered Care | Unit 9b Lecture
Ā 
PCORI: Engaging Patients in Clinical Trials & Outcomes Research
PCORI: Engaging Patients in Clinical Trials & Outcomes ResearchPCORI: Engaging Patients in Clinical Trials & Outcomes Research
PCORI: Engaging Patients in Clinical Trials & Outcomes Research
Ā 
Clinical Analytics
Clinical AnalyticsClinical Analytics
Clinical Analytics
Ā 
Sharing and standards christopher hart - clinical innovation and partnering...
Sharing and standards   christopher hart - clinical innovation and partnering...Sharing and standards   christopher hart - clinical innovation and partnering...
Sharing and standards christopher hart - clinical innovation and partnering...
Ā 
Nursing Role and scope.docx
Nursing Role and scope.docxNursing Role and scope.docx
Nursing Role and scope.docx
Ā 
The Role of Data Lakes in Healthcare
The Role of Data Lakes in HealthcareThe Role of Data Lakes in Healthcare
The Role of Data Lakes in Healthcare
Ā 
Data Standards and Interoperability in Clinical Research and Data Management
Data Standards and Interoperability in Clinical Research and Data ManagementData Standards and Interoperability in Clinical Research and Data Management
Data Standards and Interoperability in Clinical Research and Data Management
Ā 
Chapter 6
Chapter 6Chapter 6
Chapter 6
Ā 
Powering Medical Research With Data: The Research Analytics Adoption Model
Powering Medical Research With Data: The Research Analytics Adoption ModelPowering Medical Research With Data: The Research Analytics Adoption Model
Powering Medical Research With Data: The Research Analytics Adoption Model
Ā 
Evaluation of a Clinical Information System
Evaluation of a Clinical Information SystemEvaluation of a Clinical Information System
Evaluation of a Clinical Information System
Ā 
Computer System Validation with privacy zones, e-source and clinical trials b...
Computer System Validation with privacy zones, e-source and clinical trials b...Computer System Validation with privacy zones, e-source and clinical trials b...
Computer System Validation with privacy zones, e-source and clinical trials b...
Ā 
Computer validation of e-source and EHR in clinical trials-Kuchinke
Computer validation of e-source and EHR in clinical trials-KuchinkeComputer validation of e-source and EHR in clinical trials-Kuchinke
Computer validation of e-source and EHR in clinical trials-Kuchinke
Ā 
Computer System Validation - privacy zones, eSource and EHR data in clinical ...
Computer System Validation - privacy zones, eSource and EHR data in clinical ...Computer System Validation - privacy zones, eSource and EHR data in clinical ...
Computer System Validation - privacy zones, eSource and EHR data in clinical ...
Ā 
Deborah Schaler - EHPR 2014 - Patient Feedback Research
Deborah Schaler - EHPR 2014 - Patient Feedback ResearchDeborah Schaler - EHPR 2014 - Patient Feedback Research
Deborah Schaler - EHPR 2014 - Patient Feedback Research
Ā 
Brad Doebbeling Slides for AHRQ Kick-Off Event
Brad Doebbeling Slides for AHRQ Kick-Off EventBrad Doebbeling Slides for AHRQ Kick-Off Event
Brad Doebbeling Slides for AHRQ Kick-Off Event
Ā 
Microsoft: A Waking Giant In Healthcare Analytics and Big Data
Microsoft: A Waking Giant In Healthcare Analytics and Big DataMicrosoft: A Waking Giant In Healthcare Analytics and Big Data
Microsoft: A Waking Giant In Healthcare Analytics and Big Data
Ā 
Digital transformation to enable a FAIR approach for health data science
Digital transformation to enable a FAIR approach for health data scienceDigital transformation to enable a FAIR approach for health data science
Digital transformation to enable a FAIR approach for health data science
Ā 
Microsoft: A Waking Giant in Healthcare Analytics and Big Data
Microsoft: A Waking Giant in Healthcare Analytics and Big DataMicrosoft: A Waking Giant in Healthcare Analytics and Big Data
Microsoft: A Waking Giant in Healthcare Analytics and Big Data
Ā 
Chapter 25
Chapter 25Chapter 25
Chapter 25
Ā 

More from Marion Sills

Measuring and Enhancing Your Academic Medical Impact
Measuring and Enhancing Your Academic Medical ImpactMeasuring and Enhancing Your Academic Medical Impact
Measuring and Enhancing Your Academic Medical ImpactMarion Sills
Ā 
Social Media for CU's Division of Pediatric Emergency Medicine
Social Media for CU's Division of Pediatric Emergency MedicineSocial Media for CU's Division of Pediatric Emergency Medicine
Social Media for CU's Division of Pediatric Emergency MedicineMarion Sills
Ā 
Adding Social Determinant Data Changes Childrenā€™s Hospitalsā€™ Readmissions Per...
Adding Social Determinant Data Changes Childrenā€™s Hospitalsā€™ Readmissions Per...Adding Social Determinant Data Changes Childrenā€™s Hospitalsā€™ Readmissions Per...
Adding Social Determinant Data Changes Childrenā€™s Hospitalsā€™ Readmissions Per...Marion Sills
Ā 
ED abdominal pain lecture
ED abdominal pain lectureED abdominal pain lecture
ED abdominal pain lectureMarion Sills
Ā 
Stakeholder Engagement in a Patient-Reported Outcomes Implementation by a Pra...
Stakeholder Engagement in a Patient-Reported Outcomes Implementation by a Pra...Stakeholder Engagement in a Patient-Reported Outcomes Implementation by a Pra...
Stakeholder Engagement in a Patient-Reported Outcomes Implementation by a Pra...Marion Sills
Ā 
2015 0128 SAFTINet Research & Quality Improvement Quarterly Meeting.
2015 0128 SAFTINet Research & Quality Improvement Quarterly Meeting.2015 0128 SAFTINet Research & Quality Improvement Quarterly Meeting.
2015 0128 SAFTINet Research & Quality Improvement Quarterly Meeting.Marion Sills
Ā 
2014 0423 rqi meeting uds 2.0 and convocation project ideas
2014 0423 rqi meeting uds 2.0 and convocation project ideas2014 0423 rqi meeting uds 2.0 and convocation project ideas
2014 0423 rqi meeting uds 2.0 and convocation project ideasMarion Sills
Ā 
Practice Variability in and Correlates of Patient-Centered Medical Home Chara...
Practice Variability in and Correlates of Patient-Centered Medical Home Chara...Practice Variability in and Correlates of Patient-Centered Medical Home Chara...
Practice Variability in and Correlates of Patient-Centered Medical Home Chara...Marion Sills
Ā 
SAFTINet CER Asthma Protocol
SAFTINet CER Asthma ProtocolSAFTINet CER Asthma Protocol
SAFTINet CER Asthma ProtocolMarion Sills
Ā 
CEMRC H1N1 Presentation 20100614
CEMRC H1N1 Presentation 20100614CEMRC H1N1 Presentation 20100614
CEMRC H1N1 Presentation 20100614Marion Sills
Ā 
Patient-reported outcomes for asthma in children and adults
Patient-reported outcomes for asthma in children and adultsPatient-reported outcomes for asthma in children and adults
Patient-reported outcomes for asthma in children and adultsMarion Sills
Ā 
Implementing Point-of-Care PROMs
Implementing Point-of-Care PROMsImplementing Point-of-Care PROMs
Implementing Point-of-Care PROMsMarion Sills
Ā 
Pec cv pro workgroup 3 21 12
Pec cv pro workgroup 3 21 12Pec cv pro workgroup 3 21 12
Pec cv pro workgroup 3 21 12Marion Sills
Ā 
ACT Implementation in SAFTINet
ACT Implementation in SAFTINetACT Implementation in SAFTINet
ACT Implementation in SAFTINetMarion Sills
Ā 
Cv pro overview 2 may 2012
Cv pro overview 2 may 2012Cv pro overview 2 may 2012
Cv pro overview 2 may 2012Marion Sills
Ā 
Med adherence 2 july 2012
Med adherence 2 july 2012Med adherence 2 july 2012
Med adherence 2 july 2012Marion Sills
Ā 
Med adherence and self efficacy
Med adherence and self efficacyMed adherence and self efficacy
Med adherence and self efficacyMarion Sills
Ā 
Cer safti net overview edrc 1 feb 2011
Cer safti net overview edrc 1 feb 2011Cer safti net overview edrc 1 feb 2011
Cer safti net overview edrc 1 feb 2011Marion Sills
Ā 
Pec research overview 19 jan2011
Pec research overview 19 jan2011Pec research overview 19 jan2011
Pec research overview 19 jan2011Marion Sills
Ā 
Data validation 12 sept 2011
Data validation 12 sept 2011Data validation 12 sept 2011
Data validation 12 sept 2011Marion Sills
Ā 

More from Marion Sills (20)

Measuring and Enhancing Your Academic Medical Impact
Measuring and Enhancing Your Academic Medical ImpactMeasuring and Enhancing Your Academic Medical Impact
Measuring and Enhancing Your Academic Medical Impact
Ā 
Social Media for CU's Division of Pediatric Emergency Medicine
Social Media for CU's Division of Pediatric Emergency MedicineSocial Media for CU's Division of Pediatric Emergency Medicine
Social Media for CU's Division of Pediatric Emergency Medicine
Ā 
Adding Social Determinant Data Changes Childrenā€™s Hospitalsā€™ Readmissions Per...
Adding Social Determinant Data Changes Childrenā€™s Hospitalsā€™ Readmissions Per...Adding Social Determinant Data Changes Childrenā€™s Hospitalsā€™ Readmissions Per...
Adding Social Determinant Data Changes Childrenā€™s Hospitalsā€™ Readmissions Per...
Ā 
ED abdominal pain lecture
ED abdominal pain lectureED abdominal pain lecture
ED abdominal pain lecture
Ā 
Stakeholder Engagement in a Patient-Reported Outcomes Implementation by a Pra...
Stakeholder Engagement in a Patient-Reported Outcomes Implementation by a Pra...Stakeholder Engagement in a Patient-Reported Outcomes Implementation by a Pra...
Stakeholder Engagement in a Patient-Reported Outcomes Implementation by a Pra...
Ā 
2015 0128 SAFTINet Research & Quality Improvement Quarterly Meeting.
2015 0128 SAFTINet Research & Quality Improvement Quarterly Meeting.2015 0128 SAFTINet Research & Quality Improvement Quarterly Meeting.
2015 0128 SAFTINet Research & Quality Improvement Quarterly Meeting.
Ā 
2014 0423 rqi meeting uds 2.0 and convocation project ideas
2014 0423 rqi meeting uds 2.0 and convocation project ideas2014 0423 rqi meeting uds 2.0 and convocation project ideas
2014 0423 rqi meeting uds 2.0 and convocation project ideas
Ā 
Practice Variability in and Correlates of Patient-Centered Medical Home Chara...
Practice Variability in and Correlates of Patient-Centered Medical Home Chara...Practice Variability in and Correlates of Patient-Centered Medical Home Chara...
Practice Variability in and Correlates of Patient-Centered Medical Home Chara...
Ā 
SAFTINet CER Asthma Protocol
SAFTINet CER Asthma ProtocolSAFTINet CER Asthma Protocol
SAFTINet CER Asthma Protocol
Ā 
CEMRC H1N1 Presentation 20100614
CEMRC H1N1 Presentation 20100614CEMRC H1N1 Presentation 20100614
CEMRC H1N1 Presentation 20100614
Ā 
Patient-reported outcomes for asthma in children and adults
Patient-reported outcomes for asthma in children and adultsPatient-reported outcomes for asthma in children and adults
Patient-reported outcomes for asthma in children and adults
Ā 
Implementing Point-of-Care PROMs
Implementing Point-of-Care PROMsImplementing Point-of-Care PROMs
Implementing Point-of-Care PROMs
Ā 
Pec cv pro workgroup 3 21 12
Pec cv pro workgroup 3 21 12Pec cv pro workgroup 3 21 12
Pec cv pro workgroup 3 21 12
Ā 
ACT Implementation in SAFTINet
ACT Implementation in SAFTINetACT Implementation in SAFTINet
ACT Implementation in SAFTINet
Ā 
Cv pro overview 2 may 2012
Cv pro overview 2 may 2012Cv pro overview 2 may 2012
Cv pro overview 2 may 2012
Ā 
Med adherence 2 july 2012
Med adherence 2 july 2012Med adherence 2 july 2012
Med adherence 2 july 2012
Ā 
Med adherence and self efficacy
Med adherence and self efficacyMed adherence and self efficacy
Med adherence and self efficacy
Ā 
Cer safti net overview edrc 1 feb 2011
Cer safti net overview edrc 1 feb 2011Cer safti net overview edrc 1 feb 2011
Cer safti net overview edrc 1 feb 2011
Ā 
Pec research overview 19 jan2011
Pec research overview 19 jan2011Pec research overview 19 jan2011
Pec research overview 19 jan2011
Ā 
Data validation 12 sept 2011
Data validation 12 sept 2011Data validation 12 sept 2011
Data validation 12 sept 2011
Ā 

Recently uploaded

High Profile Call Girls Jaipur Vani 8445551418 Independent Escort Service Jaipur
High Profile Call Girls Jaipur Vani 8445551418 Independent Escort Service JaipurHigh Profile Call Girls Jaipur Vani 8445551418 Independent Escort Service Jaipur
High Profile Call Girls Jaipur Vani 8445551418 Independent Escort Service Jaipurparulsinha
Ā 
Housewife Call Girls Hoskote | 7001305949 At Low Cost Cash Payment Booking
Housewife Call Girls Hoskote | 7001305949 At Low Cost Cash Payment BookingHousewife Call Girls Hoskote | 7001305949 At Low Cost Cash Payment Booking
Housewife Call Girls Hoskote | 7001305949 At Low Cost Cash Payment Bookingnarwatsonia7
Ā 
Call Girls Jayanagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jayanagar Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Jayanagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jayanagar Just Call 7001305949 Top Class Call Girl Service Availablenarwatsonia7
Ā 
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Availablenarwatsonia7
Ā 
Call Girl Koramangala | 7001305949 At Low Cost Cash Payment Booking
Call Girl Koramangala | 7001305949 At Low Cost Cash Payment BookingCall Girl Koramangala | 7001305949 At Low Cost Cash Payment Booking
Call Girl Koramangala | 7001305949 At Low Cost Cash Payment Bookingnarwatsonia7
Ā 
Vip Call Girls Anna Salai Chennai šŸ‘‰ 8250192130 ā£ļøšŸ’Æ Top Class Girls Available
Vip Call Girls Anna Salai Chennai šŸ‘‰ 8250192130 ā£ļøšŸ’Æ Top Class Girls AvailableVip Call Girls Anna Salai Chennai šŸ‘‰ 8250192130 ā£ļøšŸ’Æ Top Class Girls Available
Vip Call Girls Anna Salai Chennai šŸ‘‰ 8250192130 ā£ļøšŸ’Æ Top Class Girls AvailableNehru place Escorts
Ā 
Call Girl Surat Madhuri 7001305949 Independent Escort Service Surat
Call Girl Surat Madhuri 7001305949 Independent Escort Service SuratCall Girl Surat Madhuri 7001305949 Independent Escort Service Surat
Call Girl Surat Madhuri 7001305949 Independent Escort Service Suratnarwatsonia7
Ā 
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...narwatsonia7
Ā 
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call NowKolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call NowNehru place Escorts
Ā 
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service MumbaiLow Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbaisonalikaur4
Ā 
Call Girl Bangalore Nandini 7001305949 Independent Escort Service Bangalore
Call Girl Bangalore Nandini 7001305949 Independent Escort Service BangaloreCall Girl Bangalore Nandini 7001305949 Independent Escort Service Bangalore
Call Girl Bangalore Nandini 7001305949 Independent Escort Service Bangalorenarwatsonia7
Ā 
Asthma Review - GINA guidelines summary 2024
Asthma Review - GINA guidelines summary 2024Asthma Review - GINA guidelines summary 2024
Asthma Review - GINA guidelines summary 2024Gabriel Guevara MD
Ā 
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...narwatsonia7
Ā 
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment BookingCall Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment BookingNehru place Escorts
Ā 
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Availablenarwatsonia7
Ā 
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Availablenarwatsonia7
Ā 
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...Miss joya
Ā 
Call Girls Thane Just Call 9910780858 Get High Class Call Girls Service
Call Girls Thane Just Call 9910780858 Get High Class Call Girls ServiceCall Girls Thane Just Call 9910780858 Get High Class Call Girls Service
Call Girls Thane Just Call 9910780858 Get High Class Call Girls Servicesonalikaur4
Ā 
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...Miss joya
Ā 
Sonagachi Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Sonagachi Call Girls Services 9907093804 @24x7 High Class Babes Here Call NowSonagachi Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Sonagachi Call Girls Services 9907093804 @24x7 High Class Babes Here Call NowRiya Pathan
Ā 

Recently uploaded (20)

High Profile Call Girls Jaipur Vani 8445551418 Independent Escort Service Jaipur
High Profile Call Girls Jaipur Vani 8445551418 Independent Escort Service JaipurHigh Profile Call Girls Jaipur Vani 8445551418 Independent Escort Service Jaipur
High Profile Call Girls Jaipur Vani 8445551418 Independent Escort Service Jaipur
Ā 
Housewife Call Girls Hoskote | 7001305949 At Low Cost Cash Payment Booking
Housewife Call Girls Hoskote | 7001305949 At Low Cost Cash Payment BookingHousewife Call Girls Hoskote | 7001305949 At Low Cost Cash Payment Booking
Housewife Call Girls Hoskote | 7001305949 At Low Cost Cash Payment Booking
Ā 
Call Girls Jayanagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jayanagar Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Jayanagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jayanagar Just Call 7001305949 Top Class Call Girl Service Available
Ā 
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
Ā 
Call Girl Koramangala | 7001305949 At Low Cost Cash Payment Booking
Call Girl Koramangala | 7001305949 At Low Cost Cash Payment BookingCall Girl Koramangala | 7001305949 At Low Cost Cash Payment Booking
Call Girl Koramangala | 7001305949 At Low Cost Cash Payment Booking
Ā 
Vip Call Girls Anna Salai Chennai šŸ‘‰ 8250192130 ā£ļøšŸ’Æ Top Class Girls Available
Vip Call Girls Anna Salai Chennai šŸ‘‰ 8250192130 ā£ļøšŸ’Æ Top Class Girls AvailableVip Call Girls Anna Salai Chennai šŸ‘‰ 8250192130 ā£ļøšŸ’Æ Top Class Girls Available
Vip Call Girls Anna Salai Chennai šŸ‘‰ 8250192130 ā£ļøšŸ’Æ Top Class Girls Available
Ā 
Call Girl Surat Madhuri 7001305949 Independent Escort Service Surat
Call Girl Surat Madhuri 7001305949 Independent Escort Service SuratCall Girl Surat Madhuri 7001305949 Independent Escort Service Surat
Call Girl Surat Madhuri 7001305949 Independent Escort Service Surat
Ā 
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Ā 
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call NowKolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Kolkata Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Ā 
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service MumbaiLow Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
Low Rate Call Girls Mumbai Suman 9910780858 Independent Escort Service Mumbai
Ā 
Call Girl Bangalore Nandini 7001305949 Independent Escort Service Bangalore
Call Girl Bangalore Nandini 7001305949 Independent Escort Service BangaloreCall Girl Bangalore Nandini 7001305949 Independent Escort Service Bangalore
Call Girl Bangalore Nandini 7001305949 Independent Escort Service Bangalore
Ā 
Asthma Review - GINA guidelines summary 2024
Asthma Review - GINA guidelines summary 2024Asthma Review - GINA guidelines summary 2024
Asthma Review - GINA guidelines summary 2024
Ā 
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Ā 
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment BookingCall Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
Call Girls Service Nandiambakkam | 7001305949 At Low Cost Cash Payment Booking
Ā 
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
Ā 
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Ā 
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
Ā 
Call Girls Thane Just Call 9910780858 Get High Class Call Girls Service
Call Girls Thane Just Call 9910780858 Get High Class Call Girls ServiceCall Girls Thane Just Call 9910780858 Get High Class Call Girls Service
Call Girls Thane Just Call 9910780858 Get High Class Call Girls Service
Ā 
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
Ā 
Sonagachi Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Sonagachi Call Girls Services 9907093804 @24x7 High Class Babes Here Call NowSonagachi Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Sonagachi Call Girls Services 9907093804 @24x7 High Class Babes Here Call Now
Ā 

Safti net kick off 12092010-mrs

  • 2. Welcome! ā€¢ Thank you for attending! ā€¢ Goals and objectives ā–« Outlining project vision and aims ā–« Meeting SAFTINet collaborators ā–« Starting the process ā–« Clarifying concerns and questions ā€¢ Agenda ā€¢ Meeting materials ā–« Research strategy ā–« SAFTINet commonly used acronyms
  • 3. Agenda Agenda Item Time Presenter Welcome and agenda SAFTINetContext and Overview 10 mins 20 mins Bethany Kwan Lisa Schilling Introductions and RollCall Project teams and investigators AAFP CINA University of Utah CHPC DHHA Cherokee Health Systems Intermountain Healthcare CCMCN/CACHIE 10 mins Bethany Kwan Comparative Effectiveness Research 10 mins Marion Sills Partner Engagement Community 10 mins Debbie Graham TechnicalTeam Presentation 10 mins Michael Kahn Getting started 5 mins Bethany Kwan Wrap-up and Questions 15 mins Lisa Schilling
  • 4. IOM Roundtable onValue & Science- Driven Health Care ā€¢ Goal: by the year 2020, 90 percent of clinical decisions will be supported by accurate, timely, and up-to-date clinical information, and will reflect the best available evidence ā€¢ Learning Healthcare System series
  • 5. IOM Roundtable onValue & Science- Driven Health Care ā€¢ The Learning Healthcare System (2006) ā€¢ Judging the Evidence: Standards for DeterminingClinical Effectiveness (2007) ā€¢ Leadership Commitments to ImproveValue in Healthcare:Toward Common Ground (2007) ā€¢ Redesigning the Clinical Effectiveness Research Paradigm: Innovation and Practice-Based Approaches (2007) ā€¢ Clinical Data as the Basic Staple of Health Learning: Creating and Protecting a PublicGood (2008) ā€¢ Engineering a Learning Healthcare System:A Look to the Future (2008) ā€¢ LearningWhat Works: Infrastructure Required for Learning Which Care Is Best (2008) ā€¢ Value in Health Care: Accounting for Cost, Quality, Safety, Outcomes and Innovation (2008)
  • 6. Comparative Effectiveness Milestones ā€¢ 2003 - MMA Section 1013 authorizes AHRQ to conduct and support research with a focus on ā€œoutcomes, comparative clinical effectiveness, and appropriateness of health care items and services (including prescription drugs)ā€ ā€¢ 2007- IOM Report - LearningWhatWorks Best:The Nationā€™s Need for Evidence on Comparative Effectiveness In Health Care ā€¢ 2009 - ARRA provides $1.1 Billion to NIH/HHS/AHRQ ā€¢ 2010 - Patient Protection and Affordable Care Act
  • 7. ā€¢ Need for substantially improved understanding of the comparative clinical effectiveness of healthcare interventions. ā€¢ Strengths of the randomized controlled trial muted by constraints in time, cost, and limited applicability. ā€¢ Opportunities presented by the size and expansion of potentially interoperable administrative and clinical datasets. ā€¢ Opportunities presented by innovative study designs and statistical tools. ā€¢ Need for innovative approaches leading to a more practical and reliable clinical research paradigm. ā€¢ Need to build a system in which clinical effectiveness research is a more natural by-product of the care process.
  • 8. Redesigning the Clinical Effectiveness Research Paradigm ā€¢ Address current limitations in applicability of research results ā€¢ Counter inefficiencies in timeliness, costs, and volume ā€¢ Define a more strategic use to the clinical experimental model ā€¢ Provide stimulus to new research designs, tools, and analytics ā€¢ Encourage innovation in clinical effectiveness research conduct ā€¢ Promote the notion of effectiveness research as a routine part of practice ā€¢ Improve access and use of clinical data as a knowledge resource ā€¢ Foster the transformational research potential of information technology ā€¢ Engage patients as full partners in the learning culture ā€¢ Build toward continuous learning in all aspects of care
  • 9. ā€¢ resulting research paradigm, with randomized controlled double blind trials at the pinnacle, has often left important evidence needs unmet when combined with the costs, complexity, and lack of generalizability of RCTs.
  • 10. ā€¢ Geisinger example of the power of proper EHR use ā€¢ (pg 28 ā€“ Redesigning)
  • 11. Why distributed? ā€¢ Minimize security risks by allowing the data repositories of multiple parties to remain separately owned and controlled. ā€¢ These models also provide an interface to these stores of highly useful data that allows them to function as a large combined dataset.
  • 12. ā€¢ Patient preferences and perspectives.What approaches might help ā€¢ to refine practical instruments to determine patient preferencesā€” ā€¢ such as NIHā€™s PROMIS (Patient-Reported Outcomes Measurement ā€¢ Information System)ā€”and apply them as central elements of outcome ā€¢ measurement?
  • 14.
  • 15. Patient Protection and Affordable Care Act- Public Law 111-148 :Subtitle D ā€¢ Patient-Centered Outcomes Research ā–« Comparative Clinical Effectiveness Research ā€¢ Defined Comparative Clinical Effectiveness Research ā–« The terms ā€˜comparative clinical effectiveness researchā€™ and ā€˜researchā€™ mean research evaluating and comparing health outcomes and the clinical effectiveness, risks, and benefits of 2 or more medical treatments, services..ā€ as describedā€¦
  • 16. Patient Protection and Affordable Care Act- Public Law 111-148 :Subtitle D ā€¢ Medical treatments, services, and items described in this subparagraph are health care interventions, protocols for treatment, care management, and delivery, procedures, medical devices, diagnostic tools, pharmaceuticals (including drugs and biologicals), integrative health practices, and any other strategies or items being used in the treatment, management, and diagnosis of, or prevention of illness or injury in, individuals.
  • 17. Patient Protection and Affordable Care Act- thereā€™s more ā€¢ Established Patient-Centered Outcomes Research Institute (PCORI), a non-profit corporation with duties including: ā–« Identifying national research priorities ā–« Establish a research agenda to address these priorities ā–« Carry out the research agenda (systematic reviews, primary research, funding) ā–« Disseminate
  • 18. SAFTINet Overview ā€¢ AHRQ ARRA OS: Recovery Act 2009: Scalable Distributed Research Networks forComparative Effectiveness Research (R01) ā€¢ Goal: enhance the capability and capacity of electronic health networks designed for distributed research to conduct prospective, comparative effectiveness research on outcomes of clinical interventions. ā€¢ These distributed research network projects will: ļ‚– Build on and expand existing electronic health infrastructure ļ‚– Broad, scalable and sustainable systems ļ‚– Enable the collection of longitudinal and comprehensive data across diverse healthcare delivery settings ļ‚– Evaluate effectiveness of clinical interventions for a diverse set of clinical conditions.
  • 19. $1.1 Billion -ARRA Allocations ā€¢ Research ā€¢ Data Infrastructure ā€¢ Dissemination and Adoption ā€¢ Administrative support, inventory, evaluation ā€¢ $681 M (62%) ā€¢ $268 M (24%) ā€¢ $132 M (12%) ā€¢ $ 19 M ( 2%)
  • 20. Federal Coordinating Council for Comparative Effectiveness and Research (FCC) ā€¢ FCC-CER IOM ā€¢ Data infrastructure ā€¢ Dissemination and translation ā€¢ Human and scientific capital ā€¢ Real-world settings for subpopulations, priority conditions and interventions ā€¢ 100 top priority CER topics ā€“ 50% focus on health care delivery systems ā€“ Only three of the topics are narrowly focused on drug vs. drug ā€¢ Enhanced State Data for Analysis andTracking of Comparative Effectiveness Impact: Improved ClinicalContent and Race-Ethnicity Data ā€¢ Registry of Patient Registries ā€¢ Select examples of AHRQ funding ā€¢ Electronic Data Methods (EDM) Forum for Comparative Effectiveness Researchā€¢ Enhanced Registries for Quality Improvement and Comparative Effectiveness Research Select examples of OS funding
  • 21. AHRQ Support of Actionable Evidence ā€¢ 15 Evidence-based Practice Centers (EPCs), ā€¢ 13 Developing Evidence to Inform Decisions about Effectiveness (DEcIDE) Network, ā€¢ 14 Centers for Education and Research on Therapeutics (CERTs),
  • 22. AHRQ Support of CER ā€¢ CER Methodology - 19 funded projects -**** ā€¢ Laurer, Collins JAMA 2010:303;2182
  • 23. Why CER Physicians, health insurers, & patients need information about the CE and safety of drugs, devices, therapies and processes of care. Non-randomized studies using data collected primarily for care (or billing) can supplement the evidence of RCT. Improving the value of CER means improving: data collection & use, data availability and access, CER methodology (design, analysis) and reporting.
  • 24. Cart before horse ā€¢ 1904 first radical prostectomy ā€¢ Jan 2010 1st US RCT active survelleince vs RP for localized prostate Ca ā€¢ 100 years of action without evidence
  • 25. Project Requirements ā€¢ Primary focus ā–« Develop an electronic health network that collects and links data from multiple and different healthcare delivery settings ļ‚– Capability for near-real time data extraction of de-identified patient-level data, data analysis, and new data collection at the POC ā–« Demonstrate capabilities for conducting methodologically rigorous Comparative Effectiveness Research (CER) ļ‚– Capability for collecting HRQoL measures, other patient- reported outcomes at the POC
  • 26. Funded Projects ā€¢ Scalable Architecture for FederatedTherapeutic Inquiries Network (SAFTINet) ā–« Lisa M. Schilling, University of Colorado Denver (R01 HS19908-01) ā€¢ SCANNER: Scalable National Network for Effectiveness Research ā–« Lucila Ohno-Machado, University of California San Diego (R01 HS19913-01) ā€¢ Scalable PArtnering Network for CER: Across Lifespan, Conditions, and Settings ā–« John F. Steiner, Kaiser Foundation Research Institute (R01 HS19912-01)
  • 27. SAFTINet Governance AHRQProjectOfficer Lisa Schilling, MD, MSPH Principal Investigator David West, PhD Co-investigator Project Oversight Michael Kahn, MD, PhD Co-investigator DARTNet/SAFTINet Informatics Cathy Bryan, RN, MHA QED Clinical, Inc. d/b/a CINA Julio Facelli, PhD Univ of Utah Center for High Performance Computing SAFTINetTechnical Team Wison Pace, MD Co-investigator DARTNet/SAFTINet Informatics Art Davidson, MD, MSPH Co-investigator DH Informatics, Medicaid Relationships Marion Sills, MD, MPH Co-investigator CER, Cohort Development SAFTINet Comparative Effectiveness ResearchTeam DebbieGraham, MSPH AAFP/NRN Partner Engagement Community SAFTINet Partner Engagement Community Group Bethany Kwan, PhD, MSPH Project Manager
  • 28. Research Partnership and LearningCommunity ā€¢ Specific Aim 1: Establish a broad, safety-net focused, research partnership and learning community to govern relationships, establish priorities, provide data quality oversight, and evaluate the purpose and value of the communityā€™s effort that leverages the established governance structure of DARTNet. ā€¢ Overall Goal: Create a trusted, valued multi-state community of safety net stakeholders and researchers to lead and participate in a learning community to address evidence-gaps relevant to the safety net populations ā€“ with special emphasis upon those populations served by Medicaid and State Child Health Insurance Program (SCHIP).
  • 29. Technology Development ā€¢ Specific Aim 2: Extend the DARTNet framework to build, deploy and assess a safety-net focused distributed research network which combines ambulatory and inpatient clinical data and Medicaid claims and eligibility data for clinical and research purposes ā€¢ Overall Goal: Build the technology necessary to support a valued, virtual organization that securely federates clinical EHR and Medicaid/CHIP+ data, (consistent with Medicaid agency efforts to develop Medicaid InformationTechnologyArchitecture plans and systems) to promote quality care and provide enhanced data for comparative effectiveness research.
  • 30. Comparative Effectiveness Research ā€¢ The conduct and synthesis of research comparing the benefits and harms of different interventions and strategies to prevent, diagnose, treat and monitor health conditions in ā€œreal worldā€ settings. ā–« Including delivery system strategies ā€¢ Specific Aim 3: Develop and enhance four sentinel cohort pairs of patients with asthma (pediatric and adult), hypertension, and hypercholesterolemia distinguished by their care delivery characteristics which can support comparative effectiveness research. ā–« System-level factors ļ‚– Patient-Centered Medical Home ļ‚– Integrated Mental Health care ā–« Enhanced data collection at point-of-care
  • 31. Introductions ā€¢ BRIEF organizational descriptions, roles and personnel ā€¢ Roll Call ā€¢ Investigator bios and full research strategy posted on SharePoint site
  • 32. Project team investigators Partner Engagement Community TechnicalTeam Investigators ā€¢ Debbie Graham (AAFP) ā€¢ Jeanne Rozwadowski (DHHA) ā€¢ Lucy Savitz (IMH) ā€¢ Parinda Khatri (CHS) ā€¢ Heather Stocker (CCMCN) ā€¢ Bethany Kwan (UCD) ā€¢ Lisa Schilling (UCD) ā€¢ Michael Kahn (UCD) ā€¢ Wilson Pace (UCD) ā€¢ Julio Facelli (Utah) ā€¢ Cathy Bryan (CINA) ā€¢ Ron Price (Utah) ā€¢ Jim May (CINA) ā€¢ Art Davidson (DHHA) ā€¢ Nathan Hulse (IMH) ā€¢ Lisa Schilling (UCD)
  • 33. Project team investigators CERTeam Investigators ā€¢ Marion Sills (UCD) ā€¢ Elaine Morrato (UCD) ā€¢ Lisa Schilling (UCD) ā€¢ Karl Hammermeister (UCD) ā€¢ Monica Federico (UCD) ā€¢ Ben Miller (UCD) ā€¢ RobValuck (UCD) ā€¢ Diane Fairclough (UCD) ā€¢ Bethany Kwan (UCD) ā€¢ BarbaraYawn (consultant) ā€¢ Lucy Savitz (IMH) ā€¢ Brian Sauer (Utah) SAFTINet CERTeam CER Methodology Experts Health Outcomes Content Experts Health Care Delivery System and Process Experts
  • 34. AmericanAcademy of Family Physicians (AAFP) National Research Network (NRN) ā€¢ Personnel: ā–« DebbieGraham, MSPH, AAFP Site PI ā–« Elias Brandt, Research SystemsAnalyst ā–« Project Manager, to be hired ā€¢ Established in 1999 to conduct, support, promote, and advocate for primary care research in practice-based settings. ā€¢ Role in project: ā–« Coordination with CINA activities ā–« Partner EngagementCommunity leadership
  • 35. QED Clinical, Inc. d/b/a CINA ā€¢ Personnel ā–« Cathy Bryan, MHA, BSN, RN, Chief ClinicalOfficer ā–« Jim May, MBA, Chief Executive Officer ā–« Project Manager, to be named ā€¢ CINA provides innovative technology solutions that support quality focused, evidence-based health care. ā€¢ CINA technology can be used for discrete, validated data extraction virtually real-time from ambulatory clinical records for research purposes. ā€¢ CINA also provides tools for Point of Care decision support, Population reporting, and Disease Registries http://cina-us.com/ ā€¢ Project Role ā–« Data extraction, standardization, reporting processes (Cherokee) ā–« Data aggregation across sources (Cherokee, Medicaid) and sharing with SAFTINet , as applicable ā–« Contributing to technological development for scalable, distributed networking
  • 36. University of Utah Center for High Performance Computing (CHPC) and Biomedical Informatics (BMI) ā€¢ Personnel andTechnicalTeam: ā–« Julio Facelli, PhD, CHPC Director, BMIVice Chair, PI of UtahTeam ā–« Ron Price, Sr. Software Engineer/Architect and Project Manager ā–« Derick Huth, Jr. Software Engineer ā–« Jody Smith, DatabaseAdministrator ā–« Walter Scott, DatabaseAdministrator ā–« Steve Harper, SystemAdministrator ā€¢ Project role ā–« Build the Grid
  • 37. Cherokee Health Systems, Inc. ā€¢ Personnel ā–« Parinda Khatri, PhD,CHS Director of Integrated Care, CHS Site PI ā–« Jeff Howard, CPA, CHS Chief FinancialOfficer ā–« Bob Franko, MBA, CHS training and marketing ā–« Monty Bryant, BS, Programmer/Analyst ā–« Jennifer Poling, MBA, DataAnalyst ā€¢ Cherokee Health Systems is a network of 20 clinical sites in 14 counties inTennessee, with strategic emphases on integration of behavioral health and primary care, outreach to underserved populations, and safety net preservation (http://www.cherokeehealth.com ) ā€¢ Project role ā–« Collaboration on technical and Partner EngagementCommunity teams ā–« Supporting participatingCherokee practices for data sharing, point of care data collection, and data use
  • 38. Intermountain Healthcare ā€¢ Personnel ā–« Lucy Savitz, PhD, MBA, Director of Research and Education, Institute for Health Care Delivery Research, Intermountain site PI ā–« Nathan Hulse, PhD, Intermountain informaticist ā–« Brian Sauer, PhD,CER methodology expert ā–« AmyWuthrich, MS, Project Manager ā€¢ Non-for-profit integrated health care delivery network of 24 hospitals, more than 130 outpatient clinics, a 1,000 member employed physician group with 2,000+ affiliated physicians, and associated care delivery support functions located in Utah and southeastern Idaho. ā€¢ Project roles ā–« Collaboration on technical, CER, and Partner EngagementCommunity teams ā–« Supporting participating Intermountain practices for data sharing, point of care data collection, and data use
  • 39. CCMCN/CACHIE ā€¢ Personnel ā–« JasonGreer, CACHIE Director ā–« DanTuteur, CCMCN Executive Director ā–« Heather Stocker, CCMCN Director of Clinical Programs & Development ā€¢ ColoradoCommunity ManagedCare Network (CCMCN) ā–« A non-profit Network of 15 Federally Qualified Health Centers (FQHCs) providing primary health care services to the medically underserved throughout Colorado. ā€¢ ColoradoAssociated Community Health Information Enterprise (CACHIE) ā–« Built and maintains a shared data warehouse on behalf of CCMCN health centers ā€¢ Project Role ā–« Collaboration on technical and Partner EngagementCommunity teams ā–« Supporting two participatingColoradoCommunity Health Centers for data sharing, point of care data collection, and data use
  • 40. Denver Health & Hospital Authority (DHHA) ā€¢ Personnel ā–« Art Davidson, MD, MSPH, SAFTINet Co-Investigator ā–« Jeanne Rozwadowski, MD, DHHA Site Co-investigator ā–« Dean McEwen, MS, Informatics ā€¢ Vertically integrated, public urban safety net health care system ā–« Eight federally qualified community health centers, twelve school-based clinics in the Denver public school system ā€¢ Project roles ā–« Collaboration on technical and Partner Engagement Community teams ā–« Supporting participating DHHA FQHCs for data sharing, point of care data collection, and data use
  • 41. Project teams ā€¢ Partner Engagement Community ā€¢ Technical team ā€¢ Comparative effectiveness research team
  • 42. Partner Engagement Community ā€¢ Mission ā€¢ Culture of collaboration ā€¢ Community-based participatory research ā€¢ Objectives ā€¢ Vehicle for communications between partners ā€¢ Decision making (e.g., POC data collection) ā€¢ Encouraging members to identify topics, bring value to stakeholders, prioritize future CER questions ā€¢ LearningCommunity ā€¢ Membership ā€¢ Meet monthly ā€“ 1st Wednesday at 12:00 MT/1:00CT/2:00 ET ā€¢ Listserv
  • 43. TechnicalTeam Presentations ā€¢ Aims and objectives ā€¢ Process ā–« Technical requirements ā€¢ Milestones and timeline ā–« Build the grid ā–« Set up the nodes ā–« End of year 1 goal:Two entities with nodes on the grid
  • 44. Informatics Objectives: Starting with the End Objectives ā€¢ What we need to accomplish: ļ‚– A way for local participants to control what data are and are not available for collaborative projects - what is ā€œon the gridā€ ļ‚– A way to control who/what/where/when/why for all data access ļ‚– A way to ensure patient confidentiality ļ‚– A way to include patient-reported data ļ‚– A way to include State Medicaid data ā€¢ Not all of the technical details are completely determined ļ‚– Some ā€œgivensā€; others open for negotiation ļ‚– Need to engage the various technical teams
  • 45. EHR Color code: ā€¢ Blue = A given ā€¢Yellow = Optional ā€¢Red = Still in analysis ā€¢ EHR: Electronic Health Record
  • 46. CER/CDS DM Other EHR Color code: ā€¢ Blue = A given ā€¢Yellow = Optional ā€¢Red = Still in analysis In SAFTINet participants, we have: ā€¢CINA CDR ā€¢Local data warehouse ā€¢ EHR: Electronic Health Record ā€¢ Other data sources include: claims, hospital, and third party databases ā€¢ CER/CDS DM: Comparative effectiveness research/Clinical decision support data mart
  • 47. PE CER/CDS DM Other EHR Guideline protocols Patient specific report Practice provider reports Color code: ā€¢ Blue = A given ā€¢Yellow = Optional ā€¢Red = Still in analysis ā€¢ EHR: Electronic Health Record ā€¢ Other data sources include: claims, hospital, and third party databases ā€¢ CER/CDS DM: Comparative effectiveness research/Clinical decision support data mart ā€¢ PE: Protocol Engine
  • 48. PE CER/CDS DM Other EHR Guideline protocols Patient specific report Practice provider reports Color code: ā€¢ Blue = A given ā€¢Yellow = Optional ā€¢Red = Still in analysis Shared Data w/ PHI Shared Data Encrypted Developed and Supported by SAFTINet ā€¢ EHR: Electronic Health Record ā€¢ Other data sources include: claims, hospital, and third party databases ā€¢ CER/CDS DM: Comparative effectiveness research/Clinical decision support data mart ā€¢ PE: Protocol Engine
  • 49. PE CER/CDS DM Other EHR Guideline protocols Patient specific report Practice provider reports ā€¢ EHR: Electronic Health Record ā€¢ Other data sources include: claims, hospital, and third party databases ā€¢ CER/CDS DM: Comparative effectiveness research/Clinical decision support data mart ā€¢ PE: Protocol Engine ā€¢ TRIAD: Translational Informatics and Data management Color code: ā€¢ Blue = A given ā€¢Yellow = Optional ā€¢Red = Still in analysis Shared Data w/ PHI Shared Data Encrypted Developed and Supported by SAFTINet Saftinet Portal TRIAD Node Web Services Queries and Data Transfers
  • 50. CER/CDS DM Other EHR Color code: ā€¢ Blue = A given ā€¢Yellow = Optional ā€¢Red = Still in analysis Shared Data w/ PHI Shared Data Encrypted Developed and Supported by SAFTINet Saftinet Portal TRIAD Node Web Services Queries and Data Transfers The Trickier Bitsā€¦.. Medicaid Data ? ? ? Uni-directional Or Bi-directional?
  • 51. CER/CDS DM Other EHR Color code: ā€¢ Blue = A given ā€¢Yellow = Optional ā€¢Red = Still in analysis Shared Data w/ PHI Shared Data Encrypted Developed and Supported by SAFTINet Saftinet Portal TRIAD Node Web Services Queries and Data Transfers The Trickier Bitsā€¦.. Medicaid Data ? ? ? Patient Reported Data ? ?
  • 52. Whatā€™s been happening ā€¢ Creating the use cases ā–« What types of actions do we need to support? ļ‚– Types of questions to be answered ļ‚– Types of security and access controls ā€¢ Use cases drives data elements and database ā–« What do we need to extract from each CER/CDS? ā€¢ Pilot implementations ofTRIAD technology ā–« Kicking the technology tires with large data sets to discover the warts and ā€œgotchasā€
  • 53. Whatā€™s next? ā€¢ Engage all of the technical contacts ā–« Share use cases to understand data availability and gaps ā–« Discuss how best to develop data extracts ā–« Develop data quality procedures ā–« Develop technology deployment and support plans ļ‚– Including validation, acceptance, and training
  • 55. Comparative Effectiveness Research ā€¢ The conduct and synthesis of research comparing the benefits and harms of different interventions and strategies to prevent, diagnose, treat and monitor health conditions in ā€œreal worldā€ settings. ā–« Including delivery system strategies
  • 56. CER Aim ā€¢ Specific Aim Related to CER (Aim 3): Develop and enhance four sentinel cohort pairs of patients with asthma (pediatric and adult), hypertension, and hypercholesterolemia distinguished by their care delivery characteristics which can support comparative effectiveness research.
  • 57. CER Goals ā€¢ Demonstrate the capability of SAFTINet to collect and accurately link patient-level data necessary for CER of delivery systems ā€¢ Lay the groundwork to conduct prospective observational studies and clinical trials
  • 58. CER Hypothesis ā€¢ Health care delivery system factors, such as the patient-centered medical homeā€¦ PROCESSES OF CARE (clinician factors) + STRUCTURES OF CARE (system factors) + PATIENT FACTORS ā†’ OUTCOMES (chronic disease control)
  • 59. CER Hypothesis ā€¢ Health care delivery system factors, such as the patient-centered medical home, PROCESSES OF CARE (clinician factors) + STRUCTURES OF CARE (system factors) + PATIENT FACTORS ā†’ OUTCOMES (chronic disease control) outweigh clinician factors, patient factors, and medication effectivenessā€¦
  • 60. CER Hypothesis ā€¢ Health care delivery system factors, such as the patient-centered medical home, PROCESSES OF CARE (clinician factors) + STRUCTURES OF CARE (system factors) + PATIENT FACTORS ā†’ OUTCOMES (chronic disease control) outweigh clinician factors, patient factors, and medication effectiveness in the control of asthma, high blood pressure and hypercholesterolemia.
  • 61. CER Conceptual Model Relatively Mutable Clinical inertia Counseling Drug selection Dosage selection Concomitant meds Follow-up Decision support Patient-Centered Medical Home Integrated Mental Health Care Disease-specific case management Access to care Outcomes feedback Therapy adherence Therapy persistence Mental health status Health knowledge Perceived need for care Symptoms Drug side effects Patient-centered outcomes Health-related quality of life Clinical outcomes Process PROCESSES OF CARE (clinician factors) + STRUCTURES OF CARE (system factors) + PATIENT FACTORS ā†’ OUTCOMES Relatively immutable Appointment time Patient load Physical facilities Practice type Support personnel Generalist vs. specialist Age Gender Race/ethnicity SES Marital status Religious/cultural beliefs Comorbidity
  • 63. CER Process:TheTeam Marion Sills Co-investigator SAFTINet Comparative Effectiveness Research Team Measures experts Cohort experts Brian Sauer Diane Fairclough RobValuck Elaine Morrato PCMH: Lisa Schilling IMHC: Ben Miller Pediatric asthma: Monica Federico Adult asthma: BarbaraYawn HTN, Hypercholesterolemia: Karl Hammermeister CER methods experts
  • 64. CER Process: Sources of Data ā€¢ Electronic health records ā€¢ Medicaid claims ā€¢ Enhanced point-of-care data collection ā€¢ Organizational or practice-level survey CER/CDS DM Other EHR Medicaid Data Org. Survey Patient Reported Data CER/CDS DM: Comparative effectiveness research/Clinical decision support data mart
  • 65. CER Process ā€¢ Establish data dictionary ā€¢ Develop CER-specific technology use cases ā€¢ Review data profiling and quality reports to improve data quality (ongoing) ā€¢ Analytical plan
  • 66. CER Process ā€¢ Establish data dictionary ā€¢ Develop CER-specific technology use cases ā€¢ Review data profiling and quality reports to improve data quality (ongoing) ā€¢ Analytical plan
  • 68. CER Process ā€¢ Hypothesis generation ā€¢ Cohort identification ā–« Clinical/demographic parameters ā–« Eligibility CER/CDS DM EHR Medicaid Data
  • 69. CER Process ā€¢ Hypothesis generation ā€¢ Cohort identification ā€¢ Measures ā–« Outcome measures ā–« Explanatory measures ā–« Covariates PROCESSES OF CARE (clinician factors) + STRUCTURES OF CARE (system factors) + PATIENT FACTORS ā†’ OUTCOMES (chronic disease control) CER/CDS DM EHR Medicaid Data
  • 70. CER Process ā€¢ Hypothesis generation ā€¢ Cohort identification ā€¢ Measures ā€¢ Enhanced data collection ā–« Patient-reported outcomes ā–« Quality of life ā–« PCMH ā–« IMHC CER/CDS DM Org. Survey Patient Reported Data
  • 71. CER Process ā€¢ Hypothesis generation ā€¢ Cohort identification ā€¢ Measures ā€¢ Enhanced data collection CER/CDS DM Other EHR Medicaid Data Org. Survey Patient Reported Data
  • 72. CER Process ā€¢ Establish data dictionary ā€¢ Develop CER-specific technology use cases ā€¢ Review data profiling and quality reports to improve data quality (ongoing) ā€¢ Analytical plan
  • 73. Next stepsā€¦ ā€¢ Getting started ā€¢ Wrap-up
  • 74. Getting Started ā€¢ Subcontracts ā€¢ SharePoint ā–« Shared Documents ā–« Calendar ā–« Announcements ā–« Discussions ā€¢ Upcoming events and meetings ā–« Partner Engagement Community (Scheduling in progress) ā–« Technical team (Thursdays @ 2pm MT starting 12/16) ā–« CER team (Mondays @ 1:30pm MT) ā€¢ Quarterly SAFTINet Update meetings
  • 75. Wrap-Up ā€œKnowing is not enough; we must apply.Willing is not enough; we must do.ā€ ā€”Goethe Questions/Comments --

Editor's Notes

  1. Bethany will bring meeting to order, welcome everyone and summarize the goals and objectives of the meeting, and briefly review the agenda
  2. The series collectively characterizes the key elements of a healthcare system that is designed to generate and apply the best evidence for healthcare choices of patients and providers. A related purpose of these meetings is the identification and engagement of barriers to the development of the learning healthcare system and the key opportunities for progress. Copyright National Academy of Sciences. All rights reserved. This summary plus thousands more available at http://www.nap.edu Redesigning the Clinical Effectiveness Research Paradigm: Innovation and Practice-Based Approaches: Workshop Summary http://books.nap.edu/catalog/12197.html SUMMARY
  3. The series collectively characterizes the key elements of a healthcare system that is designed to generate and apply the best evidence for healthcare choices of patients and providers. A related purpose of these meetings is the identification and engagement of barriers to the development of the learning healthcare system and the key opportunities for progress. Copyright National Academy of Sciences. All rights reserved. This summary plus thousands more available at http://www.nap.edu Redesigning the Clinical Effectiveness Research Paradigm: Innovation and Practice-Based Approaches: Workshop Summary http://books.nap.edu/catalog/12197.html SUMMARY
  4. In addition to this: prohibiting health insurers from denying coverage or refusing claims based on pre-existing conditions, expanding Medicaid eligibility, subsidizing insurance premiums, providing incentives for businesses to provide health care benefits, establishing health insurance exchanges, and support for medical research From the Congressional Record: http://thomas.loc.gov/cgi-bin/query/R?r111:FLD001:S13891 The Public Law: http://www.gao.gov/hcac/pcor_sec_6301.pdf Definition: Research evaluating and comparing health outcomes and the clinical effectiveness, risks, and benefits of 2 or more medical treatments, services, and items such as health care interventions, protocols for treatment, care management, and delivery, procedures, medical devices, diagnostic tools, pharmaceuticals (including drugs and biologicals), integrative health practices, and any other strategies or items being used in the treatment, management, and diagnosis of, or prevention of illness or injury in, individuals.
  5. PCORI: The purpose of the Institute is to assist patients, clinicians, purchasers, and policy-makers in making informed health decisions by advancing the quality and relevance of evidence concerning the manner in which diseases, disorders, and other health conditions can effectively and appropriately be prevented, diagnosed, treated, monitored, and managed through research and evidence synthesis that considers variations in patient subpopulations, and the dissemination of research findings with respect to the relative health outcomes, clinical effectiveness, and appropriateness of the medical treatments, services, and items described in subsection (a)(2)(B).
  6. Providing context for SAFTINet Why was this funded? Who funded it? What were the goals of the RFA? What are the long-term goals? What other projects are there?
  7. Project descriptions will be provided here:
  8. The applications must provide adequate details of a governance plan for project oversight, especially on issues related to data linkage, access, and privacy and confidentiality of patient information.Ā  In addition, the governance plan should describe provisions for oversight and responsibility concerning operational issues and scientific and technical concerns related to study design, implementation and data analysis.Ā  The plan must address potential solutions to barriers raised by organizational, business or other considerations that will impede collaboration and sharing of data between the partner organizations of the network.Ā  Provisions to review and manage the conflict of interest of investigators and center personnel on an ongoing and regular basis must be included.Ā  The governance plan must also describe provisions for obtaining input and feedback concerning important aspects of the design of data collection infrastructure as well as on the comparative research undertaken.Ā  End-user feedback will be important in designing the infrastructure so that the data are efficiently collected and clinical workflow is minimally impacted.Ā  The patientā€™s perspective must also be represented in the governance plan.
  9. Specific Aim 2.1 Implement and deploy data Extraction, Transformation and Loading (ETL) processes with terminology standardization; patient data capture tools; data de-identification, and use of the Translational Informatics and Data Management Grid (TRIAD) technology and research portal. Specific Aim 2.2 Share state Medicaid entitiesā€™ claims and eligibility data with their respective clinical partners via secure File Transfer Protocol (sFTP). Implement local data de-duplication using local Protected Health Information (PHI) data elements Specific Aim 2.3 Implement TRIAD nodes for Medicare participants. Establish prototype grid-based identity management solution using hashed identifiers. Deploy production SAFTINet federated grid nodes and TRIAD portal
  10. The purpose of CER is to improve health outcomes by developing and disseminating evidence-based information to patients, clinicians, and other decision-makers, responding to their expressed needs, about which interventions are most effective for which patients under specific circumstances.
  11. What is the best way to explain the relationships among these groups? Want people to see the interdependency, the collaborative nature, and the sense of community and mutual goals.
  12. Briefly introduce Investigator list, role and expertise Team leaders to introduce themselves There are additional members of these teams as well, just not ā€œinvestigatorsā€.
  13. The American Academy of Family Physicians National Research Network (AAFP NRN) is housed within the Division of Scientific Activities at the American Academy of Family Physicians (AAFP). The AAFP, founded in 1947, is the largest medical specialty society devoted solely to primary care and the third largest medical professional organization in the United States. The 94,000 members of the AAFP provide comprehensive, coordinated, and continuing care to all members of the family and serve as the patientā€™s advocate in the changing healthcare system.
  14. Cherokee Health operates the NextGen EHR to which CINA has proven interfaces. Cherokee Health anticipates using the CINA decision support reports for clinical care improvement. Cherokee also participates in their local health information exchange and we will explore how linkages with this system can enhance data from hospitals, emergency departments and other clinical settings.
  15. Intermountain Healthcare is a non-for-profit integrated health care delivery network of 21 hospitals, more than 70 outpatient clinics, a 500 member employed physician group, and associated care delivery support functions (e.g., durable medical equipment, group supply purchasing) located in Utah and southeastern Idaho. Intermountainā€™s facilities range from major adult and pediatric tertiary-level teaching/research facilities, through large urban collector hospitals, to a series of small hospital/clinics that are the only source of care in many rural Utah communities. Intermountain Healthcare uses Electronic Medical Records extensively and collects clinical data into a group of encounter-based, Hospital Information Systems (the HELP Systems), a longitudinal Clinical Data Repository (CDR), and an Enterprise Data Warehouse (EDW). Intermountain has an inpatient clinical information system and an electronic longitudinal medical record, the Clinical Data Repository (CDR). Intermountain Health (IMH) represents a third approach to participating in SAFTINet. IMH has a well-developed, integrated electronic health record that supports clinical decision support and includes robust reporting systems. Codified clinical data is standardized using a central data dictionary. We will work with the IMH information services group to create an ETL function specific to their system to directly create the CCD-PHI data structure in Figure 2. We will initially crosswalk (where necessary) the required data elements for this project between the IMH data dictionary and the SAFTINet/DARTNet data dictionary. Given that both systems can link to and use established data standards, such as SNOMED CT, we expect that this will prove to be straightforward. The SAFTINet CCD-PHI will be created within the IMH taxonomy server. The creation of the CCD-NoPHI using the one-way hash function could be performed within the IMH system or created within a SAFTINet-provided stand-alone system and then sent to the local TRIAD server node.
  16. CCMCN-CACHIE presents a different approach to participating in SAFTINet. CACHIE has an existing clinical data warehouse with demographic and clinical data elements; laboratory results standardized to LOINC codes; and medications used for most common conditions coded with NDC, AFHS, and HIC3 codes. CCMCN-CACHIE will use the CINA solution to complete the transformation, de-identification and loading activities to a local TRIAD server. The CACHIE data warehouse already contains most required data elements; any new data elements will be added through their current data warehouse vendor (Plurasoft, Inc). Since the CACHIE data warehouse pulls data from multiple EMRs, linking CINA to CACHIE provides a single point for obtaining data from multiple clinical sites with disparate EMRs. In addition, since CACHIE performs harmonization to standards, the effort to create a CCD is markedly reduced. The Colorado Associated Community Health Information Exchange (CACHIE) is a collaborative project of Colorado Community Health Network (CCHN) and Colorado Community Managed Care Network (CCMCN).Ā  With funding from the Health Resources and Services Administration (HRSA), the Agency for Healthcare Research and Quality (AHRQ), The Colorado Health Foundation (TCHF) and member investment dues, Colorado community health centers (CHCs) are joining forces to create a shared information technology system to support quality reporting, analysis, and improvement.
  17. Denver Health (DH) is an integrated, public urban safety net health care system that provides services to 25% of all Denver residents, or approximately 150,000 individuals, including 35% of Denverā€™s children and a large proportion of the indigent, vulnerable and minority populations in the city and county of Denver. DH is the major provider for the uninsured and Medicaid patients in the state of Colorado. Among DH patients, 65% are below 185% of the federal poverty level. Over 50% of DH patients are uninsured, and over 70% of DH patients represent racial and ethnic minorities. In 2007, the D , H system had over 143,000 patients with over 617,000 outpatient visits. Ā  The fourth approach to participating in SAFTINet will be developed by DHHA Public Health Informatics and eHealth Services groups. A comprehensive clinical and administrative (e.g., demographic, laboratory, radiologic, medication, diagnostic, charges, utilization, plus others) data warehouse already exists across Denver Health (DH) entities. The specification for the SAFTINet data repository will drive development of a project-specific data mart for this research effort. Data elements will be defined and mapped to specific fields and tables in the DH warehouse. Data will be normalized to the determined vocabulary code set. DH has used SNOMED-CT for other projects. Like IMH, the DHHA-created data mart will contain PHI elements. The application of the one-way hash function to PHI data elements can occur within the DHHA data mart or could be performed by a stand-alone system. The CCD-nonPHI data structure is then sent to the local TRIAD server node.
  18. Development of agenda/topics for discussion
  19. For this proposal, we will implement trial SAFTINet nodes using the grid technologies developed as part of the NCI caBIG (cancer biomedical informatics grid - https://cabig.nci.nih.gov) program, called caGrid. The caGrid software is open source grid software infrastructure aimed at enabling multi-institutional data sharing and analysis. caGrid supports a wide range of use cases in basic, translational, and clinical research. Key innovations in caGrid support large scale, secure, semantically meaningful data sharing and analysis.
  20. The CER definition has already been reviewed by Lisa. The purpose of CER is to improve health outcomes by developing and disseminating evidence-based information to patients, clinicians, and other decision-makers, responding to their expressed needs, about which interventions are most effective for which patients under specific circumstances.
  21. The grantā€™s 3rd specific aim presents the CER-related goals, which include development of four cohorts, and demonstrating the feasibility, within these cohorts, of performing CER on delivery system characteristics.
  22. The hypothesis related to this first goal, performing CER of delivery systems, states that health care deliver system factors, such as the patient-centered medical home
  23. outweigh clinician factors, patient factors, and medication effectiveness
  24. in the control of asthma, high blood pressure and hypercholesterolemia.
  25. The conceptual model underlying this hypothesis is shown here. This delineates some of the Outcome measures, Explanatory measures, and Covariates for the CER analyses.
  26. I will now give an overview of the CER process for SAFTINet.
  27. The CER team includes cohort experts for each of the 4 cohorts, CER methods experts, and measures experts for the delivery systems measures. The team meets weekly on Monday afternoons.
  28. The CER analyses will draw on several sources of data in SAFTINet. These include EHR, Medicaid, data collected at the POC, and organizational or practice-level survey data. Borrowing Michaelā€™s graphics, the data sources are shown at the bottom of this slide, in primary colors.
  29. The general steps involved in the CER process include establishing a data dictionary, developing CER-specific use cases, reviewing the quality of data, and implementing the CER analytic plan
  30. The current focus of CER team activity is establishing a data dictionary.
  31. The process for developing the data dictionary involves first generating the specific hypotheses for each cohort. These hypotheses supplement the primary hypothesis mentioned previously. WRT hypothesis generation, we will also involve the Partner Engagement Community to identify priority hypotheses and research questions amenable to OCER within the 4 cohorts.
  32. For each cohort, the CER team then develops a cohort definition, using variables available in the existing data sources. This includes both clinical and demographic parameters as well as eligibility factors.
  33. For each cohort, the CER team then develops measures necessary for testing each study hypothesis, using variables available in the existing data sources. Data elements necessary for hypothesis testing, including those for cohort identification and measure definition, are being compiled through this process to convey in dictionary format to the Technical Team.
  34. After conveying to the Technical Team the data elements requested from the EHR and claims data, the next phase involves developing methods for enhanced data collection, including patient-level data such as patient-reported outcomes and QOL, and organization-level information, such as PCMH and IMH. This process will involve input from the Partner Engagement Community.
  35. Adding enhanced data to the data elements required for building the cohorts and testing the hypotheses, the CER team will then broaden the data dictionary of necessary elements for the CER analyses.
  36. Future steps involved in the CER process include developing CER-specific use cases, reviewing the quality of data, and implementing the CER analytic plan. As with the current phase, each part of the CER process involves collaboration with the Technical Team and the Partner Engagement Community.
  37. Project management considerations