SlideShare a Scribd company logo
1 of 22
Download to read offline
Data and Accountability Feedback
Loops
Funder-Partner and Direct Service
DC Promise Neighborhood Initiative
Eastern Evaluation Research Society
May 2, 2016
Ijeoma Anyanwu and Nicholas Carrington
@DCPNI #DCPNIisallEERS
Overview
 Two perspectives on performance management
 Funder-partner feedback loops
 Service delivery feedback loops
 Recap key differences
Performance Management
1. Concept
and
Planning
2.
Curricula
Development
3.
Assessment
Development
4. Data
Entry
7. Communication
5. Data
Analysis
6. Data
Reporting
7-Step
Feedback
Cycle
• Theory of
Change
• Logic Model
Program
Curricula
Outcome
Assessments
Data
Collection
Data
Storage
Number
Crunching
Interpretation Recommendations
Inter-
Organizational
Process
Funder-Partner
Feedback Loop
1. 2. 3. 4. 5. 6. 7.
Performance
Management
Feedback
Cycle
1. Concept and Planning
Process
 Refine program models
 90-minute face-to-face
Feedback
 Alignment with:
 initiative,
 best practices
 resources
1. Concept and
Planning
2. Curricula Development
Process
 Typically already developed by
partner
Feedback
 As needed regarding connection to
outcomes
2.
Curricula
Development
3. Assessment Development
Process
 Partner provides hard copies
 Discussion to review/refine
Feedback
 Construct alignment with
outcomes
 Reliability and validity
3.
Assessment
Development
4. Data Entry
Process
 Understand methods
 Provide simple templates
 Submission Schedules
Feedback
 Collection methods
 Quality checks and follow up
 Reminders and support
4. Data Entry
5. Data Analysis
Process
 Compile and clean
 Analyze reach, focus, data
quality, program quality,
effectiveness, efficiency
Feedback
 Confusing data
5. Data Analysis
6. Reporting
Process
 Monthly program reports
 Discuss findings internally
 Develop recommendations
Feedback
 What’s measured, what could be
 DCPNI’s role in results
6. Data
Reporting
7. Communication
Process
 Discuss findings with partner
 Finalize recommendations
Feedback
 Insights about implementation,
measurement
 How partners are supported
7. Communication
1. Concept
and
Planning
2.
Curricula
Development
3.
Assessment
Development
4. Data
Entry
7. Communication
5. Data
Analysis
6. Data
Reporting
Performance
Management
Feedback
Cycle
7-Step
Feedback
Cycle
• Theory of
Change
• Logic Model
Program
Curricula
Outcome
Assessments
Data
Collection
Data
Storage
Number
Crunching
Interpretation Recommendations
Intra-
Organizational
Process
Service Delivery
Feedback Loops
1. 2. 3. 4. 5. 6. 7.
1. Concept and Planning
Logic Model
 Visual Model
 Resources
 Program outcomes
 Activities
 Output
Theory of Change
 Program need
 Theory
 Goals and Aims
 Supporting evidence
 Mission
4-5 Planning Sessions
1. Concept and
Planning
2. Curricula Development
 Materials
 Content Delivery
 Review
 Alignment
2.
Curricula
Development
2.
Curricula
Development
3. Assessment Development
 Outcome measurement
 Surveys
 Interview Protocols
 Focus Groups
 Language
 Content Alignment
3.
Assessment
Development
3.
Assessment
Development
4. Data Entry
 Data input
 Training
 Trouble shooting
 Data quality
4. Data
Entry
5. Data Analysis
 Software
 Complex and Simple
 Quantitative and
Qualitative
5. Data Analysis
6. Reporting
 Forms
 Dashboard
 Monthly reports
 Quarterly reports
 Program Impact
reports
 Design
 Report Indicators
6. Data
Reporting
6. Data
Reporting
7. Communication
 Meetings
 Findings
 Recommendations
 Strategy
7. Communication
Service Delivery vs. Funder-Partner
Relationship
 More intensive
 Management vs.
accountability focus
 More opportunity for
real-time improvement
 Ability to change or
adjust program model
Conclusion
 1 Key
 2 Locks
Questions
 Ijeoma Anyanwu,
Email: ijeoma.anyanwu@dcpni.org
Twitter: @ije_roqs
 Nicholas Carrington,
Email: Nicholas.Carrington@dcpni.org

More Related Content

What's hot

Proactive evaluation
Proactive evaluationProactive evaluation
Proactive evaluationCarlo Magno
 
In Search of a Common Evaluation framework for Mentoring - Cloud Chamber
In Search of a Common Evaluation framework for Mentoring - Cloud ChamberIn Search of a Common Evaluation framework for Mentoring - Cloud Chamber
In Search of a Common Evaluation framework for Mentoring - Cloud ChamberBrightside
 
United Way or Erie County - Programs, Program Monitoring and Evaluation, and ...
United Way or Erie County - Programs, Program Monitoring and Evaluation, and ...United Way or Erie County - Programs, Program Monitoring and Evaluation, and ...
United Way or Erie County - Programs, Program Monitoring and Evaluation, and ...Via Evaluation
 
Clarificative evaluation
Clarificative evaluationClarificative evaluation
Clarificative evaluationCarlo Magno
 
Outcomes evaluation for community organization
Outcomes evaluation for community organization  Outcomes evaluation for community organization
Outcomes evaluation for community organization Mohammad Saeb Mohajeri
 
2011 2012 parker data analysis
2011 2012 parker data analysis 2011 2012 parker data analysis
2011 2012 parker data analysis danaberg
 
Myra Coleman Resume 02 25 2015
Myra Coleman Resume 02 25 2015Myra Coleman Resume 02 25 2015
Myra Coleman Resume 02 25 2015Myra Coleman
 
Matt Decembrino CV 2.16.17
Matt Decembrino CV 2.16.17Matt Decembrino CV 2.16.17
Matt Decembrino CV 2.16.17Matt Decembrino
 
Testa@Greeniwch - institutional approach to improving feedback and assessment...
Testa@Greeniwch - institutional approach to improving feedback and assessment...Testa@Greeniwch - institutional approach to improving feedback and assessment...
Testa@Greeniwch - institutional approach to improving feedback and assessment...monikap85
 
Kevin Calderon Resume
Kevin Calderon Resume Kevin Calderon Resume
Kevin Calderon Resume Kevin Calderon
 
Research in Social Investment - Tshikululu Social Investments workshop 2010
Research in Social Investment - Tshikululu Social Investments workshop 2010Research in Social Investment - Tshikululu Social Investments workshop 2010
Research in Social Investment - Tshikululu Social Investments workshop 2010Tshikululu Social Investments
 
Monotoring and evaluation principles and theories
Monotoring and evaluation  principles and theoriesMonotoring and evaluation  principles and theories
Monotoring and evaluation principles and theoriescommochally
 
Data-Driven Decision Making
Data-Driven Decision MakingData-Driven Decision Making
Data-Driven Decision MakingNaviance
 
USAID Perspectives on Monitoring and Evaluation and Health Information Needs ...
USAID Perspectives on Monitoring and Evaluation and Health Information Needs ...USAID Perspectives on Monitoring and Evaluation and Health Information Needs ...
USAID Perspectives on Monitoring and Evaluation and Health Information Needs ...MEASURE Evaluation
 
Monitoring and Evaluation for e-Governance Projects
Monitoring and Evaluation for e-Governance ProjectsMonitoring and Evaluation for e-Governance Projects
Monitoring and Evaluation for e-Governance ProjectsLalengzuala Zualtea
 
Learning_Unit_3
Learning_Unit_3Learning_Unit_3
Learning_Unit_3Jack Ong
 
Evaluation presentation
Evaluation presentationEvaluation presentation
Evaluation presentationOlgaJubany
 

What's hot (20)

Proactive evaluation
Proactive evaluationProactive evaluation
Proactive evaluation
 
In Search of a Common Evaluation framework for Mentoring - Cloud Chamber
In Search of a Common Evaluation framework for Mentoring - Cloud ChamberIn Search of a Common Evaluation framework for Mentoring - Cloud Chamber
In Search of a Common Evaluation framework for Mentoring - Cloud Chamber
 
United Way or Erie County - Programs, Program Monitoring and Evaluation, and ...
United Way or Erie County - Programs, Program Monitoring and Evaluation, and ...United Way or Erie County - Programs, Program Monitoring and Evaluation, and ...
United Way or Erie County - Programs, Program Monitoring and Evaluation, and ...
 
Lecture 2
Lecture 2Lecture 2
Lecture 2
 
Clarificative evaluation
Clarificative evaluationClarificative evaluation
Clarificative evaluation
 
Outcomes evaluation for community organization
Outcomes evaluation for community organization  Outcomes evaluation for community organization
Outcomes evaluation for community organization
 
2011 2012 parker data analysis
2011 2012 parker data analysis 2011 2012 parker data analysis
2011 2012 parker data analysis
 
Myra Coleman Resume 02 25 2015
Myra Coleman Resume 02 25 2015Myra Coleman Resume 02 25 2015
Myra Coleman Resume 02 25 2015
 
Matt Decembrino CV 2.16.17
Matt Decembrino CV 2.16.17Matt Decembrino CV 2.16.17
Matt Decembrino CV 2.16.17
 
Testa@Greeniwch - institutional approach to improving feedback and assessment...
Testa@Greeniwch - institutional approach to improving feedback and assessment...Testa@Greeniwch - institutional approach to improving feedback and assessment...
Testa@Greeniwch - institutional approach to improving feedback and assessment...
 
Kevin Calderon Resume
Kevin Calderon Resume Kevin Calderon Resume
Kevin Calderon Resume
 
Research in Social Investment - Tshikululu Social Investments workshop 2010
Research in Social Investment - Tshikululu Social Investments workshop 2010Research in Social Investment - Tshikululu Social Investments workshop 2010
Research in Social Investment - Tshikululu Social Investments workshop 2010
 
Monotoring and evaluation principles and theories
Monotoring and evaluation  principles and theoriesMonotoring and evaluation  principles and theories
Monotoring and evaluation principles and theories
 
Ntombizinhle Tshabalala - Reference
Ntombizinhle Tshabalala - ReferenceNtombizinhle Tshabalala - Reference
Ntombizinhle Tshabalala - Reference
 
Data-Driven Decision Making
Data-Driven Decision MakingData-Driven Decision Making
Data-Driven Decision Making
 
USAID Perspectives on Monitoring and Evaluation and Health Information Needs ...
USAID Perspectives on Monitoring and Evaluation and Health Information Needs ...USAID Perspectives on Monitoring and Evaluation and Health Information Needs ...
USAID Perspectives on Monitoring and Evaluation and Health Information Needs ...
 
Monitoring and Evaluation for e-Governance Projects
Monitoring and Evaluation for e-Governance ProjectsMonitoring and Evaluation for e-Governance Projects
Monitoring and Evaluation for e-Governance Projects
 
Project Monitoring and Evaluation
Project Monitoring and EvaluationProject Monitoring and Evaluation
Project Monitoring and Evaluation
 
Learning_Unit_3
Learning_Unit_3Learning_Unit_3
Learning_Unit_3
 
Evaluation presentation
Evaluation presentationEvaluation presentation
Evaluation presentation
 

Similar to AnyanwuCarrington_DataAndAccountability

Performance Management to Program Evaluation: Creating a Complementary Connec...
Performance Management to Program Evaluation: Creating a Complementary Connec...Performance Management to Program Evaluation: Creating a Complementary Connec...
Performance Management to Program Evaluation: Creating a Complementary Connec...nicholes21
 
E. Socio-Educationa Project - Interactive Activity Group 3
E. Socio-Educationa Project - Interactive Activity Group 3E. Socio-Educationa Project - Interactive Activity Group 3
E. Socio-Educationa Project - Interactive Activity Group 3ESPE - UFA
 
Overview of Project Management Knowledge Areas and Processes
Overview of Project Management Knowledge Areas and ProcessesOverview of Project Management Knowledge Areas and Processes
Overview of Project Management Knowledge Areas and ProcessesIdris Animasaun, PMP
 
Overview of project management knowledge areas 2
Overview of project management knowledge areas 2Overview of project management knowledge areas 2
Overview of project management knowledge areas 2Idris Animasaun, PMP
 
OVERVIEW OF PROJECT MANAGEMENT KNOWLEDGE AREAS 2
OVERVIEW OF PROJECT MANAGEMENT KNOWLEDGE AREAS 2OVERVIEW OF PROJECT MANAGEMENT KNOWLEDGE AREAS 2
OVERVIEW OF PROJECT MANAGEMENT KNOWLEDGE AREAS 2Idris Animasaun, PMP
 
Community engagement - what constitutes success
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes successcontentli
 
Project management for instructional designers
Project management for instructional designersProject management for instructional designers
Project management for instructional designersKimberly Kaye
 
Collaborative 2 ingrid margarita and sandra
Collaborative 2 ingrid margarita and sandraCollaborative 2 ingrid margarita and sandra
Collaborative 2 ingrid margarita and sandraSandra Guevara
 
Projects Management
Projects ManagementProjects Management
Projects ManagementNirmal Shah
 
Implementing Project Portfolio Management
Implementing Project Portfolio ManagementImplementing Project Portfolio Management
Implementing Project Portfolio Managementdlipper
 
Sanitized Knowledge Transfer Deliverable:Rapid Process Change Tutorial
Sanitized Knowledge Transfer Deliverable:Rapid Process Change TutorialSanitized Knowledge Transfer Deliverable:Rapid Process Change Tutorial
Sanitized Knowledge Transfer Deliverable:Rapid Process Change Tutorialguesta83e9d
 
Program evaluation
Program evaluationProgram evaluation
Program evaluationYen Bunsoy
 
Using Measurement to Drive the Impact and Effectiveness of Your Leadership De...
Using Measurement to Drive the Impact and Effectiveness of Your Leadership De...Using Measurement to Drive the Impact and Effectiveness of Your Leadership De...
Using Measurement to Drive the Impact and Effectiveness of Your Leadership De...Forum Corporation
 
Get Quality Preparation with PMI Project Management (PMP) Certification
Get Quality Preparation with PMI Project Management (PMP) CertificationGet Quality Preparation with PMI Project Management (PMP) Certification
Get Quality Preparation with PMI Project Management (PMP) CertificationMeghna Arora
 
Establishing measurable performance expectations Feb 2019 Criterion Conferenc...
Establishing measurable performance expectations Feb 2019 Criterion Conferenc...Establishing measurable performance expectations Feb 2019 Criterion Conferenc...
Establishing measurable performance expectations Feb 2019 Criterion Conferenc...Mark Hocknell
 
J&J: Transforming Study Start-up in a Global Environment
J&J: Transforming Study Start-up in a Global Environment J&J: Transforming Study Start-up in a Global Environment
J&J: Transforming Study Start-up in a Global Environment Veeva Systems
 
Lc Presentation
Lc PresentationLc Presentation
Lc Presentationreachab7
 

Similar to AnyanwuCarrington_DataAndAccountability (20)

Performance Management to Program Evaluation: Creating a Complementary Connec...
Performance Management to Program Evaluation: Creating a Complementary Connec...Performance Management to Program Evaluation: Creating a Complementary Connec...
Performance Management to Program Evaluation: Creating a Complementary Connec...
 
E. Socio-Educationa Project - Interactive Activity Group 3
E. Socio-Educationa Project - Interactive Activity Group 3E. Socio-Educationa Project - Interactive Activity Group 3
E. Socio-Educationa Project - Interactive Activity Group 3
 
Overview of Project Management Knowledge Areas and Processes
Overview of Project Management Knowledge Areas and ProcessesOverview of Project Management Knowledge Areas and Processes
Overview of Project Management Knowledge Areas and Processes
 
Overview of project management knowledge areas 2
Overview of project management knowledge areas 2Overview of project management knowledge areas 2
Overview of project management knowledge areas 2
 
OVERVIEW OF PROJECT MANAGEMENT KNOWLEDGE AREAS 2
OVERVIEW OF PROJECT MANAGEMENT KNOWLEDGE AREAS 2OVERVIEW OF PROJECT MANAGEMENT KNOWLEDGE AREAS 2
OVERVIEW OF PROJECT MANAGEMENT KNOWLEDGE AREAS 2
 
Community engagement - what constitutes success
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes success
 
Project management for instructional designers
Project management for instructional designersProject management for instructional designers
Project management for instructional designers
 
Collaborative 2 ingrid margarita and sandra
Collaborative 2 ingrid margarita and sandraCollaborative 2 ingrid margarita and sandra
Collaborative 2 ingrid margarita and sandra
 
Projects Management
Projects ManagementProjects Management
Projects Management
 
Implementing Project Portfolio Management
Implementing Project Portfolio ManagementImplementing Project Portfolio Management
Implementing Project Portfolio Management
 
Sanitized Knowledge Transfer Deliverable:Rapid Process Change Tutorial
Sanitized Knowledge Transfer Deliverable:Rapid Process Change TutorialSanitized Knowledge Transfer Deliverable:Rapid Process Change Tutorial
Sanitized Knowledge Transfer Deliverable:Rapid Process Change Tutorial
 
L+D ROI
L+D ROIL+D ROI
L+D ROI
 
Program evaluation
Program evaluationProgram evaluation
Program evaluation
 
Using Measurement to Drive the Impact and Effectiveness of Your Leadership De...
Using Measurement to Drive the Impact and Effectiveness of Your Leadership De...Using Measurement to Drive the Impact and Effectiveness of Your Leadership De...
Using Measurement to Drive the Impact and Effectiveness of Your Leadership De...
 
PMP-Scope Management area
PMP-Scope Management areaPMP-Scope Management area
PMP-Scope Management area
 
Get Quality Preparation with PMI Project Management (PMP) Certification
Get Quality Preparation with PMI Project Management (PMP) CertificationGet Quality Preparation with PMI Project Management (PMP) Certification
Get Quality Preparation with PMI Project Management (PMP) Certification
 
Establishing measurable performance expectations Feb 2019 Criterion Conferenc...
Establishing measurable performance expectations Feb 2019 Criterion Conferenc...Establishing measurable performance expectations Feb 2019 Criterion Conferenc...
Establishing measurable performance expectations Feb 2019 Criterion Conferenc...
 
J&J: Transforming Study Start-up in a Global Environment
J&J: Transforming Study Start-up in a Global Environment J&J: Transforming Study Start-up in a Global Environment
J&J: Transforming Study Start-up in a Global Environment
 
M & E Presentation DSK.ppt
M & E Presentation DSK.pptM & E Presentation DSK.ppt
M & E Presentation DSK.ppt
 
Lc Presentation
Lc PresentationLc Presentation
Lc Presentation
 

AnyanwuCarrington_DataAndAccountability

  • 1. Data and Accountability Feedback Loops Funder-Partner and Direct Service DC Promise Neighborhood Initiative Eastern Evaluation Research Society May 2, 2016 Ijeoma Anyanwu and Nicholas Carrington @DCPNI #DCPNIisallEERS
  • 2. Overview  Two perspectives on performance management  Funder-partner feedback loops  Service delivery feedback loops  Recap key differences
  • 4. 1. Concept and Planning 2. Curricula Development 3. Assessment Development 4. Data Entry 7. Communication 5. Data Analysis 6. Data Reporting 7-Step Feedback Cycle • Theory of Change • Logic Model Program Curricula Outcome Assessments Data Collection Data Storage Number Crunching Interpretation Recommendations Inter- Organizational Process Funder-Partner Feedback Loop 1. 2. 3. 4. 5. 6. 7. Performance Management Feedback Cycle
  • 5. 1. Concept and Planning Process  Refine program models  90-minute face-to-face Feedback  Alignment with:  initiative,  best practices  resources 1. Concept and Planning
  • 6. 2. Curricula Development Process  Typically already developed by partner Feedback  As needed regarding connection to outcomes 2. Curricula Development
  • 7. 3. Assessment Development Process  Partner provides hard copies  Discussion to review/refine Feedback  Construct alignment with outcomes  Reliability and validity 3. Assessment Development
  • 8. 4. Data Entry Process  Understand methods  Provide simple templates  Submission Schedules Feedback  Collection methods  Quality checks and follow up  Reminders and support 4. Data Entry
  • 9. 5. Data Analysis Process  Compile and clean  Analyze reach, focus, data quality, program quality, effectiveness, efficiency Feedback  Confusing data 5. Data Analysis
  • 10. 6. Reporting Process  Monthly program reports  Discuss findings internally  Develop recommendations Feedback  What’s measured, what could be  DCPNI’s role in results 6. Data Reporting
  • 11. 7. Communication Process  Discuss findings with partner  Finalize recommendations Feedback  Insights about implementation, measurement  How partners are supported 7. Communication
  • 12. 1. Concept and Planning 2. Curricula Development 3. Assessment Development 4. Data Entry 7. Communication 5. Data Analysis 6. Data Reporting Performance Management Feedback Cycle 7-Step Feedback Cycle • Theory of Change • Logic Model Program Curricula Outcome Assessments Data Collection Data Storage Number Crunching Interpretation Recommendations Intra- Organizational Process Service Delivery Feedback Loops 1. 2. 3. 4. 5. 6. 7.
  • 13. 1. Concept and Planning Logic Model  Visual Model  Resources  Program outcomes  Activities  Output Theory of Change  Program need  Theory  Goals and Aims  Supporting evidence  Mission 4-5 Planning Sessions 1. Concept and Planning
  • 14. 2. Curricula Development  Materials  Content Delivery  Review  Alignment 2. Curricula Development 2. Curricula Development
  • 15. 3. Assessment Development  Outcome measurement  Surveys  Interview Protocols  Focus Groups  Language  Content Alignment 3. Assessment Development 3. Assessment Development
  • 16. 4. Data Entry  Data input  Training  Trouble shooting  Data quality 4. Data Entry
  • 17. 5. Data Analysis  Software  Complex and Simple  Quantitative and Qualitative 5. Data Analysis
  • 18. 6. Reporting  Forms  Dashboard  Monthly reports  Quarterly reports  Program Impact reports  Design  Report Indicators 6. Data Reporting 6. Data Reporting
  • 19. 7. Communication  Meetings  Findings  Recommendations  Strategy 7. Communication
  • 20. Service Delivery vs. Funder-Partner Relationship  More intensive  Management vs. accountability focus  More opportunity for real-time improvement  Ability to change or adjust program model
  • 22. Questions  Ijeoma Anyanwu, Email: ijeoma.anyanwu@dcpni.org Twitter: @ije_roqs  Nicholas Carrington, Email: Nicholas.Carrington@dcpni.org