1. Data and Accountability Feedback
Loops
Funder-Partner and Direct Service
DC Promise Neighborhood Initiative
Eastern Evaluation Research Society
May 2, 2016
Ijeoma Anyanwu and Nicholas Carrington
@DCPNI #DCPNIisallEERS
2. Overview
Two perspectives on performance management
Funder-partner feedback loops
Service delivery feedback loops
Recap key differences
4. 1. Concept
and
Planning
2.
Curricula
Development
3.
Assessment
Development
4. Data
Entry
7. Communication
5. Data
Analysis
6. Data
Reporting
7-Step
Feedback
Cycle
• Theory of
Change
• Logic Model
Program
Curricula
Outcome
Assessments
Data
Collection
Data
Storage
Number
Crunching
Interpretation Recommendations
Inter-
Organizational
Process
Funder-Partner
Feedback Loop
1. 2. 3. 4. 5. 6. 7.
Performance
Management
Feedback
Cycle
5. 1. Concept and Planning
Process
Refine program models
90-minute face-to-face
Feedback
Alignment with:
initiative,
best practices
resources
1. Concept and
Planning
6. 2. Curricula Development
Process
Typically already developed by
partner
Feedback
As needed regarding connection to
outcomes
2.
Curricula
Development
7. 3. Assessment Development
Process
Partner provides hard copies
Discussion to review/refine
Feedback
Construct alignment with
outcomes
Reliability and validity
3.
Assessment
Development
8. 4. Data Entry
Process
Understand methods
Provide simple templates
Submission Schedules
Feedback
Collection methods
Quality checks and follow up
Reminders and support
4. Data Entry
9. 5. Data Analysis
Process
Compile and clean
Analyze reach, focus, data
quality, program quality,
effectiveness, efficiency
Feedback
Confusing data
5. Data Analysis
10. 6. Reporting
Process
Monthly program reports
Discuss findings internally
Develop recommendations
Feedback
What’s measured, what could be
DCPNI’s role in results
6. Data
Reporting
11. 7. Communication
Process
Discuss findings with partner
Finalize recommendations
Feedback
Insights about implementation,
measurement
How partners are supported
7. Communication
12. 1. Concept
and
Planning
2.
Curricula
Development
3.
Assessment
Development
4. Data
Entry
7. Communication
5. Data
Analysis
6. Data
Reporting
Performance
Management
Feedback
Cycle
7-Step
Feedback
Cycle
• Theory of
Change
• Logic Model
Program
Curricula
Outcome
Assessments
Data
Collection
Data
Storage
Number
Crunching
Interpretation Recommendations
Intra-
Organizational
Process
Service Delivery
Feedback Loops
1. 2. 3. 4. 5. 6. 7.
13. 1. Concept and Planning
Logic Model
Visual Model
Resources
Program outcomes
Activities
Output
Theory of Change
Program need
Theory
Goals and Aims
Supporting evidence
Mission
4-5 Planning Sessions
1. Concept and
Planning
14. 2. Curricula Development
Materials
Content Delivery
Review
Alignment
2.
Curricula
Development
2.
Curricula
Development
15. 3. Assessment Development
Outcome measurement
Surveys
Interview Protocols
Focus Groups
Language
Content Alignment
3.
Assessment
Development
3.
Assessment
Development
16. 4. Data Entry
Data input
Training
Trouble shooting
Data quality
4. Data
Entry
17. 5. Data Analysis
Software
Complex and Simple
Quantitative and
Qualitative
5. Data Analysis
18. 6. Reporting
Forms
Dashboard
Monthly reports
Quarterly reports
Program Impact
reports
Design
Report Indicators
6. Data
Reporting
6. Data
Reporting
20. Service Delivery vs. Funder-Partner
Relationship
More intensive
Management vs.
accountability focus
More opportunity for
real-time improvement
Ability to change or
adjust program model