Chapter 6
Policy Evaluation
Public Policy and Governance
(950701)
Introduction o Definition
o The process of policy
evaluation
o Types of evaluation
o Utilization of evaluation
results
o Challenges in policy
evaluation
o Strategies for evaluators
o Conclusion
Contoso Ltd.
○ Synthesizing what is known about a
problem and its proposed policy or
program remedy;
○ Demystifying conventional wisdom related
to either the problem or its solution(s);
○ Developing new information about
information about program or policy
effectiveness; and
○ Explainingto policy actors the implications
of new information derived through
evaluation
Policy evaluation refers broadly to
all the activities carried out by a
range of state and societal actors to
determine how a policy has fared
inpracticeandtoestimatehowitis
likely to perform in the future.
3
DefinitionEvaluation contributes to the
policy-making process by:
Contoso Ltd.
The Process of policy evaluation
Defining the
scope of
evaluation
Determining
evaluation
criteria
Collecting
information
Conducting
evaluation
4
Contoso Ltd.
Types of evaluation
Add a footer
5
Input Process Output Outcome Impact
Policy evaluation concentrates on one or more of the
following types of information about policies
performance:
Contoso Ltd.
1. Simple Evaluation
Input evaluation
Output evaluation
Process evaluation
6
Contoso Ltd.
The central task of
technical policy
evaluation is
frequently to isolate
the effects of a
particular policy from
those caused by other
factors.
Add a footer
7
2. Outcome and Impact Evaluation
Source: adapted from Rossi, Lipsey, and Freeman, 2004.
Contoso Ltd.
Evaluation design for isolating net outcomes from gross
outcomes
Add a footer
8
2. Simple
before/after
comparison
Contoso Ltd.
Add a footer
9
Utilization of
evaluation
results
Policy Learning
a.Social Learning
b.Lesson-drawing
c.Policy-oriented
Learning
d.Government Learning
Contoso Ltd.
10
Add a footer
Policy Termination
a. Suggests a complete cessation of the
policy in question (de Leon 1983).
b. Accounts of such eventually under
score the extent to which termination
often requires an ideological shift in
government and society allowing
uniform judgements of success of
failure to be made (Jordan et al. 2013).
Contoso Ltd.
Challenges in policy evaluation
Add a footer
11
1. Lack of
organizational
support
2. Shortage of
evaluation skills
3. Narrow
perception of
the scope of
evaluation
4. Insufficient capacity for
data collection
Technical &
Organizational
constraints
Contoso Ltd.
Add a footer
12
Political
1. Politically charged
environment for policy
evaluation
2. Unclear goals and
subjectivity in
interpreting result
3. The subjective nature of
the interpretation of
evaluation findings
4. Self-interest
Contoso Ltd.
Strategies for evaluators
Clarifying
evaluation
criteria,
benchmarking,
and performance
measures
Establishing
independent
evaluation
departments
within
government
agencies
Strengthening
nongovernmental
participation
Add a footer
13
Contoso Ltd.
○Evaluation is a key policy function
to which policy actors should
devote more care and attention
than they commonly do.
○Participatory monitoring and
evaluation of routine performance
data especially offers vast potential
for assessing performance and
drawing practical policy
conclusion.
Conclusion
Add a footer
14
Thank You

The Public Policy Primer text

  • 1.
    Chapter 6 Policy Evaluation PublicPolicy and Governance (950701)
  • 2.
    Introduction o Definition oThe process of policy evaluation o Types of evaluation o Utilization of evaluation results o Challenges in policy evaluation o Strategies for evaluators o Conclusion
  • 3.
    Contoso Ltd. ○ Synthesizingwhat is known about a problem and its proposed policy or program remedy; ○ Demystifying conventional wisdom related to either the problem or its solution(s); ○ Developing new information about information about program or policy effectiveness; and ○ Explainingto policy actors the implications of new information derived through evaluation Policy evaluation refers broadly to all the activities carried out by a range of state and societal actors to determine how a policy has fared inpracticeandtoestimatehowitis likely to perform in the future. 3 DefinitionEvaluation contributes to the policy-making process by:
  • 4.
    Contoso Ltd. The Processof policy evaluation Defining the scope of evaluation Determining evaluation criteria Collecting information Conducting evaluation 4
  • 5.
    Contoso Ltd. Types ofevaluation Add a footer 5 Input Process Output Outcome Impact Policy evaluation concentrates on one or more of the following types of information about policies performance:
  • 6.
    Contoso Ltd. 1. SimpleEvaluation Input evaluation Output evaluation Process evaluation 6
  • 7.
    Contoso Ltd. The centraltask of technical policy evaluation is frequently to isolate the effects of a particular policy from those caused by other factors. Add a footer 7 2. Outcome and Impact Evaluation Source: adapted from Rossi, Lipsey, and Freeman, 2004.
  • 8.
    Contoso Ltd. Evaluation designfor isolating net outcomes from gross outcomes Add a footer 8 2. Simple before/after comparison
  • 9.
    Contoso Ltd. Add afooter 9 Utilization of evaluation results Policy Learning a.Social Learning b.Lesson-drawing c.Policy-oriented Learning d.Government Learning
  • 10.
    Contoso Ltd. 10 Add afooter Policy Termination a. Suggests a complete cessation of the policy in question (de Leon 1983). b. Accounts of such eventually under score the extent to which termination often requires an ideological shift in government and society allowing uniform judgements of success of failure to be made (Jordan et al. 2013).
  • 11.
    Contoso Ltd. Challenges inpolicy evaluation Add a footer 11 1. Lack of organizational support 2. Shortage of evaluation skills 3. Narrow perception of the scope of evaluation 4. Insufficient capacity for data collection Technical & Organizational constraints
  • 12.
    Contoso Ltd. Add afooter 12 Political 1. Politically charged environment for policy evaluation 2. Unclear goals and subjectivity in interpreting result 3. The subjective nature of the interpretation of evaluation findings 4. Self-interest
  • 13.
    Contoso Ltd. Strategies forevaluators Clarifying evaluation criteria, benchmarking, and performance measures Establishing independent evaluation departments within government agencies Strengthening nongovernmental participation Add a footer 13
  • 14.
    Contoso Ltd. ○Evaluation isa key policy function to which policy actors should devote more care and attention than they commonly do. ○Participatory monitoring and evaluation of routine performance data especially offers vast potential for assessing performance and drawing practical policy conclusion. Conclusion Add a footer 14
  • 15.