evaluation

1. EVALUATION RESEARCH DESIGNS
Lecturer : Dr. Imron Rosidy, M. Th., M.Ed
Presented By
Habil Syahril Haj (230101210021)
Muhammad Fery (230101210043)

2. Contents Overview
1. Definition of Evaluation Research Designs
2. Basic Concepts of Evaluation Research
Designs
3. Types of Evaluation Research Design
4. Characteristics of Evaluation Research
Designs
5. Methods of Evaluation Research Designs

3. Definition of evaluation research designs
Evaluation research design is a scientific method
used to determine the effectiveness of a
program, policy, project, and specific activities
that have been implemented, are ongoing, and
future programs.
Prof. Dr. Sugiyono, Evaluation Research Methods (Bandung:Alfabeta, 2018), 3.

4. Basic concepts of evaluation research
designs
Programs and
Objectives
Program
Implementation
Activities
Results
achieved
Data Collection Activities
Comparing
Implementation
with Plan
Comparing
Results with
Program
objectives
Plan
implementation
level information
Program
achievement
level information
Follow-up program & method improvements
Prof. Dr. Sugiyono, Evaluation
Research Methods
(Bandung:Alfabeta, 2018), 5.

5. Types of evaluation research
designs
Summative
Evaluation
Formative
Evaluation
Prof. Dr. Sugiyono, Evaluation Research Methods (Bandung:Alfabeta, 2018), 10.

6. Summative Evaluation
1. Outcome Evaluation
2. Impact Evaluation
3. Cost- evectivennes and cost benefit analysis
4. Secondary analysis
5. Meta-analysis
Prof. Dr. Sugiyono, Evaluation Research Methods (Bandung:Alfabeta, 2018), 11.

7. Formative Evaluation
1. Needs assesment
2. Evaluability asessment
3. Structured conceptualization
4. Implementation evaluation
5. Process evaluation
Prof. Dr. Sugiyono, Evaluation Research Methods (Bandung:Alfabeta, 2018), 10.

8. The difference between summative and formative evaluation
Aspects Formative Evaluation Summative Evaluation
Uses Improving Programs Making program decisions in
the future
Audience Program Manager and staff Policymakers and consumers
Main characteristics Obtain feedback for program
implementers
Make a decision whether the
program is continued or not
Design What information do you need? What standards are used to
make decisions
Purpose of data
collection
Finding flaws Judgmental
Data collection
frequency
Often Infrequently
Sample Size Small Big
Prof. Dr. Sugiyono, Evaluation Research Methods (Bandung:Alfabeta, 2018), 10.

9. Characteristics of Evaluation Research
Designs
1. Knowing the achievement of the vision, mission
and goals
2. Focusing on evaluators and stakeholders
3. Evaluation results for decision making
4. Instruments are arranged based on program
objectives
5. Publication limited to stakeholders

10. Methods Of Evaluation Research
Designs
Quantitative
Methods
Qualitative
Methods
John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And
Qualitative Research (Boston: Pearson Education,2012), 283

11. John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And
Qualitative Research (Boston: Pearson Education,2012), 283
1. emphasis on the quality of the hypotheses and
variables
2. the control of extraneous variables,
3. and the importance of the discussion
4. and its implications for research and practice.
Quantitative Standards

12. Lincoln’s (1995)
Philosophical
Criteria:
Creswell’s (2007)
Procedural
Criteria:
Richardson’s (2000)
Participatory and Advocacy
Criteria
John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And
Qualitative Research (Boston: Pearson Education,2012), 285
Qualitative Standards
• Standards set in the inquiry
community such as guidelines
for publication.
• Positionality: The “text” should
display honesty or authenticity
about its own stance and about
the position of the author.
• It employs a tradition of inquiry,
such as case study, ethnography,
grounded theory, or narrative inquiry
as a procedural guide for the study
.
• It starts with a single focus on a
central phenomenon rather than a
comparison or relationship (as in
quantitative research).
• Substantive contribution: Does
this piece contribute to our
understanding of social life?
• Aesthetic merit: Does this piece
succeed aesthetically? Does the
use
of practices open up the text and
invite interpretive responses? Is the
text artistically shaped, satis

13. Checklist for Evaluating the Process of a
Quantitative Study
• Title for the Study.
• Problem Statement.
• Review of the Literature.
• Purpose, Hypotheses, and Research Questions.
• Data Collection
• Data Analysis and Results.
• Writing
John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And
Qualitative Research (Boston: Pearson Education,2012), 286

14. Checklist for Evaluating the Process of a
Qualitative Study
• Title for the Study.
• Problem Statement.
• Review of the Literature.
• Purpose and Research Questions
• Data Collection.
• Data Analysis and Findings
• Writing
John W. Creswell, educational Research: Planning, Conducting, And Evaluating Quantitative And
Qualitative Research (Boston: Pearson Education,2012), 287

15. Conclusion
Evaluation research is a method of in-depth analysis of an
activity, program, or policy with the aim of measuring its
effectiveness, efficiency, relevance, and impact. Through
evaluation research, researchers can infer the extent to
which a program has achieved its objectives, identify factors
that influence its results, and provide recommendations for
future improvement or development