SlideShare a Scribd company logo
1 of 28
Download to read offline
T E A M 4
MODULE 7: CHAPTER 17
G&M
What is evaluation to you?
Our text lists five program issues for evaluation:
● Quality
● Suitability
● Effectiveness
● Efficiency
● Importance
How do these components relate to your place of work? Can you
provide examples?
EVALUATION PRE-DISCUSSION
—Evaluation-estimating value
—Two steps
1.Compare results and objectives
2.Appraise or judge the value of the differences assessed
What is the difference between “measurement” and
“evaluation”?
EVALUATION
—A systematic process, reliant upon multiple skills
● —Collecting information
● —Interpreting data
● —Drawing conclusions
● —Communicating outcomes
The authors list two major purposes of evaluations.
What are they?
EVALUATION
ADDIE MODEL
1. Identify All Clients and Stakeholders and Clarify Their Needs
2. Identify the Performance Improvement Initiative to Be Evaluated
3. Identify and Clarify the Purposes for the Evaluation
4. Determine the Critical Research Questions That the Evaluation Must
Address
5. Develop an Evaluation Design
6. Analyze Resources and Constraints
7. Determine the Best Data Collection Methods
8. Plan Reporting and Communications Actions
Can one person explain a step of the process from their own
experience at work?
THE PROCESS
KIRKPATRICK’S FOUR LEVELS OF
EVALUATION MODEL
Most of us said that our organizations utilized the
Kirkpatrick model of evaluation, but in a limited
capacity (reaction and learning)
What do you think would have been an effective
method of incorporating Levels 3-4 (behavior and
impact) ?
KIRKPATRICK
● Helps training professionals to understand evaluation
in a systematic way
● A straightforward system for discussing training
outcomes
● recognizes that single outcome measures cannot
adequately reflect complexity of organizational
training programs (Bates, 2004)
Are there any other advantages of Kirkpatrick’s model
that you would like to add?
KIRKPATRICK ADVANTAGES
● Model is incomplete- oversimplified view of training
effectiveness. Other factors influence training
outcomes.
o learning culture of the organization
o organizational or work unit goals and values
o interpersonal support
o climate for learning transfer
o adequacy of material resources
(Bates, 2004)
KIRKPATRICK LIMITATIONS
● Assumption of Causal Linkages- model assumes
that the criteria represent a causal relationship
between the levels of evaluation
o research has failed to confirm causal linkages
o “ if training is going to be effective , it is
important that trainees react favorably” and
“without learning, no change in behavior will
occur” (Kirkpatrick, 1994)
(Bates, 2004)
KIRKPATRICK LIMITATIONS
● Incremental Importance of Information- model assumes
that each level of evaluation provides data that is more
informative than the last
o perception that establishing level 4 results provide
the most useful information
o “in practice, however, the weak conceptual
linkages inherent in the model and resulting data it
generates do not provide an adequate basis for this
assumption” (Bates, 2004)
KIRKPATRICK LIMITATIONS
•“Evaluation is the systematic process of delineating,
obtaining, reporting, and applying descriptive and
judgmental information about some object’s merit,
worth, probity [moral correctness], feasibility, safety,
significance, or equity"(Stufflebeam & Shinkfield,
2007)
EVALUATION
Context- Input-Process-Product
STUFFLEBEAM’S CIPP MODEL (1983)
What needs to be done? Context
How should it be done? Input
Is it being done? Process
Did it succeed? Product
STUFFLEBEAM’S CIPP MODEL
Uses for CIPP model:
● Conduct a needs analysis
● Evaluation of alternatives for addressing needs
● Monitor design/implementation of interventions
● Helps to examine outcomes of intervention
regarding impact to the organization
STUFFLEBEAM’S CIPP MODEL
● Addresses concerns of decision-makers for
justifying the investment in interventions/initiatives
● Provides a framework for comparing alternatives
for future investments
COST BENEFIT MODEL (KEARSLEY,
1986)
● Provides the expected benefit or return on
investment
● Expressed as a percentage or in actual dollars
● Identify the benefits of intervention ($), divide by
the cost (%) or subtract costs
RETURN ON INVESTMENT
● Helps to decide how to best allocate resources
● Disadvantage: most interventions or initiatives
provide benefits which are hard to quantify
RETURN ON INVESTMENT
1. What do you think is the difference between the
Cost Benefit Model and the ROI model?
2. Provide examples of when these models should be
used.
QUESTIONS:
7 step model
1. Determine purpose, objectives, participants (who
wants this information)
2. Assess information needs
3. Consider proper protocol
4. Describe population to be studied, selet subjects
5. Identify other variables
6. Formulate a study design
7. Formulate a management plan
FORMATIVE EVALUATIONS
● Most useful for evaluating instruction
● May be used to for performance improvement
and change interventions
FORMATIVE EVALUATIONS
“...evaluative inquiry can not only be a means of
accumulating information for decision making and
action..but that it also be equally concerned with
questioning and debating the value of what we do
in organizations” (Preskill and Torres, 1999)
EVALUATIVE INQUIRY
Evaluative inquiry is a way of fostering individual
learning and team learning within an organization ,
about issues that are critical to its purpose and what
it values (Parsons, 2009)
EVALUATIVE INQUIRY
● Collaboration
● Organizational learning and change
● Links learning and performance
● Diverse perspectives
EVALUATIVE INQUIRY
● A study is needed to evaluate and redesign an
online master’s degree program consisting of 12
courses in informatics
● Educators are concerned about the quality of
online education courses
● Meaningful assessment is essential for improving
quality of such programs
CASE STUDY FOR EVALUATION
Considering the evaluation models that we have
discussed:
1. Which model(s) would you consider appropriate
for this case? Why?
2. Design an evaluation program to include Steps 1-5
as described by Rothwell and Kazanas ( Gilley &
Maycunich, p. 430-432)
CASE STUDY FOR EVALUATION
Bates, R. (2004) A critical analysis of evaluation practice; the Kirkpatrick model and the
principle
of beneficence. Evaluation and program planning,27(3),341-34
Parsons, B. (2009) Evaluative inquiry for complex times. OD Practitioner, 41(1).
Preskill, H. & Torres, R. T.(1999). building capacity for organizational learning through
evaluative
inquiry. Evaluation, 5(1) 42-60
REFERENCES

More Related Content

What's hot

Rethinking Evaluation
Rethinking EvaluationRethinking Evaluation
Rethinking EvaluationDavid Wilson
 
Building Capacity to Measure, Analyze and Evaluate Government Performance
Building Capacity to Measure, Analyze and Evaluate Government PerformanceBuilding Capacity to Measure, Analyze and Evaluate Government Performance
Building Capacity to Measure, Analyze and Evaluate Government PerformanceWashington Evaluators
 
Assessing learning in Instructional Design
Assessing learning in Instructional DesignAssessing learning in Instructional Design
Assessing learning in Instructional Designleesha roberts
 
Krickpatrick basic level of evaluation
Krickpatrick basic level of evaluationKrickpatrick basic level of evaluation
Krickpatrick basic level of evaluationSajan Ks
 
The Ultimate Personal Project Guide
The Ultimate Personal Project GuideThe Ultimate Personal Project Guide
The Ultimate Personal Project GuideMirjam Berghuis
 
Presentation (m & e)
Presentation (m & e)Presentation (m & e)
Presentation (m & e)shainaanwar
 
The Evaluation of Learning
The Evaluation of Learning The Evaluation of Learning
The Evaluation of Learning Emma Weber
 
STRATEGIC AND OPERATIONAL MANAGEMENT-8615
STRATEGIC AND OPERATIONAL MANAGEMENT-8615STRATEGIC AND OPERATIONAL MANAGEMENT-8615
STRATEGIC AND OPERATIONAL MANAGEMENT-8615EqraBaig
 
Problem and situation analysis
Problem and situation analysisProblem and situation analysis
Problem and situation analysisMoamen Abu Nada
 
CHAPTER 12 DESIGNING AND CONDUCTING SUMMATIVE EVALUATION
CHAPTER 12 DESIGNING AND CONDUCTING SUMMATIVE EVALUATION CHAPTER 12 DESIGNING AND CONDUCTING SUMMATIVE EVALUATION
CHAPTER 12 DESIGNING AND CONDUCTING SUMMATIVE EVALUATION TruckBCH
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...Institute of Development Studies
 
Systems Approach to Training
Systems Approach to Training Systems Approach to Training
Systems Approach to Training Arete-Zoe, LLC
 

What's hot (20)

PROVUS'S DISCREPENCY EVALUATION MODEL
PROVUS'S DISCREPENCY EVALUATION MODELPROVUS'S DISCREPENCY EVALUATION MODEL
PROVUS'S DISCREPENCY EVALUATION MODEL
 
Rethinking Evaluation
Rethinking EvaluationRethinking Evaluation
Rethinking Evaluation
 
Building Capacity to Measure, Analyze and Evaluate Government Performance
Building Capacity to Measure, Analyze and Evaluate Government PerformanceBuilding Capacity to Measure, Analyze and Evaluate Government Performance
Building Capacity to Measure, Analyze and Evaluate Government Performance
 
Assessing learning in Instructional Design
Assessing learning in Instructional DesignAssessing learning in Instructional Design
Assessing learning in Instructional Design
 
Krickpatrick basic level of evaluation
Krickpatrick basic level of evaluationKrickpatrick basic level of evaluation
Krickpatrick basic level of evaluation
 
The Ultimate Personal Project Guide
The Ultimate Personal Project GuideThe Ultimate Personal Project Guide
The Ultimate Personal Project Guide
 
Cet7034 unit 3
Cet7034 unit 3Cet7034 unit 3
Cet7034 unit 3
 
Presentation (m & e)
Presentation (m & e)Presentation (m & e)
Presentation (m & e)
 
Cet7034 unit 7
Cet7034 unit 7Cet7034 unit 7
Cet7034 unit 7
 
09 l2i adaptivemanagement,innovationresearch
09 l2i adaptivemanagement,innovationresearch09 l2i adaptivemanagement,innovationresearch
09 l2i adaptivemanagement,innovationresearch
 
System approach
System approachSystem approach
System approach
 
The Evaluation of Learning
The Evaluation of Learning The Evaluation of Learning
The Evaluation of Learning
 
STRATEGIC AND OPERATIONAL MANAGEMENT-8615
STRATEGIC AND OPERATIONAL MANAGEMENT-8615STRATEGIC AND OPERATIONAL MANAGEMENT-8615
STRATEGIC AND OPERATIONAL MANAGEMENT-8615
 
Problem and situation analysis
Problem and situation analysisProblem and situation analysis
Problem and situation analysis
 
CHAPTER 12 DESIGNING AND CONDUCTING SUMMATIVE EVALUATION
CHAPTER 12 DESIGNING AND CONDUCTING SUMMATIVE EVALUATION CHAPTER 12 DESIGNING AND CONDUCTING SUMMATIVE EVALUATION
CHAPTER 12 DESIGNING AND CONDUCTING SUMMATIVE EVALUATION
 
Chapter 12
Chapter 12Chapter 12
Chapter 12
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
 
Systems Approach to Training
Systems Approach to Training Systems Approach to Training
Systems Approach to Training
 
Cet7034 unit 1
Cet7034 unit 1Cet7034 unit 1
Cet7034 unit 1
 
1 proposal writing 3-3
1 proposal writing 3-31 proposal writing 3-3
1 proposal writing 3-3
 

Viewers also liked

Design Options for Open Education
Design Options for Open EducationDesign Options for Open Education
Design Options for Open EducationMike KEPPELL
 
Curriculum constrction sem i evaluation models
Curriculum constrction sem i   evaluation modelsCurriculum constrction sem i   evaluation models
Curriculum constrction sem i evaluation modelsRaj Kumar
 
Management-Oriented Evaluation Approaches
Management-Oriented Evaluation ApproachesManagement-Oriented Evaluation Approaches
Management-Oriented Evaluation ApproachesLarry Weas
 
Final thesis presented december 2009 march 2010
Final thesis presented december 2009 march 2010Final thesis presented december 2009 march 2010
Final thesis presented december 2009 march 2010Lumbad 1989
 

Viewers also liked (6)

Design Options for Open Education
Design Options for Open EducationDesign Options for Open Education
Design Options for Open Education
 
Curriculum constrction sem i evaluation models
Curriculum constrction sem i   evaluation modelsCurriculum constrction sem i   evaluation models
Curriculum constrction sem i evaluation models
 
Management-Oriented Evaluation Approaches
Management-Oriented Evaluation ApproachesManagement-Oriented Evaluation Approaches
Management-Oriented Evaluation Approaches
 
Final thesis presented december 2009 march 2010
Final thesis presented december 2009 march 2010Final thesis presented december 2009 march 2010
Final thesis presented december 2009 march 2010
 
Final na final thesis
Final na final thesisFinal na final thesis
Final na final thesis
 
My thesis proposal
My thesis proposalMy thesis proposal
My thesis proposal
 

Similar to Module 7 g&m

seminar BSC.pdf2.pdf
seminar BSC.pdf2.pdfseminar BSC.pdf2.pdf
seminar BSC.pdf2.pdfShimaaHosney1
 
Data Driven Decision Making Presentation
Data Driven Decision Making PresentationData Driven Decision Making Presentation
Data Driven Decision Making PresentationRussell Kunz
 
Using a standards alignment model as a framework for doctoral candidate asses...
Using a standards alignment model as a framework for doctoral candidate asses...Using a standards alignment model as a framework for doctoral candidate asses...
Using a standards alignment model as a framework for doctoral candidate asses...CPEDInitiative
 
Training needs analysis, skills auditing and training
Training needs analysis, skills auditing and trainingTraining needs analysis, skills auditing and training
Training needs analysis, skills auditing and trainingCharles Cotter, PhD
 
Training Needs Analysis, Skills Auditing & Evaluation
Training Needs Analysis, Skills Auditing & EvaluationTraining Needs Analysis, Skills Auditing & Evaluation
Training Needs Analysis, Skills Auditing & EvaluationCharles Cotter, PhD
 
Chapter 11 Training Evaluation.ppt
Chapter 11 Training Evaluation.pptChapter 11 Training Evaluation.ppt
Chapter 11 Training Evaluation.pptDr. Nazrul Islam
 
Evaluation And Evaluation Of Evaluation
Evaluation And Evaluation Of EvaluationEvaluation And Evaluation Of Evaluation
Evaluation And Evaluation Of EvaluationDenise Enriquez
 
Measuring Learning Impact
Measuring Learning ImpactMeasuring Learning Impact
Measuring Learning ImpactIskandar Noor
 
OBJEKTIF PPT MODEL.pptx
OBJEKTIF PPT MODEL.pptxOBJEKTIF PPT MODEL.pptx
OBJEKTIF PPT MODEL.pptxSitiHafidah1
 
Key-Performance-Indicators.pptx
Key-Performance-Indicators.pptxKey-Performance-Indicators.pptx
Key-Performance-Indicators.pptxAsifAli165576
 
Reflect on and explore the reasons why evaluation is critical to tra.docx
Reflect on and explore the reasons why evaluation is critical to tra.docxReflect on and explore the reasons why evaluation is critical to tra.docx
Reflect on and explore the reasons why evaluation is critical to tra.docxlaurieellan
 
SharePoint "Moneyball" - The Art and Science of Winning the SharePoint Metric...
SharePoint "Moneyball" - The Art and Science of Winning the SharePoint Metric...SharePoint "Moneyball" - The Art and Science of Winning the SharePoint Metric...
SharePoint "Moneyball" - The Art and Science of Winning the SharePoint Metric...Susan Hanley
 
Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2Brent MacKinnon
 
MODELLING TRAINING EFFECTIVENESS AND ITS IMPACT ON DEVELOPMENT OF MANAGERS IN...
MODELLING TRAINING EFFECTIVENESS AND ITS IMPACT ON DEVELOPMENT OF MANAGERS IN...MODELLING TRAINING EFFECTIVENESS AND ITS IMPACT ON DEVELOPMENT OF MANAGERS IN...
MODELLING TRAINING EFFECTIVENESS AND ITS IMPACT ON DEVELOPMENT OF MANAGERS IN...IAEME Publication
 
Administration and Supervision in Evaluation
Administration and Supervision in EvaluationAdministration and Supervision in Evaluation
Administration and Supervision in EvaluationSharon Geroquia
 

Similar to Module 7 g&m (20)

seminar BSC.pdf2.pdf
seminar BSC.pdf2.pdfseminar BSC.pdf2.pdf
seminar BSC.pdf2.pdf
 
306 - Performance Management the Death Of the Collegiate system in HE
306 - Performance Management the Death Of the Collegiate system in HE306 - Performance Management the Death Of the Collegiate system in HE
306 - Performance Management the Death Of the Collegiate system in HE
 
Putting Program Evaluation to Work for You
Putting Program Evaluation to Work for YouPutting Program Evaluation to Work for You
Putting Program Evaluation to Work for You
 
Data Driven Decision Making Presentation
Data Driven Decision Making PresentationData Driven Decision Making Presentation
Data Driven Decision Making Presentation
 
Using a standards alignment model as a framework for doctoral candidate asses...
Using a standards alignment model as a framework for doctoral candidate asses...Using a standards alignment model as a framework for doctoral candidate asses...
Using a standards alignment model as a framework for doctoral candidate asses...
 
Training needs analysis, skills auditing and training
Training needs analysis, skills auditing and trainingTraining needs analysis, skills auditing and training
Training needs analysis, skills auditing and training
 
Training Needs Analysis, Skills Auditing & Evaluation
Training Needs Analysis, Skills Auditing & EvaluationTraining Needs Analysis, Skills Auditing & Evaluation
Training Needs Analysis, Skills Auditing & Evaluation
 
Chapter 11 Training Evaluation.ppt
Chapter 11 Training Evaluation.pptChapter 11 Training Evaluation.ppt
Chapter 11 Training Evaluation.ppt
 
Trg evaluation
Trg evaluationTrg evaluation
Trg evaluation
 
Evaluation And Evaluation Of Evaluation
Evaluation And Evaluation Of EvaluationEvaluation And Evaluation Of Evaluation
Evaluation And Evaluation Of Evaluation
 
Measuring Learning Impact
Measuring Learning ImpactMeasuring Learning Impact
Measuring Learning Impact
 
OBJEKTIF PPT MODEL.pptx
OBJEKTIF PPT MODEL.pptxOBJEKTIF PPT MODEL.pptx
OBJEKTIF PPT MODEL.pptx
 
Training Needs Analysis
Training Needs AnalysisTraining Needs Analysis
Training Needs Analysis
 
Key-Performance-Indicators.pptx
Key-Performance-Indicators.pptxKey-Performance-Indicators.pptx
Key-Performance-Indicators.pptx
 
Reflect on and explore the reasons why evaluation is critical to tra.docx
Reflect on and explore the reasons why evaluation is critical to tra.docxReflect on and explore the reasons why evaluation is critical to tra.docx
Reflect on and explore the reasons why evaluation is critical to tra.docx
 
SharePoint "Moneyball" - The Art and Science of Winning the SharePoint Metric...
SharePoint "Moneyball" - The Art and Science of Winning the SharePoint Metric...SharePoint "Moneyball" - The Art and Science of Winning the SharePoint Metric...
SharePoint "Moneyball" - The Art and Science of Winning the SharePoint Metric...
 
Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2
 
MODELLING TRAINING EFFECTIVENESS AND ITS IMPACT ON DEVELOPMENT OF MANAGERS IN...
MODELLING TRAINING EFFECTIVENESS AND ITS IMPACT ON DEVELOPMENT OF MANAGERS IN...MODELLING TRAINING EFFECTIVENESS AND ITS IMPACT ON DEVELOPMENT OF MANAGERS IN...
MODELLING TRAINING EFFECTIVENESS AND ITS IMPACT ON DEVELOPMENT OF MANAGERS IN...
 
www.ijerd.com
www.ijerd.comwww.ijerd.com
www.ijerd.com
 
Administration and Supervision in Evaluation
Administration and Supervision in EvaluationAdministration and Supervision in Evaluation
Administration and Supervision in Evaluation
 

Recently uploaded

PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdfPHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdfSumit Tiwari
 
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...Marlene Maheu
 
LEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollLEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollDr. Bruce A. Johnson
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudDr. Bruce A. Johnson
 
Quantitative research methodology and survey design
Quantitative research methodology and survey designQuantitative research methodology and survey design
Quantitative research methodology and survey designBalelaBoru
 
Alamkara theory by Bhamaha Indian Poetics (1).pptx
Alamkara theory by Bhamaha Indian Poetics (1).pptxAlamkara theory by Bhamaha Indian Poetics (1).pptx
Alamkara theory by Bhamaha Indian Poetics (1).pptxDhatriParmar
 
POST ENCEPHALITIS case study Jitendra bhargav
POST ENCEPHALITIS case study  Jitendra bhargavPOST ENCEPHALITIS case study  Jitendra bhargav
POST ENCEPHALITIS case study Jitendra bhargavJitendra Bhargav
 
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in PharmacyASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in PharmacySumit Tiwari
 
Auchitya Theory by Kshemendra Indian Poetics
Auchitya Theory by Kshemendra Indian PoeticsAuchitya Theory by Kshemendra Indian Poetics
Auchitya Theory by Kshemendra Indian PoeticsDhatriParmar
 
Pharmacology chapter No 7 full notes.pdf
Pharmacology chapter No 7 full notes.pdfPharmacology chapter No 7 full notes.pdf
Pharmacology chapter No 7 full notes.pdfSumit Tiwari
 
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptxMetabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptxDr. Santhosh Kumar. N
 
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptxAUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptxiammrhaywood
 
AI Uses and Misuses: Academic and Workplace Applications
AI Uses and Misuses: Academic and Workplace ApplicationsAI Uses and Misuses: Academic and Workplace Applications
AI Uses and Misuses: Academic and Workplace ApplicationsStella Lee
 
Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024bsellato
 
3.14.24 The Selma March and the Voting Rights Act.pptx
3.14.24 The Selma March and the Voting Rights Act.pptx3.14.24 The Selma March and the Voting Rights Act.pptx
3.14.24 The Selma March and the Voting Rights Act.pptxmary850239
 
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...AKSHAYMAGAR17
 
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17Celine George
 
3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptxmary850239
 

Recently uploaded (20)

PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdfPHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
PHARMACOGNOSY CHAPTER NO 5 CARMINATIVES AND G.pdf
 
Least Significance Difference:Biostatics and Research Methodology
Least Significance Difference:Biostatics and Research MethodologyLeast Significance Difference:Biostatics and Research Methodology
Least Significance Difference:Biostatics and Research Methodology
 
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
2024 March 11, Telehealth Billing- Current Telehealth CPT Codes & Telehealth ...
 
LEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community CollLEAD5623 The Economics of Community Coll
LEAD5623 The Economics of Community Coll
 
LEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced StudLEAD6001 - Introduction to Advanced Stud
LEAD6001 - Introduction to Advanced Stud
 
Quantitative research methodology and survey design
Quantitative research methodology and survey designQuantitative research methodology and survey design
Quantitative research methodology and survey design
 
Alamkara theory by Bhamaha Indian Poetics (1).pptx
Alamkara theory by Bhamaha Indian Poetics (1).pptxAlamkara theory by Bhamaha Indian Poetics (1).pptx
Alamkara theory by Bhamaha Indian Poetics (1).pptx
 
POST ENCEPHALITIS case study Jitendra bhargav
POST ENCEPHALITIS case study  Jitendra bhargavPOST ENCEPHALITIS case study  Jitendra bhargav
POST ENCEPHALITIS case study Jitendra bhargav
 
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in PharmacyASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
ASTRINGENTS.pdf Pharmacognosy chapter 5 diploma in Pharmacy
 
Problems on Mean,Mode,Median Standard Deviation
Problems on Mean,Mode,Median Standard DeviationProblems on Mean,Mode,Median Standard Deviation
Problems on Mean,Mode,Median Standard Deviation
 
Auchitya Theory by Kshemendra Indian Poetics
Auchitya Theory by Kshemendra Indian PoeticsAuchitya Theory by Kshemendra Indian Poetics
Auchitya Theory by Kshemendra Indian Poetics
 
Pharmacology chapter No 7 full notes.pdf
Pharmacology chapter No 7 full notes.pdfPharmacology chapter No 7 full notes.pdf
Pharmacology chapter No 7 full notes.pdf
 
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptxMetabolism of  lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
Metabolism of lipoproteins & its disorders(Chylomicron & VLDL & LDL).pptx
 
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptxAUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
AUDIENCE THEORY - PARTICIPATORY - JENKINS.pptx
 
AI Uses and Misuses: Academic and Workplace Applications
AI Uses and Misuses: Academic and Workplace ApplicationsAI Uses and Misuses: Academic and Workplace Applications
AI Uses and Misuses: Academic and Workplace Applications
 
Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024Awards Presentation 2024 - March 12 2024
Awards Presentation 2024 - March 12 2024
 
3.14.24 The Selma March and the Voting Rights Act.pptx
3.14.24 The Selma March and the Voting Rights Act.pptx3.14.24 The Selma March and the Voting Rights Act.pptx
3.14.24 The Selma March and the Voting Rights Act.pptx
 
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
DNA and RNA , Structure, Functions, Types, difference, Similarities, Protein ...
 
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
How to Customise Quotation's Appearance Using PDF Quote Builder in Odoo 17
 
3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx3.14.24 Gender Discrimination and Gender Inequity.pptx
3.14.24 Gender Discrimination and Gender Inequity.pptx
 

Module 7 g&m

  • 1. T E A M 4 MODULE 7: CHAPTER 17 G&M
  • 2. What is evaluation to you? Our text lists five program issues for evaluation: ● Quality ● Suitability ● Effectiveness ● Efficiency ● Importance How do these components relate to your place of work? Can you provide examples? EVALUATION PRE-DISCUSSION
  • 3. —Evaluation-estimating value —Two steps 1.Compare results and objectives 2.Appraise or judge the value of the differences assessed What is the difference between “measurement” and “evaluation”? EVALUATION
  • 4. —A systematic process, reliant upon multiple skills ● —Collecting information ● —Interpreting data ● —Drawing conclusions ● —Communicating outcomes The authors list two major purposes of evaluations. What are they? EVALUATION
  • 6. 1. Identify All Clients and Stakeholders and Clarify Their Needs 2. Identify the Performance Improvement Initiative to Be Evaluated 3. Identify and Clarify the Purposes for the Evaluation 4. Determine the Critical Research Questions That the Evaluation Must Address 5. Develop an Evaluation Design 6. Analyze Resources and Constraints 7. Determine the Best Data Collection Methods 8. Plan Reporting and Communications Actions Can one person explain a step of the process from their own experience at work? THE PROCESS
  • 7. KIRKPATRICK’S FOUR LEVELS OF EVALUATION MODEL
  • 8. Most of us said that our organizations utilized the Kirkpatrick model of evaluation, but in a limited capacity (reaction and learning) What do you think would have been an effective method of incorporating Levels 3-4 (behavior and impact) ? KIRKPATRICK
  • 9. ● Helps training professionals to understand evaluation in a systematic way ● A straightforward system for discussing training outcomes ● recognizes that single outcome measures cannot adequately reflect complexity of organizational training programs (Bates, 2004) Are there any other advantages of Kirkpatrick’s model that you would like to add? KIRKPATRICK ADVANTAGES
  • 10. ● Model is incomplete- oversimplified view of training effectiveness. Other factors influence training outcomes. o learning culture of the organization o organizational or work unit goals and values o interpersonal support o climate for learning transfer o adequacy of material resources (Bates, 2004) KIRKPATRICK LIMITATIONS
  • 11. ● Assumption of Causal Linkages- model assumes that the criteria represent a causal relationship between the levels of evaluation o research has failed to confirm causal linkages o “ if training is going to be effective , it is important that trainees react favorably” and “without learning, no change in behavior will occur” (Kirkpatrick, 1994) (Bates, 2004) KIRKPATRICK LIMITATIONS
  • 12. ● Incremental Importance of Information- model assumes that each level of evaluation provides data that is more informative than the last o perception that establishing level 4 results provide the most useful information o “in practice, however, the weak conceptual linkages inherent in the model and resulting data it generates do not provide an adequate basis for this assumption” (Bates, 2004) KIRKPATRICK LIMITATIONS
  • 13. •“Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and judgmental information about some object’s merit, worth, probity [moral correctness], feasibility, safety, significance, or equity"(Stufflebeam & Shinkfield, 2007) EVALUATION
  • 15. What needs to be done? Context How should it be done? Input Is it being done? Process Did it succeed? Product STUFFLEBEAM’S CIPP MODEL
  • 16. Uses for CIPP model: ● Conduct a needs analysis ● Evaluation of alternatives for addressing needs ● Monitor design/implementation of interventions ● Helps to examine outcomes of intervention regarding impact to the organization STUFFLEBEAM’S CIPP MODEL
  • 17. ● Addresses concerns of decision-makers for justifying the investment in interventions/initiatives ● Provides a framework for comparing alternatives for future investments COST BENEFIT MODEL (KEARSLEY, 1986)
  • 18. ● Provides the expected benefit or return on investment ● Expressed as a percentage or in actual dollars ● Identify the benefits of intervention ($), divide by the cost (%) or subtract costs RETURN ON INVESTMENT
  • 19. ● Helps to decide how to best allocate resources ● Disadvantage: most interventions or initiatives provide benefits which are hard to quantify RETURN ON INVESTMENT
  • 20. 1. What do you think is the difference between the Cost Benefit Model and the ROI model? 2. Provide examples of when these models should be used. QUESTIONS:
  • 21. 7 step model 1. Determine purpose, objectives, participants (who wants this information) 2. Assess information needs 3. Consider proper protocol 4. Describe population to be studied, selet subjects 5. Identify other variables 6. Formulate a study design 7. Formulate a management plan FORMATIVE EVALUATIONS
  • 22. ● Most useful for evaluating instruction ● May be used to for performance improvement and change interventions FORMATIVE EVALUATIONS
  • 23. “...evaluative inquiry can not only be a means of accumulating information for decision making and action..but that it also be equally concerned with questioning and debating the value of what we do in organizations” (Preskill and Torres, 1999) EVALUATIVE INQUIRY
  • 24. Evaluative inquiry is a way of fostering individual learning and team learning within an organization , about issues that are critical to its purpose and what it values (Parsons, 2009) EVALUATIVE INQUIRY
  • 25. ● Collaboration ● Organizational learning and change ● Links learning and performance ● Diverse perspectives EVALUATIVE INQUIRY
  • 26. ● A study is needed to evaluate and redesign an online master’s degree program consisting of 12 courses in informatics ● Educators are concerned about the quality of online education courses ● Meaningful assessment is essential for improving quality of such programs CASE STUDY FOR EVALUATION
  • 27. Considering the evaluation models that we have discussed: 1. Which model(s) would you consider appropriate for this case? Why? 2. Design an evaluation program to include Steps 1-5 as described by Rothwell and Kazanas ( Gilley & Maycunich, p. 430-432) CASE STUDY FOR EVALUATION
  • 28. Bates, R. (2004) A critical analysis of evaluation practice; the Kirkpatrick model and the principle of beneficence. Evaluation and program planning,27(3),341-34 Parsons, B. (2009) Evaluative inquiry for complex times. OD Practitioner, 41(1). Preskill, H. & Torres, R. T.(1999). building capacity for organizational learning through evaluative inquiry. Evaluation, 5(1) 42-60 REFERENCES