SlideShare a Scribd company logo
1 of 23
Program Evaluation George Vukotich, Ph.D.   Copyright © 2004 Intergovernmental Executive Development Program
Program Evaluation Measuring Success It all begins with setting goals and  knowing where you are going.
SMART GOALS ,[object Object],[object Object],[object Object],[object Object],[object Object]
Relevant Measurement ,[object Object],[object Object],[object Object],Are we measuring the right thing.
Price / Quality / Innovation What is your organization known for. What is your approach to providing services.
What to Evaluate e.g. Evaluating IEDP ,[object Object],[object Object],[object Object],[object Object],[object Object]
Evaluation Process ADDIE Model ,[object Object],[object Object],[object Object],[object Object],[object Object]
Evaluate to What Standard ,[object Object],[object Object],[object Object],[object Object],[object Object]
How to evaluate ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Degree of Success ,[object Object],[object Object]
Formative vs. Summative ,[object Object],[object Object]
Test – Retest Methodology
Sampling
Data – Not just getting it, but    using it.
Reliability and Validity ,[object Object],[object Object],[object Object]
Kirkpatrick’s 4 - Levels ,[object Object],[object Object],[object Object],[object Object]
Balanced Scorecard
Cost / Benefit Analysis ,[object Object],[object Object],[object Object],[object Object]
Unintended Consequences What is  the cost of making an error in our evaluation. Risk Analysis
[object Object],[object Object],[object Object],[object Object],[object Object],C O R R E L A T I O N S Return on Investment (ROI)
Theory into practice How can your team use “program evaluation”  to help you be more successful.
 
 

More Related Content

What's hot

Joshua grant resume
Joshua grant resumeJoshua grant resume
Joshua grant resume
jngrant117
 
Return On Investment Training And Development
Return On Investment   Training And DevelopmentReturn On Investment   Training And Development
Return On Investment Training And Development
Ahmed Zeen EL Abeden
 
The 5 D's of Innovation
The 5 D's of InnovationThe 5 D's of Innovation
The 5 D's of Innovation
Ben Wilkoff
 

What's hot (19)

The Kirkpatrick-Phillips-Evaluation Model
The Kirkpatrick-Phillips-Evaluation ModelThe Kirkpatrick-Phillips-Evaluation Model
The Kirkpatrick-Phillips-Evaluation Model
 
Return on Investment On Training
Return on Investment On TrainingReturn on Investment On Training
Return on Investment On Training
 
Devry proj 410 week 6 dq 2
Devry proj 410 week 6 dq 2Devry proj 410 week 6 dq 2
Devry proj 410 week 6 dq 2
 
You Can Do Program Evaluation
You Can Do Program EvaluationYou Can Do Program Evaluation
You Can Do Program Evaluation
 
Pan eSeminar Two For One Using Assessments For Selection & Development 06...
Pan eSeminar Two For One Using Assessments For Selection & Development 06...Pan eSeminar Two For One Using Assessments For Selection & Development 06...
Pan eSeminar Two For One Using Assessments For Selection & Development 06...
 
Business BTEC
Business BTECBusiness BTEC
Business BTEC
 
Project Management - Value Proposition
Project Management - Value PropositionProject Management - Value Proposition
Project Management - Value Proposition
 
Joshua grant resume
Joshua grant resumeJoshua grant resume
Joshua grant resume
 
Return On Investment Training And Development
Return On Investment   Training And DevelopmentReturn On Investment   Training And Development
Return On Investment Training And Development
 
Free PMP Sample Q & A
Free PMP Sample Q & AFree PMP Sample Q & A
Free PMP Sample Q & A
 
Change Management & Project Management reporting integration using inverted p...
Change Management & Project Management reporting integration using inverted p...Change Management & Project Management reporting integration using inverted p...
Change Management & Project Management reporting integration using inverted p...
 
Free PMP Sample Q & A
Free PMP Sample Q & AFree PMP Sample Q & A
Free PMP Sample Q & A
 
The 5 D's of Innovation
The 5 D's of InnovationThe 5 D's of Innovation
The 5 D's of Innovation
 
Measuring roi of training
Measuring roi of trainingMeasuring roi of training
Measuring roi of training
 
Project Management: definition, examples and benefits
Project Management: definition, examples and benefitsProject Management: definition, examples and benefits
Project Management: definition, examples and benefits
 
MSc Thesis Presentation
MSc Thesis PresentationMSc Thesis Presentation
MSc Thesis Presentation
 
Free PMP Sample Q & A
Free PMP Sample Q & AFree PMP Sample Q & A
Free PMP Sample Q & A
 
Rajesh Resume
Rajesh ResumeRajesh Resume
Rajesh Resume
 
Addie
AddieAddie
Addie
 

Viewers also liked (6)

Workforce 2020 White Paper
Workforce 2020 White PaperWorkforce 2020 White Paper
Workforce 2020 White Paper
 
Curriculum Development Roadmap
Curriculum Development RoadmapCurriculum Development Roadmap
Curriculum Development Roadmap
 
Opening Keynote "Shaping the HIT Leader’s Future: Dynamic Industry Drivers a...
Opening Keynote "Shaping the HIT Leader’s Future:  Dynamic Industry Drivers a...Opening Keynote "Shaping the HIT Leader’s Future:  Dynamic Industry Drivers a...
Opening Keynote "Shaping the HIT Leader’s Future: Dynamic Industry Drivers a...
 
Leveraging the Present, Preparing for the Future
Leveraging the Present, Preparing for the FutureLeveraging the Present, Preparing for the Future
Leveraging the Present, Preparing for the Future
 
Future trends in leadership development
Future trends in leadership developmentFuture trends in leadership development
Future trends in leadership development
 
LavaCon 2015 New Manager Boot Camp
LavaCon 2015 New Manager Boot CampLavaCon 2015 New Manager Boot Camp
LavaCon 2015 New Manager Boot Camp
 

Similar to Program Evaluation Handouts

Validation & evaluation
Validation & evaluationValidation & evaluation
Validation & evaluation
Shruti
 
Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...
Dr. Regis P. Chasse, MBA
 
Black, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomesBlack, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomes
eaquals
 

Similar to Program Evaluation Handouts (20)

Rethinking Evaluation
Rethinking EvaluationRethinking Evaluation
Rethinking Evaluation
 
Value Summary Online Improvement Portal: Product Overview
Value Summary Online Improvement Portal: Product OverviewValue Summary Online Improvement Portal: Product Overview
Value Summary Online Improvement Portal: Product Overview
 
Evaluating hrd-programs
Evaluating hrd-programsEvaluating hrd-programs
Evaluating hrd-programs
 
Unit 8 updated
Unit 8 updatedUnit 8 updated
Unit 8 updated
 
Does your learning solution solve business performance problems?
Does your learning solution solve business performance problems?Does your learning solution solve business performance problems?
Does your learning solution solve business performance problems?
 
Validation & evaluation
Validation & evaluationValidation & evaluation
Validation & evaluation
 
ROI-Institute-Brochure1
ROI-Institute-Brochure1ROI-Institute-Brochure1
ROI-Institute-Brochure1
 
Importance of M&E
Importance of M&EImportance of M&E
Importance of M&E
 
Module 5 Training Evaluation.pptx
Module 5 Training Evaluation.pptxModule 5 Training Evaluation.pptx
Module 5 Training Evaluation.pptx
 
Innovation Management for BU syllabus
Innovation Management for BU syllabusInnovation Management for BU syllabus
Innovation Management for BU syllabus
 
Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...
 
Black, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomesBlack, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomes
 
Sub Contractor Evaluation - Sahil Bhutani
Sub Contractor Evaluation - Sahil BhutaniSub Contractor Evaluation - Sahil Bhutani
Sub Contractor Evaluation - Sahil Bhutani
 
Performance Management
Performance ManagementPerformance Management
Performance Management
 
Trg evaluation
Trg evaluationTrg evaluation
Trg evaluation
 
Training evaluation
Training evaluationTraining evaluation
Training evaluation
 
Placing A Value On World Class Skills
Placing A Value On World Class SkillsPlacing A Value On World Class Skills
Placing A Value On World Class Skills
 
Transform Organisational Culture - Defining, Communicating and Measuring Core...
Transform Organisational Culture - Defining, Communicating and Measuring Core...Transform Organisational Culture - Defining, Communicating and Measuring Core...
Transform Organisational Culture - Defining, Communicating and Measuring Core...
 
Utilization of evaluation
Utilization of evaluationUtilization of evaluation
Utilization of evaluation
 
Evaluation of training
Evaluation of trainingEvaluation of training
Evaluation of training
 

More from George Vukotich

10 steps to successful change management presentation 062811
10 steps to successful change management presentation 06281110 steps to successful change management presentation 062811
10 steps to successful change management presentation 062811
George Vukotich
 
19 maple tree court layout
19 maple tree court layout19 maple tree court layout
19 maple tree court layout
George Vukotich
 

More from George Vukotich (8)

Mentoring Startups - What it takes to make a difference
Mentoring Startups - What it takes to make a differenceMentoring Startups - What it takes to make a difference
Mentoring Startups - What it takes to make a difference
 
Persuasion
Persuasion Persuasion
Persuasion
 
TeamSTEPPS Vukotich UIC PSL Octomber 2019
TeamSTEPPS Vukotich UIC PSL Octomber 2019TeamSTEPPS Vukotich UIC PSL Octomber 2019
TeamSTEPPS Vukotich UIC PSL Octomber 2019
 
10 steps to successful change management presentation 062811
10 steps to successful change management presentation 06281110 steps to successful change management presentation 062811
10 steps to successful change management presentation 062811
 
19 maple tree court layout
19 maple tree court layout19 maple tree court layout
19 maple tree court layout
 
Sun Star Dental Alternative To Dental Insurance
Sun Star Dental Alternative To Dental InsuranceSun Star Dental Alternative To Dental Insurance
Sun Star Dental Alternative To Dental Insurance
 
Breaking the Chains of Culture - Slides used in Webinar with the Best Practic...
Breaking the Chains of Culture - Slides used in Webinar with the Best Practic...Breaking the Chains of Culture - Slides used in Webinar with the Best Practic...
Breaking the Chains of Culture - Slides used in Webinar with the Best Practic...
 
Oprf Small Business Networking Event Chang Ehandouts052009
Oprf Small Business Networking Event Chang Ehandouts052009Oprf Small Business Networking Event Chang Ehandouts052009
Oprf Small Business Networking Event Chang Ehandouts052009
 

Recently uploaded

Recently uploaded (20)

WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through Observability
 
Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at Comcast
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
Strategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering TeamsStrategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering Teams
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty Secure
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
The UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoThe UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, Ocado
 
THE BEST IPTV in GERMANY for 2024: IPTVreel
THE BEST IPTV in  GERMANY for 2024: IPTVreelTHE BEST IPTV in  GERMANY for 2024: IPTVreel
THE BEST IPTV in GERMANY for 2024: IPTVreel
 

Program Evaluation Handouts