SlideShare a Scribd company logo
1 of 25
Measure Learning Effectiveness
Without Breaking the Budget
Julie Fitzgerald Z Energy Phil Garing Synapsys N.Z. Ltd
Covering
• Where is New Zealand and who is Z Energy?
• The Evaluator backstory
• The Z evaluation, process and survey results
• Sheep farmers want evaluation too!
• Top tips; getting evaluation right
The Evaluator
Deloitte Global Human Capital Trends
2016
The promise of new tools and
technologies
Engage on job
Build sustainable communities of learning
Reduce development cost
Increase uptake and application
Break the tyranny of distance
Break the shackles of the LMS
Investment approach
We need
investment
We need a
business
case
We need
to justify
investment
We need
evidence
of ROI
We’re
delivering
value!
Learning &
Development
2020
Learning &
Development
2010
Application
Knowledge
OutcomeProcess
Kirkpatrick 1
Kirkpatrick 2
Kirkpatrick 3
Kirkpatrick 4
Find the sweet spot: Kirkpatrick Level 3?
Right tool for the job?
ROI Navigator
Project based research
Portfolio Observation
LRS/xAPI
LMS
Survey
TheEvaluator
Kirkpatrick 1
Kirkpatrick 2
Kirkpatrick 3
Kirkpatrick 4
Continuous
improvement
Demonstrate
changed
behaviour on
job
The Evaluator
Smart surveying
Proven rubrics
Rich analytics
Smart surveying
• No questions, just aspirational statements
• No scale/forced choice – just react to perfection
Analysis: polar map, role comparisons
The outcomes for Z
The Red Meat Profit Partnership
The Red Meat Profit Partnership (RMPP)
• A collaboration
between the Red
Meat Sector and
the New Zealand
Government.
• To drive sustainable
productivity
improvements in
the sheep and beef
sector
The evaluation questions
• How good was delivery?
• Were farmers more confident in their stock selection decisions?
• Can we use the tool to measure all programmes?
The programme
• Workshop and applied training in decisionmaking on genetic stock selection
• Delivered by Meat Processing companies, supported by RMPP
Focus Before Workshop 1 Workshop 2
Farmer confidence Y Y Y
Facilitation Y Y
Content Y Y
Before Immediately after 12 weeks
Confidence in stock selection
Key outcomes for RMPP
• Stronger, clearer relationships with on farm advisors
• Better uptake of technology tools
• Improvement in delivery of content between workshops
• Evaluation framework for rollout across programmes
Evaluation: Top tips
1. Be clear about ‘why?’, and who will decide what from the results
2. Target the right measures; people have to trust the results
3. Kirkpatrick Level 3 is ‘bang for buck’ for many organisations wanting
evidence of value
4. Data must be useable
Your feedback helps ATD continue to provide top-notch educational
programs that help you stay on top of a changing profession.
Evaluations forms for this session are available via the mobile app
and at the following link: http://www.atdconference.org/attendees.

More Related Content

What's hot

6 Disciplines of Breakthrough Learning
6 Disciplines of Breakthrough Learning6 Disciplines of Breakthrough Learning
6 Disciplines of Breakthrough LearningS Babu
 
Soft skill training need and market potential
Soft skill training need and market potentialSoft skill training need and market potential
Soft skill training need and market potentialSamuel Sekhar 2000+
 
Management trainee report.ppt
Management trainee report.pptManagement trainee report.ppt
Management trainee report.pptGeekaranja
 
Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...Dr. Regis P. Chasse, MBA
 
The Future of Learning & Development
The Future of Learning & DevelopmentThe Future of Learning & Development
The Future of Learning & DevelopmentGabriel Banerjee
 
Learning and Development mission, strategy, and goals
Learning and Development mission, strategy, and goalsLearning and Development mission, strategy, and goals
Learning and Development mission, strategy, and goalsJerry Davis
 
PVibesCapabilityL&D
PVibesCapabilityL&DPVibesCapabilityL&D
PVibesCapabilityL&DShibaji Bose
 
7 Key Elements for Every Top Learning Strategy - Webinar 02.19.14
7 Key Elements for Every Top Learning Strategy - Webinar 02.19.147 Key Elements for Every Top Learning Strategy - Webinar 02.19.14
7 Key Elements for Every Top Learning Strategy - Webinar 02.19.14BizLibrary
 
Questionnaire on training
Questionnaire on trainingQuestionnaire on training
Questionnaire on trainingswati_tiwari
 
Employee Training and Development: How to Measure Effectiveness and Impact | ...
Employee Training and Development: How to Measure Effectiveness and Impact | ...Employee Training and Development: How to Measure Effectiveness and Impact | ...
Employee Training and Development: How to Measure Effectiveness and Impact | ...BizLibrary
 
PowerPoint Storytelling Sample (Management Trainee Program Review)
PowerPoint Storytelling Sample (Management Trainee Program Review)PowerPoint Storytelling Sample (Management Trainee Program Review)
PowerPoint Storytelling Sample (Management Trainee Program Review)Jocelyn Kaylee Neo
 
Transform Your Learning Results with Data from Measurable Instructional Design
Transform Your Learning Results with Data from Measurable Instructional DesignTransform Your Learning Results with Data from Measurable Instructional Design
Transform Your Learning Results with Data from Measurable Instructional DesignTraining Industry Conference & Expo
 
Scorecards, Learning Metrics and Measurement Strategies
Scorecards, Learning Metrics and Measurement StrategiesScorecards, Learning Metrics and Measurement Strategies
Scorecards, Learning Metrics and Measurement StrategiesHuman Capital Media
 
Improving Diversity through Positive Candidate Experience
Improving Diversity through Positive Candidate ExperienceImproving Diversity through Positive Candidate Experience
Improving Diversity through Positive Candidate ExperienceCielo
 

What's hot (20)

5901816
59018165901816
5901816
 
6 Disciplines of Breakthrough Learning
6 Disciplines of Breakthrough Learning6 Disciplines of Breakthrough Learning
6 Disciplines of Breakthrough Learning
 
Soft skill training need and market potential
Soft skill training need and market potentialSoft skill training need and market potential
Soft skill training need and market potential
 
Management trainee report.ppt
Management trainee report.pptManagement trainee report.ppt
Management trainee report.ppt
 
Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...
 
The Future of Learning & Development
The Future of Learning & DevelopmentThe Future of Learning & Development
The Future of Learning & Development
 
Learning and Development mission, strategy, and goals
Learning and Development mission, strategy, and goalsLearning and Development mission, strategy, and goals
Learning and Development mission, strategy, and goals
 
PVibesCapabilityL&D
PVibesCapabilityL&DPVibesCapabilityL&D
PVibesCapabilityL&D
 
7 Key Elements for Every Top Learning Strategy - Webinar 02.19.14
7 Key Elements for Every Top Learning Strategy - Webinar 02.19.147 Key Elements for Every Top Learning Strategy - Webinar 02.19.14
7 Key Elements for Every Top Learning Strategy - Webinar 02.19.14
 
Questionnaire on training
Questionnaire on trainingQuestionnaire on training
Questionnaire on training
 
Employee Training and Development: How to Measure Effectiveness and Impact | ...
Employee Training and Development: How to Measure Effectiveness and Impact | ...Employee Training and Development: How to Measure Effectiveness and Impact | ...
Employee Training and Development: How to Measure Effectiveness and Impact | ...
 
Change Management
Change ManagementChange Management
Change Management
 
PowerPoint Storytelling Sample (Management Trainee Program Review)
PowerPoint Storytelling Sample (Management Trainee Program Review)PowerPoint Storytelling Sample (Management Trainee Program Review)
PowerPoint Storytelling Sample (Management Trainee Program Review)
 
Transform Your Learning Results with Data from Measurable Instructional Design
Transform Your Learning Results with Data from Measurable Instructional DesignTransform Your Learning Results with Data from Measurable Instructional Design
Transform Your Learning Results with Data from Measurable Instructional Design
 
Scorecards, Learning Metrics and Measurement Strategies
Scorecards, Learning Metrics and Measurement StrategiesScorecards, Learning Metrics and Measurement Strategies
Scorecards, Learning Metrics and Measurement Strategies
 
Org excellence 24 jan ss
Org excellence 24 jan ssOrg excellence 24 jan ss
Org excellence 24 jan ss
 
Healthcare Employee Engagement Solutions
Healthcare Employee Engagement Solutions Healthcare Employee Engagement Solutions
Healthcare Employee Engagement Solutions
 
Gels launch snapshot
Gels launch snapshotGels launch snapshot
Gels launch snapshot
 
How to Engage Employees During Compliance Training
How to Engage Employees During Compliance TrainingHow to Engage Employees During Compliance Training
How to Engage Employees During Compliance Training
 
Improving Diversity through Positive Candidate Experience
Improving Diversity through Positive Candidate ExperienceImproving Diversity through Positive Candidate Experience
Improving Diversity through Positive Candidate Experience
 

Similar to Td2017 presssv2 0

Go Beyond: Going Beyond With Learning Analytics
Go Beyond: Going Beyond With Learning AnalyticsGo Beyond: Going Beyond With Learning Analytics
Go Beyond: Going Beyond With Learning AnalyticsAggregage
 
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15BizLibrary
 
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...BizLibrary
 
Enabling Step Change in your PPM Maturity - Vince Hines | Project Challenge, ...
Enabling Step Change in your PPM Maturity - Vince Hines | Project Challenge, ...Enabling Step Change in your PPM Maturity - Vince Hines | Project Challenge, ...
Enabling Step Change in your PPM Maturity - Vince Hines | Project Challenge, ...Wellingtone
 
5 steps to success - a complete overview on how to apply
5 steps to success - a complete overview on how to apply5 steps to success - a complete overview on how to apply
5 steps to success - a complete overview on how to applyCity & Guilds Group
 
SDiaB training program
SDiaB training program SDiaB training program
SDiaB training program Bill Hooker
 
Programme de recherche du CGIAR sur les animaux d’élevage et les poissons : P...
Programme de recherche du CGIAR sur les animaux d’élevage et les poissons : P...Programme de recherche du CGIAR sur les animaux d’élevage et les poissons : P...
Programme de recherche du CGIAR sur les animaux d’élevage et les poissons : P...ILRI
 
Does your learning solution solve business performance problems?
Does your learning solution solve business performance problems?Does your learning solution solve business performance problems?
Does your learning solution solve business performance problems?Javier Amaro Castillo
 
CallidusCloud Webinar: 5 Steps to Better Sales Performance Management
CallidusCloud Webinar: 5 Steps to Better Sales Performance ManagementCallidusCloud Webinar: 5 Steps to Better Sales Performance Management
CallidusCloud Webinar: 5 Steps to Better Sales Performance ManagementErika Alexander
 
Moving to the Front of the Pack: How to Achieve Digital Transformation with M...
Moving to the Front of the Pack: How to Achieve Digital Transformation with M...Moving to the Front of the Pack: How to Achieve Digital Transformation with M...
Moving to the Front of the Pack: How to Achieve Digital Transformation with M...Apttus
 
Leverage lms synapsyselearnz2015
Leverage lms synapsyselearnz2015Leverage lms synapsyselearnz2015
Leverage lms synapsyselearnz2015Phil Garing
 
OCA Sept 2014: Measuring Organization Development Interventions
OCA Sept 2014: Measuring Organization Development InterventionsOCA Sept 2014: Measuring Organization Development Interventions
OCA Sept 2014: Measuring Organization Development Interventionsmyjobtolearn
 
PM-Champion-PPT-11-10-2020.pdf
PM-Champion-PPT-11-10-2020.pdfPM-Champion-PPT-11-10-2020.pdf
PM-Champion-PPT-11-10-2020.pdfErmiyas Tariku
 
Financial Metrics That Mean to Nonprofits
Financial Metrics That Mean to NonprofitsFinancial Metrics That Mean to Nonprofits
Financial Metrics That Mean to NonprofitsIntacct Corporation
 
Ill final presentationdraft1
Ill final presentationdraft1Ill final presentationdraft1
Ill final presentationdraft1hulins
 
Measuring Learning Impact
Measuring Learning ImpactMeasuring Learning Impact
Measuring Learning ImpactIskandar Noor
 

Similar to Td2017 presssv2 0 (20)

Go Beyond: Going Beyond With Learning Analytics
Go Beyond: Going Beyond With Learning AnalyticsGo Beyond: Going Beyond With Learning Analytics
Go Beyond: Going Beyond With Learning Analytics
 
Implementing portfolio managment tools, Ed Couch, Astra Zeneca
Implementing portfolio managment tools, Ed Couch, Astra ZenecaImplementing portfolio managment tools, Ed Couch, Astra Zeneca
Implementing portfolio managment tools, Ed Couch, Astra Zeneca
 
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
 
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
 
Measuring_HR_ROI-1.pdf
Measuring_HR_ROI-1.pdfMeasuring_HR_ROI-1.pdf
Measuring_HR_ROI-1.pdf
 
Enabling Step Change in your PPM Maturity - Vince Hines | Project Challenge, ...
Enabling Step Change in your PPM Maturity - Vince Hines | Project Challenge, ...Enabling Step Change in your PPM Maturity - Vince Hines | Project Challenge, ...
Enabling Step Change in your PPM Maturity - Vince Hines | Project Challenge, ...
 
5 steps to success - a complete overview on how to apply
5 steps to success - a complete overview on how to apply5 steps to success - a complete overview on how to apply
5 steps to success - a complete overview on how to apply
 
SDiaB training program
SDiaB training program SDiaB training program
SDiaB training program
 
MAGNATAS AUGUST 2015
MAGNATAS AUGUST 2015MAGNATAS AUGUST 2015
MAGNATAS AUGUST 2015
 
Programme de recherche du CGIAR sur les animaux d’élevage et les poissons : P...
Programme de recherche du CGIAR sur les animaux d’élevage et les poissons : P...Programme de recherche du CGIAR sur les animaux d’élevage et les poissons : P...
Programme de recherche du CGIAR sur les animaux d’élevage et les poissons : P...
 
Does your learning solution solve business performance problems?
Does your learning solution solve business performance problems?Does your learning solution solve business performance problems?
Does your learning solution solve business performance problems?
 
CallidusCloud Webinar: 5 Steps to Better Sales Performance Management
CallidusCloud Webinar: 5 Steps to Better Sales Performance ManagementCallidusCloud Webinar: 5 Steps to Better Sales Performance Management
CallidusCloud Webinar: 5 Steps to Better Sales Performance Management
 
Moving to the Front of the Pack: How to Achieve Digital Transformation with M...
Moving to the Front of the Pack: How to Achieve Digital Transformation with M...Moving to the Front of the Pack: How to Achieve Digital Transformation with M...
Moving to the Front of the Pack: How to Achieve Digital Transformation with M...
 
Leverage lms synapsyselearnz2015
Leverage lms synapsyselearnz2015Leverage lms synapsyselearnz2015
Leverage lms synapsyselearnz2015
 
OCA Sept 2014: Measuring Organization Development Interventions
OCA Sept 2014: Measuring Organization Development InterventionsOCA Sept 2014: Measuring Organization Development Interventions
OCA Sept 2014: Measuring Organization Development Interventions
 
Promote_About_Promote
Promote_About_PromotePromote_About_Promote
Promote_About_Promote
 
PM-Champion-PPT-11-10-2020.pdf
PM-Champion-PPT-11-10-2020.pdfPM-Champion-PPT-11-10-2020.pdf
PM-Champion-PPT-11-10-2020.pdf
 
Financial Metrics That Mean to Nonprofits
Financial Metrics That Mean to NonprofitsFinancial Metrics That Mean to Nonprofits
Financial Metrics That Mean to Nonprofits
 
Ill final presentationdraft1
Ill final presentationdraft1Ill final presentationdraft1
Ill final presentationdraft1
 
Measuring Learning Impact
Measuring Learning ImpactMeasuring Learning Impact
Measuring Learning Impact
 

More from Phil Garing

Microsoft All of Government Presentation
Microsoft All of Government PresentationMicrosoft All of Government Presentation
Microsoft All of Government PresentationPhil Garing
 
Biaphr summit july18vfinal
Biaphr summit july18vfinalBiaphr summit july18vfinal
Biaphr summit july18vfinalPhil Garing
 
Deanz2016 presv4 3
Deanz2016 presv4 3Deanz2016 presv4 3
Deanz2016 presv4 3Phil Garing
 
PhilGaringL&D2016Keynote
PhilGaringL&D2016KeynotePhilGaringL&D2016Keynote
PhilGaringL&D2016KeynotePhil Garing
 
Phil Garing Keynote NZATD2016
Phil Garing Keynote NZATD2016Phil Garing Keynote NZATD2016
Phil Garing Keynote NZATD2016Phil Garing
 
Ed techjan15v1 2
Ed techjan15v1 2Ed techjan15v1 2
Ed techjan15v1 2Phil Garing
 
Leveraging your Learning Management System (LMS) for long term success
Leveraging your Learning Management System (LMS) for long term successLeveraging your Learning Management System (LMS) for long term success
Leveraging your Learning Management System (LMS) for long term successPhil Garing
 

More from Phil Garing (7)

Microsoft All of Government Presentation
Microsoft All of Government PresentationMicrosoft All of Government Presentation
Microsoft All of Government Presentation
 
Biaphr summit july18vfinal
Biaphr summit july18vfinalBiaphr summit july18vfinal
Biaphr summit july18vfinal
 
Deanz2016 presv4 3
Deanz2016 presv4 3Deanz2016 presv4 3
Deanz2016 presv4 3
 
PhilGaringL&D2016Keynote
PhilGaringL&D2016KeynotePhilGaringL&D2016Keynote
PhilGaringL&D2016Keynote
 
Phil Garing Keynote NZATD2016
Phil Garing Keynote NZATD2016Phil Garing Keynote NZATD2016
Phil Garing Keynote NZATD2016
 
Ed techjan15v1 2
Ed techjan15v1 2Ed techjan15v1 2
Ed techjan15v1 2
 
Leveraging your Learning Management System (LMS) for long term success
Leveraging your Learning Management System (LMS) for long term successLeveraging your Learning Management System (LMS) for long term success
Leveraging your Learning Management System (LMS) for long term success
 

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxheathfieldcps1
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Jisc
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxJisc
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Pooja Bhuva
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxCeline George
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.MaryamAhmad92
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxAmanpreet Kaur
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfNirmal Dwivedi
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jisc
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...Nguyen Thanh Tu Collection
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.christianmathematics
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - Englishneillewis46
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentationcamerronhm
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17Celine George
 

Recently uploaded (20)

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 

Td2017 presssv2 0

  • 1.
  • 2. Measure Learning Effectiveness Without Breaking the Budget Julie Fitzgerald Z Energy Phil Garing Synapsys N.Z. Ltd
  • 3. Covering • Where is New Zealand and who is Z Energy? • The Evaluator backstory • The Z evaluation, process and survey results • Sheep farmers want evaluation too! • Top tips; getting evaluation right
  • 4.
  • 5.
  • 6.
  • 7.
  • 9. Deloitte Global Human Capital Trends 2016
  • 10. The promise of new tools and technologies Engage on job Build sustainable communities of learning Reduce development cost Increase uptake and application Break the tyranny of distance Break the shackles of the LMS
  • 11. Investment approach We need investment We need a business case We need to justify investment We need evidence of ROI We’re delivering value!
  • 12. Learning & Development 2020 Learning & Development 2010 Application Knowledge OutcomeProcess Kirkpatrick 1 Kirkpatrick 2 Kirkpatrick 3 Kirkpatrick 4 Find the sweet spot: Kirkpatrick Level 3?
  • 13. Right tool for the job? ROI Navigator Project based research Portfolio Observation LRS/xAPI LMS Survey TheEvaluator Kirkpatrick 1 Kirkpatrick 2 Kirkpatrick 3 Kirkpatrick 4
  • 15. Smart surveying • No questions, just aspirational statements • No scale/forced choice – just react to perfection
  • 16. Analysis: polar map, role comparisons
  • 18. The Red Meat Profit Partnership
  • 19. The Red Meat Profit Partnership (RMPP) • A collaboration between the Red Meat Sector and the New Zealand Government. • To drive sustainable productivity improvements in the sheep and beef sector
  • 20. The evaluation questions • How good was delivery? • Were farmers more confident in their stock selection decisions? • Can we use the tool to measure all programmes?
  • 21. The programme • Workshop and applied training in decisionmaking on genetic stock selection • Delivered by Meat Processing companies, supported by RMPP Focus Before Workshop 1 Workshop 2 Farmer confidence Y Y Y Facilitation Y Y Content Y Y
  • 22. Before Immediately after 12 weeks Confidence in stock selection
  • 23. Key outcomes for RMPP • Stronger, clearer relationships with on farm advisors • Better uptake of technology tools • Improvement in delivery of content between workshops • Evaluation framework for rollout across programmes
  • 24. Evaluation: Top tips 1. Be clear about ‘why?’, and who will decide what from the results 2. Target the right measures; people have to trust the results 3. Kirkpatrick Level 3 is ‘bang for buck’ for many organisations wanting evidence of value 4. Data must be useable
  • 25. Your feedback helps ATD continue to provide top-notch educational programs that help you stay on top of a changing profession. Evaluations forms for this session are available via the mobile app and at the following link: http://www.atdconference.org/attendees.

Editor's Notes

  1. .
  2. O
  3. OK, so what shaping L&D thinking in Corp/Govt sectors?