Download to read offline
Uploaded byPhil Garing
Td2017 presssv2 0
This document summarizes an evaluation of learning effectiveness conducted by Z Energy and Synapsys N.Z. Ltd. It describes the background and process used, including surveying participants before and after workshops using "smart surveying" without scales. The results showed increased farmer confidence in stock selection and improved delivery between workshops. It also discusses applying this approach to evaluate other programs by the Red Meat Profit Partnership on genetic stock selection. The document concludes with tips for effective evaluation, such as clarifying objectives, targeting the right measures, and ensuring useful data.
More Related Content
Similar to Td2017 presssv2 0
Td2017 presssv2 0
- 2. Measure Learning Effectiveness WithoutBreaking the Budget Julie Fitzgerald Z Energy Phil Garing Synapsys N.Z. Ltd
- 3. Covering • Where isNew Zealand and who is Z Energy? • The Evaluator backstory • The Z evaluation, process and survey results • Sheep farmers want evaluation too! • Top tips; getting evaluation right
- 8.
- 9. Deloitte Global HumanCapital Trends 2016
- 10. The promise ofnew tools and technologies Engage on job Build sustainable communities of learning Reduce development cost Increase uptake and application Break the tyranny of distance Break the shackles of the LMS
- 11. Investment approach We need investment Weneed a business case We need to justify investment We need evidence of ROI We’re delivering value!
- 12. Learning & Development 2020 Learning & Development 2010 Application Knowledge OutcomeProcess Kirkpatrick1 Kirkpatrick 2 Kirkpatrick 3 Kirkpatrick 4 Find the sweet spot: Kirkpatrick Level 3?
- 13. Right tool forthe job? ROI Navigator Project based research Portfolio Observation LRS/xAPI LMS Survey TheEvaluator Kirkpatrick 1 Kirkpatrick 2 Kirkpatrick 3 Kirkpatrick 4
- 14. Continuous improvement Demonstrate changed behaviour on job The Evaluator Smartsurveying Proven rubrics Rich analytics
- 15. Smart surveying • Noquestions, just aspirational statements • No scale/forced choice – just react to perfection
- 16. Analysis: polar map,role comparisons
- 17.
- 18. The Red MeatProfit Partnership
- 19. The Red MeatProfit Partnership (RMPP) • A collaboration between the Red Meat Sector and the New Zealand Government. • To drive sustainable productivity improvements in the sheep and beef sector
- 20. The evaluation questions •How good was delivery? • Were farmers more confident in their stock selection decisions? • Can we use the tool to measure all programmes?
- 21. The programme • Workshopand applied training in decisionmaking on genetic stock selection • Delivered by Meat Processing companies, supported by RMPP Focus Before Workshop 1 Workshop 2 Farmer confidence Y Y Y Facilitation Y Y Content Y Y
- 22. Before Immediately after12 weeks Confidence in stock selection
- 23. Key outcomes forRMPP • Stronger, clearer relationships with on farm advisors • Better uptake of technology tools • Improvement in delivery of content between workshops • Evaluation framework for rollout across programmes
- 24. Evaluation: Top tips 1.Be clear about ‘why?’, and who will decide what from the results 2. Target the right measures; people have to trust the results 3. Kirkpatrick Level 3 is ‘bang for buck’ for many organisations wanting evidence of value 4. Data must be useable
- 25. Your feedback helpsATD continue to provide top-notch educational programs that help you stay on top of a changing profession. Evaluations forms for this session are available via the mobile app and at the following link: http://www.atdconference.org/attendees.