0
Session 3 – Evaluation Approach
 
 
<ul><li>Reaction, Satisfaction </li></ul><ul><li>Learning </li></ul><ul><li>Transfer/application </li></ul><ul><li>Busines...
Element Description <ul><li>Reaction </li></ul>Happiness with learning interventions <ul><li>Learning </li></ul>Changes in...
<ul><li>Skills to master: </li></ul><ul><ul><li>Ability to define  a planning framework for each level: </li></ul></ul><ul...
Level Need Program Objective Evaluation Strategy Metric 1 2 3 4 5
Training Need Program Objectives Evaluation Approach Level Business need Impact objectives Business impact Level 4 Job per...
 
Training Need Program Objectives Evaluation Approach Level Business need Impact objectives Business impact Level 4 Job per...
 
Training Need Program Objectives Evaluation Approach Level Business need Impact objectives Business impact Level 4 Job per...
Cognitive Affective Psychomotor Recall Awareness Imitation - copy Understanding Respond Manipulation – follow instructions...
Training Need Program Objectives Evaluation Approach Level Business need Impact objectives Business impact Level 4 Job per...
Disagree  Agree 1 2 3 4 5 6 The content was relevant for what I required The manual followed the lectures logically The pr...
 
 
<ul><li>Wissan Motor Manufacturing Company has been rated as a very top quality, highly productive automobile manufacturer...
<ul><li>The program is designed to improve quality, reduce costs, improve delivery, and improve safety.  Delivery is defin...
 
<ul><li>In response to increased claims of sexual harassment, the Department of Indiscreet Affairs, a large federal agency...
<ul><li>After attending this workshop, participants should be able to : </li></ul><ul><li>Understand, interpret, and enfor...
 
<ul><li>Accra Wholesale Brickworks,  find that there production targets are not being met. The Company is midsize but esta...
 
 
<ul><li>Decision Tree 1: </li></ul>Their systems are manual and procurement/production planning is not possible Can this b...
<ul><li>Decision Tree 1: </li></ul>Foreman don’t know how to conduct proper production planning and monitoring meetings Ca...
<ul><li>Decision Tree 2: </li></ul>The basic business need is to raise improve profits False/True Decide what metric will ...
<ul><li>Decision Tree 2: </li></ul>The basic business need is to raise production False/True Decide what metric will you u...
EXERCISE Level Need Program Objective Evaluation Strategy Metric 1 2 3 4 5
 
Upcoming SlideShare
Loading in...5
×

ROI Evaluation Approach

3,177

Published on

ROI Evaluation Approach

Published in: Business, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,177
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
122
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Transcript of "ROI Evaluation Approach"

  1. 1. Session 3 – Evaluation Approach
  2. 4. <ul><li>Reaction, Satisfaction </li></ul><ul><li>Learning </li></ul><ul><li>Transfer/application </li></ul><ul><li>Business Impact </li></ul><ul><li>Return on Investment </li></ul><ul><li>Intangibles </li></ul>
  3. 5. Element Description <ul><li>Reaction </li></ul>Happiness with learning interventions <ul><li>Learning </li></ul>Changes in knowledge, skills and attitudes <ul><li>Application and implementation </li></ul>Changes in on the job behaviors over time (competence) <ul><li>Business Impact </li></ul>Changes in impact variables <ul><li>ROI </li></ul>Intervention benefits in relation to cost Intangibles Intervention benefits in relation to policy and/or strategic direction and related factors
  4. 6. <ul><li>Skills to master: </li></ul><ul><ul><li>Ability to define a planning framework for each level: </li></ul></ul><ul><ul><ul><li>Reaction </li></ul></ul></ul><ul><ul><ul><li>Learning </li></ul></ul></ul><ul><ul><ul><li>Transfer/application </li></ul></ul></ul><ul><ul><ul><li>Business </li></ul></ul></ul><ul><ul><li>Ability to work from the business level to the reaction level </li></ul></ul>
  5. 7. Level Need Program Objective Evaluation Strategy Metric 1 2 3 4 5
  6. 8. Training Need Program Objectives Evaluation Approach Level Business need Impact objectives Business impact Level 4 Job performance needs Application objectives Transfer and application Level 3 Competence needs (Skills; knowledge; attitudes) Learning objectives Learning and competence testing Level 2 Preferences Satisfaction objectives Reaction Level 1
  7. 10. Training Need Program Objectives Evaluation Approach Level Business need Impact objectives Business impact Level 4 Job performance needs Application objectives Transfer and application Level 3 Competence needs (Skills; knowledge; attitudes) Learning objectives Learning and competence testing Level 2 Preferences Satisfaction objectives Reaction Level 1
  8. 12. Training Need Program Objectives Evaluation Approach Level Business need Impact objectives Business impact Level 4 Job performance needs Application objectives Transfer and application Level 3 Competence needs (Skills; knowledge; attitudes) Learning objectives Learning and competence testing Level 2 Preferences Satisfaction objectives Reaction Level 1
  9. 13. Cognitive Affective Psychomotor Recall Awareness Imitation - copy Understanding Respond Manipulation – follow instructions Application Value (understand and act) Develop precision Analysis Organize personal value system - talk Articulation – combine and relate related skills Synthesize Internalize personal value system - walk Naturalization - automate Evaluate
  10. 14. Training Need Program Objectives Evaluation Approach Level Business need Impact objectives Business impact Level 4 Job performance needs Application objectives Transfer and application Level 3 Competence needs (Skills; knowledge; attitudes) Learning objectives Learning and competence testing Level 2 Preferences Satisfaction objectives Reaction Level 1
  11. 15. Disagree Agree 1 2 3 4 5 6 The content was relevant for what I required The manual followed the lectures logically The presentation material was of a high quality Presentations were interesting and engaging The lecturer know the material The lecturer knows the subject well The lecturer was well prepared The venue was conducive to learning The food was of an acceptable standard
  12. 18. <ul><li>Wissan Motor Manufacturing Company has been rated as a very top quality, highly productive automobile manufacturer. Wissan relates much of its success on four major areas: reliable systems, problem resolution, follow-up, and continuous improvement through learning. </li></ul><ul><li>One of the successful learning programs is on shop-floor supervision where teams and team leaders are taught how to: </li></ul><ul><ul><li>Plan as a team </li></ul></ul><ul><ul><li>Conduct team review meetings </li></ul></ul><ul><ul><li>Have performance discussions </li></ul></ul><ul><ul><li>Implement shop floor disciplinary code </li></ul></ul>
  13. 19. <ul><li>The program is designed to improve quality, reduce costs, improve delivery, and improve safety. Delivery is defined as the percent of daily production schedule met. </li></ul><ul><li>  </li></ul><ul><li>Questions for discussion </li></ul><ul><li>At what level could this program be evaluated? How? </li></ul><ul><li>What are the highest level measures? </li></ul>
  14. 21. <ul><li>In response to increased claims of sexual harassment, the Department of Indiscreet Affairs, a large federal agency, developed a one-day sexual harassment workshop for supervisors and managers. After the workshop, supervisors were expected to meet with their employees and discuss the issues with them. </li></ul>
  15. 22. <ul><li>After attending this workshop, participants should be able to : </li></ul><ul><li>Understand, interpret, and enforce the agency’s sexual harassment policy. </li></ul><ul><li>  Identify comments, actions, and behavior that might constitute sexual harassment. </li></ul><ul><li>  Reduce the number of complaints regarding sexual harassment. </li></ul><ul><li>  Communicate to employees the policy and expected behavior. </li></ul><ul><li>    Questions for discussion: </li></ul><ul><li>  At what levels could you evaluate this program? Please explain. </li></ul><ul><li>How would you evaluate at Levels 2, 3, and 4? </li></ul>
  16. 24. <ul><li>Accra Wholesale Brickworks, find that there production targets are not being met. The Company is midsize but established in the City. It employs a production team consisting of three foreman, that supervise approximately 8 workers each and these teams take responsibility for procurement of the raw materials, mixing, filling the moulds, drying and baking. The production function is managed by a section manager. </li></ul>
  17. 27. <ul><li>Decision Tree 1: </li></ul>Their systems are manual and procurement/production planning is not possible Can this be solved through training? Decide type of training and proceed to Decision Tree 2
  18. 28. <ul><li>Decision Tree 1: </li></ul>Foreman don’t know how to conduct proper production planning and monitoring meetings Can this be solved through training? Decide type of training and proceed to Decision Tree 2
  19. 29. <ul><li>Decision Tree 2: </li></ul>The basic business need is to raise improve profits False/True Decide what metric will you use to show the value of an increase in production
  20. 30. <ul><li>Decision Tree 2: </li></ul>The basic business need is to raise production False/True Decide what metric will you use to show the value of an increase in production
  21. 31. EXERCISE Level Need Program Objective Evaluation Strategy Metric 1 2 3 4 5
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×