1. THE FOUR LEVELS OF EVALUATION
LEVEL KEY QUESTION METHODS of
MEASURING
Level 1: REACTION: survey Did the students react Questionnaires
to participate on the course and favorably to the course? Interviews
the trainer + the intent or
potential of applying it
Level 2: KNOWLEDGE / Did the students improve their Pro-tests and post-tests
SKILL: results of exams or any knowledge and skill as a result Observations
work done during (the) training of the course?
Performance problems
Simulations
Level 3: APPLICATION: Are the students able to apply Test or observations on
OTJ or output after training what they learned to improve the job, or under job-like
their job performance? conditions
Survey of Managers
Pre- and Post-Course
Conversations (with
supervisor) RE Adoption
Level 4: BUSINESS Did the results of the course Performance records
RESULTS / IMPACT: the have a favorable impact on Cost analysis
key business objectives which staff performance/business
Overall Business Needs /
were met + how well the staff/ performance?
Objectives Met
company’s performed improved
BONUS
Level 5: RETURN ON Did the training intervention Analyze the Impact (e.g.
INVEMENT (ROI): the contribute/link to the company/ trend-line analysis)
financial return generated business increase in profit? Isolate the Effects of the
compared to the cost of the Training (e.g. control groups)
intervention
Convert Data to Monetary
Values (e.g. using data from
external databases, using his-
torical costs, refer to hard data
targets)
Calculate “Program
Benefits ÷ Program
Costs” …and then “Net
Program Benefits
÷Program Costs”
Created by: Michelle Buckland -1- Date Created: January 15, 2013