SlideShare a Scribd company logo
1 of 15
© 2014 LearnZippy Pvt. Ltd. The information contained here in is subject to change without notice.
Tips For Measuring
Online Training Results
Measuring your online training program is essential to ensure its effectiveness and
relevance. It should be reviewed against strict guidelines that truly judge its ability
to transfer information to the employees.
Here are some tips that can help you measure your online training program and
Measuring Online Training
Overview
According to Strother (2002), online corporate training can be evaluated on
a five-level progressive scale based on Kirkpatrick’s model (1954).
Reaction is a measure of the learners' reactions to the course.Level 1
Learning is a measure of what they learned.Level 2
Transfer is a measure of the changes in working knowledge/skills post the
training program.
Level 3
Results is a measure of the business outcomes due to changes post
training.
Level 4
Level 4 – Results and ROI
Level 3 – Transfer of Information
Level 2 - Measure
4 Levels of Measuring Online Training
Level 1 - Reaction
Levels of
Measuring
Online
Training
Reaction is measuring the learners’ response to the course:
• Include a detailed feedback system such as, employee satisfaction surveys, questionnaires,
• Users can state whether the content could be easily comprehended, its strengths, its
engaging enough, whether all these factors led to learning.
Level 1 - Reaction
A Learning Management System (LMS) provides an in-built feedback
gathering system:
• It should be programmed to ask 10-15 short and succinct questions where
the answers are on a graded scale
• Avoid yes/no answers
• Avoid open-ended questions as evaluating subjective answers on a fixed
scale is complicated
• Subjective feedback should be avoided, especially in the case of a mass
automated system
Use the constructive suggestions on improving the course
Level 2 - Measure
Measuring training can be done via a few methods:
• Analytics/statistics
• Measure the broader statistics of the course as a whole
• Assessments
• Measure individual trainee performance regarding their learning
The combined understanding gained from these two measures can assist
learning managers to improve their existing training course. They can
personalize the learning experience by analyzing the performance of the
trainees and noting areas of difficulty or a lack of interest; this in turn will
boost learner retention rates and ensure effective learning.
Before beginning, you should ascertain what you want to measure, this
should correlate with the learning objectives outlined for the course.
Level 2 – Measure – Analytics/Statistics
• Learning analytics consist of vital pieces of information that,
• They offer a comprehensive understanding of the learners’ training
• They can be collated to evaluate the broader training program
• This information can be utilized to make the course content more user-friendly
• Most LMS’s support the gathering of analytics data based on pre-determined keys
that are ideally defined during the implementation of the LMS and can present
reports on users, courses, chapters, and the overall system.
“are recorded throughout the duration of the eLearning course such as… how quickly they
are progressing through a module, how many times have they have logged in, whether
they have participated in a discussion board, etc.”
(Moffett)
• Great way to gain insight into the actual level of employee information
• Can be intelligently designed and administered between modules or after the entire course
• Assessment scores can be used to highlight whether the trainee is grasping the concepts/skills or if they require
any extra help
• LMS’s support in-built assessment features that can report on employee performance and can further provide
certification for the completed courses
• Important to define the questionnaires based on the objectives and blooms level applicable for the training
program
• Design the questions in such a way that complexities are clearly defined and scoring a 100% and a 60% should
aptly reflect the expertise of the trainee
Level 2 – Measure – Assessments
Level 3 – Transfer of Information
• The best approach is for the managers to observe the trainees and make
note of any difference in job performance prior-to and post training
• Over time, it should be apparent whether the employee retained the
information received during training or not
• In online training, assessment can be achieved using
scenario based tests where the user is made to react to a
certain situation and their reactions can be gauged to
determine the extent of learning internalized
• Specific scenario-based learning and certification are not
designed to check the knowledge directly, but to check for
the implementation of the knowledge
• Good instructional design ensures a well-planned extensive
scenario that assesses for more than one objective and gives
higher confidence to the learner on the concepts taught
Level 4 – Results and ROI
• Measuring the monetary and business outcome is challenging and requires time
• A system should be in place to measure pre-training and post-training data
and watch for any changes that would indicate success in the program
• First identify which results are closely related to the administered
training.
• These can range from increased content recall rates, improved sales
and/or production, faster execution reduction in quality issues,
quicker SLAs, increased customer satisfaction, etc., depending on the
objectives of the training
• With time measure the cost-to-performance ratio, where you will
be able to place cost of training on one side and evaluate it
against the performance results
• This will lead to a calculation of ROI and a true indicator of the
effectiveness of the training
Conclusion
Measuring training is important to ensure that the employees are receiving the best
training possible by narrowing on the programs strengths and weaknesses and
improving on the latter. No matter your method of training your employees,
assessment of the program is vital. Systematic and regular research is required to
ensure that the employees are learning what they are supposed to in order to be
productive in their team and job. Similar to any other investment, check in once in a
while to make sure that they are providing the desired ROI.
http://www.irrodl.org/index.php/irrodl/article/view/83/161
References
STROTHER
http://elearningindustry.com/5-reasons-why-learning-analytics-are-
important-for-elearning
MOFFET
About Us
Skill Gap Analysis that measures the current skills of the employees and rate them against the desired skills for the role to identify
the gap and devise strategy to minimize it.
Training Mix Analysis that helps in deciding the apt training mix for your employees based on the nature of learning content,
learning objectives, and learners' profiles.
Custom Content Development that helps develop custom training courses based on thorough understanding ofbusiness objectives,
training context, and other critical aspects.
Learning Administration that involves deployment of learning via SaaS-based learning management platform and manage
users, catalogues, sessions and roster as well as reporting and certification and
Assessment Services that offers both assessment technology and delivery services to help monitor the training process and
presents insights with actionable analytics. Our suite of Customized Learning Solutions is developed from products stemming from
engagement and designing the right mix.
Our Managed Learning Services looks at five main aspects of Learning Management:
We believe in partnership.
Our continued engagement with our
clients throughout the design of
training solutions helps ensure
requirements are met even as they
evolve.
We design the combination of training
solutions that is just right for our
clients' needs. Our clients, therefore,
enjoy multifold benefits in the form of
effective training and a high ROI.
Our training solutions aim to simplify
learning in terms of simplifying both
the concepts being taught and teaching
strategies being employed.
WE ENGAGE WE DESIGN THE RIGHT MIX WE KEEP IT SIMPLE
Our Services
thank you
© 2014 LearnZippy Pvt. Ltd. All Rights Reserved.
contact us:
LearnZippy
sales@learnzippy.com

More Related Content

Viewers also liked

Tata management training center
Tata management training centerTata management training center
Tata management training centerRushali wankhede
 
PowerPoint Training Slides Used By John Woon Latex Consultants
PowerPoint Training Slides Used By John Woon Latex ConsultantsPowerPoint Training Slides Used By John Woon Latex Consultants
PowerPoint Training Slides Used By John Woon Latex ConsultantsJohn Woon
 
Case study on training and developement
Case study on training and developementCase study on training and developement
Case study on training and developementDiLip ChauDhary
 
Training -developement
Training -developementTraining -developement
Training -developementBabasab Patil
 
Training on outcome based education
Training on outcome based educationTraining on outcome based education
Training on outcome based educationobepsp
 
Case study training(2)
Case study   training(2)Case study   training(2)
Case study training(2)Tanuj Poddar
 
My presentation future of training-final.ppt
My presentation future of training-final.pptMy presentation future of training-final.ppt
My presentation future of training-final.pptninakude123
 
training and development at infosys
training and development at infosystraining and development at infosys
training and development at infosysSwati Luthra
 
9. Evaluation of Training Effectiveness
9. Evaluation of Training Effectiveness9. Evaluation of Training Effectiveness
9. Evaluation of Training EffectivenessISEAL Alliance
 
INTERIOR DESIGN PRACTICE and OFFICE MANAGEMENT– II (Show 2.1 to 2.4)
INTERIOR DESIGN PRACTICE and OFFICE MANAGEMENT– II (Show 2.1 to 2.4)INTERIOR DESIGN PRACTICE and OFFICE MANAGEMENT– II (Show 2.1 to 2.4)
INTERIOR DESIGN PRACTICE and OFFICE MANAGEMENT– II (Show 2.1 to 2.4)Gautam Shah
 
Training evaluation ppt 6
Training evaluation   ppt 6Training evaluation   ppt 6
Training evaluation ppt 6SBMC Jobs
 
Case study of nestle training and development
Case study of nestle training and developmentCase study of nestle training and development
Case study of nestle training and developmentSachin Kharecha
 
Evaluation of training
Evaluation of trainingEvaluation of training
Evaluation of trainingSelf-employed
 
How To Facilitate Great Meetings - Results Washington Training - Day 1
How To Facilitate Great Meetings - Results Washington Training - Day 1How To Facilitate Great Meetings - Results Washington Training - Day 1
How To Facilitate Great Meetings - Results Washington Training - Day 1Zachary Cohn
 
LIHEAP Program Integrity Challenges and Solutions
LIHEAP Program Integrity Challenges and SolutionsLIHEAP Program Integrity Challenges and Solutions
LIHEAP Program Integrity Challenges and Solutionsakmrahman
 

Viewers also liked (19)

Tata management training center
Tata management training centerTata management training center
Tata management training center
 
PowerPoint Training Slides Used By John Woon Latex Consultants
PowerPoint Training Slides Used By John Woon Latex ConsultantsPowerPoint Training Slides Used By John Woon Latex Consultants
PowerPoint Training Slides Used By John Woon Latex Consultants
 
Case study on training and developement
Case study on training and developementCase study on training and developement
Case study on training and developement
 
Training -developement
Training -developementTraining -developement
Training -developement
 
Training on outcome based education
Training on outcome based educationTraining on outcome based education
Training on outcome based education
 
Case study training(2)
Case study   training(2)Case study   training(2)
Case study training(2)
 
My presentation future of training-final.ppt
My presentation future of training-final.pptMy presentation future of training-final.ppt
My presentation future of training-final.ppt
 
TRAINING PROCESS
TRAINING PROCESSTRAINING PROCESS
TRAINING PROCESS
 
Infosys training design
Infosys training design Infosys training design
Infosys training design
 
training and development at infosys
training and development at infosystraining and development at infosys
training and development at infosys
 
9. Evaluation of Training Effectiveness
9. Evaluation of Training Effectiveness9. Evaluation of Training Effectiveness
9. Evaluation of Training Effectiveness
 
Measuring Training Effectiveness
Measuring Training EffectivenessMeasuring Training Effectiveness
Measuring Training Effectiveness
 
INTERIOR DESIGN PRACTICE and OFFICE MANAGEMENT– II (Show 2.1 to 2.4)
INTERIOR DESIGN PRACTICE and OFFICE MANAGEMENT– II (Show 2.1 to 2.4)INTERIOR DESIGN PRACTICE and OFFICE MANAGEMENT– II (Show 2.1 to 2.4)
INTERIOR DESIGN PRACTICE and OFFICE MANAGEMENT– II (Show 2.1 to 2.4)
 
Training evaluation ppt 6
Training evaluation   ppt 6Training evaluation   ppt 6
Training evaluation ppt 6
 
Case study of nestle training and development
Case study of nestle training and developmentCase study of nestle training and development
Case study of nestle training and development
 
Evaluation of training
Evaluation of trainingEvaluation of training
Evaluation of training
 
How To Facilitate Great Meetings - Results Washington Training - Day 1
How To Facilitate Great Meetings - Results Washington Training - Day 1How To Facilitate Great Meetings - Results Washington Training - Day 1
How To Facilitate Great Meetings - Results Washington Training - Day 1
 
LIHEAP Program Integrity Challenges and Solutions
LIHEAP Program Integrity Challenges and SolutionsLIHEAP Program Integrity Challenges and Solutions
LIHEAP Program Integrity Challenges and Solutions
 
Training & development evaluation
Training & development evaluationTraining & development evaluation
Training & development evaluation
 

Tips for Measuring Online Training Results

  • 1. © 2014 LearnZippy Pvt. Ltd. The information contained here in is subject to change without notice. Tips For Measuring Online Training Results
  • 2. Measuring your online training program is essential to ensure its effectiveness and relevance. It should be reviewed against strict guidelines that truly judge its ability to transfer information to the employees. Here are some tips that can help you measure your online training program and Measuring Online Training
  • 3. Overview According to Strother (2002), online corporate training can be evaluated on a five-level progressive scale based on Kirkpatrick’s model (1954). Reaction is a measure of the learners' reactions to the course.Level 1 Learning is a measure of what they learned.Level 2 Transfer is a measure of the changes in working knowledge/skills post the training program. Level 3 Results is a measure of the business outcomes due to changes post training. Level 4
  • 4. Level 4 – Results and ROI Level 3 – Transfer of Information Level 2 - Measure 4 Levels of Measuring Online Training Level 1 - Reaction Levels of Measuring Online Training
  • 5. Reaction is measuring the learners’ response to the course: • Include a detailed feedback system such as, employee satisfaction surveys, questionnaires, • Users can state whether the content could be easily comprehended, its strengths, its engaging enough, whether all these factors led to learning. Level 1 - Reaction A Learning Management System (LMS) provides an in-built feedback gathering system: • It should be programmed to ask 10-15 short and succinct questions where the answers are on a graded scale • Avoid yes/no answers • Avoid open-ended questions as evaluating subjective answers on a fixed scale is complicated • Subjective feedback should be avoided, especially in the case of a mass automated system Use the constructive suggestions on improving the course
  • 6. Level 2 - Measure Measuring training can be done via a few methods: • Analytics/statistics • Measure the broader statistics of the course as a whole • Assessments • Measure individual trainee performance regarding their learning The combined understanding gained from these two measures can assist learning managers to improve their existing training course. They can personalize the learning experience by analyzing the performance of the trainees and noting areas of difficulty or a lack of interest; this in turn will boost learner retention rates and ensure effective learning. Before beginning, you should ascertain what you want to measure, this should correlate with the learning objectives outlined for the course.
  • 7. Level 2 – Measure – Analytics/Statistics • Learning analytics consist of vital pieces of information that, • They offer a comprehensive understanding of the learners’ training • They can be collated to evaluate the broader training program • This information can be utilized to make the course content more user-friendly • Most LMS’s support the gathering of analytics data based on pre-determined keys that are ideally defined during the implementation of the LMS and can present reports on users, courses, chapters, and the overall system. “are recorded throughout the duration of the eLearning course such as… how quickly they are progressing through a module, how many times have they have logged in, whether they have participated in a discussion board, etc.” (Moffett)
  • 8. • Great way to gain insight into the actual level of employee information • Can be intelligently designed and administered between modules or after the entire course • Assessment scores can be used to highlight whether the trainee is grasping the concepts/skills or if they require any extra help • LMS’s support in-built assessment features that can report on employee performance and can further provide certification for the completed courses • Important to define the questionnaires based on the objectives and blooms level applicable for the training program • Design the questions in such a way that complexities are clearly defined and scoring a 100% and a 60% should aptly reflect the expertise of the trainee Level 2 – Measure – Assessments
  • 9. Level 3 – Transfer of Information • The best approach is for the managers to observe the trainees and make note of any difference in job performance prior-to and post training • Over time, it should be apparent whether the employee retained the information received during training or not • In online training, assessment can be achieved using scenario based tests where the user is made to react to a certain situation and their reactions can be gauged to determine the extent of learning internalized • Specific scenario-based learning and certification are not designed to check the knowledge directly, but to check for the implementation of the knowledge • Good instructional design ensures a well-planned extensive scenario that assesses for more than one objective and gives higher confidence to the learner on the concepts taught
  • 10. Level 4 – Results and ROI • Measuring the monetary and business outcome is challenging and requires time • A system should be in place to measure pre-training and post-training data and watch for any changes that would indicate success in the program • First identify which results are closely related to the administered training. • These can range from increased content recall rates, improved sales and/or production, faster execution reduction in quality issues, quicker SLAs, increased customer satisfaction, etc., depending on the objectives of the training • With time measure the cost-to-performance ratio, where you will be able to place cost of training on one side and evaluate it against the performance results • This will lead to a calculation of ROI and a true indicator of the effectiveness of the training
  • 11. Conclusion Measuring training is important to ensure that the employees are receiving the best training possible by narrowing on the programs strengths and weaknesses and improving on the latter. No matter your method of training your employees, assessment of the program is vital. Systematic and regular research is required to ensure that the employees are learning what they are supposed to in order to be productive in their team and job. Similar to any other investment, check in once in a while to make sure that they are providing the desired ROI.
  • 14. Skill Gap Analysis that measures the current skills of the employees and rate them against the desired skills for the role to identify the gap and devise strategy to minimize it. Training Mix Analysis that helps in deciding the apt training mix for your employees based on the nature of learning content, learning objectives, and learners' profiles. Custom Content Development that helps develop custom training courses based on thorough understanding ofbusiness objectives, training context, and other critical aspects. Learning Administration that involves deployment of learning via SaaS-based learning management platform and manage users, catalogues, sessions and roster as well as reporting and certification and Assessment Services that offers both assessment technology and delivery services to help monitor the training process and presents insights with actionable analytics. Our suite of Customized Learning Solutions is developed from products stemming from engagement and designing the right mix. Our Managed Learning Services looks at five main aspects of Learning Management: We believe in partnership. Our continued engagement with our clients throughout the design of training solutions helps ensure requirements are met even as they evolve. We design the combination of training solutions that is just right for our clients' needs. Our clients, therefore, enjoy multifold benefits in the form of effective training and a high ROI. Our training solutions aim to simplify learning in terms of simplifying both the concepts being taught and teaching strategies being employed. WE ENGAGE WE DESIGN THE RIGHT MIX WE KEEP IT SIMPLE Our Services
  • 15. thank you © 2014 LearnZippy Pvt. Ltd. All Rights Reserved. contact us: LearnZippy sales@learnzippy.com