2. Project No: 2017-1-IE01-KA202-025711
This project has been funded with support from the European Commission.
This publication reflects the views only of the author, and the Commission
cannot be held responsible for any use which may be made of the
information contained therein.
2
3. What’s in this Module
Module 3 : Assessment
• Evaluate your learners as part of a distance education
3
4. Aim : Evaluate the acquisition of learners' skills in the context of digital
training
Objectives: By the end of this session you will be able to:
Aim & Objectives
• Evaluate the acquisition of learners' skills in the context of digital
training
5. Evaluation in digital learning session
The possibilities of evaluating the acquisition of skills are multiple in a digital universe.
The LMS tool used to disseminate the different training modules will allow to follow
the evolution of the learners through:
• The establishment of regular evaluation questionnaires to check the good
acquisition of skills
• Soliciting learners on a specific point through the forum
• Construction and implementation of a self-positioning questionnaire (administer
the same evaluation questionnaire before and after the training follow-up to
measure the skills gap)
In short, there are many possibilities for you to adapt your evaluation methods
according to your audience and the criteria you want to evaluate.
6. What are the evaluation criteria in digital learning?
When we talk about evaluation of training, we can not omit to refer
to the Kirkpatrick repository that organizes the assessment in four
levels:
• level 1, the reaction: was the training enjoyable? Are you
satisfied?
• level 2, learning: what is the knowledge acquired?
• level 3, behaviors: are the skills acquired applied in real
situations?
• level 4, the results: what are the concrete and operational
results of the training?
7. Evaluate training satisfaction
• This involves administering a standard satisfaction
questionnaire (which you will build from the LMS platform), at
the end of training
• Specifically, level 1 is mostly measured at more than 90% and
generally indicates a good level of satisfaction.
8. Evaluate acquired skills
• Level 2 is usually measured by trainer observation in the case of
classroom training. But it is rarely formalized or exploited. In
distance education, it is the traditional end-of-module quiz that
measures the skills acquired.
9. Evaluate the application of skills in situation
• Level 3 seeks to answer the question of the application of new
skills acquired in real-life situations.This level is more difficult to
measure because it is outside the scope of training. It requires
the implementation of individual measurement tools integrated
into the professional context.
• The training is aimed at a population "lack of time" because of
their activity of farmers, this level will not necessarily be
applicable on the project LeadFarm
10. Evaluate the impact of digital learning thanks to ROI and ROE
As for level 4, which allows to know the impact of training on organizations and
structures, 2 ways are possible:
• the first, measuring the effectiveness of training in a numerical way: this is called
ROI for Return on Investment. Here we will ask the question:What is the gain in
terms of the cost of training?
• the second, measuring the achievement of operational objectives: the ROE for
Return on Expectations.We will focus here on the questions: Do sales increase?
Does customer satisfaction increase? Does the incident rate decrease? etc.
This requires keeping in touch with your learners after the training, the goal being to
be able to interview them 6 to 12 months after the training
11. How to evaluate a training in digital learning?
• Evaluation is not just a measure at a specific moment, but a complete process in
several stages.
• The key to a successful evaluation is to start at the end.That is, to precisely define
the expected ends of the training. And to properly frame the process, it is crucial to
measure the initial levels before training, in order to measure progress.
• Who is best placed to evaluate?The learner is both an evaluator and an evaluator,
but he is not the only actor. His manager, colleagues, trainer or tutor, clients can
also be involved in the evaluation.
12. Other criteria to be included in the assessment
• Completion rate: number of people in the entire group of learners completing the
training
• Time spent learning by learners: generally time spent learning is correlated with
the outcome of the assessment
• Scores obtained: results to the different questions and exercises addressed to the
learners by the trainer
• Connection rate: For online training through an LMS platform, it is possible to
collect the connection rate of employees to the training platform.
• All this information is available on the LMS platform
