This document discusses methods for gathering feedback after an eLearning training session. It emphasizes using both qualitative and quantitative feedback to evaluate the impact of training. The Kirkpatrick model is presented as a framework to measure reaction, learning, behavior change, and results at four levels. Follow-up methods are suggested, including discussion forums, quizzes, and using social networks to continue the learning process after training. The document provides tips for gathering useful feedback, setting trainee expectations, and reporting progress and results to stakeholders.
Do you know your LMS inside out? If you’re responsible for your learning management system, hopefully the answer is yes!
However, even if you’re an LMS expert, you still need to ensure other users in your organization are properly trained on everything they need to know in order to be effective in their roles — as administrators, course developers, trainers or instructors.
Whether you’re the person in charge of e-learning or training, or you need to showcase its importance, attend this webinar for an in-depth look at how to approach “Training the Trainers” of your LMS environment in order to improve your overall online learning programs, and measure and manage ongoing improvements.
Watch the presentation to learn:
- Measurable outcomes from training
- Training vs. Set-up vs. Support — A breakdown
- How LMS training can increase learner engagement and reduce internal costs
- What LMS training should consist of, and best practices
Presented by Dr. Ashley Castleberry, Director of Assessment and Assistant Professor at the University of Arkansas for Medical Sciences College of Pharmacy.
Peer evaluation and grading can be a powerful teaching method. Learning occurs when student have to assess another student’s work because it forces them to analyze the finer nuances of the assignment in order to grade and provide effective feedback to a peer. This feature can be used to assess as well as teach. This session will explore how ExamSoft Rubrics can be used for peer grading and lessons learned when first implementing this type of assignment.
Previously recorded August 19th, 2015
Learning Management Systems - Online EducationBrian Pichman
Schools and universities around the world are teaching today's future leaders through online classroom environments. They utilize a tool called a Learning Managment System to track student progress and performance throughout the course. In today's shifting landscape, many companies are adopting the same approach to train and ensure their team is up to date with processes and procedures. At the same time, they are developing content to teach their employees skills. Join Brian Pichman
of the Evolve Project as he navigates you through what an LMS is and how it can be applied to train library staff (and even patrons). Learn how you can create a strategy to create a robust learning environment to help your staff to help them learn and grow.
Do you know your LMS inside out? If you’re responsible for your learning management system, hopefully the answer is yes!
However, even if you’re an LMS expert, you still need to ensure other users in your organization are properly trained on everything they need to know in order to be effective in their roles — as administrators, course developers, trainers or instructors.
Whether you’re the person in charge of e-learning or training, or you need to showcase its importance, attend this webinar for an in-depth look at how to approach “Training the Trainers” of your LMS environment in order to improve your overall online learning programs, and measure and manage ongoing improvements.
Watch the presentation to learn:
- Measurable outcomes from training
- Training vs. Set-up vs. Support — A breakdown
- How LMS training can increase learner engagement and reduce internal costs
- What LMS training should consist of, and best practices
Presented by Dr. Ashley Castleberry, Director of Assessment and Assistant Professor at the University of Arkansas for Medical Sciences College of Pharmacy.
Peer evaluation and grading can be a powerful teaching method. Learning occurs when student have to assess another student’s work because it forces them to analyze the finer nuances of the assignment in order to grade and provide effective feedback to a peer. This feature can be used to assess as well as teach. This session will explore how ExamSoft Rubrics can be used for peer grading and lessons learned when first implementing this type of assignment.
Previously recorded August 19th, 2015
Learning Management Systems - Online EducationBrian Pichman
Schools and universities around the world are teaching today's future leaders through online classroom environments. They utilize a tool called a Learning Managment System to track student progress and performance throughout the course. In today's shifting landscape, many companies are adopting the same approach to train and ensure their team is up to date with processes and procedures. At the same time, they are developing content to teach their employees skills. Join Brian Pichman
of the Evolve Project as he navigates you through what an LMS is and how it can be applied to train library staff (and even patrons). Learn how you can create a strategy to create a robust learning environment to help your staff to help them learn and grow.
This presentation helps you to address the key challenges in remote teaching through various teaching platforms & tools for specific purpose, Effective use of technology using SAMR model. Educators can use this content to manage their own professional growth and well-being.
Using Brightspace for Skills Assessment by Gary Abbott of D2L London office.
Presentation at the Brightspace London Connection, May 18. 2017, at the Canada House in Trafalgar Square.
Imagine being able to extend student learning beyond the traditional four
walls of the classroom. Learn how social media tools can be used as social
learning tools. Discover ways to integrate these tools into your teaching
process. Learn how to integrate them to your classroom to engage, excite and
connect with your students. Leverage the creative power of social media to
encourage students to teach other students, to share their knowledge and to
gain input from practitioners in the field. This presentation provides you
with a close examination of several social media tools and describes how they can be
applied to foster student success, learning and engagement.
A description of what is going to happen to the assignment tool in QMplus when we upgrade to Moodle 2.6 in July 2014.
Presentation given at the E-Learning Unit event on June 11th 2014.
Like Google Forms for Assessment, But Graded For Youedulastic
Edulastic is a free online assessment app that integrates easily with Google Apps and Google Classroom, allowing teachers to do formative assessments within Google that are auto-graded and give instant data. Edulastic also has 30+ question types like drag-and-drop, number line and passages.
There's more to learning evaluation than surveys and smile sheets. In this recent webinar, Andrew Downes laid down practical, straightforward advice on how to take your learning evaluation further and measure whether your learning programs are having the impact they were designed to achieve.
Here's the slides!
5R Open Course Design Framework, Fall 2015 versionDavid Wiley
A drastically simplified course design framework for use with faculty as they transition from using commercial textbooks in their courses to using open educational resources (OER).
This presentation helps you to address the key challenges in remote teaching through various teaching platforms & tools for specific purpose, Effective use of technology using SAMR model. Educators can use this content to manage their own professional growth and well-being.
Using Brightspace for Skills Assessment by Gary Abbott of D2L London office.
Presentation at the Brightspace London Connection, May 18. 2017, at the Canada House in Trafalgar Square.
Imagine being able to extend student learning beyond the traditional four
walls of the classroom. Learn how social media tools can be used as social
learning tools. Discover ways to integrate these tools into your teaching
process. Learn how to integrate them to your classroom to engage, excite and
connect with your students. Leverage the creative power of social media to
encourage students to teach other students, to share their knowledge and to
gain input from practitioners in the field. This presentation provides you
with a close examination of several social media tools and describes how they can be
applied to foster student success, learning and engagement.
A description of what is going to happen to the assignment tool in QMplus when we upgrade to Moodle 2.6 in July 2014.
Presentation given at the E-Learning Unit event on June 11th 2014.
Like Google Forms for Assessment, But Graded For Youedulastic
Edulastic is a free online assessment app that integrates easily with Google Apps and Google Classroom, allowing teachers to do formative assessments within Google that are auto-graded and give instant data. Edulastic also has 30+ question types like drag-and-drop, number line and passages.
There's more to learning evaluation than surveys and smile sheets. In this recent webinar, Andrew Downes laid down practical, straightforward advice on how to take your learning evaluation further and measure whether your learning programs are having the impact they were designed to achieve.
Here's the slides!
5R Open Course Design Framework, Fall 2015 versionDavid Wiley
A drastically simplified course design framework for use with faculty as they transition from using commercial textbooks in their courses to using open educational resources (OER).
Measuring the Impact of eLearning: Turning Kirkpatrick’s Four Levels of Evalu...Lambda Solutions
Access to webinar recording here: http://go.lambdasolutions.net/webinar-growing-trend-of-open-source-learning
Whether it’s to inform, to improve, to change—or a combination of these factors, training must have measurable outcomes that contribute to larger organizational goals. Good training evaluation techniques identify and measure the impact of learning on job performance and ultimately, organization-wide business results. When it comes to measuring eLearning, Donald Kirkpatrick’s Four Level of Evaluation model is one of the most widely used and respected worldwide.
Co-hosted by Paula Yunker, with 30+ years of instructional design experience and certification in Kirkpatricks Four Levels Evaluation—this webinar will explore why learning evaluation is an important component of any training program and how you can measure the application of learning beyond the learning event itself. We’ll discuss how to implement learning evaluation that’s practical and provides value but isn’t complicated, time consuming or expensive. Paula will also share her favorite learning evaluation resources after the webinar!
Check out the slides to learn more about:
- Why learning evaluation is critical for business results
- Kirkpatrick’s four levels of evaluation explained
- Aligning learning to organizational goals
- Typical challenges implementing evaluation in an organization
- Practical strategies for implementing learning evaluation
- Our favorite learning evaluation resources
Information Literacy For the Information Literate Rajen Ruth R Pagell
Information Literacy for the Information Literate is part of the UNESCO Train the Trainers program
with Rajen Munoo
Now available as an article:
Information literacy for the information literate: A model and case study from the Wuhan UNESCO training the trainers in information literacy program
The International Information & Library Review, Volume 42, Issue 2, June 2010, Pages 84-90
Ruth A. Pagell, Rajen Munoo
Proactive Feedback Strategies in Online (and Offline) TeachingDavid Lynn Painter
Are you frustrated or overwhelmed when trying to balance punitive comments, or justifications for point deductions, with constructive criticism, or specific revision suggestions, in your evaluations of student assignments? Is listing the reasons points were deducted from student work the sole function of an effective teacher? How can instructors best manage their time to develop assignments and provide constructive criticism that fosters student learning and growth? If you find any of these questions compelling, please join our discussion on the struggle to balance objective and subjective criteria to develop positive, mentoring roles with your students.
As an Assessment Leader in Higher Education, I wanted to share some tips on how Career Services offices can be measuring and developing their learning outcomes. Feel free to contact me with questions! Hope you enjoy. Shari Lindner
An overview of a survey on cataloging/metadata training. How are staff trained? Is it successful? by robin fay, georgiawebgurl@gmail.com & Beth Thornton
GaETC 2004 - LTTS: Online Professional Development for Technology IntegrationMichael Barbour
Barbour, M. K., Bleich, L., & Orrill C. (2004, February). LTTS: Online professional development for technology integration. Paper presented at the annual Georgia Educational Technology Conference, Macon, GA.
The Operations Management team at the University of Hertfordshire has successfully run 40 Business Field Trips as part of its modular programme in the last 5 years. This full day HEA session was designed as a workshop built around appreciative enquiry to share best practice and identify/address issues with the wider HEA Operations Management group.
This presentation is part of a blog post about this event, which can be accessed via http://bit.ly/18m8F7f
For further details of HEA Social Sciences work relating to employability and global citizenship please see http://www.heacademy.ac.uk/resources/detail/disciplines/Soc_Sci/Strategic_2013/EmployabilityAndGlobal
How to Build a Module in Odoo 17 Using the Scaffold MethodCeline George
Odoo provides an option for creating a module by using a single line command. By using this command the user can make a whole structure of a module. It is very easy for a beginner to make a module. There is no need to make each file manually. This slide will show how to create a module using the scaffold method.
A Strategic Approach: GenAI in EducationPeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...Levi Shapiro
Letter from the Congress of the United States regarding Anti-Semitism sent June 3rd to MIT President Sally Kornbluth, MIT Corp Chair, Mark Gorenberg
Dear Dr. Kornbluth and Mr. Gorenberg,
The US House of Representatives is deeply concerned by ongoing and pervasive acts of antisemitic
harassment and intimidation at the Massachusetts Institute of Technology (MIT). Failing to act decisively to ensure a safe learning environment for all students would be a grave dereliction of your responsibilities as President of MIT and Chair of the MIT Corporation.
This Congress will not stand idly by and allow an environment hostile to Jewish students to persist. The House believes that your institution is in violation of Title VI of the Civil Rights Act, and the inability or
unwillingness to rectify this violation through action requires accountability.
Postsecondary education is a unique opportunity for students to learn and have their ideas and beliefs challenged. However, universities receiving hundreds of millions of federal funds annually have denied
students that opportunity and have been hijacked to become venues for the promotion of terrorism, antisemitic harassment and intimidation, unlawful encampments, and in some cases, assaults and riots.
The House of Representatives will not countenance the use of federal funds to indoctrinate students into hateful, antisemitic, anti-American supporters of terrorism. Investigations into campus antisemitism by the Committee on Education and the Workforce and the Committee on Ways and Means have been expanded into a Congress-wide probe across all relevant jurisdictions to address this national crisis. The undersigned Committees will conduct oversight into the use of federal funds at MIT and its learning environment under authorities granted to each Committee.
• The Committee on Education and the Workforce has been investigating your institution since December 7, 2023. The Committee has broad jurisdiction over postsecondary education, including its compliance with Title VI of the Civil Rights Act, campus safety concerns over disruptions to the learning environment, and the awarding of federal student aid under the Higher Education Act.
• The Committee on Oversight and Accountability is investigating the sources of funding and other support flowing to groups espousing pro-Hamas propaganda and engaged in antisemitic harassment and intimidation of students. The Committee on Oversight and Accountability is the principal oversight committee of the US House of Representatives and has broad authority to investigate “any matter” at “any time” under House Rule X.
• The Committee on Ways and Means has been investigating several universities since November 15, 2023, when the Committee held a hearing entitled From Ivory Towers to Dark Corners: Investigating the Nexus Between Antisemitism, Tax-Exempt Universities, and Terror Financing. The Committee followed the hearing with letters to those institutions on January 10, 202
Thinking of getting a dog? Be aware that breeds like Pit Bulls, Rottweilers, and German Shepherds can be loyal and dangerous. Proper training and socialization are crucial to preventing aggressive behaviors. Ensure safety by understanding their needs and always supervising interactions. Stay safe, and enjoy your furry friends!
How to Add Chatter in the odoo 17 ERP ModuleCeline George
In Odoo, the chatter is like a chat tool that helps you work together on records. You can leave notes and track things, making it easier to talk with your team and partners. Inside chatter, all communication history, activity, and changes will be displayed.
Biological screening of herbal drugs: Introduction and Need for
Phyto-Pharmacological Screening, New Strategies for evaluating
Natural Products, In vitro evaluation techniques for Antioxidants, Antimicrobial and Anticancer drugs. In vivo evaluation techniques
for Anti-inflammatory, Antiulcer, Anticancer, Wound healing, Antidiabetic, Hepatoprotective, Cardio protective, Diuretics and
Antifertility, Toxicity studies as per OECD guidelines
This presentation includes basic of PCOS their pathology and treatment and also Ayurveda correlation of PCOS and Ayurvedic line of treatment mentioned in classics.
Delivering Micro-Credentials in Technical and Vocational Education and TrainingAG2 Design
Explore how micro-credentials are transforming Technical and Vocational Education and Training (TVET) with this comprehensive slide deck. Discover what micro-credentials are, their importance in TVET, the advantages they offer, and the insights from industry experts. Additionally, learn about the top software applications available for creating and managing micro-credentials. This presentation also includes valuable resources and a discussion on the future of these specialised certifications.
For more detailed information on delivering micro-credentials in TVET, visit this https://tvettrainer.com/delivering-micro-credentials-in-tvet/
MATATAG CURRICULUM: ASSESSING THE READINESS OF ELEM. PUBLIC SCHOOL TEACHERS I...NelTorrente
In this research, it concludes that while the readiness of teachers in Caloocan City to implement the MATATAG Curriculum is generally positive, targeted efforts in professional development, resource distribution, support networks, and comprehensive preparation can address the existing gaps and ensure successful curriculum implementation.
The simplified electron and muon model, Oscillating Spacetime: The Foundation...RitikBhardwaj56
Discover the Simplified Electron and Muon Model: A New Wave-Based Approach to Understanding Particles delves into a groundbreaking theory that presents electrons and muons as rotating soliton waves within oscillating spacetime. Geared towards students, researchers, and science buffs, this book breaks down complex ideas into simple explanations. It covers topics such as electron waves, temporal dynamics, and the implications of this model on particle physics. With clear illustrations and easy-to-follow explanations, readers will gain a new outlook on the universe's fundamental nature.
Macroeconomics- Movie Location
This will be used as part of your Personal Professional Portfolio once graded.
Objective:
Prepare a presentation or a paper using research, basic comparative analysis, data organization and application of economic information. You will make an informed assessment of an economic climate outside of the United States to accomplish an entertainment industry objective.
A workshop hosted by the South African Journal of Science aimed at postgraduate students and early career researchers with little or no experience in writing and publishing journal articles.
A review of the growth of the Israel Genealogy Research Association Database Collection for the last 12 months. Our collection is now passed the 3 million mark and still growing. See which archives have contributed the most. See the different types of records we have, and which years have had records added. You can also see what we have for the future.
2. www.5leap.com
Agenda
Did the training have an impact?
TIP OF THE ICE BERG
• Qualitative vs Quantitative
• Kirkpatrick model
• Discussion forums
Methodology
• Reporting
• Follow-up
How to use the feedback
Tricks of the trade
2
3. www.5leap.com
Methodology
3
Qualitative deals with subjective feedback, what did they like and what did they not like
Quantitative deals with numerical feedback, giving trends and patterns.
Qualitative vs Quantitative
4. www.5leap.com
Qualitative – Expressed in words
4
“How did it compare to other
Sessions on this program/ on
this subject?”
“What did you specifically
dislike?”
“What did you specifically
like?”
“How will you use what you
learned during this training?”
5. www.5leap.com
Quantitative – Rated in numbers
“How would you rate the format
and structure of the training?”
“How valuable do you think the
concepts and skills will be to
you in your work? “
" What is your overall opinion of
the course that you just took?”
“How would you rate the activities
and exercises in the session?”
5
6. www.5leap.com
Kirkpatrick
Four levels of training evaluation (and sometimes there is a fifth…)
Learning
2nd level
”What did the trainees
actually learn?”
Reaction
1st level
"Did the trainees feel that
the training was worth
their time?”
Behaviour
3rd level
"Did the trainees put any
of their learning to use?”
Results
4th level
”What has changed, over
time?”
ROI
Theoretical?
”Show me the money”
7. www.5leap.com
Kirkpatrick – practical application
7
1st level
0
2nd level
-1
3rd level
3w
4th level
3m
Evaluation is given
immediately after
training is over.
Both Qualitative and
Quantitative
questions
Integral part of the
training
To measure learning,
both a post and a pre-
quiz is needed.
Pre-quiz also helps
prepare the trainee for
what is important
Pre and post quiz
Can be done through
local partners,
personally or
combined with
questionnaires
Observe
Requires the before
data, overview over
other actions taken
and ideally a control
group
Track results
8. www.5leap.com
Ask the question first, then follow up
with the learning
Demanding style
Most LMS tools support modules that
have multiple paths, depending on
what trainee answers in questions
Multipath modules
Use discussion forums, local
champions and email/Yammer groups
to follow up after training
Learning groups
10. www.5leap.com
Dealing with
stakeholders
10
1. What is the problem the stakeholders
want to solve?
1. Expected result/impact
2. Was any new problems discovered
during training?
2. What are the next steps?
1. Individual follow ups
2. Progress reports
3. Building
3. Who took part and how did they score?
4. Increase your own visibility
11. www.5leap.com
Post training follow up
11
It is not up to (only)
you
• Ask trainees to recommend
others that would benefit from
the training
• Challenge trainees to support
and coach others with their new
knowledge/skills, e.g. be “local
champions”
P2P Learning
• Challenge the trainees with
a quiz, award best scores
• Add the previous training to
any rolling knowledge
assessment
Quiz
• Post statistics related to the
training
• Ask for feedback on how
training was applied and
share anecdotes
Communication
12. www.5leap.com
Using social networks as feedback tools
12
On the same level
• Exchange ideas and experiences
• Faster communication
• Identify high potential
• Written communication is often positive for
introverts
TRAINEE GROUPS
Invite managers to take part of the forums
and social groups, increasing engagement
and visibility
Increase visibility
• Write what they learned during training
• How did they apply the new
skills/knowledge
• Did the training lead to expected
outcomes, if so why? Or why not?
Challenge trainees
13. www.5leap.com
PORTFOLIO PROJECTS 04
13
RIGHT RANGE
Asking the trainees to
rate between 1-5 will
lead to a higher avg.
rating than 1-10
WORDS USED
In the feedback, are the
words negatively or
positively charged?
ASK
“What do you want to
learn” is a good start on
managing expectations
SET EXPECTATIONS
Inform trainees in
advance how they will
be measured, this will
lead to better scores
OPEN BOOK
If you use an Open book
style exam, start your
exam with 2-3 questions
referring to specific texts
14. www.5leap.com
1
4
What do the trainees feel had the greatest
impact and how do they rate your training
overall
Use questions during training, to increase
engagement and drive learning (Discovery
learning)
Learning does not end with the trainee
leaving the “classroom.” Set expectations for
continued learning and continueto gather
data after end of training
Report both progress and final results to
stakeholders
MEASURE
PROGRESS
QUALITATIVE AND
QUANTITATIVE
Allows you to ask in-depth questions, discovering how users reacted, what they felt were particularly good. It also gives you good “sound bites” for your reports.
- Gives the voice of the individual trainee
The main benefit over quantitative feedback is that it allows for building a track record of how well a training have been received, across subjects and formats. It makes progress very visible and allows for easy reporting. Gives the voice of the overall trainee population - TIP: Ratings from 1-5 gives better overall scores, than 1-10. Especially in the Nordic countries) - TIP: Report in percentage scores
Kirkpatrick is perhaps the most known and well respected model for training evaluation. The four levels of the training model, is progressively growing in complexity and cost to implement. Most organizations can easily implement level 1 and 2, while level 3 requires investment. The fifth level is not technically first invented by Kirkpatrick, but it is often associated with the model.
Key for all these levels are that they are data driven, and level 2-4 should all be done in terms of Quantitative tracking, e.g. use of standard tracking sheets. Level 3 can also be measured through a trainees ability, to train another. If there is not distinct improvements, training will not have been successful.
Integrating Kirkpatrick with eLearning – 3 tipsAny other suggestions /ideas?
This is in the order of priority when giving feedback to stakeholders, it will help build training status. Training should also have Very few trainers use the data they collect to build their reputation with the managers who sent people on the courses, and as management information to senior managers who have control of the budgetWe achieved 95% Excellent or Good ratings". That is so much more compelling than "We got 67% Good ratings and 28% Excellent Ratings.
Discovery activity, eg “your results are 0% Poor, 4% Fair, 67% Good and 27% Excellent ratings.” How would you sell this to senior management?