Research to show results!




Wendi Tatum MEd. Kentucky Farm Bureau Mutual Insurance Companies
What is your company doing for research in the
training process?

How do you evaluate the impacts of a training
method? Do...
Jay needs training for
some Customer Service
Representatives. He
comes to you for training.
You have an idea about
what wi...
Form
             Hypothesis                     Pre-test




   Test                   Gather Feedback
Hypothesis        ...
Form
                                       Hypothesis




Turn your hypothesis into a question
Pre-test




Find data sources to collect.

Identify your sample (control vs. test
group)
Test
                                           Hypothesis




Method 1 : Pre- and Post- tests with
one group of learners....
Kirkpatrick Review   Evaluate
2. Develop learning
     1. Conduct and             objectives for each
     document a needs           training topic.
  ...
Action Research
Does _______ solve the problem or
validate a theory (educated guess) or
hypothesis?
T-test
The t-test is probably the most commonly
used procedure for hypothesis testing.

Actually, there are several kinds of t-te...
http://web.mst.edu/~psyworld/texample.ht
m
http://ccnmtl.columbia.edu/projects/qmss/t
he_ttest/twosample_ttest.html
http:/...
Problem: Freshman students use of grammar
and writing conventions.
Rationale: 2003-2004 ISTEP+ results below
average in wr...
http://www.graphpad.com/quickcalcs/ttest1.cfm
Isolate one item.
Anticipate and plan for
glitches. They will
happen.
Set targets for your
evaluations .
Track your data.
...
Form
             Hypothesis                     Pre-test




   Test                   Gather Feedback
Hypothesis        ...
Identify the Problem

Think about a problem
related to technology or
training that you are
trying to solve at your
company...
Learning Experience
Evaluation




Empirical Research and
       Training
Did the presentation meet your
expectations?
   1. Yes, it exceeded my
      expectations
   2. No, it didn’t meet my
    ...
Did you learn new information
in this session?



   1.   Yes
   2.   No
I will go back and implement pre-
 and post- tests.
                               100%
1.   Yes
2.   No
3.   I am already...
I will go back and implement a t-
 test with my pre- and post- tests.
1.   Yes
2.   No
3.   I am already doing this
The length of presentation
was..?

   1.   just right
   2.   too long
   3.   too short
The presenter was
knowledgeable, well prepared
and presented material clearly
and effectively?
  1.   Strongly agree
  2. ...
Please feel free to leave any other
comments on the card in front of
you.
Contact:
Emp Research
Emp Research
Emp Research
Emp Research
Emp Research
Upcoming SlideShare
Loading in …5
×

Emp Research

671 views
625 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
671
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Emp Research

  1. 1. Research to show results! Wendi Tatum MEd. Kentucky Farm Bureau Mutual Insurance Companies
  2. 2. What is your company doing for research in the training process? How do you evaluate the impacts of a training method? Do you conduct evaluations for all programs? Who sees that information? What is it used for? How do you know that you have made a positive change in the learners’ behavior or knowledge base?
  3. 3. Jay needs training for some Customer Service Representatives. He comes to you for training. You have an idea about what will help. You want to be certain that this will work…
  4. 4. Form Hypothesis Pre-test Test Gather Feedback Hypothesis and Post-test Evaluate
  5. 5. Form Hypothesis Turn your hypothesis into a question
  6. 6. Pre-test Find data sources to collect. Identify your sample (control vs. test group)
  7. 7. Test Hypothesis Method 1 : Pre- and Post- tests with one group of learners. ▪ Administer pre-test to the group Method 2: Two groups of learners, one control group and one group with the training method ▪ Administer pre-test to control group ▪ Administer pre-test to the test group
  8. 8. Kirkpatrick Review Evaluate
  9. 9. 2. Develop learning 1. Conduct and objectives for each document a needs training topic. assessment. Steps to create an 8. Communicate the 4. Develop evaluation process and effective criteria. incorporate into the management system. evaluation process 5. Set targets for 7. Track the data evaluation types. Some Conduct Cost/ Benefit ROI examples: 100% L1, 80% L2, 25% L3, 5-10% L4
  10. 10. Action Research Does _______ solve the problem or validate a theory (educated guess) or hypothesis? T-test
  11. 11. The t-test is probably the most commonly used procedure for hypothesis testing. Actually, there are several kinds of t-tests, but the most common is the "two-sample t-test“ or “students t-test” or the "independent samples t- test".
  12. 12. http://web.mst.edu/~psyworld/texample.ht m http://ccnmtl.columbia.edu/projects/qmss/t he_ttest/twosample_ttest.html http://www.markettruths.com/process/exa mples/ttest.asp
  13. 13. Problem: Freshman students use of grammar and writing conventions. Rationale: 2003-2004 ISTEP+ results below average in writing. Plan: Integrate rubrics into the ninth grade OLC curriculum. Question: Will rubrics improve students post- test scores and correct poor grammar? Data Collection: Writing Samples, Rubric Assignments, pre- and post- test data (4 week period)
  14. 14. http://www.graphpad.com/quickcalcs/ttest1.cfm
  15. 15. Isolate one item. Anticipate and plan for glitches. They will happen. Set targets for your evaluations . Track your data. Communicate the process and incorporate into the management system.
  16. 16. Form Hypothesis Pre-test Test Gather Feedback Hypothesis and Post-test Evaluate
  17. 17. Identify the Problem Think about a problem related to technology or training that you are trying to solve at your company right now.. List your problem ______________ Empirical Analysis for Training
  18. 18. Learning Experience Evaluation Empirical Research and Training
  19. 19. Did the presentation meet your expectations? 1. Yes, it exceeded my expectations 2. No, it didn’t meet my expectations
  20. 20. Did you learn new information in this session? 1. Yes 2. No
  21. 21. I will go back and implement pre- and post- tests. 100% 1. Yes 2. No 3. I am already doing this 0% 0% s s o i Ye N th g in do dy a re al m Ia
  22. 22. I will go back and implement a t- test with my pre- and post- tests. 1. Yes 2. No 3. I am already doing this
  23. 23. The length of presentation was..? 1. just right 2. too long 3. too short
  24. 24. The presenter was knowledgeable, well prepared and presented material clearly and effectively? 1. Strongly agree 2. Agree 3. Disagree 4. Strongly Disagree
  25. 25. Please feel free to leave any other comments on the card in front of you.
  26. 26. Contact:

×