Eliminating Misinformation and Doubt in Learning And Creating the Process of Discovery To Achieve Mastery Tim Adams  Chief...
Training Disconnect <ul><li>People are being trained </li></ul><ul><li>but their performance doesn’t </li></ul><ul><li>alw...
Disconnect  Food Manufacturer <ul><ul><li>Implementing all the best practices and training </li></ul></ul><ul><ul><li>Brin...
Disconnect  Healthcare Organizations <ul><li>Number of preventable deaths 2003-2005 – 247,662 1 </li></ul><ul><li>1% of pa...
Why the disconnect? <ul><li>Activity #1 </li></ul>
The Impact of Guessing <ul><li>People given credit for knowledge they don’t have </li></ul><ul><li>People given job respon...
<ul><li>“ Invisible errors ” in the workplace </li></ul><ul><li>resulting from guessing correctly on true/false </li></ul>...
Why the disconnect? <ul><li>Activity #2 </li></ul>
Format Makes a Difference <ul><li>Certain types of questions are prone to guesswork </li></ul><ul><ul><li>T/F, Yes/No – 50...
Why the disconnect? <ul><li>Activity #3 </li></ul>
The Value of a Second Dimension <ul><li>More accurate predictor of behavior </li></ul><ul><li>Focuses on knowledge quality...
The Problem: Learning Effectiveness A score only tells you how many questions  someone answered correctly.  75% 100% 0%
The Problem: Learning Outcomes 100% 0% A score can’t detect guessing or doubt. This may be what they really know. 55% 75%
“ The 55/15 Rule ” <ul><li>The average level of confidence and correctness for employees across all industries is  55% </l...
Knowledge Profile   A Better Indicator of Potential Performance Knowledge Learning Behavior Model tm Confidence Action No ...
What companies need is… <ul><li>MASTERY </li></ul><ul><li>Confidently-held, correct knowledge  </li></ul><ul><li>put into ...
<ul><li>Demonstration </li></ul>
Case Study Results Healthcare Organization Adverse outcomes Minimized with CBL   Positive outcomes Maximized with CBL   Mi...
Seminar Results on   Fair Labor Standards Act  Example of risk of  not  knowing Question :  A worker in a science laborato...
Tracking the Path to Mastery …  to eliminate potential errors resulting  from misinformation CBL identifies knowledge  qua...
Reporting Analytics GROUP PERFORMANCE Item analysis by  question   allows an organization… … to identify liabilities  befo...
Confidence-Based Measurement   <ul><li>Surgically isolates misinformation </li></ul>
Confidence-Based Learning Design <ul><li>Metadata –  </li></ul><ul><ul><li>Module </li></ul></ul><ul><ul><li>Topic </li></...
<ul><li>Evaluation tools </li></ul><ul><li>Test items, assessments, certifications </li></ul><ul><li>questions, correct an...
<ul><li>Supporting content </li></ul><ul><li>Case studies </li></ul><ul><li>Further info – websites, PDFs, video, flash, e...
Mapping Existing Training Supporting Docs Testing Training Content Learning Objective Supporting Docs Test Databank Traini...
Importance of confidence in measuring knowledge <ul><li>It is a predictor of behavior </li></ul><ul><li>Provides cognitive...
ADVANTAGES <ul><li>Confidence Based Learning is the next Learning imperative that: </li></ul><ul><li>Proves acquisition of...
SUMMARY   <ul><li>Moves focus of Learning from a score to achieving  MASTERY ! </li></ul><ul><li>Learning and assessment a...
<ul><li>Questions </li></ul><ul><li>& </li></ul><ul><li>Discussion </li></ul>
THANK YOU! Tim Adams, CLO [email_address] Brian Webster, Vice President [email_address] www.Knowledge Factor.com 720-214-4...
Upcoming SlideShare
Loading in …5
×

Kfi Innovation In Learning Presentation Sept 2007

828 views

Published on

Published in: Business, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
828
On SlideShare
0
From Embeds
0
Number of Embeds
33
Actions
Shares
0
Downloads
29
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Kfi Innovation In Learning Presentation Sept 2007

    1. 1. Eliminating Misinformation and Doubt in Learning And Creating the Process of Discovery To Achieve Mastery Tim Adams Chief Learning Officer & Co-Founder Brian Webster VP Client Solutions
    2. 2. Training Disconnect <ul><li>People are being trained </li></ul><ul><li>but their performance doesn’t </li></ul><ul><li>always reflect it. </li></ul>
    3. 3. Disconnect Food Manufacturer <ul><ul><li>Implementing all the best practices and training </li></ul></ul><ul><ul><li>Bringing uniform metrics to a $1B+ operation built through acquisitions </li></ul></ul><ul><ul><li>Elated with business performance improvements - 70% efficiency! </li></ul></ul><ul><ul><li>The cost of 30% inefficiency - $150M </li></ul></ul>
    4. 4. Disconnect Healthcare Organizations <ul><li>Number of preventable deaths 2003-2005 – 247,662 1 </li></ul><ul><li>1% of patients are injured in the hospital and 25% of these injuries result in death 2 </li></ul><ul><li>Medication errors harm 1.5M people each year 3 </li></ul><ul><li>Malpractice payments in 2004: $4.2B 4 </li></ul><ul><li>Preventable medication errors cost hospitals $3.5B per year 5 </li></ul>1 HealthGrades, 2007; 2 Harvard medical study, 2006; 3 Nat’l Academy of Science, 2006; 4 Public Citizen, 2005; 5 Institute of Medicine, 2006
    5. 5. Why the disconnect? <ul><li>Activity #1 </li></ul>
    6. 6. The Impact of Guessing <ul><li>People given credit for knowledge they don’t have </li></ul><ul><li>People given job responsibilities they are not prepared to handle </li></ul><ul><li>Management has false sense of security </li></ul><ul><li>Hidden liabilities in organization </li></ul><ul><li>Management doesn’t know that on-the-job mistakes are a product of the training regimen </li></ul>
    7. 7. <ul><li>“ Invisible errors ” in the workplace </li></ul><ul><li>resulting from guessing correctly on true/false </li></ul><ul><li>and multiple choice tests are </li></ul><ul><li>“ common and potentially damaging .” </li></ul><ul><li>Human Resource Guide </li></ul><ul><li>Department of Labor study </li></ul>
    8. 8. Why the disconnect? <ul><li>Activity #2 </li></ul>
    9. 9. Format Makes a Difference <ul><li>Certain types of questions are prone to guesswork </li></ul><ul><ul><li>T/F, Yes/No – 50/50 chance of getting right, but not a measure of knowledge </li></ul></ul><ul><li>Content is not always aligned with outcomes </li></ul><ul><li>Content and assessment are not always aligned with each other </li></ul>
    10. 10. Why the disconnect? <ul><li>Activity #3 </li></ul>
    11. 11. The Value of a Second Dimension <ul><li>More accurate predictor of behavior </li></ul><ul><li>Focuses on knowledge quality </li></ul><ul><li>Isolates knowledge states that can lead to mistakes </li></ul><ul><li>Provides moments of discovery </li></ul><ul><li>Installs a new set of rules – focusing on knowledge outcomes and not test scores! </li></ul><ul><li>Confidence is the missing element in the learning process </li></ul>
    12. 12. The Problem: Learning Effectiveness A score only tells you how many questions someone answered correctly. 75% 100% 0%
    13. 13. The Problem: Learning Outcomes 100% 0% A score can’t detect guessing or doubt. This may be what they really know. 55% 75%
    14. 14. “ The 55/15 Rule ” <ul><li>The average level of confidence and correctness for employees across all industries is 55% </li></ul><ul><li>15% of the knowledge employees have is actually confidently-held misinformation </li></ul>
    15. 15. Knowledge Profile A Better Indicator of Potential Performance Knowledge Learning Behavior Model tm Confidence Action No Action
    16. 16. What companies need is… <ul><li>MASTERY </li></ul><ul><li>Confidently-held, correct knowledge </li></ul><ul><li>put into practice </li></ul><ul><li>How do you get there? </li></ul>
    17. 17. <ul><li>Demonstration </li></ul>
    18. 18. Case Study Results Healthcare Organization Adverse outcomes Minimized with CBL Positive outcomes Maximized with CBL Misinformation extraordinarily high among seasoned employees
    19. 19. Seminar Results on Fair Labor Standards Act Example of risk of not knowing Question : A worker in a science laboratory supervises and manages a department with 10 other full-time employees. She makes all the decisions about whether to hire, to fire or to promote employees within her department, but she is not senior enough to make big decisions about the direction of the company. What must the company consider when determining if the employees is an exempt executive? 100 attendees in a conference 65% were misinformed Fine for not following this statute: $10,000 Potential fines among attendees: $650,000
    20. 20. Tracking the Path to Mastery … to eliminate potential errors resulting from misinformation CBL identifies knowledge quality of individuals …
    21. 21. Reporting Analytics GROUP PERFORMANCE Item analysis by question allows an organization… … to identify liabilities before they impact business objectives.
    22. 22. Confidence-Based Measurement <ul><li>Surgically isolates misinformation </li></ul>
    23. 23. Confidence-Based Learning Design <ul><li>Metadata – </li></ul><ul><ul><li>Module </li></ul></ul><ul><ul><li>Topic </li></ul></ul><ul><ul><li>Rich media </li></ul></ul><ul><li>Question </li></ul><ul><li>Answers </li></ul><ul><ul><li>Correct answer </li></ul></ul><ul><ul><li>Incorrect answer 1 </li></ul></ul><ul><ul><li>Incorrect answer 2 </li></ul></ul><ul><li>Explanation </li></ul><ul><li>Further training links </li></ul>Intro Text: Link Text: Link URL: <Further Training Links> <Explanation> <Incorrect Answer 2> <Incorrect Answer 1> <Correct Answer> <Question Text> <Rich Media File> <Question Number> <Topic> <Module>up
    24. 24. <ul><li>Evaluation tools </li></ul><ul><li>Test items, assessments, certifications </li></ul><ul><li>questions, correct answers, incorrect answers </li></ul>Learning Objective Training Content Test Databank Mapping Existing Training Start with…
    25. 25. <ul><li>Supporting content </li></ul><ul><li>Case studies </li></ul><ul><li>Further info – websites, PDFs, video, flash, etc. </li></ul>Learning Objective Training Content Test Databank Supporting Docs Mapping Existing Training Start with…
    26. 26. Mapping Existing Training Supporting Docs Testing Training Content Learning Objective Supporting Docs Test Databank Training Content Learning Objective Training Content Convert to CBL… Intro Text: Link Text: Link URL: <Further Training Links> <Explanation> <Incorrect Answer 2> <Incorrect Answer 1> <Correct Answer> <Question Text> <Rich Media File> <Question Number> <Topic> <Module>
    27. 27. Importance of confidence in measuring knowledge <ul><li>It is a predictor of behavior </li></ul><ul><li>Provides cognitive moments of discovery </li></ul><ul><li>Provides accurate picture of knowledge quality </li></ul><ul><li>Provides the ability to correct errors before </li></ul><ul><li>Aligns learning with business outcomes </li></ul>
    28. 28. ADVANTAGES <ul><li>Confidence Based Learning is the next Learning imperative that: </li></ul><ul><li>Proves acquisition of essential knowledge through an informal learning process </li></ul><ul><li>Increases retention of essential knowledge </li></ul><ul><li>Improves the quality of the learning experience and engages the learner to achieve mastery </li></ul><ul><li>Enables training to focus on knowledge application and skills development </li></ul><ul><li>Moves focus of Learning from a score to achieving MASTERY ! </li></ul>
    29. 29. SUMMARY <ul><li>Moves focus of Learning from a score to achieving MASTERY ! </li></ul><ul><li>Learning and assessment are both done in the same context – creating Contextually Relevant Learning and the opportunity for discovery! </li></ul><ul><li>Discovery process creates cognitive linkage and greater retention of material. </li></ul><ul><li>Engages learners in new ways </li></ul><ul><li>Shifts the paradigm! </li></ul>
    30. 30. <ul><li>Questions </li></ul><ul><li>& </li></ul><ul><li>Discussion </li></ul>
    31. 31. THANK YOU! Tim Adams, CLO [email_address] Brian Webster, Vice President [email_address] www.Knowledge Factor.com 720-214-4874

    ×