Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Openness, Learning Analytics, and Continuous Quality Improvement


Published on

Keynote presentation at ELI 2011.

Published in: Education, Technology
  • Be the first to comment

Openness, Learning Analytics, and Continuous Quality Improvement

  1. 1. Openness, Analytics, and Continuous Quality Improvement David Wiley, PhD Department of Instructional Psychology & Technology Brigham Young University
  2. 2. Download These Slides
  3. 6.
  4. 7. If the Book Didn’t Change Schools Can the computer? Can the internet?
  5. 9. Openness… In Education? Let ’s begin by defining terms
  6. 10. Open, adj . Describes educational artifacts
  7. 11. Open Textbooks Open Educational Resources Open Courseware (Open Source Software)
  8. 12. Open, adj . Teaching materials freely shared with permissions to engage in the “4R” activities
  9. 13. The 4Rs Reuse – copy verbatim Redistribute – share with others Revise – adapt and improve Remix – combine with others
  10. 14. Communicate 4Rs Permissions <ul><li>Since this overrides default copyright, you must use a copyright license </li></ul>
  11. 15. Offers easy to use 4R ’s licenses
  12. 20. While Nouns Differ… The operationalizing actions are the same
  13. 21. Open, adj . Generous, sharing, giving
  14. 22. Open, adj . Providing (1) access and (2) local control
  15. 23. Your Inner Two-year Old Overcoming the impulse to scream “ Mine!”
  16. 24. Law and Policy “Enable” Us To shout “Mine!” ever more loudly, convulse ever more uncontrollably, and hit each other with ever larger toys
  17. 25. Society ’s Siren Song “ Be selfish. Keep it to yourself. It’s legal. It’s ok.”
  18. 26. Education Is Not Immune This kind of thinking is accepted
  19. 27. Role of Openness in Education? A terrible, insidious question
  20. 28. Openness is the only means of doing education.
  21. 29. If There Is No Sharing There is no education
  22. 30. Successful Educators Share most thoroughly with the most students
  23. 31. Expertise Is Nonrivalrous Can be given without being given away
  24. 32. “ He who receives ideas from me, receives instruction himself without lessening mine; as he who lights his taper at mine receives light without darkening me.” Thomas Jefferson
  25. 33. Expressions Are Different To give a book you must give it away
  26. 34. Expressions Are Different To give a book you must give it away
  27. 35. Expressions Are Different Digital expressions are nonrivalrous n ’t ^
  28. 36. E.g., Online Book We can all read simultaneously
  29. 37. An Indescribable Advance The first time in human history
  30. 38. Expertise and Its Expressions Give without giving away
  31. 39. Unprecedented Capacity We can share as never before
  32. 40. Unprecedented Capacity We can educate as never before
  33. 41. Stewardship For which we are accountable
  34. 42. Open Educational Resources Open Course Ware Open Courses Open Textbooks
  35. 43. Repository Examples
  36. 47. OpenCourseWare Examples
  37. 52. Open Courses Examples
  38. 56. Open Textbook Examples
  39. 59. Expanded Funding
  40. 60. Department of Labor <ul><li>$2 Billion for high-demand two year programs </li></ul>
  41. 62. Not Just Foundation Funding
  42. 63. Accreditation <ul><li>Get credit for what you know </li></ul>
  43. 65. University of the People
  44. 66. OER University
  45. 67. Mozilla Badge Lab
  46. 68. Practical Analytics <ul><li>Making use of data </li></ul>
  47. 73. Each and Every Interaction <ul><li>Recorded and stored for analysis </li></ul>
  48. 74. If Only We Could Get Data! <ul><li>We could do analyses (aka research) too </li></ul>
  49. 78. Canvas
  50. 79. Even the Grocer! <ul><li>Almost every industry (1) gathers and (2) uses data more effectively than we do </li></ul>
  51. 80. What Kind of Data? <ul><li>Assessment data </li></ul><ul><li>Construct-relevant behavioral data </li></ul>
  52. 81. Assessment Data <ul><li>Difficulty estimates Discrimination estimates Per standard expertise estimates (Not just “grades”) </li></ul>
  53. 82. Behavioral Data <ul><li>When they logged in, read, and worked </li></ul><ul><li>How long they logged in, read, and worked </li></ul><ul><li>Pathway information Social network analysis &c. </li></ul>
  54. 83. What If You Could Know <ul><li>Which students need the most help? </li></ul><ul><li>Specifically what those students need help on (academic or behavioral)? </li></ul><ul><li>The least effective parts of you curriculum? </li></ul><ul><li>Which parts of your tests are malfunctioning? </li></ul>
  55. 86. Teaching as Science <ul><li>With sufficient amounts of data, and appropriate commitment, it’s possible </li></ul>
  56. 87. Learning Analytics <ul><li>Can tell us who and what needs help </li></ul>
  57. 88. Openness <ul><li>Gives us permission to make changes / adaptations / improvements </li></ul>
  58. 89. Pointless <ul><li>Knowing what needs fixed, when you don’t have permission to fix it </li></ul>
  59. 90. Pointless <ul><li>Having permission to fix things, when you don’t know where to start </li></ul>
  60. 91. Openness + Analytics <ul><li>Enable Continuous Quality Improvement </li></ul>
  61. 93. The Loop Curriculum Use Curriculum Redesign Student Performance Data Data Describing Curriculum Performance Data Supporting Strategic Tutoring
  62. 94. “ Strategic Tutoring?” <ul><li>What if we could do one-on-one tutoring just-in-time and just-on-topic? </li></ul>
  63. 95. You Would Have to Know <ul><li>Who needs help right now? </li></ul><ul><li>What do they need help on? </li></ul>
  64. 96. Strategic Tutoring <ul><li>1. Online curriculum teaches as much as possible 2. Teachers do proactive, data-based, one-on-one outreach </li></ul>
  65. 97. Teacher Becomes Tutor <ul><li>Has the computer replaced the teacher? </li></ul><ul><li>As broadcast machinery, yes. </li></ul>
  66. 98. The Loop and Conjoint CQI <ul><li>Student learning AND curriculum effectiveness </li></ul><ul><li>grow simultaneously </li></ul>
  67. 99. But Tutoring Data are Out-of-Band! <ul><li>Where does the data go? </li></ul>
  68. 101. If the Book Didn’ t Change Schools Can openness? Can analytics? Can openness + analytics?
  69. 103. Reconsider Your Stewardship CQI is possible today Do you have an ethical or moral responsibility to engage?
  70. 104. Thank You [email_address] @opencontent