Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Learning analytics and evidence-based teaching and learning

Slides for a talk on 30 May 2014 at Goldsmiths' Learning Enhancement Unit conference 'Designing Learning Landscapes'. #dllgold14

  • Be the first to comment

Learning analytics and evidence-based teaching and learning

  1. 1. Learning analytics and evidence-based teaching and learning Doug Clow Institute of Educational Technology, The Open University, UK slideshare.net/dougclow Goldsmiths Learning & Teaching Conference 30 May 2014
  2. 2. What do you want to hear most about? a) What is learning analytics? b) Some examples of learning analytics c) Evidence-based practice d) What can we do? e) I’m only here for the next speaker cc licensed ( BY ) flickr photo by Swaminathan: http://flickr.com/photos/araswami/2168316216/
  3. 3. What is learning analytics?
  4. 4. “Big data is like teenage sex: everyone talks about it, nobody really knows how to do it, everyone thinks everyone else is doing it, so everyone claims they are doing it…” – Dan Ariely, Facebook, 6 Jan 2013
  5. 5. “Big data is like teenage sex: everyone talks about it, nobody really knows how to do it, everyone thinks everyone else is doing it, so everyone claims they are doing it…” – Dan Ariely, Facebook, 6 Jan 2013 … and the world of education seems obsessed about it, but the little that does go on is often done badly, and leaves people disillusioned.
  6. 6. “feeding back the data exhaust” Big Data in Education Photo (CC)-BY Iain Watson http://www.flickr.com/photos/dagoaty/3329699788/
  7. 7. It’s not very big but it may be clever Photo (CC)-BY Paul and Cathy https://www.flickr.com/photos/becker271/7903353008
  8. 8. What is learning analytics? • the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs – First International Conference on Learning Analytics And Knowledge (LAK11), Banff, Alberta, 2011 Photo (CC)-BY Cris: http://flickr.com/photos/chrismatos/6917786197/
  9. 9. Photo public domain: http://commons.wikimedia.org/wiki/File:DESYNebelkammer.jpg Erik Duval http://erikduval.wordpress.com/2012/01/30/learning- analytics-and-educational-data-mining/ “collecting traces that learners leave behind and using those traces to improve learning”
  10. 10. Clow, LAK12, 2012
  11. 11. some examples
  12. 12. • Predictive modeling, datamining (Blackboard) • Place students in one of three risk groups => traffic light • Trigger for intervention emails • Dramatic retention improvements • Consistent grade performance improvement
  13. 13. Social Network Analysis • Social Networks Adapting Pedagogic Practice • Network visualisations of forum activity data from VLE • See patterns • Spot central and disconnected • Identify at-risk • Improve teaching
  14. 14. Content/semantic analysis • Lárusson and White, 2012
  15. 15. • Santos, Govaerts, Verbert and Duval, 2012 Usage tracking
  16. 16. evidence-based practice
  17. 17. Evidence-based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. –Sackett et al (1996) Photo (CC)-BY photophilde: https://www.flickr.com/photos/photophilde/8127001284/
  18. 18. Evidence-based practice is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual clients. –Sackett et al (1997) Photo (CC)-BY photophilde: https://www.flickr.com/photos/photophilde/8127001284/
  19. 19. Evidence-based teaching and learning is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual learners. Photo (CC)-BY photophilde: https://www.flickr.com/photos/photophilde/8127001284/
  20. 20. Randomised controlled trial • Groups vary only in the thing you’re testing • People assigned to groups at random • Participants and researchers don’t know which Photo (CC)-BY Kevin Dooley https://www.flickr.com/photos/pagedooley/6613526021/
  21. 21. cc licensed ( BY ) flickr photo by LASZLO ILYES: http://flickr.com/photos/laszlo-photo/4093575863/ Why so few RCTs in HE? • Ethics • Impracticality • Complexity
  22. 22. Ethics: HIV/AIDS in 80s/90s • Poor prognosis for HIV infection • New, effective treatments –Untested, unavailable • New protocols –Wider access –Early endpoints to trials Photo (CC)-BY Swami Stream https://www.flickr.com/photos/araswami/525922259/
  23. 23. Ethics: Vioxx • New drug • Pain relief & anti-inflammatory –without stomach damage • Heart attacks and strokes • Withdrawn • Other painkillers now under suspicion Photo (CC)-BY xJason.Rogersx https://www.flickr.com/photos/restlessglobetrotter/3058701116/
  24. 24. Practicality • Online learning = data • A/B testing Photo (CC)-BY Jonathan Combe https://www.flickr.com/photos/jono566/8489053557/
  25. 25. Complexity • Important outcomes long delayed • Disagreement about end points –Medicine: All-cause mortality –Education: Passes, grades, employment Gentian sino-ornata Photo (CC)-BY reurinkjan https://www.flickr.com/photos/reurinkjan/3241158162/ • Richness of humanity • Assessment Problem
  26. 26. What is to be done?
  27. 27. Competition: • Large established companies • High-tech startups • Private sector HE providers Japanese Knotweed Fallopia japonica Photo (CC)-BY Maja Dumat https://www.flickr.com/photos/blumenbiene/6146039333
  28. 28. catnip for senior managers Photo (CC)-BY Dylan Ashe https://www.flickr.com/photos/ackook/3929957511/
  29. 29. • See what data you (can) have about your students • Move towards evidence-based practice –Look for evidence before innovation –Make new evidence • Find out more about learning analytics Photo (CC)-BY Wonderlane https://www.flickr.com/photos/wonderlane/3065525293/
  30. 30. www.laceproject.eu • Evidence Hub • Events: SoLAR Flare, 24 Oct 14 • Publications, briefings, webinars Learning Analytics Community Exchange (FP7)
  31. 31. Thanks to: People: • OU Learning Analytics: IET Student Statistics and Survey Team, Gill Kirkup and the other Data Wranglers, Kevin Mayles, Belinda Tynan, Simon Buckingham Shum, Rebecca Ferguson, Bart Rientes • LACE: Rebecca Ferguson, Simon Cross, Michelle Bailey, Rebecca Wilson, partners. Funders: • LACE: EC 619424-FP7-ICT-2013-11
  32. 32. Doug Clow @dougclow dougclow.org doug.clow@open.ac.uk dougclow.org/intro-to-la slideshare.net/dougclow This work is licensed under a Creative Commons Attribution 3.0 Unported License
  33. 33. Photo (CC)-BY David Goehring: http://flickr.com/photos/carbonnyc/33413040/

×