Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Learning analytics: Threats and opportunities

6,865 views

Published on

Slides used at ALT's White Rose Learning Technologist's SIG to introduce threats and opportunities for using Learning Analytics. Links related to this presentation are at http://bit.ly/LAWhiteRose

Published in: Education
  • Be the first to comment

Learning analytics: Threats and opportunities

  1. 1. Learning Analytics: Threats and opportunities Martin Hawksey @mhawksey
  2. 2. alt.ac.uk Overview ◊ Introduction to Learning Analytics ◊ Hands-on – Mining Twitter for actionable insight @mhawksey 2
  3. 3. “ alt.ac.uk How much do you know about Learning Analytics? In small groups share what you 2mins @mhawksey 3
  4. 4. alt.ac.uk@mhawksey 4
  5. 5. alt.ac.uk@mhawksey 5
  6. 6. “ alt.ac.uk Analytics in Education Analytics is the process of developing actionable insights through problem definition and the application of statistical models and analysis against existing and/or simulated future data Adam Cooper, What is Analytics? http://publications.cetis.ac.uk/wp- content/uploads/2012/11/What-is-Analytics-Vol1-No-5.pdf @mhawksey 6
  7. 7. “ alt.ac.uk Learning Analytics Definition the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs First International Conference on Learning Analytics and Knowledge (LAK11), 2011 @mhawksey 7
  8. 8. alt.ac.uk Disciplines ◊ Computer science ◊ Statistics ◊ Programming ◊ Network analysis ◊ Psychology of education ◊ … @mhawksey 8
  9. 9. alt.ac.uk Methods ◊ Content Analytics ◊ Context Analytics ◊ Discourse Analytics ◊ Social Learning Analytics ◊ Disposition Analytics ◊ Social Network Analysis ◊ … @mhawksey 9 Ferguson and Buckingham Shum (2012) Social Learning Analytics: Five Approaches
  10. 10. alt.ac.uk Tools/Products ◊ Spreadsheets - MS Excel, Tableau, Open Refine, Google Sheets… ◊ SNA – NodeXL, Gephi, Cytoscape ◊ Programming: R, Python, MATLAB… ◊ VLEs - Blackboard Analytics for Learn, Desire2Learn Insights … ◊ … @mhawksey 10
  11. 11. alt.ac.uk Flow @mhawksey Data Analytic Insight Who? Institution Tutor Self … Educational Commercial How? Social network Discourse Content Disposition Context … Administration What? Platform Service … Availability Access 11
  12. 12. alt.ac.uk@mhawksey Threat: The Absence of Theory 12
  13. 13. “ alt.ac.uk Amazon cares not a whit *why* people who buy german chocolate also buy cake pans as long as they get to the checkout buying both Mike Caulfield - Short Notes on the Absence of Theory http://hapgood.us/2013/12/10/short-notes-on-the-absence- of-theory/ @mhawksey 13
  14. 14. “ alt.ac.uk Counts don’t count much if decontextualized Wilson, T.D. (1999). Models in information behaviour research. Journal of Documentation, 55(3), 249 – 270. @mhawksey Dragan Gasevic speaking at DiCE Seminar Moray House School of Education – 9th January 2015 14
  15. 15. “ alt.ac.uk@mhawksey Dragan Gasevic speaking at DiCE Seminar Moray House School of Education – 9th January 2015 Analytics to account for conditions, operations, products, evaluation, and standards (COPES) Gašević, D., Dawson, S., Siemens, G. (2015). Let's not forget: Learning analytics are about learning. TechTrends, 59(1), 64-71, https://bit.ly/techtrends15 15
  16. 16. alt.ac.uk@mhawksey Threat: Visualizations 16
  17. 17. @mhawksey 17
  18. 18. “ alt.ac.uk Graphs can be a powerful way to represent relationships between data, but they are also a very abstract concept, which means that they run the danger of meaning something only to the creator of the graph … Everything looks like a graph, but almost nothing should ever be drawn as one. Ben Fry in ‘Visualizing Data’ @mhawksey 18
  19. 19. alt.ac.uk Explanatory visualization Data visualizations that are used to transmit information or a point of view from the designer to the reader. Explanatory visualizations typically have a specific “story” or information that they are intended to transmit. Exploratory visualization Data visualizations that are used by the designer for self-informative purposes to discover patterns, trends, or sub-problems in a dataset. Exploratory visualizations typically don’t have an already-known story. Iliinsky & Steele - Designing Data Visualizations: Representing Informational Relationships @mhawksey 19
  20. 20. “ alt.ac.uk Visualizations can be harmful Corrin, L., & de Barba, P. (2014). Exploring students’ interpretation of feedback delivered through learning analytics dashboards. In Proceedings of the ascilite 2014 conference (pp. 629-633). ascilite. @mhawksey Dragan Gasevic speaking at DiCE Seminar Moray House School of Education – 9th January 2015 20
  21. 21. “ alt.ac.uk Visualizations can be useful if embedded into and fit learning tasks @mhawksey Dragan Gasevic speaking at DiCE Seminar Moray House School of Education – 9th January 2015 21
  22. 22. alt.ac.uk@mhawksey Threat: Ethics, privacy and data sharing 22
  23. 23. “ alt.ac.uk The worlds of privacy and analytics intersect Downes (2014)@mhawksey …not always happily 23 © Unknown Source: http://crooksandliars.com/files/primary_image/14/05/inbloom-drawing.jpg
  24. 24. alt.ac.uk Ethics ◊ Clarity ◊ Comfort and care ◊ Choice and consent ◊ Consequence and complaint @mhawksey 24 Legal, Risk and Ethical Aspects of Analytics in Higher Education (Kay, Korn, & Oppenheim, 2012)
  25. 25. alt.ac.uk@mhawksey Opportunities 25
  26. 26. “ alt.ac.uk Feedback loops between students and instructors are missing! Hattie, J., & Timperley, H. (2007). The power of feedback. Review of education research, 77(1), 82-112. @mhawksey 26
  27. 27. “ alt.ac.uk At best analytics can help start a conversation. People have to be willing to take the conversation on Roberts, G. Analytics are not relationships http://rworld2.brookesblogs.net/2014/12/12/analytics-are-not- @mhawksey 27
  28. 28. “ alt.ac.uk What might you use Learning Analytics for? In small groups discuss – 5mins @mhawksey 28
  29. 29. alt.ac.uk Useful links • LACE (learning analytics community exchange) : http://www.laceproject.eu/ • SoLAR : Society for Learning Analytics Research http://solaresearch.org/ • Jisc: http://analytics.jiscinvolve.org/wp • Cetis Analytics Series : http://publications.cetis.ac.uk/c/analytics • LAK15 Conference #lak15 From http://www.slideshare.net/sheilamac/intro-to-learning-analytics-universities- scotlanddec2014smn @mhawksey 29
  30. 30. alt.ac.uk@mhawksey Wrapping up 30
  31. 31. “ alt.ac.uk Learning activities don’t happen in a single platform Dragon Gasevic @mhawksey 31
  32. 32. “ alt.ac.uk Not everything that can be counted counts. Not everything that counts can be counted. William Bruce Cameron @mhawksey 32
  33. 33. “ alt.ac.uk What kind of learners are we trying to create? this should drive our analytics Simon Buckingham Shum @mhawksey 33
  34. 34. “ alt.ac.uk Learning Analytics can’t be “Computer says no” @mhawksey 34
  35. 35. alt.ac.uk Useful links • LACE (learning analytics community exchange) : http://www.laceproject.eu/ • SoLAR : Society for Learning Analytics Research http://solaresearch.org/ • Jisc: http://analytics.jiscinvolve.org/wp • Cetis Analytics Series : http://publications.cetis.ac.uk/c/analytics • LAK15 Conference #lak15 From http://www.slideshare.net/sheilamac/intro-to-learning-analytics-universities- scotlanddec2014smn @mhawksey 35
  36. 36. alt.ac.uk Thank you! @mhawksey+MartinHawksey @mhawksey 36
  37. 37. Association for Learning Technology Registered charity number: 1063519 www.alt.ac.uk @A_L_T

×