Learning Analytics:
Making learning better?
Dr Doug Clow
Institute of Educational Technology, The Open University, UK
@dougclow
dougclow.org
doug.clow@open.ac.uk
2
2
CC-BY – You are free to:
copy, share, adapt, or re-mix;
photograph, film, or broadcast;
blog, live-blog, or post video of
this presentation provided that:
You attribute the work to its author and respect the rights and
licences associated with its components.
What is learning analytics?
• the measurement, collection, analysis and reporting of
data about learners and their contexts, for purposes of
understanding and optimising learning and the
environments in which it occurs
– First International Conference on Learning Analytics And Knowledge (LAK11), Banff, Alberta, Feb 27-
Mar 1, 2011
Photo (CC)-BY Cris: http://flickr.com/photos/chrismatos/6917786197/
Photo public domain: http://commons.wikimedia.org/wiki/File:DESYNebelkammer.jpg
- Erik Duval
http://erikduval.wordpress.com/2012/01/30/learning-
analytics-and-educational-data-mining/
“collecting traces
that learners leave
behind and using
those traces to
improve learning”
“feeding back the
data exhaust”
Big Data in
Education
Photo (CC)-BY Iain Watson http://www.flickr.com/photos/dagoaty/3329699788/
Clow, LAK12, 2012
examples
School dashboards (Google Images)
• Maybe chop the first slide about this.
8
Dispositions analytics
• Learning dispositions
• ‘Learning power’:
Effective Lifelong
Learning Inventory
• “A framework for a
coaching conversation
which moves between
identity and
performance”
• Schools to
Graduate schools
9
Buckingham Shum and Deakin Crick, 2012 (LAK12)
ELLI
Teacher view
10
Buckingham Shum and Deakin Crick, 2012 (LAK12)
what else could you do?
What data do we have about learners?
• Demographics
• Previous educational experience
• Grades, scores, achievements, struggles
• Attendance, location, gaze
• Software logs
• Online tracking
• Other online activity (tracking)
• … more every week.
12
Photo (CC)-BY-SA AJ Cann https://www.flickr.com/photos/ajc1/15574010080/
What can we do with that data?
• Identify learners who need help
– Simple or predictive
• Trigger interventions
– Via teacher, or direct
• Learn which interventions work
• Build a complete cognitive learning system
• Suggest resources or source of help
– Learners like you found this helpful
– This person might be able to help you
13
Photo (CC)-BY-NC Pulpolux https://www.flickr.com/photos/pulpolux/8735428280
what should we do?
15
control
Photo (CC)-BY Andy Roberts https://www.flickr.com/photos/aroberts/3035796
surveillance
16
support
Photo (CC)-BY-NC-SA Drew Bennett https://www.flickr.com/photos/abennett96/2710211041
guidance
Glasswinged butterfly, ? Greta oro
Photo (CC)-BY-NC-ND by Greg Foster on Flickr http://www.flickr.com/photos/gregfoster/3365801458/
Principles
• Privacy
• Data
protection
• Ethics
• Transparency
www.laceproject.eu
Learning Analytics Community Exchange (FP7)
• Coordination and Support
• Evidence Hub
• Events
• Publications, briefings, webinars
Thanks to:
People:
• LACE at the OU: Rebecca Ferguson, Simon Cross, Linda Norwood Michelle
Bailey, Rebecca Wilson, Evaghn De Souza, Natalie Eggleston, Oliver
Millard, Gary Elliot-Citigottis,
• LACE project partners: CETIS (Bolton), OUNL, Skolverket, HIOA,
Kennisnet, ITS, ATiT.
• The learning analytics community, including SoLAR, IEDMS, those I’ve met
at LAK and LASI
Funders:
• LACE: European Commission 619424-FP7-ICT-2013-11
“Learning Analytics: Making Learning Better?” by Doug Clow,
Institute of Educational Technology, The Open University,
was presented at Bett, London, on 23 January 2015.
@dougclow
dougclow.org
doug.clow@open.ac.uk
This work was undertaken as part of the LACE Project, supported by the European Commission Seventh
Framework Programme, grant 619424.
These slides are provided under the Creative Commons Attribution Licence:
http://creativecommons.org/licenses/by/4.0/. Some images used may have different licence terms.
www.laceproject.eu
@laceproject
20
cc licensed ( BY ) flickr photo by David Goehring: http://flickr.com/photos/carbonnyc/33413040/

Learning Analytics: Making learning better?

  • 1.
    Learning Analytics: Making learningbetter? Dr Doug Clow Institute of Educational Technology, The Open University, UK @dougclow dougclow.org doug.clow@open.ac.uk
  • 2.
    2 2 CC-BY – Youare free to: copy, share, adapt, or re-mix; photograph, film, or broadcast; blog, live-blog, or post video of this presentation provided that: You attribute the work to its author and respect the rights and licences associated with its components.
  • 3.
    What is learninganalytics? • the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs – First International Conference on Learning Analytics And Knowledge (LAK11), Banff, Alberta, Feb 27- Mar 1, 2011 Photo (CC)-BY Cris: http://flickr.com/photos/chrismatos/6917786197/
  • 4.
    Photo public domain:http://commons.wikimedia.org/wiki/File:DESYNebelkammer.jpg - Erik Duval http://erikduval.wordpress.com/2012/01/30/learning- analytics-and-educational-data-mining/ “collecting traces that learners leave behind and using those traces to improve learning”
  • 5.
    “feeding back the dataexhaust” Big Data in Education Photo (CC)-BY Iain Watson http://www.flickr.com/photos/dagoaty/3329699788/
  • 6.
  • 7.
  • 8.
    School dashboards (GoogleImages) • Maybe chop the first slide about this. 8
  • 9.
    Dispositions analytics • Learningdispositions • ‘Learning power’: Effective Lifelong Learning Inventory • “A framework for a coaching conversation which moves between identity and performance” • Schools to Graduate schools 9 Buckingham Shum and Deakin Crick, 2012 (LAK12)
  • 10.
    ELLI Teacher view 10 Buckingham Shumand Deakin Crick, 2012 (LAK12)
  • 11.
  • 12.
    What data dowe have about learners? • Demographics • Previous educational experience • Grades, scores, achievements, struggles • Attendance, location, gaze • Software logs • Online tracking • Other online activity (tracking) • … more every week. 12 Photo (CC)-BY-SA AJ Cann https://www.flickr.com/photos/ajc1/15574010080/
  • 13.
    What can wedo with that data? • Identify learners who need help – Simple or predictive • Trigger interventions – Via teacher, or direct • Learn which interventions work • Build a complete cognitive learning system • Suggest resources or source of help – Learners like you found this helpful – This person might be able to help you 13 Photo (CC)-BY-NC Pulpolux https://www.flickr.com/photos/pulpolux/8735428280
  • 14.
  • 15.
    15 control Photo (CC)-BY AndyRoberts https://www.flickr.com/photos/aroberts/3035796 surveillance
  • 16.
    16 support Photo (CC)-BY-NC-SA DrewBennett https://www.flickr.com/photos/abennett96/2710211041 guidance
  • 17.
    Glasswinged butterfly, ?Greta oro Photo (CC)-BY-NC-ND by Greg Foster on Flickr http://www.flickr.com/photos/gregfoster/3365801458/ Principles • Privacy • Data protection • Ethics • Transparency
  • 18.
    www.laceproject.eu Learning Analytics CommunityExchange (FP7) • Coordination and Support • Evidence Hub • Events • Publications, briefings, webinars
  • 19.
    Thanks to: People: • LACEat the OU: Rebecca Ferguson, Simon Cross, Linda Norwood Michelle Bailey, Rebecca Wilson, Evaghn De Souza, Natalie Eggleston, Oliver Millard, Gary Elliot-Citigottis, • LACE project partners: CETIS (Bolton), OUNL, Skolverket, HIOA, Kennisnet, ITS, ATiT. • The learning analytics community, including SoLAR, IEDMS, those I’ve met at LAK and LASI Funders: • LACE: European Commission 619424-FP7-ICT-2013-11
  • 20.
    “Learning Analytics: MakingLearning Better?” by Doug Clow, Institute of Educational Technology, The Open University, was presented at Bett, London, on 23 January 2015. @dougclow dougclow.org doug.clow@open.ac.uk This work was undertaken as part of the LACE Project, supported by the European Commission Seventh Framework Programme, grant 619424. These slides are provided under the Creative Commons Attribution Licence: http://creativecommons.org/licenses/by/4.0/. Some images used may have different licence terms. www.laceproject.eu @laceproject 20
  • 21.
    cc licensed (BY ) flickr photo by David Goehring: http://flickr.com/photos/carbonnyc/33413040/

Editor's Notes

  • #3 Please copy, adapt, photograph, video. Tell your friends!
  • #4 Learning analytics is on the Internet and the Internet has cats Data mining, business intelligence, academic analytics, learner analytics – focus here is on the learning, not the management and administration of learning
  • #5 Photo: Cloud Chamber at the German Electron Synchrotron DESY
  • #6 Our data isn’t big. Most fits in Excel! Small data = Excel, Medium = laptop with R or other stats, Big = need special servers/cloud services
  • #7 Without interventions: still good stuff: computer science, educational research, business intelligence But only LA if fed back. What good teachers have always been doing, but more data, and better techniques.
  • #9 Massive investment by educational software vendors, from VC-backed startups to large international media companies. Most products here at Bett will have a dashboard or analytics.
  • #11 Cohort dispositional analytics. Building critical self-awareness. Correlations with success measures, but complex relationship. Learning power goes down over time in school!
  • #14 To help the learner! Not just tracking.
  • #18 Privacy – education makes space to fail, make mistakes, and learn from them – and not have that held against you. Data protection – longstanding EU legislation Ethics vast, complex, tricky. 70% chance to complete (about right) but 1% chance succeed. Alex the student. Vs ignoring info could help success. When does keeping the door to success open become giving unrealistic hope? Ethics critical path. Transparency – to learners, but to the outside. Shared processes.
  • #19 Again heard from Peter.
  • #20 Big thanks in small fonts
  • #21 )