Learning Analytics 2012:Review and Future ChallengesDr Rebecca FergusonThe Open University, UK
Learning analyticsThe measurement, collection,analysis and reporting of dataabout learners and their contexts,for purposes...
Driver 1: Big dataFormal: Blackboard, MoodleInformal: Facebook, OpenLearn•Interaction data•Personal data•Systems informati...
Technical challengeHow can we extract value from thesebig sets of learning-related data?
Driver 2: Online learning            Infographic: http://sloanconsortium.org/sites/default/files/pages/OnlineLearningSurve...
Educational challengeHow can we optimise opportunitiesfor learning?
Driver 3: Political concerns      The goal of creating an interconnected feedback system would be to      ensure that key ...
Political challengeHow can we substantially improvelearning opportunities and educationalresults at national or internatio...
Three main interest groups   Learners                              Governments and teachers                Schools and    ...
Data-driven analyticsUse of web mining techniques•Clustering•Classification•Outlier detection•Association rule mining•Sequ...
Effective better learnersThe goal:Turn learners into effective better learnersFocus on:data mining and machine learning te...
Learning-focused perspectivesKnowledge is constructedthrough social negotiationLearning takes place innetworks and incommu...
Strategic perspectives – 2007/8by 2020 the overall portion of the U.S.workforce with a college degree willbe lower than it...
EDM and analytics split• extend geographical focus• make tools easier for educators to use• standardize methods and data a...
Disambiguation                 Phil Long, George Siemens (2011)
Dividing responsibilityEducational data miningHow can we extract value from these big sets oflearning-related data?Academi...
Meeting the challengeHow can we optimise opportunities for learning?•Maintain focus on this challenge•Learn from previous ...
Fresh challenges• Widen range of theory-driven approaches• Develop methods of presenting analytics clearly• Adopt standard...
Upcoming SlideShare
Loading in...5
×

SOLAR - learning analytics, the state of the art

1,270

Published on

On 3 May 2012, the Society for Learning Analytics Research (SoLAR) organised a learning analytics summit. The summit took place in Vancouver, Canada, following the second Learning Ananlytics and Knowledge conference (LAK12). This presentation summarised the state of the art in learning analytics at the time, identifying drivers, challenges, interest groups and future challenges.

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,270
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
29
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • I work at the UK’s Open University – my department has been collecting and analysing data about the university’s students for more than 40 years Here today as a member of the SOLAR steering group Aim is that this presentation, and our discussion, will enable us to develop a shared understanding of how the field has emerged and what it it aiming to achieve
  • Definitions of learning analytics have changed over the last decade. A set of processes focused on learning. Unstated – ‘data’ refers to large, machine-readable datasets that were generated for other purposes.
  • First the drivers, and their associated challenges 1. The rise of big data in business, moving to education
  • How can we draw on records that are distributed across different sites with different standards, owners and levels of access?
  • 2. US has 6 million online learners. Benefits and problems. Disorientated, technical problems, motivation Teachers can struggle to interpret the learning and participation of individuals when this is buried beneath hundreds of contributions within discussions that have lasted many weeks. Infographic: http://sloanconsortium.org/sites/default/files/pages/OnlineLearningSurvey-Infographic-1.png
  • Improve the experience for learners and teachers, to improve both learning and the learning environment.
  • Organisation for Economic Co-operation and Development (OECD) Measure, demonstrate and improve performance These reports can be used to drive political change. Countries benchmark themselves against similar countries and against the rest of the world Table from http://www.oecd.org/document/2/0,3746,en_2649_39263238_48634114_1_1_1_1,00.html  
  • 3. looking beyond the learner and the institution to the country as a whole – looking for ways to improve standards nationally.
  • Three drivers, three challenges and three interest groups These require work on different scales and at different granularities They therefore affect how researchers conceptualise problems, gather data, report and act on findings.
  • Brief history In the early 21 st -century we were still investigating how learning took place online, so data driven analytics predominated. These used established web mining techniques. Clustering and classification -novices and experts Association rule mining -common characteristics of students who did well, or dropped out. Sequential pattern mining -routes student took through learning materials, text mining - forum interactions. Image taken from Damez, Dang,Marsala, Bouchon-Meunier, 2005
  • There is perhaps a tendency to assume that the focus was all on data and algorithms. This is not the case. These ideas are from the most referenced paper in data mining This is some indication of the way that the terminology has shifted over the past decade And of the clear links between data mining and learner analytics
  • Pedagogy neutral – social constructivist view that knowledge is constructed through social negotiation they weren’t particularly associated with any theories about how learning takes place This began to change as social network analysis was introduced to the toolkit. Learning theorists such as Vygotsky and Wenger increasingly began to inform and drive research
  • Educause had been increasingly active in this area – trying to disambiguate the terminology A flurry of publications in 2007/8 focused attention on analytics in relation to education, and their strategic importance
  • At this point the move to three stakeholders and three challenges catalysed a split in the field EDM made firmer steps to being a field in its own right – with the first of its annual conferences (none of the paper titles used the term ‘analytics’) Two reviews of the field came out. ROMERO, C. & VENTURA, S. 2007. (1995-2005) BAKER, R. S. J. D. & YACEF, K. 2009. (2009) While the split may have been inevitable, it was a shame because (a) we lost access to the literature and (b) we lost sight of their vision
  • The split between academic analytics and learner analytics is still taking place The field still doesn’t seem to be broad enough to support another community and conference So academic analytics and learning analytics remain increasingly uneasy bedfellows
  • Three fields have emerged – each one addressing one of the challenges posed by the original drivers – big data, shifts in the learning landscape, and political concerns about education
  • This gives us a clear challenge, but it also explains some of the issues that have been problematic at this conference Explains why we are not always focused on learning It explains why we are reformulating ideas that appeared within the EDM community years ago It explains why the input from learning sciences is not as high as we would like And it explains why our attention wanders from learners and teachers, to the concerns of institutions. - But we have been relatively quick to put our house in order
  • For the future, we have a series of challenges, that have emerged from this conference and from the literature These could be addressed piecemeal by individual scholars and research teams However, today’s summit gives us the chance to move forward together, in a concerted way, with a shared understanding of where we have come from and what we are aiming to achieve
  • SOLAR - learning analytics, the state of the art

    1. 1. Learning Analytics 2012:Review and Future ChallengesDr Rebecca FergusonThe Open University, UK
    2. 2. Learning analyticsThe measurement, collection,analysis and reporting of dataabout learners and their contexts,for purposes ofunderstanding and optimising learningand the environments in which it occurs. LAK 11 Call for Papers
    3. 3. Driver 1: Big dataFormal: Blackboard, MoodleInformal: Facebook, OpenLearn•Interaction data•Personal data•Systems information•Academic information•Social information
    4. 4. Technical challengeHow can we extract value from thesebig sets of learning-related data?
    5. 5. Driver 2: Online learning Infographic: http://sloanconsortium.org/sites/default/files/pages/OnlineLearningSurvey-Infographic-1.png
    6. 6. Educational challengeHow can we optimise opportunitiesfor learning?
    7. 7. Driver 3: Political concerns The goal of creating an interconnected feedback system would be to ensure that key decisions about learning are informed by data and that data are aggregated and made accessible at all levels of the education system for continuous improvement. US Department of Education, 2010Table: http://www.oecd.org/document/2/0,3746,en_2649_39263238_48634114_1_1_1_1,00.html
    8. 8. Political challengeHow can we substantially improvelearning opportunities and educationalresults at national or international levels?
    9. 9. Three main interest groups Learners Governments and teachers Schools and colleges
    10. 10. Data-driven analyticsUse of web mining techniques•Clustering•Classification•Outlier detection•Association rule mining•Sequential pattern mining•Text mining
    11. 11. Effective better learnersThe goal:Turn learners into effective better learnersFocus on:data mining and machine learning techniques…to enhance web-based learning environments forthe educator to better evaluate the learning process,as well as for the learners to help them in theirlearning endeavour Zaïane, 2001
    12. 12. Learning-focused perspectivesKnowledge is constructedthrough social negotiationLearning takes place innetworks and incommunities of practiceLearning can be scaffoldedby a more able other Dawson, McWilliam, Tan, 2008
    13. 13. Strategic perspectives – 2007/8by 2020 the overall portion of the U.S.workforce with a college degree willbe lower than it was in 2000analytics is emerging as a newtool that can address what seemlike intractable challengesanalytics has the potential toimprove teaching, learning, andstudent success
    14. 14. EDM and analytics split• extend geographical focus• make tools easier for educators to use• standardize methods and data across systems• integrate tools within e-learning environments• develop education-specific mining techniques
    15. 15. Disambiguation Phil Long, George Siemens (2011)
    16. 16. Dividing responsibilityEducational data miningHow can we extract value from these big sets oflearning-related data?Academic (and action) analyticsHow can we substantially improve learningopportunities and educational results at national orinternational levels?Learning analyticsHow can we optimise opportunities for learning?
    17. 17. Meeting the challengeHow can we optimise opportunities for learning?•Maintain focus on this challenge•Learn from previous work in all three fields•Integrate experience from different disciplines•Focus on learners and teachers
    18. 18. Fresh challenges• Widen range of theory-driven approaches• Develop methods of presenting analytics clearly• Adopt standards for the structure and export of data• Broaden focus from higher education• Broaden international focus• Address issues around ethics, privacy and data• Explore possibilities offered by new data sources
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×