Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Learning Analytics in Higher Education

570 views

Published on

Presents an overview of the learning analytics field touching on the status of the technology, the challenges it faces, the arrival of predictive analytics to education and the best approach towards a successful implementation.

Published in: Education
  • Be the first to comment

  • Be the first to like this

Learning Analytics in Higher Education

  1. 1. 1 www.iadlearning.com Learning Analytics Your next movement towards the future of education Jose A Omedes Jose.omedes@itoptraining.com
  2. 2. 2 www.iadlearning.com What raises interest in LA area? Analysis of around 300 posts on the topic 20.11% 11.41% 9.24% 8.70%8.15% 4.89%
  3. 3. 3 www.iadlearning.com Index • Defining Learning Analytics • The three elements of analytics: data, analysis and action • Learning Analytics maturity and the predictive bridge. • Learning Analytics benefits and experiences • A new learning era • Implementing learning analytics • Learning analytics ethics • Key take aways
  4. 4. 4 www.iadlearning.com Learning Analytics Defined “Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs” International conference on learning analytics
  5. 5. 5 www.iadlearning.com Learning Analytics Defined Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs DATA Basic asset. Raw material to be transformed into analytical insights. ANALYSIS Process to add intelligence to data using algorithms. ACTION Critical step towards achieving the purpose: Understanding & optimizing learning International conference on learning analytics
  6. 6. 6 www.iadlearning.com Learning Analytics and EDM Educational Data Mining (EDM) EDM focuses on the development of methods for exploring the unique types of data that come from an educational context. […] the objective of data mining in education is largely to improve learning […] Handbook of educational data mining Educational Data Mining (EDM) ≈ Learning Analytics
  7. 7. 7 www.iadlearning.com LA and EDM on Google
  8. 8. 8 www.iadlearning.com Data Types Internal External PROVIDED / OBSERVED Learning Analytics INFERRED DERIVED Learning Analytics Algorithms PROVIDED: Consciously given OBSERVED: Recorded automatically DERIVED: Produced from other data INFERRED: Produced using analytics Usually based on correlation between data sets
  9. 9. 9 www.iadlearning.com Data Sources Demographic Data Not Sensitive Sensitive Name, birthdate, Sex Ethnicity, Disability, Scholarship Academic Data Prior Performance Current Performance Learner Content Maths: A, Physics: B, Electromagnetism: B Course 1: Assignment 1: 89% Assignment 2: 56% Course 2: Assignment 1: 35%, Assignment 2: 64% Essay 1, Group Report B, Chat 1 … Learning Activity Data Activity Records 2017/10/02- 10:50 Logged into LMS 2017/10/02- 11:50 Accessed Library Catalog 2017/10/02- 12:00 Check out library book “Human body anatomy” Educational Context Data Context Info Course 1: start: 2017/09/02, duration: 10 weeks, instructor: Allan Green Course 2: start: 2017/08/05, duration: 15 weeks, instructor: Mike Brown External Data Social Account Profiles Other apps info Facebook, Twitter, Google + eBook apps, xAPI enabled apps …
  10. 10. 10 www.iadlearning.com Data Sources SIS (Student Information Systems) LMS / LRS (Learning Management System) Other Internal Systems External Systems Learning Analytics go beyond the LMS !!!
  11. 11. 11 www.iadlearning.com Analysis Process of obtaining insights from data based on a set of statistical and machine learning based algorithms ANALYSIS Data Learning Analytics
  12. 12. 12 www.iadlearning.com Analytics maturity model analysis complexity (imposes demands on data: volume, type, timeframe, etc.) Diagram Source: https://www.ibm.com/developerworks/community/blogs/jfp/entry/the_analytics_maturity_model?lang=en
  13. 13. 13 www.iadlearning.com Predictive Analytics Bridge Descriptive Diagnostic Predictive Algorithms Data Reactive Understand the past Proactive Influence the present
  14. 14. 14 www.iadlearning.com Action Is the overall target of the learning analytics process No action = Failure Having in place the internal processes that lead to action is critical CultureLeadership
  15. 15. 15 www.iadlearning.com Is it worth? Benefits Reduce drop out rates Increase learners’ performance Targeted proactive tutoring Increase retention Targeted proactive tutoring Offer personalized learning experiences Adaptive Learning / Adaptive content Understand content consumption patterns & quality issues Improve content & course quality Instructional design
  16. 16. 16 www.iadlearning.com Is it worth? Benefits Cost efficient allocation Understand which resources work and which don`t Data-driven investment decisions Identify and promote student success factors Create student structured pathways towards graduation Proactively drive success Curriculum design
  17. 17. 17 www.iadlearning.com Source: https://www.jisc.ac.uk/reports/learning-analytics-in-higher-education Does it work?
  18. 18. 18 www.iadlearning.com Does it work? Source: https://www.jisc.ac.uk/reports/learning-analytics-in-higher-education Case studies show: • Validity of the predictive models applied to learning analytics systems • Interventions with at-risk students are effective • There are other benefits to taking a data-driven approach
  19. 19. 19 www.iadlearning.com A new learning era … or not? Learning Analytics: The coming third wave Malcolm Brown, Director, EDUCAUSE Learning Initiative The Predictive Learning Analytics Revolution EDUCASE ECAR Working Group Paper Adaptive Learning Holds Promise for the Future of Higher Education BARNES6NOBLE at EDUCATION DIVE
  20. 20. 20 www.iadlearning.com Reality … The world is more and more data-driven … Education is no exception. “Learning analytics” is an important tool to improve education and to make high education institutions more competitive. “Learning analytics” are successful only if there is action as a result of its implementation. Institutions must cross the predictive analytics bridge to benefit from a new way of driving students success.
  21. 21. 21 www.iadlearning.com The decision automation leap Prescriptive Prescriptive Human supported Fully automated Learning Analytics
  22. 22. 22 www.iadlearning.com The decision automation leap Impressive and completely automated Really impressive !!! 80% Unknown … Never forget the human factor in education !!!
  23. 23. 23 www.iadlearning.com Implementing Learning Analytics How do I implement my learning analytics project?
  24. 24. 24 www.iadlearning.com Implementing Learning Analytics 1 Start small Duration Scope 2 Don’t focus on technology Focus on specific problems you want to address 3 Go after quick wins Show there are positive outcomes and possible impact 4 Involve from day one all the critical stakeholders Don’t forget the people that would use the technology in the end
  25. 25. 25 www.iadlearning.com Learning Analytics Readiness Understand whether institutions are ready for learning analytics from multiple dimensions LEARNING ANALYTICS READINESS JISC Culture & Vision Ethics & Legal Issues Strategy & Investment Structure & Governance Technology & Data LEARNING ANALYTICS READINESS INSTRUMENT Culture & Processes Data Management Expertise Data Analysis Expertise Governance / Infrastructure Readiness perception Kimberly E. Arnold Steven Lonn Matthew D. Pistilli ANALYTICS MATURITY INDEX
  26. 26. 26 www.iadlearning.com What is Readiness about? Strategy & Vision Culture Governance and Processes Ethics and Legal Issues Investment Technology Data ACTION ANALYTICS MATURITY INDEX
  27. 27. 27 www.iadlearning.com Don’t get trapped by the readiness loop Strategy & Vision Culture Governance and Processes Ethics and Legal Issues Investment Technology Data ACTION Readiness Assessment 1 Start small 2 Don’t focus on technology 3 Go after quick wins 4 Involve from day one all the critical stakeholders Start your seed project!
  28. 28. 28 www.iadlearning.com Technology Challenges Data Capture Not all educational interactions happen in a digital environment Predictions Accuracy All statistical processes draw conclusions subject to an estimated error Partial View Learning processes go beyond what data tell us Data Literacy Analytics consumers need the skills to interpret analytics properly Data Variety Combine data coming from multiple sources and systems Comparable Analytics Not all systems use same algorithms or measure the same way Open standards?
  29. 29. 29 www.iadlearning.com Learning Analytics Ethics Source: Accenture Tecnology: https://www.accenture.com/us-en/insight-data-ethics Data Supply Chain DATA ANALISYS ACTION
  30. 30. 30 www.iadlearning.com Learning Analytics Ethics DATA ANALISYS ACTION • Consent • Privacy • Access • Validity • Right to opt out • Safety • Transparency • Accuracy • Validation • Systematic & random errors • Obligation to act • Failure to act • Adverse impact • Abuse / Gaming • Discrimination /social status • Pedagogical impact Complete ethical issues taxonomy by Sclater: https://analytics.jiscinvolve.org/wp/2015/03/03/a-taxonomy-of-ethical-legal-and-logistical-issues-of-learning-analytics-v1-0/
  31. 31. 31 www.iadlearning.com Key Take Aways • Learning analytics are an important asset for institutions providing important benefits but also competitiveness • Institutions must cross the predictive analytics bridge and start influencing the future by changing the present. • Learning analytics are about action. No action = Failure. Get ready to act and change ! • Launch your analytics seed project: start small, don’t focus on technology, go after quick wins, involve stakeholders. • Develop your code of conduct and run analytics protecting all the stakeholders and specially the students.
  32. 32. 32 www.iadlearning.com What raises interest in LA area? Analysis of around 300 posts on the topic 20.11% 11.41% 9.24% 8.70%8.15% 4.89%
  33. 33. 33 www.iadlearning.com For more info … Thanks a lot! Jose A Omedes Research and Development Director Jose.omedes@itoptraining.com

×