The role of institutional data in Learning Analytics

555 views

Published on

Learning analytics has the potential of improving how higher education institutions operate. A significant portion of this potential derives from the use of institutional data. In this talk we review the role of these units in achieving institutional capacity and show some examples of the type of solutions possible at the level of instructors.

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
555
On SlideShare
0
From Embeds
0
Number of Embeds
20
Actions
Shares
0
Downloads
23
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

The role of institutional data in Learning Analytics

  1. 1. The role of institutional data in Learning Analytics Dr Abelardo Pardo (@abelardopardo)
 Faculty of Engineering and IT slideshare.net/abelardo_pardo Australian Association for Institutional Research SIG Forum 17 June 2016, Adelaide, Australia AdamJonesflickr.com
  2. 2. Abelardo Pardo The role of institutional data in Learning Analytics 2 Analytics in Education Potential for Impact Learning Analytics Strategic Elements NicoHoggflickr.com
  3. 3. Abelardo Pardo The role of institutional data in Learning Analytics 3 Analytics in Education NicoHoggflickr.com
  4. 4. Abelardo Pardo The role of institutional data in Learning Analytics 4 Analytics instead of intuition do drive actions Steinberg, L. (2015). Changing the Game: The Rise of Sports Analytics. Forbes. Retrieved from http://www.forbes.com/sites/leighsteinberg/ 2015/08/18/changing-the-game-the-rise-of-sports-analytics
  5. 5. Abelardo Pardo The role of institutional data in Learning Analytics 5 diffusorflickr.com Big Data has landed in Higher Education… … it was there all along!
  6. 6. Abelardo Pardo The role of institutional data in Learning Analytics 6 http://www.theguardian.com/guardian-professional/2015/jun/30/how-universities-are-using-data-to-stop-students-dropping-out
  7. 7. Abelardo Pardo The role of institutional data in Learning Analytics 7 deepwarrenflickr.com Observe in and out of the classroom
  8. 8. Abelardo Pardo The role of institutional data in Learning Analytics 8 DmitryGrigorievflickr.com Learning Analytics: measure, collect, analyse data about learners to understand and improve their learning and the environment in which it occurs
  9. 9. Abelardo Pardo The role of institutional data in Learning Analytics 9 EustaquioSantimanoflickr.com Collect Report Analyse Act Refine
  10. 10. Abelardo Pardo The role of institutional data in Learning Analytics 10
  11. 11. Abelardo Pardo The role of institutional data in Learning Analytics 11 Australian Learning Analytics Summer Institute
  12. 12. Abelardo Pardo The role of institutional data in Learning Analytics 12 Long, P., & Siemens, G. (2011). Penetrating the Fog: Analytics in Learning and Education. EDUCAUSE Review, 48(5), 31-40.
  13. 13. Abelardo Pardo The role of institutional data in Learning Analytics 13 Analytics in Education Potential for Impact NicoHoggflickr.com
  14. 14. Abelardo Pardo The role of institutional data in Learning Analytics 14 Bichsel, J. (2012). Analytics in Higher Education Benefits, Barriers, Progress, and Recommendations (Research Report). Louisville, CO, USA: Educause Center for Applied Research. • Collecting more data than ever • Used to satisfy credentialing or reporting requirements • Not used to address strategic questions • High potential in resource optimisation, administrative functions CarolVonCanonflickr.com
  15. 15. Abelardo Pardo The role of institutional data in Learning Analytics 15 Norris, D. M., & Baer, L. L. (2013). Building Organizational Capacity for Analytics. Louisville, CO, USA: Educause Library. • Ease to capture value: bottom quartile • IT Intensity: bottom quartile • Data-driven mind set: bottom quartile • Data availability: bottom quartile ShallomJohnsonflickr.com
  16. 16. Abelardo Pardo The role of institutional data in Learning Analytics 16 Macfadyen, L. P., Dawson, S., Pardo, A., & Gašević, D. (2014). Embracing Big Data in Complex Educational Systems: The Learning Analytics Imperative and the Policy Challenge. Research & Practice in Assessment, 9, 17-28. shifts in the culture, technological infrastructure, and teaching practices are needed! Potential for improving learning, development of self- regulated learning skills, student success
  17. 17. Abelardo Pardo The role of institutional data in Learning Analytics 17 Shacklock, X. (2016). From bricks to clicks. The potential of data and analytics in higher education. London, UK: Higher Education Commission. • Essential building blocks are in place • Opportunities offered by data • Planning for the future is poor
  18. 18. Abelardo Pardo The role of institutional data in Learning Analytics 18 Siemens, George, Shane Dawson, and Grace Lynch. “Improving the Quality and Productivity of the Higher Education Sector. Policy and Strategy for Systems-Level Deployment of Learning Analytics.” Society for Learning Analytics Research for the Australian Office for Learning and Teaching, 2013.
  19. 19. Abelardo Pardo The role of institutional data in Learning Analytics 19 Analytics in Education Potential for Impact Learning Analytics NicoHoggflickr.com
  20. 20. Abelardo Pardo The role of institutional data in Learning Analytics 20 Long, P., & Siemens, G. (2011). Penetrating the Fog: Analytics in Learning and Education. EDUCAUSE Review, 48(5), 31-40.
  21. 21. Abelardo Pardo The role of institutional data in Learning Analytics Active Learning anything course-related that all students in a class session are called upon to do other than simply watching, listening and taking notes 21 Felder, Richard M., and Rebeca Brent. “Active Learning: An Introduction.” ASQ Higher Education 2, no. August (2009).
  22. 22. Abelardo Pardo The role of institutional data in Learning Analytics 22 SamAbrahamflickr.com Blended Learning Frontier between physical and virtual spaces is blurring
  23. 23. Abelardo Pardo The role of institutional data in Learning Analytics 23 2 Hours 2 Hours 3 Hours Pardo, A. & Mirriahi N. (in press). Design, Deployment and Evaluation of a Flipped Learning First Year Engineering Course. In C. Reidsema, Kavanagh, R. Hadgraft & N. Smith (Eds.), Flipping the Classroom: Practice and Practices. Singapore: Springer.
  24. 24. Abelardo Pardo The role of institutional data in Learning Analytics 24 Tracking
  25. 25. Abelardo Pardo The role of institutional data in Learning Analytics 25
  26. 26. Abelardo Pardo The role of institutional data in Learning Analytics 26 No statistically significant difference in the rating of feedback (2013 edition, M=3.25, SD=0.97; 2014 edition, M=3.35, SD=1.03); t(389.78) = -0.97, p <0.17
  27. 27. Abelardo Pardo The role of institutional data in Learning Analytics 27 EustaquioSantimanoflickr.com Collect Report Analyse Act Refine
  28. 28. Abelardo Pardo The role of institutional data in Learning Analytics 28 You should take a more careful look at how symbols are encoded in the video. Would you be able to encode/ decode UAL symbols without looking at the video? Good initial work. However, did you understand the trick to handle encoding with a variable number of bits? Would you be able to provide an example? Good work. Would you be able to come up with your own machine language and your encoding scheme? Remember that it has to be unambiguous. Thorough work with the task about machine language encoding. Give it a quick review before the midterm. Q1 Q2 Q3 Q4 Instructor
  29. 29. Abelardo Pardo The role of institutional data in Learning Analytics 29 Algorithm
  30. 30. Abelardo Pardo The role of institutional data in Learning Analytics 30 Automatic Email
  31. 31. Abelardo Pardo The role of institutional data in Learning Analytics 31 Significant difference in the rating of feedback (2014 edition, M=3.35, SD=1.03; 2015 edition, M=3.82, SD=0.90); t(389.78) = -4.88, p <10-6
 Effect size (Cohen’s d) = 0.49. Medium positive effect
  32. 32. Abelardo Pardo The role of institutional data in Learning Analytics 32 Significant difference in the midterm score (2014 edition, M=12.80, SD=4.79; 2015 edition, M=13.83, SD=4.89); t(684.5) = -2.86, p < 0.002
 Effect size (Cohen’s d) = 0.21. Small positive effect
  33. 33. Abelardo Pardo The role of institutional data in Learning Analytics 33 Jovanović, J., Pardo, A., Gasevic, D., Dawson, S., Mirriahi, N. (2016). Dynamic Analytics of Learning Strategies in Flipped Classrooms. Manuscript in preparation. Learning Strategies
  34. 34. Abelardo Pardo The role of institutional data in Learning Analytics 34 Predictive models • Week 10 • Predicted score at leaves (out of 40) • Conditions at nodes • If (EXC.in >=22) and (VID.PL < 8.5) then score = 6 Pardo, A., Mirriahi, N., Martínez-Maldonado, R., Jovanović, J., Dawson, S., & Gasevic, D. (2016). Generating Actionable Predictive Models of Academic Performance. Paper presented at the International Conference on Learning Analytics and Knowledge, Edinburgh.
  35. 35. Abelardo Pardo The role of institutional data in Learning Analytics 35 Refine Learning Design
  36. 36. Abelardo Pardo The role of institutional data in Learning Analytics 36 Tracking Krugazorflickr.com
  37. 37. Abelardo Pardo The role of institutional data in Learning Analytics 37 Liu, D. Y.-T., Bartimote-Aufflick, K., Pardo, A., & Bridgeman, A. J. (2016). Data-driven Personalization of Student Learning Support in Higher Education. In A. Peña-Ayala (Ed.), Learning analytics: Fundaments, applications, and trends: A view of the current state of the art. In preparation: Springer. • Upload student listing • Upload indicators per student • Write filters or rules • Contact selected students with personalised email
  38. 38. Abelardo Pardo The role of institutional data in Learning Analytics 38 What if I tell you…
  39. 39. Abelardo Pardo The role of institutional data in Learning Analytics 39 Analytics in Education Potential for Impact Institutional Adoption Strategic Elements NicoHoggflickr.com
  40. 40. Abelardo Pardo The role of institutional data in Learning Analytics 40 Learning analytics and Education Systems JBrewflickr.com Built on networks and relationships Relationships span beyond organisational silos
  41. 41. Abelardo Pardo The role of institutional data in Learning Analytics 41 Pardo, A., & Dawson, S. (2014). Learning Analytics: What capacities do IT departments need in order to cope with complexities and uncertainties and how can the university leadership team best support them Invited talk at EduTECH Brisbane, Australia. Cross-disciplinary approach
  42. 42. Abelardo Pardo The role of institutional data in Learning Analytics 42 Pardo, A., & Dawson, S. (2014). Learning Analytics: What capacities do IT departments need in order to cope with complexities and uncertainties and how can the university leadership team best support them Invited talk at EduTECH Brisbane, Australia. Cross-disciplinary approach • Student Engagement • Assessment • Feedback • Learning Design • etc.
  43. 43. Abelardo Pardo The role of institutional data in Learning Analytics 43 Pardo, A., & Dawson, S. (2014). Learning Analytics: What capacities do IT departments need in order to cope with complexities and uncertainties and how can the university leadership team best support them Invited talk at EduTECH Brisbane, Australia. Cross-disciplinary approach • Student Engagement • Assessment • Feedback • Learning Design • etc. • Data warehousing • Single source of truth • Data cleaning • Interfaces • etc.
  44. 44. Abelardo Pardo The role of institutional data in Learning Analytics 44 Powell, S., & MacNeil, S. (2012). Analytics Series Institutional Readiness for Analytics. CETIS Analytics Series, 1(8), 1-11.
  45. 45. Abelardo Pardo The role of institutional data in Learning Analytics 45 Siemens, George, Shane Dawson, and Grace Lynch. “Improving the Quality and Productivity of the Higher Education Sector. Policy and Strategy for Systems-Level Deployment of Learning Analytics.” Society for Learning Analytics Research for the Australian Office for Learning and Teaching, 2013.
  46. 46. Abelardo Pardo The role of institutional data in Learning Analytics 46 ChrisYunkerflickr.com BI ICT Learning and Teaching Break the silos Step 0
  47. 47. Abelardo Pardo The role of institutional data in Learning Analytics • What are the questions that need to be answered? • What are the available data sources? • What is needed to maintain them? • What tools are required? • Agility to adapt to new scenarios, data sources. • What skills and expertise? 47 Further Steps
  48. 48. Abelardo Pardo The role of institutional data in Learning Analytics 48 Jayneanddflickr.com • Institutions already collect massive amounts of data • Huge potential for widespread improvements • Challenging to articulate • Needs leadership vision and • Cross-disciplinary approach
  49. 49. The role of institutional data in Learning Analytics Dr Abelardo Pardo (@abelardopardo)
 Faculty of Engineering and IT slideshare.net/abelardo_pardo Australian Association for Institutional Research SIG Forum 17 June 2016, Adelaide, Australia AdamJonesflickr.com

×