Slideshare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our User Agreement and Privacy Policy.

Slideshare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our Privacy Policy and User Agreement for details.

Successfully reported this slideshow.

Like this presentation? Why not share!

- The role of data in the provision ... by Abelardo Pardo 283 views
- The role of institutional data in L... by Abelardo Pardo 952 views
- Feedback at scale with a little hel... by Abelardo Pardo 911 views
- Designing Effective Flipped Learnin... by Abelardo Pardo 17427 views
- Scaling the provision of feedback f... by Abelardo Pardo 1050 views
- Behavioral analytics. Observe, proc... by Abelardo Pardo 6400 views

698 views

Published on

Published in:
Education

No Downloads

Total views

698

On SlideShare

0

From Embeds

0

Number of Embeds

32

Shares

0

Downloads

13

Comments

0

Likes

1

No embeds

No notes for slide

- 1. Abelardo Pardo, Negin Mirriahi, Roberto Martínez-Maldonado, Jelena Jovanovic, Shane Dawson, Dragan Gašević KannanBﬂickr.com Generating Actionable Predictive Models of Academic Performance International Conference on Learning Analytics and Knowledge University of Edinburgh 29 April 2016
- 2. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. The problem • Detailed data footprints collected • Sophisticated algorithms applied • Predictive models created • How to derive/apply actions? 2 MichaelPereckasﬂickr.com
- 3. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. Retention/Attrition 3 TrevorHuxmanﬂickr.com Predict student abandoning course/institution E.g., Jayaprakash, S. M., Moody, E. W., Eitel, J. M., Regan, J. R., & Baron, J. D. (2014). Early Alert of Academically At-Risk Students : An Open Source Analytics Initiative. Journal of Learning Analytics, 1, 6-47.
- 4. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. Sophisticated predictive models 4 KevLewisﬂickr.com Romero, C., López, M.-I., Luna, J.-M., & Ventura, S. (2013). Predicting students' ﬁnal performance from participation in on-line discussion forums. Computers & Education, 68, 458-472. doi:10.1016/j.compedu.2013.06.009 Classiﬁcation • Divide students in groups • Useful for instructors • Unclear how to intervene
- 5. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. 5 Tanes, Z., Arnold, K. E., King, A. S., & Remnet, M. A. (2011). Using Signals for appropriate feedback: Perceptions and practices. Computers & Education, 57(4), 2414-2422. doi:10.1016/j.compedu.2011.05.016 Course Performance • Well • Mediocre • Poor VitBrunnerFlickr.com
- 6. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. Disproportionate attention 6 FarrukhFlickr.com Intervene Wise, A. F. (2014). Designing pedagogical interventions to support student use of learning analytics. Paper presented at the International Conference on Learning Analytics and Knowledge.
- 7. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. 7 Gather data on the state of the student Identify action to take Deliver feedback McKay, T., Miller, K., & Tritz, J. (2012). What to do with actionable intelligence: E2Coach as an intervention engine. Paper presented at the International Conference on Learning Analytics and Knowledge, Vancouver, BC, Canada. Paulﬂickr.com
- 8. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. Objective 1. Data indicators close to learning design 2. Predictive model 3. Bridge between model and application 4. Straightforward delivery method 8 OliverBraubachﬂickr.com
- 9. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. • Event counts from interactive course material • Midterm/ﬁnal exam scores • Recursive partitioning • Divide cohort into performance categories 9 LouishPixelﬂickr.com
- 10. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. Recursive Partitioning • Arbitrary magnitudes in factors • Handle large number of factors • Handle heterogeneous factos • Model with intuitive interpretation • Performance? 10 theilrﬂickr.com
- 11. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. 11 WilliamMurphyﬂickr.com • 13 Week ﬁrst year Engineering • Weekly activities (formative/summative) • Videos, MCQ, Exercises, dashboard • n = 272, Weeks 2-5 and 7-13
- 12. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. 12 Data collected • Indicators are directly connected with learning design • Data structure shaped by the schedule (weeks) • Data available in a per-week basis • What is the expected midterm/ﬁnal score in week n?
- 13. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. Result Example • Week 10 • Predicted score at leaves (out of 40) • Conditions at nodes • If (EXC.in >=22) and (VID.PL < 8.5) then score = 6 13
- 14. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. • Each leaf node represents a group of students with their estimated score. • Example: 6, 8.3, 8.4, 9.4, 9.9, 10, 15 (out of 40) • Intervention: suggested work before exam 14 Result interpretation
- 15. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. 15 shabnammayetFlickr.com Performance RMSE: Root mean square error, MAE: Mean absolute error
- 16. Generating Actionable Predictive Models of Academic PerformancePardo, Mirriahi, et al. Conclusions and Future Work Indicators closed to learning design Hierarchical partition Student partition respect to midterm/ﬁnal Acceptable performance Immediate action by instructors 16 HamishIrvineﬂickr.com
- 17. Abelardo Pardo, Negin Mirriahi, Roberto Martínez-Maldonado, Jelena Jovanovic, Shane Dawson, Dragan Gašević KannanBﬂickr.com Generating Actionable Predictive Models of Academic Performance International Conference on Learning Analytics and Knowledge University of Edinburgh 29 April 2016

No public clipboards found for this slide

Be the first to comment