Blue Canary was a higher education data and analytics company based in Phoenix, Arizona USA, acquired by Blackboard Inc in December of 2015. We worked with a university to help predict at-risk students in their undergraduate degree programs. Our model predicted attendance in a given week since we knew that missing a week of class was a proxy for attrition. The models were trained and selected using standard efficacy measures (precision, recall, F1 score). After using the models in production for 6 months, we saw that those metrics for actual data were fairly true to the training metrics. This validated the development of our predictive models.
This presentation was part of the Practitioner Track at LAK16 delivered April 28. 2016