Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Assessment & Analytics Using Data to Inform & Improve  Student Success Strategy
Introductions
Initial Data Review Findings Fall 2005 85% of online students were completing courses. 77% of students who completed, pass...
Initial Data Review Findings <ul><li>Challenge identified in 2005: </li></ul><ul><li>77% of  at-risk  students completed c...
<ul><li>By 2007: </li></ul><ul><li>82% of at-risk students completed </li></ul><ul><li>5% Improvement </li></ul><ul><li>66...
What is your organization doing today to identify online students at-risk of withdrawing from or  not successfully complet...
<ul><li>Identify at-risk students early. </li></ul><ul><li>“ The effectiveness of early (identification) is that it’s earl...
What is At-Risk? Before Course Start <ul><li>First-time online student  </li></ul><ul><li>Returning to school after 5+ yea...
What is At-Risk? After Course Start <ul><li>Student enrolls after course start </li></ul><ul><li>Grade-to-date is below a ...
Week 1 Days Logged In : Completed vs. Dropped Student Completed Avg. = 3.1 Dropped Avg. = 1.7 Avg. Days Logged In/Section ...
Week 1 Activity: Completed vs. Dropped Student Completed Avg. = 3.1 Dropped Avg. = 1.3 Avg. Student Activity/Section by De...
Action Taken <ul><li>Hire Student Services Manager </li></ul><ul><li>Leverage LMS Data Warehouse </li></ul><ul><li>Identif...
Intervention Strategy <ul><li>Personalized, Automated Welcome Email </li></ul><ul><li>Semi-Automated Intervention Emails <...
Progress Report Provided to College Advisors Weekly First Name Course Last Login Date Activity Minutes Activity Submission...
Instructor Report Conveniently Located Within Course
Instructor Report Provided to Advisors Student  Name Instructor Name Reason for  At Risk Other Explanations At Risk Date H...
Results <ul><li>Course success rate for at-risk students increased 9% over 2-year period. </li></ul>
Intermission You Can Do This Questions?
<ul><li>In 2010: </li></ul><ul><li>84% of at-risk students completed their courses </li></ul><ul><li>Additional 2% improve...
Now What? Completion Rates vs. Enrollments Avg. Section Completion Rate = 77% Department Term Start Enrollments I II III I...
What Now? <ul><li>Further improve  Success  in English Composition and Math. </li></ul><ul><li>Enhance At-Risk  Case Manag...
Faculty Dashboard
Faculty Dashboard
Student Dashboard
Enrollments (at course end)  12 Withdrawals 7 Course Average Grade  55%  Noticeable Trends: Top scoring students show stro...
Enrollments (at course end)  17 Withdrawals 4 Course Average Grade   83%  Noticeable Trends: Multiple directional edges to...
Conclusion You can do this too. Questions?
Contacts Steve Rheinschmidt, Director ICCOC [email_address] Steve Ast, Senior Account Exec. eCollege [email_address]
Upcoming SlideShare
Loading in …5
×

2011Using Data Analytics

333 views

Published on

  • Be the first to comment

  • Be the first to like this

2011Using Data Analytics

  1. 1. Assessment & Analytics Using Data to Inform & Improve Student Success Strategy
  2. 2. Introductions
  3. 3. Initial Data Review Findings Fall 2005 85% of online students were completing courses. 77% of students who completed, passed course with grade of C or better. Is this good enough? What questions should we ask?
  4. 4. Initial Data Review Findings <ul><li>Challenge identified in 2005: </li></ul><ul><li>77% of at-risk students completed courses </li></ul><ul><li>57% of at-risk students earned C or better </li></ul><ul><li>At-risk included: </li></ul><ul><ul><li>New to online (40%) </li></ul></ul><ul><ul><li>Returning to school after 5 years (35%) </li></ul></ul><ul><ul><li>Low High School GPA (15%) </li></ul></ul><ul><li>Desire to increase Student Success </li></ul>
  5. 5. <ul><li>By 2007: </li></ul><ul><li>82% of at-risk students completed </li></ul><ul><li>5% Improvement </li></ul><ul><li>66% of at-risk students earned C or better </li></ul><ul><li>9% Improvement </li></ul>Program Improvement Iowa Results
  6. 6. What is your organization doing today to identify online students at-risk of withdrawing from or not successfully completing a course? Introduction
  7. 7. <ul><li>Identify at-risk students early. </li></ul><ul><li>“ The effectiveness of early (identification) is that it’s early” - Vincent Tinto, NISOD 2011 </li></ul><ul><li>Intervene and support students in need. </li></ul><ul><li>Increase at-risk student success rate. </li></ul>Goal in 2005 Improve At-Risk Student Success
  8. 8. What is At-Risk? Before Course Start <ul><li>First-time online student </li></ul><ul><li>Returning to school after 5+ years </li></ul><ul><li>Registered for three or more online classes simultaneously </li></ul><ul><li>Failed an online course the previous 2 years </li></ul>
  9. 9. What is At-Risk? After Course Start <ul><li>Student enrolls after course start </li></ul><ul><li>Grade-to-date is below a ‘C’ </li></ul><ul><li>Stops attending for 5 consecutive days </li></ul><ul><li>Logs-in fewer than 3 times per week </li></ul><ul><li>Activity less than 3 hours per week. </li></ul>
  10. 10. Week 1 Days Logged In : Completed vs. Dropped Student Completed Avg. = 3.1 Dropped Avg. = 1.7 Avg. Days Logged In/Section by Department Completed Student at Add/Drop Dropped Student at Add/Drop
  11. 11. Week 1 Activity: Completed vs. Dropped Student Completed Avg. = 3.1 Dropped Avg. = 1.3 Avg. Student Activity/Section by Department (hrs) Completed Student at Add/Drop Dropped Student at Add/Drop
  12. 12. Action Taken <ul><li>Hire Student Services Manager </li></ul><ul><li>Leverage LMS Data Warehouse </li></ul><ul><li>Identify / Track At-Risk Students </li></ul><ul><li>Provide Manual Intervention </li></ul>
  13. 13. Intervention Strategy <ul><li>Personalized, Automated Welcome Email </li></ul><ul><li>Semi-Automated Intervention Emails </li></ul><ul><li>Weekly Activity/Progress Reports </li></ul><ul><li>Instructor Reporting </li></ul><ul><li>Sharing of Better Practices </li></ul>
  14. 14. Progress Report Provided to College Advisors Weekly First Name Course Last Login Date Activity Minutes Activity Submission Count Course Points Earned Course Points Possible to Date Course Average Grade To Date Rocky 4/28/11 722 11 133 470 28.30% Melissa 5/8/11 3,053 35 479 530 90.38% Megan 5/5/11 2,981 30 557 556 100.18% Anneliese 5/7/11 5,633 66 509 585 87.01% Bradley 5/8/11 2,613 57 508 820 70.37% Alyssa 5/8/11 3,290 116 625 680 91.91% Lynsey 5/8/11 2,536 72 860 1,000 88.02% Jeremy 5/8/11 1,209 37 62 190 32.63% Angelica 5/7/11 731 24 789 900 87.67% Carrie 4/5/11 103 2 31 145 21.38%
  15. 15. Instructor Report Conveniently Located Within Course
  16. 16. Instructor Report Provided to Advisors Student Name Instructor Name Reason for At Risk Other Explanations At Risk Date Heather Lori Other Did not complete Unit 1. I did get an e-mail doesn't understand how class works, needs some help. 1/23/2011 Ann Steve Not completing assignments missed first quiz and first lab assignment 1/26/2011 Courtney Rose Other Did not participate in Week 1. 1/26/2011 Donna Mark Stopped Participating She participated through week 6, has since dropped off the map and I have not received any work from her. She’s not responded to e-mail. 3/16/2011
  17. 17. Results <ul><li>Course success rate for at-risk students increased 9% over 2-year period. </li></ul>
  18. 18. Intermission You Can Do This Questions?
  19. 19. <ul><li>In 2010: </li></ul><ul><li>84% of at-risk students completed their courses </li></ul><ul><li>Additional 2% improvement in 3 years </li></ul><ul><li>68% of successful at-risk students completed courses with a C or higher </li></ul><ul><li>Additional 2% improvement in 3 years </li></ul>Now What? Results Today
  20. 20. Now What? Completion Rates vs. Enrollments Avg. Section Completion Rate = 77% Department Term Start Enrollments I II III IV Median Dept Enrollments = 767 Department Completion Rates – Term Start to Term End English Mathematics
  21. 21. What Now? <ul><li>Further improve Success in English Composition and Math. </li></ul><ul><li>Enhance At-Risk Case Management </li></ul><ul><li>Provide simple, visual Dashboard for instructors </li></ul><ul><li>Publish Methodology </li></ul>
  22. 22. Faculty Dashboard
  23. 23. Faculty Dashboard
  24. 24. Student Dashboard
  25. 25. Enrollments (at course end) 12 Withdrawals 7 Course Average Grade 55% Noticeable Trends: Top scoring students show strong edges to professor in both directions. Secondary networks forming between multiple high performing students Questions to Research (Predictive) 1. Do networks between students relate to successful completion? 2. How does professor interaction with at risk or low performing students impact student success? MAT100 – Section A Thread Interaction
  26. 26. Enrollments (at course end) 17 Withdrawals 4 Course Average Grade 83% Noticeable Trends: Multiple directional edges to and from the professor node. Multiple secondary networks forming. Lamsen is a curiosity – no target interaction to that node, yet multiple source edges Joshua not part of the forming subnetworks Question to Research (Predictive) How important is multi node, multi directional interaction to course success? MAT100 – Section B Thread Interaction
  27. 27. Conclusion You can do this too. Questions?
  28. 28. Contacts Steve Rheinschmidt, Director ICCOC [email_address] Steve Ast, Senior Account Exec. eCollege [email_address]

×