PSOL BasicsThere are 72 questions that comprise the PSOL.Average completion time is 15 minutes.26 Priorities statements (can add 10)7 Information sources about school/program11 Factors to enroll in the program3 Overall satisfaction questions14 Demographics questions (can add 1)NOTE: questions are answered on a 7-point Likert scale, where 7 is high. 9
Sources of Information5.97 - College website5.82 - Online college catalog5.24 - Instructor/advisor recommendation4.95 - Printed catalog & brochures4.90 - Contact w/current students or grads4.52 - College representatives3.74 - Advertisements
Factors to Enroll6.60 - Convenience6.45 – Work schedule6.39 – Flex pacing 4 program completion6.19 – Program requirements6.11 - Cost6.06 – Future Employment Opportunities6.03 – Ability to transfer credits
Sample PSOL Statement 1. This institution has a good reputationImportance Satisfaction1. Not important at all 1. Not satisfied at all2. Not very important 2. Not very satisfied3. Somewhat unimportant 3. Somewhat dissatisfied4. Neutral 4. Neutral5. Somewhat important 5. Somewhat satisfied6. Important 6. Satisfied7. Very important 7. Very satisfied N/A does not apply N/A = not available/used
Examples of Useful Reports• Student satisfaction breakdown by online program area• Primarily online vs. Primarily on-campus• Previous online enrollment• Age breakdown: 24 & under vs. 25 & up• Comparison to MnOnline consortium• Comparison to Peer Group of Schools
Strengths/Challenges• Noel-Levitz identifies strengths and challenges based on your data.• I call these “Internal” strengths and challenges. They might not be a strength or a challenge when compared to others.
Matrix for Prioritizing Action Very Important 18 11 32 ? Very VeryDissatisfied Satisfied ? ? Very Unimportant 22
Matrix for Prioritizing Action #2 Very Important 29 18 25 6 11 32 20 12 4Somewhat 10 Very Satisfied Satisfied 1 30 8 Somewhat Important 25
Changes from FY04 to FY05• Satisfaction with Bookstore Service increased by 0.44 from 5.28 to 5.72 – Created an online bookstore between surveys.• Satisfaction with billing and payments increased by 0.28 from 5.74 to 6.02 – Online bill payment is now available to all students.• Satisfaction with institutional response to info requests increased by 0.21 from 5.46 to 5.67 – Virtual Campus Center opened during the year. 26
NOTE: SSI is the Noel-Levitz Survey for on-ground learners, PSOL is the Noel- 27Levitz survey for online learners.
NOTE: SSI is the Noel-Levitz Survey for on-ground learners, PSOL is the Noel- 28Levitz survey for online learners.
Peer Group Comparison• Better than National data• Better than MnOnline consortium data• We picked 10-13 schools with similar missions and circumstances• Noel-Levitz ran special reports for us• 2006 (13 schools) and 2008 (10 schools) and 2009 (11 schools)
Largest Differences - Peer Group FY06 Primarily Online Students - PSOL 7.00 6.50 6.00 5.50 5.00 4.50 4.00 14. Info about 24. Tutoring 18. Convenient 20. Quality of 13. Faculty financial aid available registration instruction interactions LSC Peer Group 30
Added Questions• 10 spots for additional statements• MnSCU uses 5 spots for MnOnline questions, including reliability of D2L• LSC uses 5 spots to ask about things of importance. In 2009 we hit a sweet spot with student importance.
5 Added Items for LSC in 2009FY09 Noel-Levitz PSOL (Priorities Survey for Online Learners) LSC Students Item - Importance high to low Import. Satisf. Gap 32. Layout of courses, as designed by instructors, is easy to navigate and understand. 6.60 5.83 0.77 33. Instructions to students on how to meet the course learning objectives are adequate and clearly written. 6.58 5.90 0.68 20. The quality of online instruction is excellent. 6.56 5.68 0.88 28. The online course delivery platform (Desire2Learn or D2L) is reliable. 6.56 6.04 0.52 34. Grading policies are easy to locate and understand in courses. 6.56 6.09 0.47 06. Tuition paid is a worthwhile investment. 6.55 5.77 0.78 18. Registration for online courses is convenient. 6.55 6.36 0.19 36. Clear standards are set in courses for instructor availability and response time. 6.55 5.99 0.56 31. Taking an online course allowed me to stay on track with my educational goals. 6.54 6.18 0.36 35. Instructional materials have sufficient depth in content to learn the subject. 6.54 5.91 0.63
What’s Missing?• Student uses of technology• Computer skills assessment• Student success rates• Comparison between online and on-ground students (using same survey)
Student Uses of e-Services Online Library Services1 Never used it; didnt know about it. 25.30%2 Never used it; but was aware of it. 33.70%3 Have used it a little; will use again. 25.70%4 2.80% Have used it a little; won’t use it again.5 5.70% Have used it a lot; planning to continue the same.6 0.56% Have used it a lot; planning to reduce usage.0.00% 10.00% 20.00% 30.00% 40.00%
Student Uses of e-Services Online Career Services1 Never used it; didnt know about it. 49.40%2 Never used it; but was aware of it. 32.30%3 7.30% Have used it a little; will use it again.4 1.60% Have used it a little; won’t use it again.5 1.90% Have used it a lot; planning to continue the same.6 0.30% Have used it a lot; planning to reduce usage.0.00% 10.00% 20.00% 30.00% 40.00% 50.00%
Excellence in e-Education Survey Creation• Create a Student Technology Survey that: – measures importance of, satisfaction with, and usage of online college services. – is applicable both on-campus and online. – measures uses of technology and computer literacy. – compares survey results with student success factors.
Discussion TimeMeasuring Student Satisfaction with Online Learning