Presentation by Ross McMillan based on a survey of senior leadership in Division of Students at York University. Along with findings, survey points to future direc

1. VPS Assessment
Snapshot of Aptitude, Attitude and Future
Direction
March 15, 2012 – Divisional Directors Meeting
1

2. Self Assessment is Key
2

3. Overview
• Purpose was to have an outline of current assessment
activities as well as help determine barriers and
priorities
• Survey of senior leadership in Division of Students
• 26 respondents
3

4. Support for Assessment and Data
50.00%
45.00%
40.00%
35.00%
Assessment is supported within
30.00% the Division
25.00% Department regularly uses data
for planning and decision-
20.00% making
15.00% Division uses data for planning
and decision making
10.00%
5.00%
0.00%
Strongly Agree Somewhat Neither Agree Somewhat Strongly
Agree Nor Disagree Disagree Disagree
4

5. Please rate the quality of your own
assessment work
60.00%
50.00%
40.00%
30.00%
20.00%
10.00%
0.00%
Excellent Good Average Below Average Poor
5

6. Please Rate Your Level of
Proficiency - Conducting
70.00%
60.00%
50.00%
Q8- Creating Survey
40.00% Questions
Q9- Conducting focus
30.00%
groups
20.00% Q10 - Conducting statistical
analyses
10.00%
Q14 - Writing learning
outcomes
0.00%
Extremely Very Moderately Slightly Not at all
6

7. Please Rate Your Level of
Proficiency - Using
45.00%
40.00%
35.00%
30.00%
25.00% Q11 - Interpreting results
20.00%
Q12 - Explaining results
15.00%
10.00%
Q13 - Using results to improve
5.00% programs and services
0.00%
Extremely Very Moderately Slightly Not at all
7

8. Please Rate Your Level of Proficiency –
StudentVoice Assessment Tools & Resources
45.00%
40.00%
35.00%
30.00%
25.00%
20.00%
15.00%
10.00%
5.00%
0.00%
Extremely Very Moderately Slightly Not at all
8

9. Top 5 Barriers or Challenges
Self (Directors) Department Staff
1 Limited Time Limited Staff
2 Limited Staff Limited Time
3 Limited Financial Resources Limited Assessment Expertise
4 Limited Assessment Expertise Limited Financial Resources
5 Not knowing what types of data Not knowing what types of data to
to collect collect
9

10. Training Priorities
• Benchmarking
• Basic Assessment Overview
• Choosing Appropriate Methods for Data Collection
• Developing learning outcomes and objectives
• Effective Reporting
• Survey Design and Implementation
10

11. Survey Conclusions
• Overall, respondents believe assessment activity is
valued as as a department and division
• Moderate ability to conduct assessment activities
• Stronger ability to understand and interpret data for
decision making
• Big gap in knowledge and use of Student Voice
• Barriers are similar amongst directors and staff
• Training, comfort and staff resources are key
11

12. Next Steps – Future Direction
1. Support
• Met with most Directors on possible top tier projects
• Model of direct assistance versus passive persuasion
• Assessment project template complete
• Alignment of assessment projects to IRP and White
Paper priorities
2. Training
• Dedicated Webinars with Vennessa from Campus Labs
focused on on Baseline 101 and Benchmarking
• Additional dedicated webinars on identified
12 areas of need

13. Next Steps – Future Direction
3. Communications
• VPS Assessment website in development
• Sharing of assessment projects at Divisional Directors
meetings
• Monthly Brown Bag series showcasing assessment
work that is being done in Division (special invite based
on content)
• You Said It, We Did It, We’re Listening campaign
4. Learning Outcomes
• Process to identify, develop &map outcomes
13