Sp131010

588 views
484 views

Published on

Practically and productively analysing Course Experience Questionnaire student comment data
Stuart Palmer and Malcolm Campbell
Revised version
Faculty of Science, Engineering and Built Environment Deakin University

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
588
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Sp131010

  1. 1. PRACTICALLY AND PRODUCTIVELY ANALYSING COURSE EXPERIENCE QUESTIONNAIRE STUDENT COMMENT DATA Stuart Palmer and Malcolm Campbell Faculty of Science, Engineering and Built Environment Deakin University Deakin University CRICOS Provider Code: 00113B
  2. 2. Accessing the Student Voice - Scott Survey text data is often under-utilised Large-scale investigation of CEQ comments 160k+ CEQ comments from 2001-2004 Common themes identified CEQuery software developed to automate the analysis of CEQ comment data Five factor structure proposed… Deakin University CRICOS Provider Code: 00113B
  3. 3. CEQuery domains and sub-domains 1. Outcomes 2. Staff 3. Course design 4. Assessment 5. Support Intellectual Teaching skills Practical-theory links Relevance Library Work application/ career Accessibility and responsiveness Methods of learning & teaching Marking Learning resources Further learning Quality and attitude Flexibility/responsiveness Expectations Infrastructure/ environment Personal Practical experience (current) Relevance (to work/life/discipline) Feedback/return Student administration Structure and expectations Standards Student services Interpersonal Knowledge/skills Deakin University CRICOS Provider Code: 00113B Social affinity/support
  4. 4. Project aims 1. To validate the 2012 annual Faculty CEQ comment data set against the five domain model proposed previously by Scott (2006) 2. Identify how to best use this data, in practice, at the individual-Program-level as part of the wider use of SET data for the improvement of teaching and learning Deakin University CRICOS Provider Code: 00113B
  5. 5. Ranked overall comment hit counts by Faculty Program Needs Improvement Overall comment count 160 Best Aspects 140 120 100 80 60 40 20 0 Ranked order (by overall comment count) of all 55 Faculty programs Deakin University CRICOS Provider Code: 00113B
  6. 6. Overall BA and NI comment hit count proportions 50% This investigation 47.3% As found by Scott 2006 39.1% 40% 26.3% 30% 21.8% 18.1% 20% 14.5% 11.9% 12.6% 10% 2.6% 4.0% 1.4% 0.4% 0% Course design Staff Outcomes This investigation 50% 40% 40.8% Support Assessment Other Everything As found by Scott 2006 43.2% 30% 24.9% 24.3% 20% 14.4% 16.5% 10% 8.9% 9.5% 6.0% 6.5% 3.5% 0% Course design Deakin University CRICOS Provider Code: 00113B Staff Support Assessment Outcomes None 1.5% Other
  7. 7. Overall BA comment hit count proportions by School and Gender School A School B School C School D 50% 40% 30% 20% 10% 0% Course design Staff Outcomes Support Female 50% Assessment Other Everything Other Everything Male 40% 30% 20% 10% 0% Course design Deakin University CRICOS Provider Code: 00113B Staff Outcomes Support Assessment
  8. 8. When Program comments are few… Where separately reported Programs have a significant degree of commonality, the comment data for those programs could be consolidated to form a larger pool Where the number of CEQ responses is low, data from more than one year can be pooled to form a more useful data set Deakin University CRICOS Provider Code: 00113B
  9. 9. When Program comments are few… At the School- or Program-level, it is feasible to simply pass on the ‘raw’ CEQ comments directly to the relevant program leadership for consideration… …in conjunction with other SET data, surveys of graduates and employers, benchmarking, advice from accreditation bodies, student focus groups, etc. Deakin University CRICOS Provider Code: 00113B
  10. 10. Conclusions – We found… …support for Scott’s 5 factor structure …manual coding of comments against the 5 factor model is feasible, and achieves a superior coding rate compared to CEQuery …large number of Course Design comments, both BA and NI, related to practical aspects of a Program Deakin University CRICOS Provider Code: 00113B
  11. 11. Thank you for your time ow.ly/qlhzo Deakin University CRICOS Provider Code: 00113B

×