Brookes Pathfinder Evaluation Nlc 2008


Published on

Presentation to Networked Learning conference May 2008

Published in: Economy & Finance, Education
  • Be the first to comment

  • Be the first to like this

Brookes Pathfinder Evaluation Nlc 2008

  1. 1. Exploring Patterns of Student Learning Technology Use Ruslan Ramanau, Rhona Sharpe, Greg Benfield
  2. 2. Technology-rich learning environments An ‘”underworld” of digital communication among learners’ (LEX, Creanor et al 2006) Google and Wikipedia preferred information search & retrieval tools (LXP, Conole et al 2006) “ technologically adept and had integrated ICT into their lives (JISC 2007: 10) ©BBC
  3. 3. Aims and Key Research Question <ul><li>Pathfinder evaluation aimed to explore learner experiences of learning technologies for interpersonal interaction and collaboration at Oxford Brookes </li></ul><ul><li>The two key areas of investigation were: </li></ul><ul><ul><li>student experiences of e-learning as part of their curriculum </li></ul></ul><ul><ul><li>informal social uses of software to support their Universities studies </li></ul></ul><ul><li>Key research question: </li></ul><ul><li>How do students experience social uses of technology in different learning contexts? </li></ul>
  4. 4. Research Design <ul><li>Mixed-methods approach </li></ul><ul><li>Seven interview-based case studies to provide rich data on the nature and the impact of e-learning innovation on learner experiences </li></ul><ul><li>Survey of patterns of online media use and their relation to views on learner choice and independence in studies as well as strategies for self- and context-regulation </li></ul>
  5. 5. Questionnaire Instrument and Sampling <ul><li>Questionnaire in four sections: </li></ul><ul><ul><li>demographic profile of the respondents; </li></ul></ul><ul><ul><li>patterns in accessing online resources and choice in forms of interpersonal contact; </li></ul></ul><ul><ul><li>patterns in online media use; </li></ul></ul><ul><ul><li>views on learner choice, learning community and self-regulation in learning </li></ul></ul><ul><li>Proportional sampling by school affiliation (one of the crucial determinants of learning experience?) </li></ul><ul><li>Approx 1200 survey respondents, representing at least 10% of U/G population of each school, of which </li></ul><ul><li>400 online respondents and 781 paper </li></ul>
  6. 6. Survey Descriptive Statistics <ul><li>Ages 17- 64 years, mean = 21.7 years </li></ul><ul><li>37.3 % male 62.7 % female </li></ul><ul><li>87.8 % UK residents 12.2 % international students </li></ul><ul><li>Employment: approx 40% in paid employment ( just over half 10-30 hours per week) </li></ul><ul><li>46.5 % 1st year, 25.3 % 2nd year, 27.9 % 3rd year </li></ul><ul><li>8.8 % declared a disability </li></ul>
  7. 7. Descriptive Statistics by School 132 11.9 15.5 12.4 72.1 21.7 68 64 Tech 10.7 9.5 12.0 9.3 19.0 9.5 10.7 Est. % of students 162 46.5 47.1 5.7 22.8 162 0 WIE 122 38.5 31.1 30.3 21.7 46 76 SSL 197 12.8 9.2 77.9 26.7 92 105 HSC 216 25.0 39.4 35.6 20.6 134 82 BS 92 39.1 28.3 32.6 22.1 59 33 LS 109 9.3 6.5 84.1 19.8 94 15 BE 150 41.1 21.9 36.3 21.1 125 25 A & H Total 3 rd year% 2 nd year % 1 st year % Age Print Online
  8. 8. Preferences in Forms of Contact
  9. 11. Section C Use of online media 1.4 C24 virtual worlds (2nd life) 1.6 C10 own blog 1.3 C25 social bookmarking 1.8 C11 web site contribution 2.5 C21 share files 1.6 C9 blog posts 1.8 C20 play multiplayer games 1.9 C8 online forums 2.1 C19 play games alone 3.5 C6 Brookes resources 3.5 C18 watch video 3.7 C5 learning resources 3.4 C17 listen audio 3.7 C4 access library online 2.4 C15 upload multimedia 3.8 C2 read learning materials Mean Item Mean Item
  10. 12. Results of Factor Analysis <ul><li>To explore patterns in online use a PCI (principal component analysis) with varimax rotation was employed </li></ul><ul><li>After examining the Scree Plot and eigenvalues a five-factor solution was deemed appropriate: </li></ul><ul><ul><li>multimedia use (items C15, C17, C18 and C21) </li></ul></ul><ul><ul><li>pioneering (C24 and C25) </li></ul></ul><ul><ul><li>contributing (C8, C9 and C10, C11) </li></ul></ul><ul><ul><li>gaming (C19, C20) </li></ul></ul><ul><ul><li>accessing learning resources (C2, C4, C5 and C6) </li></ul></ul>
  11. 13. 2nd order factor analysis <ul><li>A Second-order factor analysis suggested a two-factor solution </li></ul><ul><li>accessing learning resources being the first dimension </li></ul><ul><li>the four other first-order scales (recreational?) the second one </li></ul>
  12. 14. School Differences on Patterns of Use <ul><li>School affiliation was a strong predictor of online media usage (ANOVA tests for all the five factor-based scales were significant at the .001 level) </li></ul>Gaming Pioneering Technology Business Contribution Technology Access Learning Resources Health and Social Care Social Sciences and Law Scored higher than other schools on these factors School
  13. 15. Differences by year of study <ul><li>Year of study did not appear to be a predictor of student scores on the five factor-based scales, except … </li></ul><ul><li>accessing learning resources increased year on year </li></ul>
  14. 16. Age Differences pioneering Access learning resources 25+ years Contributing Multimedia use 20-25 years gaming 17-19 years less likely more likely Age band
  15. 17. Perceptions of learning subscales <ul><li>Section D used 4 subscales </li></ul><ul><li>Learning community (Course Experience Questionnaire (CEQ), Ramsden) </li></ul><ul><li>Student Choice (CEQ) </li></ul><ul><li>Use of peers (Motivation and Self-Regulated Learning (MSLQ), Pintrich) </li></ul><ul><li>Positive perceptions of online learning (Brookes generated) </li></ul>
  16. 18. Correlations with perceptions of learning Multimedia Contributing Accessing learning resources Gaming Use of peers (MSLQ) Multimedia Contributing Accessing learning resources Learning community (CEQ) Positive correlations with online patterns of use (section C factors) Perception of learning (section D subscale)
  17. 19. Conclusions <ul><li>Preferred study environments </li></ul><ul><ul><li>Home (by far), laptop over desktop </li></ul></ul><ul><ul><li>Study centre on campus over pooled computer room </li></ul></ul><ul><li>Distinct patterns of use, that conform with previous and expected findings concerning age and year of study, e.g. dominant ones are multimedia and accessing learning resources </li></ul><ul><li>Predictors of patterns of use: </li></ul><ul><ul><li>perceptions of learning community and use of peers </li></ul></ul><ul><ul><li>school </li></ul></ul><ul><ul><li>year of study </li></ul></ul><ul><ul><li>age </li></ul></ul>
  18. 20. What next? <ul><li>Exploring school differences </li></ul><ul><ul><li>are they discipline or cohort related? </li></ul></ul><ul><ul><li>are they a problem? </li></ul></ul><ul><ul><li>do they change by year of study? </li></ul></ul><ul><li>Further development of the questionnaire </li></ul><ul><ul><li>some ambiguous questions </li></ul></ul><ul><ul><li>did not ask about programme affiliation </li></ul></ul><ul><ul><li>section C item analysis </li></ul></ul>
  19. 21. References <ul><li>Conole, G., De Laat, M., Dillon, T. and Darby, J. (2006, November 2006). &quot;JISC LXP: Student Experiences of Technologies Draft Final Report.&quot; November 2006.[Online] Retrieved 20 Nov, 2006, from . </li></ul><ul><li>Creanor, L., Trinder, K., Gowan, D. and Howells, C. (2006, August 2006). &quot;LEX: The Learner Experience of e-Learning Final Project Report August 2006.&quot; [Online] Retrieved 2 November, 2006, from </li></ul><ul><li>JISC (2007). &quot;Student Expectations Study: Key findings from online research and discussion evenings held in June 2007 for the Joint Information Systems Committee.&quot; [Online] Retrieved 10 September, 2007, from http://www. jisc .ac. uk/media/documents/publications/studentexpectations . pdf </li></ul>