Sakai Student Survey Result 2008 & 2010, Claremont Consortium
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share

Sakai Student Survey Result 2008 & 2010, Claremont Consortium

  • 2,022 views
Uploaded on

The Claremont Consortium administers a biennial survey to the approximately 5,000 Sakai-using undergraduate and graduate students in its member institutions [Claremont McKenna College, Claremont......

The Claremont Consortium administers a biennial survey to the approximately 5,000 Sakai-using undergraduate and graduate students in its member institutions [Claremont McKenna College, Claremont Graduate University, Harvey Mudd College, Keck Graduate Institute, Pitzer College, Pomona College and Scripps College]. The presentation summarizes findings from the 2008 and 2010 surveys. We identify changes in student use of Sakai; student assessment of the benefits and drawbacks of courses that use Sakai; which tools students find most useful in their courses as well as tool usage patterns, and student suggestions to improve Sakai and the ways that it is used in their classes.

Presented at the 2010 Sakai Conference (Denver, CO) on June 17, 2010. (Presentation slightly updated for online viewing.)

More in: Education
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
2,022
On Slideshare
1,412
From Embeds
610
Number of Embeds
4

Actions

Shares
Downloads
3
Comments
0
Likes
0

Embeds 610

http://doctorgeek.net 479
http://www.doctorgeek.net 123
http://pages.scrippscollege.edu 7
http://3akai.sakaiproject.org 1

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Good afternoon, I’m Mary McMahon from Pomona College and this is Susan Kullmann from Scripps College. Thank you for choosing to spend this time at our presentation in the last period of this conference. Susan Kullman and I will be discussing results of Sakai satisfaction surveys administered in 2008 and again in 2010 to students in the Claremont Consortium. We’ll be comparing and contrasting the results of those surveys administered two years apart. In doing so, we’re reporting on contributions made by many people, some of whom are in the room . . . --next slide
  • You’re met some of these folks in the last few days. We’ll try to represent our students’ views the many who are not here. 1 st a few words about the Claremont Consortium Next->
  • We are 5 residential liberal arts colleges plus 2 grad institutions about 30 miles east of Los Angeles. There are 7 of us here at the conference from those schools. In total, the student population is about 6,300 from all 7 schools. We administered the student survey in spring 2008 and again on 2010. The intervening years we administration Faculty Satisfaction surveys. For both faculty and student cycles, we use the standard questions from the Multi Institutional Survey Initiative (MISI) survey managed by University of Michigan. Here’s our responses by college->
  • 2008 = 865 (~14%) 2010 = 1128 (~18%) HMC had a contest for entrants PO 257 250 HMC 234 307 CMC 102 153 PZ 20 82 SCR 114 172 CGU 65 138 KGI 0 27 2008 TOTAL 865 14% 2010 TOTAL 1130 18%
  • We asked which browser they use— Other included largely Chrome plus a few who indicated they used multiple browsers.
  • How they rated their own proficiency –
  • HMC students generally more perceived as moretechnical
  • Sakai was never difficult for most students to use.
  • Survey Question: Which Sakai tools do you use? 2008 – Other tools mentioned by less than 25% (and more than 10%) of respondents: Schedule/Calendar (13%). 2010 – Other tools mentioned by less than 25% (and more than 10%) of respondents: Schedule/Calendar (18%), Forums (16%), Messages (16%). Implications: More faculty are using Sakai. Newer faculty users are probably using fewer tools than early adaptors.
  • Questions: Which of the following Sakai tools do you find most useful in your courses. For both years, all other tools were selected by less than 10% of respondents.
  • Question: Please rate your overall experience with Sakai. Positive (Excellent + Good) 2008 = 62% 2010 = 76%
  • Question: I prefer courses that use Sakai to organize course materials and communications.
  • Students are more familiar with Sakai because of more individual usage and more classes using Sakai More classes use Sakai - All courses automatically have Sakai course sites populated with students and faculty; rosters updated regularly during add/drop period - More faculty USE in 2010 because of greater Sakai experience (administrative uses), training workshops, exposure to peer usage, etc.
  • Open-ended question: If you could change one feature in Sakai, what would it be? Why?
  • These are issues mentioned in a questions about the drawbacks of courses that use Sakai. Faculty preferences &/or training: inconsistent use, failure to use email notification, resource naming conventions, syllabus Sakai software: no search feature, back button Network: Email from Sakai goes to spam: 7 email servers interact with Sakai. Problem when students forward to/from gMail accounts
  • Open-ended question: What are the benefits of courses that use Sakai?
  • These are some of our favorite student comments Sakai URL = sakai.claremont.edu which redirects to a longer URL This is summary data from 7 institutions (undergraduate & graduate) All are small private institutions so there are no fully online classes, some hybrids at the graduate school 2008 survey was taken one year after Sakai adoption 2010 data is encouraging and provides us with areas to focus our energy and resources re: usability and training

Transcript

  • 1. Sakai: The Student Perspective Claremont Colleges Consortium Claremont, CA
  • 2. Student Perspective Presenters & Contributors
    • Mary McMahon, Pomona College
    • Susan Kullmann, Scripps College
    • Elizabeth Hodas, Harvey Mudd College
    • Susan Roig, Claremont Graduate Univ.
    • Ben Royas, Claremont McKenna College
    • Jez Dene, Honnold Mudd Libraries
    • . . . & many Claremont Colleges students
  • 3. Claremont Colleges Consortium
    • 7 institutions
      • Claremont McKenna, Harvey Mudd, Pitzer, Pomona and Scripps Colleges
      • Claremont Graduate University and Keck Graduate Institute
    • ~ 6,300 students in the Consortium 09-10
    • Total Student survey respondents 2008 = 865 2010 = 1128
  • 4. Sakai Student Respondents By College
  • 5. Students’ Browser Preferences
  • 6. Sakai Students’ Self-Identified Computer Proficiency
  • 7. Sakai Student Users
    • The definitions of levels of proficiency varies widely from college to college
        • Wider range of browsers suggests different usage habits
    • Macintosh users increased 9% in 2 years
    • Students across the consortium have various levels of exposure to Sakai
  • 8. Sakai Implementation How many of students’ classes use Sakai? 2008 2010
  • 9. Sakai Implementation How often do students visit Sakai?
  • 10. Sakai Use 2008  2010
    • Students use Sakai for more courses
    • Students access Sakai course sites more frequently
    • Benefits of centralization/convenience reported as much greater
    • Overall students are significantly more positive about their use of Sakai
  • 11. Overall Experience How easy is Sakai to use? 2008 2010 14% 72% 9% 2% 4% 18% 73% 7% 0 1% 72% 73% T=857 students T=1124 students
  • 12. Which tools do students use?*
    • 2008 (809 students)
    • Resources
    • Assignments
    • Syllabus
    • Announcements
    • Dropbox
    • Discussion + Forums
    • Gradebook
    • 2010 (1101 students)
    • Resources
    • Announcements
    • Dropbox
    • Assignments
    • Syllabus
    • Gradebook
    83% 64% 53% 49% 33% 25% 24% 87% 58% 57% 40% 39% 37% *Tools with >25% use
  • 13. Which tools do students find most useful in their courses?*
    • 2008 (780 students)
    • Resources
    • Assignments
    • Syllabus
    • Announcements
    • Gradebook
    • Dropbox
    • Schedule
    • 2010 ( 1101 students)
    • Resources
    • Assignments
    • Announcements
    • Syllabus
    • Dropbox
    • Gradebook
    76% 45% 33% 32% 19% 18% 12% 87% 40% 39% 34% 31% 27% *Tools >10% found useful
  • 14. Overall Experience 2008 2010 2008 9% 53% 25% 7% 5% 2010 15% 61% 20% 3% 1%
  • 15. Overall Experience: Do students prefer courses that use Sakai? 2008 2010 2008 9% 54% 19% 8% 10% 2010 23% 57% 13% 3% 5%
  • 16. Overall Experience 2008 - 2010
    • Students rate Sakai more positively (62%  76%)
    • Fewer students strongly dislike Sakai (7%  3%)
    • More students strongly favor courses that use Sakai (63%  80%)
    • Fewer students feel entirely unfamiliar with Sakai (10%  5%)
  • 17. Feedback - Feature to Change
    • 2008 (403)
    • Navigation (57)
      • Interface (38)
    • None (56)
    • Resource/Dropbox (33)
    • Login (28)
    • Customize tabs (19)
    • Discussion tool (14)
    • 2010 (500)
    • Customize tabs (68)
    • None (59)
    • Remove unused tools (52)
    • Navigation (47)
      • Interface (36)
    • Login (32)
    • Resource/Dropbox (27)
  • 18. Feedback – Features to change
    • In 2008 and 2010, “None” or “No changes” ranked in the top five choices
    • Other significant results included comments about “faculty ease of use,” “inconsistent use of tools,” and “faculty training”
    • Some changes require student training – i.e. (automatic) login
  • 19. Feedback - Drawbacks
    • 2008
    • Glitches, technical difficulties
    • Dependence on computer access
    • Confusing
    • Faculty training
    • Need to update & check frequently
    • Need to print, prefer printed copies
    • Underutilized
    • Impersonal
    • 2010 (627 students)
    • Faculty ease of use (97)
    • Inconsistent use, unused tools (85)
    • Not user friendly (53)
    • Technical difficulties (47)
    • Prefer printed handouts (44)
    • Communication (36)
    • Not checked or updated enough (28)
    • Slow downloads (21)
  • 20. Feedback Specific technical issues
    • Inconsistent use
    • No search feature
    • Failure to use email notification
    • Back button
    • Email from Sakai goes to spam
    • Naming conventions for resources
    • Syllabus should be required
  • 21. Feedback: Benefits
    • 2008
    • 24/7 access
    • Communication between colleges
    • Archive, back-up of resources
    • One-stop, centralization
    • Submit assignments
    • Convenience
    • 2010
    • Easy access to course materials
    • Convenience
    • Better organization
      • - Standardization
    • Better communication
    • Saves paper
    • Gradebook
    • Cost Effective
  • 22. Drawbacks: students comments
    • Sakai gives a lot of homework.
    • Announcements are just annoying ways to send email.
    • Doesn’t include those who aren’t officially registered.
    • [Prof. X] knows that I was doing his homework at 5 o’clock in the morning when it was due.
    • I would like it to be blue. Sakai would be prettier if it were completely blue.
    • The Claremont Colleges Sakai url is really difficult to remember.
    • Oh man, it's so ugly. I would make it nicer-looking.
    • Some professors just aren’t that good with computers.
  • 23. Questions?
    • Susan Kullmann susan.kullmann@scrippscollege.edu
    • Mary McMahon [email_address]