SMSQ&ACourse Evaluations<br />Stephen Marquard<br />stephen.marquard@uct.ac.zahttp://twitter.com/stephenmarquard<br />Cent...
3 Sakai contrib tools<br />	SMSMobile messaging from Sakai<br />Q&AQuestions and Answers<br />	Course EvaluationsOnline co...
SMS<br />11th Sakai Conference - June 15-17, 2010<br />3<br />Wth Sakai U 2 can snd txt msgs to grps of ppl! W00t!<br />
SMS Overview<br />	What is it?<br />	SMS provides mobile text messaging in Sakai, including a tool for sending messages, a...
Outgoing SMS<br />11th Sakai Conference - June 15-17, 2010<br />5<br />In the SMS Messages tool,<br />Write message (with ...
Incoming SMS Examples<br />11th Sakai Conference - June 15-17, 2010<br />6<br />Placement offers: “UCT Health Sciences off...
Incoming SMS<br />Any tool/service can accept incoming articles by registering a command prefix with the SMS service.<br /...
Deployment considerations<br />	Service provider<br />	You need a service provider with an SMPP gateway (e.g. http://www.c...
SMS: Privacy<br />	Our approach at UCT (Vula = our Sakai):<br />	Student, staff and third party cell numbers in Vula come ...
Q&A<br />11th Sakai Conference - June 15-17, 2010<br />10<br />
Q&A Overview<br />	What is it?<br />	A tool which supports question-driven interaction (optionally anonymous) with web, em...
Why questions?<br />Many students ask the same question<br />Students will ask a question online which they wouldn’t or co...
Supported workflows<br />Instructor-led: Student asks question > instructor responds privately (by email), and/or publicly...
Tool demo<br />Set up tool “personality” and workflow through Options and Permissions<br />View, ask and respond to questi...
View questions and ask a new one<br />
Viewing responses<br />
Respond to a question (instructor)<br />
Add an answer (student)<br />
Organise questions<br />
SMS support<br />Q&A is minimally SMS-enabled<br />Supports asking questions by SMS, receiving answers and/or retrieving a...
Course Evaluation<br />11th Sakai Conference - June 15-17, 2010<br />22<br />
Course Evaluation Overview<br />	What is it?<br />	A tool for delivering course evaluations or surveys.<br />	Where do I f...
Caveats<br />How you might implement this depends heavily on institutional processes and policy.<br />Evaluation System is...
Generic issues and concerns<br />Response rates may be lower (dependent on lecturer involvement and feedback)<br />… but s...
UCT self-service model<br />Site Owners or Support Staff can create and assign evaluations to one or more of their Vula si...
The questions
Start and end dates
How to encourage students to respond
What to do with the results</li></ul>(subject to Department or Faculty processes or guidelines)<br />
UCT possible teaching models<br />One or more lecturers (aka instructors)<br /><ul><li>Every student evaluates all lecture...
Students are taught in cohorts: each student chooses his/her lecturer to evaluate</li></ul>Tutors (aka TAs)<br /><ul><li>T...
Every student evaluates all tutors individually
Each student belongs to one or more tutor groups, and therefore chooses one or more tutors to evaluate</li></li></ul><li>U...
UCT evaluation structure<br />        About the course<br />        About you<br />        (About all lectures/tutors)<br ...
Upcoming SlideShare
Loading in …5
×

SMS, Q&A and Course Evaluations in Sakai

1,553 views

Published on

Overview of the SMS, Q&A and Course Evaluation contrib tools in Sakai

Published in: Education, Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,553
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

SMS, Q&A and Course Evaluations in Sakai

  1. 1. SMSQ&ACourse Evaluations<br />Stephen Marquard<br />stephen.marquard@uct.ac.zahttp://twitter.com/stephenmarquard<br />Centre for Educational Technology, University of Cape Town<br />June 2010<br />
  2. 2. 3 Sakai contrib tools<br /> SMSMobile messaging from Sakai<br />Q&AQuestions and Answers<br /> Course EvaluationsOnline course evaluations and surveys<br />2<br />11th Sakai Conference - June 15-17, 2010<br />
  3. 3. SMS<br />11th Sakai Conference - June 15-17, 2010<br />3<br />Wth Sakai U 2 can snd txt msgs to grps of ppl! W00t!<br />
  4. 4. SMS Overview<br /> What is it?<br /> SMS provides mobile text messaging in Sakai, including a tool for sending messages, and a “switchboard” for handing incoming messages to tools or scripts.<br /> Where do I find it? http://confluence.sakaiproject.org/display/SMS/<br />https://source.sakaiproject.org/contrib/sms/<br />http://jira.sakaiproject.org/browse/SMS<br /> More information?<br /> Screenshots on Confluence. Ask questions on the sakai-dev list, or contact UCT.<br />4<br />11th Sakai Conference - June 15-17, 2010<br />
  5. 5. Outgoing SMS<br />11th Sakai Conference - June 15-17, 2010<br />5<br />In the SMS Messages tool,<br />Write message (with context and sender)<br />Select recipients by one or more of:<br /> Users with a role (e.g. Student)<br /> Users in a group (e.g. Tutorial 1)<br /> Users by name<br /> List of mobile numbers<br />c. Calculate cost / credits<br />d. Send<br />e. View delivery status<br />See more screenshots at <br />http://confluence.sakaiproject.org/display/SMS/SMS+Messages+Screenshots<br />
  6. 6. Incoming SMS Examples<br />11th Sakai Conference - June 15-17, 2010<br />6<br />Placement offers: “UCT Health Sciences offers you a place in MBChB for 2010: SMS ‘offer studentnumber accept/decline’ to #####” (200+ responses in 10 minutes).<br />Q&A: What new use of Vula are you considering? SMS your answer to#####<br />R 3461 I would like to use Vula for surveys<br />Q&A: Ask a question about Vula: SMS your question to#####:<br /> Q smsdemoHow can I use Vula for surveys?<br />Other possible uses for incoming SMS: Chat, Polls, Glossaries, etc.<br />
  7. 7. Incoming SMS<br />Any tool/service can accept incoming articles by registering a command prefix with the SMS service.<br />Either implement ShortMessageCommand or configure a REST endpoint for incoming messages.<br /> Example code:https://source.sakaiproject.org/contrib/qna/trunk/impl/src/java/org/sakaiproject/qna/logic/impl/sms/QuestionSmsCommand.java<br /> Example REST registration: see http://confluence.sakaiproject.org/display/SMS/Incoming+SMS<br />11th Sakai Conference - June 15-17, 2010<br />7<br />
  8. 8. Deployment considerations<br /> Service provider<br /> You need a service provider with an SMPP gateway (e.g. http://www.clickatell.com). What destination networks / countries are supported, and at what cost per message?<br /> Mobile numbers<br />Populate user numbers in the user profile, or implement a provider (e.g. for LDAP lookup or some external source).<br /> Privacy and defaults<br /> Opt-in or opt-out, private or visible.<br /> Cost and accounting model<br /> Who incurs costs for sending messages? Prepaid or postpaid? Default implementation supports a prepaid model, with credit allocation per site.<br />11th Sakai Conference - June 15-17, 2010<br />8<br />
  9. 9. SMS: Privacy<br /> Our approach at UCT (Vula = our Sakai):<br /> Student, staff and third party cell numbers in Vula come from Peoplesoft, SAP HR, Third Party system<br /> Default My Workspace / Profile settings:<br /> Allow Vula users to send SMS messages to my cellphone: Yes<br /> Hide my cellphone number from other Vula users: Yes<br /> Users can opt out (0.5% so far)<br /> People sending messages see only the username, not the user’s cell number<br /> Use SMS wisely Otherwise people will opt out which makes it less useful for everyone.<br />
  10. 10. Q&A<br />11th Sakai Conference - June 15-17, 2010<br />10<br />
  11. 11. Q&A Overview<br /> What is it?<br /> A tool which supports question-driven interaction (optionally anonymous) with web, email and SMS workflows (comparisons: Yahoo Answers, StackOverflow, Purdue Hotseat).<br /> Where do I find it?http://confluence.sakaiproject.org/display/QNA/Home<br />https://source.sakaiproject.org/contrib/qna/<br /> More information?<br /> “A question is worth a thousand answers” (Paris Sakai conference presentation):http://confluence.sakaiproject.org/download/attachments/39616558/paris-sakai-qna.pdf<br /> Ask questions on the sakai-dev list, or contact UCT.<br />11<br />11th Sakai Conference - June 15-17, 2010<br />
  12. 12. Why questions?<br />Many students ask the same question<br />Students will ask a question online which they wouldn’t or couldn’t ask face-to-face<br />Students may ask a question differently (or at all) if they can ask it anonymously<br />Students answer each other’s questions<br />The student questions and answers provide a window into student thought processes, their difficulties, confusions, misconceptions and successes.<br />Questions and answers provide academic support, peer support, and diagnostic insights.<br />
  13. 13. Supported workflows<br />Instructor-led: Student asks question > instructor responds privately (by email), and/or publicly (in the site)<br />Collaborative: Student asks question > peers respond > (optional) instructor / TA provides or nominates a definitive answer<br />Questions may be moderated, i.e. only become visible in the site once reviewed by an instructor / TA<br />Site members may be allowed to ask questions anonymously<br />
  14. 14. Tool demo<br />Set up tool “personality” and workflow through Options and Permissions<br />View, ask and respond to questions<br />Create and organise categories and reorganize questions across categories<br />
  15. 15.
  16. 16. View questions and ask a new one<br />
  17. 17. Viewing responses<br />
  18. 18. Respond to a question (instructor)<br />
  19. 19. Add an answer (student)<br />
  20. 20. Organise questions<br />
  21. 21. SMS support<br />Q&A is minimally SMS-enabled<br />Supports asking questions by SMS, receiving answers and/or retrieving answers<br />Not really exposed in UI yet (except for Options)<br />
  22. 22. Course Evaluation<br />11th Sakai Conference - June 15-17, 2010<br />22<br />
  23. 23. Course Evaluation Overview<br /> What is it?<br /> A tool for delivering course evaluations or surveys.<br /> Where do I find it?<br />http://confluence.sakaiproject.org/display/EVALSYS/Home<br /> https://source.sakaiproject.org/contrib/evaluation/<br /> More information?<br /> Ask on the evaluation@collab.sakaiproject.org mailing list.<br /> UCT screencast (instructor-managed evaluations) http://confluence.sakaiproject.org/display/EVALSYS/Course+Evaluations+video+tutorial<br />23<br />11th Sakai Conference - June 15-17, 2010<br />
  24. 24. Caveats<br />How you might implement this depends heavily on institutional processes and policy.<br />Evaluation System is a complex tool which has support for different institutional models of delivering evaluations.<br />The information in Confluence is not up-to-date.<br />No 2 sites run the tool in exactly the same way.<br />Ask on the evaluations list!<br />11th Sakai Conference - June 15-17, 2010<br />24<br />
  25. 25. Generic issues and concerns<br />Response rates may be lower (dependent on lecturer involvement and feedback)<br />… but students give more written feedback online than in paper-based evaluations<br />Moving from paper to online does not lead to less favourable ratings (U. Michigan)<br />The set of respondents is representative of the course cohort by race, gender, final course mark: lower response rates do not skew results (IPD, UCT)<br />Online evaluation is popular with students and provides more opportunities for student feedback<br />Different opinions and strategies about incentives<br />What happens to the results?<br />
  26. 26. UCT self-service model<br />Site Owners or Support Staff can create and assign evaluations to one or more of their Vula sites. The evaluation owner decides:<br /><ul><li>Who is evaluated (lecturers and tutors)
  27. 27. The questions
  28. 28. Start and end dates
  29. 29. How to encourage students to respond
  30. 30. What to do with the results</li></ul>(subject to Department or Faculty processes or guidelines)<br />
  31. 31. UCT possible teaching models<br />One or more lecturers (aka instructors)<br /><ul><li>Every student evaluates all lecturers in the evaluation
  32. 32. Students are taught in cohorts: each student chooses his/her lecturer to evaluate</li></ul>Tutors (aka TAs)<br /><ul><li>Tutors interact with students as a group: students evaluate the support of the tutors in general
  33. 33. Every student evaluates all tutors individually
  34. 34. Each student belongs to one or more tutor groups, and therefore chooses one or more tutors to evaluate</li></li></ul><li>UCT: running an online evaluation<br />Add the Course Evaluations tool to one or more existing Vula course sites <br />Create a new evaluation:<br />Choose a template to start from<br />Choose start and end dates<br />Choose reminder options<br />Assign the evaluation to one or more Vula sites<br />Identify Lecturers and Tutors to be included in the evaluation<br />If necessary, edit the evaluation (add, remove or change questions)<br />While the evaluation is open:<br />Look at the response rates, and encourage students to complete the evaluation<br />Optionally, extend the closing date if the response rate is insufficient<br />When the evaluation has closed:<br />View results (online, PDF, export to Excel)<br />Provide feedback to students and/or class reps<br />Provide a copy of results to HoD, other staff<br />
  35. 35. UCT evaluation structure<br /> About the course<br /> About you<br /> (About all lectures/tutors)<br />Lecturer 1 questions<br /> Lecturer question a<br /> Lecturer question b, …<br />Lecturer 2 questions<br /> Lecturer question a<br /> Lecturer question b, …<br /> Tutor 1 questions<br /> Tutor question a<br /> Tutor question b, …<br /> Tutor 2 questions<br /> Tutor question a<br /> Tutor question b, …<br />General questions<br />Lecturer questions<br />repeated for each assigned lecturer<br />[respond to all, select one, select many]<br />Tutor questions<br />repeated for each assigned tutor<br />[respond to all, select one, select many]<br />
  36. 36. UCT: selecting the Lecturers to Evaluate<br />
  37. 37. UCT: The Student’s View<br />

×