Sakai Tests

Christine Doherty Lydia Li Karen Tsao Stanford University (aka Tests & Quizzes) S akai A ssessment M anager I G O

Agenda
Feature Overview
Demo of Features
2.5 Highlights
2.6 Roadmap
Quick Create Demo
Q&A

What are SAMigo’s features:
Assessment Authoring
Assessment Publishing
Assessment-Taking Management
Assessment Grading
Question Pools Management
Assessment-Type Management

Pedagogical Flexibility
Online test
Self-study questions
Homework, problem-sets
Paper, code, or project submission
Language drills
Quick knowledge probes
Surveys
Others???

Organize & Publish Assessments
Core (pending) Assessments for a course
Starting page for assessment authoring
Can be exported/imported in QTI XML format
When ready, published via Settings
Published Assessments for student assessment-taking
When students respond, Scores link appears
Can change release, due, retract dates, plus some feedback and grading settings
Can remove published assessments * New in 2.5

Question Types
Auto-scored
Multiple Choice (single and multiple correct)
Survey (multiple choice, different rating scales available)
Fill in the Blank
Numeric Response
Matching
True/False
Manually scored
Short Answer/Essay
Audio Recording
File Upload

Rich-Text & Attachments
At all levels of assessment authoring:
Assessment/Part Headers
Questions
Selections
Feedback

Create an Assessment

* New in 2.5

Import/Export
Supports QTI v 1.2
Export types: IMS QTI-compliant XML or IMS Content Packaging (for use with attachments)
Useful for
Making copies of core assessment in same site
Copying assessment to different site

Settings
Configures delivery of assessments (how they appear to students)
Options include:
display/organization
late handling
number of submissions
feedback options
high security and time limit for high stakes testing
Most settings are not editable after publishing , so it is very important for instructors to review these carefully before publishing

* New in 2.5

Save Settings and Publish - to release to students Save Settings - to make changes to core assessment settings, can publish assessement at later time

Publishing
Release assessment to students
Copy of core assessment -- core assessment can be modified without affecting published version (and released with new title)
Can set Available Date in future -- useful for instructors who want to do bulk of setup early
Can retract any time, making assessment unavailable to all students

Published Inactive Assessments
Retracted assessments will not appear to any students
Assessments that are past the due date will not appear to students, with following exception:
When late submission is allowed, students who have not submitted will get “one last chance” to submit

Taking an Assessment (Students)
Take an Assessment section
List determined by available, due, and retract dates
Submit for Grading and Save for Later options
Table of Contents and Mark for Review features available in non-linear assessment organization
Submitted Assessments section
Provides submission confirmation with timestamp
Depending on settings, students can review scores, feedback, grader’s comments, statistics

Grading Workflows
Ability to grade all questions for one student or grade all responses to one question
Manual adjustments can be made to individual questions or entire assessment
Comments can be made for individual questions or entire assessment
Display of scores can be filtered by section

Other Grading Features
Email students from Scores page
Allow Retake for individual student
Download All function for file upload questions -- generates zip file of all student submissions
Statistics and histograms
Export students' responses to Excel file (New in 2.5)

Grading Settings
Anonymous grading OR show student identities
Send scores to Gradebook -- this can be toggled on and off after assessment is published
Record highest score OR last score

* New in 2.5

Question Pools
Organize questions into multiple subpools
Move/copy/remove multiple questions to other pool * New in 2.5
Author questions from within Pool Manager
Import questions from IMS QTI-compliant XML file
Randomly draw from pools for an assessment
IMPORTANT NOTE: Question pools belong to an individual user only, available across all user’s sites

Assessment Types
Create assessment “types” for different disciplines, different uses
Hide complexity by selecting which settings are visible to the instructor.
Pre-set defaults by making setting choices for the type (e.g., Self-study always has immediate feedback)

Assessment Creation Workflow

2.5 Highlights
Adjust score in edit assessment screen *
Remove published assessments
Allow feedback to be viewed right after an assessment is submitted
Export students' responses to Excel file **
Reset point values of questions when a random draw from pool part is created *
Move/copy/remove multiple questions to other pool *
Copy all questions in a part to a selected pool *
Event logging for user operations
* Contributed by Rutgers University ** Partly based on contributions from Rutgers University

2.6 Roadmap
Edit a published assessment
Includes editing content of existing questions and most settings
Does not include editing parts, reordering parts or questions, adding or removing questions
Ability to regrade auto-scored questions for existing submissions
Copy a (core) pending assessment
Share question pools *
Release assessment to one or more groups/sections **
Statistics for item analysis **
* Based on contributions from Universidad Politecnica de Valencia ** Contributed by University of Cape Town

Quick Create
Contributed by Claremont McKenna College and UC Davis
Disabled by default, but can be turned on in sakai properties
Efficiency created by reducing number of clicks, pages loading and saving
Useful for transferring assessments created in other applications or LMS (e.g., MS Word, WebCT), no need to paste into different fields
Rich text and attachments can be added later, through edit assessment screen

Questions?

Contacts
Questions and feeback: [email_address]
Lydia Li, Stanford University
Project Manager
[email_address]
Homepage:
http://confluence.sakaiproject.org/confluence/display/SAM

Sakai Tests

by odepasqua

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 6

Statistics

Sakai Tests Presentation Transcript