High Stakes Testing on Sakai with Samigo and a Locked-down OS image
Upcoming SlideShare
Loading in...5
×
 

High Stakes Testing on Sakai with Samigo and a Locked-down OS image

on

  • 427 views

Online writing tests, using an OS image that prevents access to any site other than Sakai.

Online writing tests, using an OS image that prevents access to any site other than Sakai.

Statistics

Views

Total Views
427
Views on SlideShare
427
Embed Views
0

Actions

Likes
0
Downloads
1
Comments
0

0 Embeds 0

No embeds

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Paul WalkInstructional technology in higher education should move forward by doing the following:

High Stakes Testing on Sakai with Samigo and a Locked-down OS image High Stakes Testing on Sakai with Samigo and a Locked-down OS image Presentation Transcript

  • Ken Romeo Language Center Mike Queisser Academic Computing Services Stanford University June 10-15, 2012Growing Community;Growing Possibilities
  •  Background: Why did we do this? Pieces: Where, what, and how? ◦ Hardware ◦ Test settings ◦ OS image ◦ Preparation ◦ Administration Results: How well did it work? Lessons learned: What should/can we fix? The biggest victory: Collaborations 2012 Jasig Sakai Conference 2
  •  CourseWork = Sakai ACTFL = American Council on the Teaching of Foreign Languages WPA = Writing Proficiency Assessment IME = Input Method Editor 2012 Jasig Sakai Conference 3
  •  Language Requirement Accountability Speaking & Writing ACTFL Proficiency guidelines 2012 Jasig Sakai Conference 4
  • 2012 Jasig Sakai Conference 5
  • 2012 Jasig Sakai Conference 6
  • More secureBetter organizationTyping produces more language 2012 Jasig Sakai Conference 7
  • 2012 Jasig Sakai Conference 8
  • 2012 Jasig Sakai Conference 9
  • 2012 Jasig Sakai Conference 10
  • 2012 Jasig Sakai Conference 11
  • 2012 Jasig Sakai Conference 12
  • 2012 Jasig Sakai Conference 13
  • 2012 Jasig Sakai Conference 14
  • 2012 Jasig Sakai Conference 15
  •  Lightweight, simple system Security Privacy 2012 Jasig Sakai Conference 16
  •  Minimize running services and applications Sophos A/V, Python 2.6, and CopSSH Automatic login XML file >> IME settings CMD.exe and Notepad.exe Windows updates disabled 2012 Jasig Sakai Conference 17
  •  Active directory Domain and local group policies Proxy server to allow access to only certain sites Script read from imaging management server 2012 Jasig Sakai Conference 18
  • 2012 Jasig Sakai Conference 19
  •  function FindProxyForURL(url, host) { //strings to return var allow = "DIRECT"; var block = "PROXY localhost:80"; if (shExpMatch(url, "https://coursework.stanford.edu/*")) { return allow; } if (shExpMatch(url, "https://cw-tests.stanford.edu/*")) { return allow; } if (shExpMatch(url, "https://weblogin.stanford.edu/*")) { return allow; } if (shExpMatch(url, "*.microsoft.com/*")) { return allow; } if (shExpMatch(url, "*.windowsupdate.com/*")) { return allow; } if (shExpMatch(url, "*.microsoftupdates.com/*")) { return allow; } if (shExpMatch(url, "*.sophos.com/*")) { return allow; } return block; } 2012 Jasig Sakai Conference 20
  •  Clear temporary files at logout Reset user account completely at login 2012 Jasig Sakai Conference 21
  •  Typing: PC – IE8 (NOT a Mac, MSWord) Instructions ◦ Language bar ◦ Don’t click the back button ◦ Save after every sentence ◦ Mistakes: ctrl-z / close browser ◦ Submit when complete ◦ Can re-open unsubmitted work ◦ Can re-submit new work 2012 Jasig Sakai Conference 22
  •  Coordinator group and 1-on-1 meetings Multiple emails to instructors Coordinator meetings with instructors Consulting on preparation activities 2012 Jasig Sakai Conference 23
  •  Overview / schedule Preparation: steps and samigo export file Orientation ◦ Typing instructions: US International, Chinese, Japanese, Korean ◦ Test taking instructions Testing day instructions for administration ◦ Setup ◦ Test start to finish ◦ Error handling 2012 Jasig Sakai Conference 24
  •  Introduction: Honor code and instructions 2 items: text prompt, short answer responses Settings: ◦ No release, due, retract dates ◦ No time limit ◦ Allow multiple submissions ◦ Allow late submissions ◦ High security: UserID and password Concept: security through physical location 2012 Jasig Sakai Conference 25
  •  Previously observed Virtual server to avoid load balancer Certificate Vanilla Sakai In the end … 2012 Jasig Sakai Conference 26
  •  2011: pilot 155 tests in Western languages 2012: 493 on samigo / 238 on paper, ◦ 31 Chinese, Japanese, and Korean pilot tests ◦ No major data loss: 11 students lost 1-2 sentences ◦ One test fell back to paper (10 students) 2013: expand CJK Remaining languages: Russian and Arabic 2012 Jasig Sakai Conference 27
  •  Students don’t read paper instructions Logistics are never, ever trivial Something was sketchy: load balancer? Overcautious instructions worked, sort of Non-soft controls (physical presence) worked OS image totally worked (except notepad) 2012 Jasig Sakai Conference 28
  •  Block Notepad and CMD IE >> Firefox ESR Point out language bar 2012 Jasig Sakai Conference 29
  •  Desktop (not web) app Enrollment from Sakai Results to Sakai Cache results until completely uploaded SOPI application 2012 Jasig Sakai Conference 30
  •  The end of the blue book Mid-terms, finals: like paper, but online Instructional technology for the 80% The beginning of learning analytics 2012 Jasig Sakai Conference 31
  • CourseWork Team Imaging(Mike’s cube) Language Lab (Ken’s office) 2012 Jasig Sakai Conference 32
  •  Cannot do instructional technology *at scale* in isolation Collaborations across units work! Face-to-face meetings Professional cooperation to improve instruction = incentive n.b. My explicit role is to facilitate these collaborations for the Language Center 2012 Jasig Sakai Conference 33
  •  Proactively address needs Address problems systematically, institutionally Cross institutional boundaries Generalize to contribute to the field 2012 Jasig Sakai Conference 34
  • Ken Romeo – kenro@stanford.edu Language Center Mike Queisser – squeezer@stanford.edu Academic Computing Services Stanford University June 10-15, 2012Growing Community;Growing Possibilities