High Stakes Testing on Sakai with Samigo and a Locked-down OS image

489 views

Published on

Online writing tests, using an OS image that prevents access to any site other than Sakai.

Published in: Education, Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
489
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Paul WalkInstructional technology in higher education should move forward by doing the following:
  • High Stakes Testing on Sakai with Samigo and a Locked-down OS image

    1. 1. Ken Romeo Language Center Mike Queisser Academic Computing Services Stanford University June 10-15, 2012Growing Community;Growing Possibilities
    2. 2.  Background: Why did we do this? Pieces: Where, what, and how? ◦ Hardware ◦ Test settings ◦ OS image ◦ Preparation ◦ Administration Results: How well did it work? Lessons learned: What should/can we fix? The biggest victory: Collaborations 2012 Jasig Sakai Conference 2
    3. 3.  CourseWork = Sakai ACTFL = American Council on the Teaching of Foreign Languages WPA = Writing Proficiency Assessment IME = Input Method Editor 2012 Jasig Sakai Conference 3
    4. 4.  Language Requirement Accountability Speaking & Writing ACTFL Proficiency guidelines 2012 Jasig Sakai Conference 4
    5. 5. 2012 Jasig Sakai Conference 5
    6. 6. 2012 Jasig Sakai Conference 6
    7. 7. More secureBetter organizationTyping produces more language 2012 Jasig Sakai Conference 7
    8. 8. 2012 Jasig Sakai Conference 8
    9. 9. 2012 Jasig Sakai Conference 9
    10. 10. 2012 Jasig Sakai Conference 10
    11. 11. 2012 Jasig Sakai Conference 11
    12. 12. 2012 Jasig Sakai Conference 12
    13. 13. 2012 Jasig Sakai Conference 13
    14. 14. 2012 Jasig Sakai Conference 14
    15. 15. 2012 Jasig Sakai Conference 15
    16. 16.  Lightweight, simple system Security Privacy 2012 Jasig Sakai Conference 16
    17. 17.  Minimize running services and applications Sophos A/V, Python 2.6, and CopSSH Automatic login XML file >> IME settings CMD.exe and Notepad.exe Windows updates disabled 2012 Jasig Sakai Conference 17
    18. 18.  Active directory Domain and local group policies Proxy server to allow access to only certain sites Script read from imaging management server 2012 Jasig Sakai Conference 18
    19. 19. 2012 Jasig Sakai Conference 19
    20. 20.  function FindProxyForURL(url, host) { //strings to return var allow = "DIRECT"; var block = "PROXY localhost:80"; if (shExpMatch(url, "https://coursework.stanford.edu/*")) { return allow; } if (shExpMatch(url, "https://cw-tests.stanford.edu/*")) { return allow; } if (shExpMatch(url, "https://weblogin.stanford.edu/*")) { return allow; } if (shExpMatch(url, "*.microsoft.com/*")) { return allow; } if (shExpMatch(url, "*.windowsupdate.com/*")) { return allow; } if (shExpMatch(url, "*.microsoftupdates.com/*")) { return allow; } if (shExpMatch(url, "*.sophos.com/*")) { return allow; } return block; } 2012 Jasig Sakai Conference 20
    21. 21.  Clear temporary files at logout Reset user account completely at login 2012 Jasig Sakai Conference 21
    22. 22.  Typing: PC – IE8 (NOT a Mac, MSWord) Instructions ◦ Language bar ◦ Don’t click the back button ◦ Save after every sentence ◦ Mistakes: ctrl-z / close browser ◦ Submit when complete ◦ Can re-open unsubmitted work ◦ Can re-submit new work 2012 Jasig Sakai Conference 22
    23. 23.  Coordinator group and 1-on-1 meetings Multiple emails to instructors Coordinator meetings with instructors Consulting on preparation activities 2012 Jasig Sakai Conference 23
    24. 24.  Overview / schedule Preparation: steps and samigo export file Orientation ◦ Typing instructions: US International, Chinese, Japanese, Korean ◦ Test taking instructions Testing day instructions for administration ◦ Setup ◦ Test start to finish ◦ Error handling 2012 Jasig Sakai Conference 24
    25. 25.  Introduction: Honor code and instructions 2 items: text prompt, short answer responses Settings: ◦ No release, due, retract dates ◦ No time limit ◦ Allow multiple submissions ◦ Allow late submissions ◦ High security: UserID and password Concept: security through physical location 2012 Jasig Sakai Conference 25
    26. 26.  Previously observed Virtual server to avoid load balancer Certificate Vanilla Sakai In the end … 2012 Jasig Sakai Conference 26
    27. 27.  2011: pilot 155 tests in Western languages 2012: 493 on samigo / 238 on paper, ◦ 31 Chinese, Japanese, and Korean pilot tests ◦ No major data loss: 11 students lost 1-2 sentences ◦ One test fell back to paper (10 students) 2013: expand CJK Remaining languages: Russian and Arabic 2012 Jasig Sakai Conference 27
    28. 28.  Students don’t read paper instructions Logistics are never, ever trivial Something was sketchy: load balancer? Overcautious instructions worked, sort of Non-soft controls (physical presence) worked OS image totally worked (except notepad) 2012 Jasig Sakai Conference 28
    29. 29.  Block Notepad and CMD IE >> Firefox ESR Point out language bar 2012 Jasig Sakai Conference 29
    30. 30.  Desktop (not web) app Enrollment from Sakai Results to Sakai Cache results until completely uploaded SOPI application 2012 Jasig Sakai Conference 30
    31. 31.  The end of the blue book Mid-terms, finals: like paper, but online Instructional technology for the 80% The beginning of learning analytics 2012 Jasig Sakai Conference 31
    32. 32. CourseWork Team Imaging(Mike’s cube) Language Lab (Ken’s office) 2012 Jasig Sakai Conference 32
    33. 33.  Cannot do instructional technology *at scale* in isolation Collaborations across units work! Face-to-face meetings Professional cooperation to improve instruction = incentive n.b. My explicit role is to facilitate these collaborations for the Language Center 2012 Jasig Sakai Conference 33
    34. 34.  Proactively address needs Address problems systematically, institutionally Cross institutional boundaries Generalize to contribute to the field 2012 Jasig Sakai Conference 34
    35. 35. Ken Romeo – kenro@stanford.edu Language Center Mike Queisser – squeezer@stanford.edu Academic Computing Services Stanford University June 10-15, 2012Growing Community;Growing Possibilities

    ×