Sakai and Language Assessment

478 views

Published on

How Sakai helps the Stanford Language Center do assessment

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

Sakai and Language Assessment

  1. 1. Sakai and Language Assessment Ken Romeo, Ph.D. Academic Technology Specialist / Lecturer Stanford Language Center / Academic Computing June 14, 2010
  2. 2. Background <ul><li>Me </li></ul><ul><ul><li>ESL instructor (20 years) </li></ul></ul><ul><ul><li>Academic Technology Specialist (2006) </li></ul></ul><ul><ul><li>CourseWork (Sakai) team meeting observer / participant (2008) </li></ul></ul><ul><li>Stanford Language Center </li></ul><ul><ul><li>Language requirement </li></ul></ul><ul><ul><li>1995 – new director: Prof. Elizabeth Bernhardt </li></ul></ul><ul><ul><li>Emphasis on assessment and professional development </li></ul></ul><ul><li>This presentation </li></ul><ul><ul><li>American Council on the Teaching of Foreign Languages (ACTFL 2007) Bernhardt, Molitoris, Miano, Gelmetti, Tsethlikai, Romeo </li></ul></ul>Stanford Language Center / Academic Computing 11th Sakai Conference - June 15-17, 2010
  3. 3. Assessment Program <ul><li>Objectives </li></ul><ul><ul><li>Improve student performance </li></ul></ul><ul><ul><li>Enhance credibility (students and the public) </li></ul></ul><ul><ul><li>Programmatic consistency </li></ul></ul><ul><li>Methods </li></ul><ul><ul><li>ACTFL Oral Proficiency Standards (ACTFL, 1999) </li></ul></ul><ul><ul><li>Oral Placement and Exit exams </li></ul></ul><ul><ul><li>More face-time for instructors  put diagnostic assessment online (CourseWork) </li></ul></ul>Stanford Language Center / Academic Computing 11th Sakai Conference - June 15-17, 2010
  4. 4. Foreign Language Placement <ul><li>800 unregistered students: not in Sakai </li></ul><ul><li>Online tests during the summer </li></ul><ul><li>Oral assessment on campus: 1 hour, cassette tapes </li></ul>Stanford Language Center / Academic Computing 11th Sakai Conference - June 15-17, 2010
  5. 5. Exit Assessment: SOPI Definition <ul><li>Based on live Oral Proficiency Interview (OPI) </li></ul><ul><li>Simulated Oral Proficiency Interview (SOPI): Instructions + Image  Thinking  Prompt  Response  Next </li></ul><ul><li>Software requirements </li></ul><ul><ul><li>High stakes: content security and reliability </li></ul></ul><ul><ul><li>Enrollment from existing courses (Sakai) </li></ul></ul><ul><ul><li>Non-standard roles: Coordinator, instructor </li></ul></ul><ul><ul><li>No student control = no web delivery </li></ul></ul><ul><ul><li>Securely archive audio recordings (Sakai) </li></ul></ul>Stanford Language Center / Academic Computing 11th Sakai Conference - June 15-17, 2010
  6. 6. SOPI Software (Project Manager: Makoto Tsuchitani) <ul><li>Application (Developer: Casey Dunn) </li></ul><ul><ul><li>Desktop Java application </li></ul></ul><ul><ul><li>Quicktime for Java – play and record </li></ul></ul><ul><ul><li>WebServices to communicate with Sakai </li></ul></ul><ul><li>SOPI Monitor (Developer: Zach Thomas) </li></ul><ul><ul><li>Realtime progress of each student </li></ul></ul><ul><ul><li>UI depends on role </li></ul></ul><ul><ul><li>Packaging for further dissemination </li></ul></ul>Stanford Language Center / Academic Computing 11th Sakai Conference - June 15-17, 2010
  7. 7. SOPI Application Stanford Language Center / Academic Computing 11th Sakai Conference - June 15-17, 2010
  8. 8. SOPI Monitor Tool Stanford Language Center / Academic Computing 11th Sakai Conference - June 15-17, 2010
  9. 9. Technology Integration: Key Points <ul><li>Each part has a pedagogically valid purpose and is not focused on technology. </li></ul><ul><li>Uses a standalone application with connection to Sakai to do what the web can’t. </li></ul><ul><li>All instructors create material based on the same standards-based framework . </li></ul><ul><li>Implementation takes a huge number of human hours and coordination across many different groups. </li></ul>Stanford Language Center / Academic Computing 11th Sakai Conference - June 15-17, 2010
  10. 10. Thank you! <ul><li>Ken Romeo :: kenro at stanford dot edu </li></ul>Stanford Language Center / Academic Computing 11th Sakai Conference - June 15-17, 2010

×