Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

PowerPoint Presentation

411 views

Published on

  • Be the first to comment

  • Be the first to like this

PowerPoint Presentation

  1. 1. Assessing Students Online League for Innovation 2005 Dallas, TX October 24, 8:00 AM – 9:00 AM Manchester, Tower Mezzanine
  2. 2. Who Are We? <ul><li>Montgomery County Community College, Blue Bell, PA </li></ul><ul><li>Patricia Rahmlow Assistant Professor, Computer Science [email_address] </li></ul><ul><li>Marie Hartlein Associate Professor, Computer Science [email_address] </li></ul><ul><li>Linda Moulton Professor Mathematics and Computer Science [email_address] </li></ul><ul><li>http://faculty.mc3.edu/prahmlow/Presentations/index.html </li></ul>
  3. 3. Who Are You? <ul><li>Disciplines </li></ul><ul><li>Online, hybrid, face-to-face professor </li></ul><ul><li>Blackboard, WebCT, other </li></ul><ul><li>Use publisher packages </li></ul><ul><li>Use online quizzes </li></ul>
  4. 4. Why Assess Students Online? <ul><li>Space and time independent </li></ul>
  5. 5. Why Assess Students Online? <ul><li>Immediate feedback </li></ul>
  6. 6. Why Assess Students Online? <ul><li>Learning aide </li></ul>
  7. 7. Uses of Online Assessment <ul><li>Evaluation of student learning </li></ul><ul><ul><li>Pre-test </li></ul></ul><ul><ul><li>Post-test </li></ul></ul>
  8. 8. Uses of Online Assessment <ul><li>Evaluation of student learning </li></ul><ul><li>Assessment of knowledge </li></ul><ul><ul><li>Exams </li></ul></ul><ul><ul><li>Make-up tests </li></ul></ul>
  9. 9. Uses of Online Assessment <ul><li>Evaluation of student learning </li></ul><ul><li>Assessment of knowledge </li></ul><ul><li>Self-evaluation </li></ul><ul><ul><li>Repetitive testing </li></ul></ul><ul><ul><li>Feedback </li></ul></ul>
  10. 10. Uses of Online Assessment <ul><li>Evaluation of student learning </li></ul><ul><li>Assessment of knowledge </li></ul><ul><li>Self-evaluation </li></ul><ul><li>Distance learning assessment </li></ul><ul><ul><li>Keeps students as “distance” learners </li></ul></ul><ul><ul><li>More convenient for student </li></ul></ul>
  11. 11. Online Assessment Tools <ul><li>Course delivery software </li></ul><ul><ul><li>Blackboard </li></ul></ul><ul><ul><li>WebCT </li></ul></ul><ul><ul><li>Publisher course delivery sites </li></ul></ul>
  12. 12. Online Assessment Tools <ul><li>Course delivery software </li></ul><ul><li>Simulated software application testing </li></ul><ul><ul><li>SAM </li></ul></ul><ul><ul><li>Train IT </li></ul></ul><ul><ul><li>SimNet </li></ul></ul><ul><ul><li>SNAP </li></ul></ul>
  13. 13. Online Assessment Tools <ul><li>Course delivery software </li></ul><ul><li>Simulated software application testing </li></ul><ul><li>Free / low-cost quiz sites </li></ul><ul><ul><li>http://getonline.wichita.edu/transitions/assess.asp#assessmenttools </li></ul></ul>
  14. 14. Online Assessment Tools <ul><li>Course delivery software </li></ul><ul><li>Simulated software application testing </li></ul><ul><li>Free / low-cost quiz sites </li></ul><ul><li>Textbook web sites </li></ul><ul><ul><li>Computer Science Concepts </li></ul></ul><ul><ul><ul><li>http://csilluminated.jbpub.com/ </li></ul></ul></ul><ul><ul><li>Information Literacy Concepts </li></ul></ul><ul><ul><ul><li>http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,1799886-,00.html </li></ul></ul></ul><ul><ul><li>Active Help Desk </li></ul></ul><ul><ul><ul><li>http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter03/index.html </li></ul></ul></ul><ul><ul><li>Accounting Textbook </li></ul></ul><ul><ul><ul><li>http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html </li></ul></ul></ul>
  15. 15. Online Assessment Modes <ul><li>Time constraints </li></ul><ul><ul><li>None </li></ul></ul><ul><ul><li>Timed – warning mode </li></ul></ul><ul><ul><li>Timed – shut down mode </li></ul></ul>
  16. 16. Online Assessment Modes <ul><li>Time constraints </li></ul><ul><li>Number of attempts </li></ul><ul><ul><li>One </li></ul></ul><ul><ul><li>Multiple </li></ul></ul><ul><ul><li>Unlimited </li></ul></ul><ul><ul><li>Student specific </li></ul></ul>
  17. 17. Online Assessment Modes <ul><li>Time constraints </li></ul><ul><li>Number of attempts </li></ul><ul><li>Restricted access </li></ul><ul><ul><li>Site password </li></ul></ul><ul><ul><li>Assessment password </li></ul></ul>**********
  18. 18. Online Assessment Modes <ul><li>Time constraints </li></ul><ul><li>Number of attempts </li></ul><ul><li>Restricted access </li></ul><ul><li>Survey </li></ul><ul><ul><li>Anonymous </li></ul></ul><ul><ul><li>Course evaluation </li></ul></ul>?
  19. 19. Knowledge Based Questions <ul><li>True/False </li></ul><ul><li>Multiple Choice </li></ul><ul><li>Matching </li></ul><ul><li>Multiple Answer </li></ul><ul><li>Ordering </li></ul><ul><li>Fill in the Blank </li></ul><ul><li>Essay </li></ul><ul><li>Calculated Numeric </li></ul><ul><li>Calculated Formula </li></ul><ul><li>File Response </li></ul><ul><li>Hot Spot </li></ul><ul><li>Fill in Multiple Blanks </li></ul><ul><li>Jumbled Sentence </li></ul><ul><li>Opinion Scale/Likert </li></ul><ul><li>Short Answer </li></ul><ul><li>Either/Or </li></ul><ul><li>Quiz Bowl </li></ul>
  20. 20. Performance Based Questions <ul><li>Open / close files </li></ul><ul><li>Search internet </li></ul><ul><li>Send email </li></ul><ul><li>Format documents </li></ul><ul><li>Develop formulas </li></ul><ul><li>Query a database </li></ul>
  21. 21. Assessment Integrity <ul><li>Timed </li></ul><ul><ul><li>Allow use of textbook </li></ul></ul><ul><ul><li>Insufficient time to look up all answers </li></ul></ul>
  22. 22. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><ul><li>Large pool of questions </li></ul></ul><ul><ul><li>No two quizzes identical </li></ul></ul>
  23. 23. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><ul><li>Facilitates face-to-face use </li></ul></ul><ul><ul><li>Less likely to memorize answers </li></ul></ul>
  24. 24. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><li>Frequent assessments </li></ul><ul><ul><li>Less likely someone else will take assessment </li></ul></ul>
  25. 25. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><li>Frequent assessments </li></ul><ul><li>Don’t reveal answers </li></ul><ul><ul><li>Send answers after exam time ends </li></ul></ul><ul><ul><li>Send only correct / incorrect indicator </li></ul></ul><ul><ul><li>Time release results </li></ul></ul>
  26. 26. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><li>Frequent assessments </li></ul><ul><li>Don’t reveal correct answers </li></ul><ul><li>Proctored </li></ul>
  27. 27. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><li>Frequent assessments </li></ul><ul><li>Don’t reveal correct answers </li></ul><ul><li>Proctored </li></ul><ul><li>Other forms of assessment </li></ul><ul><ul><li>“ Portfolio” of student ability </li></ul></ul><ul><ul><li>Discussions </li></ul></ul><ul><ul><li>Homework / Projects </li></ul></ul>
  28. 28. Technical Issues <ul><li>ISP Disconnect </li></ul><ul><ul><li>“ Passive” assessments </li></ul></ul><ul><ul><ul><li>Keep under 30 minutes </li></ul></ul></ul><ul><ul><ul><li>Reset quizzes </li></ul></ul></ul><ul><ul><ul><li>Question pools </li></ul></ul></ul><ul><ul><li>“ Active” assessments </li></ul></ul><ul><ul><ul><li>Count first recorded response </li></ul></ul></ul><ul><li>Pop-up Blockers </li></ul><ul><li>Special Software </li></ul>
  29. 29. Tool Selection <ul><li>Cost </li></ul><ul><li>Ease of use </li></ul><ul><ul><li>Student </li></ul></ul><ul><ul><ul><li>Access </li></ul></ul></ul><ul><ul><ul><li>Software </li></ul></ul></ul><ul><ul><li>Professor </li></ul></ul><ul><ul><ul><li>Set-up </li></ul></ul></ul><ul><ul><ul><li>Grading (SCORM) </li></ul></ul></ul><ul><li>Purpose </li></ul><ul><ul><li>Graded assessment </li></ul></ul><ul><ul><li>Self-assessment </li></ul></ul>
  30. 30. Demonstrations <ul><li>SAM </li></ul><ul><ul><li>http://sam2003.course.com </li></ul></ul><ul><li>Blackboard </li></ul><ul><ul><li>https://my.mc3.edu/ </li></ul></ul><ul><li>Textbook web sites </li></ul><ul><ul><li>Computer Science Concepts </li></ul></ul><ul><ul><ul><li>http:// csilluminated.jbpub.com / </li></ul></ul></ul><ul><ul><li>Information Literacy Concepts </li></ul></ul><ul><ul><ul><li>http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,1799886-,00.html </li></ul></ul></ul><ul><ul><li>Active Help Desk </li></ul></ul><ul><ul><ul><li>http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter03/index.html </li></ul></ul></ul><ul><ul><li>Accounting Textbook </li></ul></ul><ul><ul><ul><li>http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html </li></ul></ul></ul>

×