PowerPoint Presentation

390 views
286 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
390
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

PowerPoint Presentation

  1. 1. Assessing Students Online League for Innovation 2005 Dallas, TX October 24, 8:00 AM – 9:00 AM Manchester, Tower Mezzanine
  2. 2. Who Are We? <ul><li>Montgomery County Community College, Blue Bell, PA </li></ul><ul><li>Patricia Rahmlow Assistant Professor, Computer Science [email_address] </li></ul><ul><li>Marie Hartlein Associate Professor, Computer Science [email_address] </li></ul><ul><li>Linda Moulton Professor Mathematics and Computer Science [email_address] </li></ul><ul><li>http://faculty.mc3.edu/prahmlow/Presentations/index.html </li></ul>
  3. 3. Who Are You? <ul><li>Disciplines </li></ul><ul><li>Online, hybrid, face-to-face professor </li></ul><ul><li>Blackboard, WebCT, other </li></ul><ul><li>Use publisher packages </li></ul><ul><li>Use online quizzes </li></ul>
  4. 4. Why Assess Students Online? <ul><li>Space and time independent </li></ul>
  5. 5. Why Assess Students Online? <ul><li>Immediate feedback </li></ul>
  6. 6. Why Assess Students Online? <ul><li>Learning aide </li></ul>
  7. 7. Uses of Online Assessment <ul><li>Evaluation of student learning </li></ul><ul><ul><li>Pre-test </li></ul></ul><ul><ul><li>Post-test </li></ul></ul>
  8. 8. Uses of Online Assessment <ul><li>Evaluation of student learning </li></ul><ul><li>Assessment of knowledge </li></ul><ul><ul><li>Exams </li></ul></ul><ul><ul><li>Make-up tests </li></ul></ul>
  9. 9. Uses of Online Assessment <ul><li>Evaluation of student learning </li></ul><ul><li>Assessment of knowledge </li></ul><ul><li>Self-evaluation </li></ul><ul><ul><li>Repetitive testing </li></ul></ul><ul><ul><li>Feedback </li></ul></ul>
  10. 10. Uses of Online Assessment <ul><li>Evaluation of student learning </li></ul><ul><li>Assessment of knowledge </li></ul><ul><li>Self-evaluation </li></ul><ul><li>Distance learning assessment </li></ul><ul><ul><li>Keeps students as “distance” learners </li></ul></ul><ul><ul><li>More convenient for student </li></ul></ul>
  11. 11. Online Assessment Tools <ul><li>Course delivery software </li></ul><ul><ul><li>Blackboard </li></ul></ul><ul><ul><li>WebCT </li></ul></ul><ul><ul><li>Publisher course delivery sites </li></ul></ul>
  12. 12. Online Assessment Tools <ul><li>Course delivery software </li></ul><ul><li>Simulated software application testing </li></ul><ul><ul><li>SAM </li></ul></ul><ul><ul><li>Train IT </li></ul></ul><ul><ul><li>SimNet </li></ul></ul><ul><ul><li>SNAP </li></ul></ul>
  13. 13. Online Assessment Tools <ul><li>Course delivery software </li></ul><ul><li>Simulated software application testing </li></ul><ul><li>Free / low-cost quiz sites </li></ul><ul><ul><li>http://getonline.wichita.edu/transitions/assess.asp#assessmenttools </li></ul></ul>
  14. 14. Online Assessment Tools <ul><li>Course delivery software </li></ul><ul><li>Simulated software application testing </li></ul><ul><li>Free / low-cost quiz sites </li></ul><ul><li>Textbook web sites </li></ul><ul><ul><li>Computer Science Concepts </li></ul></ul><ul><ul><ul><li>http://csilluminated.jbpub.com/ </li></ul></ul></ul><ul><ul><li>Information Literacy Concepts </li></ul></ul><ul><ul><ul><li>http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,1799886-,00.html </li></ul></ul></ul><ul><ul><li>Active Help Desk </li></ul></ul><ul><ul><ul><li>http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter03/index.html </li></ul></ul></ul><ul><ul><li>Accounting Textbook </li></ul></ul><ul><ul><ul><li>http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html </li></ul></ul></ul>
  15. 15. Online Assessment Modes <ul><li>Time constraints </li></ul><ul><ul><li>None </li></ul></ul><ul><ul><li>Timed – warning mode </li></ul></ul><ul><ul><li>Timed – shut down mode </li></ul></ul>
  16. 16. Online Assessment Modes <ul><li>Time constraints </li></ul><ul><li>Number of attempts </li></ul><ul><ul><li>One </li></ul></ul><ul><ul><li>Multiple </li></ul></ul><ul><ul><li>Unlimited </li></ul></ul><ul><ul><li>Student specific </li></ul></ul>
  17. 17. Online Assessment Modes <ul><li>Time constraints </li></ul><ul><li>Number of attempts </li></ul><ul><li>Restricted access </li></ul><ul><ul><li>Site password </li></ul></ul><ul><ul><li>Assessment password </li></ul></ul>**********
  18. 18. Online Assessment Modes <ul><li>Time constraints </li></ul><ul><li>Number of attempts </li></ul><ul><li>Restricted access </li></ul><ul><li>Survey </li></ul><ul><ul><li>Anonymous </li></ul></ul><ul><ul><li>Course evaluation </li></ul></ul>?
  19. 19. Knowledge Based Questions <ul><li>True/False </li></ul><ul><li>Multiple Choice </li></ul><ul><li>Matching </li></ul><ul><li>Multiple Answer </li></ul><ul><li>Ordering </li></ul><ul><li>Fill in the Blank </li></ul><ul><li>Essay </li></ul><ul><li>Calculated Numeric </li></ul><ul><li>Calculated Formula </li></ul><ul><li>File Response </li></ul><ul><li>Hot Spot </li></ul><ul><li>Fill in Multiple Blanks </li></ul><ul><li>Jumbled Sentence </li></ul><ul><li>Opinion Scale/Likert </li></ul><ul><li>Short Answer </li></ul><ul><li>Either/Or </li></ul><ul><li>Quiz Bowl </li></ul>
  20. 20. Performance Based Questions <ul><li>Open / close files </li></ul><ul><li>Search internet </li></ul><ul><li>Send email </li></ul><ul><li>Format documents </li></ul><ul><li>Develop formulas </li></ul><ul><li>Query a database </li></ul>
  21. 21. Assessment Integrity <ul><li>Timed </li></ul><ul><ul><li>Allow use of textbook </li></ul></ul><ul><ul><li>Insufficient time to look up all answers </li></ul></ul>
  22. 22. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><ul><li>Large pool of questions </li></ul></ul><ul><ul><li>No two quizzes identical </li></ul></ul>
  23. 23. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><ul><li>Facilitates face-to-face use </li></ul></ul><ul><ul><li>Less likely to memorize answers </li></ul></ul>
  24. 24. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><li>Frequent assessments </li></ul><ul><ul><li>Less likely someone else will take assessment </li></ul></ul>
  25. 25. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><li>Frequent assessments </li></ul><ul><li>Don’t reveal answers </li></ul><ul><ul><li>Send answers after exam time ends </li></ul></ul><ul><ul><li>Send only correct / incorrect indicator </li></ul></ul><ul><ul><li>Time release results </li></ul></ul>
  26. 26. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><li>Frequent assessments </li></ul><ul><li>Don’t reveal correct answers </li></ul><ul><li>Proctored </li></ul>
  27. 27. Assessment Integrity <ul><li>Timed </li></ul><ul><li>Question pool </li></ul><ul><li>Randomize questions </li></ul><ul><li>Frequent assessments </li></ul><ul><li>Don’t reveal correct answers </li></ul><ul><li>Proctored </li></ul><ul><li>Other forms of assessment </li></ul><ul><ul><li>“ Portfolio” of student ability </li></ul></ul><ul><ul><li>Discussions </li></ul></ul><ul><ul><li>Homework / Projects </li></ul></ul>
  28. 28. Technical Issues <ul><li>ISP Disconnect </li></ul><ul><ul><li>“ Passive” assessments </li></ul></ul><ul><ul><ul><li>Keep under 30 minutes </li></ul></ul></ul><ul><ul><ul><li>Reset quizzes </li></ul></ul></ul><ul><ul><ul><li>Question pools </li></ul></ul></ul><ul><ul><li>“ Active” assessments </li></ul></ul><ul><ul><ul><li>Count first recorded response </li></ul></ul></ul><ul><li>Pop-up Blockers </li></ul><ul><li>Special Software </li></ul>
  29. 29. Tool Selection <ul><li>Cost </li></ul><ul><li>Ease of use </li></ul><ul><ul><li>Student </li></ul></ul><ul><ul><ul><li>Access </li></ul></ul></ul><ul><ul><ul><li>Software </li></ul></ul></ul><ul><ul><li>Professor </li></ul></ul><ul><ul><ul><li>Set-up </li></ul></ul></ul><ul><ul><ul><li>Grading (SCORM) </li></ul></ul></ul><ul><li>Purpose </li></ul><ul><ul><li>Graded assessment </li></ul></ul><ul><ul><li>Self-assessment </li></ul></ul>
  30. 30. Demonstrations <ul><li>SAM </li></ul><ul><ul><li>http://sam2003.course.com </li></ul></ul><ul><li>Blackboard </li></ul><ul><ul><li>https://my.mc3.edu/ </li></ul></ul><ul><li>Textbook web sites </li></ul><ul><ul><li>Computer Science Concepts </li></ul></ul><ul><ul><ul><li>http:// csilluminated.jbpub.com / </li></ul></ul></ul><ul><ul><li>Information Literacy Concepts </li></ul></ul><ul><ul><ul><li>http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,1799886-,00.html </li></ul></ul></ul><ul><ul><li>Active Help Desk </li></ul></ul><ul><ul><ul><li>http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter03/index.html </li></ul></ul></ul><ul><ul><li>Accounting Textbook </li></ul></ul><ul><ul><ul><li>http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html </li></ul></ul></ul>

×