Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

High-Tech Assessment

1,517 views

Published on

Using online tools to measure learning outcomes.

Published in: Education, Business
  • Be the first to comment

  • Be the first to like this

High-Tech Assessment

  1. 1. High-Tech Assessment The tools to use
  2. 2. Objectives <ul><li>Recognize some high-tech assessment technologies. </li></ul><ul><li>Understand how they can be used effectively. </li></ul><ul><li>Know where to go for more information. </li></ul>
  3. 3. Traditional Pedagogy and Traditional Assessment <ul><li>Class lectures </li></ul><ul><li>Assigned reading </li></ul><ul><li>Individual projects </li></ul><ul><li>Papers and presentations </li></ul><ul><li>Tests, tests, tests </li></ul><ul><li>Class participation </li></ul><ul><li>Portfolios </li></ul>
  4. 4. Pedagogy and Assessment 2.0 <ul><li>Online courses </li></ul><ul><ul><li>Online quizzes </li></ul></ul><ul><ul><li>Online discussion forums </li></ul></ul><ul><li>Group projects </li></ul><ul><ul><li>ePortfolios </li></ul></ul><ul><ul><li>Online Discussion Forums </li></ul></ul><ul><li>On-demand online training </li></ul><ul><ul><li>Online quizzes </li></ul></ul><ul><ul><li>Response times for online tests </li></ul></ul><ul><li>Course management systems </li></ul><ul><ul><li>Online quizzes </li></ul></ul><ul><ul><li>ePortfolios </li></ul></ul><ul><ul><li>Online discussion forums </li></ul></ul><ul><ul><li>Audience response systems </li></ul></ul><ul><li>Podcasted lectures </li></ul><ul><ul><li>Download rates </li></ul></ul><ul><ul><li>Online discussion forums </li></ul></ul><ul><li>Gaming/Simulation </li></ul><ul><ul><li>Game scores </li></ul></ul><ul><ul><li>Response Times </li></ul></ul>
  5. 5. On-Demand Online Tutorials <ul><li>“ Screencasts” </li></ul><ul><li>Recorded demonstrations of using computer programs. </li></ul><ul><li>Camtasia </li></ul><ul><ul><li>Leading screencasting system. </li></ul></ul><ul><ul><li>Allows audio, video, highlights, mouse-clicks, etc. </li></ul></ul><ul><ul><li>Includes quiz function to assess learning. </li></ul></ul>
  6. 6. Examples of tutorial w/quiz in Libraries <ul><li>TILT </li></ul><ul><li>Park Library Online Tutorial </li></ul><ul><li>Colorado State </li></ul>
  7. 7. Online Quizzes <ul><li>Course Management Systems (CMS) </li></ul><ul><ul><li>Blackboard </li></ul></ul><ul><ul><li>Moodle </li></ul></ul><ul><li>Online survey systems </li></ul><ul><ul><li>SurveyMonkey (base version is free) </li></ul></ul><ul><li>Online Tutorials </li></ul><ul><ul><li>Camtasia </li></ul></ul><ul><li>Provides instant summaries of results. </li></ul><ul><li>Can track respondents’: </li></ul><ul><ul><li>Answers </li></ul></ul><ul><ul><li>When started/completed </li></ul></ul><ul><ul><li>Time on quiz </li></ul></ul><ul><ul><li>Time on question (some, not all) </li></ul></ul><ul><li>Assessment Uses </li></ul><ul><ul><li>Pre-test/Post-tests </li></ul></ul><ul><ul><li>Knowledge retained </li></ul></ul><ul><ul><li>Longitudinal assessment </li></ul></ul>
  8. 8. Online Quiz/Test Example
  9. 9. Learning Assessment
  10. 10. Audience Response Systems <ul><li>“ Clickers” </li></ul><ul><li>Enable anonymous or non-anonymous responses to ad-hoc questions during a lecture. </li></ul><ul><li>Can be used to assess learning and direct course of lecture. </li></ul><ul><li>Often integrated with MS Office programs </li></ul><ul><ul><li>PowerPoint for presentation </li></ul></ul><ul><ul><li>Excel for reporting </li></ul></ul><ul><li>… and Class Management Systems </li></ul>
  11. 11. Demo of ARS and ARS in Libraries <ul><li>Quizdom Remotes Demo </li></ul><ul><li>Lehigh University Library </li></ul><ul><li>Dickinson College </li></ul>
  12. 12. Learning Assessment
  13. 13. ePortfolios <ul><li>Digital repository of work completed by student. </li></ul><ul><li>Meant to assess progress “as a whole.” </li></ul><ul><li>Often included with CMS </li></ul><ul><ul><li>Blackboard </li></ul></ul><ul><li>Other tools: </li></ul><ul><ul><li>Wikis (PBWiki – cheap and easy to use) </li></ul></ul><ul><ul><li>Blogs (MovableType) </li></ul></ul><ul><ul><li>Digital Archives (DSpace – campus-wide implementation) </li></ul></ul>
  14. 14. Examples of ePortfolios <ul><li>Polaris (UT) </li></ul><ul><li>ePortfolio at LaGuardia </li></ul><ul><li>Valdosta State </li></ul><ul><ul><li>Assessment of instruction services </li></ul></ul><ul><ul><li>Article in Reference Services Review </li></ul></ul><ul><li>UNISA </li></ul><ul><ul><li>Research Information Skills in distance ed class </li></ul></ul><ul><ul><li>Article in Education for Information </li></ul></ul>
  15. 15. Gaming/Simulation <ul><li>Simulation of real-world experiences </li></ul><ul><li>Good for assessing higher-ordered thinking skills </li></ul><ul><li>Formative assessment is better. </li></ul><ul><ul><li>Based on choices made. </li></ul></ul><ul><ul><li>Can be used to compare with others. </li></ul></ul><ul><li>Other measures </li></ul><ul><ul><li>Completion time </li></ul></ul><ul><ul><li>Self-correction rates </li></ul></ul>
  16. 16. Examples of Gaming in Libraries <ul><li>UNC Greensboro (a Web-based board game) </li></ul><ul><li>Ohio State – set of games to assess learning. </li></ul><ul><li>Arizona State University – developing a simulation game </li></ul><ul><ul><li>Quarantined </li></ul></ul>
  17. 17. Learning Assessment
  18. 18. Online Discussion Forums <ul><li>Similar to class participation </li></ul><ul><li>Can be scheduled or unscheduled </li></ul><ul><li>Better to be synchronous </li></ul><ul><li>Assessment measures: </li></ul><ul><ul><li>Quality of participation </li></ul></ul><ul><ul><li>Quantity of participation (minutes, lines, etc.) </li></ul></ul><ul><ul><li>Frequency of participation </li></ul></ul>
  19. 19. Demo of Online Discussion Forum in Libraries
  20. 20. Tool Summary <ul><li>Online Quizzes/Tests </li></ul><ul><ul><li>Similar to paper-based. </li></ul></ul><ul><ul><li>CMS or SurveyMonkey </li></ul></ul><ul><ul><li>Good for “open-book” tests. No checks for “cheating”. </li></ul></ul><ul><ul><li>Better at assessing lower-ordered thinking skills </li></ul></ul><ul><li>Recorded Demonstrations </li></ul><ul><ul><li>Good for short segments of training. </li></ul></ul><ul><ul><li>Better for demonstrations. </li></ul></ul><ul><ul><li>Include a quiz for assessment. </li></ul></ul><ul><ul><li>Not good for difficult topics. </li></ul></ul>
  21. 21. More Tools Summary <ul><li>ARS </li></ul><ul><ul><li>Useful for continuous feedback from students to guide lecture. </li></ul></ul><ul><ul><li>Good for assessing the class/course. </li></ul></ul><ul><li>Gaming/Simulation </li></ul><ul><ul><li>Better at assessing higher-order thinking skills. </li></ul></ul><ul><ul><li>Complex to create. </li></ul></ul>
  22. 22. References <ul><li>Wikipedia </li></ul><ul><ul><li>ePortfolio </li></ul></ul><ul><li>EDUCAUSE </li></ul><ul><ul><li>E-Portfolios (a bit old, but still has some good background) </li></ul></ul><ul><ul><li>Gaming </li></ul></ul><ul><ul><li>Screencasting </li></ul></ul><ul><ul><li>ARS </li></ul></ul><ul><li>E-Portfolios for Learning blog </li></ul><ul><li>Proof of learning: Assessment in Serious Games </li></ul><ul><li>ePortfolios: Hi-Octane Assessment </li></ul><ul><li>Bibliographic Gaming </li></ul><ul><li>Game on: Games in Libraries </li></ul>
  23. 23. More References <ul><li>Leach, Guy J and Tammy S. Sugarman. 2006. Play to win! Using games in library instruction to enhance student learning. Research Strategies , v. 20(3):191-203. </li></ul><ul><li>Fourie, I. and van Niekerk, D. (1999). Using portfolio assessment in a module in research information skills. Education for Information , 17(4), pp. 333-352. </li></ul><ul><li>Chapman, J. M., Perrway, C., and White, M. (2001) The portfolio: an instruction program assessment tool . Reference Services Review, 29, 294-300 . [CrossRef] </li></ul>
  24. 24. Vendor List <ul><li>Online Testing </li></ul><ul><ul><li>Blackboard </li></ul></ul><ul><ul><li>SurveyMonkey </li></ul></ul><ul><li>Screencasting/Online Tutorials </li></ul><ul><ul><li>Camtasia </li></ul></ul><ul><ul><li>Adobe Captivate </li></ul></ul><ul><li>ePortfolios </li></ul><ul><ul><li>Blackboard </li></ul></ul><ul><ul><li>Dspace </li></ul></ul><ul><ul><li>OpenSource Portfolios (OSP) </li></ul></ul><ul><li>Audience Response Systems </li></ul><ul><ul><li>TurningPoint </li></ul></ul><ul><ul><li>Quizdom </li></ul></ul>

×