Linking Objectives and Outcomes Assessment in Electronic Learning


Published on

This short presentation was given recently at the University of South Alabama Conference on Teaching and Learning (May 2011).

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Linking Objectives and Outcomes Assessment in Electronic Learning

  1. 1. Linking Objectives and Outcomes Assessment in Electronic Learning Bret M. Webb, Ph.D. Civil Engineering
  2. 2. Think about your last class… <ul><li>Can you list what YOU covered? </li></ul><ul><li>Can you list what the STUDENTS learned? </li></ul>Why is Question 1 easier to answer than Question 2 ?
  3. 3. Eating the Elephant <ul><li>Course outcomes are broad and conceptual </li></ul><ul><li>Each course outcome requires intermediate steps </li></ul><ul><li>In order to “eat the elephant,” you have to know where to start, and how big of a bite to take… </li></ul><ul><li>Use learning objectives! </li></ul>
  4. 4. Operational Definition Lesson Content Stated in Learning Terms <ul><li>Describes what the learner should be able to do after: </li></ul><ul><ul><li>Completing the reading assignments </li></ul></ul><ul><ul><li>Attending class (regularly) </li></ul></ul><ul><ul><li>Completing homework assignments </li></ul></ul><ul><li>Typically 2 to 4 per 50-minute class </li></ul>
  5. 5. Learning Objectives <ul><li>Start with action verbs </li></ul><ul><li>Use quantifiable language </li></ul><ul><li>Use complete and simple sentences </li></ul><ul><ul><li>Verb = process/behavior </li></ul></ul><ul><ul><li>Noun = knowledge to acquire or construct </li></ul></ul>Let Bloom be your guide…
  6. 6. Bloom’s Taxonomy of Educational Objectives* *Includes refinements by Anderson et al. (2001). Remember Comprehend Apply Analyze Synthesize Evaluate explain, paraphrase calculate, solve, determine, apply compare, classify, derive, model design, improve, propose justify, assess, recommend
  7. 7. An Example… <ul><li>Define steady-state, conservative, scalar, vector, total head, Reynolds number, and relative roughness. </li></ul><ul><li>Recall the equations of continuity and momentum. </li></ul><ul><li>Apply continuity to solve for velocity and discharge. </li></ul>
  8. 8. So What? <ul><li>Undergraduate education focuses on the lower levels of cognitive ability. </li></ul><ul><ul><li>Knowledge, comprehension, application </li></ul></ul><ul><li>Ideally, all levels should be addressed in every course </li></ul><ul><li>Ideally, all levels should be assessed in every course </li></ul>
  9. 9. Learning Objectives as Tools <ul><li>Use them to prepare: </li></ul><ul><ul><li>Quizzes, assignments, exams </li></ul></ul><ul><li>Use them to assess: </li></ul><ul><ul><li>Performance </li></ul></ul><ul><li>Use them for feedback: </li></ul><ul><ul><li>Fairness? </li></ul></ul>Key: L.O. #. L.O. (Bloom Level) [Practice] {Exam Problem}
  10. 10. Exam Assessment
  11. 11. Exam Assessment What happened here?
  12. 12. Electronic Delivery <ul><li>Screencast software </li></ul><ul><li>USB pen tablet </li></ul><ul><li>A webcam (opt.) </li></ul><ul><li>A good microphone </li></ul><ul><ul><li>USB seems to work well </li></ul></ul>
  13. 13. Impact of Podcasts… <ul><li>Four years of exam results are compared to describe the impact of podcasts on learning outcomes in an undergraduate class. </li></ul>
  14. 14. Impact of Hybrid Delivery… <ul><li>Two years of graduate exam averages have been used to determine, preliminarily, the impact of hybrid course delivery methods on learning outcomes. </li></ul>
  15. 15. Summary <ul><li>Linking objectives and outcomes requires a consistent rubric for evaluation </li></ul><ul><li>Summative and formative assessment can be achieved when both are evaluated relative to a consistent benchmark </li></ul><ul><li>The impact of podcasts on content-specific learning outcomes appears to be positive </li></ul><ul><li>The impact of hybrid course delivery on broad learning outcomes appears to be positive </li></ul>
  16. 16. Thank you… <ul><li>Questions? Comments? Please contact me for more information… </li></ul><ul><li>Bret M. Webb, Ph.D. </li></ul><ul><li>Assistant Professor of Civil Engineering (251) 460-7507 </li></ul><ul><li>University of South Alabama [email_address] </li></ul><ul><li>Mobile, AL 36688 </li></ul>
  17. 17. References <ul><li>Bloom, B.S., M.D. Engelhart, E.J. Furst, W.H. Hill, and D.R. Krathwohl (1956). Taxonomy of educational objectives: Handbook 1: Cognitive domain. New York: David McKay. </li></ul><ul><li>Anderson, L.W., D.R. Krathwohl, P.W. Airasian, K.A. Cruikshank, R.E. Mayer, P.R. Pintrich, J. Raths, and M.C. Wittrock (2001). A Taxonomy for Learning,“Teaching, and Assessing-A Revision of Bloom's Taxonomy of Educational Objectives.” Addison Wesley Longman. </li></ul>
  18. 18. Assessment Made Simple A Quick In-Class Exercise <ul><li>Consider using the “Muddiest Point” exercise </li></ul><ul><li>With a few minutes left at the end of class, ask students to respond (in writing) to the following prompt: </li></ul><ul><ul><li>Name one thing you understand well (clear) </li></ul></ul><ul><ul><li>Name one thing you understand poorly (muddy) </li></ul></ul>
  19. 19. Muddiest Point Results (typ)
  20. 20. Revisit Your Learning Objectives <ul><li>Define learning objective. </li></ul><ul><li>Classify learning objectives according to Bloom’s Taxonomy. </li></ul><ul><li>Construct a learning objective. </li></ul><ul><li>Appraise the usefulness of learning objectives. </li></ul>
  21. 21. Our Learning Objectives ( on learning objectives ) <ul><li>Define learning objective. </li></ul><ul><li>Classify learning objectives according to Bloom’s Taxonomy. </li></ul><ul><li>Construct a learning objective. </li></ul><ul><li>Appraise the usefulness of learning objectives. </li></ul>