• Like
SGTS Theory 3 - Learning Outcomes, Assessment
Upcoming SlideShare
Loading in...5

Thanks for flagging this SlideShare!

Oops! An error has occurred.

SGTS Theory 3 - Learning Outcomes, Assessment


SGTS Theory Stream, Week 3 …

SGTS Theory Stream, Week 3
May 9, 2013
Learning Outcomes
Assessment that supports learning

Peter Newbury

Published in Education , Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads


Total Views
On SlideShare
From Embeds
Number of Embeds



Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

    No notes for slide


  • 1. Summer Graduate Teaching ScholarsMay 9, 2013Theory 3:Learning Outcomes and Assessment
  • 2. Scholarly approach to teaching:SGTS Theory Stream - collegeclassroom.ucsd.edu2Carl WiemanScience Education InitiativeWhat shouldstudentslearn?What arestudentslearning?What instructionalapproacheshelp studentslearn?learningoutcomes(goals, objectives)assessment
  • 3. (Image: NASA)SGTS Theory Stream - collegeclassroom.ucsd.edu3
  • 4. Introductory “Astro 101”This course covers Chapters1. Mercury2. Venus…8. Neptune9. other objects10. Formation of the SolarSystem deduce from patterns in theproperties of the planets,moons, asteroids and otherbodies that the SolarSystem had singleformation event. provide notable examplesof how comets influencedhistory, art and science4SGTS Theory Stream - collegeclassroom.ucsd.eduTraditional Course Syllabus Course with Learning Outcomes
  • 5. Learning outcomesSGTS Theory Stream - collegeclassroom.ucsd.edu5 completes the sentence, “By this end of thislesson/unit/course, you will be able to…” begins with an action verb (more below…) clarifies what it means to “understand” the concept deduce from patterns in theproperties of the planets,moons, asteroids and otherbodies that the SolarSystem had singleformation event.
  • 6. What is the Value of Course-SpecificLearning GoalsSGTS Theory Stream - collegeclassroom.ucsd.edu6What was the most interesting thing you learned fromSimon & Taylor? [1] thisOutcomes
  • 7. SGTS Theory Stream - collegeclassroom.ucsd.edu7Simon & Taylor (2009)
  • 8. Learning outcomes are valuable to theinstructor, too.SGTS Theory Stream - collegeclassroom.ucsd.edu8 crystallizes what prof actually cares about helped prof choose clicker questions for class write the final exam
  • 9. …choose clicker questions for classSGTS Theory Stream - collegeclassroom.ucsd.edu9ClassAction http://astro.unl.edu/classaction/
  • 10. …write the final examSGTS Theory Stream - collegeclassroom.ucsd.edu10(10 marks) List 3 patterns of the Solar System as awhole. Then, outline in some detail the current model forthe formation of the Solar System. In particular, makesure you explain how the observed patterns andregularities are related to this theory of formation.
  • 11. Writing LOs – The Easy WaySGTS Theory Stream - collegeclassroom.ucsd.edu11Astro 101 Learning Outcomes learn about SaturnAssess your LOs: “learn”? Learn what? how does a student demonstrate to you s/he has“learned about Saturn?” how does a student check that s/he has mastered theSaturn part of the course?
  • 12. Writing LOs – More Effective WaySGTS Theory Stream - collegeclassroom.ucsd.edu12Astro 101 Learning Outcomes describe in detail the size and structure of Saturn’srings step through the gravitational feedback cycle thatkeeps Saturn’s rings so thinAssess your LOs:1. Is this really what I want them to know?2. Are they capable of that?3. How do I assess their ability to demonstrate this LO?
  • 13. Deciding on the level of a LOSGTS Theory Stream - collegeclassroom.ucsd.edu13Writing learning outcomes is hard because you have to recognize declare (admit)what you want your students to be capable of doing.A good start is picking the verb describing the actionthe students will perform to demonstrate their masteryof the concept:
  • 14. Bloom’s Taxonomy [2,3]SGTS Theory Stream - collegeclassroom.ucsd.edu14RememberUnderstandApplyAnalyzeEvaluateCreatethink critically about and defend a positiontransform or combine ideas to createsomething newbreak down concepts into partsapply comprehension to unfamiliar situationsdemonstrate understanding of ideas andconceptsremember and recall factual information
  • 15. Bloom’s Taxonomy [2,3]SGTS Theory Stream - collegeclassroom.ucsd.edu15RememberUnderstandApplyAnalyzeEvaluateCreatehigher order thinkinglower order thinking
  • 16. Bloom’s Taxonomy [2,3]SGTS Theory Stream - collegeclassroom.ucsd.edu16RememberUnderstandApplyAnalyzeEvaluateCreatedevelop, create, propose, formulate,design, inventjudge, appraise, recommend, justify,defend, criticize, evaluatecompare, contrast, categorize, distinguish,identify, inferapply, demonstrate, use, compute, solve,predict, construct, modifydescribe, explain, summarize, interpret,illustratedefine, list, state, label, name, describe
  • 17. Driver’s Ed 101: How to Drive in CASGTS Theory Stream - collegeclassroom.ucsd.edu17The whiteboards on the tables are numbered. Yourgroup will concentrate on the question on the CaliforniaDMV Test [4] matching your board’s number.Task: Write a learning outcomethat your group’s question assesses.(Refer to Wieman handoutfor Bloom’s levels and corresponding verbs)
  • 18. Revised Bloom’s Taxonomy [2]18SGTS Theory Stream - collegeclassroom.ucsd.edu
  • 19. Vocabulary check: assessmentis that which gives a finaljudgment of evaluation ofproficiency, such as grades orscores.(How Learning Works, p. 139)explicitly communicates tostudents about some specificaspects of their performancerelative to specific targetcriteria, and … providesinformation that helps studentsprogress toward meeting thosecriteria…[It] informs students’subsequent learning.(How Learning Works, p. 139)19SGTS Theory Stream - collegeclassroom.ucsd.edusummative assessment formative assessment
  • 20. Feedback and Practice that EnhanceLearning (How Learning Works [5])20Writing – public policy coursePresentations on research – medical anthropologySGTS Theory Stream - collegeclassroom.ucsd.eduInstructors’ expertiseand bias not clear tostudents (or themselves)
  • 21. Feedback and Practice that EnhanceLearning (How Learning Works [5])21Solution: Goal-directed practice coupled with targetedfeedback are critical to learning.SGTS Theory Stream - collegeclassroom.ucsd.eduImages:Excellent Shot by Varsity Life on flickr CCMusic by Piulet on flickr CC
  • 22. Feedback and Practice that EnhanceLearning (How Learning Works [5])22Solution: Goal-directed practice coupled with targetedfeedback are critical to learning.[G]oals can direct the nature of focused practice, providethe basis for evaluating observed performance, and shapethe targeted feedback that guides students’ future efforts.(p. 127)[T]argeted feedback gives students prioritized informationabout how their performance does or does not meet thecriteria so they can understand how to improve their futureperformance.(p. 141)SGTS Theory Stream - collegeclassroom.ucsd.edu
  • 23. ScenariosSGTS Theory Stream - collegeclassroom.ucsd.edu23feedback atappropriate levelfeedback not atappropriate levelproductive practice unproductive practicepractice is goal-directed practice not goal-directedtimely feedback untimely feedbackFind the person with the samecolored sheet as you. Fill outthe sheet together.
  • 24. Feedback at Appropriate Level Feedback not at Appropriate Levelsport/hobby________________education__________________
  • 25. Productive Practice Unproductive Practicesport/hobby________________education__________________
  • 26. Practice Goal-directed Practice not Goal-directedsport/hobby________________education__________________
  • 27. Timely Feedback Untimely Feedbacksport/hobby________________education__________________
  • 28. Instructional Scaffolding28 Needs to be given BEFORE and BUILT INTO assignment Outlines what it takes to improve Supports Zone of Proximal Development [8]SGTS Theory Stream - collegeclassroom.ucsd.edu
  • 29. Appropriate Level of Challenge29Glued to Games [6]: Psychologicalexploration (and comparison witheducational practices) of characteristicsof games that drive people to spend timeand succeed.James Paul Gee [7] “What video gameshave to teach us about learning andliteracy”SGTS Theory Stream - collegeclassroom.ucsd.eduangrybirds.com
  • 30. SGTS Theory Stream - collegeclassroom.ucsd.edu30
  • 31. Clicker question31Does this rubric foster aA) fixed/performance mindsetB) growth/mastery mindsetC) neitherD) bothSGTS Theory Stream - collegeclassroom.ucsd.edu
  • 32. SGTS Theory Stream - collegeclassroom.ucsd.eduRobert Talberttinyurl.com/RobertTalbertRubric
  • 33. Instructional Scaffolding33 Rubrics support growth mindsets path to improvement goal-directed[G]oals can direct the nature of focused practice, providethe basis for evaluating observed performance, and shapethe targeted feedback that guides students’ future efforts. targeted feedback[T]argeted feedback gives students prioritized informationabout how their performance does or does not meet thecriteria so they can understand how to improve their futureperformance.SGTS Theory Stream - collegeclassroom.ucsd.edu
  • 34. Assessment Strategies…SGTS Theory Stream - collegeclassroom.ucsd.edu34 addressing the need for goal-directed practice addressing the need for targeted feedbackWork on the hand-out,thinking about what you’veexperienced or what youaspire to do in your field.
  • 35. Executive Summary:SGTS Theory Stream - collegeclassroom.ucsd.edu35Plan your courseby synchronizing andaligning your learningoutcomes, activities andassessments.What shouldstudentslearn?What arestudentslearning?What instructionalapproacheshelp studentslearn?
  • 36. ReferencesSGTS Theory Stream - collegeclassroom.ucsd.edu361. Simon, B., & Taylor, J. (2009). What is the Value of Course-Specific LearningGoals? Journal of College Science Teaching, 39, 2, 52-57. PDF available atwww.cwsei.ubc.ca/SEI_research/files/LifeSci/Simon_Taylor_ValueOfCourseSpecificLG.pdf2. Bloom B. S. (1956). Taxonomy of Educational Objectives, Handbook I: TheCognitive Domain. New York: David McKay Co Inc.Adapted from Anderson, L. W., & Krathwohl, D. R. (2001). A Taxonomy forLearning. Teaching, and assessing: A revision of blooms taxonomy of educationalobjectives.Revised Bloom’s Taxonomy www.celt.iastate.edu/teaching/RevisedBlooms1.html3. Excerpt from Wieman, C. (2007). Slides from the Wieman Learning GoalsWorkshop. www.cwsei.ubc.ca/resources/learn_goals.htm4. California DMV Sample Class C Written Test 5www.dmv.ca.gov/pubs/interactive/tdrive/clc6written.htm
  • 37. References, continuedSGTS Theory Stream - collegeclassroom.ucsd.edu375. Ambrose, S.A., Bridges, M.W., DiPietro, M., Lovett, M.C., & Norman, M.K. (2010).How Learning Works. San Fransisco: Jossey-Bass.6. Glued to Games: How Video Games Draw Us In and Hold Us Spellboundhttp://www.gluedtogames.com/7. Gee, J.P. (2005). Learning by Design: good video games as learning machines. E-Learning 2, 1, 5-16.8. Wertsch, J.V. (1984). The zone of proximal development: Some conceptual issues.New Directions for Child and Adolescent Development, 1984, 23, 7–18.
  • 38. Bloom’s Taxonomy of the Cognitive Domain(Levels of Learning) [Wieman, 2007]386. Synthesis: transform and combine ideas to create something newdevelop, create, propose, formulate, design, invent5. Evaluation: think critically about and defend a positionjudge, appraise, recommend, justify, defend, criticize, evaluate4. Analysis: break down concepts into partscompare, contrast, categorize, distinguish, identify, infer3. Application: apply comprehension to unfamiliar situationsapply, demonstrate, use, compute, solve, predict, construct, modify2. Comprehension: demonstrate understanding of ideas, conceptsdescribe, explain, summarize, interpret, illustrate1. Factual Knowledge: remember and recall factual knowledgedefine, list, state, label, name, describeSGTS Theory Stream - collegeclassroom.ucsd.edu