Assessment II:Moving from Theory to Practice<br />April 14, 2011<br />Ken Doxsee, Academic Affairs<br />and<br />Jason Schreiner, Teaching Effectiveness Program<br />
Overview<br />Motivation – The value of assessment<br />Curriculum mapping – the concept<br />Samples of curriculum maps<br />Creation of a curriculum map<br />Steps and strategies<br />Establishing outcomes at the Department or Program level<br />
Resources<br />University of Oregon Assessment Workshop Slides<br />http://assessment.uoregon.edu/node/70<br />University of Hawaii Manoa Curriculum Mapping/Matrix<br />http://manoa.hawaii.edu/assessment/howto/mapping.htm<br />University of West Florida Center for Teaching, Learning and Assessment<br />http://uwf.edu/cutla/curriculum_maps.cfm<br />Boise State University<br />http://ctl.boisestate.edu/programs/CurriculumRevision.asp<br />http://ctl.boisestate.edu/maps/Faculty_Program-Level_Outcomes.pdf<br />
Student Experience at the Research University Survey (SERU)<br />Origins in U of California system – UCUES<br />Extension to AAU institutions<br />Oregon, Texas, Florida, Pitt, Rutgers, Michigan, Minnesota<br />Highlights<br />Annual analysis of student self-reported observations and experience<br />Target population – all undergraduates<br />Data drillable to individual department level<br />2010 UO SERU – ca. 3,800 student responses<br />
SERU Focus Areas<br />Satisfaction with Educational Experience<br />Current Skills Self-Assessment<br />Gains in Self-Assessment of Skills<br />Development of Scholarship<br />Understanding Other Perspectives<br />Research Experiences<br />Quantitative Skills<br />Use of Time / Academic Disengagement<br />
UO Students Think They Learn A Lot<br />Does that make you wonder if it’s true?<br />If so, when do these gains occur?<br />
Time spent in class (blue) and out of class on academic pursuit (red), relative to UO average<br />*<br />*<br />*<br />*<br />*<br />*<br />*<br />* = n < 10<br />Time Utilization<br />
Time spent in class (blue) and out of class on academic pursuit (red), relative to UO average<br />*<br />*<br />*<br />* = n < 10<br />Time Utilization<br />
Time spent in class (blue) and out of class on academic pursuit (red), relative to UO average<br />B<br />B<br />B<br />*<br />* = n < 10<br />B = Bend campus offering<br />Time Utilization<br />
Curriculum Mapping<br />A method to align instruction in courses with desired program-level outcomes and to support decision making about the curriculum. <br /><ul><li>Are the objectives aligned with the curriculum?
Is the curriculum aligned with overall objectives?
What is the relationship between what students do in their courses and the program’s learning objectives?
Identification of gaps (or overemphasis) can lead to curricular change, offering promise for improved student learning and attenuated faculty workloads.</li></li></ul><li>Benefits of Curriculum Mapping<br />Improves program coherence.<br />Increases the likelihood that students achieve program level outcomes.<br />Documents what is taught and when.<br />Reveals gaps and redundancies in the curriculum.<br />Assists the program in making informed decisions regarding the curriculum.<br />Helps design an assessment plan.<br />
Types of Curriculum Maps<br />“Yes or no”<br />“Intensity scale”<br />E.g., Introduced/Developing/Mastering<br />E.g., Basic/Intermediate/Advanced<br />Scales of maps<br />Alignment of course assignments with course or program goals<br />Alignment of course goals with program goals<br />Curricular alignment with program goals<br />
Developing and Using aCurriculum Map<br />Develop/confirm program-level student learning outcomes.<br />List recommended and required courses, including Core/LFL courses.<br />Create the map in the form of a table.<br />Mark courses that currently address these outcomes indicating the level at which the outcomes are addressed (and how they are assessed, if you wish).<br />Analyze the map, noting gaps, redundancies, and areas where additional information is needed.<br />Gather additional information including evidence related to student achievement of the outcomes.<br />Use the map to make decisions about the program’s curriculum and assess its effectiveness.<br />
Program Core Outcomes<br />Communication: oral (speaking/listening) and written (reading/writing)<br />Interpersonal: collaboration, leadership<br />Problem-solving: application of content/methods to a variety of contexts<br />Critical thinking: application of inquiry/methods to a variety of contexts<br />Information literacy: how to use information (computer, library, media, technical, modeling, etc.)<br />
Program Core Outcomes<br />Multicultural awareness: respecting others and multiple views<br />Intellectual flexibility: open to new ideas and adaptive to changing environments<br />Methods: inquiry process, evidence gathering and assessment, statistics, etc.<br />Ethics: world, personal, research<br />Responsibility: well-rounded character, civic engagement, etc.<br />
Examples<br />Vague: The student will gain knowledge of automated chemistry tests.<br />Specific: The student will state the principle for each automated chemistry test listed.<br />
Examples<br />Vague: The student will be familiar with red blood cell maturation in the bone marrow. <br />Specific: The student will diagram the maturation of red blood cells.<br />
Examples<br />Vague: The student will become familiar with theories of population growth.<br />Specific: The student will compare and contrast neo-Malthusian, modernization, and distributionist theories of population growth. <br />
Examples<br />Vague: The student will understand the benefits of various exercise modalities for an elderly person.<br />Specific: The student will determine the most appropriate exercise modality for health maintenance in a patience who is elderly. <br />
Drafting Process<br />Draft: Students will be familiar with the major theories of the discipline<br />Revision 1: Students will be familiar with withdrawal, smoothing, forcing, compromising, and problem solving<br />Revision 2: Students will summarize the concepts of withdrawal, smoothing, forcing, compromising, and problem solving<br />Specific: Students will summarize the five major approaches to conflict resolution: withdrawal, smoothing, forcing, compromising, and problem solving<br />Higher order thinking objective: Students will choose and defend a conflict resolution approach appropriate for a given situation<br />
Course Example<br />This course is designed to facilitate your learning and practice of essential knowledge and skills for engaging in critical social and environmental inquiry or ‘critical environmental studies.’ If you invest your time and effort fully in meeting course expectations and requirements, you should finish the term being able to:<br />Recognize and describe environmental problems <br />Examine and diagnose social ‘root causes’ of environmental problems<br />Appraise potential solutions for addressing environmental problems<br />Articulate viable courses of action for addressing environmental problems<br />Use your own voice to contribute meaningful ideas to public discourse about environmental issues<br />Summarize and critique major social scientific interpretations of environmental change<br />