Closingthe loop


Published on

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • (Its not so easy to quantify analysis in the Humanities disciplines.)
  • Garth helped A TON with this.
  • Good because well documented. You can see evolution in the paperwork.
  • Closingthe loop

    1. 1. Closing the Loop on Course Level Assessment.
    2. 2. <ul><li>For more examples, please join the MyCR Assessment site . </li></ul><ul><li>All assessment documents collected from faculty are organized by discipline. </li></ul>
    3. 3. Process Overview 2009-2011 <ul><li>Art 2: Introduction to Art </li></ul><ul><li>An introductory course designed to provide students with studio and lecture experience in the visual arts. Concepts covered include line, value, composition, color and both 2 and 3-dimansional space. Media used include drawing, painting, printmaking, ceramics, sculpture and new media. </li></ul>
    4. 4. SLO #5: Depict and verbally describe the concepts of line, composition, shape, value, space, and color for representational and non-representational image making in two and three dimensions. Course Student Learning Outcomes measured
    5. 5. 2 full-time faculty (Shannon Sullivan, Garth Johnson) and 2 part time faculty (Dean Smith, Kit Davenport) gathered on December 10, 2009. Each faculty member teaching a section of Art 2 during the fall 2009 semester selected 10 student artworks from the final portfolio review. Professors were careful to randomly select works from a range of students and projects . Each professor arranged his or her work in a group and each artwork was labeled #1-30. ASSESSMENT TOOL/ ASSIGNMENT Describe briefly and/or attach a copy of the assignment, if possible
    6. 6. Faculty members discussed the broad, overarching concepts that make up SLO #5, and decided to place each work in one of three categories: 1: The student is demonstrating an outstanding attainment of SLO #5 2: This student is demonstrating an average attainment of SLO #5 3: The student is not demonstrating an attainment of SLO #5 Rubric or Criteria for Evaluation Describe briefly and/or attach a copy of rubric
    7. 7. 65% of students demonstrated outstanding attainment of SLO #5, 30% of students demonstrated an average attainment of SLO #5, and 5 % of the students demonstrated no level of attainment of SLO #5. The 4 instructors took note that many students were performing beyond the limits of the assignments. Many students demonstrated conceptual innovations and technical excellence . The 4 instructors determined that an placing an emphasis on avoiding subject matter Clichés when approaching a project is important to improve student performance. Instructors discussed the dynamics of collaborative projects . Professor Garth Johnson did some experimentation with collaborative sculpture and found it to be a great way build community within the class . ASSESSMENT RESULTS In general, describe how students performed on the assignment. (Include performance data if applicable In what areas was student performance outstanding? In what areas should student performance be improved? Describe any unaddressed student needs or issues that the assessment revealed.
    8. 8. X-Revise course content and/or assignments □ Revise activities leading up to and/or supporting assignment/activities □ Increase guidance for students as they work on assignments □ Revise the amount of writing/oral/visual/clinical or similar work X-State goals or objectives of assignment/activity more explicitly □ State criteria for grading more explicitly X-Employ different/revised teaching methods (Explain below) □ Increase/improve in-class discussions and activities □ Increase/improve student collaboration and/or peer review □ Provide more frequent and/or more effective feedback on student progress □ Encourage more interaction with students outside of class X-Seek out collegial feedback on assignments/activities □ Collect more data □ Nothing; assessment indicates no improvement necessary □ Other (please describe) Additional Explanation: 1.Continue to incorporate digital technologies such as google docs, you tube, and Art Stor 2. Encourage student knowledge of historical and contemporary art trends by assigning student research presentations on course related topics. 3. Tour students around the Creative Art facilities. This extra effort encourages students to engage deeply in their material and in our discipline. NEXT STEP(S) TO IMPROVE STUDENT LEARNING How will you address the needs and issues that were revealed by your assessment? What are your plans and strategies for improving student learning? Check all that apply
    9. 9. This assessment activity was completed in December of 2009 and implementation began the following spring semester of 2010. One year passed before we took a look at how the assessment findings have permeated In the spring of 2011, a survey was given out to all instructors who had taught Art 2 during the spring 2011 semester. Here are the questions from the survey: IMPLEMENTATION Describe the departmental plans to implement these priorities.
    10. 10. <ul><li>1. In the Spring 2009 assessment activity, the participants suggested that faculty continue to incorporate digital technologies such as google docs, you tube, and Art Stor. Have you been using these technologies on at least a couple of occasions in your class? </li></ul><ul><li>2. In the Spring 2009 assessment activity, the participants suggested that faculty continue to encourage student knowledge of historical and contemporary art by assigning student research presentations on course related topics. How have you been incorporating historical and contemporary trends in your course? </li></ul><ul><li>3. In the Spring 2009 assessment activity, the participants suggested that faculty tour students around the Creative Arts facilities. Have you toured your students in CA? </li></ul><ul><li>4. In the Spring 2009 assessment activity, the participants suggested that faculty continue seek out collegial feedback on course related activities. Have you had dialogue with other instructors who teach Art 2? </li></ul><ul><li>5. In the Spring 2009 assessment activity, the participants suggested that faculty continue to revise course content and/or assignments to improve student success. What have you changed to improve your course? </li></ul>
    11. 11. We had 4 faculty involved in the initial course level assessment. One year later when it became time to close the loop, 4 instructors were teaching Art 2 and 3 of them replied to the survey. Two of these four instructors were participants in the initial assessment activity.
    12. 12. <ul><li>Here is a summary of the responses: </li></ul><ul><li>1. All instructors are actively using digital technologies in their courses . All faculty surveyed use MyCR for posting course related materials. Respondents cited using google docs, slideshare, You Tube, and Netflix to expand the possibilities of their course . </li></ul><ul><li>2. All three faculty respondents incorporated historical and contemporary art trends in their courses and have found unique assignments to foster student learning about this topic. One instructor assigns a contemporary artist research assignment by having students select a keyword that corresponds to an artist. Another instructor uses art periodicals , such as Art in America, for her students to an write informational summery. Another instructor assigns a gallery review project where students attend a local art event. </li></ul><ul><li>3. All three instructors made strong efforts to familiarize students with the art department as a whole. Some instructors utilized various studios to teach their course, others made official tours of the department , and all were able to connect with the ceramics department for viewing and participating in special firings such as raku, pit firing, and wood firing. </li></ul><ul><li>4. All of the respondents reported active collegial interactions such as broadcasting local and campus events, inviting colleagues into class, trading assignments, and encouraging students to participate in the juried student exhibition. </li></ul><ul><li>5. Respondents reported incorporating new online course content including videos and web content. All three instructors are continuously altering course content to improve student success </li></ul>
    13. 13. A useful assessment? Yes…
    14. 14. How could it have been better for faculty trying to improve student learning and success?
    15. 15. Keep everyone in the loop!
    16. 16. <ul><li>One associate faculty member teaching Art 2 during the spring 2010 semester reported feeling “out of the loop” when she received the survey for closing the loop. </li></ul><ul><li>It had been a year since we performed the first course level assessment, and while the assessment information had been passed to all Art 2 faculty for fall 2009, it was not passed to new instructors for the spring 2010 semesters. </li></ul><ul><li>Lesson learned: effective assessment involves regular departmental communication ! </li></ul>
    17. 17. Now that I’ve summarized the process of creating an assessment activity and closing the loop, Cindy is going to discuss closing the loop using data from IR
    18. 18. Closing The Loop on an Art 17 (Drawing) Assessment Activity
    19. 20. This is how we “quantified” our analysis:
    20. 21. These are the conclusions we came to:
    21. 22. <ul><li>Results from an anonymous follow-up survey (conducted two years later): </li></ul><ul><li>We all now include color theory principles among our assignments. </li></ul><ul><li>We all include abstraction-based and postmodern/conceptually themed assignments. </li></ul><ul><li>We all use technology-based instruction, but are not yet sure about technology-based assignments. </li></ul>
    22. 23. A data set that tracks Art 17 student success data from 3 years before and 3 years after the assessment activity:
    23. 24. What should we do with this disappointing data?
    24. 25. Try to assess a different Art 17 SLO to see if positive changes occur?
    25. 26. Reevaluate/modify our existing Art 17 SLOs?
    26. 27. Reevaluate our initial assumptions?
    27. 28. Are factors outside of our assessment efforts responsible for this trend?
    28. 29. We did get something accomplished, though—according to our new Assessment Handbook:
    29. 30. (Our mutual commitment to technology-based instruction.)
    30. 31. (Our discussion is helping us develop a departmental philosophy statement.)
    31. 32. (We did more closely coordinate our Art 17 curriculum.)
    32. 33. And here’s Erin with another example…
    33. 34. Closing the Loop in Mathematics
    34. 35. Math 55 (Math 45) <ul><li>Math 55- Differential Equations (Fall 2009) </li></ul>Assessment Tool: Math 55 (Differential Equations) is offered once a year in the spring. The student clientele in this class is comprised of mathematicians, engineers, and scientists, all of whom have had a minimum of two courses in calculus.   In order to assess SLO's #1, 2, 3, 5, and 6, students in the Spring of 2009 were assigned a term project. Students were required to investigate a real-world application of differential equations, write a paper on the topic, and present a 15-minute talk on their topic, to be accompanied by presentation slides prepared in advance.
    35. 36. Other Details <ul><li>Smaller Project first using LaTex. The guidelines and requirements for this project can be found online at the </li></ul><ul><li>Timeline for Term Project and Presentation. </li></ul>
    36. 37. Assessment Results <ul><li>All of the students successfully completed their term projects and presentations on time. Student work, both term papers and presentation slides, can be viewed at the following URL: </li></ul><ul><li> </li></ul>
    37. 38. 1 st : A large amount of time was wasted in the opening week or two as students tried to find a suitable model for their first project. For comparison, students in the Fall 2009 Math 45 (Linear Algebra) class were assigned a specific task for their opening introduction to the LaTeX document preparation system. This was highly successful, allowing students to get started with LaTeX much earlier. We recommend that future instructors in differential equations use this strategy in the future. Two Problem Areas to Address:
    38. 39. 2 nd : Another difficulty that presented itself was the fact that students had a hard time choosing an application of appropriate difficulty for their term project. Some chose topics that were too trivial, others chose topics that were too difficult to tackle in a semester's time. For comparison, in the fall of 2009 in Math 45 (Linear Algebra), the instructor hand-picked a number of papers and allowed the students to choose from this collection during the first class meeting. Hopefully, this strategy will allow students an early start and they can focus on the learning rather than running about looking for a suitable project on their own. *These changes will be implemented in Spring 2010*
    39. 40. Result of the Proposed Changes (From Spring 2011 Program Review) Over the past several semesters, additions and edits to the department written “Student Term Project Timeline’’ have enabled students to address their paper and presentation throughout the semester, instead of waiting until the last minute to rush out a poor result. This has helped to greatly improve students’ effort on their term project. Student work can be viewed at the following URL’s: and . It is noteworthy to examine the development and improvement in student work over the course of the past 13 years.
    40. 41. Another Example, Math 120 <ul><li>Current SLOs </li></ul><ul><li>1. Students should be able to read, write, and speak accurately about mathematical ideas using correct mathematical notation. </li></ul><ul><li>2. Students should be able to apply the mathematics they have learned to real-world problems and applications. </li></ul><ul><li>3. Students should be able to use graphs and the graphing calculator to explore mathematical concepts and to verify their work. </li></ul><ul><li>4. Students should be able to demonstrate competency in the required prerequisite skills for all transfer level math courses. </li></ul><ul><li>5. Students should be able to demonstrate the characteristics of an effective learner, such as note-taking, critical reading, etc. </li></ul><ul><li>6. Students should be able to explain the concept of function, identify the characteristics of different classes of functions, and use functions to solve problems in mathematics. </li></ul><ul><li>7. Students should be able to demonstrate the algebraic skills that will support success in the other outcomes. </li></ul>
    41. 42. Proposed Changes: Math 120 SLOs <ul><li>1. Evaluate and interpret general functions symbolically, numerically, and graphically. Identify the domain and range using interval notation. </li></ul><ul><li>2. Sketch a collection points and a line of best fit, then find and interpret the equation by hand and by use of technology. </li></ul><ul><li>3. Produce an accurate graph of a quadratic function by hand, and identify all salient features. </li></ul><ul><li>4. Sketch the graph of a polynomial function by hand by identifying the zeros and the end behavior. </li></ul><ul><li>5. Sketch the graph of rational functions, simplify mathematical expressions involving rational functions and solve rational equations. </li></ul><ul><li>6. Given exponential and logarithmic functions, sketch accurate graphs and solve equations and applications. </li></ul><ul><li>7. Simplify mathematical expressions involving square roots, sketch the graphs and solve equations involving square root functions. </li></ul>
    42. 43. For More Information <ul><li>Attend the next session: </li></ul><ul><li>Refining Student Learning Outcomes at the Course and Program Level </li></ul><ul><li>(AT103/104) </li></ul>
    43. 44. Future <ul><li>Complete course outline update for Math 120. </li></ul><ul><li>Update Math 380 and Math 376 outlines using the same process piloted for Math 120 (Course Meetings) </li></ul><ul><li>Add Assessment Information to Course Pages and Department Repository (Improved Communication) </li></ul><ul><li>Working our 5-Year Plans </li></ul>