Documenting Teaching Effectiveness

989 views
922 views

Published on

Published in: Education, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
989
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
19
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Documenting Teaching Effectiveness

  1. 1. Documenting Evidence of Teaching / Page 1 Documenting Teaching Effectiveness: Sources of Data Instructor Self Assessment – your perceptions of your teachingi  Course Portfolio – developmental, what you want to think about/know more aboutii  Teaching Portfolio – evaluative, what reviewers want to know/assessiii  Teaching Journal – critically reflective teacher/teachingiv  Expanded Teaching Philosophy – to serve as reflective introduction to dossier Student Perceptions – student perceptions of your teaching  Midterm / Early term student feedback  End-of-Term Student Ratings of Teaching  On-going collection of in-class feedback through short evaluation surveys (eg, new assignments, use of readings, delivery of class session; Likert & open ended)  Critical Incident Questionnaire o At what point in class this week did you feel most engaged with what was happening? o At what point in class this week did you feel most distanced from what was happening? o What action that anyone (teacher or student) took in class did you find most affirming & helpful? o What action that anyone (teacher or student) took in class did you did most puzzling or confusing? oWhat about class this week surprised you the most? (From your own reactions to what went on, to something that someone did, or to anything else that occurs to you as you write now.) Student Learning – student perceptions of learning as a result of teaching  Student Feedback through Consensusv  Develop Classroom Assessment Techniques (CATs) to gather student perceptions of their own learning and of teaching effectiveness related to particular practices recurring in class sessions, across a new segment/unit in course, in activities or assignments (eg, interactive lecture technique, coherence of lecture notes across a new segment of course, use of peer response groups, on grading practices/rubric, on use of suggested resources)  Evidence of student achievement (national exams/benchmark outcomes, grad school placement, thesis completion, student retention/completion; UROP)  Localize National Survey of Student Engagement (NSSE) benchmarks such as use of high impact activities that "require that students engage in substantive matters while actively interacting and collaborating with faculty and their peers"  Develop measures that allow for addressing and analyzing particular forms of resistance to learning and for aligning student/teacher expectations – consider whether students expect that you will address, for example, race, class, sexuality in your course? expect that engaged learning will be the norm for this course? expect to write even if this is not a writing intensive course?
  2. 2. Documenting Evidence of Teaching / Page 2 Peer / Colleague Review – peer perceptions of your teaching / learning  Classroom observation – teaching peers, cohort faculty  Lesson Study Project (http://www.uwlax.edu/sotl/lsp/)  Review of instructional materials; syllabus, assignments, exams (Peer Review Project: www.courseportfolio.org/)  Review of innovative uses of technology; contributions to distance learning  Review of engaged pedagogies/approaches to non-traditional students' and learning (eg, service learning, study abroad, multicultural teaching and learning)  Mentoring activities – whether being a mentor or a mentee  Development of teaching- and/or learning-related workshop for peers  Peer-reviewed teaching/learning article accepted or grant accepted Teaching / Learning Resources – research-based perceptions of learning  Engagement with disciplinary journals related to teaching, from course design to assessment of courses, teaching and learning (eg, incorporation into teaching approach, formation of journal club, participation in learning community)  Pursuit of a teaching-related research question to address via Scholarship of Teaching & Learning  Participation in faculty professional development programming (eg, career programs, New Faculty Orientation, teaching with writing or technology workshops, multicultural teaching and learning fellowships/ research programs) Administrative Perspective – perceptions of teaching role & excellence  Dossier Requirements/Data to Document Administrative Guidelines (as set by department, college and/or university-wide policy)  Evaluative Teaching Portfolios  Data from curriculum assessment Summarizing by Graphic Displays Assemble graphs with an explanation: include number of students, dates the courses were taught, qualities that are being evaluated. A main feature of graphs is that they should be clear, not cluttered. Depending on your audience, include all courses taught over a certain period of time (promotion and tenure purposes) or only a select number (applying for a faculty job) in order to showcase the courses you've actually designed. Either way, it will be important to describe which courses you've chosen to include and why. See image on next page. Credit: http://ucat.osu.edu/read/teaching-portfolio/feedback#samples.
  3. 3. Documenting Evidence of Teaching / Page 3 Plotting Means of Course Evaluations At the Center for Teaching Effectiveness we have found it useful to plot the progress of teaching in a given course over several semesters. By laying out general items along a time line, a professor can document trends in student evaluations. If a single data point is out of line, its impact is lessened by the overview, and the professor may choose to discuss factors in that particular semester that could have contributed to the deviation. http://ctl.utexas.edu/teaching/peer_review/teaching_portfoliol: Analyzing Written Comments Matrix: Laying out a matrix grouping written comments according to the overall course rating given by each student evaluator provides a context for the comments. An instructor can see what kinds of comments were made by students who were in general satisfied with the course, and what kind were made by those who were dissatisfied.. This analysis of written comments sometimes helps to explain certain positive or negative comments, which might be confided to a small subset of a course. See matrix image on next page. Credit: http://ctl.utexas.edu/teaching/peer_review/teaching_portfolio.
  4. 4. Documenting Evidence of Teaching / Page 4 Summary of Student Feedback with Reflection: Jane Doe / Linguistics At the end of each quarter, students fill out an Evaluation of Instruction Report. They are asked to rate aspects of both the course and the instructor using a Likert-type scale of 1 (poor) to 5 (excellent). The overall rating at the end of my first quarter teaching was 4.2; at the end of my second quarter, this rose slightly to 4.3 More informative evidence came from students’ written evaluations. In evaluating my first quarter of teaching, student comments were generally favorable, though they sensed my lack of experience as a teacher. This was not mentioned after my second quarter of teaching, as I felt more comfortable with both the course content and with leading a classroom. Some students were rather impressed that I learned everyone’s name quickly – not a frequent occurrence at a large state university. A notable aspect of my teaching was that I encouraged them to argue against some of the theories presented. One student described this as “encouraging them to express their own thoughts and feelings.” Other aspects of my teaching that they praise are that I am well-organized, I pay attention to students’ needs and spend extra time helping them when necessary, and I foster a relaxed learning environment in class. Students' main suggestion for improvement was to incorporate more classroom activities. This corresponds to what I have been learning in professional development workshops: students can have a richer learning experience when they are engaged in the process. Incorporating activities such as demonstrations of experiments, videos, and small-group discussions would accomplish several goals. It would break up the long class time (typically 1 hour, 48 minutes), preventing students from losing attention, and it would provide opportunities for students to work with the material presented in class in a variety of ways. (Last 3 examples from http://ucat.osu.edu/read/teaching-portfolio.) i The diagram and its organizing principle were drawn from documents once available at the Center for Instructional Development and Research at the UWashington-Seattle; the specific suggestions derive from multiple print/electronic sources, hiring committee members’ suggestions and professional experience. ii See, for example, http://depts.washington.edu/cidrweb/portfolio/developmental.html or http://www.courseportfolio.org/peer/pages/index.jsp?what=rootMenuD&rootMenuId=3#benchmark. iii See, for example: http://ucat.osu.edu/read/teaching-portfolio or http://www.courseportfolio.org/peer/pages/index.jsp?what=rootMenuD&rootMenuId=3#inquiry. iv See Stephen Brookfield's resources on Becoming a Critically Reflective Teacher at http://vccslitonline.cc.va.us/mrcte/brookfield.htm. v University of Minnesota Center for Teaching & Learning, Consultations for Individuals: http://www1.umn.edu/ohr/teachlearn/consultations/index.html.

×