Documenting Teaching Effectiveness


Published on

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Documenting Teaching Effectiveness

  1. 1. Documenting Teaching Effectiveness: Sources of DataInstructor Self Assessment – your perceptions of your teaching1 • Course Portfolio – developmental, what you want to think about/know more about2 • Teaching Portfolio – evaluative, what reviewers want to know/assess3 • Teaching Journal – critically reflective teacher/teaching4 • Expanded Teaching Philosophy – to serve as reflective introduction to dossierStudent Perceptions – student perceptions of your teaching • Midterm / Early term student feedback • End-of-Term Student Ratings of Teaching • On-going collection of in-class feedback through short evaluation surveys (eg, new assignments, use of readings, delivery of class session; Likert & open ended) • Critical Incident Questionnaire o At what point in class this week did you feel most engaged with what was happening? o At what point in class this week did you feel most distanced from what was happening? o What action that anyone (teacher or student) took in class did you find most affirming & helpful? o What action that anyone (teacher or student) took in class did you did most puzzling or confusing? o What about class this week surprised you the most? (From your own reactions to what went on, to something that someone did, or to anything else that occurs to you as you write now.)Student Learning – student perceptions of learning as a result of teaching • Student Feedback through Consensus5 • Develop Classroom Assessment Techniques (CATs) to gather student perceptions of their own learning and of teaching effectiveness related to particular practices recurring in class sessions, across a new segment/unit in course, in activities or assignments (eg, interactive lecture technique, coherence of lecture notes across a new segment of course, use of peer response groups, on grading practices/rubric, on use of suggested resources) • Evidence of student achievement (national exams/benchmark outcomes, grad school placement, thesis completion, student retention/completion; UROP) • Localize National Survey of Student Engagement (NSSE) benchmarks such as use of high impact activities that "require that students engage in substantive matters while actively interacting and collaborating with faculty and their peers" • Develop measures that allow for addressing and analyzing particular forms of resistance to learning and for aligning student/teacher expectations – consider whether students expect that you will address, for example, race, class, sexuality in your course? expect that engaged learning will be the norm for this course? expect to write even if this is not a writing intensive course? Documenting Evidence of Teaching / Page 1
  2. 2. Peer / Colleague Review – peer perceptions of your teaching / learning • Classroom observation – teaching peers, cohort faculty • Lesson Study Project ( • Review of instructional materials; syllabus, assignments, exams (Peer Review Project: • Review of innovative uses of technology; contributions to distance learning • Review of engaged pedagogies/approaches to non-traditional students and learning (eg, service learning, study abroad, multicultural teaching and learning) • Mentoring activities – whether being a mentor or a mentee • Development of teaching- and/or learning-related workshop for peers • Peer-reviewed teaching/learning article accepted or grant acceptedTeaching / Learning Resources – research-based perceptions of learning • Engagement with disciplinary journals related to teaching, from course design to assessment of courses, teaching and learning (eg, incorporation into teaching approach, formation of journal club, participation in learning community) • Pursuit of a teaching-related research question to address via Scholarship of Teaching & Learning • Participation in faculty professional development programming (eg, career programs, New Faculty Orientation, teaching with writing or technology workshops, multicultural teaching and learning fellowships/ research programs)Administrative Perspective – perceptions of teaching role & excellence • Dossier Requirements/Data to Document Administrative Guidelines (as set by department, college and/or university-wide policy) • Evaluative Teaching Portfolios • Data from curriculum assessment1. The diagram and its organizing principle are drawn from the Center for Instructional Development andResearch at the University of Washington-Seattle; see The suggestions derive from multiplesources, suggestions and experiences shared by CTL consultants.2. See, for example, or See, for example: or See Stephen Brookfields resources on Becoming a Critically Reflective Teacher at University of Minnesota Center for Teaching & Learning: by Graphic DisplaysAssemble graphs with an explanation: include number of students, dates the courses were taught, qualitiesthat are being evaluated. A main feature of graphs is that they should be clear, not cluttered. Depending onyour audience, include all courses taught over a certain period of time (promotion and tenure purposes) or onlya select number (applying for a faculty job) in order to showcase the courses youve actually designed. Eitherway, it will be important to describe which courses youve chosen to include and why. See impage on nextpage. Credit: Documenting Evidence of Teaching / Page 2
  3. 3. Plotting Means of Course EvaluationsAt the Center for Teaching Effectiveness we have found it useful to plot the progress of teaching in a givencourse over several semesters. By laying out general items along a time line, a professor can document trendsin student evaluations. If a single data point is out of line, its impact is lessened by the overview, and theprofessor may choose to discuss factors in that particular semester that could have contributed to thedeviation. Written CommentsMatrix: Laying out a matrix grouping written comments according to the overall course rating given byeach student evaluator provides a context for the comments. An instructor can see what kinds ofcomments were made by students who were in general satisfied with the course, and what kind weremade by those who were dissatisfied.. This analysis of written comments sometimes helps to explaincertain positive or negative comments, which might be confided to a small subset of a course. Seematrix image on next page. Credit: Documenting Evidence of Teaching / Page 3
  4. 4. Summary of Student Feedback with Reflection: Jane Doe / Linguistics At the end of each quarter, students fill out an Evaluation of Instruction Report. They are asked to rateaspects of both the course and the instructor using a Likert-type scale of 1 (poor) to 5 (excellent). The overallrating at the end of my first quarter teaching was 4.2; at the end of my second quarter, this rose slightly to 4.3 More informative evidence came from students’ written evaluations. In evaluating my first quarter ofteaching, student comments were generally favorable, though they sensed my lack of experience as ateacher. This was not mentioned after my second quarter of teaching, as I felt more comfortable with both thecourse content and with leading a classroom. Some students were rather impressed that I learnedeveryone’s name quickly – not a frequent occurrence at a large state university. A notable aspect of myteaching was that I encouraged them to argue against some of the theories presented. One studentdescribed this as “encouraging them to express their own thoughts and feelings.” Other aspects of myteaching that they praise are that I am well-organized, I pay attention to students’ needs and spend extratime helping them when necessary, and I foster a relaxed learning environment in class. Students main suggestion for improvement was to incorporate more classroom activities. Thiscorresponds to what I have been learning in professional development workshops: students can have aricher learning experience when they are engaged in the process. Incorporating activities such asdemonstrations of experiments, videos, and small-group discussions would accomplish several goals. Itwould break up the long class time (typically 1 hour, 48 minutes), preventing students from losing attention,and it would provide opportunities for students to work with the material presented in class in a variety ofways. (Last 3 examples from Documenting Evidence of Teaching / Page 4
  5. 5. 1 The diagram and its organizing principle are drawn from the Center for Instructional Developmentand Research at the University of Washington-Seattle; see The suggestions derive frommultiple sources, suggestions and experiences shared by CTL consultants.2 See, for example, or See, for example: or See Stephen Brookfields resources on Becoming a Critically Reflective Teacher at University of Minnesota Center for Teaching & Learning: