Innovation in Educator
Evaluation:
Using the D-SORT to observe classroom teaching




Philip R. Fletcher – Pearson
Kathy McKnight – Pearson
Katherine Bassett – NNSTOY
Digital card sort makes classroom observation
    easier & takes less time
      Statements are stated in clear, observable language
      Technology makes it easy to record observations & generate reports




1   Innovation in Educator Evaluation
Sorting cards creates dimensions of teaching
    for greater accuracy

                                        Dimension                    Label
                                            1       Keeps class focused on main task
                                                    Modifies instruction to meet student
                                            2       needs
                                                    Encourages students to inquire and
                                            3       investigate
                                                    Shows confidence in students’ learning
                                            4       capabilities
                                            5       Knows when to differentiate instruction
                                            6       Has a positive class atmosphere
                                            7       Makes lesson activities accessible to all
                                                    Builds learner self-direction and
                                            8       ownership of learning
                                            9       Sorts out student misunderstandings
                                           10       Stimulates curiosity and inquiry
                                                    Uses supplementary resources and
                                           11       technologies effectively
                                           12       Provides timely and effective feedback


2   Innovation in Educator Evaluation
Multiple items make up each dimension for
    greater accuracy
    Cluster    Item                     Label                  Tally   Cluster    Item                  Label                   Tally

       1      NY370 Helps students control their own            2        1       JK060 Gives students time to complete tasks     2
                    learning                                                           at their own pace
       1      PF040 Keeps class focused on main task            1        1       PF760 Captures and holds students' attention    0
                                                                                       at every time
       1      NY550 Provides a safe physical environment        1        1       MZ360 Makes self available to students who      2
                                                                                       need guidance or resources
       1      PF070    Sustains student attention to class      0        1       NY450 Focuses primarily upon student            1
                       work activities                                                 engagement in the learning process
       1      IT090    Helps students work productively and     2        1       IT120 Peer relationships promote each           1
                       cooperatively with one another                                  other's learning
       1      JK010    Shows evidence of being responsible      1        1       JK280 Available as a resource for students      1
                       for class functioning
       1      IT430    Continuously monitors student            1        1       NY360 Promotes student sharing and              2
                       learning                                                        collaborating

       2      IT390    Knows when to adjust plans based on      1        2       EM020 Rephrases presentations as necessary,     1
                       assessment information                                          to make ideas accessible
       2      IT260    Multiple types of assessment support,    1        2       IT530 Adapts instruction to student             1
                       verify and document learning                                    responses, ideas and needs
       2      IT630    Adjusts plans in the face of changing    1        2       IT550 Uses learner data to differentiate        1
                       circumstances                                                   instruction
       2      IT330    Adjusts to meet each student's           0        2       NY010 Sets lesson objectives with achievable    1
                       learning needs                                                  goals


3   Innovation in Educator Evaluation
D-SORT generates a Classroom Profile


                                    Classroom profile set of scores                                                    Classroom profile type.
                                    on each teaching dimension.

                                                        IRT Profile Set of Scores                                                                         Diagnostic Class Probabilities
                                4                                                                                                 1.0
                                                                                                                                  0.9   A         0.010
                                3                                                                                                       B         0.002
                                                                                                                                  0.8   C         0.006
    Normal Deviate (Z-Score)




                                2                                                                                                       D         0.006
                                                                                                                                  0.7   E         0.977
                                                                                                                                        Entropy   0.823
                                1




                                                                                                                    Probability
                                                        0.516                                                                     0.6
                                      0.183 0.055 0.396
                                0                                                                                                 0.5
                                                                         -0.011                            -0.034
                                                                -0.418            -0.424 -0.529                                   0.4
                               -1                                                                 -0.758
                                                                                                                                  0.3
                               -2
                                                                                                                                  0.2
                               -3                                                                                                 0.1
                               -4                                                                                                 0.0
                                       S1   S10    S2    S3      S4     S5          S6     S7      S8       S9                                    A         B             C                D   E
                                                                   Score                                                                                                 Class




4                              Innovation in Educator Evaluation
Using D-SORT for evaluating effectiveness and
    targeted professional development
                                                                                                           National
                                                           Item/Scale                        True-Score   Percentile
•D-SORT   provides a personal
                                        Adjusts instruction to suit student needs                   1.6
profile with norms for assessing        Gives positive as well as corrective task-related
strengths and areas of need                 commentary
                                        Knows when to adjust plans based on
                                                                                                    1.6

                                            assessment information                                  1.6
                                        Knows when to differentiate instruction                     1.6

•Item  scores linked to associated      Uses learner data to differentiate instruction              1.6

domain, which is linked to
                                        Rephrases presentations as necessary, to make
                                            ideas accessible                                        1.7
supporting best practices               Knows when to differentiate instruction Scale               9.8          44.4
literature
                                        Assists student participation in inquiry processes          2.7
                                        Encourages learners to create novel approaches
                                             to solving problems                                    2.7

•Resources, combined with               Elaborates difficult concepts                               2.8

targeted assistance, are used to        Encourages students to challenge assumptions                2.8

improve teaching practice and           Encourages students to inquire and investigate              2.8

student-teacher interactions in         Incorporates technology into instruction                    2.8
                                        Offers students choices for reaching general
their own classrooms                         objectives                                             2.8
                                        Uses technological tools and a variety of
                                             communication strategies                               2.8
                                        Encourages students to inquire and investigate
                                             Scale                                                 22.2           66.1

5   Innovation in Educator Evaluation

Innovation in Educator Evaluation:Using D-SORT

  • 1.
    Innovation in Educator Evaluation: Usingthe D-SORT to observe classroom teaching Philip R. Fletcher – Pearson Kathy McKnight – Pearson Katherine Bassett – NNSTOY
  • 2.
    Digital card sortmakes classroom observation easier & takes less time Statements are stated in clear, observable language Technology makes it easy to record observations & generate reports 1 Innovation in Educator Evaluation
  • 3.
    Sorting cards createsdimensions of teaching for greater accuracy Dimension Label 1 Keeps class focused on main task Modifies instruction to meet student 2 needs Encourages students to inquire and 3 investigate Shows confidence in students’ learning 4 capabilities 5 Knows when to differentiate instruction 6 Has a positive class atmosphere 7 Makes lesson activities accessible to all Builds learner self-direction and 8 ownership of learning 9 Sorts out student misunderstandings 10 Stimulates curiosity and inquiry Uses supplementary resources and 11 technologies effectively 12 Provides timely and effective feedback 2 Innovation in Educator Evaluation
  • 4.
    Multiple items makeup each dimension for greater accuracy Cluster Item Label Tally Cluster Item Label Tally 1 NY370 Helps students control their own 2 1 JK060 Gives students time to complete tasks 2 learning at their own pace 1 PF040 Keeps class focused on main task 1 1 PF760 Captures and holds students' attention 0 at every time 1 NY550 Provides a safe physical environment 1 1 MZ360 Makes self available to students who 2 need guidance or resources 1 PF070 Sustains student attention to class 0 1 NY450 Focuses primarily upon student 1 work activities engagement in the learning process 1 IT090 Helps students work productively and 2 1 IT120 Peer relationships promote each 1 cooperatively with one another other's learning 1 JK010 Shows evidence of being responsible 1 1 JK280 Available as a resource for students 1 for class functioning 1 IT430 Continuously monitors student 1 1 NY360 Promotes student sharing and 2 learning collaborating 2 IT390 Knows when to adjust plans based on 1 2 EM020 Rephrases presentations as necessary, 1 assessment information to make ideas accessible 2 IT260 Multiple types of assessment support, 1 2 IT530 Adapts instruction to student 1 verify and document learning responses, ideas and needs 2 IT630 Adjusts plans in the face of changing 1 2 IT550 Uses learner data to differentiate 1 circumstances instruction 2 IT330 Adjusts to meet each student's 0 2 NY010 Sets lesson objectives with achievable 1 learning needs goals 3 Innovation in Educator Evaluation
  • 5.
    D-SORT generates aClassroom Profile Classroom profile set of scores Classroom profile type. on each teaching dimension. IRT Profile Set of Scores Diagnostic Class Probabilities 4 1.0 0.9 A 0.010 3 B 0.002 0.8 C 0.006 Normal Deviate (Z-Score) 2 D 0.006 0.7 E 0.977 Entropy 0.823 1 Probability 0.516 0.6 0.183 0.055 0.396 0 0.5 -0.011 -0.034 -0.418 -0.424 -0.529 0.4 -1 -0.758 0.3 -2 0.2 -3 0.1 -4 0.0 S1 S10 S2 S3 S4 S5 S6 S7 S8 S9 A B C D E Score Class 4 Innovation in Educator Evaluation
  • 6.
    Using D-SORT forevaluating effectiveness and targeted professional development National Item/Scale True-Score Percentile •D-SORT provides a personal Adjusts instruction to suit student needs 1.6 profile with norms for assessing Gives positive as well as corrective task-related strengths and areas of need commentary Knows when to adjust plans based on 1.6 assessment information 1.6 Knows when to differentiate instruction 1.6 •Item scores linked to associated Uses learner data to differentiate instruction 1.6 domain, which is linked to Rephrases presentations as necessary, to make ideas accessible 1.7 supporting best practices Knows when to differentiate instruction Scale 9.8 44.4 literature Assists student participation in inquiry processes 2.7 Encourages learners to create novel approaches to solving problems 2.7 •Resources, combined with Elaborates difficult concepts 2.8 targeted assistance, are used to Encourages students to challenge assumptions 2.8 improve teaching practice and Encourages students to inquire and investigate 2.8 student-teacher interactions in Incorporates technology into instruction 2.8 Offers students choices for reaching general their own classrooms objectives 2.8 Uses technological tools and a variety of communication strategies 2.8 Encourages students to inquire and investigate Scale 22.2 66.1 5 Innovation in Educator Evaluation

Editor's Notes

  • #2 Card sort statements are clear, in behavioral terms, so they are easier to rate