SlideShare a Scribd company logo
Welcome!
While you’re waiting for the webinar to start, please
consider these questions and share your thoughts in
the chat:
1. What types of assessments have you used in your teaching?
2. Which do you find to be the best for your students’ learning?
3. Which do you find to be the best for your teaching?
“Will the test be multiple choice?”:
Fully using Canvas Quiz Statistics to measure
student learning
IGNIS Webinar, May 30, 2:00-3:00pm
Melisa Ziegler, PhD
Learning Objectives
- Describe at least three ways to improve testing and item design
- Find the Quiz Statistics links in Canvas
- Explain the difference between the Student and Item Analysis
features
- Describe standard deviation
- Describe discrimination index
- Identify at least two ways to use Quiz Statistics to improve
future quizzes
Vocabulary
Multiple-choice Test
Item
Stem
Distractor
Poll 1
Do you assess your students’ learning using
multiple-choice tests?
Why test?
Assessment
Purpose: discriminate
between students based on
mastery of learning
objectives
Success: higher the
discriminability of a test, the
more effective the test
Learning
Purpose: improve students’
knowledge of learning
objectives
Success: the more students’
knowledge increases after a
test, the more effective the
test
DiscussionIf you use multiple-choice tests, are they for
assessment, learning, or both?
Please share an example in the chat.
Test Design
Reliability
Observed Score = True Score + Error
The goal is to reduce error.
Strategies:
- Design a speed or power test
based on your learning objectives
- Write simple multiple-choice
items
- Write a moderately difficult test
Validity
Evidence to support the interpretation
and use of test scores
The goal is to accumulate evidence.
Strategies:
- Align your items to your learning
objectives
- Evaluate scores as measures of
knowledge and cognition
Item Design: Stem
- Align items to your learning objectives
- Recall: “Which of the following buildings is the tallest in the world?”
- Compare: “Which of the following is a way in which hawks differ from eagles?”
- Analyze: “Given that the patient shows symptoms X, Y, and Z, which of the
following diagnoses is most likely?” (Butler, p. 326)
- Phrase items positively (i.e. avoid using “not”)
- Negative: Which of the following is not an example of classical conditioning?
- Positive: Which of the following is an example of classical conditioning?
- Unless this is a specific cognitive process you want them to practice that
transfers beyond the class
Stem Practice: Matching to Learning Objectives
How could you better align this stem to this learning
objective?
Learning Objective: Determine the most appropriate exercise
modality for health maintenance in elderly patients.
Stem: Which of the following is the definition of exercise
modality?
Please share your answers in the chat.
Stem Practice: Positive Phrasing
How could you rephrase this stem using positive
phrasing?
Negative Phrasing: Which of the following is not an
appropriate exercise modality for health maintenance for
elderly patients?
Please share your answers in the chat.
Item Design: Distractors
- Use a simple format (i.e. list of possible responses where only one is correct)
- Use two or three distractors → base the number on the quality of the
distractor
- Use correct answers for one item on another item → benefits students’
learning
- Use simple vocabulary that aligns with your textbook and your teaching
- Rotate the correct answers within the distractors throughout the test
- Avoid using “none of the above” or “all of the above” or “a and c” etc.
- Make each response option about the same length
- Check for spelling, punctuation, and grammar
Distractor Practice
What are some of the issues with these distractors?
Stem: Which of the following is an appropriate exercise modality for health
maintenance for elderly patients?
a. Aquatherapy
b. Work directly with the patient
c. A and B
d. Start with simple exercises followed by more complex exercises as patient
progresses
Please share your answers in the chat.
Poll 2What is the most difficult part of the item
for you to write: the stem, the correct
answer, or the distractors?
We’ve written our items and
students have completed our
test. Now what?
Important Terms
Standard Deviation
σ or square root of the variance
The spread of your scores.
Discrimination Index
How well an item discriminates
between students according to how
they did on the test
The effectiveness of an item.
Canvas Quiz Statistics
Student Analysis
Student Responses
Item Analysis
Difficulty Index
Correct Student Count
Standard Deviation by Item
Point Biserial of Distractor
Discrimination Index Practice
Which of the following discrimination indices represents an item that
best discriminates among students: +0.47 with 69% answering correctly,
+0.56 with 92% answering correctly, or +0.22 with 85% answering
correctly?
Using Canvas Quiz Statistics to Help you Improve
Student Analysis
- How did a particular student
respond?
- You know your students. Who
did you expect to know a topic
and didn’t?
- Opportunity for 1:1 follow up
Item Analysis
- Is it the item, concept, or both
that students didn’t
understand?
- Did the distractors distract
appropriately?
- Model your thinking as you
explain the correct answers in
comparison to the distractors
Demo in Canvas
Q&A
References
Butler, A. (2018). Multiple-choice testing in education: Are the best practices for
assessment also good for learning? Journal of Applied Research in Memory and
Cognition, 7, 323-331.
Canvas (2018). Canvas quiz item analysis. Retrieved from
https://s3.amazonaws.com/tr-learncanvas/docs/CanvasQuizItemAnalysis.pdf
Canvas (2019). Once I publish a quiz, what kinds of quiz statistics are available?
Retrieved from https://community.canvaslms.com/docs/DOC-13037-415241484
Suen, H. K. (2018). Multiple-choice item-writing rules. Retrieved from
http://www.schreyerinstitute.psu.edu/pdf/Multiple_Choice_Item_Writing_Rules.pdf
Contact Information
Melisa Ziegler, PhD
Coordinator of Organizational Learning
mziegler@tacomacc.edu
THANK YOU!
Unless otherwise specified, IGNIS content is licensed under a
Creative Commons Attribution 4.0 International License.

More Related Content

What's hot

Bloom's Taxonomy
Bloom's TaxonomyBloom's Taxonomy
Bloom's Taxonomybutest
 
Multiple choice
Multiple choiceMultiple choice
Multiple choice
halay
 
Test Assembling (writing and constructing)
Test Assembling (writing and constructing)Test Assembling (writing and constructing)
Test Assembling (writing and constructing)
Tasneem Ahmad
 
Q uestionnaire design
Q uestionnaire design Q uestionnaire design
Q uestionnaire design
Suvarna JaipurkarGanvir
 
Annette jordan creating an effective test or survey instrument
Annette jordan creating an effective test or survey instrumentAnnette jordan creating an effective test or survey instrument
Annette jordan creating an effective test or survey instrumentaljordan22
 
Chapter 3: Evidence-Based Practice
Chapter 3: Evidence-Based PracticeChapter 3: Evidence-Based Practice
Chapter 3: Evidence-Based Practice
Nicole Beauchamp
 
A multiday approach to coaching students to proficiency
A multiday approach to coaching students to proficiencyA multiday approach to coaching students to proficiency
A multiday approach to coaching students to proficiencymcaesar
 
Different Format of Classroom Assessment Tools
Different Format  of Classroom Assessment ToolsDifferent Format  of Classroom Assessment Tools
Different Format of Classroom Assessment Tools
Anna Marie Paradero
 
how to conduct a survey research sem 1 session 20152016
 how to conduct a survey research sem 1 session 20152016 how to conduct a survey research sem 1 session 20152016
how to conduct a survey research sem 1 session 20152016
Rohaniza Rejab
 
MCQ Workshop - Dr Jane Holland
MCQ Workshop - Dr Jane HollandMCQ Workshop - Dr Jane Holland
MCQ Workshop - Dr Jane Holland
Ireland & UK Moodlemoot 2012
 
Testing
TestingTesting
Testinghangha
 
Essay,short answer questions and multiple choice question
Essay,short answer questions and multiple choice questionEssay,short answer questions and multiple choice question
Essay,short answer questions and multiple choice question
OM VERMA
 
Designing MC Exams
Designing MC ExamsDesigning MC Exams
Designing MC Exams
St. John Fisher College
 
True or false
True or falseTrue or false
True or false
lory liza deiparine
 
Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...
Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...
Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...
Sundar B N
 
ACT Practice Test 2017 | 2018
ACT Practice Test 2017 | 2018ACT Practice Test 2017 | 2018
ACT Practice Test 2017 | 2018
RebecaJtiva
 

What's hot (19)

The art of questioning cindy
The art of questioning  cindyThe art of questioning  cindy
The art of questioning cindy
 
Teacher
TeacherTeacher
Teacher
 
Bloom's Taxonomy
Bloom's TaxonomyBloom's Taxonomy
Bloom's Taxonomy
 
Multiple choice
Multiple choiceMultiple choice
Multiple choice
 
Test Assembling (writing and constructing)
Test Assembling (writing and constructing)Test Assembling (writing and constructing)
Test Assembling (writing and constructing)
 
Q uestionnaire design
Q uestionnaire design Q uestionnaire design
Q uestionnaire design
 
Annette jordan creating an effective test or survey instrument
Annette jordan creating an effective test or survey instrumentAnnette jordan creating an effective test or survey instrument
Annette jordan creating an effective test or survey instrument
 
Chapter 3: Evidence-Based Practice
Chapter 3: Evidence-Based PracticeChapter 3: Evidence-Based Practice
Chapter 3: Evidence-Based Practice
 
A multiday approach to coaching students to proficiency
A multiday approach to coaching students to proficiencyA multiday approach to coaching students to proficiency
A multiday approach to coaching students to proficiency
 
Past exams
Past examsPast exams
Past exams
 
Different Format of Classroom Assessment Tools
Different Format  of Classroom Assessment ToolsDifferent Format  of Classroom Assessment Tools
Different Format of Classroom Assessment Tools
 
how to conduct a survey research sem 1 session 20152016
 how to conduct a survey research sem 1 session 20152016 how to conduct a survey research sem 1 session 20152016
how to conduct a survey research sem 1 session 20152016
 
MCQ Workshop - Dr Jane Holland
MCQ Workshop - Dr Jane HollandMCQ Workshop - Dr Jane Holland
MCQ Workshop - Dr Jane Holland
 
Testing
TestingTesting
Testing
 
Essay,short answer questions and multiple choice question
Essay,short answer questions and multiple choice questionEssay,short answer questions and multiple choice question
Essay,short answer questions and multiple choice question
 
Designing MC Exams
Designing MC ExamsDesigning MC Exams
Designing MC Exams
 
True or false
True or falseTrue or false
True or false
 
Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...
Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...
Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...
 
ACT Practice Test 2017 | 2018
ACT Practice Test 2017 | 2018ACT Practice Test 2017 | 2018
ACT Practice Test 2017 | 2018
 

Similar to IGNIS 2019 Will the test be multiple choice? Fully using Canvas Quiz Statistics to measure student learning - Melisa Ziegler 05.30.19

Questionnaire design
Questionnaire design Questionnaire design
Questionnaire design
Suvarna JaipurkarGanvir
 
Educational Psychology Developing Learners 8th Edition Ormrod Test Bank
Educational Psychology Developing Learners 8th Edition Ormrod Test BankEducational Psychology Developing Learners 8th Edition Ormrod Test Bank
Educational Psychology Developing Learners 8th Edition Ormrod Test Bank
kynep
 
Assessment with a Purpose
Assessment with a PurposeAssessment with a Purpose
Assessment with a Purpose
Jenny Shotts
 
How to create multiple choice questions
How to create multiple choice questionsHow to create multiple choice questions
How to create multiple choice questions
Jennifer Morrow
 
Essay assessment
Essay assessmentEssay assessment
Essay assessment
Abigail Sapico
 
Writing surveys that work
Writing surveys that workWriting surveys that work
Writing surveys that workrebeccaweiss
 
Setting Question_Dr Jamilah.pptx
Setting Question_Dr Jamilah.pptxSetting Question_Dr Jamilah.pptx
Setting Question_Dr Jamilah.pptx
YusriBinAbdullah1
 
Test construction
Test constructionTest construction
Test construction
Manasa Trinath
 
Writing surveys that work
Writing surveys that workWriting surveys that work
Writing surveys that workrebeccaweiss
 
Sreedevi P.S
Sreedevi P.SSreedevi P.S
Sreedevi P.S
Sree Devi
 
QUESTIONNAIRE METHOD.pptx
QUESTIONNAIRE METHOD.pptxQUESTIONNAIRE METHOD.pptx
QUESTIONNAIRE METHOD.pptx
GarimaBhati5
 
TOS-WITH-OVERVIEW-OF-TEST-CONSTRUCTION.pptx
TOS-WITH-OVERVIEW-OF-TEST-CONSTRUCTION.pptxTOS-WITH-OVERVIEW-OF-TEST-CONSTRUCTION.pptx
TOS-WITH-OVERVIEW-OF-TEST-CONSTRUCTION.pptx
JhayTangco
 
22.10.17 instrumentation and data collection
22.10.17 instrumentation and data collection22.10.17 instrumentation and data collection
22.10.17 instrumentation and data collection
Adibah Latif
 
administrating test,scoring, grading vs marks
administrating test,scoring, grading vs marksadministrating test,scoring, grading vs marks
administrating test,scoring, grading vs markskrishu29
 
.ppStress, Coping Mechanism, and Challenges of Nursing Students in the Clinic...
.ppStress, Coping Mechanism, and Challenges of Nursing Students in the Clinic....ppStress, Coping Mechanism, and Challenges of Nursing Students in the Clinic...
.ppStress, Coping Mechanism, and Challenges of Nursing Students in the Clinic...
DeborahFloridaEngkoh
 
Survey designs
Survey designsSurvey designs
Survey designs
VivaAs
 
Effective Surveys
Effective SurveysEffective Surveys
Effective Surveys
ltownson
 
Krish edu,semi2
Krish edu,semi2Krish edu,semi2
Krish edu,semi2krishu29
 
Arte387 Ch3
Arte387 Ch3Arte387 Ch3
Arte387 Ch3SCWARTED
 

Similar to IGNIS 2019 Will the test be multiple choice? Fully using Canvas Quiz Statistics to measure student learning - Melisa Ziegler 05.30.19 (20)

Questionnaire design
Questionnaire design Questionnaire design
Questionnaire design
 
Educational Psychology Developing Learners 8th Edition Ormrod Test Bank
Educational Psychology Developing Learners 8th Edition Ormrod Test BankEducational Psychology Developing Learners 8th Edition Ormrod Test Bank
Educational Psychology Developing Learners 8th Edition Ormrod Test Bank
 
Assessment with a Purpose
Assessment with a PurposeAssessment with a Purpose
Assessment with a Purpose
 
How to create multiple choice questions
How to create multiple choice questionsHow to create multiple choice questions
How to create multiple choice questions
 
Essay assessment
Essay assessmentEssay assessment
Essay assessment
 
Research problem copy
Research problem   copyResearch problem   copy
Research problem copy
 
Writing surveys that work
Writing surveys that workWriting surveys that work
Writing surveys that work
 
Setting Question_Dr Jamilah.pptx
Setting Question_Dr Jamilah.pptxSetting Question_Dr Jamilah.pptx
Setting Question_Dr Jamilah.pptx
 
Test construction
Test constructionTest construction
Test construction
 
Writing surveys that work
Writing surveys that workWriting surveys that work
Writing surveys that work
 
Sreedevi P.S
Sreedevi P.SSreedevi P.S
Sreedevi P.S
 
QUESTIONNAIRE METHOD.pptx
QUESTIONNAIRE METHOD.pptxQUESTIONNAIRE METHOD.pptx
QUESTIONNAIRE METHOD.pptx
 
TOS-WITH-OVERVIEW-OF-TEST-CONSTRUCTION.pptx
TOS-WITH-OVERVIEW-OF-TEST-CONSTRUCTION.pptxTOS-WITH-OVERVIEW-OF-TEST-CONSTRUCTION.pptx
TOS-WITH-OVERVIEW-OF-TEST-CONSTRUCTION.pptx
 
22.10.17 instrumentation and data collection
22.10.17 instrumentation and data collection22.10.17 instrumentation and data collection
22.10.17 instrumentation and data collection
 
administrating test,scoring, grading vs marks
administrating test,scoring, grading vs marksadministrating test,scoring, grading vs marks
administrating test,scoring, grading vs marks
 
.ppStress, Coping Mechanism, and Challenges of Nursing Students in the Clinic...
.ppStress, Coping Mechanism, and Challenges of Nursing Students in the Clinic....ppStress, Coping Mechanism, and Challenges of Nursing Students in the Clinic...
.ppStress, Coping Mechanism, and Challenges of Nursing Students in the Clinic...
 
Survey designs
Survey designsSurvey designs
Survey designs
 
Effective Surveys
Effective SurveysEffective Surveys
Effective Surveys
 
Krish edu,semi2
Krish edu,semi2Krish edu,semi2
Krish edu,semi2
 
Arte387 Ch3
Arte387 Ch3Arte387 Ch3
Arte387 Ch3
 

More from SBCTCProfessionalLearning

WACCy Wednesday Webinar Open Pedagogy to Support EDI - Critical and Renewable...
WACCy Wednesday Webinar Open Pedagogy to Support EDI - Critical and Renewable...WACCy Wednesday Webinar Open Pedagogy to Support EDI - Critical and Renewable...
WACCy Wednesday Webinar Open Pedagogy to Support EDI - Critical and Renewable...
SBCTCProfessionalLearning
 
WACCy Wednesday Webinar Open Pedagogy to Support EDI - Open Pedagogy Collabo...
WACCy Wednesday Webinar Open Pedagogy to Support EDI -  Open Pedagogy Collabo...WACCy Wednesday Webinar Open Pedagogy to Support EDI -  Open Pedagogy Collabo...
WACCy Wednesday Webinar Open Pedagogy to Support EDI - Open Pedagogy Collabo...
SBCTCProfessionalLearning
 
WACCyy Wednedsay Synchronous Classrooms (Pedagogical Use of Zoom) Zoom Kevin ...
WACCyy Wednedsay Synchronous Classrooms (Pedagogical Use of Zoom) Zoom Kevin ...WACCyy Wednedsay Synchronous Classrooms (Pedagogical Use of Zoom) Zoom Kevin ...
WACCyy Wednedsay Synchronous Classrooms (Pedagogical Use of Zoom) Zoom Kevin ...
SBCTCProfessionalLearning
 
IGNIS 2019 Wrestling the Ongoing Dilemma of Late Work - Ellen Bremen 05.23.19
IGNIS 2019 Wrestling the Ongoing Dilemma of Late Work - Ellen Bremen 05.23.19IGNIS 2019 Wrestling the Ongoing Dilemma of Late Work - Ellen Bremen 05.23.19
IGNIS 2019 Wrestling the Ongoing Dilemma of Late Work - Ellen Bremen 05.23.19
SBCTCProfessionalLearning
 
IGNIS Intro 2019 Will the test be multiple choice Melisa Ziegler 05.30.19
IGNIS Intro 2019  Will the test be multiple choice Melisa Ziegler  05.30.19 IGNIS Intro 2019  Will the test be multiple choice Melisa Ziegler  05.30.19
IGNIS Intro 2019 Will the test be multiple choice Melisa Ziegler 05.30.19
SBCTCProfessionalLearning
 
IGNIS Intro 2019 Wrestling the Ongoing Dilemma of Late Work Ellen Bremen 05....
IGNIS Intro 2019  Wrestling the Ongoing Dilemma of Late Work Ellen Bremen 05....IGNIS Intro 2019  Wrestling the Ongoing Dilemma of Late Work Ellen Bremen 05....
IGNIS Intro 2019 Wrestling the Ongoing Dilemma of Late Work Ellen Bremen 05....
SBCTCProfessionalLearning
 
QM CONNECT - 5 Steps to an Accessible Syllabus Slidedeck ASELLS 0917
QM CONNECT - 5 Steps to an Accessible Syllabus Slidedeck ASELLS 0917QM CONNECT - 5 Steps to an Accessible Syllabus Slidedeck ASELLS 0917
QM CONNECT - 5 Steps to an Accessible Syllabus Slidedeck ASELLS 0917
SBCTCProfessionalLearning
 
IGNIS 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusive Pow...
IGNIS 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusive Pow...IGNIS 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusive Pow...
IGNIS 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusive Pow...
SBCTCProfessionalLearning
 
IGNIS Intro 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusi...
IGNIS Intro 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusi...IGNIS Intro 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusi...
IGNIS Intro 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusi...
SBCTCProfessionalLearning
 
IGNIS 2019 Cognitive and Affective in Cultural Competence - Mihaela Cosma 042519
IGNIS 2019 Cognitive and Affective in Cultural Competence - Mihaela Cosma 042519IGNIS 2019 Cognitive and Affective in Cultural Competence - Mihaela Cosma 042519
IGNIS 2019 Cognitive and Affective in Cultural Competence - Mihaela Cosma 042519
SBCTCProfessionalLearning
 
IGNIS Intro 2019 Cognitive and Affective in Cultural Competence - Mihaela Cos...
IGNIS Intro 2019 Cognitive and Affective in Cultural Competence - Mihaela Cos...IGNIS Intro 2019 Cognitive and Affective in Cultural Competence - Mihaela Cos...
IGNIS Intro 2019 Cognitive and Affective in Cultural Competence - Mihaela Cos...
SBCTCProfessionalLearning
 
IGNIS Intro 2019 - How to Engage Students in the Internet Age - William Jacks...
IGNIS Intro 2019 - How to Engage Students in the Internet Age - William Jacks...IGNIS Intro 2019 - How to Engage Students in the Internet Age - William Jacks...
IGNIS Intro 2019 - How to Engage Students in the Internet Age - William Jacks...
SBCTCProfessionalLearning
 
IGNIS 2019 Introduction to Awarding Badges using Badgr in Canvas - Kelley Mee...
IGNIS 2019 Introduction to Awarding Badges using Badgr in Canvas - Kelley Mee...IGNIS 2019 Introduction to Awarding Badges using Badgr in Canvas - Kelley Mee...
IGNIS 2019 Introduction to Awarding Badges using Badgr in Canvas - Kelley Mee...
SBCTCProfessionalLearning
 
IGNIS 2019 Intro Slides - Introduction to Using Badgr to Award Badges in Canv...
IGNIS 2019 Intro Slides - Introduction to Using Badgr to Award Badges in Canv...IGNIS 2019 Intro Slides - Introduction to Using Badgr to Award Badges in Canv...
IGNIS 2019 Intro Slides - Introduction to Using Badgr to Award Badges in Canv...
SBCTCProfessionalLearning
 
320 Feedback Loop Assignment
320 Feedback Loop Assignment320 Feedback Loop Assignment
320 Feedback Loop Assignment
SBCTCProfessionalLearning
 
Professional Email Format
Professional Email FormatProfessional Email Format
Professional Email Format
SBCTCProfessionalLearning
 
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communica...
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communica...IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communica...
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communica...
SBCTCProfessionalLearning
 
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communic...
IGNIS 2018  Did I Miss Anything Important: Teaching Your Students to Communic...IGNIS 2018  Did I Miss Anything Important: Teaching Your Students to Communic...
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communic...
SBCTCProfessionalLearning
 
IGNIS 2018 Webinar To Lock or Not to Lock: Using Respondus for.Secure Assessm...
IGNIS 2018 Webinar To Lock or Not to Lock: Using Respondus for.Secure Assessm...IGNIS 2018 Webinar To Lock or Not to Lock: Using Respondus for.Secure Assessm...
IGNIS 2018 Webinar To Lock or Not to Lock: Using Respondus for.Secure Assessm...
SBCTCProfessionalLearning
 
IGNIS 2018 Intro Humanizing and Personalizing Information Literacy Derek Jorg...
IGNIS 2018 Intro Humanizing and Personalizing Information Literacy Derek Jorg...IGNIS 2018 Intro Humanizing and Personalizing Information Literacy Derek Jorg...
IGNIS 2018 Intro Humanizing and Personalizing Information Literacy Derek Jorg...
SBCTCProfessionalLearning
 

More from SBCTCProfessionalLearning (20)

WACCy Wednesday Webinar Open Pedagogy to Support EDI - Critical and Renewable...
WACCy Wednesday Webinar Open Pedagogy to Support EDI - Critical and Renewable...WACCy Wednesday Webinar Open Pedagogy to Support EDI - Critical and Renewable...
WACCy Wednesday Webinar Open Pedagogy to Support EDI - Critical and Renewable...
 
WACCy Wednesday Webinar Open Pedagogy to Support EDI - Open Pedagogy Collabo...
WACCy Wednesday Webinar Open Pedagogy to Support EDI -  Open Pedagogy Collabo...WACCy Wednesday Webinar Open Pedagogy to Support EDI -  Open Pedagogy Collabo...
WACCy Wednesday Webinar Open Pedagogy to Support EDI - Open Pedagogy Collabo...
 
WACCyy Wednedsay Synchronous Classrooms (Pedagogical Use of Zoom) Zoom Kevin ...
WACCyy Wednedsay Synchronous Classrooms (Pedagogical Use of Zoom) Zoom Kevin ...WACCyy Wednedsay Synchronous Classrooms (Pedagogical Use of Zoom) Zoom Kevin ...
WACCyy Wednedsay Synchronous Classrooms (Pedagogical Use of Zoom) Zoom Kevin ...
 
IGNIS 2019 Wrestling the Ongoing Dilemma of Late Work - Ellen Bremen 05.23.19
IGNIS 2019 Wrestling the Ongoing Dilemma of Late Work - Ellen Bremen 05.23.19IGNIS 2019 Wrestling the Ongoing Dilemma of Late Work - Ellen Bremen 05.23.19
IGNIS 2019 Wrestling the Ongoing Dilemma of Late Work - Ellen Bremen 05.23.19
 
IGNIS Intro 2019 Will the test be multiple choice Melisa Ziegler 05.30.19
IGNIS Intro 2019  Will the test be multiple choice Melisa Ziegler  05.30.19 IGNIS Intro 2019  Will the test be multiple choice Melisa Ziegler  05.30.19
IGNIS Intro 2019 Will the test be multiple choice Melisa Ziegler 05.30.19
 
IGNIS Intro 2019 Wrestling the Ongoing Dilemma of Late Work Ellen Bremen 05....
IGNIS Intro 2019  Wrestling the Ongoing Dilemma of Late Work Ellen Bremen 05....IGNIS Intro 2019  Wrestling the Ongoing Dilemma of Late Work Ellen Bremen 05....
IGNIS Intro 2019 Wrestling the Ongoing Dilemma of Late Work Ellen Bremen 05....
 
QM CONNECT - 5 Steps to an Accessible Syllabus Slidedeck ASELLS 0917
QM CONNECT - 5 Steps to an Accessible Syllabus Slidedeck ASELLS 0917QM CONNECT - 5 Steps to an Accessible Syllabus Slidedeck ASELLS 0917
QM CONNECT - 5 Steps to an Accessible Syllabus Slidedeck ASELLS 0917
 
IGNIS 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusive Pow...
IGNIS 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusive Pow...IGNIS 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusive Pow...
IGNIS 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusive Pow...
 
IGNIS Intro 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusi...
IGNIS Intro 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusi...IGNIS Intro 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusi...
IGNIS Intro 2019 - PowerPoint Me Towards Accessibility! The Basics of Inclusi...
 
IGNIS 2019 Cognitive and Affective in Cultural Competence - Mihaela Cosma 042519
IGNIS 2019 Cognitive and Affective in Cultural Competence - Mihaela Cosma 042519IGNIS 2019 Cognitive and Affective in Cultural Competence - Mihaela Cosma 042519
IGNIS 2019 Cognitive and Affective in Cultural Competence - Mihaela Cosma 042519
 
IGNIS Intro 2019 Cognitive and Affective in Cultural Competence - Mihaela Cos...
IGNIS Intro 2019 Cognitive and Affective in Cultural Competence - Mihaela Cos...IGNIS Intro 2019 Cognitive and Affective in Cultural Competence - Mihaela Cos...
IGNIS Intro 2019 Cognitive and Affective in Cultural Competence - Mihaela Cos...
 
IGNIS Intro 2019 - How to Engage Students in the Internet Age - William Jacks...
IGNIS Intro 2019 - How to Engage Students in the Internet Age - William Jacks...IGNIS Intro 2019 - How to Engage Students in the Internet Age - William Jacks...
IGNIS Intro 2019 - How to Engage Students in the Internet Age - William Jacks...
 
IGNIS 2019 Introduction to Awarding Badges using Badgr in Canvas - Kelley Mee...
IGNIS 2019 Introduction to Awarding Badges using Badgr in Canvas - Kelley Mee...IGNIS 2019 Introduction to Awarding Badges using Badgr in Canvas - Kelley Mee...
IGNIS 2019 Introduction to Awarding Badges using Badgr in Canvas - Kelley Mee...
 
IGNIS 2019 Intro Slides - Introduction to Using Badgr to Award Badges in Canv...
IGNIS 2019 Intro Slides - Introduction to Using Badgr to Award Badges in Canv...IGNIS 2019 Intro Slides - Introduction to Using Badgr to Award Badges in Canv...
IGNIS 2019 Intro Slides - Introduction to Using Badgr to Award Badges in Canv...
 
320 Feedback Loop Assignment
320 Feedback Loop Assignment320 Feedback Loop Assignment
320 Feedback Loop Assignment
 
Professional Email Format
Professional Email FormatProfessional Email Format
Professional Email Format
 
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communica...
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communica...IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communica...
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communica...
 
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communic...
IGNIS 2018  Did I Miss Anything Important: Teaching Your Students to Communic...IGNIS 2018  Did I Miss Anything Important: Teaching Your Students to Communic...
IGNIS 2018 Did I Miss Anything Important: Teaching Your Students to Communic...
 
IGNIS 2018 Webinar To Lock or Not to Lock: Using Respondus for.Secure Assessm...
IGNIS 2018 Webinar To Lock or Not to Lock: Using Respondus for.Secure Assessm...IGNIS 2018 Webinar To Lock or Not to Lock: Using Respondus for.Secure Assessm...
IGNIS 2018 Webinar To Lock or Not to Lock: Using Respondus for.Secure Assessm...
 
IGNIS 2018 Intro Humanizing and Personalizing Information Literacy Derek Jorg...
IGNIS 2018 Intro Humanizing and Personalizing Information Literacy Derek Jorg...IGNIS 2018 Intro Humanizing and Personalizing Information Literacy Derek Jorg...
IGNIS 2018 Intro Humanizing and Personalizing Information Literacy Derek Jorg...
 

Recently uploaded

Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
DhatriParmar
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
Jheel Barad
 
Francesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptxFrancesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptx
EduSkills OECD
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
beazzy04
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
timhan337
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
Balvir Singh
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
Peter Windle
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
kaushalkr1407
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
Nguyen Thanh Tu Collection
 
678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf
CarlosHernanMontoyab2
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
GeoBlogs
 

Recently uploaded (20)

Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 
Francesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptxFrancesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptx
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
 
678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
 

IGNIS 2019 Will the test be multiple choice? Fully using Canvas Quiz Statistics to measure student learning - Melisa Ziegler 05.30.19

  • 1. Welcome! While you’re waiting for the webinar to start, please consider these questions and share your thoughts in the chat: 1. What types of assessments have you used in your teaching? 2. Which do you find to be the best for your students’ learning? 3. Which do you find to be the best for your teaching?
  • 2. “Will the test be multiple choice?”: Fully using Canvas Quiz Statistics to measure student learning IGNIS Webinar, May 30, 2:00-3:00pm Melisa Ziegler, PhD
  • 3. Learning Objectives - Describe at least three ways to improve testing and item design - Find the Quiz Statistics links in Canvas - Explain the difference between the Student and Item Analysis features - Describe standard deviation - Describe discrimination index - Identify at least two ways to use Quiz Statistics to improve future quizzes
  • 5. Poll 1 Do you assess your students’ learning using multiple-choice tests?
  • 6. Why test? Assessment Purpose: discriminate between students based on mastery of learning objectives Success: higher the discriminability of a test, the more effective the test Learning Purpose: improve students’ knowledge of learning objectives Success: the more students’ knowledge increases after a test, the more effective the test
  • 7. DiscussionIf you use multiple-choice tests, are they for assessment, learning, or both? Please share an example in the chat.
  • 8. Test Design Reliability Observed Score = True Score + Error The goal is to reduce error. Strategies: - Design a speed or power test based on your learning objectives - Write simple multiple-choice items - Write a moderately difficult test Validity Evidence to support the interpretation and use of test scores The goal is to accumulate evidence. Strategies: - Align your items to your learning objectives - Evaluate scores as measures of knowledge and cognition
  • 9. Item Design: Stem - Align items to your learning objectives - Recall: “Which of the following buildings is the tallest in the world?” - Compare: “Which of the following is a way in which hawks differ from eagles?” - Analyze: “Given that the patient shows symptoms X, Y, and Z, which of the following diagnoses is most likely?” (Butler, p. 326) - Phrase items positively (i.e. avoid using “not”) - Negative: Which of the following is not an example of classical conditioning? - Positive: Which of the following is an example of classical conditioning? - Unless this is a specific cognitive process you want them to practice that transfers beyond the class
  • 10. Stem Practice: Matching to Learning Objectives How could you better align this stem to this learning objective? Learning Objective: Determine the most appropriate exercise modality for health maintenance in elderly patients. Stem: Which of the following is the definition of exercise modality? Please share your answers in the chat.
  • 11. Stem Practice: Positive Phrasing How could you rephrase this stem using positive phrasing? Negative Phrasing: Which of the following is not an appropriate exercise modality for health maintenance for elderly patients? Please share your answers in the chat.
  • 12. Item Design: Distractors - Use a simple format (i.e. list of possible responses where only one is correct) - Use two or three distractors → base the number on the quality of the distractor - Use correct answers for one item on another item → benefits students’ learning - Use simple vocabulary that aligns with your textbook and your teaching - Rotate the correct answers within the distractors throughout the test - Avoid using “none of the above” or “all of the above” or “a and c” etc. - Make each response option about the same length - Check for spelling, punctuation, and grammar
  • 13. Distractor Practice What are some of the issues with these distractors? Stem: Which of the following is an appropriate exercise modality for health maintenance for elderly patients? a. Aquatherapy b. Work directly with the patient c. A and B d. Start with simple exercises followed by more complex exercises as patient progresses Please share your answers in the chat.
  • 14. Poll 2What is the most difficult part of the item for you to write: the stem, the correct answer, or the distractors?
  • 15. We’ve written our items and students have completed our test. Now what?
  • 16. Important Terms Standard Deviation σ or square root of the variance The spread of your scores. Discrimination Index How well an item discriminates between students according to how they did on the test The effectiveness of an item.
  • 17. Canvas Quiz Statistics Student Analysis Student Responses Item Analysis Difficulty Index Correct Student Count Standard Deviation by Item Point Biserial of Distractor
  • 18. Discrimination Index Practice Which of the following discrimination indices represents an item that best discriminates among students: +0.47 with 69% answering correctly, +0.56 with 92% answering correctly, or +0.22 with 85% answering correctly?
  • 19. Using Canvas Quiz Statistics to Help you Improve Student Analysis - How did a particular student respond? - You know your students. Who did you expect to know a topic and didn’t? - Opportunity for 1:1 follow up Item Analysis - Is it the item, concept, or both that students didn’t understand? - Did the distractors distract appropriately? - Model your thinking as you explain the correct answers in comparison to the distractors
  • 21. Q&A
  • 22. References Butler, A. (2018). Multiple-choice testing in education: Are the best practices for assessment also good for learning? Journal of Applied Research in Memory and Cognition, 7, 323-331. Canvas (2018). Canvas quiz item analysis. Retrieved from https://s3.amazonaws.com/tr-learncanvas/docs/CanvasQuizItemAnalysis.pdf Canvas (2019). Once I publish a quiz, what kinds of quiz statistics are available? Retrieved from https://community.canvaslms.com/docs/DOC-13037-415241484 Suen, H. K. (2018). Multiple-choice item-writing rules. Retrieved from http://www.schreyerinstitute.psu.edu/pdf/Multiple_Choice_Item_Writing_Rules.pdf
  • 23. Contact Information Melisa Ziegler, PhD Coordinator of Organizational Learning mziegler@tacomacc.edu
  • 24. THANK YOU! Unless otherwise specified, IGNIS content is licensed under a Creative Commons Attribution 4.0 International License.

Editor's Notes

  1. Both Use resources during the test to look up things they don’t know Apply resources to solve problems/answer questions Review test answers immediately after and offer opportunities to submit corrected/updated test
  2. Knowledge and cognition versus transferable skills Create a moderately difficult test (e.g. benefits of processing distractors and choosing the correct answer; concerns of processing distractors and choosing incorrect answers)
  3. Bloom’s Taxonomy: Knowledge, Comprehension, Application, Analysis, Synthesis, Evaluation Don’t use not ;)
  4. Standard deviation Sigma or square root of the variance Smaller SD when you think your students are more similar in their knowledge of the content Bigger SD when you think your students are more dissimilar in their knowledge of the content Discrimination Index Disciminate here means “shows the difference” How well does this item show the difference in knowledge levels among students Could also be considered how effective an item is Want a discrimination index higher than +.25 and Canvas will change the color to black to show this; red if under +.25 Point biserial correlation between getting the answer correct/incorrect and the overall score on the test You want those who did well on the test to get the more difficult answers correct Negative discimination indices mean there’s a problem with the item the people who are scoring high are getting the question wrong and the people scoring low are getting the question right Example of asking students about equality and those who knew a lot about the topic didn’t know how to answer because they were knowledgeable about equity “Equality is an important value for me.” or something like that Important to consider the discrimination index AND the percent who answered correctly Even with high discrimination index, if the % answered correctly is extremly high or low, it may not have been an effective question We want to discriminate among students in the mid range of their knowledge, not at the extreme easy or difficult ends
  5. Student Analysis Student responses: gives you a pretty ugly report, but it will show you item responses by student helpful in 1:1 mtgs with students Item Analysis Difficulty index: Proportion of students who answered correctly; higher the number, the more students who answered correctly; “Item Easiness Index” since it’s proportion that got the answer right Correct Student Count: How many students got the answer right Standard Deviation by Item: The spread for each item, easier questions should have a smaller SD and harder questions should have a bigger SD Point Biserial of Distractors: correlation of the students’ scores on the whole test to their item response; correct answers should be close to +1 and distractors close to -1; want your distractors to be equally appealing; if not, consider rewriting them; if a distractor isn’t plausible (i.e. no/few students chose it) then it’s not contributing to the performance of the item because the item becomes easier with fewer plausible alternatives