SlideShare a Scribd company logo
1 of 23
Multiple Choice Questions
Members
Miss Wipaporn Portip No.5681114010
Miss Salimah Tamhama No.5681114013
Miss Jantima Chuseang No.5681114014
Miss Theeranart Jansawat No.5681114061
Multiple choice is a form of assessment in which
respondents are asked to select the best possible answer out of
the choices from a list.
If guessing an answer, there's usually a 25 percent chance
of getting it correct on a 4 answer choice question.
Finding the right answer from multiple choices can be
automated using multiple choice question answering systems.
The multiple choice format is most frequently used in
educational testing, in market research, and in elections, when a
person chooses between multiple candidates, parties, or
policies.
History
Although E. L. Thorndike developed an early multiple
choice test, Frederick J. Kelly was the first to use such items as part
of a large scale assessment. While Director of the Training School
at Kansas State Normal School (now Emporia State University) in
1915, he developed and administered the Kansas Silent Reading
Test.
Soon after, Kelly became the third Dean of the College
of Education at the University of Kansas. The first all multiple
choice, large scale assessment was the Army Alpha, used to
assess the intelligence and more specifically the aptitudes of
World War I military recruits. Multiple choice testing is
particularly popular in the United States.
Characteristics of multiple-choice questions
Multiple-choice Questions are probably the most widely
used of objective tests. Such questions are normally composed of
four parts:
•STEM - question or incomplete statement or picture
•OPTIONS - suggested answers or completions
•DISTRACTERS - incorrect responses
•KEY - correct response
Advantages
•objective tests can sample a broad range of a course
•objective tests are rapidly marked
•students are not able to "bluff" or "pool" answers
•scoring is objective and reliable (e.g. no halo effect)
•distribution of scores is determined by the test - not by the
examiner
•only the objectives tested for are marked
•"good" items may be stored in an item bank and reused
Disadvantages
•objective tests are time consuming to set
•there is no credit for partial information
•objective tests may encourage guessing
•good objective tests are difficult to set
•student "selects" information
•objective tests may encourage reproduction learning
Limitations
•Difficult and time-consuming to write good items that
address thinking skills above the factual level
•The items are difficult to phrase so that all students
interpret them in the same way
•When students study for multiple choice tests, they focus
on recognition, not recall. Recent learning theories
indicate that students need to process information to really
learn it, so time spent studying for recognition is not as
effective as time spent working with information.
•By guessing, students who don’t know the answer have a
25% chance of correctly selecting the correct response in a
multiple choice item with 4 options. This decreases to
20% for items with 5 options, etc.
Options
In particular, the person constructing the test should AVOID
USING:
•serotyped or standard phrases which direct a student to the
correct answer
•unequal length of options where, in order to make the key
unambiguously correct, the examiner makes it obviously
longer than the distracters
• mutually exclusive options where, if one option is incorrect,
its opposite must be correct
• overlapping alternatives when one or more options is a subset
of another
• grammatical inconsistencies where options may be
disregarded because they are grammatically inconsistent with
the stem
• absolutes (never, always, only, none of the above, all of the
above). These options are usually incorrect
• the key in a different form from the distracters makes the
correct response more conspicuous
• double negatives - causes great confusion. Where negatives are
used they should only be used in the stem and should be
highlighted by printing in capitals or by underlining. "None of
the above" should only be used when it is important to conceal
a correct response which is easily recognized
Facility (F)
Facility (F) is the percentage of the class obtaining the
correct answer. In general:
if F < 30% the question is hard
if F = 30-75% the question is satisfactory
if F > 75% the question is easy
Writing Good Multiple Choice Test Questions
Multiple choice test questions, also known as items, can
be an effective and efficient way to assess learning outcomes.
Multiple choice test items have several potential advantages:
Versatility: Multiple choice test items can be written to
assess various levels of learning outcomes, from basic recall to
application, analysis, and evaluation. Because students are
choosing from a set of potential answers, however, there are
obvious limits on what can be tested with multiple choice items.
For example, they are not an effective way to test students’
ability to organize thoughts or articulate explanations or creative
ideas.
Reliability: is defined as the degree to which a test
consistently measures a learning outcome. Multiple choice test
items are less susceptible to guessing than true/false questions,
making them a more reliable means of assessment. The
reliability is enhanced when the number of MC items focused on
a single learning objective is increased. In addition, the
objective scoring associated with multiple choice test items frees
them from problems with scorer inconsistency that can plague
scoring of essay questions.
Validity: is the degree to which a test measures the learning
outcomes it purports to measure. Because students can typically
answer a multiple choice item much more quickly than an essay
question, tests based on multiple choice items can typically focus
on a relatively broad representation of course material, thus
increasing the validity of the assessment.
Multiple choice-questions
Multiple choice-questions
Multiple choice-questions

More Related Content

What's hot (20)

Assessment
AssessmentAssessment
Assessment
 
Maxims of teaching
Maxims of teachingMaxims of teaching
Maxims of teaching
 
Essay type test
Essay type testEssay type test
Essay type test
 
Lesson planning
Lesson planningLesson planning
Lesson planning
 
Objective Types of test...
Objective Types of test...Objective Types of test...
Objective Types of test...
 
Unit plan
Unit planUnit plan
Unit plan
 
Rating scale
Rating scaleRating scale
Rating scale
 
Objective Test Type
Objective Test TypeObjective Test Type
Objective Test Type
 
Educational objectives
Educational  objectivesEducational  objectives
Educational objectives
 
Item analysis ppt
Item analysis pptItem analysis ppt
Item analysis ppt
 
short answer Questions
short answer Questionsshort answer Questions
short answer Questions
 
Standardized Testing
Standardized TestingStandardized Testing
Standardized Testing
 
Standardized test
Standardized test Standardized test
Standardized test
 
Administering,scoring and reporting a test ppt
Administering,scoring and reporting a test pptAdministering,scoring and reporting a test ppt
Administering,scoring and reporting a test ppt
 
Micro teaching
Micro teachingMicro teaching
Micro teaching
 
checklist
checklistchecklist
checklist
 
Multiple choice tests
Multiple choice testsMultiple choice tests
Multiple choice tests
 
Unit planning
Unit planningUnit planning
Unit planning
 
ASSESSMENT AND TYPES OF ASSESSMENT
ASSESSMENT AND TYPES OF ASSESSMENTASSESSMENT AND TYPES OF ASSESSMENT
ASSESSMENT AND TYPES OF ASSESSMENT
 
STANDARDIZED AND NON-STANDARDIZED TEST
STANDARDIZED AND NON-STANDARDIZED TESTSTANDARDIZED AND NON-STANDARDIZED TEST
STANDARDIZED AND NON-STANDARDIZED TEST
 

Similar to Multiple choice-questions

Multiple Choice Tests
Multiple Choice TestsMultiple Choice Tests
Multiple Choice TestsDK Padua
 
Ed103format3 complete summary.docx[1]
Ed103format3 complete summary.docx[1]Ed103format3 complete summary.docx[1]
Ed103format3 complete summary.docx[1]mark maneb
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)HennaAnsari
 
EXAMINING DISTRACTORS AND EFFECTIVENESS
EXAMINING DISTRACTORS AND  EFFECTIVENESSEXAMINING DISTRACTORS AND  EFFECTIVENESS
EXAMINING DISTRACTORS AND EFFECTIVENESSJill Frances Salinas
 
HOW TO CONSTRUCT A MCQ.pptx
HOW TO CONSTRUCT A MCQ.pptxHOW TO CONSTRUCT A MCQ.pptx
HOW TO CONSTRUCT A MCQ.pptxDrNamrataMane
 
Assessment of Learning - Multiple Choice Test
Assessment of Learning - Multiple Choice TestAssessment of Learning - Multiple Choice Test
Assessment of Learning - Multiple Choice TestXiTian Miran
 
Multiple choice test items
Multiple choice test itemsMultiple choice test items
Multiple choice test itemslorne27
 
Writing good multiple choice test questions
Writing good multiple choice test questionsWriting good multiple choice test questions
Writing good multiple choice test questionsenglishonecfl
 
TEST_CONSTRUCTION.pptx
TEST_CONSTRUCTION.pptxTEST_CONSTRUCTION.pptx
TEST_CONSTRUCTION.pptxJayMaravilla1
 
Chapter 6: Writing Objective Test Items
Chapter 6: Writing Objective Test ItemsChapter 6: Writing Objective Test Items
Chapter 6: Writing Objective Test ItemsSHELAMIE SANTILLAN
 
Multiple Choice Test
Multiple Choice TestMultiple Choice Test
Multiple Choice TestJen Gregana
 
Educational Psychology Developing Learners 8th Edition Ormrod Test Bank
Educational Psychology Developing Learners 8th Edition Ormrod Test BankEducational Psychology Developing Learners 8th Edition Ormrod Test Bank
Educational Psychology Developing Learners 8th Edition Ormrod Test Bankkynep
 
Sreedevi P.S
Sreedevi P.SSreedevi P.S
Sreedevi P.SSree Devi
 
Designing Test Questions
Designing Test QuestionsDesigning Test Questions
Designing Test QuestionsGuinevere Shaw
 
Designing Test Questions
Designing Test QuestionsDesigning Test Questions
Designing Test QuestionsGuin Shaw
 
Lesson - Questionnaire.pptx
Lesson         -           Questionnaire.pptxLesson         -           Questionnaire.pptx
Lesson - Questionnaire.pptxJessaBejer1
 

Similar to Multiple choice-questions (20)

Multiple Choice Tests
Multiple Choice TestsMultiple Choice Tests
Multiple Choice Tests
 
Ed103format3 complete summary.docx[1]
Ed103format3 complete summary.docx[1]Ed103format3 complete summary.docx[1]
Ed103format3 complete summary.docx[1]
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)
 
EXAMINING DISTRACTORS AND EFFECTIVENESS
EXAMINING DISTRACTORS AND  EFFECTIVENESSEXAMINING DISTRACTORS AND  EFFECTIVENESS
EXAMINING DISTRACTORS AND EFFECTIVENESS
 
HOW TO CONSTRUCT A MCQ.pptx
HOW TO CONSTRUCT A MCQ.pptxHOW TO CONSTRUCT A MCQ.pptx
HOW TO CONSTRUCT A MCQ.pptx
 
Assessment of Learning - Multiple Choice Test
Assessment of Learning - Multiple Choice TestAssessment of Learning - Multiple Choice Test
Assessment of Learning - Multiple Choice Test
 
Multiple choice test items
Multiple choice test itemsMultiple choice test items
Multiple choice test items
 
Item writing
Item writingItem writing
Item writing
 
Questions
QuestionsQuestions
Questions
 
Writing good multiple choice test questions
Writing good multiple choice test questionsWriting good multiple choice test questions
Writing good multiple choice test questions
 
TEST_CONSTRUCTION.pptx
TEST_CONSTRUCTION.pptxTEST_CONSTRUCTION.pptx
TEST_CONSTRUCTION.pptx
 
Chapter 6: Writing Objective Test Items
Chapter 6: Writing Objective Test ItemsChapter 6: Writing Objective Test Items
Chapter 6: Writing Objective Test Items
 
Multiple Choice Test
Multiple Choice TestMultiple Choice Test
Multiple Choice Test
 
Educational Psychology Developing Learners 8th Edition Ormrod Test Bank
Educational Psychology Developing Learners 8th Edition Ormrod Test BankEducational Psychology Developing Learners 8th Edition Ormrod Test Bank
Educational Psychology Developing Learners 8th Edition Ormrod Test Bank
 
Multiple choice
Multiple choiceMultiple choice
Multiple choice
 
Sreedevi P.S
Sreedevi P.SSreedevi P.S
Sreedevi P.S
 
Designing Test Questions
Designing Test QuestionsDesigning Test Questions
Designing Test Questions
 
Designing Test Questions
Designing Test QuestionsDesigning Test Questions
Designing Test Questions
 
Lesson - Questionnaire.pptx
Lesson         -           Questionnaire.pptxLesson         -           Questionnaire.pptx
Lesson - Questionnaire.pptx
 
Creating exams
Creating examsCreating exams
Creating exams
 

Recently uploaded

CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docxPoojaSen20
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsKarinaGenton
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...M56BOOKSTORE PRODUCT/SERVICE
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsanshu789521
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Celine George
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon AUnboundStockton
 

Recently uploaded (20)

CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docx
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its Characteristics
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha elections
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon A
 

Multiple choice-questions

  • 2. Members Miss Wipaporn Portip No.5681114010 Miss Salimah Tamhama No.5681114013 Miss Jantima Chuseang No.5681114014 Miss Theeranart Jansawat No.5681114061
  • 3. Multiple choice is a form of assessment in which respondents are asked to select the best possible answer out of the choices from a list. If guessing an answer, there's usually a 25 percent chance of getting it correct on a 4 answer choice question.
  • 4. Finding the right answer from multiple choices can be automated using multiple choice question answering systems. The multiple choice format is most frequently used in educational testing, in market research, and in elections, when a person chooses between multiple candidates, parties, or policies.
  • 5. History Although E. L. Thorndike developed an early multiple choice test, Frederick J. Kelly was the first to use such items as part of a large scale assessment. While Director of the Training School at Kansas State Normal School (now Emporia State University) in 1915, he developed and administered the Kansas Silent Reading Test.
  • 6. Soon after, Kelly became the third Dean of the College of Education at the University of Kansas. The first all multiple choice, large scale assessment was the Army Alpha, used to assess the intelligence and more specifically the aptitudes of World War I military recruits. Multiple choice testing is particularly popular in the United States.
  • 7. Characteristics of multiple-choice questions Multiple-choice Questions are probably the most widely used of objective tests. Such questions are normally composed of four parts: •STEM - question or incomplete statement or picture •OPTIONS - suggested answers or completions •DISTRACTERS - incorrect responses •KEY - correct response
  • 8. Advantages •objective tests can sample a broad range of a course •objective tests are rapidly marked •students are not able to "bluff" or "pool" answers
  • 9. •scoring is objective and reliable (e.g. no halo effect) •distribution of scores is determined by the test - not by the examiner •only the objectives tested for are marked •"good" items may be stored in an item bank and reused
  • 10. Disadvantages •objective tests are time consuming to set •there is no credit for partial information •objective tests may encourage guessing •good objective tests are difficult to set •student "selects" information •objective tests may encourage reproduction learning
  • 11. Limitations •Difficult and time-consuming to write good items that address thinking skills above the factual level •The items are difficult to phrase so that all students interpret them in the same way
  • 12. •When students study for multiple choice tests, they focus on recognition, not recall. Recent learning theories indicate that students need to process information to really learn it, so time spent studying for recognition is not as effective as time spent working with information. •By guessing, students who don’t know the answer have a 25% chance of correctly selecting the correct response in a multiple choice item with 4 options. This decreases to 20% for items with 5 options, etc.
  • 13. Options In particular, the person constructing the test should AVOID USING: •serotyped or standard phrases which direct a student to the correct answer •unequal length of options where, in order to make the key unambiguously correct, the examiner makes it obviously longer than the distracters
  • 14. • mutually exclusive options where, if one option is incorrect, its opposite must be correct • overlapping alternatives when one or more options is a subset of another • grammatical inconsistencies where options may be disregarded because they are grammatically inconsistent with the stem • absolutes (never, always, only, none of the above, all of the above). These options are usually incorrect
  • 15. • the key in a different form from the distracters makes the correct response more conspicuous • double negatives - causes great confusion. Where negatives are used they should only be used in the stem and should be highlighted by printing in capitals or by underlining. "None of the above" should only be used when it is important to conceal a correct response which is easily recognized
  • 16. Facility (F) Facility (F) is the percentage of the class obtaining the correct answer. In general: if F < 30% the question is hard if F = 30-75% the question is satisfactory if F > 75% the question is easy
  • 17. Writing Good Multiple Choice Test Questions Multiple choice test questions, also known as items, can be an effective and efficient way to assess learning outcomes. Multiple choice test items have several potential advantages:
  • 18. Versatility: Multiple choice test items can be written to assess various levels of learning outcomes, from basic recall to application, analysis, and evaluation. Because students are choosing from a set of potential answers, however, there are obvious limits on what can be tested with multiple choice items. For example, they are not an effective way to test students’ ability to organize thoughts or articulate explanations or creative ideas.
  • 19. Reliability: is defined as the degree to which a test consistently measures a learning outcome. Multiple choice test items are less susceptible to guessing than true/false questions, making them a more reliable means of assessment. The reliability is enhanced when the number of MC items focused on a single learning objective is increased. In addition, the objective scoring associated with multiple choice test items frees them from problems with scorer inconsistency that can plague scoring of essay questions.
  • 20. Validity: is the degree to which a test measures the learning outcomes it purports to measure. Because students can typically answer a multiple choice item much more quickly than an essay question, tests based on multiple choice items can typically focus on a relatively broad representation of course material, thus increasing the validity of the assessment.