Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
  Designing Objective  (Multiple Choice) Exams   Mike DeBisschop, Dawn Rager,  and Theresa Westbay
Tools & Strategies for Writing Questions <ul><li>Types of Questions </li></ul><ul><ul><li>Factual </li></ul></ul><ul><ul><...
Another Example of an Exam Blueprint % of Test Items at Each Level Number of Questions 4 3 2 1 Applied Questions Conceptua...
Tools & Strategies for Writing Questions <ul><li>Design of Questions </li></ul><ul><ul><li>Simplicity and clarity are usua...
Minimizing Test Anxiety <ul><li>Consider giving practice questions </li></ul><ul><li>Consider permitting students to ask f...
Evaluating Test Items & the Exam as a Whole <ul><li>Item analysis </li></ul><ul><li>Peer review </li></ul><ul><li>Consider...
Activity: Evaluating Items <ul><li>Activity on evaluating multiple choice items at the University of Texas Instructional A...
Additional Resources <ul><li>PETAL website </li></ul><ul><ul><li>Grading </li></ul></ul><ul><li>Writing Multiple-Choice Qu...
Upcoming SlideShare
Loading in …5
×

Designing MC Exams

518 views

Published on

Grading & Midterm Assessments - Designing Exams: A Roundtable Exchange of What Works in Creating Objective Questions

Published in: Education
  • Be the first to comment

  • Be the first to like this

Designing MC Exams

  1. 1. Designing Objective (Multiple Choice) Exams Mike DeBisschop, Dawn Rager, and Theresa Westbay
  2. 2. Tools & Strategies for Writing Questions <ul><li>Types of Questions </li></ul><ul><ul><li>Factual </li></ul></ul><ul><ul><li>Conceptual </li></ul></ul><ul><ul><li>Applied </li></ul></ul><ul><ul><li>See examples corresponding to Bloom’s Taxonomy at the University of Texas Instructional Assessment Resources website </li></ul></ul><ul><li>Content of Questions and the Exam as a Whole </li></ul><ul><ul><li>Work backwards from learning objectives </li></ul></ul><ul><ul><li>Does the distribution of items make sense given the learning objectives? </li></ul></ul><ul><ul><li>Construct an exam blueprint </li></ul></ul><ul><ul><ul><li>See example blueprint at the University of Texas Instructional Assessment Resources website </li></ul></ul></ul>
  3. 3. Another Example of an Exam Blueprint % of Test Items at Each Level Number of Questions 4 3 2 1 Applied Questions Conceptual Questions Factual Questions Topics % of Test Devoted to Each Topic Number of Questions Levels of Understanding
  4. 4. Tools & Strategies for Writing Questions <ul><li>Design of Questions </li></ul><ul><ul><li>Simplicity and clarity are usually best </li></ul></ul><ul><ul><li>Avoid &quot;tricky&quot; or confusing questions </li></ul></ul><ul><ul><li>Take extra care when using negative language </li></ul></ul><ul><ul><li>Avoid obvious distracter items </li></ul></ul><ul><li>Time Considerations </li></ul><ul><ul><li>Carefully consider the length of the exam and time required to complete it </li></ul></ul><ul><ul><ul><li>Influenced by the nature of the items </li></ul></ul></ul><ul><ul><ul><li>Try to keep questions brief </li></ul></ul></ul><ul><ul><ul><li>Consider individual student variability </li></ul></ul></ul>
  5. 5. Minimizing Test Anxiety <ul><li>Consider giving practice questions </li></ul><ul><li>Consider permitting students to ask for clarification </li></ul><ul><li>Consider using humor in small doses </li></ul>
  6. 6. Evaluating Test Items & the Exam as a Whole <ul><li>Item analysis </li></ul><ul><li>Peer review </li></ul><ul><li>Consider allowing students to challenge questions in a controlled, but fair manner </li></ul><ul><li>Consider marking and quickly reviewing scantrons by hand to detect errors and discourage cheating </li></ul><ul><li>What to do when you discover that an item is faulty </li></ul><ul><li>Evaluate the overall grade distribution </li></ul><ul><ul><li>Compare across sections and/or over time if possible </li></ul></ul><ul><li>Use the information gathered reflectively in designing future exams </li></ul>
  7. 7. Activity: Evaluating Items <ul><li>Activity on evaluating multiple choice items at the University of Texas Instructional Assessment Resources website </li></ul>
  8. 8. Additional Resources <ul><li>PETAL website </li></ul><ul><ul><li>Grading </li></ul></ul><ul><li>Writing Multiple-Choice Questions that Demand Critical Thinking </li></ul><ul><li>Designing and Managing MCQs : </li></ul>

×