34. Student oTest anxiety, cheat, guess, interpretation different than intentEnvironment oC old, hot, poor light, time restraints, noise, lunch, recess
35. Eliminating errors due to bias increase the Reliability of our assessments
36. W hat was new?W hat was re-new?
37. Steps to Structured ResponsetestPrepare a blueprintSelect material to assessBuild test items from propositions
38. Step 1Prepare a blueprint
39. Cnn ot t e Ko & nw Poes rcs& Tt oa l Tr t ae gs U drad ne t sn Ap a n pl t ic ioFr s fom o 1 0 5 1 5gvrmnoe et nS ut e f St c r oU r u 7 5 1 2gvrmnoe et nRh & igts 8 5 1 3r p nibitse os il s ieo cizn fitesTt oa l 2 5 1 5 4 0
40. Step 2Select material to assess
41. “ It is always tempting to emphasize the parts of the course that are easiest to test, rather than the parts that are important to test.” Ben C lay Is This a Trick Question?
42. So what’s worthassessing?
43. Review the C ase StudyW hich test items, if any, need to be changed?C an you think of a test that included items you felt weren’t worth learning or assessing?H ow do you make decisions about what’s worth assessing?
44. So . . . ?A select sub-set of all possible important elementsProfessional judgment of relative importance
45. Step 3Build test items from propositions o“ C learlystated sentences that reflect elements of content aligned to C ourse / U nit EU s & EQ s.” oC reate more than blueprint requires
46. ExamplesIn a monarchy, the right to govern is secured through birth.The executive and legislative branches differ in that the latter is elected directly by the people.
47. T rue or FalseIn a monarchy, the right to govern is secured through birth.orIn a monarchy, the right to govern is secured through the approval of those governed.
48. Fill in the BlankH ow is the right to govern secured in a monarchy?
49. Multiple C hoiceH ow is the right to govern secured in a monarchy? A . W ith military power B. T hrough birth C . By popular vote D . Through purchase
50. T rue or FalseThe executive and legislative branches differ in that the latter is elected directly by the people.orMembers of executive and legislative branches are both elected directly by the people.
51. Fill in the BlankElection of members of the executive and legislative branches differ in what way?
52. Multiple C hoiceElection of members of the executive and legislative branches differ in what way? A . Legislators are restricted by term limits; presidents are not B. Legislators are elected directly; presidents are not. C . O ne must register to vote for legislators; not for president D . O ne must register to vote for presidents;
53. Franzipanics Q uiz
54. Specific assessment criteria
55. Multiple choiceA dvantages oEffectivemeasurement oReduces guessing oC an cover wide range of contentD isadvantages oD ifficult to create
56. Multiple C hoice suggestionsStem is a clear, explicit & singular questionU se at least four alternativesA void grammatical / sentence structural cuesH ighlight the negative in negatively stated stems
57. A lternatives are the same format and lengthA ll alternatives should be plausibleA void answer patterns
58. Is the question any good?Student who knows the content will know the answer before reading the alternatives
59. “ Your goal is not to trick students or require them to make difficult judgments about two nearly equal options.”
60. “ Your goal is to write questions that students who understand the material will answer correctly and students who do not understand will answer incorrectly.” D r. John Johnson Penn State U niversity