SlideShare a Scribd company logo
1 of 8
Download to read offline
TEMPLATE #2
STEP 4: DEVELOP ITEMS/TASKS
Procedural Steps: Multiple Choice (MC) Items
1. Review the targeted content standard.
2. Determine which aspects of the standard can be measured objectively.
3. Select the focused aspect and determine the cognitive demand reflected in the standard’s
description.
4. Create a question (stem), one (1) correct answer, and plausible (realistic) distractors.
5. Review the item and answer options for grammatical soundness.

Framework: MC
1.

___<Item Stem>___________________________________________________________.

A. __<Answer Option>__
B. __<Answer Option>__
C. __<Answer Option>__
D. __<Answer Option>__
(___<Item Tag>___)

QA Checklist: MC
 Presents a definite, explicit, and singular question, which is worded positively.
 Contains only one (1) correct answer, with each distractor being plausible and/or
representing common misconceptions.
 Consists of answer options being of similar length, structure, and format.
 Places charts, tables, graphs, and/or images within the item.
 Uses consistent grammar among the question (stem) and answer options.
 Avoids multiple answer options, such as “All of the above.”, “None of the above.”, and
“Both A and B.”
Template #2-Building the Assessment
1
 Arranges answer options in logical order when applicable, such as numeric or chronological
order.
 Avoids repeating the same words or phrases in each of the answer options.

Procedural Steps: Short Answer (SA) Tasks
1. Review the targeted content standard(s).
2. Determine which aspects of the standard(s) can be best measured by having students
“construct” a short response.
3. Select and list aspects of the targeted content standard(s) to be measured.
4. Create a prompt, select a passage, or develop a scenario for students.
5. Develop a clear statement that articulates specific criteria for the test-taker to provide.

Framework: SA
Directions:

_______________________________<Task/Passage/Scenario>__________________________
______________________________________________________________________________

___<Item Stem>________________________________________________________________
__<Response Area>_____________________________________________________________
(___<Item Tag>___)

Technical Note: Short Answer (SA) or Short Constructed Response (SCR) item-types are
typically assigned up to three (3) points.

QA Checklist: SA
 Presents a prompt, scenario, or passage using content-specific terminology, along with
developmentally appropriate references.
 Ensures the prompt, passage, or scenario is concise, free of jargon, and grammatically
correct.
 Uses appropriate verbs to communicate expectations.
 Articulates response instructions using a clear sentence structure.
 Communicates in clear, unambiguous terms the extent of the expected answer.
Template #2-Building the Assessment
2
Procedural Steps: Extended Answer (EA) Tasks
1. Review the targeted content standard(s).
2. Determine which aspects of the standard(s) can be best measured by having students
“construct” an extended response to a given prompt, scenario, or passage.
3. Select and list aspects of the targeted content standard(s) to be measured.
4. Create a prompt, select a passage, or develop a scenario for students.
5. Develop a clear statement for each subordinate task that articulates specific criteria for the
test-taker to provide.
Framework: EA
Directions:

_____________________________<Task/Passage/Scenario>____________________________
______________________________________________________________________________
______________________________________________________________________________

___<Item Stem>________________________________________________________________
__<Response Area>_____________________________________________________________
(___<Item Tag>___)

QA Checklist: EA
 Presents a prompt, scenario, or passage using content-specific terminology, along with
developmentally appropriate references.
 Aligns the prompt, scenario, passage and test-taker response requirements with the targeted
content standard(s) identified in the test blueprint.
 Uses appropriate verbs to communicate expectation.
 Communicates in clear, unambiguous terms the extent of the expected answer.
 Ensures non-content specific behaviors (e.g., attitude, motivational levels, engagement,
attendance, etc.) are not articulated in either the response criteria or scoring rubric.

Template #2-Building the Assessment
3
Procedural Steps: Extended Performance (EP) Tasks
1. Review the targeted content standard(s).
2. Determine which aspects of the standard(s) can be best measured by having students
“develop” a complex response, demonstration, or performance over an extend period of time
(e.g., two weeks).
3. Select and list all aspects of the targeted content standard(s) to be measured.
4. Create a project, portfolio, or demonstration expectation statement that includes subordinate
tasks, which are aligned to the test blueprint.
5. Develop a clear statement for each subordinate task that articulates specific criteria for the
test-taker to provide.

Framework: EP Tasks
_______________________<Project-Portfolio-Demonstration Description>____________________
______________________________________________________________________________

___<Task __ of __ >_____________________________________________________________
__<Criteria>___________________________________________________________________
(___<Item Tag>___)

QA Checklist: EP Tasks
 Presents project, portfolio, or demonstration using content-specific terminology, along with
developmentally appropriate references.
 Aligns the project, portfolio, or demonstration and test-taker response requirements with the
targeted content standards identified in the test blueprint.
 Uses appropriate verbs to communicate expectation.
 Communicates in clear, unambiguous terms the extent of the expected answer.
 Ensures non-content specific behaviors (e.g., attitude, motivational levels, engagement,
attendance, etc.) are not articulated in either the response criteria or scoring rubric.

Template #2-Building the Assessment
4
STEP 5: SCORING KEYS AND RUBRICS
SCORING KEYS: MC ITEMS
Procedural Steps
1. Enter the assessment information at the top of the Scoring Key.
2. Record the item number, item tag (optional), item type, and point value.
3. Record the MC answers in the Answer column.
4. Repeat steps 1-4 until all items on the test blueprint are reflected within the Scoring Key.
5. Validate that each question-to-answer relationship is recorded correctly.
Framework
Assessment Name

Item #

Grade/Course

Item Tag

Item Type

Administration

Point Value

Total Possible
Points

Answer

1
2

QA Checklist: MC Items
 All items articulated on the test specifications are represented within the Scoring Key.
 All items have been validated to ensure only one correct answer exists among the possible
answer options.
 Answers do not create a discernible pattern.
 Answers are “balanced” among the possible options.
 Answers are revalidated after the assessment reviews are complete.
SCORING RUBRICS
Procedural Steps
1. Review the SA, EA, or EP task and the criteria articulated in the stem/directions.
2. Select a “generic” rubric structure (see Template #2: Building the Assessment) based upon (a)
scoring criteria and, (b) the number of dimensions being measured.
3. Modify the rubric language using specific criteria expected in the response to award the
maximum number of points.
4. Determine how much the response can deviate from “fully correct” in order to earn the next
(lower) point value. [Continue until the full range of possible scores is described.]
5. During the review, ensure the response expectation, scoring rubric, and test blueprint are
fully aligned.
Template #2-Building the Assessment
5
Framework
Short Answer (SA) – Single Dimension
Item # _____ Sample Response for: ______________________________________________
2 points
1 point
0 points

Extended Answer (EA) – Single Dimension
Item #_____ Sample Response for: ____________________________________________
4 points
3 points
2 points
1 point
0 points

Extended Performance (EP) Task – Multi-dimensional
Item #_____ Sample Response for: ____________________________________________
Dimension

Advanced
(4 points)

Proficient
(3 points)

Basic
(2 points)

Below Basic
(1 points)

QA Checklist: Scoring Rubrics
 Scoring rubrics must:
 reflect a performance continuum;
 be clear and concise; and,
 include all dimensions (components) of the task.
 Sample expectations are used to provide a guide as to what demonstrates a “fully complete”
response.
 Avoid including non-cognitive attributes (e.g., motivation, timeliness, etc.).

Template #2-Building the Assessment
6
STEP 6: CREATE TEST FORMS
Procedural Steps: Administration Guidelines
1. Create a series of administrative steps for before, during, and after the assessment window.
2. Explain any requirements or equipment necessary, including accommodations. State any
ancillary materials (e.g., calculators) needed or allowed by the test-takers.
3. Identify the approximate time afforded to complete the assessment, including each subtask in
an EP task.
4. Include detailed “scripts” articulating exactly what is to be communicated to students,
especially when administering performance tasks over a long period of time.
5. Include procedures for scoring, administering make-ups, and handling completed
assessments.
Framework: Administration Guidelines
Preparation
STEP 1.
STEP 2.
STEP 3.

____________________________________________________________
____________________________________________________________
____________________________________________________________

Administration
STEP 1.
STEP 2.
STEP 3.

____________________________________________________________
____________________________________________________________
____________________________________________________________

After Testing
STEP 1.
____________________________________________________________
STEP 2.
____________________________________________________________
STEP 3.
____________________________________________________________
QA Checklist: Administration Guidelines
 Guidelines explain administrative steps before, during, and after the assessment window.
 Guidelines articulate the step-by-step procedures during each phase of administration.
 Requirements for completing the performance measure items/tasks, including
accommodations, equipment, and material are included.
 Approximate time needed to complete the overall performance measure is provided.
 Detailed “scripts” articulate the information to be communicated in a standardized manner.

Template #2-Building the Assessment
7
Procedural Steps: Test Forms
1. Develop a cover page stating the test form developed and include any necessary demographic
information (e.g., section number, student name, date administered, etc.).
2. Organize the items/tasks/prompts in a sequence that will maximize student engagement.
3. Add item tags and section dividers (optional).
4. Refine the draft form to minimize “blank space”, verify picture, graph, table, and figure
placement in relationship to the item/task, and ensure MC answer options do not drift from
one page to the next.
5. Add scoring rubric or criteria for constructed response tasks.

Framework: Test Forms
*Note: See content model assessments in the “Guides” folder.


Cover



Administration Guidelines



MC and SA Questions



EA Questions



EP Tasks with Scoring Rubric(s)

QA Checklist: Test Forms
 Directions state what to do, where and how to respond, and the point value for items/tasks.
 Items/tasks/prompts on the test form reflect the blueprint.
 Form layout minimizes “white space”, “drift” “crowding of items”, and distance from stem
to response options/placement.
 Forms are free from unclear, small, or unnecessary images, figures, charts, or graphs.

Template #2-Building the Assessment
8

More Related Content

Similar to Template #2 Building the Assessment-22JAN14

Template #1-Designing the Assessment-June 2014-FINAL
Template #1-Designing the Assessment-June 2014-FINALTemplate #1-Designing the Assessment-June 2014-FINAL
Template #1-Designing the Assessment-June 2014-FINALResearch in Action, Inc.
 
Template #1 Designing the Assessment-22JAN14
Template #1 Designing the Assessment-22JAN14Template #1 Designing the Assessment-22JAN14
Template #1 Designing the Assessment-22JAN14Research in Action, Inc.
 
Developing Assessment Instruments
Developing Assessment InstrumentsDeveloping Assessment Instruments
Developing Assessment InstrumentsAngel Jones
 
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINALHO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINALResearch in Action, Inc.
 
Template #6-Performance Measure Rubric-May 2014-Final
Template #6-Performance Measure Rubric-May 2014-FinalTemplate #6-Performance Measure Rubric-May 2014-Final
Template #6-Performance Measure Rubric-May 2014-FinalResearch in Action, Inc.
 
TABLE OF SPECIFICATION
TABLE OF SPECIFICATIONTABLE OF SPECIFICATION
TABLE OF SPECIFICATIONfloriejean
 
Template #3a performance measure rubric-final-la
Template #3a performance measure rubric-final-laTemplate #3a performance measure rubric-final-la
Template #3a performance measure rubric-final-laResearch in Action, Inc.
 
Template #3-Performance Measure Rubric-June 2014-FINAL
Template #3-Performance Measure Rubric-June 2014-FINALTemplate #3-Performance Measure Rubric-June 2014-FINAL
Template #3-Performance Measure Rubric-June 2014-FINALResearch in Action, Inc.
 
HO #3-Reviewing the Assessment-Scored Example-22JAN14
HO #3-Reviewing the Assessment-Scored Example-22JAN14HO #3-Reviewing the Assessment-Scored Example-22JAN14
HO #3-Reviewing the Assessment-Scored Example-22JAN14Research in Action, Inc.
 
M1-Designing the Assessment-June 2014-FINAL
M1-Designing the Assessment-June 2014-FINALM1-Designing the Assessment-June 2014-FINAL
M1-Designing the Assessment-June 2014-FINALResearch in Action, Inc.
 
STEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLSSTEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLSLoradelLegaspi
 
Apt 501 chapter_7
Apt 501 chapter_7Apt 501 chapter_7
Apt 501 chapter_7cdjhaigler
 
Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7cdjhaigler
 
Developing Assessment Instrument
Developing Assessment InstrumentDeveloping Assessment Instrument
Developing Assessment Instrumentcdjhaigler
 
Assessment_Basics[1]
Assessment_Basics[1]Assessment_Basics[1]
Assessment_Basics[1]'Gbenga Aina
 

Similar to Template #2 Building the Assessment-22JAN14 (20)

Template #1-Designing the Assessment-June 2014-FINAL
Template #1-Designing the Assessment-June 2014-FINALTemplate #1-Designing the Assessment-June 2014-FINAL
Template #1-Designing the Assessment-June 2014-FINAL
 
Template #1 Designing the Assessment-22JAN14
Template #1 Designing the Assessment-22JAN14Template #1 Designing the Assessment-22JAN14
Template #1 Designing the Assessment-22JAN14
 
Template #1 designing the slo-sso-final
Template #1 designing the slo-sso-finalTemplate #1 designing the slo-sso-final
Template #1 designing the slo-sso-final
 
Developing Assessment Instruments
Developing Assessment InstrumentsDeveloping Assessment Instruments
Developing Assessment Instruments
 
Chapter 10 apt 501
Chapter 10 apt 501Chapter 10 apt 501
Chapter 10 apt 501
 
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINALHO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
 
Template #6-Performance Measure Rubric-May 2014-Final
Template #6-Performance Measure Rubric-May 2014-FinalTemplate #6-Performance Measure Rubric-May 2014-Final
Template #6-Performance Measure Rubric-May 2014-Final
 
QS M1-Designing the Assessment-22JAN14
QS M1-Designing the Assessment-22JAN14QS M1-Designing the Assessment-22JAN14
QS M1-Designing the Assessment-22JAN14
 
TABLE OF SPECIFICATION
TABLE OF SPECIFICATIONTABLE OF SPECIFICATION
TABLE OF SPECIFICATION
 
Template #3a performance measure rubric-final-la
Template #3a performance measure rubric-final-laTemplate #3a performance measure rubric-final-la
Template #3a performance measure rubric-final-la
 
QS M2-Building the Assessment-11FEB14
QS M2-Building the Assessment-11FEB14QS M2-Building the Assessment-11FEB14
QS M2-Building the Assessment-11FEB14
 
Template #3-Performance Measure Rubric-June 2014-FINAL
Template #3-Performance Measure Rubric-June 2014-FINALTemplate #3-Performance Measure Rubric-June 2014-FINAL
Template #3-Performance Measure Rubric-June 2014-FINAL
 
HO #3-Reviewing the Assessment-Scored Example-22JAN14
HO #3-Reviewing the Assessment-Scored Example-22JAN14HO #3-Reviewing the Assessment-Scored Example-22JAN14
HO #3-Reviewing the Assessment-Scored Example-22JAN14
 
M1-Designing the Assessment-June 2014-FINAL
M1-Designing the Assessment-June 2014-FINALM1-Designing the Assessment-June 2014-FINAL
M1-Designing the Assessment-June 2014-FINAL
 
STEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLSSTEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLS
 
Apt 501 chapter_7
Apt 501 chapter_7Apt 501 chapter_7
Apt 501 chapter_7
 
Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7
 
Developing Assessment Instrument
Developing Assessment InstrumentDeveloping Assessment Instrument
Developing Assessment Instrument
 
Achievment Test.pptx
Achievment Test.pptxAchievment Test.pptx
Achievment Test.pptx
 
Assessment_Basics[1]
Assessment_Basics[1]Assessment_Basics[1]
Assessment_Basics[1]
 

More from Research in Action, Inc.

Quick Start Users Guide-June 2014-Working Draft
Quick Start Users Guide-June 2014-Working DraftQuick Start Users Guide-June 2014-Working Draft
Quick Start Users Guide-June 2014-Working DraftResearch in Action, Inc.
 
Performance Task Framework-June 2014-FINAL
Performance Task Framework-June 2014-FINALPerformance Task Framework-June 2014-FINAL
Performance Task Framework-June 2014-FINALResearch in Action, Inc.
 
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)Research in Action, Inc.
 
Model #3-Nutrition Culinary-Level III-DEMO-FINAL
Model #3-Nutrition Culinary-Level III-DEMO-FINALModel #3-Nutrition Culinary-Level III-DEMO-FINAL
Model #3-Nutrition Culinary-Level III-DEMO-FINALResearch in Action, Inc.
 

More from Research in Action, Inc. (20)

SLO for teachers
SLO for teachersSLO for teachers
SLO for teachers
 
M3-Reviewing the SLO-SSO-DemoSite
M3-Reviewing the SLO-SSO-DemoSiteM3-Reviewing the SLO-SSO-DemoSite
M3-Reviewing the SLO-SSO-DemoSite
 
M2-Building the SLO-SSO-DemoSite
M2-Building the SLO-SSO-DemoSiteM2-Building the SLO-SSO-DemoSite
M2-Building the SLO-SSO-DemoSite
 
M1 Designing the SLO-SSO-Demo Site
M1 Designing the SLO-SSO-Demo SiteM1 Designing the SLO-SSO-Demo Site
M1 Designing the SLO-SSO-Demo Site
 
M0 School Leader Orientation-Demo Site
M0 School Leader Orientation-Demo SiteM0 School Leader Orientation-Demo Site
M0 School Leader Orientation-Demo Site
 
M0 Orientation to the SLO-SSO-DemoSite
M0 Orientation to the SLO-SSO-DemoSiteM0 Orientation to the SLO-SSO-DemoSite
M0 Orientation to the SLO-SSO-DemoSite
 
Template #3 coherency rubric-final-jp
Template #3 coherency rubric-final-jpTemplate #3 coherency rubric-final-jp
Template #3 coherency rubric-final-jp
 
Template #2c building the sso-final
Template #2c building the sso-finalTemplate #2c building the sso-final
Template #2c building the sso-final
 
Template #2a building the slo-final
Template #2a building the slo-finalTemplate #2a building the slo-final
Template #2a building the slo-final
 
M3 reviewing the slo-sso-final
M3 reviewing the slo-sso-finalM3 reviewing the slo-sso-final
M3 reviewing the slo-sso-final
 
M2 building the slo-sso-final
M2 building the slo-sso-finalM2 building the slo-sso-final
M2 building the slo-sso-final
 
M1 designing the slo-sso-final
M1 designing the slo-sso-finalM1 designing the slo-sso-final
M1 designing the slo-sso-final
 
M0 school leader orientation-final
M0 school leader orientation-finalM0 school leader orientation-final
M0 school leader orientation-final
 
M0 orientation to the slo-sso-final
M0 orientation to the slo-sso-finalM0 orientation to the slo-sso-final
M0 orientation to the slo-sso-final
 
Educator evaluation policy overview-final
Educator evaluation policy overview-finalEducator evaluation policy overview-final
Educator evaluation policy overview-final
 
Quick Start Users Guide-June 2014-Working Draft
Quick Start Users Guide-June 2014-Working DraftQuick Start Users Guide-June 2014-Working Draft
Quick Start Users Guide-June 2014-Working Draft
 
Performance Task Framework-June 2014-FINAL
Performance Task Framework-June 2014-FINALPerformance Task Framework-June 2014-FINAL
Performance Task Framework-June 2014-FINAL
 
Depth of Knowledge Chart
Depth of Knowledge ChartDepth of Knowledge Chart
Depth of Knowledge Chart
 
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
 
Model #3-Nutrition Culinary-Level III-DEMO-FINAL
Model #3-Nutrition Culinary-Level III-DEMO-FINALModel #3-Nutrition Culinary-Level III-DEMO-FINAL
Model #3-Nutrition Culinary-Level III-DEMO-FINAL
 

Recently uploaded

Biting mechanism of poisonous snakes.pdf
Biting mechanism of poisonous snakes.pdfBiting mechanism of poisonous snakes.pdf
Biting mechanism of poisonous snakes.pdfadityarao40181
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxAvyJaneVismanos
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersSabitha Banu
 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon AUnboundStockton
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaVirag Sontakke
 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxEyham Joco
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfMahmoud M. Sallam
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 

Recently uploaded (20)

Biting mechanism of poisonous snakes.pdf
Biting mechanism of poisonous snakes.pdfBiting mechanism of poisonous snakes.pdf
Biting mechanism of poisonous snakes.pdf
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini  Delhi NCR9953330565 Low Rate Call Girls In Rohini  Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptx
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginners
 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon A
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of India
 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptx
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdf
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 

Template #2 Building the Assessment-22JAN14

  • 1. TEMPLATE #2 STEP 4: DEVELOP ITEMS/TASKS Procedural Steps: Multiple Choice (MC) Items 1. Review the targeted content standard. 2. Determine which aspects of the standard can be measured objectively. 3. Select the focused aspect and determine the cognitive demand reflected in the standard’s description. 4. Create a question (stem), one (1) correct answer, and plausible (realistic) distractors. 5. Review the item and answer options for grammatical soundness. Framework: MC 1. ___<Item Stem>___________________________________________________________. A. __<Answer Option>__ B. __<Answer Option>__ C. __<Answer Option>__ D. __<Answer Option>__ (___<Item Tag>___) QA Checklist: MC  Presents a definite, explicit, and singular question, which is worded positively.  Contains only one (1) correct answer, with each distractor being plausible and/or representing common misconceptions.  Consists of answer options being of similar length, structure, and format.  Places charts, tables, graphs, and/or images within the item.  Uses consistent grammar among the question (stem) and answer options.  Avoids multiple answer options, such as “All of the above.”, “None of the above.”, and “Both A and B.” Template #2-Building the Assessment 1
  • 2.  Arranges answer options in logical order when applicable, such as numeric or chronological order.  Avoids repeating the same words or phrases in each of the answer options. Procedural Steps: Short Answer (SA) Tasks 1. Review the targeted content standard(s). 2. Determine which aspects of the standard(s) can be best measured by having students “construct” a short response. 3. Select and list aspects of the targeted content standard(s) to be measured. 4. Create a prompt, select a passage, or develop a scenario for students. 5. Develop a clear statement that articulates specific criteria for the test-taker to provide. Framework: SA Directions: _______________________________<Task/Passage/Scenario>__________________________ ______________________________________________________________________________ ___<Item Stem>________________________________________________________________ __<Response Area>_____________________________________________________________ (___<Item Tag>___) Technical Note: Short Answer (SA) or Short Constructed Response (SCR) item-types are typically assigned up to three (3) points. QA Checklist: SA  Presents a prompt, scenario, or passage using content-specific terminology, along with developmentally appropriate references.  Ensures the prompt, passage, or scenario is concise, free of jargon, and grammatically correct.  Uses appropriate verbs to communicate expectations.  Articulates response instructions using a clear sentence structure.  Communicates in clear, unambiguous terms the extent of the expected answer. Template #2-Building the Assessment 2
  • 3. Procedural Steps: Extended Answer (EA) Tasks 1. Review the targeted content standard(s). 2. Determine which aspects of the standard(s) can be best measured by having students “construct” an extended response to a given prompt, scenario, or passage. 3. Select and list aspects of the targeted content standard(s) to be measured. 4. Create a prompt, select a passage, or develop a scenario for students. 5. Develop a clear statement for each subordinate task that articulates specific criteria for the test-taker to provide. Framework: EA Directions: _____________________________<Task/Passage/Scenario>____________________________ ______________________________________________________________________________ ______________________________________________________________________________ ___<Item Stem>________________________________________________________________ __<Response Area>_____________________________________________________________ (___<Item Tag>___) QA Checklist: EA  Presents a prompt, scenario, or passage using content-specific terminology, along with developmentally appropriate references.  Aligns the prompt, scenario, passage and test-taker response requirements with the targeted content standard(s) identified in the test blueprint.  Uses appropriate verbs to communicate expectation.  Communicates in clear, unambiguous terms the extent of the expected answer.  Ensures non-content specific behaviors (e.g., attitude, motivational levels, engagement, attendance, etc.) are not articulated in either the response criteria or scoring rubric. Template #2-Building the Assessment 3
  • 4. Procedural Steps: Extended Performance (EP) Tasks 1. Review the targeted content standard(s). 2. Determine which aspects of the standard(s) can be best measured by having students “develop” a complex response, demonstration, or performance over an extend period of time (e.g., two weeks). 3. Select and list all aspects of the targeted content standard(s) to be measured. 4. Create a project, portfolio, or demonstration expectation statement that includes subordinate tasks, which are aligned to the test blueprint. 5. Develop a clear statement for each subordinate task that articulates specific criteria for the test-taker to provide. Framework: EP Tasks _______________________<Project-Portfolio-Demonstration Description>____________________ ______________________________________________________________________________ ___<Task __ of __ >_____________________________________________________________ __<Criteria>___________________________________________________________________ (___<Item Tag>___) QA Checklist: EP Tasks  Presents project, portfolio, or demonstration using content-specific terminology, along with developmentally appropriate references.  Aligns the project, portfolio, or demonstration and test-taker response requirements with the targeted content standards identified in the test blueprint.  Uses appropriate verbs to communicate expectation.  Communicates in clear, unambiguous terms the extent of the expected answer.  Ensures non-content specific behaviors (e.g., attitude, motivational levels, engagement, attendance, etc.) are not articulated in either the response criteria or scoring rubric. Template #2-Building the Assessment 4
  • 5. STEP 5: SCORING KEYS AND RUBRICS SCORING KEYS: MC ITEMS Procedural Steps 1. Enter the assessment information at the top of the Scoring Key. 2. Record the item number, item tag (optional), item type, and point value. 3. Record the MC answers in the Answer column. 4. Repeat steps 1-4 until all items on the test blueprint are reflected within the Scoring Key. 5. Validate that each question-to-answer relationship is recorded correctly. Framework Assessment Name Item # Grade/Course Item Tag Item Type Administration Point Value Total Possible Points Answer 1 2 QA Checklist: MC Items  All items articulated on the test specifications are represented within the Scoring Key.  All items have been validated to ensure only one correct answer exists among the possible answer options.  Answers do not create a discernible pattern.  Answers are “balanced” among the possible options.  Answers are revalidated after the assessment reviews are complete. SCORING RUBRICS Procedural Steps 1. Review the SA, EA, or EP task and the criteria articulated in the stem/directions. 2. Select a “generic” rubric structure (see Template #2: Building the Assessment) based upon (a) scoring criteria and, (b) the number of dimensions being measured. 3. Modify the rubric language using specific criteria expected in the response to award the maximum number of points. 4. Determine how much the response can deviate from “fully correct” in order to earn the next (lower) point value. [Continue until the full range of possible scores is described.] 5. During the review, ensure the response expectation, scoring rubric, and test blueprint are fully aligned. Template #2-Building the Assessment 5
  • 6. Framework Short Answer (SA) – Single Dimension Item # _____ Sample Response for: ______________________________________________ 2 points 1 point 0 points Extended Answer (EA) – Single Dimension Item #_____ Sample Response for: ____________________________________________ 4 points 3 points 2 points 1 point 0 points Extended Performance (EP) Task – Multi-dimensional Item #_____ Sample Response for: ____________________________________________ Dimension Advanced (4 points) Proficient (3 points) Basic (2 points) Below Basic (1 points) QA Checklist: Scoring Rubrics  Scoring rubrics must:  reflect a performance continuum;  be clear and concise; and,  include all dimensions (components) of the task.  Sample expectations are used to provide a guide as to what demonstrates a “fully complete” response.  Avoid including non-cognitive attributes (e.g., motivation, timeliness, etc.). Template #2-Building the Assessment 6
  • 7. STEP 6: CREATE TEST FORMS Procedural Steps: Administration Guidelines 1. Create a series of administrative steps for before, during, and after the assessment window. 2. Explain any requirements or equipment necessary, including accommodations. State any ancillary materials (e.g., calculators) needed or allowed by the test-takers. 3. Identify the approximate time afforded to complete the assessment, including each subtask in an EP task. 4. Include detailed “scripts” articulating exactly what is to be communicated to students, especially when administering performance tasks over a long period of time. 5. Include procedures for scoring, administering make-ups, and handling completed assessments. Framework: Administration Guidelines Preparation STEP 1. STEP 2. STEP 3. ____________________________________________________________ ____________________________________________________________ ____________________________________________________________ Administration STEP 1. STEP 2. STEP 3. ____________________________________________________________ ____________________________________________________________ ____________________________________________________________ After Testing STEP 1. ____________________________________________________________ STEP 2. ____________________________________________________________ STEP 3. ____________________________________________________________ QA Checklist: Administration Guidelines  Guidelines explain administrative steps before, during, and after the assessment window.  Guidelines articulate the step-by-step procedures during each phase of administration.  Requirements for completing the performance measure items/tasks, including accommodations, equipment, and material are included.  Approximate time needed to complete the overall performance measure is provided.  Detailed “scripts” articulate the information to be communicated in a standardized manner. Template #2-Building the Assessment 7
  • 8. Procedural Steps: Test Forms 1. Develop a cover page stating the test form developed and include any necessary demographic information (e.g., section number, student name, date administered, etc.). 2. Organize the items/tasks/prompts in a sequence that will maximize student engagement. 3. Add item tags and section dividers (optional). 4. Refine the draft form to minimize “blank space”, verify picture, graph, table, and figure placement in relationship to the item/task, and ensure MC answer options do not drift from one page to the next. 5. Add scoring rubric or criteria for constructed response tasks. Framework: Test Forms *Note: See content model assessments in the “Guides” folder.  Cover  Administration Guidelines  MC and SA Questions  EA Questions  EP Tasks with Scoring Rubric(s) QA Checklist: Test Forms  Directions state what to do, where and how to respond, and the point value for items/tasks.  Items/tasks/prompts on the test form reflect the blueprint.  Form layout minimizes “white space”, “drift” “crowding of items”, and distance from stem to response options/placement.  Forms are free from unclear, small, or unnecessary images, figures, charts, or graphs. Template #2-Building the Assessment 8