SlideShare a Scribd company logo
TEMPLATE #2
STEP 4: DEVELOP ITEMS/TASKS
Procedural Steps: Multiple Choice (MC) Items
1. Review the targeted content standard.
2. Determine which aspects of the standard can be measured objectively.
3. Select the focused aspect and determine the cognitive demand reflected in the standard’s
description.
4. Create a question (stem), one (1) correct answer, and plausible (realistic) distractors.
5. Review the item and answer options for grammatical soundness.

Framework: MC
1.

___<Item Stem>___________________________________________________________.

A. __<Answer Option>__
B. __<Answer Option>__
C. __<Answer Option>__
D. __<Answer Option>__
(___<Item Tag>___)

QA Checklist: MC
 Presents a definite, explicit, and singular question, which is worded positively.
 Contains only one (1) correct answer, with each distractor being plausible and/or
representing common misconceptions.
 Consists of answer options being of similar length, structure, and format.
 Places charts, tables, graphs, and/or images within the item.
 Uses consistent grammar among the question (stem) and answer options.
 Avoids multiple answer options, such as “All of the above.”, “None of the above.”, and
“Both A and B.”
Template #2-Building the Assessment
1
 Arranges answer options in logical order when applicable, such as numeric or chronological
order.
 Avoids repeating the same words or phrases in each of the answer options.

Procedural Steps: Short Answer (SA) Tasks
1. Review the targeted content standard(s).
2. Determine which aspects of the standard(s) can be best measured by having students
“construct” a short response.
3. Select and list aspects of the targeted content standard(s) to be measured.
4. Create a prompt, select a passage, or develop a scenario for students.
5. Develop a clear statement that articulates specific criteria for the test-taker to provide.

Framework: SA
Directions:

_______________________________<Task/Passage/Scenario>__________________________
______________________________________________________________________________

___<Item Stem>________________________________________________________________
__<Response Area>_____________________________________________________________
(___<Item Tag>___)

Technical Note: Short Answer (SA) or Short Constructed Response (SCR) item-types are
typically assigned up to three (3) points.

QA Checklist: SA
 Presents a prompt, scenario, or passage using content-specific terminology, along with
developmentally appropriate references.
 Ensures the prompt, passage, or scenario is concise, free of jargon, and grammatically
correct.
 Uses appropriate verbs to communicate expectations.
 Articulates response instructions using a clear sentence structure.
 Communicates in clear, unambiguous terms the extent of the expected answer.
Template #2-Building the Assessment
2
Procedural Steps: Extended Answer (EA) Tasks
1. Review the targeted content standard(s).
2. Determine which aspects of the standard(s) can be best measured by having students
“construct” an extended response to a given prompt, scenario, or passage.
3. Select and list aspects of the targeted content standard(s) to be measured.
4. Create a prompt, select a passage, or develop a scenario for students.
5. Develop a clear statement for each subordinate task that articulates specific criteria for the
test-taker to provide.
Framework: EA
Directions:

_____________________________<Task/Passage/Scenario>____________________________
______________________________________________________________________________
______________________________________________________________________________

___<Item Stem>________________________________________________________________
__<Response Area>_____________________________________________________________
(___<Item Tag>___)

QA Checklist: EA
 Presents a prompt, scenario, or passage using content-specific terminology, along with
developmentally appropriate references.
 Aligns the prompt, scenario, passage and test-taker response requirements with the targeted
content standard(s) identified in the test blueprint.
 Uses appropriate verbs to communicate expectation.
 Communicates in clear, unambiguous terms the extent of the expected answer.
 Ensures non-content specific behaviors (e.g., attitude, motivational levels, engagement,
attendance, etc.) are not articulated in either the response criteria or scoring rubric.

Template #2-Building the Assessment
3
Procedural Steps: Extended Performance (EP) Tasks
1. Review the targeted content standard(s).
2. Determine which aspects of the standard(s) can be best measured by having students
“develop” a complex response, demonstration, or performance over an extend period of time
(e.g., two weeks).
3. Select and list all aspects of the targeted content standard(s) to be measured.
4. Create a project, portfolio, or demonstration expectation statement that includes subordinate
tasks, which are aligned to the test blueprint.
5. Develop a clear statement for each subordinate task that articulates specific criteria for the
test-taker to provide.

Framework: EP Tasks
_______________________<Project-Portfolio-Demonstration Description>____________________
______________________________________________________________________________

___<Task __ of __ >_____________________________________________________________
__<Criteria>___________________________________________________________________
(___<Item Tag>___)

QA Checklist: EP Tasks
 Presents project, portfolio, or demonstration using content-specific terminology, along with
developmentally appropriate references.
 Aligns the project, portfolio, or demonstration and test-taker response requirements with the
targeted content standards identified in the test blueprint.
 Uses appropriate verbs to communicate expectation.
 Communicates in clear, unambiguous terms the extent of the expected answer.
 Ensures non-content specific behaviors (e.g., attitude, motivational levels, engagement,
attendance, etc.) are not articulated in either the response criteria or scoring rubric.

Template #2-Building the Assessment
4
STEP 5: SCORING KEYS AND RUBRICS
SCORING KEYS: MC ITEMS
Procedural Steps
1. Enter the assessment information at the top of the Scoring Key.
2. Record the item number, item tag (optional), item type, and point value.
3. Record the MC answers in the Answer column.
4. Repeat steps 1-4 until all items on the test blueprint are reflected within the Scoring Key.
5. Validate that each question-to-answer relationship is recorded correctly.
Framework
Assessment Name

Item #

Grade/Course

Item Tag

Item Type

Administration

Point Value

Total Possible
Points

Answer

1
2

QA Checklist: MC Items
 All items articulated on the test specifications are represented within the Scoring Key.
 All items have been validated to ensure only one correct answer exists among the possible
answer options.
 Answers do not create a discernible pattern.
 Answers are “balanced” among the possible options.
 Answers are revalidated after the assessment reviews are complete.
SCORING RUBRICS
Procedural Steps
1. Review the SA, EA, or EP task and the criteria articulated in the stem/directions.
2. Select a “generic” rubric structure (see Template #2: Building the Assessment) based upon (a)
scoring criteria and, (b) the number of dimensions being measured.
3. Modify the rubric language using specific criteria expected in the response to award the
maximum number of points.
4. Determine how much the response can deviate from “fully correct” in order to earn the next
(lower) point value. [Continue until the full range of possible scores is described.]
5. During the review, ensure the response expectation, scoring rubric, and test blueprint are
fully aligned.
Template #2-Building the Assessment
5
Framework
Short Answer (SA) – Single Dimension
Item # _____ Sample Response for: ______________________________________________
2 points
1 point
0 points

Extended Answer (EA) – Single Dimension
Item #_____ Sample Response for: ____________________________________________
4 points
3 points
2 points
1 point
0 points

Extended Performance (EP) Task – Multi-dimensional
Item #_____ Sample Response for: ____________________________________________
Dimension

Advanced
(4 points)

Proficient
(3 points)

Basic
(2 points)

Below Basic
(1 points)

QA Checklist: Scoring Rubrics
 Scoring rubrics must:
 reflect a performance continuum;
 be clear and concise; and,
 include all dimensions (components) of the task.
 Sample expectations are used to provide a guide as to what demonstrates a “fully complete”
response.
 Avoid including non-cognitive attributes (e.g., motivation, timeliness, etc.).

Template #2-Building the Assessment
6
STEP 6: CREATE TEST FORMS
Procedural Steps: Administration Guidelines
1. Create a series of administrative steps for before, during, and after the assessment window.
2. Explain any requirements or equipment necessary, including accommodations. State any
ancillary materials (e.g., calculators) needed or allowed by the test-takers.
3. Identify the approximate time afforded to complete the assessment, including each subtask in
an EP task.
4. Include detailed “scripts” articulating exactly what is to be communicated to students,
especially when administering performance tasks over a long period of time.
5. Include procedures for scoring, administering make-ups, and handling completed
assessments.
Framework: Administration Guidelines
Preparation
STEP 1.
STEP 2.
STEP 3.

____________________________________________________________
____________________________________________________________
____________________________________________________________

Administration
STEP 1.
STEP 2.
STEP 3.

____________________________________________________________
____________________________________________________________
____________________________________________________________

After Testing
STEP 1.
____________________________________________________________
STEP 2.
____________________________________________________________
STEP 3.
____________________________________________________________
QA Checklist: Administration Guidelines
 Guidelines explain administrative steps before, during, and after the assessment window.
 Guidelines articulate the step-by-step procedures during each phase of administration.
 Requirements for completing the performance measure items/tasks, including
accommodations, equipment, and material are included.
 Approximate time needed to complete the overall performance measure is provided.
 Detailed “scripts” articulate the information to be communicated in a standardized manner.

Template #2-Building the Assessment
7
Procedural Steps: Test Forms
1. Develop a cover page stating the test form developed and include any necessary demographic
information (e.g., section number, student name, date administered, etc.).
2. Organize the items/tasks/prompts in a sequence that will maximize student engagement.
3. Add item tags and section dividers (optional).
4. Refine the draft form to minimize “blank space”, verify picture, graph, table, and figure
placement in relationship to the item/task, and ensure MC answer options do not drift from
one page to the next.
5. Add scoring rubric or criteria for constructed response tasks.

Framework: Test Forms
*Note: See content model assessments in the “Guides” folder.


Cover



Administration Guidelines



MC and SA Questions



EA Questions



EP Tasks with Scoring Rubric(s)

QA Checklist: Test Forms
 Directions state what to do, where and how to respond, and the point value for items/tasks.
 Items/tasks/prompts on the test form reflect the blueprint.
 Form layout minimizes “white space”, “drift” “crowding of items”, and distance from stem
to response options/placement.
 Forms are free from unclear, small, or unnecessary images, figures, charts, or graphs.

Template #2-Building the Assessment
8

More Related Content

Similar to Template #2 Building the Assessment-22JAN14

Template #1-Designing the Assessment-June 2014-FINAL
Template #1-Designing the Assessment-June 2014-FINALTemplate #1-Designing the Assessment-June 2014-FINAL
Template #1-Designing the Assessment-June 2014-FINALResearch in Action, Inc.
 
Template #1 Designing the Assessment-22JAN14
Template #1 Designing the Assessment-22JAN14Template #1 Designing the Assessment-22JAN14
Template #1 Designing the Assessment-22JAN14Research in Action, Inc.
 
Developing Assessment Instruments
Developing Assessment InstrumentsDeveloping Assessment Instruments
Developing Assessment InstrumentsAngel Jones
 
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINALHO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINALResearch in Action, Inc.
 
Template #6-Performance Measure Rubric-May 2014-Final
Template #6-Performance Measure Rubric-May 2014-FinalTemplate #6-Performance Measure Rubric-May 2014-Final
Template #6-Performance Measure Rubric-May 2014-FinalResearch in Action, Inc.
 
TABLE OF SPECIFICATION
TABLE OF SPECIFICATIONTABLE OF SPECIFICATION
TABLE OF SPECIFICATIONfloriejean
 
Template #3a performance measure rubric-final-la
Template #3a performance measure rubric-final-laTemplate #3a performance measure rubric-final-la
Template #3a performance measure rubric-final-laResearch in Action, Inc.
 
Template #3-Performance Measure Rubric-June 2014-FINAL
Template #3-Performance Measure Rubric-June 2014-FINALTemplate #3-Performance Measure Rubric-June 2014-FINAL
Template #3-Performance Measure Rubric-June 2014-FINALResearch in Action, Inc.
 
HO #3-Reviewing the Assessment-Scored Example-22JAN14
HO #3-Reviewing the Assessment-Scored Example-22JAN14HO #3-Reviewing the Assessment-Scored Example-22JAN14
HO #3-Reviewing the Assessment-Scored Example-22JAN14Research in Action, Inc.
 
M1-Designing the Assessment-June 2014-FINAL
M1-Designing the Assessment-June 2014-FINALM1-Designing the Assessment-June 2014-FINAL
M1-Designing the Assessment-June 2014-FINALResearch in Action, Inc.
 
STEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLSSTEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLSLoradelLegaspi
 
Apt 501 chapter_7
Apt 501 chapter_7Apt 501 chapter_7
Apt 501 chapter_7cdjhaigler
 
Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7cdjhaigler
 
Developing Assessment Instrument
Developing Assessment InstrumentDeveloping Assessment Instrument
Developing Assessment Instrumentcdjhaigler
 
Assessment_Basics[1]
Assessment_Basics[1]Assessment_Basics[1]
Assessment_Basics[1]'Gbenga Aina
 

Similar to Template #2 Building the Assessment-22JAN14 (20)

Template #1-Designing the Assessment-June 2014-FINAL
Template #1-Designing the Assessment-June 2014-FINALTemplate #1-Designing the Assessment-June 2014-FINAL
Template #1-Designing the Assessment-June 2014-FINAL
 
Template #1 Designing the Assessment-22JAN14
Template #1 Designing the Assessment-22JAN14Template #1 Designing the Assessment-22JAN14
Template #1 Designing the Assessment-22JAN14
 
Template #1 designing the slo-sso-final
Template #1 designing the slo-sso-finalTemplate #1 designing the slo-sso-final
Template #1 designing the slo-sso-final
 
Developing Assessment Instruments
Developing Assessment InstrumentsDeveloping Assessment Instruments
Developing Assessment Instruments
 
Chapter 10 apt 501
Chapter 10 apt 501Chapter 10 apt 501
Chapter 10 apt 501
 
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINALHO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
HO #3-Reviewing the Assessment-Scored Example-June 2014-FINAL
 
Template #6-Performance Measure Rubric-May 2014-Final
Template #6-Performance Measure Rubric-May 2014-FinalTemplate #6-Performance Measure Rubric-May 2014-Final
Template #6-Performance Measure Rubric-May 2014-Final
 
QS M1-Designing the Assessment-22JAN14
QS M1-Designing the Assessment-22JAN14QS M1-Designing the Assessment-22JAN14
QS M1-Designing the Assessment-22JAN14
 
TABLE OF SPECIFICATION
TABLE OF SPECIFICATIONTABLE OF SPECIFICATION
TABLE OF SPECIFICATION
 
Template #3a performance measure rubric-final-la
Template #3a performance measure rubric-final-laTemplate #3a performance measure rubric-final-la
Template #3a performance measure rubric-final-la
 
QS M2-Building the Assessment-11FEB14
QS M2-Building the Assessment-11FEB14QS M2-Building the Assessment-11FEB14
QS M2-Building the Assessment-11FEB14
 
Template #3-Performance Measure Rubric-June 2014-FINAL
Template #3-Performance Measure Rubric-June 2014-FINALTemplate #3-Performance Measure Rubric-June 2014-FINAL
Template #3-Performance Measure Rubric-June 2014-FINAL
 
HO #3-Reviewing the Assessment-Scored Example-22JAN14
HO #3-Reviewing the Assessment-Scored Example-22JAN14HO #3-Reviewing the Assessment-Scored Example-22JAN14
HO #3-Reviewing the Assessment-Scored Example-22JAN14
 
M1-Designing the Assessment-June 2014-FINAL
M1-Designing the Assessment-June 2014-FINALM1-Designing the Assessment-June 2014-FINAL
M1-Designing the Assessment-June 2014-FINAL
 
STEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLSSTEP IN DEVELOPMENT ASSESSMENT TOOLS
STEP IN DEVELOPMENT ASSESSMENT TOOLS
 
Apt 501 chapter_7
Apt 501 chapter_7Apt 501 chapter_7
Apt 501 chapter_7
 
Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7
 
Developing Assessment Instrument
Developing Assessment InstrumentDeveloping Assessment Instrument
Developing Assessment Instrument
 
Achievment Test.pptx
Achievment Test.pptxAchievment Test.pptx
Achievment Test.pptx
 
Assessment_Basics[1]
Assessment_Basics[1]Assessment_Basics[1]
Assessment_Basics[1]
 

More from Research in Action, Inc.

Quick Start Users Guide-June 2014-Working Draft
Quick Start Users Guide-June 2014-Working DraftQuick Start Users Guide-June 2014-Working Draft
Quick Start Users Guide-June 2014-Working DraftResearch in Action, Inc.
 
Performance Task Framework-June 2014-FINAL
Performance Task Framework-June 2014-FINALPerformance Task Framework-June 2014-FINAL
Performance Task Framework-June 2014-FINALResearch in Action, Inc.
 
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)Research in Action, Inc.
 
Model #3-Nutrition Culinary-Level III-DEMO-FINAL
Model #3-Nutrition Culinary-Level III-DEMO-FINALModel #3-Nutrition Culinary-Level III-DEMO-FINAL
Model #3-Nutrition Culinary-Level III-DEMO-FINALResearch in Action, Inc.
 

More from Research in Action, Inc. (20)

SLO for teachers
SLO for teachersSLO for teachers
SLO for teachers
 
M3-Reviewing the SLO-SSO-DemoSite
M3-Reviewing the SLO-SSO-DemoSiteM3-Reviewing the SLO-SSO-DemoSite
M3-Reviewing the SLO-SSO-DemoSite
 
M2-Building the SLO-SSO-DemoSite
M2-Building the SLO-SSO-DemoSiteM2-Building the SLO-SSO-DemoSite
M2-Building the SLO-SSO-DemoSite
 
M1 Designing the SLO-SSO-Demo Site
M1 Designing the SLO-SSO-Demo SiteM1 Designing the SLO-SSO-Demo Site
M1 Designing the SLO-SSO-Demo Site
 
M0 School Leader Orientation-Demo Site
M0 School Leader Orientation-Demo SiteM0 School Leader Orientation-Demo Site
M0 School Leader Orientation-Demo Site
 
M0 Orientation to the SLO-SSO-DemoSite
M0 Orientation to the SLO-SSO-DemoSiteM0 Orientation to the SLO-SSO-DemoSite
M0 Orientation to the SLO-SSO-DemoSite
 
Template #3 coherency rubric-final-jp
Template #3 coherency rubric-final-jpTemplate #3 coherency rubric-final-jp
Template #3 coherency rubric-final-jp
 
Template #2c building the sso-final
Template #2c building the sso-finalTemplate #2c building the sso-final
Template #2c building the sso-final
 
Template #2a building the slo-final
Template #2a building the slo-finalTemplate #2a building the slo-final
Template #2a building the slo-final
 
M3 reviewing the slo-sso-final
M3 reviewing the slo-sso-finalM3 reviewing the slo-sso-final
M3 reviewing the slo-sso-final
 
M2 building the slo-sso-final
M2 building the slo-sso-finalM2 building the slo-sso-final
M2 building the slo-sso-final
 
M1 designing the slo-sso-final
M1 designing the slo-sso-finalM1 designing the slo-sso-final
M1 designing the slo-sso-final
 
M0 school leader orientation-final
M0 school leader orientation-finalM0 school leader orientation-final
M0 school leader orientation-final
 
M0 orientation to the slo-sso-final
M0 orientation to the slo-sso-finalM0 orientation to the slo-sso-final
M0 orientation to the slo-sso-final
 
Educator evaluation policy overview-final
Educator evaluation policy overview-finalEducator evaluation policy overview-final
Educator evaluation policy overview-final
 
Quick Start Users Guide-June 2014-Working Draft
Quick Start Users Guide-June 2014-Working DraftQuick Start Users Guide-June 2014-Working Draft
Quick Start Users Guide-June 2014-Working Draft
 
Performance Task Framework-June 2014-FINAL
Performance Task Framework-June 2014-FINALPerformance Task Framework-June 2014-FINAL
Performance Task Framework-June 2014-FINAL
 
Depth of Knowledge Chart
Depth of Knowledge ChartDepth of Knowledge Chart
Depth of Knowledge Chart
 
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
Assessment Selection Paper-Herman_Heritage_Goldschmidt (2011)
 
Model #3-Nutrition Culinary-Level III-DEMO-FINAL
Model #3-Nutrition Culinary-Level III-DEMO-FINALModel #3-Nutrition Culinary-Level III-DEMO-FINAL
Model #3-Nutrition Culinary-Level III-DEMO-FINAL
 

Recently uploaded

How to the fix Attribute Error in odoo 17
How to the fix Attribute Error in odoo 17How to the fix Attribute Error in odoo 17
How to the fix Attribute Error in odoo 17Celine George
 
2024_Student Session 2_ Set Plan Preparation.pptx
2024_Student Session 2_ Set Plan Preparation.pptx2024_Student Session 2_ Set Plan Preparation.pptx
2024_Student Session 2_ Set Plan Preparation.pptxmansk2
 
Telling Your Story_ Simple Steps to Build Your Nonprofit's Brand Webinar.pdf
Telling Your Story_ Simple Steps to Build Your Nonprofit's Brand Webinar.pdfTelling Your Story_ Simple Steps to Build Your Nonprofit's Brand Webinar.pdf
Telling Your Story_ Simple Steps to Build Your Nonprofit's Brand Webinar.pdfTechSoup
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXMIRIAMSALINAS13
 
Matatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptxMatatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptxJenilouCasareno
 
UNIT – IV_PCI Complaints: Complaints and evaluation of complaints, Handling o...
UNIT – IV_PCI Complaints: Complaints and evaluation of complaints, Handling o...UNIT – IV_PCI Complaints: Complaints and evaluation of complaints, Handling o...
UNIT – IV_PCI Complaints: Complaints and evaluation of complaints, Handling o...Sayali Powar
 
Open Educational Resources Primer PowerPoint
Open Educational Resources Primer PowerPointOpen Educational Resources Primer PowerPoint
Open Educational Resources Primer PowerPointELaRue0
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleCeline George
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonSteve Thomason
 
The Benefits and Challenges of Open Educational Resources
The Benefits and Challenges of Open Educational ResourcesThe Benefits and Challenges of Open Educational Resources
The Benefits and Challenges of Open Educational Resourcesaileywriter
 
Application of Matrices in real life. Presentation on application of matrices
Application of Matrices in real life. Presentation on application of matricesApplication of Matrices in real life. Presentation on application of matrices
Application of Matrices in real life. Presentation on application of matricesRased Khan
 
[GDSC YCCE] Build with AI Online Presentation
[GDSC YCCE] Build with AI Online Presentation[GDSC YCCE] Build with AI Online Presentation
[GDSC YCCE] Build with AI Online PresentationGDSCYCCE
 
slides CapTechTalks Webinar May 2024 Alexander Perry.pptx
slides CapTechTalks Webinar May 2024 Alexander Perry.pptxslides CapTechTalks Webinar May 2024 Alexander Perry.pptx
slides CapTechTalks Webinar May 2024 Alexander Perry.pptxCapitolTechU
 
Gyanartha SciBizTech Quiz slideshare.pptx
Gyanartha SciBizTech Quiz slideshare.pptxGyanartha SciBizTech Quiz slideshare.pptx
Gyanartha SciBizTech Quiz slideshare.pptxShibin Azad
 
The impact of social media on mental health and well-being has been a topic o...
The impact of social media on mental health and well-being has been a topic o...The impact of social media on mental health and well-being has been a topic o...
The impact of social media on mental health and well-being has been a topic o...sanghavirahi2
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345beazzy04
 
PART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePedroFerreira53928
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfjoachimlavalley1
 
Pragya Champions Chalice 2024 Prelims & Finals Q/A set, General Quiz
Pragya Champions Chalice 2024 Prelims & Finals Q/A set, General QuizPragya Champions Chalice 2024 Prelims & Finals Q/A set, General Quiz
Pragya Champions Chalice 2024 Prelims & Finals Q/A set, General QuizPragya - UEM Kolkata Quiz Club
 
The Last Leaf, a short story by O. Henry
The Last Leaf, a short story by O. HenryThe Last Leaf, a short story by O. Henry
The Last Leaf, a short story by O. HenryEugene Lysak
 

Recently uploaded (20)

How to the fix Attribute Error in odoo 17
How to the fix Attribute Error in odoo 17How to the fix Attribute Error in odoo 17
How to the fix Attribute Error in odoo 17
 
2024_Student Session 2_ Set Plan Preparation.pptx
2024_Student Session 2_ Set Plan Preparation.pptx2024_Student Session 2_ Set Plan Preparation.pptx
2024_Student Session 2_ Set Plan Preparation.pptx
 
Telling Your Story_ Simple Steps to Build Your Nonprofit's Brand Webinar.pdf
Telling Your Story_ Simple Steps to Build Your Nonprofit's Brand Webinar.pdfTelling Your Story_ Simple Steps to Build Your Nonprofit's Brand Webinar.pdf
Telling Your Story_ Simple Steps to Build Your Nonprofit's Brand Webinar.pdf
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
Matatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptxMatatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptx
 
UNIT – IV_PCI Complaints: Complaints and evaluation of complaints, Handling o...
UNIT – IV_PCI Complaints: Complaints and evaluation of complaints, Handling o...UNIT – IV_PCI Complaints: Complaints and evaluation of complaints, Handling o...
UNIT – IV_PCI Complaints: Complaints and evaluation of complaints, Handling o...
 
Open Educational Resources Primer PowerPoint
Open Educational Resources Primer PowerPointOpen Educational Resources Primer PowerPoint
Open Educational Resources Primer PowerPoint
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
 
The Benefits and Challenges of Open Educational Resources
The Benefits and Challenges of Open Educational ResourcesThe Benefits and Challenges of Open Educational Resources
The Benefits and Challenges of Open Educational Resources
 
Application of Matrices in real life. Presentation on application of matrices
Application of Matrices in real life. Presentation on application of matricesApplication of Matrices in real life. Presentation on application of matrices
Application of Matrices in real life. Presentation on application of matrices
 
[GDSC YCCE] Build with AI Online Presentation
[GDSC YCCE] Build with AI Online Presentation[GDSC YCCE] Build with AI Online Presentation
[GDSC YCCE] Build with AI Online Presentation
 
slides CapTechTalks Webinar May 2024 Alexander Perry.pptx
slides CapTechTalks Webinar May 2024 Alexander Perry.pptxslides CapTechTalks Webinar May 2024 Alexander Perry.pptx
slides CapTechTalks Webinar May 2024 Alexander Perry.pptx
 
Gyanartha SciBizTech Quiz slideshare.pptx
Gyanartha SciBizTech Quiz slideshare.pptxGyanartha SciBizTech Quiz slideshare.pptx
Gyanartha SciBizTech Quiz slideshare.pptx
 
The impact of social media on mental health and well-being has been a topic o...
The impact of social media on mental health and well-being has been a topic o...The impact of social media on mental health and well-being has been a topic o...
The impact of social media on mental health and well-being has been a topic o...
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
PART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePART A. Introduction to Costumer Service
PART A. Introduction to Costumer Service
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
Pragya Champions Chalice 2024 Prelims & Finals Q/A set, General Quiz
Pragya Champions Chalice 2024 Prelims & Finals Q/A set, General QuizPragya Champions Chalice 2024 Prelims & Finals Q/A set, General Quiz
Pragya Champions Chalice 2024 Prelims & Finals Q/A set, General Quiz
 
The Last Leaf, a short story by O. Henry
The Last Leaf, a short story by O. HenryThe Last Leaf, a short story by O. Henry
The Last Leaf, a short story by O. Henry
 

Template #2 Building the Assessment-22JAN14

  • 1. TEMPLATE #2 STEP 4: DEVELOP ITEMS/TASKS Procedural Steps: Multiple Choice (MC) Items 1. Review the targeted content standard. 2. Determine which aspects of the standard can be measured objectively. 3. Select the focused aspect and determine the cognitive demand reflected in the standard’s description. 4. Create a question (stem), one (1) correct answer, and plausible (realistic) distractors. 5. Review the item and answer options for grammatical soundness. Framework: MC 1. ___<Item Stem>___________________________________________________________. A. __<Answer Option>__ B. __<Answer Option>__ C. __<Answer Option>__ D. __<Answer Option>__ (___<Item Tag>___) QA Checklist: MC  Presents a definite, explicit, and singular question, which is worded positively.  Contains only one (1) correct answer, with each distractor being plausible and/or representing common misconceptions.  Consists of answer options being of similar length, structure, and format.  Places charts, tables, graphs, and/or images within the item.  Uses consistent grammar among the question (stem) and answer options.  Avoids multiple answer options, such as “All of the above.”, “None of the above.”, and “Both A and B.” Template #2-Building the Assessment 1
  • 2.  Arranges answer options in logical order when applicable, such as numeric or chronological order.  Avoids repeating the same words or phrases in each of the answer options. Procedural Steps: Short Answer (SA) Tasks 1. Review the targeted content standard(s). 2. Determine which aspects of the standard(s) can be best measured by having students “construct” a short response. 3. Select and list aspects of the targeted content standard(s) to be measured. 4. Create a prompt, select a passage, or develop a scenario for students. 5. Develop a clear statement that articulates specific criteria for the test-taker to provide. Framework: SA Directions: _______________________________<Task/Passage/Scenario>__________________________ ______________________________________________________________________________ ___<Item Stem>________________________________________________________________ __<Response Area>_____________________________________________________________ (___<Item Tag>___) Technical Note: Short Answer (SA) or Short Constructed Response (SCR) item-types are typically assigned up to three (3) points. QA Checklist: SA  Presents a prompt, scenario, or passage using content-specific terminology, along with developmentally appropriate references.  Ensures the prompt, passage, or scenario is concise, free of jargon, and grammatically correct.  Uses appropriate verbs to communicate expectations.  Articulates response instructions using a clear sentence structure.  Communicates in clear, unambiguous terms the extent of the expected answer. Template #2-Building the Assessment 2
  • 3. Procedural Steps: Extended Answer (EA) Tasks 1. Review the targeted content standard(s). 2. Determine which aspects of the standard(s) can be best measured by having students “construct” an extended response to a given prompt, scenario, or passage. 3. Select and list aspects of the targeted content standard(s) to be measured. 4. Create a prompt, select a passage, or develop a scenario for students. 5. Develop a clear statement for each subordinate task that articulates specific criteria for the test-taker to provide. Framework: EA Directions: _____________________________<Task/Passage/Scenario>____________________________ ______________________________________________________________________________ ______________________________________________________________________________ ___<Item Stem>________________________________________________________________ __<Response Area>_____________________________________________________________ (___<Item Tag>___) QA Checklist: EA  Presents a prompt, scenario, or passage using content-specific terminology, along with developmentally appropriate references.  Aligns the prompt, scenario, passage and test-taker response requirements with the targeted content standard(s) identified in the test blueprint.  Uses appropriate verbs to communicate expectation.  Communicates in clear, unambiguous terms the extent of the expected answer.  Ensures non-content specific behaviors (e.g., attitude, motivational levels, engagement, attendance, etc.) are not articulated in either the response criteria or scoring rubric. Template #2-Building the Assessment 3
  • 4. Procedural Steps: Extended Performance (EP) Tasks 1. Review the targeted content standard(s). 2. Determine which aspects of the standard(s) can be best measured by having students “develop” a complex response, demonstration, or performance over an extend period of time (e.g., two weeks). 3. Select and list all aspects of the targeted content standard(s) to be measured. 4. Create a project, portfolio, or demonstration expectation statement that includes subordinate tasks, which are aligned to the test blueprint. 5. Develop a clear statement for each subordinate task that articulates specific criteria for the test-taker to provide. Framework: EP Tasks _______________________<Project-Portfolio-Demonstration Description>____________________ ______________________________________________________________________________ ___<Task __ of __ >_____________________________________________________________ __<Criteria>___________________________________________________________________ (___<Item Tag>___) QA Checklist: EP Tasks  Presents project, portfolio, or demonstration using content-specific terminology, along with developmentally appropriate references.  Aligns the project, portfolio, or demonstration and test-taker response requirements with the targeted content standards identified in the test blueprint.  Uses appropriate verbs to communicate expectation.  Communicates in clear, unambiguous terms the extent of the expected answer.  Ensures non-content specific behaviors (e.g., attitude, motivational levels, engagement, attendance, etc.) are not articulated in either the response criteria or scoring rubric. Template #2-Building the Assessment 4
  • 5. STEP 5: SCORING KEYS AND RUBRICS SCORING KEYS: MC ITEMS Procedural Steps 1. Enter the assessment information at the top of the Scoring Key. 2. Record the item number, item tag (optional), item type, and point value. 3. Record the MC answers in the Answer column. 4. Repeat steps 1-4 until all items on the test blueprint are reflected within the Scoring Key. 5. Validate that each question-to-answer relationship is recorded correctly. Framework Assessment Name Item # Grade/Course Item Tag Item Type Administration Point Value Total Possible Points Answer 1 2 QA Checklist: MC Items  All items articulated on the test specifications are represented within the Scoring Key.  All items have been validated to ensure only one correct answer exists among the possible answer options.  Answers do not create a discernible pattern.  Answers are “balanced” among the possible options.  Answers are revalidated after the assessment reviews are complete. SCORING RUBRICS Procedural Steps 1. Review the SA, EA, or EP task and the criteria articulated in the stem/directions. 2. Select a “generic” rubric structure (see Template #2: Building the Assessment) based upon (a) scoring criteria and, (b) the number of dimensions being measured. 3. Modify the rubric language using specific criteria expected in the response to award the maximum number of points. 4. Determine how much the response can deviate from “fully correct” in order to earn the next (lower) point value. [Continue until the full range of possible scores is described.] 5. During the review, ensure the response expectation, scoring rubric, and test blueprint are fully aligned. Template #2-Building the Assessment 5
  • 6. Framework Short Answer (SA) – Single Dimension Item # _____ Sample Response for: ______________________________________________ 2 points 1 point 0 points Extended Answer (EA) – Single Dimension Item #_____ Sample Response for: ____________________________________________ 4 points 3 points 2 points 1 point 0 points Extended Performance (EP) Task – Multi-dimensional Item #_____ Sample Response for: ____________________________________________ Dimension Advanced (4 points) Proficient (3 points) Basic (2 points) Below Basic (1 points) QA Checklist: Scoring Rubrics  Scoring rubrics must:  reflect a performance continuum;  be clear and concise; and,  include all dimensions (components) of the task.  Sample expectations are used to provide a guide as to what demonstrates a “fully complete” response.  Avoid including non-cognitive attributes (e.g., motivation, timeliness, etc.). Template #2-Building the Assessment 6
  • 7. STEP 6: CREATE TEST FORMS Procedural Steps: Administration Guidelines 1. Create a series of administrative steps for before, during, and after the assessment window. 2. Explain any requirements or equipment necessary, including accommodations. State any ancillary materials (e.g., calculators) needed or allowed by the test-takers. 3. Identify the approximate time afforded to complete the assessment, including each subtask in an EP task. 4. Include detailed “scripts” articulating exactly what is to be communicated to students, especially when administering performance tasks over a long period of time. 5. Include procedures for scoring, administering make-ups, and handling completed assessments. Framework: Administration Guidelines Preparation STEP 1. STEP 2. STEP 3. ____________________________________________________________ ____________________________________________________________ ____________________________________________________________ Administration STEP 1. STEP 2. STEP 3. ____________________________________________________________ ____________________________________________________________ ____________________________________________________________ After Testing STEP 1. ____________________________________________________________ STEP 2. ____________________________________________________________ STEP 3. ____________________________________________________________ QA Checklist: Administration Guidelines  Guidelines explain administrative steps before, during, and after the assessment window.  Guidelines articulate the step-by-step procedures during each phase of administration.  Requirements for completing the performance measure items/tasks, including accommodations, equipment, and material are included.  Approximate time needed to complete the overall performance measure is provided.  Detailed “scripts” articulate the information to be communicated in a standardized manner. Template #2-Building the Assessment 7
  • 8. Procedural Steps: Test Forms 1. Develop a cover page stating the test form developed and include any necessary demographic information (e.g., section number, student name, date administered, etc.). 2. Organize the items/tasks/prompts in a sequence that will maximize student engagement. 3. Add item tags and section dividers (optional). 4. Refine the draft form to minimize “blank space”, verify picture, graph, table, and figure placement in relationship to the item/task, and ensure MC answer options do not drift from one page to the next. 5. Add scoring rubric or criteria for constructed response tasks. Framework: Test Forms *Note: See content model assessments in the “Guides” folder.  Cover  Administration Guidelines  MC and SA Questions  EA Questions  EP Tasks with Scoring Rubric(s) QA Checklist: Test Forms  Directions state what to do, where and how to respond, and the point value for items/tasks.  Items/tasks/prompts on the test form reflect the blueprint.  Form layout minimizes “white space”, “drift” “crowding of items”, and distance from stem to response options/placement.  Forms are free from unclear, small, or unnecessary images, figures, charts, or graphs. Template #2-Building the Assessment 8