SlideShare a Scribd company logo
1 of 8
Preparing
student
Test Assembly
Test
administration
Analysis of
student
responses
Reporting
TEST ADMINISTRATION
AND REPORTING
 Assess maximum, not typical, performance of the student
 Give students enough information about the assessment:
 Time
 Pop quizzes do not assess maximum performance
 Test condition (timed, speeded, take-home)
 Test content
 Emphasis of the test
 Scoring
 Test use
PREPARING STUDENTS
Poor test administration conditions have the potential to interfere with
students demonstrating their full potential and puts at risk the
accuracy and usefulness of the data (ODE, 2014 ).
 Purpose of the assessment being assembled
 Range of content/Learning Progression to be covered
 Distribution of test items
Type the test and distribute it fairly
 Organization of test items
Place easier items first  minimize test-anxiety and
improve validity
Give clear directions to answer each item
Provide a balance of item types, content coverage,
difficulty levels
 Make sure adequate time is allowed
TEST ASSEMBLY
 Time of day
 Time allotted
 Proximity to teaching of targeted content
 Other issues
TEST ADMINISTRATION CONSIDERATIONS
 Score student responses
 Group students  upper-, middle-, and lower-scoring group
 Did the group of students have particular difficulties? What might
be done about this?
 Compute item difficulty (percent of students passing item, or
average score)
 Analyze responses for the least and most difficult items, as
well as items where most students could do
 Distribution of scores per item
 Does the item function differently for different groups of
students?
ANALYSIS OF STUDENT RESPONSES
 Reports should provide information about student
achievement relative to the learning target (ODE,
2014).
REPORTING
 Nitko, A. J., & Brookhart, S. (2007). Educational assessment of
students. Upper Saddle River, NJ: Pearson Education, Inc.
 McMillan, J. H. (2007). Classroom assessment. Principles and
practice for effective standard-based instruction (4th ed.). Boston:
Pearson - Allyn & Bacon.
 Oregon Department of Education. (2014, June). Assessment
guidance.
 Wilson, M. (2005). Constructing measures: An item response
modeling approach. New York: Psychology Press, Taylor & Francis
Group.
 Wilson, M., & Sloane, K. (2000). From principles to practice: An
embedded assessment system. Applied Measurement in
Education, 13 (2), pp. 181-208.
 Smarter Balanced Assessment Consortium. (2012, April). General
item specifications.
BIBLIOGRAPHY
Introduction to Test Administration and Reporting PPT by the Oregon Department of
Education and Berkeley Evaluation and Assessment Research Center is licensed under
a CC BY 4.0.
Y ou a re f ree t o:
 S hare — copy and redistribute the material in any medium or format
 Adapt — remix, transform, and build upon the material
U nder t he fo llowing t erms:
 Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes
were made. You may do so in any reasonable manner, but not in any way that suggests the licensor
endorses you or your use.
 N onCommercial — You may not use the material for commercial purposes .
 S hareAlike — If you remix, transform, or build upon the material, you must distribute your
contributions under the same license as the original.
Oregon Department of Education welcomes editing of these resources and would
greatly appreciate being able to learn from the changes made. To share an edited
version of this resource, please contact Cristen McLean, cristen.mclean@state.or.us.
CREATIVE COMMONS LICENSE

More Related Content

Similar to test_administration_reporting.pptx

Assessment - Product
Assessment - ProductAssessment - Product
Assessment - Product
stomaskovic
 
Assessment: Grading & Student Evaluation
Assessment: Grading & Student EvaluationAssessment: Grading & Student Evaluation
Assessment: Grading & Student Evaluation
Eddy White, Ph.D.
 
kto12classroomassessmentppt-150405021132-conversion-gate01 (1).pdf
kto12classroomassessmentppt-150405021132-conversion-gate01 (1).pdfkto12classroomassessmentppt-150405021132-conversion-gate01 (1).pdf
kto12classroomassessmentppt-150405021132-conversion-gate01 (1).pdf
RosellMaySilvestre3
 

Similar to test_administration_reporting.pptx (20)

Intro to rubrics
Intro to rubricsIntro to rubrics
Intro to rubrics
 
Assessment - Product
Assessment - ProductAssessment - Product
Assessment - Product
 
researchED Washington Presentation
researchED Washington PresentationresearchED Washington Presentation
researchED Washington Presentation
 
Chapter 11
Chapter 11Chapter 11
Chapter 11
 
Assessment: Grading & Student Evaluation
Assessment: Grading & Student EvaluationAssessment: Grading & Student Evaluation
Assessment: Grading & Student Evaluation
 
PRESENTATION
PRESENTATIONPRESENTATION
PRESENTATION
 
Retiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative AssessmentsRetiring Exam Questions? How to Use These Items in Formative Assessments
Retiring Exam Questions? How to Use These Items in Formative Assessments
 
CCE Presentation
CCE  Presentation CCE  Presentation
CCE Presentation
 
CCE Presentation
CCE  Presentation CCE  Presentation
CCE Presentation
 
Purpose Of Assessment For Learning
Purpose Of Assessment For LearningPurpose Of Assessment For Learning
Purpose Of Assessment For Learning
 
kto12classroomassessmentppt-150405021132-conversion-gate01 (1).pdf
kto12classroomassessmentppt-150405021132-conversion-gate01 (1).pdfkto12classroomassessmentppt-150405021132-conversion-gate01 (1).pdf
kto12classroomassessmentppt-150405021132-conversion-gate01 (1).pdf
 
CCE presentation
CCE presentationCCE presentation
CCE presentation
 
Principles as discourse: A Blueprint for transformational change in assessment
Principles as discourse: A Blueprint for transformational change in assessmentPrinciples as discourse: A Blueprint for transformational change in assessment
Principles as discourse: A Blueprint for transformational change in assessment
 
EDUCARNIVAL 2016 at IIT DELHI - Presentation by Madhav Rao
EDUCARNIVAL 2016 at IIT DELHI - Presentation by Madhav RaoEDUCARNIVAL 2016 at IIT DELHI - Presentation by Madhav Rao
EDUCARNIVAL 2016 at IIT DELHI - Presentation by Madhav Rao
 
Ktt
KttKtt
Ktt
 
Lesson 12 EdTech
Lesson 12 EdTechLesson 12 EdTech
Lesson 12 EdTech
 
Learning theories
Learning theoriesLearning theories
Learning theories
 
EL7003-8 Assignment 1: Instructional Design and Engaging E-Learning Activities
EL7003-8 Assignment 1: Instructional Design and Engaging E-Learning ActivitiesEL7003-8 Assignment 1: Instructional Design and Engaging E-Learning Activities
EL7003-8 Assignment 1: Instructional Design and Engaging E-Learning Activities
 
Professional Education reviewer for PRC-LET or BLEPT Examination
Professional Education reviewer for PRC-LET or BLEPT ExaminationProfessional Education reviewer for PRC-LET or BLEPT Examination
Professional Education reviewer for PRC-LET or BLEPT Examination
 
Ckass 2 determining a research question
Ckass 2   determining a research questionCkass 2   determining a research question
Ckass 2 determining a research question
 

More from shanmuga institute of medica sciences (7)

EVALUATION OF EDUCATION PROGRAMME IN NURSING COURSE AND.pdf
EVALUATION OF EDUCATION PROGRAMME IN NURSING COURSE AND.pdfEVALUATION OF EDUCATION PROGRAMME IN NURSING COURSE AND.pdf
EVALUATION OF EDUCATION PROGRAMME IN NURSING COURSE AND.pdf
 
betty-neuman-s-theory.ppt
betty-neuman-s-theory.pptbetty-neuman-s-theory.ppt
betty-neuman-s-theory.ppt
 
standardized-tools.ppt
standardized-tools.pptstandardized-tools.ppt
standardized-tools.ppt
 
standardized-tools.pptx
standardized-tools.pptxstandardized-tools.pptx
standardized-tools.pptx
 
5055037.ppt
5055037.ppt5055037.ppt
5055037.ppt
 
instructional aids.pptx
instructional aids.pptxinstructional aids.pptx
instructional aids.pptx
 
a v aids.pptx
a v aids.pptxa v aids.pptx
a v aids.pptx
 

Recently uploaded

Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
MateoGardella
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
Chris Hunter
 

Recently uploaded (20)

Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 

test_administration_reporting.pptx

  • 2.  Assess maximum, not typical, performance of the student  Give students enough information about the assessment:  Time  Pop quizzes do not assess maximum performance  Test condition (timed, speeded, take-home)  Test content  Emphasis of the test  Scoring  Test use PREPARING STUDENTS Poor test administration conditions have the potential to interfere with students demonstrating their full potential and puts at risk the accuracy and usefulness of the data (ODE, 2014 ).
  • 3.  Purpose of the assessment being assembled  Range of content/Learning Progression to be covered  Distribution of test items Type the test and distribute it fairly  Organization of test items Place easier items first  minimize test-anxiety and improve validity Give clear directions to answer each item Provide a balance of item types, content coverage, difficulty levels  Make sure adequate time is allowed TEST ASSEMBLY
  • 4.  Time of day  Time allotted  Proximity to teaching of targeted content  Other issues TEST ADMINISTRATION CONSIDERATIONS
  • 5.  Score student responses  Group students  upper-, middle-, and lower-scoring group  Did the group of students have particular difficulties? What might be done about this?  Compute item difficulty (percent of students passing item, or average score)  Analyze responses for the least and most difficult items, as well as items where most students could do  Distribution of scores per item  Does the item function differently for different groups of students? ANALYSIS OF STUDENT RESPONSES
  • 6.  Reports should provide information about student achievement relative to the learning target (ODE, 2014). REPORTING
  • 7.  Nitko, A. J., & Brookhart, S. (2007). Educational assessment of students. Upper Saddle River, NJ: Pearson Education, Inc.  McMillan, J. H. (2007). Classroom assessment. Principles and practice for effective standard-based instruction (4th ed.). Boston: Pearson - Allyn & Bacon.  Oregon Department of Education. (2014, June). Assessment guidance.  Wilson, M. (2005). Constructing measures: An item response modeling approach. New York: Psychology Press, Taylor & Francis Group.  Wilson, M., & Sloane, K. (2000). From principles to practice: An embedded assessment system. Applied Measurement in Education, 13 (2), pp. 181-208.  Smarter Balanced Assessment Consortium. (2012, April). General item specifications. BIBLIOGRAPHY
  • 8. Introduction to Test Administration and Reporting PPT by the Oregon Department of Education and Berkeley Evaluation and Assessment Research Center is licensed under a CC BY 4.0. Y ou a re f ree t o:  S hare — copy and redistribute the material in any medium or format  Adapt — remix, transform, and build upon the material U nder t he fo llowing t erms:  Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.  N onCommercial — You may not use the material for commercial purposes .  S hareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original. Oregon Department of Education welcomes editing of these resources and would greatly appreciate being able to learn from the changes made. To share an edited version of this resource, please contact Cristen McLean, cristen.mclean@state.or.us. CREATIVE COMMONS LICENSE

Editor's Notes

  1. Once we have constructed a high-quality assessment, we want to make sure that the administration of the test, and the analysis of the results, is of high quality as well.
  2. We want to be sure that students are well-prepared to take the test We want to assess the maximum, not typical, performance of the student To do this, we need to give students enough information about the assessment, We need to give students time to prepare – pop quizzes do not assess maximum performance We need to consider the appropriateness of the test conditions for what is being assessed (is it timed in class, speeded, is it take-home?) We need to inform the students of the test content (what material will be covered on the test) We also need to consider the emphasis of the test relative to what has been taught And lastly we need to keep in mind how the test will be scored and how the resulting information will be used.
  3. It is best to keep the following in mind when assembling a test: What is the purpose of the assessment being assembled? What is the range of content or span of the learning progression to be covered? What is the distribution of test items (response type, target topic) It should be typed, printed legibly, and distributed fairly What is the organization of test items? It is a good idea to place some easier items first, to minimize test anxiety and improve validity We want to give clear directions to answer each item We also want to provide a balance of item types, content coverage, and difficulty levels as appropriate to the situation Lastly, we want to make sure adequate time is allowed, or to design a test with our testing time in mind – don’t include too many items, or items that take too long to complete.
  4. Some important test administration concerns include: Time of day – will the students be too tired at 2pm? When was the material usually taught? Time allotted – students will take longer to complete than we would, is there enough time for them to finish? Was the target content taught recently? There are doubtless many other such issues as well that are specific to a classroom and a particular age group.
  5. Next, here are some things to keep in mind when we prepare to analyze student responses: The first step is scoring Next, group students; for example into upper, middle, and lower scoring groups. Did any group of students have any particular difficulties? Is there anything in common about the lower or higher scoring groups that might indicate unfairness? Or learning difficulties? Next, we want to compute item difficulty (the percentage of students passing the item, or the average score on a scored item) Then, we can examine responses for the most and least difficult items as well as middle-of-the-road items where some students could answer correctly but others could not. Do these items function differently for different groups? Are top scorers missing “easy” questions? Are lower scores the only ones that got the “hard” questions?
  6. Last, we will need to provide reports on the results To whom are we reporting? Our students only, their parents? Are there any administrative reports that will need to be made? Different reports may be at different grainsizes, or in different formats “Reports should provide information about student achievement relative to the learning target”. Students should know the expectations, and how their results were relative to those expectations
  7. This completes our chapter on test administration, and the series of videos on item and test development. For further information, here are some references for you.