SlideShare a Scribd company logo
1 of 31
Is a term derived from the Latin word
validus, meaning strong.
In view of assessment, it is deemed valid if
it measures what it is supposed to.
Content-related evidence for validity pertains to the
extent to which the test covers the entire domain of
content.
 A test that appears to adequately measure the
learning outcomes and content is said to possess
face validity.
 Instructional validity is the extent to which as
assessment is systematically sensitive to the nature
of instruction offered.
 Table of Specifications (ToS) – it is a test
blueprint that identifies the content area and
describes the learning outcomes at each level of
domain.
Course title: Math
Grade level: V
Periods test is being used: 2
Date of test: August 8, 2014
Subject matter digest: Number and Number Sense
Type of test: Power, Speed, Partially speeded (Circle one)
Test time: 45 minutes
Test value: 100 points
Base number of test questions: 75
Constraints: Test time
Learning Objective
Item
Type
Revised Bloom's Taxonomy
Total
Remember
Understan
d
Apply Analyze Evaluate Create
No. Level Instructiona
l Time (in
minutes)
Q/P/% Q/P
1 Apply 95 16% 11/16 Matching 6(1) 5(2) 11/16
2
Understan
d
55 9% 7/10 MC 5(2) 5/10
⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞
10 Evaluate 40 7% 5/7 Essay 1(7) 1/7
Total 600 100% 75/100 11/12 23/31 16/34 4/10 3/6 1/7 58/100
Type of Test Questions Time Required to Answer
Alternate Response (True-false) 20 - 30 seconds
Modified True or False 30 - 45 seconds (Notar, et. al. 2004)
Sentence completion (one-word fill-in) 40 - 60 seconds
Multiple choice with four responses (lower level) 40 - 60 seconds
Multiple choice (higher level) 70 - 90 seconds
Matching Type (5 stems, 6 choices) 2 - 4 minutes
Short answer 2 - 4 minutes
Multiple choice (with calculations) 2 - 5 minutes
Word problems (simple arithmetic) 5 - 10 minutes
Short essays 15 - 20 minutes
Data analysis/graphing 15 - 25 minutes
Drawing models/labelling 20 - 30 minutes
Extended essays 35 - 50 minutes
Refers to the degree to which test scores agrees with an external
criterion.
It examines the relationship between an assessment and another
measure of the same trait.
There are three types of criteria:
Achievement test scores
Ratings, grades, and other
numerical judgments made by the
teacher
Career data
 Concurrent validity provides an estimate
of a student’s current performance relation
to a previously validated or established
measure.
 Predictive validity pertains to the power or
usefulness of test scores to predict future
performance.
Construct-related evidence of validity is an assessment of the
quality of the instrument used.
It measures the extent to which the assessment is a meaningful
measure of an unobservable trait or characteristics.
-Theoretical, Logical & Statistical
Convergent & Divergent
Validity occurs when measures of construct
that are in fact observe to be related.
Validity occurs when construct that are
unrelated are in reality observe not to be.
Integrates considerations of content, criteria, and
consequences into a construct framework for the empirical
testing of rational hypotheses about score meaning and
theoretically relevant relationships. (Merrick, 1989)
 Content aspect are parallel to content-related evidence
which calls for content relevance and
representativeness.
 Substantive aspects pertain to the theoretical
constructs and empirical evidences.
 Structural aspects assess how well the scoring
structure matches the construct domain.
 Generalizability aspects examine how score properties
and interpretations generalize to and across
populations groups, contexts and tasks.
 External aspects include convergent and discriminant
evidences taken from Multitrait-Multimethod studies.
 Consequential aspects pertain to the intended and
unintended effects of assessment on teaching and
learning.
Developing performance assessments
involves three steps: define the purpose,
choose the activity and develop criteria
for scoring.
1. The selected performance should reflect a valued activity.
2. The completion of performance assessments should
provide a valuable learning experiences.
3. The statement of goals and objectives should be clearly
aligned with the measurable outcomes of the
performance activity.
4. The task should not examine extraneous or unintended
variables.
5. Performance assessments should be fair and free from
bias.
1. Unclear test directions
2. Complicated vocabulary and sentence structure
3. Ambiguous statement
4. Inadequate time limits
5. Inappropriate level of difficulty of test items
6. Poorly constructed test items
7. Inappropriate test items for outcomes being measured
8. Short test
9. Improper arrangement of items
10. Identifiable pattern of answers
 Ask others to judge the clarity of what you
are assessing.
 Check to see if different ways of assessing
the same thing give the same result.
 Sample a sufficient number of examples of
what is being assessed.
 Prepare a detailed table of specifications.
 Ask others to judge the match between the
assessment items and the objectives of the
assessment.
 Compare groups known differ on what is
being assessed.
 Compare scores taken before to those taken
after instruction.
 Compare predicted consequences to actual
consequences.
 Compare scores on similar, but different traits.
 Provide adequate time to complete the
assessment.
 Ensure appropriate vocabulary, sentence
structure and item difficulty.
 Ask easy questions first.
 Use different methods to assess the same thing.
 Use only for intended purposes.
Talks about reproducibility and consistency in methods and
criteria
Internal & External reliability
A. Stability
B. Equivalence
C. Internal Consistency
D. Scorer or Rater Consistency
E. Decision Consistency
 Lengthen the assessment procedure by providing more
time, more questions and more observation whenever
practical.
 Broaden the scope of the procedure by assessing all the
significant aspects of the largest learning performance.
 Improve objectivity by using a systematic and more
formal procedure for scoring student performance. A
scoring scheme or rubric would prove useful.
 Use multiple markers by employing inter-rater
reliability.
 Combine results from several assessments
especially when making crucial educational
decisions.
 Provide sufficient time to students in completing
the assessment procedure.
 Teach students how to perform their best by
providing practice and training to students and
motivating them.
 Match the assessment difficulty to the
students’ ability levels by providing tasks
that are neither too easy nor too difficult,
and tailoring the assessment to each
student’s ability level when possible.
 Differentiate among students by selecting
assessment tasks that distinguish or
discriminate the best from the least able
students.

More Related Content

What's hot

Testing, assessment, measurement and evaluation definition
Testing, assessment, measurement and evaluation definitionTesting, assessment, measurement and evaluation definition
Testing, assessment, measurement and evaluation definitionnorazmi danuri
 
Item analysis and validation
Item analysis and validationItem analysis and validation
Item analysis and validationKEnkenken Tan
 
Efl students’ perceptions of a blended learning environment
Efl students’ perceptions of a blended learning environmentEfl students’ perceptions of a blended learning environment
Efl students’ perceptions of a blended learning environmentZalina Zamri
 
Authentic Assessment
Authentic AssessmentAuthentic Assessment
Authentic AssessmentSuha Tamim
 
Properties of Assessment Methods
Properties of Assessment MethodsProperties of Assessment Methods
Properties of Assessment MethodsMonica Angeles
 
tryout test, item analysis (difficulty, discrimination)
tryout test, item analysis (difficulty, discrimination)tryout test, item analysis (difficulty, discrimination)
tryout test, item analysis (difficulty, discrimination)April Gealene Alera
 
Table of specification dr shafqat ali
Table of specification  dr shafqat aliTable of specification  dr shafqat ali
Table of specification dr shafqat aliAmina Tariq
 
PLANNING CLASSROOM TESTS AND ASSESSMENTS
PLANNING CLASSROOM TESTS AND ASSESSMENTSPLANNING CLASSROOM TESTS AND ASSESSMENTS
PLANNING CLASSROOM TESTS AND ASSESSMENTSSANA FATIMA
 
intended vs implemented vs achieved curriculum
intended vs implemented vs achieved curriculumintended vs implemented vs achieved curriculum
intended vs implemented vs achieved curriculumobemrosalia
 
ASSESSMENT AND EVALUATION
ASSESSMENT AND EVALUATIONASSESSMENT AND EVALUATION
ASSESSMENT AND EVALUATIONcharjsanjuan28
 
Development of classroom assessment tools
Development of classroom assessment toolsDevelopment of classroom assessment tools
Development of classroom assessment toolsAko Cheri
 
Testing grammar
Testing grammarTesting grammar
Testing grammarSamcruz5
 
Distracter Analysis - Index of Effectiveness
Distracter Analysis - Index of EffectivenessDistracter Analysis - Index of Effectiveness
Distracter Analysis - Index of EffectivenessMr. Ronald Quileste, PhD
 
Valiadity and reliability- Language testing
Valiadity and reliability- Language testingValiadity and reliability- Language testing
Valiadity and reliability- Language testingPhuong Tran
 

What's hot (20)

Item analysis report
Item analysis report Item analysis report
Item analysis report
 
Testing, assessment, measurement and evaluation definition
Testing, assessment, measurement and evaluation definitionTesting, assessment, measurement and evaluation definition
Testing, assessment, measurement and evaluation definition
 
Item analysis and validation
Item analysis and validationItem analysis and validation
Item analysis and validation
 
Efl students’ perceptions of a blended learning environment
Efl students’ perceptions of a blended learning environmentEfl students’ perceptions of a blended learning environment
Efl students’ perceptions of a blended learning environment
 
Authentic Assessment
Authentic AssessmentAuthentic Assessment
Authentic Assessment
 
Properties of Assessment Methods
Properties of Assessment MethodsProperties of Assessment Methods
Properties of Assessment Methods
 
tryout test, item analysis (difficulty, discrimination)
tryout test, item analysis (difficulty, discrimination)tryout test, item analysis (difficulty, discrimination)
tryout test, item analysis (difficulty, discrimination)
 
Tools of Education Research- Dr. K. Thiyagu
Tools of Education Research- Dr. K. ThiyaguTools of Education Research- Dr. K. Thiyagu
Tools of Education Research- Dr. K. Thiyagu
 
Qualitative item analysis
Qualitative item analysisQualitative item analysis
Qualitative item analysis
 
Methods
MethodsMethods
Methods
 
Table of specification dr shafqat ali
Table of specification  dr shafqat aliTable of specification  dr shafqat ali
Table of specification dr shafqat ali
 
PLANNING CLASSROOM TESTS AND ASSESSMENTS
PLANNING CLASSROOM TESTS AND ASSESSMENTSPLANNING CLASSROOM TESTS AND ASSESSMENTS
PLANNING CLASSROOM TESTS AND ASSESSMENTS
 
intended vs implemented vs achieved curriculum
intended vs implemented vs achieved curriculumintended vs implemented vs achieved curriculum
intended vs implemented vs achieved curriculum
 
ASSESSMENT AND EVALUATION
ASSESSMENT AND EVALUATIONASSESSMENT AND EVALUATION
ASSESSMENT AND EVALUATION
 
Reading assessment
Reading assessmentReading assessment
Reading assessment
 
Development of classroom assessment tools
Development of classroom assessment toolsDevelopment of classroom assessment tools
Development of classroom assessment tools
 
T est item analysis
T est item analysisT est item analysis
T est item analysis
 
Testing grammar
Testing grammarTesting grammar
Testing grammar
 
Distracter Analysis - Index of Effectiveness
Distracter Analysis - Index of EffectivenessDistracter Analysis - Index of Effectiveness
Distracter Analysis - Index of Effectiveness
 
Valiadity and reliability- Language testing
Valiadity and reliability- Language testingValiadity and reliability- Language testing
Valiadity and reliability- Language testing
 

Similar to Validity and reliability

Program evaluation
Program evaluationProgram evaluation
Program evaluationaneez103
 
Developing Assessment Instruments
Developing Assessment InstrumentsDeveloping Assessment Instruments
Developing Assessment InstrumentsAngel Jones
 
LESSON 6 JBF 361.pptx
LESSON 6 JBF 361.pptxLESSON 6 JBF 361.pptx
LESSON 6 JBF 361.pptxAdnanIssah
 
Validity and reliability of questionnaires
Validity and reliability of questionnairesValidity and reliability of questionnaires
Validity and reliability of questionnairesVenkitachalam R
 
Apt 501 chapter_7
Apt 501 chapter_7Apt 501 chapter_7
Apt 501 chapter_7cdjhaigler
 
Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7cdjhaigler
 
Developing Assessment Instrument
Developing Assessment InstrumentDeveloping Assessment Instrument
Developing Assessment Instrumentcdjhaigler
 
1reviewofhighqualityassessment.pptx
1reviewofhighqualityassessment.pptx1reviewofhighqualityassessment.pptx
1reviewofhighqualityassessment.pptxCamposJansen
 
Construction of Tests
Construction of TestsConstruction of Tests
Construction of TestsDakshta1
 
Concept and nature of measurment and evaluation (1)
Concept and nature of measurment and evaluation (1)Concept and nature of measurment and evaluation (1)
Concept and nature of measurment and evaluation (1)dheerajvyas5
 
Week1 Assessment Overview
Week1 Assessment OverviewWeek1 Assessment Overview
Week1 Assessment OverviewIPT652
 
Week1 B Assessment Overview
Week1 B Assessment OverviewWeek1 B Assessment Overview
Week1 B Assessment OverviewIPT652
 
Assessing learning in Instructional Design
Assessing learning in Instructional DesignAssessing learning in Instructional Design
Assessing learning in Instructional Designleesha roberts
 
Languageassessmenttsl3123notes 141203115756-conversion-gate01 (1)
Languageassessmenttsl3123notes 141203115756-conversion-gate01 (1)Languageassessmenttsl3123notes 141203115756-conversion-gate01 (1)
Languageassessmenttsl3123notes 141203115756-conversion-gate01 (1)hakim azman
 
Testing for language teachers 101 (1)
Testing for language teachers 101 (1)Testing for language teachers 101 (1)
Testing for language teachers 101 (1)Paul Doyon
 

Similar to Validity and reliability (20)

Week 8 & 9 - Validity and Reliability
Week 8 & 9 - Validity and ReliabilityWeek 8 & 9 - Validity and Reliability
Week 8 & 9 - Validity and Reliability
 
Validity
ValidityValidity
Validity
 
Program evaluation
Program evaluationProgram evaluation
Program evaluation
 
7.1 assessment and the cefr (1)
7.1 assessment and the cefr (1)7.1 assessment and the cefr (1)
7.1 assessment and the cefr (1)
 
Developing Assessment Instruments
Developing Assessment InstrumentsDeveloping Assessment Instruments
Developing Assessment Instruments
 
LESSON 6 JBF 361.pptx
LESSON 6 JBF 361.pptxLESSON 6 JBF 361.pptx
LESSON 6 JBF 361.pptx
 
Validity and reliability of questionnaires
Validity and reliability of questionnairesValidity and reliability of questionnaires
Validity and reliability of questionnaires
 
Apt 501 chapter_7
Apt 501 chapter_7Apt 501 chapter_7
Apt 501 chapter_7
 
Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7Developing Assessment Instruments Chapter 7
Developing Assessment Instruments Chapter 7
 
Developing Assessment Instrument
Developing Assessment InstrumentDeveloping Assessment Instrument
Developing Assessment Instrument
 
1reviewofhighqualityassessment.pptx
1reviewofhighqualityassessment.pptx1reviewofhighqualityassessment.pptx
1reviewofhighqualityassessment.pptx
 
Construction of Tests
Construction of TestsConstruction of Tests
Construction of Tests
 
Presentation2
Presentation2Presentation2
Presentation2
 
Concept and nature of measurment and evaluation (1)
Concept and nature of measurment and evaluation (1)Concept and nature of measurment and evaluation (1)
Concept and nature of measurment and evaluation (1)
 
Week1 Assessment Overview
Week1 Assessment OverviewWeek1 Assessment Overview
Week1 Assessment Overview
 
Week1 B Assessment Overview
Week1 B Assessment OverviewWeek1 B Assessment Overview
Week1 B Assessment Overview
 
Assessing learning in Instructional Design
Assessing learning in Instructional DesignAssessing learning in Instructional Design
Assessing learning in Instructional Design
 
7.1 assessment and the cefr (1)
7.1 assessment and the cefr (1)7.1 assessment and the cefr (1)
7.1 assessment and the cefr (1)
 
Languageassessmenttsl3123notes 141203115756-conversion-gate01 (1)
Languageassessmenttsl3123notes 141203115756-conversion-gate01 (1)Languageassessmenttsl3123notes 141203115756-conversion-gate01 (1)
Languageassessmenttsl3123notes 141203115756-conversion-gate01 (1)
 
Testing for language teachers 101 (1)
Testing for language teachers 101 (1)Testing for language teachers 101 (1)
Testing for language teachers 101 (1)
 

Recently uploaded

Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxAvyJaneVismanos
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsanshu789521
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
Capitol Tech U Doctoral Presentation - April 2024.pptx
Capitol Tech U Doctoral Presentation - April 2024.pptxCapitol Tech U Doctoral Presentation - April 2024.pptx
Capitol Tech U Doctoral Presentation - April 2024.pptxCapitolTechU
 
MARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupMARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupJonathanParaisoCruz
 
AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.arsicmarija21
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersSabitha Banu
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfMahmoud M. Sallam
 
MICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxMICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxabhijeetpadhi001
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 
Blooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxBlooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxUnboundStockton
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxJiesonDelaCerna
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 

Recently uploaded (20)

Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptx
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha elections
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Capitol Tech U Doctoral Presentation - April 2024.pptx
Capitol Tech U Doctoral Presentation - April 2024.pptxCapitol Tech U Doctoral Presentation - April 2024.pptx
Capitol Tech U Doctoral Presentation - April 2024.pptx
 
MARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupMARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized Group
 
AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.AmericanHighSchoolsprezentacijaoskolama.
AmericanHighSchoolsprezentacijaoskolama.
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginners
 
OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdf
 
MICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxMICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptx
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
Blooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxBlooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docx
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptx
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 

Validity and reliability

  • 1.
  • 2. Is a term derived from the Latin word validus, meaning strong. In view of assessment, it is deemed valid if it measures what it is supposed to.
  • 3. Content-related evidence for validity pertains to the extent to which the test covers the entire domain of content.
  • 4.  A test that appears to adequately measure the learning outcomes and content is said to possess face validity.  Instructional validity is the extent to which as assessment is systematically sensitive to the nature of instruction offered.  Table of Specifications (ToS) – it is a test blueprint that identifies the content area and describes the learning outcomes at each level of domain.
  • 5. Course title: Math Grade level: V Periods test is being used: 2 Date of test: August 8, 2014 Subject matter digest: Number and Number Sense Type of test: Power, Speed, Partially speeded (Circle one) Test time: 45 minutes Test value: 100 points Base number of test questions: 75 Constraints: Test time Learning Objective Item Type Revised Bloom's Taxonomy Total Remember Understan d Apply Analyze Evaluate Create No. Level Instructiona l Time (in minutes) Q/P/% Q/P 1 Apply 95 16% 11/16 Matching 6(1) 5(2) 11/16 2 Understan d 55 9% 7/10 MC 5(2) 5/10 ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ ⁞ 10 Evaluate 40 7% 5/7 Essay 1(7) 1/7 Total 600 100% 75/100 11/12 23/31 16/34 4/10 3/6 1/7 58/100
  • 6. Type of Test Questions Time Required to Answer Alternate Response (True-false) 20 - 30 seconds Modified True or False 30 - 45 seconds (Notar, et. al. 2004) Sentence completion (one-word fill-in) 40 - 60 seconds Multiple choice with four responses (lower level) 40 - 60 seconds Multiple choice (higher level) 70 - 90 seconds Matching Type (5 stems, 6 choices) 2 - 4 minutes Short answer 2 - 4 minutes Multiple choice (with calculations) 2 - 5 minutes Word problems (simple arithmetic) 5 - 10 minutes Short essays 15 - 20 minutes Data analysis/graphing 15 - 25 minutes Drawing models/labelling 20 - 30 minutes Extended essays 35 - 50 minutes
  • 7. Refers to the degree to which test scores agrees with an external criterion. It examines the relationship between an assessment and another measure of the same trait.
  • 8. There are three types of criteria: Achievement test scores Ratings, grades, and other numerical judgments made by the teacher Career data
  • 9.  Concurrent validity provides an estimate of a student’s current performance relation to a previously validated or established measure.  Predictive validity pertains to the power or usefulness of test scores to predict future performance.
  • 10. Construct-related evidence of validity is an assessment of the quality of the instrument used. It measures the extent to which the assessment is a meaningful measure of an unobservable trait or characteristics.
  • 11. -Theoretical, Logical & Statistical
  • 13. Validity occurs when measures of construct that are in fact observe to be related.
  • 14. Validity occurs when construct that are unrelated are in reality observe not to be.
  • 15. Integrates considerations of content, criteria, and consequences into a construct framework for the empirical testing of rational hypotheses about score meaning and theoretically relevant relationships. (Merrick, 1989)
  • 16.  Content aspect are parallel to content-related evidence which calls for content relevance and representativeness.  Substantive aspects pertain to the theoretical constructs and empirical evidences.  Structural aspects assess how well the scoring structure matches the construct domain.
  • 17.  Generalizability aspects examine how score properties and interpretations generalize to and across populations groups, contexts and tasks.  External aspects include convergent and discriminant evidences taken from Multitrait-Multimethod studies.  Consequential aspects pertain to the intended and unintended effects of assessment on teaching and learning.
  • 18. Developing performance assessments involves three steps: define the purpose, choose the activity and develop criteria for scoring.
  • 19. 1. The selected performance should reflect a valued activity. 2. The completion of performance assessments should provide a valuable learning experiences. 3. The statement of goals and objectives should be clearly aligned with the measurable outcomes of the performance activity. 4. The task should not examine extraneous or unintended variables. 5. Performance assessments should be fair and free from bias.
  • 20. 1. Unclear test directions 2. Complicated vocabulary and sentence structure 3. Ambiguous statement 4. Inadequate time limits 5. Inappropriate level of difficulty of test items 6. Poorly constructed test items 7. Inappropriate test items for outcomes being measured 8. Short test 9. Improper arrangement of items 10. Identifiable pattern of answers
  • 21.  Ask others to judge the clarity of what you are assessing.  Check to see if different ways of assessing the same thing give the same result.  Sample a sufficient number of examples of what is being assessed.  Prepare a detailed table of specifications.
  • 22.  Ask others to judge the match between the assessment items and the objectives of the assessment.  Compare groups known differ on what is being assessed.  Compare scores taken before to those taken after instruction.  Compare predicted consequences to actual consequences.
  • 23.  Compare scores on similar, but different traits.  Provide adequate time to complete the assessment.  Ensure appropriate vocabulary, sentence structure and item difficulty.  Ask easy questions first.  Use different methods to assess the same thing.  Use only for intended purposes.
  • 24. Talks about reproducibility and consistency in methods and criteria
  • 25. Internal & External reliability
  • 26.
  • 27. A. Stability B. Equivalence C. Internal Consistency D. Scorer or Rater Consistency E. Decision Consistency
  • 28.
  • 29.  Lengthen the assessment procedure by providing more time, more questions and more observation whenever practical.  Broaden the scope of the procedure by assessing all the significant aspects of the largest learning performance.  Improve objectivity by using a systematic and more formal procedure for scoring student performance. A scoring scheme or rubric would prove useful.
  • 30.  Use multiple markers by employing inter-rater reliability.  Combine results from several assessments especially when making crucial educational decisions.  Provide sufficient time to students in completing the assessment procedure.  Teach students how to perform their best by providing practice and training to students and motivating them.
  • 31.  Match the assessment difficulty to the students’ ability levels by providing tasks that are neither too easy nor too difficult, and tailoring the assessment to each student’s ability level when possible.  Differentiate among students by selecting assessment tasks that distinguish or discriminate the best from the least able students.