SlideShare a Scribd company logo
1 of 53
Measurement and Evaluation of Thinking Skills (HOTS)  ASSOC. PROF DR KAMISAH OSMAN 7 APRIL 2008
Measurement and Evaluation ,[object Object],[object Object],[object Object],[object Object]
What is all about?  Student x xxx xxxxx xxxxxx Xx X x Measurement Objectives 2.4 1.3 2.4 3.3 2.3 3.1 3.2 2.1 2.2 4.1 1.1
 
Key to Good Assessment of HOTS ,[object Object],[object Object],[object Object],[object Object]
Necessary Conditions for Good Assessment ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Test Planning: Test Grid
Developing multiple-choice (MC) questions poor better Guideline 1: The stem of an item should be meaningful by itself and should present a definite problem A scientist… a. Consults the writing of Aristotle. b. Debates with fellow scientists. c. Makes a careful observation during experiments. d. Thinks about the probability. How does a scientist discover new facts? a. Consulting the writing of Aristotle. b. Debating with fellow scientists. c. Making careful observations during experiments.* d. Thinking about the probability.
Developing MC questions poor better Guideline 2: Make all choices plausible to uninformed students What are electrons? a. Negative particles* b. Positive particles c. Neutral particles d. Mechanical tools What are electrons? a. Negative particles* b. Positive particles c. Neutral particles d. Nuclei of atoms
Ways to make choices plausible ,[object Object],[object Object],[object Object],[object Object]
Developing MC questions poor better Guideline 3: Arrange the responses in a logical order if it exists How many bonding electrons does an oxygen atom have? a. 3 b. 5 c. 6 d. 2* e. 4 How many bonding electrons does an oxygen atom have? a. 2* b. 3 c. 4 d. 5 e. 6
Developing MC questions poor better Guideline 4: Avoid extraneous clues to the correct and incorrect choices Increasing the temperature will increase the pressure of a gas in a sealed container because a. No container expansion b. Gas particles constantly more c. Gas particles collide with each other d. More gas particles collide with each other and with the container walls* Increasing the temperature will increase the pressure of a gas in a sealed container because a. Gas particles move more rapidly b. Gas particles expand bigger c. Gas particles collide more with each other d. Gas particles collide more with the container*
Developing MC questions poor better Guideline 5: Avoid using the “none of the above”, “all of the above” and “I don’t know” alternatives According to Boyle’s law, which of the following changes will occur to the pressure of a gas at a given temperature when the volume of the gas is increased?  a. increase b. decrease* c. no change d. none of the above According to Boyle’s law, which of the following changes will occur to the pressure of a gas at a given temperature when the volume of the gas is increased?  a. increase b. decrease* c. increase first, then decrease d. no change
Summary: Checklist for good MC questions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Advantages and Limitations of M-C Questions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
How to measure higher order thinking skills (HOTS) ,[object Object],[object Object],[object Object],[object Object]
Lower Order Thinking Skills (LOTS) ,[object Object],[object Object],[object Object]
Higher Order Thinking Skills (HOTS) ,[object Object],[object Object],[object Object]
Original Terms  New Terms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Using combinations of question formats: M-C + M-C ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],understand analyze
Using combinations of question formats: M-C + Constructed Response ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],understand analyze
Using combinations of question formats: Performance + M-C ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Create Understand/Create
Developing appropriate M-C questions for HOTS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Developing appropriate M-C questions for HOTS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Developing appropriate M-C questions for HOTS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Developing appropriate M-C questions for HOTS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
 
Developing constructed response questions for assessing HOTS ,[object Object],[object Object],[object Object]
General guidelines for writing constructed-response questions ,[object Object],[object Object],[object Object]
Avoid ambiguous words ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
General guidelines for writing constructed-response questions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
General guidelines for writing constructed-response questions ,[object Object],[object Object]
General guidelines for writing constructed-response questions ,[object Object],[object Object],Trait 1 Trait 2 Trait 3 4 3 2 1 5. ----------------------- 4. ------------------------ 3. ------------------------ 2. ------------------------ 1. ------------------------
Holistic Scoring Rubric
Analytic Scoring Rubric
Holistic vs Analytic  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Guidelines for scoring essay questions ,[object Object],[object Object],[object Object],[object Object]
Multiple Faculty, TAs ,[object Object],[object Object],[object Object],[object Object],[object Object]
Developing vs. Adopting ,[object Object],[object Object],[object Object]
Necessary conditions for good assessment ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Administering tests ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Scoring tests ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Item and test analysis ,[object Object],[object Object]
Grading ,[object Object],[object Object]
Criterion-referenced grading based on standards ,[object Object],[object Object]
Deciding the cut-off score: M-C test ,[object Object],[object Object],[object Object],[object Object],[object Object]
Example (n = 28,   0  = .75, X 0 =21) Average Score on the Test (M) Reliability (  ) 17 21 25 .6 23.43 20.76 18.10 .8 21.75 20.75 19.25
Norm-referenced grading or curving grading ,[object Object]
Norm-referenced vs. criterion-reference ,[object Object],[object Object],[object Object],[object Object],[object Object]
Other grading issues ,[object Object],[object Object],[object Object],[object Object]
Putting all things together: VRA validity reliability absence of bias
[object Object],[object Object]

More Related Content

Similar to Ga2143 Teslchina 7 April

2.-Guidelines-in-Test-Construction.pdf
2.-Guidelines-in-Test-Construction.pdf2.-Guidelines-in-Test-Construction.pdf
2.-Guidelines-in-Test-Construction.pdfeugenelouieibarra
 
INQUIRIES, INVESTIGATION & IMMERSION (3iS)_4thCO.pptx
INQUIRIES, INVESTIGATION & IMMERSION (3iS)_4thCO.pptxINQUIRIES, INVESTIGATION & IMMERSION (3iS)_4thCO.pptx
INQUIRIES, INVESTIGATION & IMMERSION (3iS)_4thCO.pptxAnalieCabanlit1
 
Designing Assessment Items Math Ps Version
Designing Assessment Items   Math Ps VersionDesigning Assessment Items   Math Ps Version
Designing Assessment Items Math Ps VersionJanet Drews
 
Essential Biology 3.3 DNA Structure (Core)
Essential Biology 3.3 DNA Structure (Core)Essential Biology 3.3 DNA Structure (Core)
Essential Biology 3.3 DNA Structure (Core)Stephen Taylor
 
Assessment overview part-2_spring2013b
Assessment overview part-2_spring2013bAssessment overview part-2_spring2013b
Assessment overview part-2_spring2013bGreg Sherman
 
Writing multiple choice questions 3
Writing multiple choice questions 3Writing multiple choice questions 3
Writing multiple choice questions 3Julie Sievers
 
How to download movies from odiamedia.in
How to download movies from odiamedia.inHow to download movies from odiamedia.in
How to download movies from odiamedia.inOpenjobalert
 
ILO Science 7 Review
ILO Science 7 Review ILO Science 7 Review
ILO Science 7 Review Lori Simonson
 
Dll template-g10-q4-module-1-1[1]
Dll template-g10-q4-module-1-1[1]Dll template-g10-q4-module-1-1[1]
Dll template-g10-q4-module-1-1[1]jeseccabacsa
 
Quiz 1 Biology 307 Dr. Harold.docx
                            Quiz 1 Biology 307      Dr. Harold.docx                            Quiz 1 Biology 307      Dr. Harold.docx
Quiz 1 Biology 307 Dr. Harold.docxjoyjonna282
 
Georgia Milestones Parent Presentation 3rd-5th Grade
Georgia Milestones Parent Presentation 3rd-5th GradeGeorgia Milestones Parent Presentation 3rd-5th Grade
Georgia Milestones Parent Presentation 3rd-5th Gradedelilah carr
 
Topic 3 what are essays
Topic 3 what are essaysTopic 3 what are essays
Topic 3 what are essaysSharonKaur16
 
CHM130LLLab 2Measurements Accuracy and PrecisionName __.docx
CHM130LLLab 2Measurements Accuracy and PrecisionName    __.docxCHM130LLLab 2Measurements Accuracy and PrecisionName    __.docx
CHM130LLLab 2Measurements Accuracy and PrecisionName __.docxbissacr
 
Writing Good Evaluation Questions
Writing Good Evaluation QuestionsWriting Good Evaluation Questions
Writing Good Evaluation QuestionsJeff Zoller
 
ONCAMPUS MARK SCHEME for UFP Skills for Bus CSR EssayCorporate Soc.docx
ONCAMPUS MARK SCHEME for UFP Skills for Bus CSR EssayCorporate Soc.docxONCAMPUS MARK SCHEME for UFP Skills for Bus CSR EssayCorporate Soc.docx
ONCAMPUS MARK SCHEME for UFP Skills for Bus CSR EssayCorporate Soc.docxcherishwinsland
 
SCI10-Q4-MOD3.pdf
SCI10-Q4-MOD3.pdfSCI10-Q4-MOD3.pdf
SCI10-Q4-MOD3.pdfJOSHELORDE
 
Matching test items
Matching test itemsMatching test items
Matching test itemsaelnogab
 
Science - School Certificate Preparation
Science - School Certificate PreparationScience - School Certificate Preparation
Science - School Certificate PreparationPoldingLearningCentre
 

Similar to Ga2143 Teslchina 7 April (20)

2.-Guidelines-in-Test-Construction.pdf
2.-Guidelines-in-Test-Construction.pdf2.-Guidelines-in-Test-Construction.pdf
2.-Guidelines-in-Test-Construction.pdf
 
INQUIRIES, INVESTIGATION & IMMERSION (3iS)_4thCO.pptx
INQUIRIES, INVESTIGATION & IMMERSION (3iS)_4thCO.pptxINQUIRIES, INVESTIGATION & IMMERSION (3iS)_4thCO.pptx
INQUIRIES, INVESTIGATION & IMMERSION (3iS)_4thCO.pptx
 
Essay Question -assessment
Essay Question -assessmentEssay Question -assessment
Essay Question -assessment
 
Designing Assessment Items Math Ps Version
Designing Assessment Items   Math Ps VersionDesigning Assessment Items   Math Ps Version
Designing Assessment Items Math Ps Version
 
Making multiple choice items
Making multiple choice itemsMaking multiple choice items
Making multiple choice items
 
Essential Biology 3.3 DNA Structure (Core)
Essential Biology 3.3 DNA Structure (Core)Essential Biology 3.3 DNA Structure (Core)
Essential Biology 3.3 DNA Structure (Core)
 
Assessment overview part-2_spring2013b
Assessment overview part-2_spring2013bAssessment overview part-2_spring2013b
Assessment overview part-2_spring2013b
 
Writing multiple choice questions 3
Writing multiple choice questions 3Writing multiple choice questions 3
Writing multiple choice questions 3
 
How to download movies from odiamedia.in
How to download movies from odiamedia.inHow to download movies from odiamedia.in
How to download movies from odiamedia.in
 
ILO Science 7 Review
ILO Science 7 Review ILO Science 7 Review
ILO Science 7 Review
 
Dll template-g10-q4-module-1-1[1]
Dll template-g10-q4-module-1-1[1]Dll template-g10-q4-module-1-1[1]
Dll template-g10-q4-module-1-1[1]
 
Quiz 1 Biology 307 Dr. Harold.docx
                            Quiz 1 Biology 307      Dr. Harold.docx                            Quiz 1 Biology 307      Dr. Harold.docx
Quiz 1 Biology 307 Dr. Harold.docx
 
Georgia Milestones Parent Presentation 3rd-5th Grade
Georgia Milestones Parent Presentation 3rd-5th GradeGeorgia Milestones Parent Presentation 3rd-5th Grade
Georgia Milestones Parent Presentation 3rd-5th Grade
 
Topic 3 what are essays
Topic 3 what are essaysTopic 3 what are essays
Topic 3 what are essays
 
CHM130LLLab 2Measurements Accuracy and PrecisionName __.docx
CHM130LLLab 2Measurements Accuracy and PrecisionName    __.docxCHM130LLLab 2Measurements Accuracy and PrecisionName    __.docx
CHM130LLLab 2Measurements Accuracy and PrecisionName __.docx
 
Writing Good Evaluation Questions
Writing Good Evaluation QuestionsWriting Good Evaluation Questions
Writing Good Evaluation Questions
 
ONCAMPUS MARK SCHEME for UFP Skills for Bus CSR EssayCorporate Soc.docx
ONCAMPUS MARK SCHEME for UFP Skills for Bus CSR EssayCorporate Soc.docxONCAMPUS MARK SCHEME for UFP Skills for Bus CSR EssayCorporate Soc.docx
ONCAMPUS MARK SCHEME for UFP Skills for Bus CSR EssayCorporate Soc.docx
 
SCI10-Q4-MOD3.pdf
SCI10-Q4-MOD3.pdfSCI10-Q4-MOD3.pdf
SCI10-Q4-MOD3.pdf
 
Matching test items
Matching test itemsMatching test items
Matching test items
 
Science - School Certificate Preparation
Science - School Certificate PreparationScience - School Certificate Preparation
Science - School Certificate Preparation
 

Recently uploaded

Tech Startup Growth Hacking 101 - Basics on Growth Marketing
Tech Startup Growth Hacking 101  - Basics on Growth MarketingTech Startup Growth Hacking 101  - Basics on Growth Marketing
Tech Startup Growth Hacking 101 - Basics on Growth MarketingShawn Pang
 
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan CommunicationsPharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communicationskarancommunications
 
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRLMONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRLSeo
 
Creating Low-Code Loan Applications using the Trisotech Mortgage Feature Set
Creating Low-Code Loan Applications using the Trisotech Mortgage Feature SetCreating Low-Code Loan Applications using the Trisotech Mortgage Feature Set
Creating Low-Code Loan Applications using the Trisotech Mortgage Feature SetDenis Gagné
 
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsCash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsApsara Of India
 
7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...Paul Menig
 
Catalogue ONG NƯỚC uPVC - HDPE DE NHAT.pdf
Catalogue ONG NƯỚC uPVC - HDPE DE NHAT.pdfCatalogue ONG NƯỚC uPVC - HDPE DE NHAT.pdf
Catalogue ONG NƯỚC uPVC - HDPE DE NHAT.pdfOrient Homes
 
Eni 2024 1Q Results - 24.04.24 business.
Eni 2024 1Q Results - 24.04.24 business.Eni 2024 1Q Results - 24.04.24 business.
Eni 2024 1Q Results - 24.04.24 business.Eni
 
M.C Lodges -- Guest House in Jhang.
M.C Lodges --  Guest House in Jhang.M.C Lodges --  Guest House in Jhang.
M.C Lodges -- Guest House in Jhang.Aaiza Hassan
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdfRenandantas16
 
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999Tina Ji
 
Progress Report - Oracle Database Analyst Summit
Progress  Report - Oracle Database Analyst SummitProgress  Report - Oracle Database Analyst Summit
Progress Report - Oracle Database Analyst SummitHolger Mueller
 
Insurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageInsurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageMatteo Carbone
 
Socio-economic-Impact-of-business-consumers-suppliers-and.pptx
Socio-economic-Impact-of-business-consumers-suppliers-and.pptxSocio-economic-Impact-of-business-consumers-suppliers-and.pptx
Socio-economic-Impact-of-business-consumers-suppliers-and.pptxtrishalcan8
 
Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Servicediscovermytutordmt
 
DEPED Work From Home WORKWEEK-PLAN.docx
DEPED Work From Home  WORKWEEK-PLAN.docxDEPED Work From Home  WORKWEEK-PLAN.docx
DEPED Work From Home WORKWEEK-PLAN.docxRodelinaLaud
 
Grateful 7 speech thanking everyone that has helped.pdf
Grateful 7 speech thanking everyone that has helped.pdfGrateful 7 speech thanking everyone that has helped.pdf
Grateful 7 speech thanking everyone that has helped.pdfPaul Menig
 
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Lviv Startup Club
 
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130  Available With RoomVIP Kolkata Call Girl Howrah 👉 8250192130  Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Roomdivyansh0kumar0
 

Recently uploaded (20)

Tech Startup Growth Hacking 101 - Basics on Growth Marketing
Tech Startup Growth Hacking 101  - Basics on Growth MarketingTech Startup Growth Hacking 101  - Basics on Growth Marketing
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
 
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan CommunicationsPharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communications
 
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRLMONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
 
Creating Low-Code Loan Applications using the Trisotech Mortgage Feature Set
Creating Low-Code Loan Applications using the Trisotech Mortgage Feature SetCreating Low-Code Loan Applications using the Trisotech Mortgage Feature Set
Creating Low-Code Loan Applications using the Trisotech Mortgage Feature Set
 
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsCash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
 
7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...7.pdf This presentation captures many uses and the significance of the number...
7.pdf This presentation captures many uses and the significance of the number...
 
Catalogue ONG NƯỚC uPVC - HDPE DE NHAT.pdf
Catalogue ONG NƯỚC uPVC - HDPE DE NHAT.pdfCatalogue ONG NƯỚC uPVC - HDPE DE NHAT.pdf
Catalogue ONG NƯỚC uPVC - HDPE DE NHAT.pdf
 
Eni 2024 1Q Results - 24.04.24 business.
Eni 2024 1Q Results - 24.04.24 business.Eni 2024 1Q Results - 24.04.24 business.
Eni 2024 1Q Results - 24.04.24 business.
 
M.C Lodges -- Guest House in Jhang.
M.C Lodges --  Guest House in Jhang.M.C Lodges --  Guest House in Jhang.
M.C Lodges -- Guest House in Jhang.
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
 
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999
 
Progress Report - Oracle Database Analyst Summit
Progress  Report - Oracle Database Analyst SummitProgress  Report - Oracle Database Analyst Summit
Progress Report - Oracle Database Analyst Summit
 
Insurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageInsurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usage
 
Socio-economic-Impact-of-business-consumers-suppliers-and.pptx
Socio-economic-Impact-of-business-consumers-suppliers-and.pptxSocio-economic-Impact-of-business-consumers-suppliers-and.pptx
Socio-economic-Impact-of-business-consumers-suppliers-and.pptx
 
Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Service
 
DEPED Work From Home WORKWEEK-PLAN.docx
DEPED Work From Home  WORKWEEK-PLAN.docxDEPED Work From Home  WORKWEEK-PLAN.docx
DEPED Work From Home WORKWEEK-PLAN.docx
 
Best Practices for Implementing an External Recruiting Partnership
Best Practices for Implementing an External Recruiting PartnershipBest Practices for Implementing an External Recruiting Partnership
Best Practices for Implementing an External Recruiting Partnership
 
Grateful 7 speech thanking everyone that has helped.pdf
Grateful 7 speech thanking everyone that has helped.pdfGrateful 7 speech thanking everyone that has helped.pdf
Grateful 7 speech thanking everyone that has helped.pdf
 
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
 
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130  Available With RoomVIP Kolkata Call Girl Howrah 👉 8250192130  Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
 

Ga2143 Teslchina 7 April

  • 1. Measurement and Evaluation of Thinking Skills (HOTS) ASSOC. PROF DR KAMISAH OSMAN 7 APRIL 2008
  • 2.
  • 3. What is all about? Student x xxx xxxxx xxxxxx Xx X x Measurement Objectives 2.4 1.3 2.4 3.3 2.3 3.1 3.2 2.1 2.2 4.1 1.1
  • 4.  
  • 5.
  • 6.
  • 8. Developing multiple-choice (MC) questions poor better Guideline 1: The stem of an item should be meaningful by itself and should present a definite problem A scientist… a. Consults the writing of Aristotle. b. Debates with fellow scientists. c. Makes a careful observation during experiments. d. Thinks about the probability. How does a scientist discover new facts? a. Consulting the writing of Aristotle. b. Debating with fellow scientists. c. Making careful observations during experiments.* d. Thinking about the probability.
  • 9. Developing MC questions poor better Guideline 2: Make all choices plausible to uninformed students What are electrons? a. Negative particles* b. Positive particles c. Neutral particles d. Mechanical tools What are electrons? a. Negative particles* b. Positive particles c. Neutral particles d. Nuclei of atoms
  • 10.
  • 11. Developing MC questions poor better Guideline 3: Arrange the responses in a logical order if it exists How many bonding electrons does an oxygen atom have? a. 3 b. 5 c. 6 d. 2* e. 4 How many bonding electrons does an oxygen atom have? a. 2* b. 3 c. 4 d. 5 e. 6
  • 12. Developing MC questions poor better Guideline 4: Avoid extraneous clues to the correct and incorrect choices Increasing the temperature will increase the pressure of a gas in a sealed container because a. No container expansion b. Gas particles constantly more c. Gas particles collide with each other d. More gas particles collide with each other and with the container walls* Increasing the temperature will increase the pressure of a gas in a sealed container because a. Gas particles move more rapidly b. Gas particles expand bigger c. Gas particles collide more with each other d. Gas particles collide more with the container*
  • 13. Developing MC questions poor better Guideline 5: Avoid using the “none of the above”, “all of the above” and “I don’t know” alternatives According to Boyle’s law, which of the following changes will occur to the pressure of a gas at a given temperature when the volume of the gas is increased? a. increase b. decrease* c. no change d. none of the above According to Boyle’s law, which of the following changes will occur to the pressure of a gas at a given temperature when the volume of the gas is increased? a. increase b. decrease* c. increase first, then decrease d. no change
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.  
  • 28.  
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.
  • 46.
  • 47.
  • 48. Example (n = 28,  0 = .75, X 0 =21) Average Score on the Test (M) Reliability (  ) 17 21 25 .6 23.43 20.76 18.10 .8 21.75 20.75 19.25
  • 49.
  • 50.
  • 51.
  • 52. Putting all things together: VRA validity reliability absence of bias
  • 53.