SlideShare a Scribd company logo
1 of 17
Opening up Multiple Choice: Assessing with confidence CALRG Conference, June 2011 Jon Rosewell [email_address]
Multiple Choice Questions (MCQ) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Demo ,[object Object],[object Object],[object Object],screen dump
 
Confidence-Based Marking (CBM) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
CBM scoring Tentative & correct Confidently correct Cocksure – and wrong! Score -6 3 High -2 2 Medium 0 1 Low Wrong Correct Confidence
CBM motivations ,[object Object],[object Object],[object Object],[object Object]
Demo ,[object Object],[object Object],[object Object],screen dump
 
Open CBM ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Demo ,[object Object],[object Object],[object Object],screen dump
 
Open CBM advantages ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
MCQ  Open CBM ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Possible benefits ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
eSTEeM project plan (revised…) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Jon Rosewell [email_address] ,[object Object]

More Related Content

What's hot

"Preparing for SBAC: Addressing Online Testing Challenges with your Students"
"Preparing for SBAC: Addressing Online Testing Challenges with your Students""Preparing for SBAC: Addressing Online Testing Challenges with your Students"
"Preparing for SBAC: Addressing Online Testing Challenges with your Students"WowzersMath
 
College & Career Readiness
College & Career ReadinessCollege & Career Readiness
College & Career ReadinessCitizen Schools
 
Assessment For Learning (Afl)
Assessment For Learning (Afl)Assessment For Learning (Afl)
Assessment For Learning (Afl)Georg Coakley
 
Few ideas to enhance effectiveness of online teaching
Few ideas to  enhance effectiveness of  online teachingFew ideas to  enhance effectiveness of  online teaching
Few ideas to enhance effectiveness of online teachingSelf-employed
 

What's hot (7)

Oic assessment review(1)
Oic assessment review(1)Oic assessment review(1)
Oic assessment review(1)
 
"Preparing for SBAC: Addressing Online Testing Challenges with your Students"
"Preparing for SBAC: Addressing Online Testing Challenges with your Students""Preparing for SBAC: Addressing Online Testing Challenges with your Students"
"Preparing for SBAC: Addressing Online Testing Challenges with your Students"
 
College & Career Readiness
College & Career ReadinessCollege & Career Readiness
College & Career Readiness
 
computer based training
computer based trainingcomputer based training
computer based training
 
Assessment For Learning (Afl)
Assessment For Learning (Afl)Assessment For Learning (Afl)
Assessment For Learning (Afl)
 
Few ideas to enhance effectiveness of online teaching
Few ideas to  enhance effectiveness of  online teachingFew ideas to  enhance effectiveness of  online teaching
Few ideas to enhance effectiveness of online teaching
 
Lll+
Lll+Lll+
Lll+
 

Similar to Opening up multiple choice - assessing with confidence

Assessing with confidence
Assessing with confidenceAssessing with confidence
Assessing with confidenceJon Rosewell
 
Confidence based marking: assessing with confidence
Confidence based marking: assessing with confidenceConfidence based marking: assessing with confidence
Confidence based marking: assessing with confidenceEADTU
 
3 Overcoming_the_limitations_of_MCQs.pdf
3 Overcoming_the_limitations_of_MCQs.pdf3 Overcoming_the_limitations_of_MCQs.pdf
3 Overcoming_the_limitations_of_MCQs.pdfHammad Mushtaq
 
E assessment authoring
E assessment authoring E assessment authoring
E assessment authoring Nader Jarmooz
 
Basic Testing Terminology
Basic Testing TerminologyBasic Testing Terminology
Basic Testing TerminologyYee Bee Choo
 
Competency-Based Education Step-by-Step Guide
Competency-Based Education Step-by-Step GuideCompetency-Based Education Step-by-Step Guide
Competency-Based Education Step-by-Step GuideWonderlic
 
Use of various online platforms to conduct examination.pptx
Use of various online platforms to conduct examination.pptxUse of various online platforms to conduct examination.pptx
Use of various online platforms to conduct examination.pptxDr. Chetan Bhatt
 
Computer manged learning and problems code 8620 bed
Computer manged learning and problems code 8620 bedComputer manged learning and problems code 8620 bed
Computer manged learning and problems code 8620 bedHabib Ullah Qamar
 
Screening and Enrollment Faculty Development Model - Competency-Based Education
Screening and Enrollment Faculty Development Model - Competency-Based EducationScreening and Enrollment Faculty Development Model - Competency-Based Education
Screening and Enrollment Faculty Development Model - Competency-Based EducationBecky Lopanec
 
Science-Writing-Effective-MCQs-Workshop-Nov2020.pptx
Science-Writing-Effective-MCQs-Workshop-Nov2020.pptxScience-Writing-Effective-MCQs-Workshop-Nov2020.pptx
Science-Writing-Effective-MCQs-Workshop-Nov2020.pptxAbdulRashidAdams
 
Review the video The Performance Review Process” then answer the .docx
Review the video The Performance Review Process” then answer the .docxReview the video The Performance Review Process” then answer the .docx
Review the video The Performance Review Process” then answer the .docxronak56
 
Computer- Based Assessment.pptx
Computer- Based Assessment.pptxComputer- Based Assessment.pptx
Computer- Based Assessment.pptxLovelyDiosaBatnag
 
ITC12 Pre-conference Workshop: Evaluating Online Faculty2-slideshare
ITC12 Pre-conference Workshop: Evaluating Online Faculty2-slideshareITC12 Pre-conference Workshop: Evaluating Online Faculty2-slideshare
ITC12 Pre-conference Workshop: Evaluating Online Faculty2-slidesharexlents
 
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...Blackboard APAC
 
Professional development in MCQ writing
Professional development in MCQ writingProfessional development in MCQ writing
Professional development in MCQ writingSusie Macfarlane
 
Competency-based Education Overview - Brightspace
Competency-based Education Overview - BrightspaceCompetency-based Education Overview - Brightspace
Competency-based Education Overview - BrightspaceD2L Barry
 
RIDE 2010 presentation - Using interactive computer-based assessment to suppo...
RIDE 2010 presentation - Using interactive computer-based assessment to suppo...RIDE 2010 presentation - Using interactive computer-based assessment to suppo...
RIDE 2010 presentation - Using interactive computer-based assessment to suppo...Centre for Distance Education
 
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMSTHE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMSHuman Capital Media
 

Similar to Opening up multiple choice - assessing with confidence (20)

Assessing with confidence
Assessing with confidenceAssessing with confidence
Assessing with confidence
 
Confidence based marking: assessing with confidence
Confidence based marking: assessing with confidenceConfidence based marking: assessing with confidence
Confidence based marking: assessing with confidence
 
3 Overcoming_the_limitations_of_MCQs.pdf
3 Overcoming_the_limitations_of_MCQs.pdf3 Overcoming_the_limitations_of_MCQs.pdf
3 Overcoming_the_limitations_of_MCQs.pdf
 
E assessment authoring
E assessment authoring E assessment authoring
E assessment authoring
 
Basic Testing Terminology
Basic Testing TerminologyBasic Testing Terminology
Basic Testing Terminology
 
Competency-Based Education Step-by-Step Guide
Competency-Based Education Step-by-Step GuideCompetency-Based Education Step-by-Step Guide
Competency-Based Education Step-by-Step Guide
 
Use of various online platforms to conduct examination.pptx
Use of various online platforms to conduct examination.pptxUse of various online platforms to conduct examination.pptx
Use of various online platforms to conduct examination.pptx
 
Computer manged learning and problems code 8620 bed
Computer manged learning and problems code 8620 bedComputer manged learning and problems code 8620 bed
Computer manged learning and problems code 8620 bed
 
Screening and Enrollment Faculty Development Model - Competency-Based Education
Screening and Enrollment Faculty Development Model - Competency-Based EducationScreening and Enrollment Faculty Development Model - Competency-Based Education
Screening and Enrollment Faculty Development Model - Competency-Based Education
 
Science-Writing-Effective-MCQs-Workshop-Nov2020.pptx
Science-Writing-Effective-MCQs-Workshop-Nov2020.pptxScience-Writing-Effective-MCQs-Workshop-Nov2020.pptx
Science-Writing-Effective-MCQs-Workshop-Nov2020.pptx
 
Review the video The Performance Review Process” then answer the .docx
Review the video The Performance Review Process” then answer the .docxReview the video The Performance Review Process” then answer the .docx
Review the video The Performance Review Process” then answer the .docx
 
Mulligan97 (1)
Mulligan97 (1)Mulligan97 (1)
Mulligan97 (1)
 
Computer- Based Assessment.pptx
Computer- Based Assessment.pptxComputer- Based Assessment.pptx
Computer- Based Assessment.pptx
 
ITC12 Pre-conference Workshop: Evaluating Online Faculty2-slideshare
ITC12 Pre-conference Workshop: Evaluating Online Faculty2-slideshareITC12 Pre-conference Workshop: Evaluating Online Faculty2-slideshare
ITC12 Pre-conference Workshop: Evaluating Online Faculty2-slideshare
 
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
 
Professional development in MCQ writing
Professional development in MCQ writingProfessional development in MCQ writing
Professional development in MCQ writing
 
Competency-based Education Overview - Brightspace
Competency-based Education Overview - BrightspaceCompetency-based Education Overview - Brightspace
Competency-based Education Overview - Brightspace
 
RIDE 2010 presentation - Using interactive computer-based assessment to suppo...
RIDE 2010 presentation - Using interactive computer-based assessment to suppo...RIDE 2010 presentation - Using interactive computer-based assessment to suppo...
RIDE 2010 presentation - Using interactive computer-based assessment to suppo...
 
T pi he workshop 3
T pi he workshop 3T pi he workshop 3
T pi he workshop 3
 
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMSTHE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
 

More from Jon Rosewell

Remote practical-focused tutorials
Remote practical-focused tutorialsRemote practical-focused tutorials
Remote practical-focused tutorialsJon Rosewell
 
OpenStudio and Digital Photography: creating and sharing better images
OpenStudio and Digital Photography: creating and sharing better imagesOpenStudio and Digital Photography: creating and sharing better images
OpenStudio and Digital Photography: creating and sharing better imagesJon Rosewell
 
Quality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelQuality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelJon Rosewell
 
Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)Jon Rosewell
 
Remote practical-focused tutorials (eSTEeM Conference 2017)
Remote practical-focused tutorials (eSTEeM Conference 2017)Remote practical-focused tutorials (eSTEeM Conference 2017)
Remote practical-focused tutorials (eSTEeM Conference 2017)Jon Rosewell
 
Robot explorers: Gender and group attitudes to STEM: a pilot evaluation of an...
Robot explorers: Gender and group attitudes to STEM: a pilot evaluation of an...Robot explorers: Gender and group attitudes to STEM: a pilot evaluation of an...
Robot explorers: Gender and group attitudes to STEM: a pilot evaluation of an...Jon Rosewell
 
How to benchmark quality in MOOCs - the OpenupEd label
How to benchmark quality in MOOCs  - the OpenupEd labelHow to benchmark quality in MOOCs  - the OpenupEd label
How to benchmark quality in MOOCs - the OpenupEd labelJon Rosewell
 
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)Jon Rosewell
 
MOOCs and Quality Issues
MOOCs and Quality IssuesMOOCs and Quality Issues
MOOCs and Quality IssuesJon Rosewell
 
A speculation on the possible use of badges for learning at the UK Open Unive...
A speculation on the possible use of badges for learning at the UK Open Unive...A speculation on the possible use of badges for learning at the UK Open Unive...
A speculation on the possible use of badges for learning at the UK Open Unive...Jon Rosewell
 
Badges for Nature (HASTAC/DML proposal)
Badges for Nature (HASTAC/DML proposal)Badges for Nature (HASTAC/DML proposal)
Badges for Nature (HASTAC/DML proposal)Jon Rosewell
 
Next Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-LearningNext Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-LearningJon Rosewell
 
Can computer-marked final assessment improve retention?
Can computer-marked final assessment improve retention?Can computer-marked final assessment improve retention?
Can computer-marked final assessment improve retention?Jon Rosewell
 
Badges for informal learning
Badges for informal learningBadges for informal learning
Badges for informal learningJon Rosewell
 
iSpot mobile developments
iSpot mobile developmentsiSpot mobile developments
iSpot mobile developmentsJon Rosewell
 
ISpot Bayesian keys
ISpot Bayesian keysISpot Bayesian keys
ISpot Bayesian keysJon Rosewell
 
QA in e-Learning and Open Educational Resources (OER)
QA in e-Learning and Open Educational Resources (OER)QA in e-Learning and Open Educational Resources (OER)
QA in e-Learning and Open Educational Resources (OER)Jon Rosewell
 
Exploring Web 2.0 to support online learning communities: where technology me...
Exploring Web 2.0 to support online learning communities: where technology me...Exploring Web 2.0 to support online learning communities: where technology me...
Exploring Web 2.0 to support online learning communities: where technology me...Jon Rosewell
 
Equitability and Dominance in Online Forums: An Ecological Approach
Equitability and Dominance in Online Forums: An Ecological ApproachEquitability and Dominance in Online Forums: An Ecological Approach
Equitability and Dominance in Online Forums: An Ecological ApproachJon Rosewell
 
Robot Treasure Hunt
Robot Treasure HuntRobot Treasure Hunt
Robot Treasure HuntJon Rosewell
 

More from Jon Rosewell (20)

Remote practical-focused tutorials
Remote practical-focused tutorialsRemote practical-focused tutorials
Remote practical-focused tutorials
 
OpenStudio and Digital Photography: creating and sharing better images
OpenStudio and Digital Photography: creating and sharing better imagesOpenStudio and Digital Photography: creating and sharing better images
OpenStudio and Digital Photography: creating and sharing better images
 
Quality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelQuality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality label
 
Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)
 
Remote practical-focused tutorials (eSTEeM Conference 2017)
Remote practical-focused tutorials (eSTEeM Conference 2017)Remote practical-focused tutorials (eSTEeM Conference 2017)
Remote practical-focused tutorials (eSTEeM Conference 2017)
 
Robot explorers: Gender and group attitudes to STEM: a pilot evaluation of an...
Robot explorers: Gender and group attitudes to STEM: a pilot evaluation of an...Robot explorers: Gender and group attitudes to STEM: a pilot evaluation of an...
Robot explorers: Gender and group attitudes to STEM: a pilot evaluation of an...
 
How to benchmark quality in MOOCs - the OpenupEd label
How to benchmark quality in MOOCs  - the OpenupEd labelHow to benchmark quality in MOOCs  - the OpenupEd label
How to benchmark quality in MOOCs - the OpenupEd label
 
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
Next steps for excellence in the quality of e-learning (EADTU Paris masterclass)
 
MOOCs and Quality Issues
MOOCs and Quality IssuesMOOCs and Quality Issues
MOOCs and Quality Issues
 
A speculation on the possible use of badges for learning at the UK Open Unive...
A speculation on the possible use of badges for learning at the UK Open Unive...A speculation on the possible use of badges for learning at the UK Open Unive...
A speculation on the possible use of badges for learning at the UK Open Unive...
 
Badges for Nature (HASTAC/DML proposal)
Badges for Nature (HASTAC/DML proposal)Badges for Nature (HASTAC/DML proposal)
Badges for Nature (HASTAC/DML proposal)
 
Next Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-LearningNext Steps for Excellence in the Quality of e-Learning
Next Steps for Excellence in the Quality of e-Learning
 
Can computer-marked final assessment improve retention?
Can computer-marked final assessment improve retention?Can computer-marked final assessment improve retention?
Can computer-marked final assessment improve retention?
 
Badges for informal learning
Badges for informal learningBadges for informal learning
Badges for informal learning
 
iSpot mobile developments
iSpot mobile developmentsiSpot mobile developments
iSpot mobile developments
 
ISpot Bayesian keys
ISpot Bayesian keysISpot Bayesian keys
ISpot Bayesian keys
 
QA in e-Learning and Open Educational Resources (OER)
QA in e-Learning and Open Educational Resources (OER)QA in e-Learning and Open Educational Resources (OER)
QA in e-Learning and Open Educational Resources (OER)
 
Exploring Web 2.0 to support online learning communities: where technology me...
Exploring Web 2.0 to support online learning communities: where technology me...Exploring Web 2.0 to support online learning communities: where technology me...
Exploring Web 2.0 to support online learning communities: where technology me...
 
Equitability and Dominance in Online Forums: An Ecological Approach
Equitability and Dominance in Online Forums: An Ecological ApproachEquitability and Dominance in Online Forums: An Ecological Approach
Equitability and Dominance in Online Forums: An Ecological Approach
 
Robot Treasure Hunt
Robot Treasure HuntRobot Treasure Hunt
Robot Treasure Hunt
 

Recently uploaded

BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
Micromeritics - Fundamental and Derived Properties of Powders
Micromeritics - Fundamental and Derived Properties of PowdersMicromeritics - Fundamental and Derived Properties of Powders
Micromeritics - Fundamental and Derived Properties of PowdersChitralekhaTherkar
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 
PSYCHIATRIC History collection FORMAT.pptx
PSYCHIATRIC   History collection FORMAT.pptxPSYCHIATRIC   History collection FORMAT.pptx
PSYCHIATRIC History collection FORMAT.pptxPoojaSen20
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxRoyAbrique
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfUmakantAnnand
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docxPoojaSen20
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppCeline George
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsKarinaGenton
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting DataJhengPantaleon
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Celine George
 

Recently uploaded (20)

BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Micromeritics - Fundamental and Derived Properties of Powders
Micromeritics - Fundamental and Derived Properties of PowdersMicromeritics - Fundamental and Derived Properties of Powders
Micromeritics - Fundamental and Derived Properties of Powders
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
PSYCHIATRIC History collection FORMAT.pptx
PSYCHIATRIC   History collection FORMAT.pptxPSYCHIATRIC   History collection FORMAT.pptx
PSYCHIATRIC History collection FORMAT.pptx
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.Compdf
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docx
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website App
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its Characteristics
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data_Math 4-Q4 Week 5.pptx Steps in Collecting Data
_Math 4-Q4 Week 5.pptx Steps in Collecting Data
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
 

Opening up multiple choice - assessing with confidence

  • 1. Opening up Multiple Choice: Assessing with confidence CALRG Conference, June 2011 Jon Rosewell [email_address]
  • 2.
  • 3.
  • 4.  
  • 5.
  • 6. CBM scoring Tentative & correct Confidently correct Cocksure – and wrong! Score -6 3 High -2 2 Medium 0 1 Low Wrong Correct Confidence
  • 7.
  • 8.
  • 9.  
  • 10.
  • 11.
  • 12.  
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.