QTI 2.1 and Common Cartridge

1,855 views

Published on

Latest developments in QTI and Common Cartridge by Niall Barr.

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,855
On SlideShare
0
From Embeds
0
Number of Embeds
11
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

QTI 2.1 and Common Cartridge

  1. 1. QTI 2.1 and the Common Cartridge Niall S F Barr [email_address]
  2. 2. Background: The Common Cartridge <ul><li>Simple profile of IMS Content Packaging </li></ul><ul><li>Contains: </li></ul><ul><ul><li>A single organization </li></ul></ul><ul><ul><li>HTML web pages </li></ul></ul><ul><ul><li>Forum placeholders </li></ul></ul><ul><ul><li>Quizzes </li></ul></ul><ul><ul><li>Itembanks </li></ul></ul><ul><ul><li>LTI links (coming in version 1.1) </li></ul></ul>
  3. 3. Background: CC 1.0 QTI <ul><li>A profile of QTI 1.2.1 </li></ul><ul><li>One enhancement – regular expressions </li></ul><ul><li>Six (really 3) item types: </li></ul><ul><ul><li>Multiple choice </li></ul></ul><ul><ul><li>True/False </li></ul></ul><ul><ul><li>Multiple Response </li></ul></ul><ul><ul><li>Short text </li></ul></ul><ul><ul><li>Essay </li></ul></ul><ul><ul><li>Expression match </li></ul></ul><ul><li>Can be imported into legacy assessment systems </li></ul>
  4. 4. A QTI 1.2.1 CC Item <ul><li><item ident=&quot;QUE_104045&quot; title=&quot;Question 01&quot;> </li></ul><ul><li><!-- start multiplechoice --> </li></ul><ul><li><itemmetadata> </li></ul><ul><li><qtimetadata> </li></ul><ul><li><qtimetadatafield> </li></ul><ul><li><fieldlabel>cc_profile</fieldlabel> </li></ul><ul><li><fieldentry>cc.multiple_choice.v0p1</fieldentry> </li></ul><ul><li></qtimetadatafield> </li></ul><ul><li><qtimetadatafield> </li></ul><ul><li><fieldlabel>cc_question_category</fieldlabel> </li></ul><ul><li><fieldentry>Chapter 01</fieldentry> </li></ul><ul><li></qtimetadatafield> </li></ul><ul><li><qtimetadatafield> </li></ul><ul><li><fieldlabel>cc_weighting</fieldlabel> </li></ul><ul><li><fieldentry>2</fieldentry> </li></ul><ul><li></qtimetadatafield> </li></ul><ul><li></qtimetadata> </li></ul><ul><li></itemmetadata> </li></ul><ul><li><presentation> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;>Which of the following best defines psychology?</mattext> </li></ul><ul><li></material> </li></ul><ul><li><response_lid ident=&quot;QUE_104045_RL&quot; rcardinality=&quot;Single&quot;> </li></ul><ul><li><render_choice> </li></ul><ul><li><response_label ident=&quot;QUE_104045_A1&quot;> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;>the scientific study of behavior and mental processes</mattext> </li></ul><ul><li></material> </li></ul><ul><li></response_label> </li></ul><ul><li><response_label ident=&quot;QUE_104045_A2&quot;> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;>the science of mental and emotional disorder</mattext> </li></ul><ul><li></material> </li></ul><ul><li></response_label> </li></ul><ul><li><response_label ident=&quot;QUE_104045_A3&quot;> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;>the science of human and animal behavior</mattext> </li></ul><ul><li></material> </li></ul><ul><li></response_label> </li></ul><ul><li><response_label ident=&quot;QUE_104045_A4&quot;> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;>the study of actions and reactions</mattext> </li></ul><ul><li></material> </li></ul><ul><li></response_label> </li></ul><ul><li></render_choice> </li></ul><ul><li></response_lid> </li></ul><ul><li></presentation> </li></ul><ul><li><resprocessing> </li></ul><ul><li><outcomes> </li></ul><ul><li><decvar defaultval=&quot;0&quot; maxvalue=&quot;100&quot; varname=&quot;SCORE&quot; vartype=&quot;Integer&quot;/> </li></ul><ul><li></outcomes> </li></ul><ul><li><respcondition> </li></ul><ul><li><conditionvar> </li></ul><ul><li><varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A1</varequal> </li></ul><ul><li></conditionvar> </li></ul><ul><li><setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>100</setvar> </li></ul><ul><li><displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_1_IC&quot;/> </li></ul><ul><li><displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </li></ul><ul><li></respcondition> </li></ul><ul><li><respcondition> </li></ul><ul><li><conditionvar> </li></ul><ul><li><varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A2</varequal> </li></ul><ul><li></conditionvar> </li></ul><ul><li><setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>0</setvar> </li></ul><ul><li><displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_2_IC&quot;/> </li></ul><ul><li><displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </li></ul><ul><li></respcondition> </li></ul><ul><li><respcondition> </li></ul><ul><li><conditionvar> </li></ul><ul><li><varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A3</varequal> </li></ul><ul><li></conditionvar> </li></ul><ul><li><setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>0</setvar> </li></ul><ul><li><displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_3_IC&quot;/> </li></ul><ul><li><displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </li></ul><ul><li></respcondition> </li></ul><ul><li><respcondition> </li></ul><ul><li><conditionvar> </li></ul><ul><li><varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A4</varequal> </li></ul><ul><li></conditionvar> </li></ul><ul><li><setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>0</setvar> </li></ul><ul><li><displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_4_IC&quot;/> </li></ul><ul><li><displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </li></ul><ul><li></respcondition> </li></ul><ul><li><respcondition> </li></ul><ul><li><conditionvar> </li></ul><ul><li><other/> </li></ul><ul><li></conditionvar> </li></ul><ul><li><displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </li></ul><ul><li></respcondition> </li></ul><ul><li></resprocessing> </li></ul><ul><li><itemfeedback ident=&quot;QUE_104045_1_IC&quot;> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;/> </li></ul><ul><li></material> </li></ul><ul><li></itemfeedback> </li></ul><ul><li><itemfeedback ident=&quot;QUE_104045_2_IC&quot;> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;/> </li></ul><ul><li></material> </li></ul><ul><li></itemfeedback> </li></ul><ul><li><itemfeedback ident=&quot;QUE_104045_3_IC&quot;> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;/> </li></ul><ul><li></material> </li></ul><ul><li></itemfeedback> </li></ul><ul><li><itemfeedback ident=&quot;QUE_104045_4_IC&quot;> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;/> </li></ul><ul><li></material> </li></ul><ul><li></itemfeedback> </li></ul><ul><li><itemfeedback ident=&quot;QUE_104045_ALL&quot;> </li></ul><ul><li><material> </li></ul><ul><li><mattext texttype=&quot;text/html&quot;>Incorrect</mattext> </li></ul><ul><li></material> </li></ul><ul><li></itemfeedback> </li></ul><ul><li></item> </li></ul>
  5. 5. Issues with QTI 1.2.1 CC <ul><li>Lots of redundant XML that is identical in each item </li></ul><ul><li>Meta-data is needed to control presentation </li></ul><ul><li>A 'correct' QTI 1.2.1 player will display feedback incorrectly </li></ul><ul><li>It is QTI 1.2.1 – wasn't QTI 2.0 created because of issues with QTI 1.2.1? </li></ul>
  6. 6. Issues with QTI 1.2.1 CC <ul><li>Lots of redundant XML that is identical in each item </li></ul><ul><li>Meta-data is needed to control presentation </li></ul><ul><li>A 'correct' QTI 1.2.1 player will display feedback incorrectly </li></ul><ul><li>It is QTI 1.2.1 – wasn't QTI 2.0 created because of issues with QTI 1.2.1? </li></ul><ul><li>However, commercial software publishers supported QTI 1.2.1 (sort of...) </li></ul>
  7. 7. QTI 2.1 <ul><li>In many ways similar to QTI 1.2.1 </li></ul><ul><ul><li>Presentation section with text and interactions </li></ul></ul><ul><ul><li>Response processing describes a marking system </li></ul></ul><ul><li>An in many ways different </li></ul><ul><ul><li>Variables declared at the start </li></ul></ul><ul><ul><li>Presentation uses XHTML (and MathML) </li></ul></ul><ul><ul><li>Interactions clearly defined </li></ul></ul><ul><ul><li>'Correct' value can be declared at the top. </li></ul></ul><ul><li>Several implementations with high degree of interoperability </li></ul>
  8. 8. Issues for the Common Cartridge <ul><li>Common Cartridge has to be reasonably easy to implement – </li></ul><ul><ul><li>Importing items, not interpreting or compiling them. </li></ul></ul><ul><ul><li>Response processing has to stick to very simple rules. </li></ul></ul><ul><ul><li>Feedback has to accommodate different styles (option specific or just correct/incorrect) </li></ul></ul>
  9. 9. QTI 2.1 actually can do this! <ul><li>Response processing templates specifically designed to address the issue of simple systems </li></ul><ul><li>'Correct' values (mappings) are closer to simple formats </li></ul><ul><li>Just a few extra rules needed </li></ul><ul><ul><li>Only use 'template' response processing </li></ul></ul><ul><ul><li>One interaction only </li></ul></ul><ul><ul><li>Non- adaptive </li></ul></ul><ul><ul><li>Fixed names for feedback variables </li></ul></ul><ul><ul><li>Simplest possible assessments and itembanks </li></ul></ul>
  10. 10. QTI 2.1 actually can do this! <ul><li><?xml version=&quot;1.0&quot; encoding=&quot;utf-8&quot;?> </li></ul><ul><li><assessmentItem xmlns=&quot;http://www.imsglobal.org/xsd/imsqti_v2p1&quot; xmlns:xsi=&quot;http://www.w3.org/2001/XMLSchema-instance&quot; xsi:schemaLocation=&quot;http://www.imsglobal.org/xsd/imsqti_v2p1 imsqti_v2p1.xsd&quot; identifier=&quot;Choice_example_01&quot; title=&quot;Choice 1&quot; adaptive=&quot;false&quot; timeDependent=&quot;false&quot;> </li></ul><ul><li><responseDeclaration identifier=&quot;RESPONSE&quot; cardinality=&quot;single&quot; baseType=&quot;identifier&quot;> </li></ul><ul><li><correctResponse> </li></ul><ul><li><value>QUE_104045_A1</value> </li></ul><ul><li></correctResponse> </li></ul><ul><li></responseDeclaration> </li></ul><ul><li><outcomeDeclaration identifier=&quot;SCORE&quot; cardinality=&quot;single&quot; baseType=&quot;integer&quot;> </li></ul><ul><li><defaultValue> </li></ul><ul><li><value>0</value> </li></ul><ul><li></defaultValue> </li></ul><ul><li></outcomeDeclaration> </li></ul><ul><li><outcomeDeclaration identifier=&quot;FEEDBACK&quot; cardinality=&quot;single&quot; baseType=&quot;identifier&quot;/> </li></ul><ul><li><outcomeDeclaration identifier=&quot;FEEDBACKBASIC&quot; cardinality=&quot;single&quot; baseType=&quot;identifier&quot;/> </li></ul><ul><li><outcomeDeclaration identifier=&quot;MAXSCORE&quot; cardinality=&quot;single&quot; baseType=&quot;integer&quot;> </li></ul><ul><li><defaultValue> </li></ul><ul><li><value>100</value> </li></ul><ul><li></defaultValue> </li></ul><ul><li></outcomeDeclaration> </li></ul><ul><li><itemBody> </li></ul><ul><li><choiceInteraction responseIdentifier=&quot;RESPONSE&quot; shuffle=&quot;false&quot; maxChoices=&quot;1&quot;> </li></ul><ul><li><prompt>Which of the following best defines </li></ul><ul><li>psycology?</prompt> </li></ul><ul><li><simpleChoice identifier=&quot;QUE_104045_A1&quot;>the scientific study </li></ul><ul><li>of behaviour and mental processes </li></ul><ul><li><feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A1&quot;>Yes, that is correct, well </li></ul><ul><li>Done</feedbackInline> </li></ul><ul><li></simpleChoice> </li></ul><ul><li><simpleChoice identifier=&quot;QUE_104045_A2&quot;>the science of </li></ul><ul><li>mental and emotional disorder </li></ul><ul><li><feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A2&quot;>No psycology is not only about disorder, the correct answer is &quot;the </li></ul><ul><li>scientific study of behaviour and mental </li></ul><ul><li>processes</feedbackInline> </li></ul><ul><li></simpleChoice> </li></ul><ul><li><simpleChoice identifier=&quot;QUE_104045_A3&quot;>the science of human </li></ul><ul><li>and animal behaviour </li></ul><ul><li><feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A3&quot;>No psycology also covers the processes underlying behaviour, the correct answer is &quot;the </li></ul><ul><li>scientific study of behaviour and mental </li></ul><ul><li>processes</feedbackInline> </li></ul><ul><li></simpleChoice> </li></ul><ul><li><simpleChoice identifier=&quot;QUE_104045_A4&quot;>the study of actions </li></ul><ul><li>and reactions </li></ul><ul><li><feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A4&quot;>No that answer is too vague, the correct answer is &quot;the </li></ul><ul><li>scientific study of behaviour and mental </li></ul><ul><li>processes</feedbackInline> </li></ul><ul><li></simpleChoice> </li></ul><ul><li></choiceInteraction> </li></ul><ul><li><div id=&quot;hintcontainer&quot;><a href='#' OnClick=&quot;javascript:document.getElementById('hint').style.visibility = 'visible';&quot;>Hint: </a> </li></ul><ul><li><div id=&quot;hint&quot; style=&quot;visibility:hidden;&quot;>This is the hint.</div></div> </li></ul><ul><li></itemBody> </li></ul><ul><li><responseProcessing template=&quot;CC2_match&quot;/> </li></ul><ul><li><modalFeedback outcomeIdentifier=&quot;FEEDBACKBASIC&quot; showHide=&quot;show&quot; identifier=&quot;correct&quot;>Well done!</modalFeedback> </li></ul><ul><li><modalFeedback outcomeIdentifier=&quot;FEEDBACKBASIC&quot; showHide=&quot;show&quot; identifier=&quot;incorrect&quot;>No, the correct answer is &quot;the scientific </li></ul><ul><li>study of behaviour and mental processes&quot;.</modalFeedback> </li></ul><ul><li></assessmentItem> </li></ul>
  11. 11. A few minor changes <ul><li>Case insensitive mapping and mapping to regular expressions <mapEntry mapKey=&quot;^hierarchys*need$&quot; mappedValue=&quot;50&quot; caseSensitive=&quot;false&quot; mapIsRegex=&quot;true&quot;/> </li></ul><ul><li>New response processing templates </li></ul><ul><ul><li>Standard (preferred) feedback and simple feedback variations </li></ul></ul><ul><li>A no-penalty feedback system (that doesn't require an adaptive item) </li></ul>
  12. 12. A few minor changes <ul><li>Case insensitive mapping and mapping to regular expressions <mapEntry mapKey=&quot;^hierarchys*need$&quot; mappedValue=&quot;50&quot; caseSensitive=&quot;false&quot; mapIsRegex=&quot;true&quot;/> </li></ul><ul><li>New response processing templates </li></ul><ul><ul><li>Standard (preferred) feedback and simple feedback variations </li></ul></ul><ul><li>A no-penalty feedback system (that doesn't require an adaptive item) </li></ul><ul><li>Will be adopted by Common Cartridge 1.2 </li></ul>
  13. 13. The future <ul><li>QTI 2.1 is in a very strong position </li></ul><ul><ul><li>It needs (one or two) profiles </li></ul></ul><ul><ul><li>It needs more examples </li></ul></ul><ul><ul><li>Maybe it needs better documentation... </li></ul></ul>

×