QTI 2.1 and the Common Cartridge Niall S F Barr [email_address]

Background: The Common Cartridge Simple profile of IMS Content Packaging Contains: A single organization HTML web pages Forum placeholders Quizzes Itembanks LTI links (coming in version 1.1)

Simple profile of IMS Content Packaging

Contains:

A single organization

HTML web pages

Forum placeholders

Quizzes

Itembanks

LTI links (coming in version 1.1)

Background: CC 1.0 QTI A profile of QTI 1.2.1 One enhancement – regular expressions Six (really 3) item types: Multiple choice True/False Multiple Response Short text Essay Expression match Can be imported into legacy assessment systems

A profile of QTI 1.2.1

One enhancement – regular expressions

Six (really 3) item types:

Multiple choice

True/False

Multiple Response

Short text

Essay

Expression match

Can be imported into legacy assessment systems

A QTI 1.2.1 CC Item <item ident=&quot;QUE_104045&quot; title=&quot;Question 01&quot;> <!-- start multiplechoice --> <itemmetadata> <qtimetadata> <qtimetadatafield> <fieldlabel>cc_profile</fieldlabel> <fieldentry>cc.multiple_choice.v0p1</fieldentry> </qtimetadatafield> <qtimetadatafield> <fieldlabel>cc_question_category</fieldlabel> <fieldentry>Chapter 01</fieldentry> </qtimetadatafield> <qtimetadatafield> <fieldlabel>cc_weighting</fieldlabel> <fieldentry>2</fieldentry> </qtimetadatafield> </qtimetadata> </itemmetadata> <presentation> <material> <mattext texttype=&quot;text/html&quot;>Which of the following best defines psychology?</mattext> </material> <response_lid ident=&quot;QUE_104045_RL&quot; rcardinality=&quot;Single&quot;> <render_choice> <response_label ident=&quot;QUE_104045_A1&quot;> <material> <mattext texttype=&quot;text/html&quot;>the scientific study of behavior and mental processes</mattext> </material> </response_label> <response_label ident=&quot;QUE_104045_A2&quot;> <material> <mattext texttype=&quot;text/html&quot;>the science of mental and emotional disorder</mattext> </material> </response_label> <response_label ident=&quot;QUE_104045_A3&quot;> <material> <mattext texttype=&quot;text/html&quot;>the science of human and animal behavior</mattext> </material> </response_label> <response_label ident=&quot;QUE_104045_A4&quot;> <material> <mattext texttype=&quot;text/html&quot;>the study of actions and reactions</mattext> </material> </response_label> </render_choice> </response_lid> </presentation> <resprocessing> <outcomes> <decvar defaultval=&quot;0&quot; maxvalue=&quot;100&quot; varname=&quot;SCORE&quot; vartype=&quot;Integer&quot;/> </outcomes> <respcondition> <conditionvar> <varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A1</varequal> </conditionvar> <setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>100</setvar> <displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_1_IC&quot;/> <displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </respcondition> <respcondition> <conditionvar> <varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A2</varequal> </conditionvar> <setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>0</setvar> <displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_2_IC&quot;/> <displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </respcondition> <respcondition> <conditionvar> <varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A3</varequal> </conditionvar> <setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>0</setvar> <displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_3_IC&quot;/> <displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </respcondition> <respcondition> <conditionvar> <varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A4</varequal> </conditionvar> <setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>0</setvar> <displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_4_IC&quot;/> <displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </respcondition> <respcondition> <conditionvar> <other/> </conditionvar> <displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/> </respcondition> </resprocessing> <itemfeedback ident=&quot;QUE_104045_1_IC&quot;> <material> <mattext texttype=&quot;text/html&quot;/> </material> </itemfeedback> <itemfeedback ident=&quot;QUE_104045_2_IC&quot;> <material> <mattext texttype=&quot;text/html&quot;/> </material> </itemfeedback> <itemfeedback ident=&quot;QUE_104045_3_IC&quot;> <material> <mattext texttype=&quot;text/html&quot;/> </material> </itemfeedback> <itemfeedback ident=&quot;QUE_104045_4_IC&quot;> <material> <mattext texttype=&quot;text/html&quot;/> </material> </itemfeedback> <itemfeedback ident=&quot;QUE_104045_ALL&quot;> <material> <mattext texttype=&quot;text/html&quot;>Incorrect</mattext> </material> </itemfeedback> </item>

<item ident=&quot;QUE_104045&quot; title=&quot;Question 01&quot;>

<!-- start multiplechoice -->

<itemmetadata>

<qtimetadata>

<qtimetadatafield>

<fieldlabel>cc_profile</fieldlabel>

<fieldentry>cc.multiple_choice.v0p1</fieldentry>

</qtimetadatafield>

<qtimetadatafield>

<fieldlabel>cc_question_category</fieldlabel>

<fieldentry>Chapter 01</fieldentry>

</qtimetadatafield>

<qtimetadatafield>

<fieldlabel>cc_weighting</fieldlabel>

<fieldentry>2</fieldentry>

</qtimetadatafield>

</qtimetadata>

</itemmetadata>

<presentation>

<material>

<mattext texttype=&quot;text/html&quot;>Which of the following best defines psychology?</mattext>

</material>

<response_lid ident=&quot;QUE_104045_RL&quot; rcardinality=&quot;Single&quot;>

<render_choice>

<response_label ident=&quot;QUE_104045_A1&quot;>

<material>

<mattext texttype=&quot;text/html&quot;>the scientific study of behavior and mental processes</mattext>

</material>

</response_label>

<response_label ident=&quot;QUE_104045_A2&quot;>

<material>

<mattext texttype=&quot;text/html&quot;>the science of mental and emotional disorder</mattext>

</material>

</response_label>

<response_label ident=&quot;QUE_104045_A3&quot;>

<material>

<mattext texttype=&quot;text/html&quot;>the science of human and animal behavior</mattext>

</material>

</response_label>

<response_label ident=&quot;QUE_104045_A4&quot;>

<material>

<mattext texttype=&quot;text/html&quot;>the study of actions and reactions</mattext>

</material>

</response_label>

</render_choice>

</response_lid>

</presentation>

<resprocessing>

<outcomes>

<decvar defaultval=&quot;0&quot; maxvalue=&quot;100&quot; varname=&quot;SCORE&quot; vartype=&quot;Integer&quot;/>

</outcomes>

<respcondition>

<conditionvar>

<varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A1</varequal>

</conditionvar>

<setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>100</setvar>

<displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_1_IC&quot;/>

<displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/>

</respcondition>

<respcondition>

<conditionvar>

<varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A2</varequal>

</conditionvar>

<setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>0</setvar>

<displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_2_IC&quot;/>

<displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/>

</respcondition>

<respcondition>

<conditionvar>

<varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A3</varequal>

</conditionvar>

<setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>0</setvar>

<displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_3_IC&quot;/>

<displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/>

</respcondition>

<respcondition>

<conditionvar>

<varequal respident=&quot;QUE_104045_RL&quot;>QUE_104045_A4</varequal>

</conditionvar>

<setvar action=&quot;Set&quot; varname=&quot;SCORE&quot;>0</setvar>

<displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_4_IC&quot;/>

<displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/>

</respcondition>

<respcondition>

<conditionvar>

<other/>

</conditionvar>

<displayfeedback feedbacktype=&quot;Response&quot; linkrefid=&quot;QUE_104045_ALL&quot;/>

</respcondition>

</resprocessing>

<itemfeedback ident=&quot;QUE_104045_1_IC&quot;>

<material>

<mattext texttype=&quot;text/html&quot;/>

</material>

</itemfeedback>

<itemfeedback ident=&quot;QUE_104045_2_IC&quot;>

<material>

<mattext texttype=&quot;text/html&quot;/>

</material>

</itemfeedback>

<itemfeedback ident=&quot;QUE_104045_3_IC&quot;>

<material>

<mattext texttype=&quot;text/html&quot;/>

</material>

</itemfeedback>

<itemfeedback ident=&quot;QUE_104045_4_IC&quot;>

<material>

<mattext texttype=&quot;text/html&quot;/>

</material>

</itemfeedback>

<itemfeedback ident=&quot;QUE_104045_ALL&quot;>

<material>

<mattext texttype=&quot;text/html&quot;>Incorrect</mattext>

</material>

</itemfeedback>

</item>

Issues with QTI 1.2.1 CC Lots of redundant XML that is identical in each item Meta-data is needed to control presentation A 'correct' QTI 1.2.1 player will display feedback incorrectly It is QTI 1.2.1 – wasn't QTI 2.0 created because of issues with QTI 1.2.1?

Lots of redundant XML that is identical in each item

Meta-data is needed to control presentation

A 'correct' QTI 1.2.1 player will display feedback incorrectly

It is QTI 1.2.1 – wasn't QTI 2.0 created because of issues with QTI 1.2.1?

Issues with QTI 1.2.1 CC Lots of redundant XML that is identical in each item Meta-data is needed to control presentation A 'correct' QTI 1.2.1 player will display feedback incorrectly It is QTI 1.2.1 – wasn't QTI 2.0 created because of issues with QTI 1.2.1? However, commercial software publishers supported QTI 1.2.1 (sort of...)

Lots of redundant XML that is identical in each item

Meta-data is needed to control presentation

A 'correct' QTI 1.2.1 player will display feedback incorrectly

It is QTI 1.2.1 – wasn't QTI 2.0 created because of issues with QTI 1.2.1?

However, commercial software publishers supported QTI 1.2.1 (sort of...)

QTI 2.1 In many ways similar to QTI 1.2.1 Presentation section with text and interactions Response processing describes a marking system An in many ways different Variables declared at the start Presentation uses XHTML (and MathML) Interactions clearly defined 'Correct' value can be declared at the top. Several implementations with high degree of interoperability

In many ways similar to QTI 1.2.1

Presentation section with text and interactions

Response processing describes a marking system

An in many ways different

Variables declared at the start

Presentation uses XHTML (and MathML)

Interactions clearly defined

'Correct' value can be declared at the top.

Several implementations with high degree of interoperability

Issues for the Common Cartridge Common Cartridge has to be reasonably easy to implement – Importing items, not interpreting or compiling them. Response processing has to stick to very simple rules. Feedback has to accommodate different styles (option specific or just correct/incorrect)

Common Cartridge has to be reasonably easy to implement –

Importing items, not interpreting or compiling them.

Response processing has to stick to very simple rules.

Feedback has to accommodate different styles (option specific or just correct/incorrect)

QTI 2.1 actually can do this! Response processing templates specifically designed to address the issue of simple systems 'Correct' values (mappings) are closer to simple formats Just a few extra rules needed Only use 'template' response processing One interaction only Non- adaptive Fixed names for feedback variables Simplest possible assessments and itembanks

Response processing templates specifically designed to address the issue of simple systems

'Correct' values (mappings) are closer to simple formats

Just a few extra rules needed

Only use 'template' response processing

One interaction only

Non- adaptive

Fixed names for feedback variables

Simplest possible assessments and itembanks

QTI 2.1 actually can do this! <?xml version=&quot;1.0&quot; encoding=&quot;utf-8&quot;?> <assessmentItem xmlns=&quot;http://www.imsglobal.org/xsd/imsqti_v2p1&quot; xmlns:xsi=&quot;http://www.w3.org/2001/XMLSchema-instance&quot; xsi:schemaLocation=&quot;http://www.imsglobal.org/xsd/imsqti_v2p1 imsqti_v2p1.xsd&quot; identifier=&quot;Choice_example_01&quot; title=&quot;Choice 1&quot; adaptive=&quot;false&quot; timeDependent=&quot;false&quot;> <responseDeclaration identifier=&quot;RESPONSE&quot; cardinality=&quot;single&quot; baseType=&quot;identifier&quot;> <correctResponse> <value>QUE_104045_A1</value> </correctResponse> </responseDeclaration> <outcomeDeclaration identifier=&quot;SCORE&quot; cardinality=&quot;single&quot; baseType=&quot;integer&quot;> <defaultValue> <value>0</value> </defaultValue> </outcomeDeclaration> <outcomeDeclaration identifier=&quot;FEEDBACK&quot; cardinality=&quot;single&quot; baseType=&quot;identifier&quot;/> <outcomeDeclaration identifier=&quot;FEEDBACKBASIC&quot; cardinality=&quot;single&quot; baseType=&quot;identifier&quot;/> <outcomeDeclaration identifier=&quot;MAXSCORE&quot; cardinality=&quot;single&quot; baseType=&quot;integer&quot;> <defaultValue> <value>100</value> </defaultValue> </outcomeDeclaration> <itemBody> <choiceInteraction responseIdentifier=&quot;RESPONSE&quot; shuffle=&quot;false&quot; maxChoices=&quot;1&quot;> <prompt>Which of the following best defines psycology?</prompt> <simpleChoice identifier=&quot;QUE_104045_A1&quot;>the scientific study of behaviour and mental processes <feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A1&quot;>Yes, that is correct, well Done</feedbackInline> </simpleChoice> <simpleChoice identifier=&quot;QUE_104045_A2&quot;>the science of mental and emotional disorder <feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A2&quot;>No psycology is not only about disorder, the correct answer is &quot;the scientific study of behaviour and mental processes</feedbackInline> </simpleChoice> <simpleChoice identifier=&quot;QUE_104045_A3&quot;>the science of human and animal behaviour <feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A3&quot;>No psycology also covers the processes underlying behaviour, the correct answer is &quot;the scientific study of behaviour and mental processes</feedbackInline> </simpleChoice> <simpleChoice identifier=&quot;QUE_104045_A4&quot;>the study of actions and reactions <feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A4&quot;>No that answer is too vague, the correct answer is &quot;the scientific study of behaviour and mental processes</feedbackInline> </simpleChoice> </choiceInteraction> <div id=&quot;hintcontainer&quot;><a href='#' OnClick=&quot;javascript:document.getElementById('hint').style.visibility = 'visible';&quot;>Hint: </a> <div id=&quot;hint&quot; style=&quot;visibility:hidden;&quot;>This is the hint.</div></div> </itemBody> <responseProcessing template=&quot;CC2_match&quot;/> <modalFeedback outcomeIdentifier=&quot;FEEDBACKBASIC&quot; showHide=&quot;show&quot; identifier=&quot;correct&quot;>Well done!</modalFeedback> <modalFeedback outcomeIdentifier=&quot;FEEDBACKBASIC&quot; showHide=&quot;show&quot; identifier=&quot;incorrect&quot;>No, the correct answer is &quot;the scientific study of behaviour and mental processes&quot;.</modalFeedback> </assessmentItem>

<?xml version=&quot;1.0&quot; encoding=&quot;utf-8&quot;?>

<assessmentItem xmlns=&quot;http://www.imsglobal.org/xsd/imsqti_v2p1&quot; xmlns:xsi=&quot;http://www.w3.org/2001/XMLSchema-instance&quot; xsi:schemaLocation=&quot;http://www.imsglobal.org/xsd/imsqti_v2p1 imsqti_v2p1.xsd&quot; identifier=&quot;Choice_example_01&quot; title=&quot;Choice 1&quot; adaptive=&quot;false&quot; timeDependent=&quot;false&quot;>

<responseDeclaration identifier=&quot;RESPONSE&quot; cardinality=&quot;single&quot; baseType=&quot;identifier&quot;>

<correctResponse>

<value>QUE_104045_A1</value>

</correctResponse>

</responseDeclaration>

<outcomeDeclaration identifier=&quot;SCORE&quot; cardinality=&quot;single&quot; baseType=&quot;integer&quot;>

<defaultValue>

<value>0</value>

</defaultValue>

</outcomeDeclaration>

<outcomeDeclaration identifier=&quot;FEEDBACK&quot; cardinality=&quot;single&quot; baseType=&quot;identifier&quot;/>

<outcomeDeclaration identifier=&quot;FEEDBACKBASIC&quot; cardinality=&quot;single&quot; baseType=&quot;identifier&quot;/>

<outcomeDeclaration identifier=&quot;MAXSCORE&quot; cardinality=&quot;single&quot; baseType=&quot;integer&quot;>

<defaultValue>

<value>100</value>

</defaultValue>

</outcomeDeclaration>

<itemBody>

<choiceInteraction responseIdentifier=&quot;RESPONSE&quot; shuffle=&quot;false&quot; maxChoices=&quot;1&quot;>

<prompt>Which of the following best defines

psycology?</prompt>

<simpleChoice identifier=&quot;QUE_104045_A1&quot;>the scientific study

of behaviour and mental processes

<feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A1&quot;>Yes, that is correct, well

Done</feedbackInline>

</simpleChoice>

<simpleChoice identifier=&quot;QUE_104045_A2&quot;>the science of

mental and emotional disorder

<feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A2&quot;>No psycology is not only about disorder, the correct answer is &quot;the

scientific study of behaviour and mental

processes</feedbackInline>

</simpleChoice>

<simpleChoice identifier=&quot;QUE_104045_A3&quot;>the science of human

and animal behaviour

<feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A3&quot;>No psycology also covers the processes underlying behaviour, the correct answer is &quot;the

scientific study of behaviour and mental

processes</feedbackInline>

</simpleChoice>

<simpleChoice identifier=&quot;QUE_104045_A4&quot;>the study of actions

and reactions

<feedbackInline outcomeIdentifier=&quot;FEEDBACK&quot; showHide=&quot;show&quot; identifier=&quot;QUE_104045_A4&quot;>No that answer is too vague, the correct answer is &quot;the

scientific study of behaviour and mental

processes</feedbackInline>

</simpleChoice>

</choiceInteraction>

<div id=&quot;hintcontainer&quot;><a href='#' OnClick=&quot;javascript:document.getElementById('hint').style.visibility = 'visible';&quot;>Hint: </a>

<div id=&quot;hint&quot; style=&quot;visibility:hidden;&quot;>This is the hint.</div></div>

</itemBody>

<responseProcessing template=&quot;CC2_match&quot;/>

<modalFeedback outcomeIdentifier=&quot;FEEDBACKBASIC&quot; showHide=&quot;show&quot; identifier=&quot;correct&quot;>Well done!</modalFeedback>

<modalFeedback outcomeIdentifier=&quot;FEEDBACKBASIC&quot; showHide=&quot;show&quot; identifier=&quot;incorrect&quot;>No, the correct answer is &quot;the scientific

study of behaviour and mental processes&quot;.</modalFeedback>

</assessmentItem>

A few minor changes Case insensitive mapping and mapping to regular expressions <mapEntry mapKey=&quot;^hierarchys*need$&quot; mappedValue=&quot;50&quot; caseSensitive=&quot;false&quot; mapIsRegex=&quot;true&quot;/> New response processing templates Standard (preferred) feedback and simple feedback variations A no-penalty feedback system (that doesn't require an adaptive item)

Case insensitive mapping and mapping to regular expressions <mapEntry mapKey=&quot;^hierarchys*need$&quot; mappedValue=&quot;50&quot; caseSensitive=&quot;false&quot; mapIsRegex=&quot;true&quot;/>

New response processing templates

Standard (preferred) feedback and simple feedback variations

A no-penalty feedback system (that doesn't require an adaptive item)

A few minor changes Case insensitive mapping and mapping to regular expressions <mapEntry mapKey=&quot;^hierarchys*need$&quot; mappedValue=&quot;50&quot; caseSensitive=&quot;false&quot; mapIsRegex=&quot;true&quot;/> New response processing templates Standard (preferred) feedback and simple feedback variations A no-penalty feedback system (that doesn't require an adaptive item) Will be adopted by Common Cartridge 1.2

Case insensitive mapping and mapping to regular expressions <mapEntry mapKey=&quot;^hierarchys*need$&quot; mappedValue=&quot;50&quot; caseSensitive=&quot;false&quot; mapIsRegex=&quot;true&quot;/>

New response processing templates

Standard (preferred) feedback and simple feedback variations

A no-penalty feedback system (that doesn't require an adaptive item)

Will be adopted by Common Cartridge 1.2

The future QTI 2.1 is in a very strong position It needs (one or two) profiles It needs more examples Maybe it needs better documentation...

QTI 2.1 is in a very strong position

It needs (one or two) profiles

It needs more examples

Maybe it needs better documentation...