Math Assess Demo 20090130


Published on

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Leslie
  • Math Assess Demo 20090130

    1. 1. MathAssess Maths in QTI MathAssess is a JISC Demonstrator project
    2. 2. Partners <ul><li>Liverpool John Moores University </li></ul><ul><ul><li>plus Graham Smith and Sue Milne </li></ul></ul><ul><li>University of Glasgow </li></ul><ul><li>University of Portsmouth </li></ul><ul><li>University of Edinburgh - SnuggleTeX </li></ul><ul><li>Kingston University - AQuRate </li></ul><ul><li>University of Southampton - ASDEL </li></ul><ul><li>University of Cambridge - Minibix </li></ul>
    3. 3. Item and Test Use Cases <ul><li>Item Author </li></ul><ul><li>Author questions </li></ul><ul><li>Edit questions </li></ul><ul><li>Store questions </li></ul><ul><li>Student </li></ul><ul><li>Attempt questions </li></ul><ul><li>Get new questions </li></ul><ul><li>Take tests </li></ul><ul><li>Test Constructor </li></ul><ul><li>Construct tests </li></ul><ul><li>Store tests </li></ul><ul><li>Tutor </li></ul><ul><li>Assign tests </li></ul><ul><li>Administer tests </li></ul>
    4. 4. Now add Maths... <ul><li>We must be able to: </li></ul><ul><li>Display maths expressions </li></ul><ul><li>Manipulate maths expressions </li></ul><ul><li>Create randomised items, i.e. use templates </li></ul><ul><li>Compare input and expected answer algebraically, not just string matching </li></ul>...and there’s more!
    5. 5. The finer points... <ul><ul><ul><li>templateProcessing </li></ul></ul></ul><ul><ul><li>Compute mathematical values (in more complex ways than standard QTI allows) </li></ul></ul><ul><ul><li>Use a Computer Algebra System (CAS) </li></ul></ul><ul><ul><li>Do not (usually) select from “canned” examples </li></ul></ul><ul><ul><li>Set default values and constants as maths expressions </li></ul></ul><ul><ul><ul><li>responseProcessing </li></ul></ul></ul><ul><ul><li>Compare variables with mathematical values algebraically: </li></ul></ul><ul><ul><ul><li>Equal? Equivalent? Greater/Less? </li></ul></ul></ul><ul><ul><li>Compare expressions involving mathematical variables: </li></ul></ul><ul><ul><ul><li>Functions, Coefficients, Terms </li></ul></ul></ul><ul><ul><ul><li>Feedback </li></ul></ul></ul><ul><ul><li>Target student errors – “coeff of is incorrect” </li></ul></ul><ul><ul><li>Use mathematical variables in feedback </li></ul></ul>
    6. 6. What does a Maths Variable look like? <ul><li>It must have </li></ul><ul><li>Visual form </li></ul><ul><ul><li>expressions are displayed as mathematics </li></ul></ul><ul><li>Semantic meaning </li></ul><ul><ul><li>expressions can be manipulated </li></ul></ul><ul><li>Input form for students </li></ul><ul><ul><li>as “natural” as possible </li></ul></ul><ul><li>Input form for authors </li></ul><ul><ul><li>expresses meaning and hence appearance </li></ul></ul><ul><li>So the variable contains </li></ul><ul><li>Presentation MathML </li></ul><ul><li>annotated with </li></ul><ul><li>Content MathML </li></ul><ul><li>CAS code – Maxima </li></ul><ul><li>Input string - ASCIIMathML </li></ul><ul><ul><li>(if any) </li></ul></ul><ul><li>CAS code – Maxima </li></ul><ul><ul><li>used in authoring (if any) </li></ul></ul>
    7. 7. Using CAS <ul><li>For </li></ul><ul><li>Computing groups of maths expressions </li></ul><ul><li>Computing a single maths expression </li></ul><ul><li>Comparing two expressions (variables of baseValues) </li></ul><ul><li>Evaluating a condition </li></ul><ul><li>customOperator </li></ul><ul><li>scriptRule </li></ul><ul><li>casProcess </li></ul><ul><li>casCompare </li></ul><ul><li>casCondition </li></ul>customOperators all use Maxima CAS. All can be used in template and response processing.
    8. 8. SnuggleTeX & ASCIIMathML <ul><li>SnuggleTeX converts: </li></ul><ul><ul><li>LaTeX to XHTML and MathML </li></ul></ul><ul><ul><li>PMathML to CMathML </li></ul></ul><ul><ul><li>CMathML to CAS code (Maxima) </li></ul></ul><ul><li>ASCIIMathML converts </li></ul><ul><li>String input to </li></ul><ul><ul><li>(slightly strange) PMathML </li></ul></ul><ul><li>Maxima can output (strange) PMathML </li></ul><ul><li>The maths glue joins these up... </li></ul>
    9. 9. JAssess <ul><li>New implementation with maths features </li></ul><ul><li>Has been testbed for “upconversion” </li></ul><ul><li>Investigating MathAssess requirements </li></ul><ul><li>Prototype implementation </li></ul><ul><li>Proof of concept rendering </li></ul><ul><li>Uses maths glue classes </li></ul>
    10. 10. JAssess Rendering <ul><li>Desktop renderer </li></ul><ul><li>MathAssess functionality </li></ul>
    11. 13. MathAssess Tools MathQurate Item Author JQTI 2 Rendering API QTI Assessment Delivery Classes (+XSLT) ‏ Test Constructor+ ASDEL+ Assessment Delivery Minibix+ Item and Test Storage JAssess+ Preview Applet Minibix+ Item Storage API QTI Assessment Test and Item Banking Mathqurate Authoring API QTI Assessment Item Data Classes Applications Libraries QTI Engine Question Render Author Store Deliver Local Question Preview Server Question Preview Store / Retrieve Questions Store / Retrieve Tests Deliver Tests Render Questions
    12. 14. MathQurate <ul><li>New features: </li></ul><ul><li>New interface based upon Eclipse </li></ul><ul><li>Uses Java API for XML binding (JAXB) ‏ </li></ul><ul><li>Uses JQTI 2 library for preview </li></ul><ul><li>Question features: </li></ul><ul><ul><li>Templates – randomisation </li></ul></ul><ul><ul><li>Maths input via LaTeX </li></ul></ul><ul><ul><li>customOperator for CAS computations </li></ul></ul><ul><ul><li>customInteraction for maths input </li></ul></ul>
    13. 15. Step 1: Create new or import a question
    14. 16. Step 2: Review and edit meta-data <ul><li>Edit the meta-data </li></ul><ul><ul><li>Identifier </li></ul></ul><ul><ul><li>Title </li></ul></ul><ul><ul><li>Adaptive attribute </li></ul></ul>
    15. 17. Step 3: Declare template and outcome variables <ul><li>Template variables are used for randomisation </li></ul><ul><li>Outcome variables are used in response processing, after question submission </li></ul><ul><li>Edit the variables </li></ul><ul><ul><li>Define each variable's identifier </li></ul></ul><ul><ul><li>Assign its base type </li></ul></ul><ul><ul><li>Assign the cardinality </li></ul></ul><ul><ul><li>Set the default value, if any </li></ul></ul><ul><ul><li>For template variables also set the mathVariable and parameter flags </li></ul></ul>
    16. 18. Step 4: Declare the response variables <ul><li>Some response variables are bound to the student input and compared with the expected answer </li></ul><ul><li>Response variables are defined for different purposes: </li></ul><ul><ul><li>The question response </li></ul></ul><ul><ul><ul><li>Contains the student input </li></ul></ul></ul><ul><ul><ul><li>May define a correct answer </li></ul></ul></ul><ul><ul><li>Feedback requests e.g. Hint or Solution </li></ul></ul>
    17. 19. Step 5a: Editing the item body <ul><li>Edit the content for display to the student </li></ul><ul><li>Insert and edit MathML where required </li></ul><ul><li>Insert and edit ChoiceInteraction </li></ul><ul><li>Basic preview </li></ul>
    18. 20. Step 5b: Editing MathML <ul><li>SnuggleTex approach </li></ul><ul><li>LaTeX input </li></ul><ul><li>MathML output </li></ul><ul><li>Re-editing supported </li></ul>
    19. 21. Step 5c: Editing Choice Interactions <ul><li>Breaks up the XML into digestible information </li></ul><ul><ul><li>Metadata editor </li></ul></ul><ul><ul><li>HTML and MathML Prompt editor </li></ul></ul><ul><ul><li>List of Simple Choices </li></ul></ul>
    20. 22. Step 5d:Editing Simple Choices <ul><li>Each simple choice can contain HTML and MathML </li></ul><ul><li>Metadata editing </li></ul><ul><li>Editing of Feedback provided to the student inline when this choice is selected </li></ul>
    21. 23. JQTI <ul><li>JQTI is a pure Java library for handling, validating & interpreting QTI 2.x, released under a BSD licence </li></ul><ul><ul><li>JQTI v.1 </li></ul></ul><ul><ul><ul><ul><li>Full support for the assessment model, partial expression and reporting model support </li></ul></ul></ul></ul><ul><ul><li>JQTI v.2 </li></ul></ul><ul><ul><ul><ul><li>Adds full support for item, expression and reporting models </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Plug-in support for customOperators and customInteractions </li></ul></ul></ul></ul><ul><li>JQTI-Rendering is a Java library for rendering QTI using a series of XSLTs </li></ul><ul><li>JQTI-Controller is a library for coordinating the presentation of assessments </li></ul>
    22. 24. JQTI + MathAssess <ul><li>No changes to JQTI 2 required for MathAssess CAS support </li></ul><ul><ul><li>MathAssess functionality provided by a plug-in library that just needs to be placed on the classpath! </li></ul></ul>
    23. 25. Test Constructor+ <ul><li>New features: </li></ul><ul><li>Use JQTI2 library </li></ul><ul><li>Take items from item bank (Minibix) using the Maths taxonomy </li></ul><ul><li>Package as test and deposit back into bank (Minibix) </li></ul>
    24. 26. QTIEngine <ul><li>QTIEngine is a new QTI rendering and responding engine for both individual items AND complete assessments </li></ul><ul><ul><li>Built on top of JQTI 2 , JQTI-Rendering and JQTI-Controller </li></ul></ul><ul><ul><ul><li>Aims to implement the entirety of the QTI specification! </li></ul></ul></ul><ul><ul><ul><ul><li>(currently support for rendering mediaInteraction and drawingInteraction is missing, although they are supported in JQTI) </li></ul></ul></ul></ul><ul><ul><li>Includes MathML support for IE+MathPlayer & Mozilla </li></ul></ul>Demo:
    25. 29. Minibix+ <ul><li>New features: </li></ul><ul><li>Maths capability </li></ul><ul><li>Store both items and tests </li></ul><ul><li>Better search and metadata editing </li></ul><ul><li>Support organisation by taxonomy </li></ul><ul><li>Offer support and advice for online testing </li></ul>
    26. 33. Coming soon... <ul><li>In MathAssess </li></ul><ul><ul><li>Completion of work in progress </li></ul></ul><ul><ul><li>Moodle integration </li></ul></ul><ul><ul><li>CARET training materials </li></ul></ul><ul><li>And then... </li></ul><ul><ul><li>Content </li></ul></ul><ul><ul><li>Live diagrams </li></ul></ul><ul><ul><li>Live graphs </li></ul></ul><ul><ul><li>Graphical interactions in maths items </li></ul></ul>