2. Overview
• About the e-textbooks with embedded assessment
experiment
• Scalable processes and standards
• Balancing effectiveness with robustness
• Demo
• Further work
• Conclusions
• Acknowledgements and links
3. About the e-textbooks with embedded
assessment experiment
• The practical difference between books and text books:
formative assessment
• Goal of the experiment: making electronic textbooks
scalable, effective and robust
5. Balancing effectiveness with
robustness
Most interactive Most devices
Static QTI HTML inside
EPUB3
• OK experience
• Long lived
• Works anywhere
But:
• No feedback
• No analytics
• No results
(unless the user clicks a
link)
QTI HTML + javascript
inside EPUB3
• Good experience
• Reasonably long lived
• No server infrastructure
But:
• No results or analytics
• May need some work
with e-reader vendors
EPUB3 to online quiz
tool via IMS LTI
• Best experience
• Secure
• Quiz results return to
college, analytics
possible
But:
• Potential longevity
issues
• May need work with e-
reader vendors
• Needs an analytics ID
transfer solution
6. Demo
• Valid EPUB3 ebook
• Uses the same valid IMS QTI 2.1 item in all contexts
• QTI 2.1 item is used in static and dynamic HTML5 forms
using round-trippable transforms
• E-reader systems are stock, current versions
7. Differences with the current IMS
EDUPUB work
• The experiment doesn't stream activity data (but does
report online assessment data), the IMS one does
• The experiment works on a wide range of stock e-
readers, the IMS requires it's own desktop-only reader
• The experiment requires an out-of-band user ID solution,
the IMS one can ask the user to divulge their device ID
info
8. Further work
• Test the solution beyond iBooks desktop, Readium
desktop, Calibre and Adobe Digital Editions 2.0
• QTI 2.1 to HTML transforms are
– Currently limited to multiple choice and fill-in-
the-blank
– Transforms need tweaking for this application
• QTIWorks results reporting to 3d party LMS needs
testing
• QTIWorks might benefit from a better mobile user
interface
9. Conclusions
• EPUB3 combined with QTI 2.1 can provide formative
assessment in e-textbooks that is scalable, effective and
robust
• Fallback mechanisms in EPUB3 enable engaging
experiences in rich clients, whilst still supporting basic
readers
• The standards don't require change
10. Acknowledgements and links
• David McKain for making QTIWorks
(https://webapps.ph.ed.ac.uk/qtiworks/)
• Steve Lay for the QTI HTML transforms
(http://swl10.blogspot.co.uk/2013/09/transforming-qti-v2-into-xhtml-
5.html)
• John Kristian of the OAuth project for the OAuth javascript library
(http://oauth.googlecode.com/svn/code/javascript/)
• Stephen Vickers for the ceLTIc IMS LTI development tools
(http://ltiapps.net/test/tc-launch.php)
Code:
• https://github.com/wilmTap/qtiEpub/
11. Licence
This presentation Embedding QTI assessment in EPUB3
by Wilbert Kraan, w.g.kraan@ovod.net
of Cetis http://www.cetis.ac.uk is licensed under the
Creative Commons Attribution 3.0 Unported Licence
http://creativecommons.org/licenses/by/3.0/
Editor's Notes
title slide
add title into box shown:
add presenters