Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
The 
IMS 
Specifica7ons 
for 
Learning 
Content: 
Common 
Cartridge, 
LTI, 
QTI/APIP, 
Caliper 
and 
EDUPUB 
Colin 
Smythe...
Talk 
Objec7ves 
• To 
introduce 
the 
following 
IMS 
Standards 
and 
ac7vi7es: 
– IMS 
Learning 
Tools 
Interoperability...
Timetable 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
3 
Time 
Topic 
14:00-­‐14:30 
Plug 
&...
Biography 
• Joined 
IMS 
in 
May 
1999 
• Responsible 
for 
the 
development 
of 
many 
IMS 
specifica7ons 
inc. 
Ques7on...
Ques7ons 
& 
Comments 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
5
• Plug 
& 
Play 
Educa7onal 
Apps 
and 
Content: 
Common 
Cartridge 
and 
Learning 
Tools 
Interoperability 
• Interoperab...
What is Common Cartridge? 
• Common 
Cartridge 
(CC) 
is 
a 
specifica7on 
for 
packaging 
and 
exchanging 
learning 
and ...
The 
Problem 
for 
CC 
to 
Solve 
Because 
learning 
plaborms 
and 
authoring 
tools 
are 
all 
different, 
there 
is 
a 
...
What 
CC 
Does 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
9
A 
Common 
Cartridge 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
Common Cartridge 
imsmanife...
Supported 
Content 
Formats 
• IMS-­‐derived 
– QTI 
Assessments 
& 
Object 
Banks 
– Web 
Links/URLs 
– LTI 
Links 
– Dis...
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
Thin 
CC 
• Requirements 
are: 
– Acts 
as 
a 
TO...
IMS 
Validator 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
13
CC 
Conformance 
Program 
• Membership 
in 
the 
Common 
Cartridge 
Alliance 
is 
the 
only 
way 
to 
achieve 
official 
c...
CC 
Adop7on 
• A 
wide 
range 
of 
systems 
suppor7ng 
CC 
impor7ng 
(read), 
expor7ng 
(write) 
and 
rendering 
(play) 
–...
Learning 
Tools 
Interoperability 
• To 
enable 
Remote 
Tools 
and 
Content 
to 
be 
easily 
integrated 
into, 
and 
acce...
Tool 
Proxy 
Run7me 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
17 
Seongs 
Roster 
Outcomes...
LTI 
& 
Common 
Cartridge 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
18 
L 
M 
Premium 
S 
...
LTI 
1.0/1.1 
Messaging 
Admin 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
Tool Provider 
To...
LTI 
1.2 
Messaging 
Admin 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
Tool Provider 
Tool C...
Learning 
Tools 
Interoperability 
v2.0 
• LTIv2.0 
is 
LTIv1.0 
on 
steriods! 
– Now 
a 
plaborm 
for 
suppor7ng 
the 
en...
LTI 
v2.0 
Messaging 
Admin 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
Tool Provider 
Tool ...
Comparison 
of 
LTI 
Versions 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
23 
Feature 
LTI 
...
LTI 
Conformance 
Tes7ng 
• The 
LTI 
Conformance 
Test 
System 
– hjp://www.imsglobal.org/developers/alliance/LTI/cert/ 
...
LTI 
Adop7on 
• Extensive 
range 
of 
LTI 
cer7fied 
tools 
now 
available 
– hjp://developers.imsglobal.org/catalog.html ...
• Plug 
& 
Play 
Educa7onal 
Apps 
and 
Content: 
Common 
Cartridge 
and 
Learning 
Tools 
Interoperability 
• Interoperab...
The 
QTI 
Specifica7on 
• It 
is 
a 
specifica7on 
to 
support 
the 
exchange 
of 
Ques7ons 
(Items) 
and 
Tests 
(Assessm...
Historic 
Perspec7ve 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
28 
Version 
Date 
Descrip>...
The 
Four 
Cycle 
Process 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
29 
Summary 
Feedback ...
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
30 
Assessment, 
Sec7ons 
& 
Items 
• Assessment ...
A 
Deconstructed 
MC 
Ques7on 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
31 
• Extensive 
r...
The 
set 
of 
Interac7ons 
• associateInterac7on 
• choiceInterac7on 
• customInterac7on 
• drawingInterac7on 
• endAjempt...
Packaging 
the 
QTI 
-­‐ 
I 
* 
* 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
33 
IMS 
Conte...
Accessible 
Portable 
Item 
Protocol 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
(APIP) 
• T...
QTI/APIP 
APMG 
& 
Conformance 
• QTI/APIP 
APMG 
responsible 
for 
the 
specifica7ons 
and 
conformance 
• Conformance 
a...
QTI/APIP 
Adop7on 
• Several 
authoring 
systems 
have 
been 
cer7fied 
• Race-­‐to-­‐the-­‐Top 
Assessment 
– An 
ini7a7v...
EDUPUB 
IMS 
Work 
Summary 
Ini7al 
best 
prac7ces 
doc 
and 
code 
base 
(using 
Readium) 
published: 
hjp://www.imsgloba...
IMS 
EDUPUB 
Technology 
Context 
Student 
Information 
System 
(SIS) 
Learning 
Management 
System 
Learning 
Management ...
LTI-­‐Enabled 
QTI 
Approach 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
39
EPUB3-­‐Embedded 
QTI 
Approach 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
40
Proposed 
Workflow 
• Forma7ve 
Assessment 
(Quiz) 
supplied 
in 
QTI-­‐XML 
Package 
(reference 
form) 
• Transform 
from...
Best 
Prac7ces 
Doc 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
Using IMS Caliper Analytics™...
IMS 
EDUPUB 
Recommenda7ons 
• Ensure 
eBook/EPUB3 
readers 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights...
IMS 
EDUPUB 
Informa7on 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
44 
hjp://www.imsglobal....
• Plug 
& 
Play 
Educa7onal 
Apps 
and 
Content: 
Common 
Cartridge 
and 
Learning 
Tools 
Interoperability 
• Interoperab...
IMS 
Learning 
Analy7cs 
• This 
is 
the 
IMS 
framework 
for 
standardizing 
the 
collec7on 
of 
learning 
metric 
data 
...
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
47
The 
Metric 
Profiles 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
48
Caliper 
Events 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
49
Sensor 
API 
Service 
Framework 
• Different 
tools, 
apps, 
systems 
and 
content 
will 
drive 
the 
local 
Sensor 
API 
...
Sensor 
API 
& 
Metric 
Profiles 
• Defining 
the 
set 
of 
Caliper 
Events 
for 
some 
MPs 
• Current 
set 
of 
MPs 
bein...
Caliper 
& 
LTI 
• LTI 
launch 
of 
a 
tool 
that 
supports 
the 
Sensor 
API 
e.g. 
eBook 
reader 
• Use 
LTI 
to 
provid...
Caliper 
EDUPUB 
Deployment 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
53 
ePub 
Reader 
Wi...
The 
Learning 
Analy7cs 
Repository 
• The 
digital 
repository 
to 
which 
the 
Sensor 
API 
sends 
its 
data 
• Must 
su...
Learning 
Analy7cs 
Repository 
API 
• This 
has 
not 
been 
defined 
yet 
• May 
include: 
– Capability 
to 
read 
Sensor...
Defining 
a 
Metric 
Profile 
• Iden7fy 
the 
learning 
ac7vity 
• Define 
the 
set 
of 
state 
diagrams/tables 
• Create ...
Caliper 
Conformance 
Process 
• This 
is 
not 
yet 
agreed 
• Will 
be 
based 
upon 
a 
tool/app/system/content: 
– Senso...
Caliper 
Timeline 
• Alpha 
release 
of 
Sensor 
APIs 
(Sept 
2014) 
• Alpha 
release 
of 
MPs 
(Sept 
2014) 
• IMS 
Quart...
• Plug 
& 
Play 
Educa7onal 
Apps 
and 
Content: 
Common 
Cartridge 
and 
Learning 
Tools 
Interoperability 
• Interoperab...
EDUPUB 
Desk-­‐top 
Demonstra7on 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
60 
• Desktop 
...
TAO 
QTI 
Demonstra7on 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
61 
• Using 
TAO 
Test 
D...
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
62
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
63
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
64
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
65
Caliper 
& 
EDUPUB 
Demonstra7on 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
66 
• Using 
IM...
Readium 
Codebase 
• Readium 
is 
an 
open 
source 
EPUB3 
reader 
ini7a7ve 
(grew 
from 
IDPF 
but 
now 
standalone 
ac7v...
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
68
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
69
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
70
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
71
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
72
Making 
Adop7on 
Easy 
• Interoperability 
is 
a 
means 
to 
the 
end 
of 
improving 
learning 
impact 
• Moving 
from 
ju...
Boot-­‐camps 
& 
Development 
• Bootcamps 
– Hands-­‐on 
events 
on 
various 
IMS 
specifica7ons 
– Use 
the 
various 
IMS...
Summary 
• E-­‐learning 
interoperability 
is 
one 
way 
to 
improve 
learning 
impact 
• IMS 
has 
an 
extensive 
set 
of...
Ques7ons 
& 
Comments 
© 
2014 
IMS 
Global 
Learning 
Consor7um, 
Inc. 
All 
Rights 
Reserved 
76
Upcoming SlideShare
Loading in …5
×

Edupub day1 ims spec

1,405 views

Published on

EDUPUB Tokyo 2014
JEPA 日本電子出版協会

Published in: Internet
  • Be the first to comment

Edupub day1 ims spec

  1. 1. The IMS Specifica7ons for Learning Content: Common Cartridge, LTI, QTI/APIP, Caliper and EDUPUB Colin Smythe (IMS Chief Architect) csmythe@imsglobal.org © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 1
  2. 2. Talk Objec7ves • To introduce the following IMS Standards and ac7vi7es: – IMS Learning Tools Interoperability® (LTI®) – IMS Common Cartridge™ (CC) – IMS Ques7on & Test Interoperability® (QTI®) – IMS Accessible Portable Item Protocol™ (APIP) – IMS Caliper Learning Analy7cs – EDUPUB © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 2
  3. 3. Timetable © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 3 Time Topic 14:00-­‐14:30 Plug & Play Educa7onal Apps and Content: Common Cartridge and Learning Tools Interoperability 14:30-­‐15:00 Interoperable Assessment: QTI, APIP and EDUPUB QTI 15:00-­‐15:30 Break 15:30-­‐16:00 Making Educa7on Data Easy: Caliper Analy7cs 16:00-­‐16:30 IMS Standards in Ac7on: EDUPUB Demonstra7on & Development Community
  4. 4. Biography • Joined IMS in May 1999 • Responsible for the development of many IMS specifica7ons inc. Ques7on & Test Interoperability (QTI), Content Packaging, Accessible Portable Item Protocol (APIP), Learning Informa7on Services (LIS), etc. • Currently IMS Chief Architect and responsible for: – How the specifica7ons fit together – Overseeing the technical details of the specifica7ons – Suppor7ng adop7on of the specifica7ons © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 4
  5. 5. Ques7ons & Comments © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 5
  6. 6. • Plug & Play Educa7onal Apps and Content: Common Cartridge and Learning Tools Interoperability • Interoperable Assessment: QTI, APIP and EDUPUB QTI • Making Educa7on Data Easy: Caliper Analy7cs • IMS Standards in Ac7on: EDUPUB Demonstra7on & Development Community © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 6
  7. 7. What is Common Cartridge? • Common Cartridge (CC) is a specifica7on for packaging and exchanging learning and assessment content • The CC package dis7lls the latest and best community prac7ces for sharing digital content among authoring tools and learning plaborms © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 7
  8. 8. The Problem for CC to Solve Because learning plaborms and authoring tools are all different, there is a need for a standard interoperable format. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 8
  9. 9. What CC Does © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 9
  10. 10. A Common Cartridge © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved Common Cartridge imsmanifest.xml Cartridge meta-data Organization Resources resource meta-data Web Content Folder Resource 1 Resource n Resource Folder 1 Resource a Resource n’ Resource Folder n Resource x Resource n’’ Object bank LTI Resource type for integration with web applications and eBooks. Extended roles meta-data vocabulary {Instructor, Learner, Mentor} Multilingual support using alternative resources for web content and assessments Learning objectives assigned to resources using curriculum standards Assessment resources now include instructions to guide the learner in completing the assessment Human readable lesson plans provided to guide the instructor in using the cartridge content 10
  11. 11. Supported Content Formats • IMS-­‐derived – QTI Assessments & Object Banks – Web Links/URLs – LTI Links – Discussion Topics – Interac7ve White Board (IWB) – Accessible Portable Item Protocol (APIP) © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 11 • Other – Web Content (HTML) – Web Content (non-­‐HTML) – EPUB3 – Extension
  12. 12. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved Thin CC • Requirements are: – Acts as a TOC for externally hosted content – Support K-­‐12 specific metadata – Allow conformance against Thin CC features only • Constraints are: – A CCv1.3 system should be able to import/export Thin CC without change • Only Permijed Content – Web Links/URLs – LTI Links 12
  13. 13. IMS Validator © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 13
  14. 14. CC Conformance Program • Membership in the Common Cartridge Alliance is the only way to achieve official conformance to the CC. • Digital content or learning plaborms must exhibit the marks shown here, signifying achievement of the official conformance process, to be compliant with IMS Common Cartridge. • Products without this mark are not considered to be compliant by IMS Global. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 14 hjp://www.imsglobal.org/developers/alliance/conformance.cfm
  15. 15. CC Adop7on • A wide range of systems suppor7ng CC impor7ng (read), expor7ng (write) and rendering (play) – hjp://www.imsglobal.org/cc/statuschart.cfm • ‘Thin CC’ conformance soon • CCv1.4 under development by APMG © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 15
  16. 16. Learning Tools Interoperability • To enable Remote Tools and Content to be easily integrated into, and accessed from, an LMS (not limited to LMSs) • Several versions now available to support evolving requirements • Key concepts are the: – Tool Provider (TP) and Tool Consumer (TC) © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 16
  17. 17. Tool Proxy Run7me © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 17 Seongs Roster Outcomes Launch++ Tool Consumer Tool Provider TC Admin TP Admin Tool Secret Tool Proxy Secret TC User IMS Learning Tools Interoperability (LTI) Profile Tool Profile
  18. 18. LTI & Common Cartridge © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 18 L M Premium S Learning Content Common Cartridge L M S When LTI is combined with the IMS CC publishers can distribute cartridges containing ac7ve, authen7cated links back to centrally hosted content.
  19. 19. LTI 1.0/1.1 Messaging Admin © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved Tool Provider Tool Consumer 1. URL, key, secret 2. Configure 3. Click link System Administrator Teacher or Student Outcomes service (read, update, delete) 19 Out-­‐of-­‐band connec7on Browser connec7on Server-­‐to-­‐server connec7on
  20. 20. LTI 1.2 Messaging Admin © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved Tool Provider Tool Consumer 1. URL, key, secret 2. Configure 3. Click link System Administrator Teacher or Student Outcomes service (read, update, delete) 20 Out-­‐of-­‐band connec7on Browser connec7on Server-­‐to-­‐server connec7on
  21. 21. Learning Tools Interoperability v2.0 • LTIv2.0 is LTIv1.0 on steriods! – Now a plaborm for suppor7ng the en7re lifecycle of a tool with: • Service discovery • An extensible service framework (core+custom) – Uses REST/JSON-­‐LD as the binding form • An excellent tutorial is available at – hjp://developers.imsglobal.org/tutorials.html#l72 © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 21
  22. 22. LTI v2.0 Messaging Admin © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved Tool Provider Tool Consumer 1. Tool registra7on 4. Enable tool(s) 6. Click link System Administrator Teacher or Student Tool 22 Out-­‐of-­‐band connec7on Browser connec7on Server-­‐to-­‐server connec7on
  23. 23. Comparison of LTI Versions © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 23 Feature LTI 1.0 LTI 1.1 LTI 1.2 LTI 2.0 Comment Basic Launch X X X X LTI2 reduces op7onal data requirements Simple Outcomes X X X Return single numeric value. TC Profile X X Metadata for the TC’s available services. Tool Proxy X Metadata for the TC/TP interface contract. Creden7al Mangmt X Automa7c secure exchange of key/secret. Registra7on Flow X TC ini7ated new tool provisioning. Model-­‐Driven Doc X X Tool generated docs from UML. REST Services X X LTIv1.2 limits REST to TC only.
  24. 24. LTI Conformance Tes7ng • The LTI Conformance Test System – hjp://www.imsglobal.org/developers/alliance/LTI/cert/ index.php • Separate tes7ng for the Tool Provider and Tool Consumer • Follow the associated test script to drive the predefined set of tests • See the Screencasts that describe how to use the LTI Conformance Test Systems – hjp://www.imsglobal.org/developers/alliance/LTI/cert/ demo/ © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 24
  25. 25. LTI Adop7on • Extensive range of LTI cer7fied tools now available – hjp://developers.imsglobal.org/catalog.html • Working with the community to move towards LTIv2.0 adop7on © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 25
  26. 26. • Plug & Play Educa7onal Apps and Content: Common Cartridge and Learning Tools Interoperability • Interoperable Assessment: QTI, APIP and EDUPUB QTI • Making Educa7on Data Easy: Caliper Analy7cs • IMS Standards in Ac7on: EDUPUB Demonstra7on & Development Community © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 26
  27. 27. The QTI Specifica7on • It is a specifica7on to support the exchange of Ques7ons (Items) and Tests (Assessments) and to Report the associated outcomes. The objec7ves are to: – Be pedagogy independent – Support common & esoteric ques7on types – Cover the func7onally ‘low-­‐lying fruit’ – Enable rich feature support in the future – Support accessible content needs – Support summa7ve and forma7ve tes7ng © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 27
  28. 28. Historic Perspec7ve © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 28 Version Date Descrip>on QTIv1.0 June 2000 Original QTI release based upon basic research by ETS and the Four Process Cycle. QTIv1.1 Mar 2001 Inclusion of new ‘flow’ structure to support block-­‐based content. Release of QTI-­‐Lite. QTIv1.2 Feb 2002 Addi7on of Results Repor7ng, Selec7on & Ordering of Sec7ons, Outcomes Processing for Tests. QTIv1.2.1 Mar 2003 Set of correc7ons to the QTIv1.2 release. QTIv2.0 Jan 2005 New QTI Item model. Based upon XHTML. Reworking of ques7on structures using new set of Interac7ons. QTIv2.1 Jan 2013 Full QTI reworking to include Tests and Sec7on. New support for QTI Metadata, Results Repor7ng and Usage Data Sta7s7cs.
  29. 29. The Four Cycle Process © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 29 Summary Feedback Assessment/sec>on Processing Presenta>on Process Item Response Processing Ac>vity Selec>on Process Item Level Feedback Task/Evidence Composite Library Administrator Examinee
  30. 30. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 30 Assessment, Sec7ons & Items • Assessment – The Test, Quiz, etc. • Testpart – Subtests • Sec7on – Groups of Sec7ons/Items • Item – The ques7on
  31. 31. A Deconstructed MC Ques7on © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 31 • Extensive range of Interac7on types • Response Processing • Various levels of Feedback • Response Processing Templates • Outcomes Processing • Hints plus scoring implica7ons • Template-­‐based Item construc7on • Alterna7ve accessibility content • Item-­‐level rubric
  32. 32. The set of Interac7ons • associateInterac7on • choiceInterac7on • customInterac7on • drawingInterac7on • endAjemptInterac7on • extendedTextInterac7on • gapMatchInterac7on • graphicAssociateInterac7on • graphicGapMatchInterac7on • graphicOrderInterac7on © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 32 • hotspotInterac7on • hojextInterac7on • inlineChoiceInterac7on • matchInterac7on • orderInterac7on • posi7onObjectInterac7on • selec7onPointInterac7on • sliderInterac7on • textEntryIntera7on • uploadInterac7on
  33. 33. Packaging the QTI -­‐ I * * © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 33 IMS Content Package AssessmentItem AssessmentSec7on AssessmentTest imsmanifest.xml Folders Folders Folders Assets • Audio • Video • Images • Tools • etc.
  34. 34. Accessible Portable Item Protocol © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved (APIP) • To enable the exchange of accessibility-­‐enabled Tests & Ques7ons using a common format • To include support for a wide range of physical and cogni7ve accessibility needs • Combines IMS QTI with the IMS Access for All Personal Needs & Preferences (AFA PNP) v2.0 specifica7ons plus:-­‐ – Extensive profiling – Addi7on of new specifica7ons • APIPv1.0 released in May 2012 – hjp://www.imsglobal.org/apip/index.html 34
  35. 35. QTI/APIP APMG & Conformance • QTI/APIP APMG responsible for the specifica7ons and conformance • Conformance against: – Profile e.g. APIP (more to be added) – Baseline Specifica7on • Conformance of: – QTI Packages – Authoring Systems, Delivery Systems, Item/Test Banks © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 35
  36. 36. QTI/APIP Adop7on • Several authoring systems have been cer7fied • Race-­‐to-­‐the-­‐Top Assessment – An ini7a7ve in the USA to encourage K-­‐12 in the States/Districts to adopt standards-­‐based online assessment ($400millions) – Adop7ng the IMS QTI/APIP Standard for accessible assessment interoperability • Netherlands Department of Educa7on – Deploying a country-­‐wide schools-­‐level online assessment system for assessment authoring, delivery and results repor7ng – Working with IMS to develop the Dutch DoE Assessment systems conformance cer7fica7on process based on QTIv2.2 © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 36
  37. 37. EDUPUB IMS Work Summary Ini7al best prac7ces doc and code base (using Readium) published: hjp://www.imsglobal.org/edupub/index.html • LTI enablement • Caliper analy7cs enablement • QTI enablement © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 37
  38. 38. IMS EDUPUB Technology Context Student Information System (SIS) Learning Management System Learning Management System Learning Management (SIS) System (LMS) © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved (SIS) ePub Reader eBook Analytics System Assessment System Enrollments Outcomes Gradebooks Timetables Assessment Outcomes Scores Tracking Tracking Scores Outcomes … Outcomes Gradebook Tracking Scores 3rd Party Tools/Apps 38
  39. 39. LTI-­‐Enabled QTI Approach © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 39
  40. 40. EPUB3-­‐Embedded QTI Approach © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 40
  41. 41. Proposed Workflow • Forma7ve Assessment (Quiz) supplied in QTI-­‐XML Package (reference form) • Transform from the QTI-­‐XML to the target EDUPUB formats and embed in EPUB3 • Add the JScript libraries to provide the run-­‐7me features e.g. naviga7on, response processing, analy7cs repor7ng, etc. • Complete EPUB3 packaging and release © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 41
  42. 42. Best Prac7ces Doc © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved Using IMS Caliper Analytics™, Question and Test Interoperability™ and Learning Tools Interoperability™ with EPUB3TM: EDUPUB Best Practices Title: Using IMS Caliper, Question & Test Interoperability (QTI) and Learning Tools Interoperability (LTI) with EPUB3: EDUPUB Best Practices Authors: Lisa Mattson (IMS Global, USA) Colin Smythe (IMS Global, UK) Stephen Vickers (IMS Global, UK) Thor Anderson (IMS Global, USA) Chris Vento (Intellify Learning, USA) Prashant Nayak (Intellify Learning, USA) Version: PUBLIC DRAFT Version Date: 16th June 2014 Release: 1.0 Status: Discussion Document Summary: This document presents the best practice recommendations for using IMS Learning Tools Interoperability™ (LTI™), IMS Caliper Analytics™ and IMS Question & Test Interoperability™ (QTI™) based content within an EPUB3 context. These form a key part of the EDUPUB standard. Examples of these best practices are presented using the Readium open source EPUB3 reader but are generally applicable to other EPUB3 readers provided they follow the conformance requirements. © 2014 IMS Global Learning Consortium. All Rights Reserved. The$IMS$Logo$and$Learning$Tools$Interoperability®$(LTI®),$Accessible$Portable$Item$Protocol™$(APIP™),$Question$ and$Test$Interoperability®$(QTI®),$Common$Cartridge™$(CC™),$AccessForAll™,$Caliper$Analytics™$and$Sensor$API™$ are$trademarks$of$IMS$Global$Learning$Consortium,$Inc.$in$the$United$States$and/or$other$countries.$
  43. 43. IMS EDUPUB Recommenda7ons • Ensure eBook/EPUB3 readers © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved are IMS LTIv1.1 compliant • Ensure eBook/EPUB3 readers are IMS Caliper compliant • Ensure eBook/EPUB3 readers become IMS LTIv2.0 compliant • Establish best prac7ces for using these in EPUB3 publica7ons 43
  44. 44. IMS EDUPUB Informa7on © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 44 hjp://www.imsglobal.org/edupub/
  45. 45. • Plug & Play Educa7onal Apps and Content: Common Cartridge and Learning Tools Interoperability • Interoperable Assessment: QTI, APIP and EDUPUB QTI • Making Educa7on Data Easy: Caliper Analy7cs • IMS Standards in Ac7on: EDUPUB Demonstra7on & Development Community © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 45
  46. 46. IMS Learning Analy7cs • This is the IMS framework for standardizing the collec7on of learning metric data and the dissemina7on of learning analy7cs informa7on • IMS is concerned with learning analy7cs interoperability i.e. data collec7on from disparate systems and informa7on repor7ng to other disparate systems © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 46
  47. 47. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 47
  48. 48. The Metric Profiles © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 48
  49. 49. Caliper Events © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 49
  50. 50. Sensor API Service Framework • Different tools, apps, systems and content will drive the local Sensor API • Sensor API is responsible for: – Sending data to a service end-­‐point (normally a learning analy7cs repository) – Ensuring the data is protected during transmission – Only accessed by an authen7cated service-­‐end point • Open issues – Offline usage/data caching/data synchroniza7on – Content-­‐based/tool-­‐based © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved Sensor API usage/interac7ons 50
  51. 51. Sensor API & Metric Profiles • Defining the set of Caliper Events for some MPs • Current set of MPs being defined are: – Reading -­‐ reading textual content – Assessment -­‐ undertaking a test or quiz – Annota7on -­‐ annota7ng content – Performance – grading/scoring of some content – Media – interac7on with video/audio systems © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 51
  52. 52. Caliper & LTI • LTI launch of a tool that supports the Sensor API e.g. eBook reader • Use LTI to provide the key informa7on for the learning context – Supplied as LTI launch parameters – Id for the learner, etc. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 52
  53. 53. Caliper EDUPUB Deployment © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 53 ePub Reader Widgets (ePub3) edu Apps (LTI) edu App (LTI) Learning Environment Widget(s) (ePub3) edu App (LTI) Analy>cs Data Store Caliper (Sensor Endpoint) S S S S S = Caliper Sensor LTI (Consumer) LTI (Provider) LTI (Provider) LTI Reading Metrics (Consumer) LMS Metrics Widget Metrics edu App Metrics edu App(s) (LTI) A = AuthN Service A A
  54. 54. The Learning Analy7cs Repository • The digital repository to which the Sensor API sends its data • Must support the Sensor API i.e. receive and store the caliper event data • Must provide some of:-­‐ – Analy7cs algorithms – Informa7on visualiza7on – Informa7on export/repor7ng – Repository-­‐to-­‐repository © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved exchange 54
  55. 55. Learning Analy7cs Repository API • This has not been defined yet • May include: – Capability to read Sensor sourced data – Capability to read processed data – Exchange data with another LA repository • Constraints are: – Authen7cated access – Permijed access to specific Sensor data © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 55
  56. 56. Defining a Metric Profile • Iden7fy the learning ac7vity • Define the set of state diagrams/tables • Create the event label vocabulary • Establish the set of parameters for each caliper event • Define the learning context/descrip7on informa7on © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 56
  57. 57. Caliper Conformance Process • This is not yet agreed • Will be based upon a tool/app/system/content: – Sensor API ‘on-­‐the-­‐wire’ messages – Confirm correct opera7on specific MPs – Require the vendor to create test content to drive the Sensor API to produce the required set of messages – Sensor API messages logged at IMS Sensor Conformance Test Repository and analysed for correctness © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 57
  58. 58. Caliper Timeline • Alpha release of Sensor APIs (Sept 2014) • Alpha release of MPs (Sept 2014) • IMS Quarterly mee7ng (Nov 2014) – Beta release of Sensor APIs – Beta release of MPs – Sensor API v1.0 Specifica7on Public Draz – Ini7al set of MP Specifica7ons as Public Draz © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 58
  59. 59. • Plug & Play Educa7onal Apps and Content: Common Cartridge and Learning Tools Interoperability • Interoperable Assessment: QTI, APIP and EDUPUB QTI • Making Educa7on Data Easy: Caliper Analy7cs • IMS Standards in Ac7on: EDUPUB Demonstra7on & Development Community © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 59
  60. 60. EDUPUB Desk-­‐top Demonstra7on © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 60 • Desktop version of Readium • Accessed using Chrome/Readium app • Standard Readium distribu7on • Only embedded Quiz access available
  61. 61. TAO QTI Demonstra7on © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 61 • Using TAO Test Delivery System • TAO hosted service • Same test as per EDUPUB demonstra7on • Imported the test as an IMS QTIv2.1 Package
  62. 62. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 62
  63. 63. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 63
  64. 64. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 64
  65. 65. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 65
  66. 66. Caliper & EDUPUB Demonstra7on © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 66 • Using IMS hosted Moodle • Using IMS version of Readium • Same test as per EDUPUB local demonstra7on • LTI-­‐based access to • Caliper Repository • Ques7onmark remote test delivery system
  67. 67. Readium Codebase • Readium is an open source EPUB3 reader ini7a7ve (grew from IDPF but now standalone ac7vity) • Readium used as our EPUB3 reader codebase (Hosted service and desktop versions) • IMS has made a code fork for the EDUPUB work – LTIv1.0 enabled (Consumer and Provider) – Sensor API enabled © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 67
  68. 68. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 68
  69. 69. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 69
  70. 70. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 70
  71. 71. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 71
  72. 72. © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 72
  73. 73. Making Adop7on Easy • Interoperability is a means to the end of improving learning impact • Moving from just specifica7on crea7on to direct solu7on support via APIs and reference implementa7ons • IMS need more involvement from the developer community to improve our implementa7on aids © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 73
  74. 74. Boot-­‐camps & Development • Bootcamps – Hands-­‐on events on various IMS specifica7ons – Use the various IMS test and implementa7on materials – Work on APIs and implementa7on issues © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 74 • Developer Community – Community App Store Architecture (CASA) – Caliper/Sensor APIs – New community efforts to be announced shortly
  75. 75. Summary • E-­‐learning interoperability is one way to improve learning impact • IMS has an extensive set of specifica7ons released and adopted throughout the World • The specifica7on focus is now on making it easier to adopt e.g. Bootcamps • The success of IMS is heavily dependent on the Members’ involvement in the IMS ac7vi7es and not just paying the membership fee © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 75
  76. 76. Ques7ons & Comments © 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved 76

×