The document discusses open embedded assessments, which allow formative assessments to be embedded directly into open educational resources. It describes existing examples from Saylor Foundation and MIT OpenCourseWare courses. The authors' approach, OpenAssessments.org, is presented, which uses a QTI player to embed multiple choice assessments anywhere and collect analytics. The goal is to create shared banks of open assessments that can be reused across courses without reinventing assessments for each course. A demo of the OpenAssessments.org platform is provided.

1. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Opening Embedded Assessment
Brandon Muramatsu, mura@mit.edu
David Wiley, david.wiley@gmail.com
Justin Ball, justinball@gmail.com
Joel Duffin, joel.duffin@gmail.com
1Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.
Cite as: Muramatsu, B., Wiley, D., Ball, J. and Duffin, J. (2014, April). Open Embedded Assessment.
OER14: Building communities of open practice. Newcastle, UK.

2. openassessments.org
2Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Tweet
Questions
#oer14oea
openassessments.org

3. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Where in the World…
3

4. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Outline
 Motivation and Background
 Demo
 Shared Open Assessment Banks
4

5. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Content and Assessment are Separate
5
OER Content
Videos,
Lectures,
Textbooks,
Webpages,
Assessments
Current State of
OER Assessments
PDF Files,
Static,
Contained in
Separate Quiz
& Test Systems
The Challenge

6. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
The Potential?
 Do for assessments and items, what’s been done
for content (whole courses, lectures, videos)
 Embed Anywhere
 Share
 Don’t reinvent the wheel for every course
 Evaluate, Record and Track Responses
 Scale  More use of items/assessments for validity
 May lead to evidence of impact?
6

7. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Focus: Formative Assessment
 Putting mechanisms for students to check their
understanding / mastery of concepts directly in course
materials
 Primarily for formative (self-check, understanding) not
summative (exams or formal assignments)
7

8. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
What’s done today in OER with
embedded formative assessment?
8

9. Saylor Foundation – saylor.org
9
www.saylor.org
Credit:SaylorFoundation,CCBY

10. Saylor.org Precalculus II
 Course Assessments
 http://www.saylor.org/courses/ma003/?ismissing=0
&resourcetype=4
10
Credit:SaylorFoundation,CCBY
www.saylor.org

11. Saylor.org – “Assessment”
 http://www.saylor.org/site/wp-
content/uploads/2011/11/MA003-1.2.5-PART2.pdf
11
Credit:WashingtonSBCTC,CCBY

12. 12
MIT OpenCourseWare: Massachusetts Institute of Technology, http://ocw.mit.edu/courses/ocw-scholar/ (Accessed 7 Nov, 2013). License: Creative
Commons BY-NC-SA

13. OCW Scholar – 8.03SC
13
Lewin, Walter, Wit Busza, George Stephans, and Martin Connors. 8.03SC Physics III: Vibrations and Waves, Fall 2012. (MIT OpenCourseWare:
Massachusetts Institute of Technology), http://ocw.mit.edu/courses/physics/8-03sc-physics-iii-vibrations-and-waves-fall-2012 (Accessed 7 Nov, 2013).
License: Creative Commons BY-NC-SA

14. OCW Scholar – BCS9.00SC
14
Gabrieli, John. 9.00SC Introduction to Psychology, Fall 2011. (MIT OpenCourseWare: Massachusetts Institute of
Technology), http://ocw.mit.edu/courses/brain-and-cognitive-sciences/9-00sc-introduction-to-psychology-fall-2011 (Accessed 7 Nov, 2013). License:

15. OCW Scholar – 8.01SC
15
Lewin, Walter, Peter Dourmashkin, Thomas Greytak, Craig Watkins, Andy Neely, Sahana Murthy, J. Litster, and Matthew Strafuss. 8.01SC Physics I:
Classical Mechanics, Fall 2010. (MIT OpenCourseWare: Massachusetts Institute of Technology), http://ocw.mit.edu/courses/physics/8-01sc-physics-i-
classical-mechanics-fall-2010 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

16. 16
Lewin, Walter, Peter Dourmashkin, Thomas Greytak, Craig Watkins, Andy Neely, Sahana Murthy, J. Litster, and Matthew Strafuss. 8.01SC Physics I:
Classical Mechanics, Fall 2010. (MIT OpenCourseWare: Massachusetts Institute of Technology), http://ocw.mit.edu/courses/physics/8-01sc-physics-i-
classical-mechanics-fall-2010 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

17. 17Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

18. 6.002x
18Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

19. 6.002x
19Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

20. Our Approach
openassessments.org
20Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
OpenAssessments.org
Tweet
Questions
#oer14oea

21. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Open Assessments (Beta)
OpenAssessments.org
 Embed an assessment in any web content
 QTI-player
 Sends analytics
 Focus on formative assessments
 Start with limited question types
 multiple-choice/single answer
21

22. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Demo!
(cross your fingers)
22

23. openassessments.org
23Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
OpenAssessments.org
Tweet
Questions
#oer14oea

24. openassessments.org
24Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

25. OEA Stats
25Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

26. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Shared Open Assessment Banks
26

27. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Questions?
Tweet them using #oer14oea
27

28. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Opening Embedded Assessment
Brandon Muramatsu, mura@mit.edu
David Wiley, david.wiley@gmail.com
Justin Ball, justinball@gmail.com
Joel Duffin, joel.duffin@gmail.com
28Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.
Cite as: Muramatsu, B., Wiley, D., Ball, J. and Duffin, J. (2014, April). Open Embedded Assessment.
OER14: Building communities of open practice. Newcastle, UK.