Open Embedded Assessments: Play, Author; Anywhere, Anytime

Brandon Muramatsu
Brandon MuramatsuAssociate Director, Projects
1
Open Embedded Assessments:
Play, Author; Anywhere, Anytime
MIT, Atomic Jolt, Lumen Learning
Background on OEA
 Concept generated during COSL, realized by MIT, Atomic
Jolt and Lumen Learning
 Goals of Open Embedded Assessments (OpenEd 2014)
 Do for assessments and items, what’s been done for
content (whole courses, lectures, videos)
 Embed anywhere ✔
 Share (don’t reinvent the wheel for every course)
 Evaluate, record and track responses ✔
2
Development History of OEA
3
Early
Concept
(circa
2008)
MIT &
Atomic
Jolt
Proof of
Concept
(2013-
2015)
Public
Demo
(2014)
Lumen
Learning
(2015+) MIT /
CLIx
(2016+)
Atomic
Assess-
ments
(2017)
You?
COSL Planting Seeds
Atomic Jolt: Ball and Duffin
Lumen: Wiley -> Mosbacker
MIT: Muramatsu -> Merriman, Shaw and DeLong
USDA, Public Domain
OEA Components
 Player
 Embedded in web page
 For each question type
 Might be a “generic” type but “custom” player based on project needs
 Authoring
 QTI (Canvas or Moodle export) -> OEA (import)
 Native authoring
 Repository / Question Bank
 Data logging
4
Mini Case Study: About CLIx
 Connected Learning Initiative scope and scale
 Contemporary OER modules for Grade IX in math,
science and English bringing active learning and digital
tools to the classroom in India’s government (public)
schools
 ~460 schools in 4 states in India, goal of ~30,000
students in India
 (Up to 2M assessments to be offered)
5
Mini Case Study: How is CLIx using OEA?
 Players “embedded” for use in schools
 In CLIx Platform (gStudio) loaded from local network
server and accessed over local network
 In Unplatform2 loaded locally on non-Internet-
connected, non-networked computers in schools
 Can gather usage logs and responses
 Just starting to gather the data
 Authored in the cloud
7
Mini Case Study: How is Lumen using OEA?
 Helping students learn!
 Types of quizzes taken: 2.6M
 Module Pre-tests: 191,771
 In-content Embeds: 284,717
 Topic-level Self-check: 1,707,981
 Summative Quizzes: 380,728
8
Mini Case Study: How is Atomic Jolt using OEA?
 Atomic Assessments
 LTI embed and grade write back into Canvas
 (Developed players and authoring tools for MIT / CLIx)
9
Get OEA and Questions?
 MIT / CLIx - kirky@mit.edu
 https://github.com/CLIxIndia-
Dev/OpenAssessmentsClient
 Lumen Learning - bracken@lumenlearning.com
 Atomic Jolt - justin.ball@atomicjolt.com
 Atomic Assessments, customization and development
 https://github.com/atomicjolt/open_assessments
10
THANKS!
11
1 of 10

Recommended

Open Educational Resources - Session #2 by
Open Educational Resources - Session #2Open Educational Resources - Session #2
Open Educational Resources - Session #2Vanessa Camilleri
3.4K views15 slides
Open Educational Resources - Session #1 by
Open Educational Resources - Session #1Open Educational Resources - Session #1
Open Educational Resources - Session #1Vanessa Camilleri
3.1K views15 slides
Open Education Resources - Session #3 by
Open Education Resources - Session #3Open Education Resources - Session #3
Open Education Resources - Session #3Vanessa Camilleri
2.6K views12 slides
Open Education Resources - Session #4 by
Open Education Resources - Session #4Open Education Resources - Session #4
Open Education Resources - Session #4Vanessa Camilleri
2.5K views11 slides
Blogger - Project by
Blogger - ProjectBlogger - Project
Blogger - ProjectMohammad Tawfik
280 views52 slides
Moodle Presentation Summer 2009 by
Moodle Presentation Summer 2009Moodle Presentation Summer 2009
Moodle Presentation Summer 2009Tom Jenkins
688 views30 slides

More Related Content

Similar to Open Embedded Assessments: Play, Author; Anywhere, Anytime

Web meeting tools in the "SUNY Nebula" by
Web meeting tools in the "SUNY Nebula"Web meeting tools in the "SUNY Nebula"
Web meeting tools in the "SUNY Nebula"Keith Landa
777 views25 slides
Smartphones wikis and games for education by
Smartphones wikis and games for educationSmartphones wikis and games for education
Smartphones wikis and games for educationJean-Claude Bradley
1.6K views82 slides
OpenSim: A New Alternative to Second Life by
OpenSim: A New Alternative to Second LifeOpenSim: A New Alternative to Second Life
OpenSim: A New Alternative to Second LifeFleep Tuque
3.3K views57 slides
Using open source assessment and feedback tools by
Using open source assessment and feedback toolsUsing open source assessment and feedback tools
Using open source assessment and feedback toolsjisc-elearning
2.9K views51 slides
Learning Analytics – Opportunities for ISO/IEC JTC 1/SC36 standardisation by
Learning Analytics – Opportunities for ISO/IEC JTC 1/SC36 standardisationLearning Analytics – Opportunities for ISO/IEC JTC 1/SC36 standardisation
Learning Analytics – Opportunities for ISO/IEC JTC 1/SC36 standardisationTore Hoel
1.1K views27 slides
Do It Yourself LMS: Open-Source and Hi-Tech Possibilities by
Do It Yourself LMS: Open-Source and Hi-Tech PossibilitiesDo It Yourself LMS: Open-Source and Hi-Tech Possibilities
Do It Yourself LMS: Open-Source and Hi-Tech Possibilitiesgrandeped
2.1K views28 slides

Similar to Open Embedded Assessments: Play, Author; Anywhere, Anytime(20)

Web meeting tools in the "SUNY Nebula" by Keith Landa
Web meeting tools in the "SUNY Nebula"Web meeting tools in the "SUNY Nebula"
Web meeting tools in the "SUNY Nebula"
Keith Landa777 views
OpenSim: A New Alternative to Second Life by Fleep Tuque
OpenSim: A New Alternative to Second LifeOpenSim: A New Alternative to Second Life
OpenSim: A New Alternative to Second Life
Fleep Tuque3.3K views
Using open source assessment and feedback tools by jisc-elearning
Using open source assessment and feedback toolsUsing open source assessment and feedback tools
Using open source assessment and feedback tools
jisc-elearning2.9K views
Learning Analytics – Opportunities for ISO/IEC JTC 1/SC36 standardisation by Tore Hoel
Learning Analytics – Opportunities for ISO/IEC JTC 1/SC36 standardisationLearning Analytics – Opportunities for ISO/IEC JTC 1/SC36 standardisation
Learning Analytics – Opportunities for ISO/IEC JTC 1/SC36 standardisation
Tore Hoel1.1K views
Do It Yourself LMS: Open-Source and Hi-Tech Possibilities by grandeped
Do It Yourself LMS: Open-Source and Hi-Tech PossibilitiesDo It Yourself LMS: Open-Source and Hi-Tech Possibilities
Do It Yourself LMS: Open-Source and Hi-Tech Possibilities
grandeped2.1K views
EuSakai: Directions for Standards in Teaching and Learning by Charles Severance
EuSakai: Directions for Standards in Teaching and LearningEuSakai: Directions for Standards in Teaching and Learning
EuSakai: Directions for Standards in Teaching and Learning
Charles Severance810 views
OER + Blockchain Technology for Decentralization of Academic Publishing by Sh... by Sherry Jones
OER + Blockchain Technology for Decentralization of Academic Publishing by Sh...OER + Blockchain Technology for Decentralization of Academic Publishing by Sh...
OER + Blockchain Technology for Decentralization of Academic Publishing by Sh...
Sherry Jones202 views
Wide BSI/JISC Accessibility SIG meeting presentation by V_Gkatzidou
Wide BSI/JISC Accessibility SIG meeting presentationWide BSI/JISC Accessibility SIG meeting presentation
Wide BSI/JISC Accessibility SIG meeting presentation
V_Gkatzidou530 views
Building the Next Generation Teaching and Learning Environment with Tsugi (次) by Charles Severance
Building the Next Generation Teaching and Learning Environment with Tsugi (次)Building the Next Generation Teaching and Learning Environment with Tsugi (次)
Building the Next Generation Teaching and Learning Environment with Tsugi (次)
Charles Severance489 views
Building the NGDLE with Tsugi (次) and Koseu(코스) by Charles Severance
Building the NGDLE with Tsugi (次) and Koseu(코스)Building the NGDLE with Tsugi (次) and Koseu(코스)
Building the NGDLE with Tsugi (次) and Koseu(코스)
Charles Severance848 views

More from Brandon Muramatsu

Digital Credentials Enabling Mobility and Verification of Educational Achieve... by
Digital Credentials Enabling Mobility and Verification of Educational Achieve...Digital Credentials Enabling Mobility and Verification of Educational Achieve...
Digital Credentials Enabling Mobility and Verification of Educational Achieve...Brandon Muramatsu
239 views21 slides
Sustainability of OER Initiatives: An Interactive Discussion by
Sustainability of OER Initiatives: An Interactive DiscussionSustainability of OER Initiatives: An Interactive Discussion
Sustainability of OER Initiatives: An Interactive DiscussionBrandon Muramatsu
212 views17 slides
Bridging the Gap: Mixing approaches, content and tools to help college students by
Bridging the Gap: Mixing approaches, content and tools to help college studentsBridging the Gap: Mixing approaches, content and tools to help college students
Bridging the Gap: Mixing approaches, content and tools to help college studentsBrandon Muramatsu
201 views11 slides
Federations & Backstage: Thoughts for a Geoscience Education Infrastructure by
Federations & Backstage: Thoughts for a Geoscience Education InfrastructureFederations & Backstage: Thoughts for a Geoscience Education Infrastructure
Federations & Backstage: Thoughts for a Geoscience Education InfrastructureBrandon Muramatsu
176 views9 slides
The Connected Learning Initiative Quality at Scale in India by
The Connected Learning Initiative Quality at Scale in IndiaThe Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in IndiaBrandon Muramatsu
172 views18 slides
The Connected Learning Initiative Quality at Scale in India by
The Connected Learning Initiative Quality at Scale in IndiaThe Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in IndiaBrandon Muramatsu
161 views9 slides

More from Brandon Muramatsu(20)

Digital Credentials Enabling Mobility and Verification of Educational Achieve... by Brandon Muramatsu
Digital Credentials Enabling Mobility and Verification of Educational Achieve...Digital Credentials Enabling Mobility and Verification of Educational Achieve...
Digital Credentials Enabling Mobility and Verification of Educational Achieve...
Brandon Muramatsu239 views
Sustainability of OER Initiatives: An Interactive Discussion by Brandon Muramatsu
Sustainability of OER Initiatives: An Interactive DiscussionSustainability of OER Initiatives: An Interactive Discussion
Sustainability of OER Initiatives: An Interactive Discussion
Brandon Muramatsu212 views
Bridging the Gap: Mixing approaches, content and tools to help college students by Brandon Muramatsu
Bridging the Gap: Mixing approaches, content and tools to help college studentsBridging the Gap: Mixing approaches, content and tools to help college students
Bridging the Gap: Mixing approaches, content and tools to help college students
Brandon Muramatsu201 views
Federations & Backstage: Thoughts for a Geoscience Education Infrastructure by Brandon Muramatsu
Federations & Backstage: Thoughts for a Geoscience Education InfrastructureFederations & Backstage: Thoughts for a Geoscience Education Infrastructure
Federations & Backstage: Thoughts for a Geoscience Education Infrastructure
Brandon Muramatsu176 views
The Connected Learning Initiative Quality at Scale in India by Brandon Muramatsu
The Connected Learning Initiative Quality at Scale in IndiaThe Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in India
Brandon Muramatsu172 views
The Connected Learning Initiative Quality at Scale in India by Brandon Muramatsu
The Connected Learning Initiative Quality at Scale in IndiaThe Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in India
Brandon Muramatsu161 views
Strategic Education Initiatives , MIT Open Learning by Brandon Muramatsu
Strategic Education Initiatives, MIT Open LearningStrategic Education Initiatives, MIT Open Learning
Strategic Education Initiatives , MIT Open Learning
Brandon Muramatsu164 views
Evaluating and Selecting Digital Learning Resources by Brandon Muramatsu
Evaluating and Selecting Digital Learning ResourcesEvaluating and Selecting Digital Learning Resources
Evaluating and Selecting Digital Learning Resources
Brandon Muramatsu164 views
Connected Learning Initiative: Learning at Scale by Brandon Muramatsu
Connected Learning Initiative: Learning at ScaleConnected Learning Initiative: Learning at Scale
Connected Learning Initiative: Learning at Scale
Brandon Muramatsu795 views
The Best of Both Worlds: Transforming OpenCourseWare in an age of Interactivity by Brandon Muramatsu
The Best of Both Worlds: Transforming OpenCourseWare in an age of InteractivityThe Best of Both Worlds: Transforming OpenCourseWare in an age of Interactivity
The Best of Both Worlds: Transforming OpenCourseWare in an age of Interactivity
Brandon Muramatsu1.6K views
Innovative Educational Technology and Educational Infrastructure at MIT by Brandon Muramatsu
Innovative Educational Technologyand Educational Infrastructureat MITInnovative Educational Technologyand Educational Infrastructureat MIT
Innovative Educational Technology and Educational Infrastructure at MIT
Brandon Muramatsu1.6K views
Workshop: Emerging Possibilities and Takeaways for KFUPM by Brandon Muramatsu
Workshop: Emerging Possibilities and Takeaways for KFUPMWorkshop: Emerging Possibilities and Takeaways for KFUPM
Workshop: Emerging Possibilities and Takeaways for KFUPM
Brandon Muramatsu610 views
Workshop: Lessons from Online and edX / MITx Courses by Brandon Muramatsu
Workshop: Lessons from Online and edX / MITx CoursesWorkshop: Lessons from Online and edX / MITx Courses
Workshop: Lessons from Online and edX / MITx Courses
Brandon Muramatsu963 views
Workshop: Design Considerations for Online / Digital Courses by Brandon Muramatsu
Workshop: Design Considerations for Online / Digital CoursesWorkshop: Design Considerations for Online / Digital Courses
Workshop: Design Considerations for Online / Digital Courses
Brandon Muramatsu625 views
Workshop: Educational Technology Opportunities for KFUPM by Brandon Muramatsu
Workshop: Educational Technology Opportunities for KFUPMWorkshop: Educational Technology Opportunities for KFUPM
Workshop: Educational Technology Opportunities for KFUPM
Brandon Muramatsu570 views

Recently uploaded

PRELIMS ANSWER.pptx by
PRELIMS ANSWER.pptxPRELIMS ANSWER.pptx
PRELIMS ANSWER.pptxsouravkrpodder
56 views60 slides
NodeJS and ExpressJS.pdf by
NodeJS and ExpressJS.pdfNodeJS and ExpressJS.pdf
NodeJS and ExpressJS.pdfArthyR3
53 views17 slides
Mineral nutrition and Fertilizer use of Cashew by
 Mineral nutrition and Fertilizer use of Cashew Mineral nutrition and Fertilizer use of Cashew
Mineral nutrition and Fertilizer use of CashewAruna Srikantha Jayawardana
59 views107 slides
Berry country.pdf by
Berry country.pdfBerry country.pdf
Berry country.pdfMariaKenney3
82 views12 slides
Introduction to AERO Supply Chain - #BEAERO Trainning program by
Introduction to AERO Supply Chain  - #BEAERO Trainning programIntroduction to AERO Supply Chain  - #BEAERO Trainning program
Introduction to AERO Supply Chain - #BEAERO Trainning programGuennoun Wajih
135 views78 slides
The Future of Micro-credentials: Is Small Really Beautiful? by
The Future of Micro-credentials:  Is Small Really Beautiful?The Future of Micro-credentials:  Is Small Really Beautiful?
The Future of Micro-credentials: Is Small Really Beautiful?Mark Brown
121 views35 slides

Recently uploaded(20)

NodeJS and ExpressJS.pdf by ArthyR3
NodeJS and ExpressJS.pdfNodeJS and ExpressJS.pdf
NodeJS and ExpressJS.pdf
ArthyR353 views
Introduction to AERO Supply Chain - #BEAERO Trainning program by Guennoun Wajih
Introduction to AERO Supply Chain  - #BEAERO Trainning programIntroduction to AERO Supply Chain  - #BEAERO Trainning program
Introduction to AERO Supply Chain - #BEAERO Trainning program
Guennoun Wajih135 views
The Future of Micro-credentials: Is Small Really Beautiful? by Mark Brown
The Future of Micro-credentials:  Is Small Really Beautiful?The Future of Micro-credentials:  Is Small Really Beautiful?
The Future of Micro-credentials: Is Small Really Beautiful?
Mark Brown121 views
GSoC 2024 .pdf by ShabNaz2
GSoC 2024 .pdfGSoC 2024 .pdf
GSoC 2024 .pdf
ShabNaz245 views
ANGULARJS.pdf by ArthyR3
ANGULARJS.pdfANGULARJS.pdf
ANGULARJS.pdf
ArthyR354 views
Presentation_NC_Future now 2006.pdf by Lora
Presentation_NC_Future now 2006.pdfPresentation_NC_Future now 2006.pdf
Presentation_NC_Future now 2006.pdf
Lora 38 views
Creative Restart 2023: Christophe Wechsler - From the Inside Out: Cultivating... by Taste
Creative Restart 2023: Christophe Wechsler - From the Inside Out: Cultivating...Creative Restart 2023: Christophe Wechsler - From the Inside Out: Cultivating...
Creative Restart 2023: Christophe Wechsler - From the Inside Out: Cultivating...
Taste39 views
Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab... by RAHUL PAL
Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab...Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab...
Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab...
RAHUL PAL45 views

Open Embedded Assessments: Play, Author; Anywhere, Anytime

  • 1. 1 Open Embedded Assessments: Play, Author; Anywhere, Anytime MIT, Atomic Jolt, Lumen Learning
  • 2. Background on OEA  Concept generated during COSL, realized by MIT, Atomic Jolt and Lumen Learning  Goals of Open Embedded Assessments (OpenEd 2014)  Do for assessments and items, what’s been done for content (whole courses, lectures, videos)  Embed anywhere ✔  Share (don’t reinvent the wheel for every course)  Evaluate, record and track responses ✔ 2
  • 3. Development History of OEA 3 Early Concept (circa 2008) MIT & Atomic Jolt Proof of Concept (2013- 2015) Public Demo (2014) Lumen Learning (2015+) MIT / CLIx (2016+) Atomic Assess- ments (2017) You? COSL Planting Seeds Atomic Jolt: Ball and Duffin Lumen: Wiley -> Mosbacker MIT: Muramatsu -> Merriman, Shaw and DeLong USDA, Public Domain
  • 4. OEA Components  Player  Embedded in web page  For each question type  Might be a “generic” type but “custom” player based on project needs  Authoring  QTI (Canvas or Moodle export) -> OEA (import)  Native authoring  Repository / Question Bank  Data logging 4
  • 5. Mini Case Study: About CLIx  Connected Learning Initiative scope and scale  Contemporary OER modules for Grade IX in math, science and English bringing active learning and digital tools to the classroom in India’s government (public) schools  ~460 schools in 4 states in India, goal of ~30,000 students in India  (Up to 2M assessments to be offered) 5
  • 6. Mini Case Study: How is CLIx using OEA?  Players “embedded” for use in schools  In CLIx Platform (gStudio) loaded from local network server and accessed over local network  In Unplatform2 loaded locally on non-Internet- connected, non-networked computers in schools  Can gather usage logs and responses  Just starting to gather the data  Authored in the cloud 7
  • 7. Mini Case Study: How is Lumen using OEA?  Helping students learn!  Types of quizzes taken: 2.6M  Module Pre-tests: 191,771  In-content Embeds: 284,717  Topic-level Self-check: 1,707,981  Summative Quizzes: 380,728 8
  • 8. Mini Case Study: How is Atomic Jolt using OEA?  Atomic Assessments  LTI embed and grade write back into Canvas  (Developed players and authoring tools for MIT / CLIx) 9
  • 9. Get OEA and Questions?  MIT / CLIx - kirky@mit.edu  https://github.com/CLIxIndia- Dev/OpenAssessmentsClient  Lumen Learning - bracken@lumenlearning.com  Atomic Jolt - justin.ball@atomicjolt.com  Atomic Assessments, customization and development  https://github.com/atomicjolt/open_assessments 10

Editor's Notes

  1. Muramatsu, B. and Pinch, P. “The Best of Both Worlds: Transforming OpenCourseWare in the age of Interactivity.” Open Education Conference 2014.
  2. Originally goal was 150K students, 1,000 schools -> would have been on order of 7M assessments