1. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
Evaluating and Selecting
Digital Learning Resources
Brandon Muramatsu, mura@mit.edu
Louisa Rosenheck, louisa@mit.edu

2. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
Outline
• Introduction
• Framework and Selection Criteria
• Evaluating Lure of the Labyrinth
• If time: Evaluate StarLogo Nova

3. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
Brandon Muramatsu
• With Michel DeGraff and Vijay Kumar, helped to launch the
MIT-Haiti Initiative in 2010
• Background
– 9+ Years in Educational Digital Libraries: Collecting and
evaluating online / digital learning resources in engineering
education, STEM and with MERLOT
– 11+ Years in Open Education
• Strategic Education Initiatives
– Identify and develop new initiatives on behalf of MIT
– Lead all or part of the initiatives

4. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
Louisa Rosenheck
• Background in Computer Science and Education
• With the MIT Education Arcade for 5+ years
–Design Games and Tools for Learning
–Focus on Middle/High School Math/Science
–Oversee Development and Testing
–Train Teachers on Implementation
–Design and Conduct Research

5. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
Selecting Learning Technologies...
Establish Course Goals
Identify Student Learning Outcomes
Design Learning Environment
Blend of Digital and Hands-on Activities
Assess Student Learning
Digital Learning Activity
Search for Resources
Review Resources for
Applicability
Select Resource And Continue
Designing Activity
…begins with an understanding of the environment in which it will be used
7
Principles
Questions
to Consider
Premier Award
Criteria

6. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
Discussion of Selection Criteria
• Content
• Pedagogy
• Technology
• Practical Matters

7. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
LURE OF THE LABYRINTH
Example #1

8. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
Employee Cafeteria
1. Go to:
labyrinth.thinkport.org
2. Username: newdemo
3. Password: newdemo
4. Select “Play a Puzzle”
5. Go to the first one:
Employee Cafeteria
6. Play and Evaluate!

9. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
STARLOGO NOVA
Example #2

10. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
Evolution: Something’s Fishy
1. Go to: slnova.org
2. Register and log in
3. Go to
http://www.slnova.org/b
iograph/projects/2880/
4. OR search for “fishy” and
choose the first one
5. Experiment!
6. View Code if you’re
interested

11. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
Collections of (OER) Digital Learning Resources
• OER Commons (www.oercommons.org)
• Curriki (www.curriki.org)
• PhET Interactive Simulations (phet.colorado.edu)

12. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.
References and Acknowledgements
• Perry, J. and Rosenheck, L. (2015). Using Existing Commercial Off-the-
Shelf Software Worksheet.
• Seven Principles for Good Practice in Undergraduate Education adapted
from the Brigham Young University Faculty Center’s interpretation of
Chickering’s and Gamson’s Seven Principles for Good Practice in
Undergraduate Education. See document for further details.
• Premier Award. (2009). Selection Criteria for the Premier Award for
Excellence in Engineering Education Courseware.
• Portions of this presentation based on workshops by
McMartin, F., Muramatsu, B., Tront, J.G. and Bayard, J.P. (2000-2007).
Introduction to Evaluating, Selecting and Using Learning Technologies
and Digital Learning Materials.