Cooperative Learning Object Exchange (CLOE) A Learning Object Project  Case Study Peter Tittenberger, July 2009
Snapshot history <ul><li>1997?: 3 Ontario institutions join MERLOT as an institutional consortium [Guelph, Waterloo, York]...
CLOE included: <ul><li>Collaborative design and learning object development </li></ul><ul><li>Peer Review process </li></u...
List of CLOE institutions: Brock University Carleton University Conestoga College Durham College University of Guelph Lake...
1. Collaborative design and learning object development <ul><li>Grant funded </li></ul><ul><ul><li>2004-2005 Inukshuk fund...
Camp Cloe <ul><li>Instructional Design & Learning Technology Workshop    </li></ul><ul><li>Learning Object Design Process ...
CLOE design and development methodology created a rigorous set of standards for learning object creation.
http://www.brocku.ca/learningobjects/flash_content/index.html
http://www.brocku.ca/learningobjects/flash_content/LO/Stroop_Effect.html
Access Restrictions: These Learning Objects are being developed by ITS (Information Technology Services) in conjunction wi...
Form to add object to CLOE
2. Peer Review CLOE partners concluded that a hallmark of CLOE should be that all LOs in CLOE should be Peer Reviewed. CLO...
The process that the CLOE Editor-in -Chief uses when a new LO is submitted to CLOE:
Guidelines for authors creating los and for peer reviewers evaluating los.
CLOE peer review process  created a rigorous methodology and set of standards for learning object submission and review.
3. Learning object repository <ul><li>Stand alone web site. </li></ul><ul><li>Access restricted. </li></ul><ul><li>No fede...
CLOE lo ‘borrowing’ form.
4. Administrative infrastructure <ul><li>UWaterloo provided director, admin support and technical components and support <...
Memorandum of Understanding <ul><li>When partners join CLOE a high-level official at that institution signs the CLOE Memor...
Memorandum of Understanding <ul><li>Potential new partners indicated that they wanted to be full and equal partners in CLO...
Memorandum of Understanding <ul><li>Collaboration in the design of a LO </li></ul><ul><li>Collaboration in the development...
<ul><li>Empower project leadership to set and achieve goals </li></ul><ul><ul><li>Select leaders and key staff with requis...
Why did CLOE fail? <ul><li>LO Design and development? </li></ul><ul><li>Peer review? </li></ul><ul><li>Repository/reuse? <...
Why did it fail? <ul><li>LO Design and development </li></ul><ul><li>Once grant funding ended no financial incentive to co...
Why did it fail? <ul><li>Peer review </li></ul><ul><li>No recognition of peer review in promotion, retention, and tenure. ...
Why did it fail? <ul><li>Repository/reuse </li></ul><ul><li>Cumbersome registration/paperwork to reuse lo. </li></ul><ul><...
Impact on teaching practices: <ul><li>“ The foremost reason for  not  using digital resources was that they did not suppor...
Why did it fail? <ul><li>Administrative support </li></ul><ul><li>UWaterloo pulls out support after funding ends </li></ul...
Key factors for Sustainability <ul><li>Assume grant funding will not always be available </li></ul><ul><li>Define sustaina...
<ul><li>Empower project leadership to set and achieve goals </li></ul><ul><ul><li>Select leaders and key staff with requis...
Thank you.
Upcoming SlideShare
Loading in …5
×

Collaborative Learning Object Exchange (CLOE): A Case Study

3,215 views

Published on

A Case Study of the Cooperative Learning Object Exchange.

Published in: Education, Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,215
On SlideShare
0
From Embeds
0
Number of Embeds
43
Actions
Shares
0
Downloads
51
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Collaborative Learning Object Exchange (CLOE): A Case Study

  1. 1. Cooperative Learning Object Exchange (CLOE) A Learning Object Project Case Study Peter Tittenberger, July 2009
  2. 2. Snapshot history <ul><li>1997?: 3 Ontario institutions join MERLOT as an institutional consortium [Guelph, Waterloo, York]. Each pays 1/3 of the membership fee </li></ul><ul><li>1998: 8 Ontario institutions in MERLOT consortium, each contributing share of fee + faculty time to participate </li></ul><ul><li>1998-2000: grant from TeleLearning NCE to investigate further community and collaboration models </li></ul><ul><li>1999: grant from Industry Canada for students to work on &quot;learnware&quot; </li></ul><ul><li>2001-2003: grant from HRDC Office of Learning Technologies to fund learning object development with some investment in infrastructure for CLOE </li></ul><ul><li>2004-2005: grant from Inukshuk to collaboratively develop learning objects </li></ul><ul><li>2006-2007: UWaterloo continues to subsidize CLOE operation, no success in identifying sources for ongoing funding </li></ul><ul><li>2008: operation effectively ceases, although website available until domain registration expires. </li></ul>Via Tom Carey email, July 2009
  3. 3. CLOE included: <ul><li>Collaborative design and learning object development </li></ul><ul><li>Peer Review process </li></ul><ul><li>Learning object repository </li></ul><ul><li>Administrative infrastructure </li></ul>
  4. 4. List of CLOE institutions: Brock University Carleton University Conestoga College Durham College University of Guelph Lakehead University La Cité Collégiale Lambton College Laurentian University McMaster University Memorial University of Newfoundland Ministry of Science and Technology, Thailand Niagara College Nipissing University Queen's University Ryerson University Wendy Freeman Seneca College Sheridan College Trent University University of Manitoba University of Ontario Institute of Technology University of Ottawa University of Toronto University of Waterloo University of Western Ontario University of Windsor Wilfrid Laurier University York University
  5. 5. 1. Collaborative design and learning object development <ul><li>Grant funded </li></ul><ul><ul><li>2004-2005 Inukshuk fund ($2 million) </li></ul></ul><ul><li>Camp Cloe </li></ul><ul><ul><li>a one week Instructional Design workshop. CLOE partners attend and work in teams on the collaborative design of LOs and then these LOs are developed over the year. </li></ul></ul>
  6. 6. Camp Cloe <ul><li>Instructional Design & Learning Technology Workshop    </li></ul><ul><li>Learning Object Design Process      </li></ul><ul><li>Mock Learning Objects      </li></ul><ul><li>Project Management      </li></ul><ul><li>Understanding Learners      </li></ul><ul><li>Prototyping & User Testing      </li></ul><ul><li>Electronic Prototyping </li></ul>http://web.archive.org/web/20051029195100/tlc.uwaterloo.ca/projects/cloe/CaseStory/
  7. 7. CLOE design and development methodology created a rigorous set of standards for learning object creation.
  8. 8. http://www.brocku.ca/learningobjects/flash_content/index.html
  9. 9. http://www.brocku.ca/learningobjects/flash_content/LO/Stroop_Effect.html
  10. 10. Access Restrictions: These Learning Objects are being developed by ITS (Information Technology Services) in conjunction with CTLET (Centre for Teaching, Learning and Educational Technologies). All objects represent works near completion. As they are currently under development, they are authorized for use by Brock University personnel only, with permission. Completed learning objects are peer reviewed and can  be accessed through CLOE (Co-Operative Learning Object Exchange). Please contact CTLET if you would like to apply for full access to CLOE or if you would like more information on Brock University's learning object development. http://www.brocku.ca/learningobjects/flash_content/index.html Last updated: Friday, 01-Oct-2004 16:16:30 EDT
  11. 11. Form to add object to CLOE
  12. 12. 2. Peer Review CLOE partners concluded that a hallmark of CLOE should be that all LOs in CLOE should be Peer Reviewed. CLOE created its own Peer Review process modeled after the MERLOT Peer Review process ( http://taste.merlot.org/catalog/peer_review/ ) The CLOE Guidelines to Authors are used by both (a) creators of LOs to inform their design and development process and (b) CLOE Peer Reviewers when conducting a peer review.
  13. 13. The process that the CLOE Editor-in -Chief uses when a new LO is submitted to CLOE:
  14. 14. Guidelines for authors creating los and for peer reviewers evaluating los.
  15. 15. CLOE peer review process created a rigorous methodology and set of standards for learning object submission and review.
  16. 16. 3. Learning object repository <ul><li>Stand alone web site. </li></ul><ul><li>Access restricted. </li></ul><ul><li>No federated search. </li></ul><ul><li>D2L arrangement. </li></ul><ul><li>Reuse procedure (form). </li></ul><ul><li>Licensing. </li></ul>
  17. 17. CLOE lo ‘borrowing’ form.
  18. 18. 4. Administrative infrastructure <ul><li>UWaterloo provided director, admin support and technical components and support </li></ul><ul><li>Organized and hosted Camp Cloe </li></ul><ul><li>Memoranda of Understanding (MOUs) </li></ul>
  19. 19. Memorandum of Understanding <ul><li>When partners join CLOE a high-level official at that institution signs the CLOE Memorandum of Understanding (MOU). </li></ul><ul><li>The original MOU stated that each partner’s primary contribution was to submit LOs to CLOE and to reuse LOs from CLOE. </li></ul>
  20. 20. Memorandum of Understanding <ul><li>Potential new partners indicated that they wanted to be full and equal partners in CLOE and yet some of them indicated that based on the size and nature of their institution that they might not submit any LOs to CLOE. To address this issue, CLOE partners have created a new expanded MOU which allows partners to choose their commitment from a list of potential commitments. Each partner is not required to choose a specific number of items from the list but rather to choose the items that they can contribute. </li></ul>
  21. 21. Memorandum of Understanding <ul><li>Collaboration in the design of a LO </li></ul><ul><li>Collaboration in the development and subsequent use of a LO </li></ul><ul><li>Collaboration in the formative evaluation of the use of a LO </li></ul><ul><li>Peer review of LOs </li></ul><ul><li>Collaboration in the adaptation of a LO for use at the partner institution (normally this would not involve modifying the LO but rather documenting the use of the LO in a setting the is different than the setting envisioned by the designers and developers. For example, a LO created for 1st year Psychology being reused in a 2 nd year statistics course) </li></ul><ul><li>Reusing a LO from CLOE and providing summative evaluation to CLOE and the creators regarding the reuse. </li></ul>List of potential CLOE partner commitments.
  22. 22. <ul><li>Empower project leadership to set and achieve goals </li></ul><ul><ul><li>Select leaders and key staff with requisite experience; clearly communicate mission and goals of the organisation; and create an atmosphere that encourages an entrepreneurial spirit, including a willingness to test new ideas. </li></ul></ul><ul><li>Craft a strong value proposition </li></ul><ul><ul><li>Create a resource that offers unique value and continue to add value to the resource based on an understanding of users’ needs. </li></ul></ul><ul><li>Find creative ways to lower the direct costs of running the project. </li></ul><ul><ul><li>Secure contributions from the host institution; outsource work through vendors and other external partnerships; work with volunteers. </li></ul></ul><ul><li>Cultivate sources of revenue to cover both direct costs and ongoing upgrades. </li></ul><ul><ul><li>Experiment with different revenue models to find the ones that are the best fit for the project; show willingness to try new models; cultivate the ability to identify and communicate the value of the resource to the target audience (of customers, authors, subscribers and so forth). </li></ul></ul><ul><li>Establish a system of accountability and measurement of the success of the resource and the revenue model. </li></ul><ul><ul><li>Establish goals and targets and determine the balance between financial and mission-related returns; assess progress towards mission-based and financial goals and targets . </li></ul></ul>Sustaining Digital resources: An On-the-Ground View of Projects Today http://www.ithaka.org/ithaka-s-r/strategy/ithaka-case-studies-in-sustainability/report/SCA_Ithaka_SustainingDigitalResources_Report.pdf Key factors for Sustainability
  23. 23. Why did CLOE fail? <ul><li>LO Design and development? </li></ul><ul><li>Peer review? </li></ul><ul><li>Repository/reuse? </li></ul><ul><li>Administrative support? </li></ul>
  24. 24. Why did it fail? <ul><li>LO Design and development </li></ul><ul><li>Once grant funding ended no financial incentive to collaboratively design and develop. </li></ul><ul><li>Few universities and colleges had technical capacity built in (most CLOE LO development by students). </li></ul><ul><li>No demand by faculty to create objects for courses using CLOE methodology. </li></ul>
  25. 25. Why did it fail? <ul><li>Peer review </li></ul><ul><li>No recognition of peer review in promotion, retention, and tenure. </li></ul><ul><li>No interest by faculty in peer reviewing without recognition </li></ul><ul><li>Process too elaborate? </li></ul>
  26. 26. Why did it fail? <ul><li>Repository/reuse </li></ul><ul><li>Cumbersome registration/paperwork to reuse lo. </li></ul><ul><li>Low demand for lo reuse </li></ul><ul><li>D2L repository never becomes operational </li></ul><ul><li>The context question </li></ul><ul><ul><li>not an open resource </li></ul></ul><ul><ul><li>remix/repurpose restricted through no access to source code or license </li></ul></ul><ul><ul><li>no demand because … </li></ul></ul>
  27. 27. Impact on teaching practices: <ul><li>“ The foremost reason for not using digital resources was that they did not support faculty’s teaching approaches.” </li></ul><ul><li>Time to identify and adapt resources : “Lack of time was a major constraint, regardless of institution.” </li></ul><ul><li>Reusing resources in new contexts : “Faculty, including those active and enthusiastic in their use of digital resources, identified many other obstacles to using these resources for teaching, including how to . . . reuse them in new contexts” </li></ul>Opening Up Education http://mitpress.mit.edu/books/chapters/0262033712chap12.pdf
  28. 28. Why did it fail? <ul><li>Administrative support </li></ul><ul><li>UWaterloo pulls out support after funding ends </li></ul><ul><li>Unsustainable by volunteers/in kind contributions </li></ul>
  29. 29. Key factors for Sustainability <ul><li>Assume grant funding will not always be available </li></ul><ul><li>Define sustainability – determine need to generate revenue beyond operating costs </li></ul><ul><li>Understand, monitor and measure the demand side of the project </li></ul><ul><li>Consider options for long term governance </li></ul><ul><li>Develop marketing plans and seek out strategic partnerships </li></ul><ul><li>Be prepared to change direction in a rapidly changing environment </li></ul><ul><li>Leaders need to be fully dedicated, fully invested and focused </li></ul><ul><li>Support a culture of experimentation and innovation </li></ul>Sustainability and Revenue Models for Online Academic Resources http://sca.jiscinvolve.org/files/2008/06/sca_ithaka_sustainability_report-final.pdf
  30. 30. <ul><li>Empower project leadership to set and achieve goals </li></ul><ul><ul><li>Select leaders and key staff with requisite experience; clearly communicate mission and goals of the organization; and create an atmosphere that encourages an entrepreneurial spirit, including a willingness to test new ideas. </li></ul></ul><ul><li>Craft a strong value proposition </li></ul><ul><ul><li>Create a resource that offers unique value and continue to add value to the resource based on an understanding of users’ needs. </li></ul></ul><ul><li>Find creative ways to lower the direct costs of running the project. </li></ul><ul><ul><li>Secure contributions from the host institution; outsource work through vendors and other external partnerships; work with volunteers. </li></ul></ul><ul><li>Cultivate sources of revenue to cover both direct costs and ongoing upgrades. </li></ul><ul><ul><li>Experiment with different revenue models to find the ones that are the best fit for the project; show willingness to try new models; cultivate the ability to identify and communicate the value of the resource to the target audience (of customers, authors, subscribers and so forth). </li></ul></ul><ul><li>Establish a system of accountability and measurement of the success of the resource and the revenue model. </li></ul><ul><ul><li>Establish goals and targets and determine the balance between financial and mission-related returns; assess progress towards mission-based and financial goals and targets . </li></ul></ul>Sustaining Digital resources: An On-the-Ground View of Projects Today http://www.ithaka.org/ithaka-s-r/strategy/ithaka-case-studies-in-sustainability/report/SCA_Ithaka_SustainingDigitalResources_Report.pdf Key factors for Sustainability
  31. 31. Thank you.

×