Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence    Anna De Liddo & Rob Farrow ...
<ul><li>Despite the widespread diffusion of the Open Education movement, the level of adoption of OERs into common Educati...
The issue: lack of  evidence of OER effectiveness <ul><li>We propose that one of the barriers to OER adoption is the lack ...
OLnet project:  The wider research question olnet.org RQ:  How can we help researchers and practitioners in the OER field ...
Approach:  Contested Collective Intelligence olnet.org <ul><li>Collective Intelligence : Need to build on collective insig...
The Evidence Hub olnet.org <ul><li>What: </li></ul><ul><li>The Evidence Hub provides  </li></ul><ul><li>the OER community ...
The Evidence Hub olnet.org <ul><li>What: </li></ul><ul><li>The Evidence Hub provides  </li></ul><ul><li>the OER community ...
The Discourse Ecosystem Elements: A Simplified Data Model olnet.org
The Discourse Ecosystem Elements: A Simplified Data Model olnet.org
A Simplified Data Model olnet.org
A Simplified Data Model olnet.org
A Simplified Data Model olnet.org
A Simplified Data Model olnet.org
A Simplified Data Model olnet.org
Evidence Types: From simple data, anecdotes and stories to literature Analysis and Experimental Results olnet.org
Social Ecosystems (Org and Projects) olnet.org
Social Ecosystems (Org and Projects) olnet.org
Social Ecosystems (Org and Projects) olnet.org
Social Ecosystems (Org and Projects) olnet.org
Social Ecosystems (Org and Projects) olnet.org
Social Ecosystems (Org and Projects) olnet.org
CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></u...
CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></u...
CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></u...
CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></u...
CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></u...
CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></u...
A Demo of the Evidence Hub…. olnet.org
 
Exploring the OER landscape through projects/organizations and their physical locations…
 
Navigating by theme… Creating new connections… Tagging…
http://ci.olnet.org/themenode.php?nodeid=1371081452500311153001298904756&nodetype=Theme9
http://ci.olnet.org/themenode.php?nodeid=1371081452500307806001301388177&nodetype=Theme
 
<ul><li>Challenges & Solutions </li></ul><ul><li>Using CI to both identify ‘challenges’ and find ‘solutions’ </li></ul><ul...
http://ci.olnet.org/issuenode.php?q=inadequate%20institutional%20policies&nodeid=137108145400117650001314182623&nodetype=I...
http://tinyurl.com/5thcqzs
 
Key Challenges
<ul><li>Research, Evidence and Claims </li></ul><ul><ul><li>What makes a challenge important, or a solution meaningful? </...
http://ci.olnet.org/claimnode.php?q=oer%20delivers&nodeid=1215531100880909001301458516&nodetype=Claim
http://ci.olnet.org/evidencenode.php?q=jisc&nodeid=137108145400024718001315313007&nodetype=Data
http://ci.olnet.org/evidencenode.php?q=capacity&nodeid=137108145400029591001315407654&nodetype=Data
•  Unobstructed licenses expand student access to high-quality, up-to-date, engaging, and customized content more quickly,...
www.ci.olnet.org   /  http://www.youtube.com/watch?v=Oo3xPyoiwYg
Future Research:  Explore, Filter and Makesense <ul><li>When social and discourse elements become too many in number and c...
Watch the demo video at:  http://www.youtube.com/watch?v=Fcn2ab9PYo4   Watch the Open Deliberation model video at:  http:/...
Social Network Visualization
<ul><li>De Liddo, A., Sándor, Á .,Buckingham Shum, S., Contested Collective Intelligence: Rationale, Technologies, and a...
Upcoming SlideShare
Loading in …5
×

Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence

2,287 views

Published on

Much of the evidence surrounding the use (and re-use) of OER is fragmentary or anecdotal. The OLnet project has developed a software tool for effectively gathering, sharing and judging the evidence around key issues of OER. The Evidence Hub distills key insights from the cloud of discussion and opinion creating a thematically indexed, structured ecosystem of organisations, project, issues, recommendations and evidence for the use of those who form the Open Education movement. In this presentation we explain the key concepts behind the Evidence Hub and some of its possible uses.

  • Be the first to comment

Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence

  1. 1. Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence   Anna De Liddo & Rob Farrow Knowledge Media Institute/Institute of Educational Technology The Open University, UK [email_address] / [email_address] OER OpenOpen Event Open University, Wednesday 7 Dec olnet.org
  2. 2. <ul><li>Despite the widespread diffusion of the Open Education movement, the level of adoption of OERs into common Educational Policy and Teaching Practices remains quite low. </li></ul><ul><li>Why is this the case? </li></ul>olnet.org
  3. 3. The issue: lack of evidence of OER effectiveness <ul><li>We propose that one of the barriers to OER adoption is the lack of evidence of OER effectiveness . </li></ul>olnet.org
  4. 4. OLnet project: The wider research question olnet.org RQ: How can we help researchers and practitioners in the OER field to contribute to the evidences of OER effectiveness and to i nvestigate these evidences collaboratively?
  5. 5. Approach: Contested Collective Intelligence olnet.org <ul><li>Collective Intelligence : Need to build on collective insights and experiences, but adding a layer to structure and index that knowledge sharing so that it is not locked in minds or documents and it can be put in value </li></ul><ul><li>Discourse : Sensemaking, and learning, occur through discourse: the sharing and critiquing of ideas in ways that both affirm and challenge </li></ul><ul><li>Our approach to CI focuses on: </li></ul><ul><li>capturing the hidden knowledge of the OER movement and leveraging it so that can be: </li></ul><ul><li>debated ( building and confronting arguments) , </li></ul><ul><li>evaluated (assessing evidence ), and </li></ul><ul><li>put in value (distill claims used to inform practice and policy) </li></ul>
  6. 6. The Evidence Hub olnet.org <ul><li>What: </li></ul><ul><li>The Evidence Hub provides </li></ul><ul><li>the OER community with a space to harvest the evidence of OER effectiveness </li></ul><ul><li>policy makers with a community-generated knowledge base to make evidence based decision on Educational Policy. </li></ul><ul><li>How: </li></ul><ul><li>The Evidence Hub provides an environment to systematically interrogate the Open Education movement on what are the </li></ul><ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></ul><ul><li>Organizations </li></ul><ul><li>Discourse Ecosystem </li></ul><ul><li>Key challenges </li></ul><ul><li>Issues, </li></ul><ul><li>Solutions, </li></ul><ul><li>Claims </li></ul><ul><li>Evidence </li></ul><ul><li>Resources </li></ul>
  7. 7. The Evidence Hub olnet.org <ul><li>What: </li></ul><ul><li>The Evidence Hub provides </li></ul><ul><li>the OER community with a space to harvest the evidence of OER effectiveness </li></ul><ul><li>policy makers with a community-generated knowledge base to make evidence based decision on Educational Policy. </li></ul><ul><li>How: </li></ul><ul><li>The Evidence Hub provides an environment to systematically interrogate the Open Education movement on what are the </li></ul><ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></ul><ul><li>Organizations </li></ul><ul><li>Discourse Ecosystem </li></ul><ul><li>Key challenges </li></ul><ul><li>Issues, </li></ul><ul><li>Solutions, </li></ul><ul><li>Claims </li></ul><ul><li>Evidence </li></ul><ul><li>Resources </li></ul>OER Themes Themes are used to group elements across the different ecosystems
  8. 8. The Discourse Ecosystem Elements: A Simplified Data Model olnet.org
  9. 9. The Discourse Ecosystem Elements: A Simplified Data Model olnet.org
  10. 10. A Simplified Data Model olnet.org
  11. 11. A Simplified Data Model olnet.org
  12. 12. A Simplified Data Model olnet.org
  13. 13. A Simplified Data Model olnet.org
  14. 14. A Simplified Data Model olnet.org
  15. 15. Evidence Types: From simple data, anecdotes and stories to literature Analysis and Experimental Results olnet.org
  16. 16. Social Ecosystems (Org and Projects) olnet.org
  17. 17. Social Ecosystems (Org and Projects) olnet.org
  18. 18. Social Ecosystems (Org and Projects) olnet.org
  19. 19. Social Ecosystems (Org and Projects) olnet.org
  20. 20. Social Ecosystems (Org and Projects) olnet.org
  21. 21. Social Ecosystems (Org and Projects) olnet.org
  22. 22. CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></ul><ul><li>Organizations </li></ul><ul><li>Discourse Ecosystem </li></ul><ul><li>Key challenges </li></ul><ul><li>Issues, </li></ul><ul><li>Solutions, </li></ul><ul><li>Claims </li></ul><ul><li>Evidence </li></ul><ul><li>Resources </li></ul>Locating: Adding geo-location info
  23. 23. CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></ul><ul><li>Organizations </li></ul><ul><li>Discourse Ecosystem </li></ul><ul><li>Key challenges </li></ul><ul><li>Issues, </li></ul><ul><li>Solutions, </li></ul><ul><li>Claims </li></ul><ul><li>Evidence </li></ul><ul><li>Resources </li></ul>Locating: Adding geo-location info Following: Expressing Interest
  24. 24. CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></ul><ul><li>Organizations </li></ul><ul><li>Discourse Ecosystem </li></ul><ul><li>Key challenges </li></ul><ul><li>Issues, </li></ul><ul><li>Solutions, </li></ul><ul><li>Claims </li></ul><ul><li>Evidence </li></ul><ul><li>Resources </li></ul>Connecting: Adding to Widget Locating: Adding geo-location info Following: Expressing Interest
  25. 25. CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></ul><ul><li>Organizations </li></ul><ul><li>Discourse Ecosystem </li></ul><ul><li>Key challenges </li></ul><ul><li>Issues, </li></ul><ul><li>Solutions, </li></ul><ul><li>Claims </li></ul><ul><li>Evidence </li></ul><ul><li>Resources </li></ul>Connecting: Adding to Widget Locating: Adding geo-location info Following: Promoting: Ordering-Prioritizing lists Voting Connections Expressing Interest
  26. 26. CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></ul><ul><li>Organizations </li></ul><ul><li>Discourse Ecosystem </li></ul><ul><li>Key challenges </li></ul><ul><li>Issues, </li></ul><ul><li>Solutions, </li></ul><ul><li>Claims </li></ul><ul><li>Evidence </li></ul><ul><li>Resources </li></ul>Theming: Adding OER Themes Connecting: Adding to Widget Locating: Adding geo-location info Following: Promoting: Ordering-Prioritizing lists Voting Connections Expressing Interest
  27. 27. CI: Community Actions <ul><li>Social Ecosystem </li></ul><ul><li>People (Contributors) </li></ul><ul><li>Projects </li></ul><ul><li>Organizations </li></ul><ul><li>Discourse Ecosystem </li></ul><ul><li>Key challenges </li></ul><ul><li>Issues, </li></ul><ul><li>Solutions, </li></ul><ul><li>Claims </li></ul><ul><li>Evidence </li></ul><ul><li>Resources </li></ul>Theming: Adding OER Themes Connecting: Adding to Widget Locating: Adding geo-location info Following: Promoting: Ordering-Prioritizing lists Voting Connections Expressing Interest
  28. 28. A Demo of the Evidence Hub…. olnet.org
  29. 30. Exploring the OER landscape through projects/organizations and their physical locations…
  30. 32. Navigating by theme… Creating new connections… Tagging…
  31. 33. http://ci.olnet.org/themenode.php?nodeid=1371081452500311153001298904756&nodetype=Theme9
  32. 34. http://ci.olnet.org/themenode.php?nodeid=1371081452500307806001301388177&nodetype=Theme
  33. 36. <ul><li>Challenges & Solutions </li></ul><ul><li>Using CI to both identify ‘challenges’ and find ‘solutions’ </li></ul><ul><li>Capturing and visualizing relationships between disparate elements of OER world </li></ul><ul><li>Providing a mechanic to assess the importance of problems and the viability of solutions </li></ul><ul><li>Building up a picture of priorities, successes and failures </li></ul>
  34. 37. http://ci.olnet.org/issuenode.php?q=inadequate%20institutional%20policies&nodeid=137108145400117650001314182623&nodetype=Issue
  35. 38. http://tinyurl.com/5thcqzs
  36. 40. Key Challenges
  37. 41. <ul><li>Research, Evidence and Claims </li></ul><ul><ul><li>What makes a challenge important, or a solution meaningful? </li></ul></ul><ul><ul><li>We need to find evidence for the different kinds of claims being made </li></ul></ul><ul><ul><li>Evidence can be subjected to the same CI process, providing the OER movement with a basis for the claims it wants to make </li></ul></ul>
  38. 42. http://ci.olnet.org/claimnode.php?q=oer%20delivers&nodeid=1215531100880909001301458516&nodetype=Claim
  39. 43. http://ci.olnet.org/evidencenode.php?q=jisc&nodeid=137108145400024718001315313007&nodetype=Data
  40. 44. http://ci.olnet.org/evidencenode.php?q=capacity&nodeid=137108145400029591001315407654&nodetype=Data
  41. 45. • Unobstructed licenses expand student access to high-quality, up-to-date, engaging, and customized content more quickly, cost-effectively, and efficiently than today. • Unobstructed licenses unlock educational resources that are developed using taxpayer dollars so they can be shared, customized, and improved, yielding a far greater return on investment to the public. • Open educational resources with unobstructed licenses are the path forward to ensure every student has access to high-quality, engaging, personalized, and up-to-date content. • Ultimately, open educational resources with unobstructed licenses can help transform our schools by producing better equipped teachers, better prepared students, and better education outcomes Advocacy
  42. 46. www.ci.olnet.org / http://www.youtube.com/watch?v=Oo3xPyoiwYg
  43. 47. Future Research: Explore, Filter and Makesense <ul><li>When social and discourse elements become too many in number and complexity how can we make sense of them? </li></ul><ul><li>Toward CI visualization and analysis… </li></ul>olnet.org
  44. 48. Watch the demo video at: http://www.youtube.com/watch?v=Fcn2ab9PYo4 Watch the Open Deliberation model video at: http://www.youtube.com/watch?v=vthygbKA2Mg Discourse Network Visualization
  45. 49. Social Network Visualization
  46. 50. <ul><li>De Liddo, A., Sándor, Á .,Buckingham Shum, S., Contested Collective Intelligence: Rationale, Technologies, and a Human-Machine Annotation Study, CSCW Journal (In Press) </li></ul><ul><li>De Liddo, Anna and Buckingham Shum, Simon (2010). Capturing and representing deliberation in participatory planning practices. In: Fourth International Conference on Online Deliberation (OD2010), 30 Jun - 2 Jul 2010, Leeds, UK. Retrieved from http://oro.open.ac.uk/22279/ </li></ul><ul><li>Buckingham Shum, Simon and De Liddo, Anna (2010). Collective intelligence for OER sustainability. In: OpenED2010: Seventh Annual Open Education Conference, 2-4 Nov 2010, Barcelona, Spain. Available at: http://oro.open.ac.uk/23352/ </li></ul><ul><li>De Liddo, Anna (2010). From open content to open thinking. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications (Ed-Media 2010), 29 Jun, Toronto, Canada. Available at: http://oro.open.ac.uk/22283/ </li></ul><ul><li>De Liddo, Anna and Alevizou, Panagiota (2010). A method and tool to support the analysis and enhance the understanding of peer-­to-­peer learning experiences. In: OpenED2010: Seventh Annual Open Education Conference, 2-4 Nov 2010, Barcelona, Spain. Available at: http://oro.open.ac.uk/23392/ </li></ul><ul><li>Thanks for Your Attention! </li></ul><ul><li>Anna De Liddo </li></ul>References

×