• Save
Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence
Upcoming SlideShare
Loading in...5
×
 

Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence

on

  • 1,877 views

Much of the evidence surrounding the use (and re-use) of OER is fragmentary or anecdotal. The OLnet project has developed a software tool for effectively gathering, sharing and judging the evidence ...

Much of the evidence surrounding the use (and re-use) of OER is fragmentary or anecdotal. The OLnet project has developed a software tool for effectively gathering, sharing and judging the evidence around key issues of OER. The Evidence Hub distills key insights from the cloud of discussion and opinion creating a thematically indexed, structured ecosystem of organisations, project, issues, recommendations and evidence for the use of those who form the Open Education movement. In this presentation we explain the key concepts behind the Evidence Hub and some of its possible uses.

Statistics

Views

Total Views
1,877
Views on SlideShare
1,423
Embed Views
454

Actions

Likes
1
Downloads
0
Comments
0

7 Embeds 454

http://cloudworks.ac.uk 211
http://www.open.ac.uk 196
http://flavors.me 40
http://translate.googleusercontent.com 4
http://cent.uji.es 1
http://webcache.googleusercontent.com 1
http://www.slashdocs.com 1
More...

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Show evidence hub and information from flowers
  • Highlights of the organisation node page designed to show how the different data types fit together
  • This slide attempts to give a simple explanation of the data model used and to get from the idea of mapping organisations to the idea of mapping more ephemeral data and views on OER
  • Now looking at an individual theme... I would note the related organisations & possibility of following a theme. Themes provide the ‘glue’ for sticking together different kinds of data. I’ve added a link to the live page at the bottom so that you can just explore straight from here. Lots of the entries relating to copyright also relate to access. I suggest that you find a pathway to the access theme page and then cut back to use the next slide.
  • Again, a link to live site provided for convenience. At this point I would talk about how the themes provide ways of identifying challenges & associating them with possible solutions... So, moving on to the more practical aspects of the site.
  • Complex thematic map shows how these simple connections can capture the complexity of the OER world
  • Overview of the purpose of challenge and solution categories within EH
  • Example of challenge. Note url link to original identification of challenge. Two potential solutions have been proposed. These can be explored through the tinyurl link.
  • Example of solution. Formally proposed a link to an existing challenge (copyright) by proposing the use of an open web tool. Again, can be explored through tinyurl.
  • So far, we haven’t really spoken about evidence. But that’s got to be the main thrust of this.
  • NB Claims Garden entry. Example of a claim with links to nine pieces of evidence that have been cited in support of the claim. Note similar number of pieces of counter-evidence. It’s up to the OER community to decide for themselves. This is an illustration of the ‘storyteller’ or anecdotal evidence that is distilled within the hub.
  • Here is an evidence node. In this case, it’s a very recent JISC report which could be considered cutting edge research at the other end of the spectrum from anecdotal evidence. It shows the way that the EH can distill the different claims made in different discourses and bring them together in a way that doesn’t happen anywhere else. Tinyurl if you want to explore the ‘related claims’ which are supported by this piece of evidence. It might be worth pointing out at this stage that we’re just dealing with the metadata and not hosting (or deciding upon) the evidence ourselves.
  • Another example of an evidence node. This was a major UNESCO OER policy forum which produced a number of practical solutions... (leads into discussion of advocacy)
  • Show evidence hub and url, YouTube video guide

Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence Presentation Transcript

  • Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence   Anna De Liddo & Rob Farrow Knowledge Media Institute/Institute of Educational Technology The Open University, UK [email_address] / [email_address] OER OpenOpen Event Open University, Wednesday 7 Dec olnet.org
    • Despite the widespread diffusion of the Open Education movement, the level of adoption of OERs into common Educational Policy and Teaching Practices remains quite low.
    • Why is this the case?
    olnet.org
  • The issue: lack of evidence of OER effectiveness
    • We propose that one of the barriers to OER adoption is the lack of evidence of OER effectiveness .
    olnet.org View slide
  • OLnet project: The wider research question olnet.org RQ: How can we help researchers and practitioners in the OER field to contribute to the evidences of OER effectiveness and to i nvestigate these evidences collaboratively? View slide
  • Approach: Contested Collective Intelligence olnet.org
    • Collective Intelligence : Need to build on collective insights and experiences, but adding a layer to structure and index that knowledge sharing so that it is not locked in minds or documents and it can be put in value
    • Discourse : Sensemaking, and learning, occur through discourse: the sharing and critiquing of ideas in ways that both affirm and challenge
    • Our approach to CI focuses on:
    • capturing the hidden knowledge of the OER movement and leveraging it so that can be:
    • debated ( building and confronting arguments) ,
    • evaluated (assessing evidence ), and
    • put in value (distill claims used to inform practice and policy)
  • The Evidence Hub olnet.org
    • What:
    • The Evidence Hub provides
    • the OER community with a space to harvest the evidence of OER effectiveness
    • policy makers with a community-generated knowledge base to make evidence based decision on Educational Policy.
    • How:
    • The Evidence Hub provides an environment to systematically interrogate the Open Education movement on what are the
    • Social Ecosystem
    • People (Contributors)
    • Projects
    • Organizations
    • Discourse Ecosystem
    • Key challenges
    • Issues,
    • Solutions,
    • Claims
    • Evidence
    • Resources
  • The Evidence Hub olnet.org
    • What:
    • The Evidence Hub provides
    • the OER community with a space to harvest the evidence of OER effectiveness
    • policy makers with a community-generated knowledge base to make evidence based decision on Educational Policy.
    • How:
    • The Evidence Hub provides an environment to systematically interrogate the Open Education movement on what are the
    • Social Ecosystem
    • People (Contributors)
    • Projects
    • Organizations
    • Discourse Ecosystem
    • Key challenges
    • Issues,
    • Solutions,
    • Claims
    • Evidence
    • Resources
    OER Themes Themes are used to group elements across the different ecosystems
  • The Discourse Ecosystem Elements: A Simplified Data Model olnet.org
  • The Discourse Ecosystem Elements: A Simplified Data Model olnet.org
  • A Simplified Data Model olnet.org
  • A Simplified Data Model olnet.org
  • A Simplified Data Model olnet.org
  • A Simplified Data Model olnet.org
  • A Simplified Data Model olnet.org
  • Evidence Types: From simple data, anecdotes and stories to literature Analysis and Experimental Results olnet.org
  • Social Ecosystems (Org and Projects) olnet.org
  • Social Ecosystems (Org and Projects) olnet.org
  • Social Ecosystems (Org and Projects) olnet.org
  • Social Ecosystems (Org and Projects) olnet.org
  • Social Ecosystems (Org and Projects) olnet.org
  • Social Ecosystems (Org and Projects) olnet.org
  • CI: Community Actions
    • Social Ecosystem
    • People (Contributors)
    • Projects
    • Organizations
    • Discourse Ecosystem
    • Key challenges
    • Issues,
    • Solutions,
    • Claims
    • Evidence
    • Resources
    Locating: Adding geo-location info
  • CI: Community Actions
    • Social Ecosystem
    • People (Contributors)
    • Projects
    • Organizations
    • Discourse Ecosystem
    • Key challenges
    • Issues,
    • Solutions,
    • Claims
    • Evidence
    • Resources
    Locating: Adding geo-location info Following: Expressing Interest
  • CI: Community Actions
    • Social Ecosystem
    • People (Contributors)
    • Projects
    • Organizations
    • Discourse Ecosystem
    • Key challenges
    • Issues,
    • Solutions,
    • Claims
    • Evidence
    • Resources
    Connecting: Adding to Widget Locating: Adding geo-location info Following: Expressing Interest
  • CI: Community Actions
    • Social Ecosystem
    • People (Contributors)
    • Projects
    • Organizations
    • Discourse Ecosystem
    • Key challenges
    • Issues,
    • Solutions,
    • Claims
    • Evidence
    • Resources
    Connecting: Adding to Widget Locating: Adding geo-location info Following: Promoting: Ordering-Prioritizing lists Voting Connections Expressing Interest
  • CI: Community Actions
    • Social Ecosystem
    • People (Contributors)
    • Projects
    • Organizations
    • Discourse Ecosystem
    • Key challenges
    • Issues,
    • Solutions,
    • Claims
    • Evidence
    • Resources
    Theming: Adding OER Themes Connecting: Adding to Widget Locating: Adding geo-location info Following: Promoting: Ordering-Prioritizing lists Voting Connections Expressing Interest
  • CI: Community Actions
    • Social Ecosystem
    • People (Contributors)
    • Projects
    • Organizations
    • Discourse Ecosystem
    • Key challenges
    • Issues,
    • Solutions,
    • Claims
    • Evidence
    • Resources
    Theming: Adding OER Themes Connecting: Adding to Widget Locating: Adding geo-location info Following: Promoting: Ordering-Prioritizing lists Voting Connections Expressing Interest
  • A Demo of the Evidence Hub…. olnet.org
  •  
  • Exploring the OER landscape through projects/organizations and their physical locations…
  •  
  • Navigating by theme… Creating new connections… Tagging…
  • http://ci.olnet.org/themenode.php?nodeid=1371081452500311153001298904756&nodetype=Theme9
  • http://ci.olnet.org/themenode.php?nodeid=1371081452500307806001301388177&nodetype=Theme
  •  
    • Challenges & Solutions
    • Using CI to both identify ‘challenges’ and find ‘solutions’
    • Capturing and visualizing relationships between disparate elements of OER world
    • Providing a mechanic to assess the importance of problems and the viability of solutions
    • Building up a picture of priorities, successes and failures
  • http://ci.olnet.org/issuenode.php?q=inadequate%20institutional%20policies&nodeid=137108145400117650001314182623&nodetype=Issue
  • http://tinyurl.com/5thcqzs
  •  
  • Key Challenges
    • Research, Evidence and Claims
      • What makes a challenge important, or a solution meaningful?
      • We need to find evidence for the different kinds of claims being made
      • Evidence can be subjected to the same CI process, providing the OER movement with a basis for the claims it wants to make
  • http://ci.olnet.org/claimnode.php?q=oer%20delivers&nodeid=1215531100880909001301458516&nodetype=Claim
  • http://ci.olnet.org/evidencenode.php?q=jisc&nodeid=137108145400024718001315313007&nodetype=Data
  • http://ci.olnet.org/evidencenode.php?q=capacity&nodeid=137108145400029591001315407654&nodetype=Data
  • • Unobstructed licenses expand student access to high-quality, up-to-date, engaging, and customized content more quickly, cost-effectively, and efficiently than today. • Unobstructed licenses unlock educational resources that are developed using taxpayer dollars so they can be shared, customized, and improved, yielding a far greater return on investment to the public. • Open educational resources with unobstructed licenses are the path forward to ensure every student has access to high-quality, engaging, personalized, and up-to-date content. • Ultimately, open educational resources with unobstructed licenses can help transform our schools by producing better equipped teachers, better prepared students, and better education outcomes Advocacy
  • www.ci.olnet.org / http://www.youtube.com/watch?v=Oo3xPyoiwYg
  • Future Research: Explore, Filter and Makesense
    • When social and discourse elements become too many in number and complexity how can we make sense of them?
    • Toward CI visualization and analysis…
    olnet.org
  • Watch the demo video at: http://www.youtube.com/watch?v=Fcn2ab9PYo4 Watch the Open Deliberation model video at: http://www.youtube.com/watch?v=vthygbKA2Mg Discourse Network Visualization
  • Social Network Visualization
    • De Liddo, A., Sándor, Á .,Buckingham Shum, S., Contested Collective Intelligence: Rationale, Technologies, and a Human-Machine Annotation Study, CSCW Journal (In Press)
    • De Liddo, Anna and Buckingham Shum, Simon (2010). Capturing and representing deliberation in participatory planning practices. In: Fourth International Conference on Online Deliberation (OD2010), 30 Jun - 2 Jul 2010, Leeds, UK. Retrieved from http://oro.open.ac.uk/22279/
    • Buckingham Shum, Simon and De Liddo, Anna (2010). Collective intelligence for OER sustainability. In: OpenED2010: Seventh Annual Open Education Conference, 2-4 Nov 2010, Barcelona, Spain. Available at: http://oro.open.ac.uk/23352/
    • De Liddo, Anna (2010). From open content to open thinking. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications (Ed-Media 2010), 29 Jun, Toronto, Canada. Available at: http://oro.open.ac.uk/22283/
    • De Liddo, Anna and Alevizou, Panagiota (2010). A method and tool to support the analysis and enhance the understanding of peer-­to-­peer learning experiences. In: OpenED2010: Seventh Annual Open Education Conference, 2-4 Nov 2010, Barcelona, Spain. Available at: http://oro.open.ac.uk/23392/
    • Thanks for Your Attention!
    • Anna De Liddo
    References