OER Impact: Collaboration, Evidence, Synthesis

Robert Farrow
Robert FarrowSenior Research Fellow, Institute of Educational Technology
OER Impact: Collaboration,
Evidence, Synthesis
Dr. Rob Farrow
The Open University
Structure
OER Research Hub
Collaborative Research
Evidence Model
Synthesis: Mapping and Curation
OER Impact Map
please tweet to #oermap
• Research project at The Open University (UK)
• Funded by William & Flora Hewlett Foundation for two years
• Research team led by two professors
• Tasked with building the most comprehensive picture of OER impact
• Organised by eleven research hypotheses
• Collaboration model works across different educational sectors
• Global reach but with a USA focus
OER Research Hub
oerresearchhub.org
#oerrhub
Rationale
• Consolidatory phase for OER movement after years of investment and piloting
• The need for an evidence base: advocacy, strategy, policymaking
• Lack of robust evidence for OER impact
• The evidence ‘problem’ in OER impact research
• Isolated ‘pockets of innovation’
• No agreement over best methods for impact comparison
• Compare diverse experiences to assess the influence of ‘open’
• Mixed methods data from experimental + non-experimental research
Collaboration
Developing an ecology of sharing
OER Impact: Collaboration, Evidence, Synthesis
• Research instruments applied
consistently across collaborations:
surveys, interview questions,
focus groups, etc.
• Supplemented by integration of
secondary research
• ‘Agile’ research, sprinting
• Thematic and methodological
cohesion provided by research
hypotheses
Research Process
Inclusive
Holistic
Validation of experiences at the ‘cutting edge’
Open to diverse perspectives
Incommensurability?
Granularity?
Synthesis?
Practical Advantages /
Methodological Disadvantages
How will comparison
of experiences be
made rigorous?
Hypotheses
Key claims about open education
Keyword Research Hypothesis
Performance OER improve student performance/satisfaction
Openness People use OER differently from other online materials
Access OER widen participation in education
Retention OER can help at-risk learners to finish their studies
Reflection OER use leads educators to reflect on their practice
Finance OER adoption brings financial benefits for students/institutions
Indicators Informal learners use a variety of indicators when selecting OER
Support Informal learners develop their own forms of study support
Transition OER support informal learners in moving to formal study
Policy OER use encourages institutions to change their policies
Assessment Informal assessments motivate learners using OER
‘Evidence’ is only evidence in relation to a claim or hypothesis:
the project hypotheses form the core of the metadata model.
Evidence Model
Design for information architecture
Key Questions for Evidence Model
What evidence exists to support key claims about OER?
How do patterns of OER impact differ across countries?
How do patterns of OER impact differ according to sector?
How can the veracity of evidence be checked?
How can diverse evidence forms be meaningfully collected together?
• TextTitle
• Text / HTML - Supports embedding of multimediaCopy
• Association of evidence with hypothesisHypothesis
• Evidence is either +ve/-ve in relation to a hypothesisPolarity
• GeolocationLocation
• School (K12) / College / Higher Education / InformalSector
• Academic citation or Hyperlink / URLCitation
Evidence: Information Architecture
Support embedding
Evidence Records
• Popular OS
platform
• Easy to customize
• Over 27,000
existing plugins
Wordpress
• CSV importer
• Location plugin
• JSON
Customization
• Project code
available on
GitHub
• Easy to link, share
and engage
Openness
Technical Development
Synthesis
Synthesis Methods
• Isolating data by hypothesis, sector, country, or any combination
• Collaborative curation of research data
• Data visualization, reporting
• Editorial quality control exercised centrally
Validation
• Iteration through current and future patterns of evidence
• Open citation trails allow public auditing of evidence
• Community voting
Synthesis
Mapping and curation
in service of The Open University
OER Impact Map
oermap.org
OER Impact Map: Maps
oermap.org
• Country Summary Map - evidence nodes organized by country
• OER Project Map - OER initiatives and projects around the world
• OER Evidence Map - all impact evidence is categorized according to the OER
Research Hub hypotheses
• OER Policy Map is the single largest curated collection of OER policies
• OER Impact Map aggregates the other maps
• Tweetmaps show a geographical summary of tweets for a particular Twitter
hashtag. E.g. #oermap for outreach; #oerrhub for tracking project activity.
• Maps by others
Global Impact Summary
Select country to zoom
in service of The Open University
Flowmap changes according
to country selected…
Impact Summary (USA)
Node colour = sector
Node border = polarity
in service of The Open University
Positive Evidence
Negative Evidence
Uncategorized Evidence
OER Evidence Map
OER Policy Map
L
R
N
I
Local/Institutional policies
Regional policies
National policies
International policies
CC Open Policy Network
POERUP
SPARC
in service of The Open University
OER Projects
OER Project Map
in service of The Open University
OER Impact Map
in service of The Open University
OER Impact Map
Combines other maps
Supports filtering
Hypothesis Reporting
Hypothesis Reporting
in service of The Open University
in service of The Open University
Summary
• A collaborative approach to OER research is recommended
• OER Impact Map is a tool designed for the needs of the open community
• Open methods for researching openness: openly licensed instruments; remix
and reuse data; working openly; sharing
• Takeaway message: the whole is greater than the sum of the parts
Next Steps
• Adding qualitative data analysis to evidence base
• Increasing the evidence base through desk research
• Plan for final phase of map development
• Case studies
• New collaborations?
• New hypotheses?
• School of Open course on open research; Open Data; CC-BY research tools
• Survey data ‘exploration tool’
in service of The Open University
Survey Data Explorer (prototype)
in service of The Open University
Survey Data Explorer (prototype)
in service of The Open University
Survey Data Explorer (prototype)
tweetmap
tiny.cc/oermap
#oermap
in service of The Open University
We want to put you on the map!
So let us know about OER activity
and impact in your institution
Join us in building understanding
of open education
Thanks for listening!
oerresearchhub.org
oermap.org
rob.farrow@open.ac.uk
@philosopher1978
1 of 43

Recommended

Open approaches to OER impact research by
Open approaches to OER impact research Open approaches to OER impact research
Open approaches to OER impact research Robert Farrow
718 views49 slides
How to benchmark quality in MOOCs - the OpenupEd label by
How to benchmark quality in MOOCs  - the OpenupEd labelHow to benchmark quality in MOOCs  - the OpenupEd label
How to benchmark quality in MOOCs - the OpenupEd labelJon Rosewell
2.9K views18 slides
Taking advantage of openness: understanding the variety of perspectives on op... by
Taking advantage of openness: understanding the variety of perspectives on op...Taking advantage of openness: understanding the variety of perspectives on op...
Taking advantage of openness: understanding the variety of perspectives on op...OER Hub
333 views43 slides
Open Educational Resources: Impact, Evidence & Narrative by
Open Educational Resources: Impact, Evidence & NarrativeOpen Educational Resources: Impact, Evidence & Narrative
Open Educational Resources: Impact, Evidence & NarrativeOER Hub
701 views40 slides
OER Impact: Towards an Evidence Base by
OER Impact: Towards an Evidence BaseOER Impact: Towards an Evidence Base
OER Impact: Towards an Evidence BaseOER Hub
266 views40 slides
Evidence of OER Impact by
Evidence of OER ImpactEvidence of OER Impact
Evidence of OER ImpactRobert Farrow
1.8K views33 slides

More Related Content

What's hot

Science of science, scientometrics, and research policy: The need for quantit... by
Science of science, scientometrics, and research policy: The need for quantit...Science of science, scientometrics, and research policy: The need for quantit...
Science of science, scientometrics, and research policy: The need for quantit...Ludo Waltman
536 views28 slides
WEBOMETRICS 2010 by
WEBOMETRICS 2010WEBOMETRICS 2010
WEBOMETRICS 2010URAP Research Center
1.6K views23 slides
RecSysTEL2012 slides by
RecSysTEL2012 slidesRecSysTEL2012 slides
RecSysTEL2012 slidesSoudé Fazeli
351 views26 slides
MOA 2014, Open Access Barometeret: en kortlægning og visualisering af Open Ac... by
MOA 2014, Open Access Barometeret: en kortlægning og visualisering af Open Ac...MOA 2014, Open Access Barometeret: en kortlægning og visualisering af Open Ac...
MOA 2014, Open Access Barometeret: en kortlægning og visualisering af Open Ac...Kungliga biblioteket National Library of Sweden
61 views40 slides
Open Learning Analytics panel at Open Education Conference 2014 by
Open Learning Analytics panel at Open Education Conference 2014Open Learning Analytics panel at Open Education Conference 2014
Open Learning Analytics panel at Open Education Conference 2014Stian Håklev
2K views38 slides
Webometrics report by
Webometrics reportWebometrics report
Webometrics reportvienlaw
688 views29 slides

What's hot(19)

Science of science, scientometrics, and research policy: The need for quantit... by Ludo Waltman
Science of science, scientometrics, and research policy: The need for quantit...Science of science, scientometrics, and research policy: The need for quantit...
Science of science, scientometrics, and research policy: The need for quantit...
Ludo Waltman536 views
Open Learning Analytics panel at Open Education Conference 2014 by Stian Håklev
Open Learning Analytics panel at Open Education Conference 2014Open Learning Analytics panel at Open Education Conference 2014
Open Learning Analytics panel at Open Education Conference 2014
Stian Håklev2K views
Webometrics report by vienlaw
Webometrics reportWebometrics report
Webometrics report
vienlaw688 views
SHEILA project: Panel on capacity building by Riina Vuorikari
SHEILA project: Panel on capacity buildingSHEILA project: Panel on capacity building
SHEILA project: Panel on capacity building
Riina Vuorikari162 views
Altmetrics for kla final by Sarah Sutton
Altmetrics for kla finalAltmetrics for kla final
Altmetrics for kla final
Sarah Sutton399 views
The good, the efficient and the open: changing research workflows and the nee... by hierohiero
The good, the efficient and the open: changing research workflows and the nee...The good, the efficient and the open: changing research workflows and the nee...
The good, the efficient and the open: changing research workflows and the nee...
hierohiero860 views
In metrics we trust? by ORCID, Inc
In metrics we trust?In metrics we trust?
In metrics we trust?
ORCID, Inc2.4K views
Sparc-Japan-Slow-revolution-in-scholarly-communication by hierohiero
Sparc-Japan-Slow-revolution-in-scholarly-communicationSparc-Japan-Slow-revolution-in-scholarly-communication
Sparc-Japan-Slow-revolution-in-scholarly-communication
hierohiero1.1K views
Open science: what does success look like, and how would we know? by Jisc
Open science: what does success look like, and how would we know?Open science: what does success look like, and how would we know?
Open science: what does success look like, and how would we know?
Jisc2.1K views
Semantometrics: Towards Fulltext-based Research Evaluation by petrknoth
Semantometrics: Towards Fulltext-based Research EvaluationSemantometrics: Towards Fulltext-based Research Evaluation
Semantometrics: Towards Fulltext-based Research Evaluation
petrknoth1.7K views
Global Futures Intelligence System talk at WFSF 2013 by Jerome Glenn
Global Futures Intelligence System talk at WFSF 2013Global Futures Intelligence System talk at WFSF 2013
Global Futures Intelligence System talk at WFSF 2013
Jerome Glenn258 views
Overview of methodologies by Mickael Pero
Overview of methodologiesOverview of methodologies
Overview of methodologies
Mickael Pero555 views
Implementing analytics - Rob Wyn Jones, Shri Footring and Rebecca Davies by Jisc
Implementing analytics - Rob Wyn Jones, Shri Footring and Rebecca DaviesImplementing analytics - Rob Wyn Jones, Shri Footring and Rebecca Davies
Implementing analytics - Rob Wyn Jones, Shri Footring and Rebecca Davies
Jisc1.6K views
Strand 3: Angela Holzer, German Research Foundation, DFG by OAbooks
Strand 3: Angela Holzer, German Research Foundation, DFGStrand 3: Angela Holzer, German Research Foundation, DFG
Strand 3: Angela Holzer, German Research Foundation, DFG
OAbooks2.7K views

Viewers also liked

Stephen Ayre CDG2012 Collaboration to show impact of training by
Stephen Ayre CDG2012 Collaboration to show impact of trainingStephen Ayre CDG2012 Collaboration to show impact of training
Stephen Ayre CDG2012 Collaboration to show impact of trainingCareer Development Group
1.7K views21 slides
Hospital Entry Metaphor Sketches V0 4 by
Hospital Entry  Metaphor Sketches V0 4Hospital Entry  Metaphor Sketches V0 4
Hospital Entry Metaphor Sketches V0 4mollio64
369 views29 slides
Crowdsourcing Week 2014 Copenhagen: Community, Collaboration & Impact by
Crowdsourcing Week 2014 Copenhagen: Community, Collaboration & ImpactCrowdsourcing Week 2014 Copenhagen: Community, Collaboration & Impact
Crowdsourcing Week 2014 Copenhagen: Community, Collaboration & ImpactNathan Waterhouse
740 views57 slides
Matrices and row operations 12123 and applications of matrices by
Matrices and row operations 12123 and applications of matricesMatrices and row operations 12123 and applications of matrices
Matrices and row operations 12123 and applications of matricesmayaGER
2K views21 slides
How can we keep our employees engaged in their work in the current economic c... by
How can we keep our employees engaged in their work in the current economic c...How can we keep our employees engaged in their work in the current economic c...
How can we keep our employees engaged in their work in the current economic c...David Gurteen
3.5K views18 slides
"Impact2: through the power of collaboration. How we increased our impact by ... by
"Impact2: through the power of collaboration. How we increased our impact by ..."Impact2: through the power of collaboration. How we increased our impact by ...
"Impact2: through the power of collaboration. How we increased our impact by ...Hester Mountifield
802 views23 slides

Viewers also liked(11)

Hospital Entry Metaphor Sketches V0 4 by mollio64
Hospital Entry  Metaphor Sketches V0 4Hospital Entry  Metaphor Sketches V0 4
Hospital Entry Metaphor Sketches V0 4
mollio64369 views
Crowdsourcing Week 2014 Copenhagen: Community, Collaboration & Impact by Nathan Waterhouse
Crowdsourcing Week 2014 Copenhagen: Community, Collaboration & ImpactCrowdsourcing Week 2014 Copenhagen: Community, Collaboration & Impact
Crowdsourcing Week 2014 Copenhagen: Community, Collaboration & Impact
Nathan Waterhouse740 views
Matrices and row operations 12123 and applications of matrices by mayaGER
Matrices and row operations 12123 and applications of matricesMatrices and row operations 12123 and applications of matrices
Matrices and row operations 12123 and applications of matrices
mayaGER2K views
How can we keep our employees engaged in their work in the current economic c... by David Gurteen
How can we keep our employees engaged in their work in the current economic c...How can we keep our employees engaged in their work in the current economic c...
How can we keep our employees engaged in their work in the current economic c...
David Gurteen3.5K views
"Impact2: through the power of collaboration. How we increased our impact by ... by Hester Mountifield
"Impact2: through the power of collaboration. How we increased our impact by ..."Impact2: through the power of collaboration. How we increased our impact by ...
"Impact2: through the power of collaboration. How we increased our impact by ...
Hester Mountifield802 views
Tardiness and absenteeism and its repercussions in the by Stephandersen834
Tardiness and absenteeism and its repercussions in theTardiness and absenteeism and its repercussions in the
Tardiness and absenteeism and its repercussions in the
Stephandersen8344.6K views
malpractice and negligence by gurwindersran
malpractice and negligencemalpractice and negligence
malpractice and negligence
gurwindersran65.1K views
Employee Engagement Benchmark Report by Demand Metric
Employee Engagement Benchmark ReportEmployee Engagement Benchmark Report
Employee Engagement Benchmark Report
Demand Metric4.5K views
Metric for human resource management by sumanbt
Metric for human resource managementMetric for human resource management
Metric for human resource management
sumanbt15.6K views
Effective communication by nicetoslide
Effective communicationEffective communication
Effective communication
nicetoslide8K views

Similar to OER Impact: Collaboration, Evidence, Synthesis

Open Research into Open Education: The Role of Mapping and Curation by
Open Research into Open Education: The Role of Mapping and CurationOpen Research into Open Education: The Role of Mapping and Curation
Open Research into Open Education: The Role of Mapping and CurationRobert Farrow
6.8K views41 slides
Mapping & Curation in OER Impact Research #altc by
Mapping & Curation in OER Impact Research #altcMapping & Curation in OER Impact Research #altc
Mapping & Curation in OER Impact Research #altcRobert Farrow
1.7K views49 slides
ROER4D Impact Studies Workshop by
ROER4D Impact Studies WorkshopROER4D Impact Studies Workshop
ROER4D Impact Studies WorkshopRobert Farrow
754 views241 slides
The Ecology of Sharing: Synthesizing OER Research by
The Ecology of Sharing: Synthesizing OER ResearchThe Ecology of Sharing: Synthesizing OER Research
The Ecology of Sharing: Synthesizing OER ResearchRobert Farrow
1.3K views21 slides
A Grand Tour of OER Policy by
A Grand Tour of OER PolicyA Grand Tour of OER Policy
A Grand Tour of OER PolicyRobert Farrow
2.4K views47 slides
A Grand Tour of OER Policy by
A Grand Tour of OER PolicyA Grand Tour of OER Policy
A Grand Tour of OER PolicyOER Hub
1K views47 slides

Similar to OER Impact: Collaboration, Evidence, Synthesis (20)

Open Research into Open Education: The Role of Mapping and Curation by Robert Farrow
Open Research into Open Education: The Role of Mapping and CurationOpen Research into Open Education: The Role of Mapping and Curation
Open Research into Open Education: The Role of Mapping and Curation
Robert Farrow6.8K views
Mapping & Curation in OER Impact Research #altc by Robert Farrow
Mapping & Curation in OER Impact Research #altcMapping & Curation in OER Impact Research #altc
Mapping & Curation in OER Impact Research #altc
Robert Farrow1.7K views
ROER4D Impact Studies Workshop by Robert Farrow
ROER4D Impact Studies WorkshopROER4D Impact Studies Workshop
ROER4D Impact Studies Workshop
Robert Farrow754 views
The Ecology of Sharing: Synthesizing OER Research by Robert Farrow
The Ecology of Sharing: Synthesizing OER ResearchThe Ecology of Sharing: Synthesizing OER Research
The Ecology of Sharing: Synthesizing OER Research
Robert Farrow1.3K views
A Grand Tour of OER Policy by Robert Farrow
A Grand Tour of OER PolicyA Grand Tour of OER Policy
A Grand Tour of OER Policy
Robert Farrow2.4K views
A Grand Tour of OER Policy by OER Hub
A Grand Tour of OER PolicyA Grand Tour of OER Policy
A Grand Tour of OER Policy
OER Hub1K views
Grand Tour of OER Policy (w. Rob Farrow, OER Research Hub) (OER14, Newcastle UK) by Sara Frank Bristow
Grand Tour of OER Policy (w. Rob Farrow, OER Research Hub) (OER14, Newcastle UK)Grand Tour of OER Policy (w. Rob Farrow, OER Research Hub) (OER14, Newcastle UK)
Grand Tour of OER Policy (w. Rob Farrow, OER Research Hub) (OER14, Newcastle UK)
OER: Key Issues & The "Big Picture" by Robert Farrow
OER: Key Issues & The "Big Picture"OER: Key Issues & The "Big Picture"
OER: Key Issues & The "Big Picture"
Robert Farrow102 views
The Open Research Agenda (Milton Keynes) by Robert Farrow
The Open Research Agenda (Milton Keynes)The Open Research Agenda (Milton Keynes)
The Open Research Agenda (Milton Keynes)
Robert Farrow1K views
20190527_Karen Hytteballe Ibanez _ The OPERA project by OpenAIRE
 20190527_Karen Hytteballe Ibanez _ The OPERA project 20190527_Karen Hytteballe Ibanez _ The OPERA project
20190527_Karen Hytteballe Ibanez _ The OPERA project
OpenAIRE355 views
From Theory to Practice: Can Openness Improve the Quality of OER Research? by OER Hub
From Theory to Practice: Can Openness Improve the Quality of OER Research?From Theory to Practice: Can Openness Improve the Quality of OER Research?
From Theory to Practice: Can Openness Improve the Quality of OER Research?
OER Hub1K views
From Theory to Practice: can openness improve the quality of OER research? by Beck Pitt
From Theory to Practice: can openness improve the quality of OER research? From Theory to Practice: can openness improve the quality of OER research?
From Theory to Practice: can openness improve the quality of OER research?
Beck Pitt464 views
The Open Research Agenda (OERu) by Robert Farrow
The Open Research Agenda (OERu)The Open Research Agenda (OERu)
The Open Research Agenda (OERu)
Robert Farrow371 views
The Open Research Agenda by OER Hub
The Open Research AgendaThe Open Research Agenda
The Open Research Agenda
OER Hub268 views
Open Knowledge in Higher Education (OKHE) - session 3 by Chris Millson
Open Knowledge in Higher Education (OKHE) - session 3Open Knowledge in Higher Education (OKHE) - session 3
Open Knowledge in Higher Education (OKHE) - session 3
Chris Millson347 views
Open Access Barometer to Open Access Indicator: lessons learned from the jour... by Mikael Elbæk
Open Access Barometer to Open Access Indicator: lessons learned from the jour...Open Access Barometer to Open Access Indicator: lessons learned from the jour...
Open Access Barometer to Open Access Indicator: lessons learned from the jour...
Mikael Elbæk4.4K views
The Ecology of Sharing: Synthesizing OER Research by OER Hub
The Ecology of Sharing: Synthesizing OER ResearchThe Ecology of Sharing: Synthesizing OER Research
The Ecology of Sharing: Synthesizing OER Research
OER Hub616 views
Open Education Research : Overview, Benefits and Challenges by Robert Farrow
Open Education Research : Overview, Benefits and Challenges Open Education Research : Overview, Benefits and Challenges
Open Education Research : Overview, Benefits and Challenges
Robert Farrow203 views

More from Robert Farrow

From Openness to Opportunity? Strategical Approaches to OERs Uptake and Use f... by
From Openness to Opportunity? Strategical Approaches to OERs Uptake and Use f...From Openness to Opportunity? Strategical Approaches to OERs Uptake and Use f...
From Openness to Opportunity? Strategical Approaches to OERs Uptake and Use f...Robert Farrow
18 views42 slides
A Typology for OER Business Models by
A Typology for OER Business Models A Typology for OER Business Models
A Typology for OER Business Models Robert Farrow
38 views38 slides
Open Education Research: Past, Present, Future by
Open Education Research: Past, Present, FutureOpen Education Research: Past, Present, Future
Open Education Research: Past, Present, FutureRobert Farrow
50 views27 slides
Sharing innovation practices around OER: theory, practice, examples and debates by
Sharing innovation practices around OER: theory, practice, examples and debatesSharing innovation practices around OER: theory, practice, examples and debates
Sharing innovation practices around OER: theory, practice, examples and debatesRobert Farrow
32 views56 slides
ENCORE+: Your Place in the Open Ecosystem by
ENCORE+: Your Place in the Open EcosystemENCORE+: Your Place in the Open Ecosystem
ENCORE+: Your Place in the Open EcosystemRobert Farrow
101 views49 slides
ENCORE+: The Open Educational Resources (OER) Innovation Ecosystem by
ENCORE+: The Open Educational Resources (OER) Innovation EcosystemENCORE+: The Open Educational Resources (OER) Innovation Ecosystem
ENCORE+: The Open Educational Resources (OER) Innovation EcosystemRobert Farrow
56 views56 slides

More from Robert Farrow(20)

From Openness to Opportunity? Strategical Approaches to OERs Uptake and Use f... by Robert Farrow
From Openness to Opportunity? Strategical Approaches to OERs Uptake and Use f...From Openness to Opportunity? Strategical Approaches to OERs Uptake and Use f...
From Openness to Opportunity? Strategical Approaches to OERs Uptake and Use f...
Robert Farrow18 views
A Typology for OER Business Models by Robert Farrow
A Typology for OER Business Models A Typology for OER Business Models
A Typology for OER Business Models
Robert Farrow38 views
Open Education Research: Past, Present, Future by Robert Farrow
Open Education Research: Past, Present, FutureOpen Education Research: Past, Present, Future
Open Education Research: Past, Present, Future
Robert Farrow50 views
Sharing innovation practices around OER: theory, practice, examples and debates by Robert Farrow
Sharing innovation practices around OER: theory, practice, examples and debatesSharing innovation practices around OER: theory, practice, examples and debates
Sharing innovation practices around OER: theory, practice, examples and debates
Robert Farrow32 views
ENCORE+: Your Place in the Open Ecosystem by Robert Farrow
ENCORE+: Your Place in the Open EcosystemENCORE+: Your Place in the Open Ecosystem
ENCORE+: Your Place in the Open Ecosystem
Robert Farrow101 views
ENCORE+: The Open Educational Resources (OER) Innovation Ecosystem by Robert Farrow
ENCORE+: The Open Educational Resources (OER) Innovation EcosystemENCORE+: The Open Educational Resources (OER) Innovation Ecosystem
ENCORE+: The Open Educational Resources (OER) Innovation Ecosystem
Robert Farrow56 views
Ethics and Educational Technology by Robert Farrow
Ethics and Educational TechnologyEthics and Educational Technology
Ethics and Educational Technology
Robert Farrow421 views
Open Mining Education, Ethics & AI by Robert Farrow
Open Mining Education, Ethics & AIOpen Mining Education, Ethics & AI
Open Mining Education, Ethics & AI
Robert Farrow39 views
Explicable Artifical Intelligence for Education (XAIED) by Robert Farrow
Explicable Artifical Intelligence for Education (XAIED)Explicable Artifical Intelligence for Education (XAIED)
Explicable Artifical Intelligence for Education (XAIED)
Robert Farrow59 views
A Framework for Understanding Innovation with OER by Robert Farrow
A Framework for Understanding Innovation with OERA Framework for Understanding Innovation with OER
A Framework for Understanding Innovation with OER
Robert Farrow213 views
ENCORE+ Innovation and Business Models Circle 2 by Robert Farrow
ENCORE+ Innovation and Business Models Circle 2ENCORE+ Innovation and Business Models Circle 2
ENCORE+ Innovation and Business Models Circle 2
Robert Farrow99 views
OER Ecosystem(s) of Tomorrow #oer22 by Robert Farrow
OER Ecosystem(s) of Tomorrow #oer22OER Ecosystem(s) of Tomorrow #oer22
OER Ecosystem(s) of Tomorrow #oer22
Robert Farrow185 views
Conceptual Frameworks for Doctoral Research into Open Education by Robert Farrow
Conceptual Frameworks for Doctoral Research into Open EducationConceptual Frameworks for Doctoral Research into Open Education
Conceptual Frameworks for Doctoral Research into Open Education
Robert Farrow463 views
Innovation with Open Educational Resources: The State of the Art by Robert Farrow
Innovation with Open Educational Resources: The State of the ArtInnovation with Open Educational Resources: The State of the Art
Innovation with Open Educational Resources: The State of the Art
Robert Farrow235 views
Open Education as Innovation by Robert Farrow
Open Education as InnovationOpen Education as Innovation
Open Education as Innovation
Robert Farrow203 views
The function of microcredentials for the Open University by Robert Farrow
The function of microcredentials for the Open UniversityThe function of microcredentials for the Open University
The function of microcredentials for the Open University
Robert Farrow168 views
Building the 21st Century OER Ecosystem by Robert Farrow
Building the 21st Century OER EcosystemBuilding the 21st Century OER Ecosystem
Building the 21st Century OER Ecosystem
Robert Farrow451 views
Pathways to Learning: International Collaboration Under Covid-19 by Robert Farrow
Pathways to Learning: International Collaboration Under Covid-19Pathways to Learning: International Collaboration Under Covid-19
Pathways to Learning: International Collaboration Under Covid-19
Robert Farrow184 views
Enhancing Research Communities Through Open Collaboration: The GO-GN Guide to... by Robert Farrow
Enhancing Research Communities Through Open Collaboration: The GO-GN Guide to...Enhancing Research Communities Through Open Collaboration: The GO-GN Guide to...
Enhancing Research Communities Through Open Collaboration: The GO-GN Guide to...
Robert Farrow232 views
Innovating Open Education: Critical Pathways and Communities of Practice by Robert Farrow
Innovating Open Education: Critical Pathways and Communities of PracticeInnovating Open Education: Critical Pathways and Communities of Practice
Innovating Open Education: Critical Pathways and Communities of Practice
Robert Farrow364 views

Recently uploaded

2022 CAPE Merit List 2023 by
2022 CAPE Merit List 2023 2022 CAPE Merit List 2023
2022 CAPE Merit List 2023 Caribbean Examinations Council
4.6K views76 slides
Google solution challenge..pptx by
Google solution challenge..pptxGoogle solution challenge..pptx
Google solution challenge..pptxChitreshGyanani1
117 views18 slides
Collective Bargaining and Understanding a Teacher Contract(16793704.1).pptx by
Collective Bargaining and Understanding a Teacher Contract(16793704.1).pptxCollective Bargaining and Understanding a Teacher Contract(16793704.1).pptx
Collective Bargaining and Understanding a Teacher Contract(16793704.1).pptxCenter for Integrated Training & Education
91 views57 slides
AI Tools for Business and Startups by
AI Tools for Business and StartupsAI Tools for Business and Startups
AI Tools for Business and StartupsSvetlin Nakov
105 views39 slides
Use of Probiotics in Aquaculture.pptx by
Use of Probiotics in Aquaculture.pptxUse of Probiotics in Aquaculture.pptx
Use of Probiotics in Aquaculture.pptxAKSHAY MANDAL
95 views15 slides
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant... by
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...Ms. Pooja Bhandare
73 views45 slides

Recently uploaded(20)

AI Tools for Business and Startups by Svetlin Nakov
AI Tools for Business and StartupsAI Tools for Business and Startups
AI Tools for Business and Startups
Svetlin Nakov105 views
Use of Probiotics in Aquaculture.pptx by AKSHAY MANDAL
Use of Probiotics in Aquaculture.pptxUse of Probiotics in Aquaculture.pptx
Use of Probiotics in Aquaculture.pptx
AKSHAY MANDAL95 views
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant... by Ms. Pooja Bhandare
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...
Scope of Biochemistry.pptx by shoba shoba
Scope of Biochemistry.pptxScope of Biochemistry.pptx
Scope of Biochemistry.pptx
shoba shoba126 views
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively by PECB
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks EffectivelyISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
PECB 574 views
Narration lesson plan.docx by TARIQ KHAN
Narration lesson plan.docxNarration lesson plan.docx
Narration lesson plan.docx
TARIQ KHAN108 views
Create a Structure in VBNet.pptx by Breach_P
Create a Structure in VBNet.pptxCreate a Structure in VBNet.pptx
Create a Structure in VBNet.pptx
Breach_P72 views
Community-led Open Access Publishing webinar.pptx by Jisc
Community-led Open Access Publishing webinar.pptxCommunity-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptx
Jisc91 views
JiscOAWeek_LAIR_slides_October2023.pptx by Jisc
JiscOAWeek_LAIR_slides_October2023.pptxJiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptx
Jisc93 views
AUDIENCE - BANDURA.pptx by iammrhaywood
AUDIENCE - BANDURA.pptxAUDIENCE - BANDURA.pptx
AUDIENCE - BANDURA.pptx
iammrhaywood77 views
REPRESENTATION - GAUNTLET.pptx by iammrhaywood
REPRESENTATION - GAUNTLET.pptxREPRESENTATION - GAUNTLET.pptx
REPRESENTATION - GAUNTLET.pptx
iammrhaywood91 views
PLASMA PROTEIN (2).pptx by MEGHANA C
PLASMA PROTEIN (2).pptxPLASMA PROTEIN (2).pptx
PLASMA PROTEIN (2).pptx
MEGHANA C66 views

OER Impact: Collaboration, Evidence, Synthesis

  • 1. OER Impact: Collaboration, Evidence, Synthesis Dr. Rob Farrow The Open University
  • 2. Structure OER Research Hub Collaborative Research Evidence Model Synthesis: Mapping and Curation OER Impact Map
  • 3. please tweet to #oermap
  • 4. • Research project at The Open University (UK) • Funded by William & Flora Hewlett Foundation for two years • Research team led by two professors • Tasked with building the most comprehensive picture of OER impact • Organised by eleven research hypotheses • Collaboration model works across different educational sectors • Global reach but with a USA focus OER Research Hub oerresearchhub.org #oerrhub
  • 5. Rationale • Consolidatory phase for OER movement after years of investment and piloting • The need for an evidence base: advocacy, strategy, policymaking • Lack of robust evidence for OER impact • The evidence ‘problem’ in OER impact research • Isolated ‘pockets of innovation’ • No agreement over best methods for impact comparison • Compare diverse experiences to assess the influence of ‘open’ • Mixed methods data from experimental + non-experimental research
  • 8. • Research instruments applied consistently across collaborations: surveys, interview questions, focus groups, etc. • Supplemented by integration of secondary research • ‘Agile’ research, sprinting • Thematic and methodological cohesion provided by research hypotheses Research Process
  • 9. Inclusive Holistic Validation of experiences at the ‘cutting edge’ Open to diverse perspectives Incommensurability? Granularity? Synthesis? Practical Advantages / Methodological Disadvantages How will comparison of experiences be made rigorous?
  • 10. Hypotheses Key claims about open education
  • 11. Keyword Research Hypothesis Performance OER improve student performance/satisfaction Openness People use OER differently from other online materials Access OER widen participation in education Retention OER can help at-risk learners to finish their studies Reflection OER use leads educators to reflect on their practice Finance OER adoption brings financial benefits for students/institutions Indicators Informal learners use a variety of indicators when selecting OER Support Informal learners develop their own forms of study support Transition OER support informal learners in moving to formal study Policy OER use encourages institutions to change their policies Assessment Informal assessments motivate learners using OER ‘Evidence’ is only evidence in relation to a claim or hypothesis: the project hypotheses form the core of the metadata model.
  • 12. Evidence Model Design for information architecture
  • 13. Key Questions for Evidence Model What evidence exists to support key claims about OER? How do patterns of OER impact differ across countries? How do patterns of OER impact differ according to sector? How can the veracity of evidence be checked? How can diverse evidence forms be meaningfully collected together?
  • 14. • TextTitle • Text / HTML - Supports embedding of multimediaCopy • Association of evidence with hypothesisHypothesis • Evidence is either +ve/-ve in relation to a hypothesisPolarity • GeolocationLocation • School (K12) / College / Higher Education / InformalSector • Academic citation or Hyperlink / URLCitation Evidence: Information Architecture
  • 16. • Popular OS platform • Easy to customize • Over 27,000 existing plugins Wordpress • CSV importer • Location plugin • JSON Customization • Project code available on GitHub • Easy to link, share and engage Openness Technical Development
  • 17. Synthesis Synthesis Methods • Isolating data by hypothesis, sector, country, or any combination • Collaborative curation of research data • Data visualization, reporting • Editorial quality control exercised centrally Validation • Iteration through current and future patterns of evidence • Open citation trails allow public auditing of evidence • Community voting
  • 19. in service of The Open University
  • 21. OER Impact Map: Maps oermap.org • Country Summary Map - evidence nodes organized by country • OER Project Map - OER initiatives and projects around the world • OER Evidence Map - all impact evidence is categorized according to the OER Research Hub hypotheses • OER Policy Map is the single largest curated collection of OER policies • OER Impact Map aggregates the other maps • Tweetmaps show a geographical summary of tweets for a particular Twitter hashtag. E.g. #oermap for outreach; #oerrhub for tracking project activity. • Maps by others
  • 22. Global Impact Summary Select country to zoom
  • 23. in service of The Open University Flowmap changes according to country selected…
  • 24. Impact Summary (USA) Node colour = sector Node border = polarity
  • 25. in service of The Open University Positive Evidence Negative Evidence Uncategorized Evidence OER Evidence Map
  • 26. OER Policy Map L R N I Local/Institutional policies Regional policies National policies International policies CC Open Policy Network POERUP SPARC
  • 27. in service of The Open University OER Projects OER Project Map
  • 28. in service of The Open University OER Impact Map
  • 29. in service of The Open University OER Impact Map Combines other maps Supports filtering
  • 32. in service of The Open University
  • 33. in service of The Open University
  • 34. Summary • A collaborative approach to OER research is recommended • OER Impact Map is a tool designed for the needs of the open community • Open methods for researching openness: openly licensed instruments; remix and reuse data; working openly; sharing • Takeaway message: the whole is greater than the sum of the parts
  • 35. Next Steps • Adding qualitative data analysis to evidence base • Increasing the evidence base through desk research • Plan for final phase of map development • Case studies • New collaborations? • New hypotheses? • School of Open course on open research; Open Data; CC-BY research tools • Survey data ‘exploration tool’
  • 36. in service of The Open University Survey Data Explorer (prototype)
  • 37. in service of The Open University Survey Data Explorer (prototype)
  • 38. in service of The Open University Survey Data Explorer (prototype)
  • 40. in service of The Open University
  • 41. We want to put you on the map! So let us know about OER activity and impact in your institution
  • 42. Join us in building understanding of open education