SlideShare a Scribd company logo
1 of 10
How will you ensure that
"massive" education is high
quality education?
Presentation to the University of West of
Scotland, Hamilton, 7th
January 2016
Fred Riley
www.fredriley.org.uk
Perspectives
●
This presentation takes the following
perspectives:
●
MOOC student
●
E-learning media developer
●
Learning Technologist
Quality
●
What is 'quality' in a MOOC context?
●
How can course quality be assessed?
●
no outcomes, as in 'normal' uni courses
●
'success' is subjective, down to the individual
●
participation metrics and analysis ('paradata')
●
student feedback and survey
●
Resource quality
●
high-quality peer-reviewed content
●
hiqh technical quality
●
both are required
●
When designing a course, read existing MOOC literature (see
References)
Resources
●
Develop in-house, from scratch, where possible
●
MOOC should be a distinct offering, not a recycle bin
●
Audio and video:
●
professionally shot and scripted
●
time-consuming to produce, esp video
– value from re-use in degree programmes
●
Graphics and animations
●
Open Source formats
●
accessible (text alternatives)
●
Quizzes and self-assessments
●
careful construction and meaningful feedback
●
Should be downloadable (text, AV clips) for offline use and revision
Open Educational Resources
(OER)
●
OER can be useful and economical in MOOCs
●
IF relevant OER exist AND
●
they're quality-controlled (teaching and technical) AND
●
open licences permit reuse AND
●
resources can be copied locally
●
Example: BBC footage* used in Climate Change MOOC
●
A collegiate gesture would be to make MOOC resources
available as OER for the community
* Not strictly OER, I know...
Community
●
Discussion and reflection important
●
MOOC should not be a solely passive experience
●
students need to feel part of a learning community, even if
they stay schtumm and just lurk
●
Facilitators useful to start and steer conversations
(and keep them on-topic!)
●
'Follow' and threading helpful when 000s of students
participating in fora
●
Social media feeds (eg Twitter) useful for mobile
students
Student experience
●
Interface preset mostly (totally?) by
FutureLearn environment
●
Getting started guides (FL has
produced a '
'crowdsourced guide to learning'')
●
Stage guidance - what should I do
now?
References
●
MOOCs @ Edinburgh 2013: Report 1 (Coursera)
●
MOOC report 2013 (University of London)
(Coursera)
●
MOOCs and Quality (QAA, 2015)
●
Experiences of MOOCs (HEA, 2015)
(FutureLearn)
●
MOOCs and beyond (Open Education Europa)
POSTSCRIPT
●
the quality of the content is of paramount importance. It doesn't matter how high quality a video clip is if its contents is
mediocre. Need high calibre, experienced staff providing up-to-date materials for delivery in a variety of formats.
●
as a new user I found it all a bit overwhelming, knowing there were several thousand people registered. I appreciated some
good practical advice - about not trying to read everything, just enough to be able to engage in discussion, and to follow some
people, including the course staff and people whose comments you liked - but had to search for it.
●
Also appreciated fairly explicit guidance about what was required at each stage. Some of this guidance directed you to get
stuck into the discussion - eg select two comments you found interesting and respond to them - and that helped you get
involved
●
Also liked the way you could access how you were progressing - how much you'd done, percentage remaining.
●
Really liked the variety of formats, text, video clips of talking heads, video clips of role play, multiple choice questions,
websites, articles etc
●
For a longer, accredited course presumably you'd be writing essays etc. Guidance on note taking would probably be useful,
so you could refer back to points more easily that having to trawl through the online stuff again
●
the opportunity for personalised feedback from the tutor is pretty useful, I received a couple of feedback comments and
questions which were useful. An experienced, encouraging and knowledgeable tutor is an important asset.
The following are comments from a first-time MOOC student of mature years on a
two-week course in Mental Health under the FutureLearn platform:
POSTSCRIPT
●
the quality of the content is of paramount importance. It doesn't matter how high quality a video clip is if its contents is
mediocre. Need high calibre, experienced staff providing up-to-date materials for delivery in a variety of formats.
●
as a new user I found it all a bit overwhelming, knowing there were several thousand people registered. I appreciated some
good practical advice - about not trying to read everything, just enough to be able to engage in discussion, and to follow some
people, including the course staff and people whose comments you liked - but had to search for it.
●
Also appreciated fairly explicit guidance about what was required at each stage. Some of this guidance directed you to get
stuck into the discussion - eg select two comments you found interesting and respond to them - and that helped you get
involved
●
Also liked the way you could access how you were progressing - how much you'd done, percentage remaining.
●
Really liked the variety of formats, text, video clips of talking heads, video clips of role play, multiple choice questions,
websites, articles etc
●
For a longer, accredited course presumably you'd be writing essays etc. Guidance on note taking would probably be useful,
so you could refer back to points more easily that having to trawl through the online stuff again
●
the opportunity for personalised feedback from the tutor is pretty useful, I received a couple of feedback comments and
questions which were useful. An experienced, encouraging and knowledgeable tutor is an important asset.
The following are comments from a first-time MOOC student of mature years on a
two-week course in Mental Health under the FutureLearn platform:

More Related Content

Viewers also liked

Viewers also liked (20)

University-Industry Perspectives Report
University-Industry Perspectives ReportUniversity-Industry Perspectives Report
University-Industry Perspectives Report
 
TEL and the student experience
TEL and the student experienceTEL and the student experience
TEL and the student experience
 
An evolution of Vscene in action - John Wilson
An evolution of Vscene in action - John WilsonAn evolution of Vscene in action - John Wilson
An evolution of Vscene in action - John Wilson
 
Perspectives on implementing a vision for developing staff digital capability
Perspectives on implementing a vision for developing staff digital capabilityPerspectives on implementing a vision for developing staff digital capability
Perspectives on implementing a vision for developing staff digital capability
 
Embracing local devolution - two college's intriguing insights into respondin...
Embracing local devolution - two college's intriguing insights into respondin...Embracing local devolution - two college's intriguing insights into respondin...
Embracing local devolution - two college's intriguing insights into respondin...
 
Learning analytics for FE colleges
Learning analytics for FE collegesLearning analytics for FE colleges
Learning analytics for FE colleges
 
Inclusively enhancing learning from lecture recordings: using Synote without ...
Inclusively enhancing learning from lecture recordings: using Synote without ...Inclusively enhancing learning from lecture recordings: using Synote without ...
Inclusively enhancing learning from lecture recordings: using Synote without ...
 
Making best use of technology for employability: the Jisc employability toolkit
Making best use of technology for employability: the Jisc employability toolkitMaking best use of technology for employability: the Jisc employability toolkit
Making best use of technology for employability: the Jisc employability toolkit
 
An evolution of Vscene in action - Tim Boundy
An evolution of Vscene in action - Tim BoundyAn evolution of Vscene in action - Tim Boundy
An evolution of Vscene in action - Tim Boundy
 
Institutional visions for a digital student experience
Institutional visions for a digital student experienceInstitutional visions for a digital student experience
Institutional visions for a digital student experience
 
Increasing student satisfaction by closing the feedback loop
Increasing student satisfaction by closing the feedback loopIncreasing student satisfaction by closing the feedback loop
Increasing student satisfaction by closing the feedback loop
 
Exploiting digital collections in learning, teaching and research
Exploiting digital collections in learning, teaching and researchExploiting digital collections in learning, teaching and research
Exploiting digital collections in learning, teaching and research
 
Transforming organisational culture
Transforming organisational cultureTransforming organisational culture
Transforming organisational culture
 
Amazon Web Services
Amazon Web ServicesAmazon Web Services
Amazon Web Services
 
Digital technology is fundamentally changing learning and teaching in higher ...
Digital technology is fundamentally changing learning and teaching in higher ...Digital technology is fundamentally changing learning and teaching in higher ...
Digital technology is fundamentally changing learning and teaching in higher ...
 
Learning and exploring with new technology at Dundee and Angus College
Learning and exploring with new technology at Dundee and Angus CollegeLearning and exploring with new technology at Dundee and Angus College
Learning and exploring with new technology at Dundee and Angus College
 
Evidence-based practice in technology-enhanced learning
Evidence-based practice in technology-enhanced learningEvidence-based practice in technology-enhanced learning
Evidence-based practice in technology-enhanced learning
 
Doing better things: transforming how we use Turnitin for learning
Doing better things: transforming how we use Turnitin for learningDoing better things: transforming how we use Turnitin for learning
Doing better things: transforming how we use Turnitin for learning
 
Are you future ready? Preparing students for living and working in a digital ...
Are you future ready? Preparing students for living and working in a digital ...Are you future ready? Preparing students for living and working in a digital ...
Are you future ready? Preparing students for living and working in a digital ...
 
Attendance monitoring in higher education
Attendance monitoring in higher educationAttendance monitoring in higher education
Attendance monitoring in higher education
 

Similar to MOOCs and quality

Preparing to teach online
Preparing to teach onlinePreparing to teach online
Preparing to teach online
Jim Wentworth
 
Formative EvaluationFormative evaluation gives real results as t.docx
Formative EvaluationFormative evaluation gives real results as t.docxFormative EvaluationFormative evaluation gives real results as t.docx
Formative EvaluationFormative evaluation gives real results as t.docx
hanneloremccaffery
 

Similar to MOOCs and quality (20)

Transitions into HE - Project Overview
Transitions into HE - Project OverviewTransitions into HE - Project Overview
Transitions into HE - Project Overview
 
Workshop - Open online courses
Workshop - Open online coursesWorkshop - Open online courses
Workshop - Open online courses
 
Mooc for professional learning - A Presentation
Mooc for professional learning - A PresentationMooc for professional learning - A Presentation
Mooc for professional learning - A Presentation
 
Realizing the potential of online and blended professional development
Realizing the potential of online and blended professional development Realizing the potential of online and blended professional development
Realizing the potential of online and blended professional development
 
Teaching by twitter [Presented at Curtin University, Western Australia]
Teaching by twitter [Presented at Curtin University, Western Australia]Teaching by twitter [Presented at Curtin University, Western Australia]
Teaching by twitter [Presented at Curtin University, Western Australia]
 
Student Peer Assessment Essentials
Student Peer Assessment EssentialsStudent Peer Assessment Essentials
Student Peer Assessment Essentials
 
Moving Student Presentations Online
Moving Student Presentations OnlineMoving Student Presentations Online
Moving Student Presentations Online
 
Mooc evaluation
Mooc evaluationMooc evaluation
Mooc evaluation
 
Comerford "Case Study: Building an Accessible Digital Learning Environment"
Comerford "Case Study: Building an Accessible Digital Learning Environment"Comerford "Case Study: Building an Accessible Digital Learning Environment"
Comerford "Case Study: Building an Accessible Digital Learning Environment"
 
Student peer assessment( BC Campus Symposium 2018)
Student peer assessment( BC Campus Symposium 2018)Student peer assessment( BC Campus Symposium 2018)
Student peer assessment( BC Campus Symposium 2018)
 
Edu4change4development 20130602
Edu4change4development 20130602Edu4change4development 20130602
Edu4change4development 20130602
 
Nbvtalkonmoocs
NbvtalkonmoocsNbvtalkonmoocs
Nbvtalkonmoocs
 
Qualität von MOOCs - Folien zum GMW Workshop mit Rolf Schulmeister, Claudia B...
Qualität von MOOCs - Folien zum GMW Workshop mit Rolf Schulmeister, Claudia B...Qualität von MOOCs - Folien zum GMW Workshop mit Rolf Schulmeister, Claudia B...
Qualität von MOOCs - Folien zum GMW Workshop mit Rolf Schulmeister, Claudia B...
 
Preparing Instructors to Teach Online: Two Faculty Development Models
Preparing Instructors to Teach Online: Two Faculty Development ModelsPreparing Instructors to Teach Online: Two Faculty Development Models
Preparing Instructors to Teach Online: Two Faculty Development Models
 
Preparing to teach online
Preparing to teach onlinePreparing to teach online
Preparing to teach online
 
Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722
Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722
Leap Not Creep Participant Guide Pre-Course Through Week 3 - 20140722
 
Formative EvaluationFormative evaluation gives real results as t.docx
Formative EvaluationFormative evaluation gives real results as t.docxFormative EvaluationFormative evaluation gives real results as t.docx
Formative EvaluationFormative evaluation gives real results as t.docx
 
Nursing Professional Development on Mobile Learning and Microlearning
Nursing Professional Development on Mobile Learning and MicrolearningNursing Professional Development on Mobile Learning and Microlearning
Nursing Professional Development on Mobile Learning and Microlearning
 
Moocs and how to use them july 2014
Moocs and how to use them   july 2014Moocs and how to use them   july 2014
Moocs and how to use them july 2014
 
Teaching by twitter ... a view on mLearning
Teaching by twitter ... a view on mLearningTeaching by twitter ... a view on mLearning
Teaching by twitter ... a view on mLearning
 

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Recently uploaded (20)

REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
latest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answerslatest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answers
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 

MOOCs and quality

  • 1. How will you ensure that "massive" education is high quality education? Presentation to the University of West of Scotland, Hamilton, 7th January 2016 Fred Riley www.fredriley.org.uk
  • 2. Perspectives ● This presentation takes the following perspectives: ● MOOC student ● E-learning media developer ● Learning Technologist
  • 3. Quality ● What is 'quality' in a MOOC context? ● How can course quality be assessed? ● no outcomes, as in 'normal' uni courses ● 'success' is subjective, down to the individual ● participation metrics and analysis ('paradata') ● student feedback and survey ● Resource quality ● high-quality peer-reviewed content ● hiqh technical quality ● both are required ● When designing a course, read existing MOOC literature (see References)
  • 4. Resources ● Develop in-house, from scratch, where possible ● MOOC should be a distinct offering, not a recycle bin ● Audio and video: ● professionally shot and scripted ● time-consuming to produce, esp video – value from re-use in degree programmes ● Graphics and animations ● Open Source formats ● accessible (text alternatives) ● Quizzes and self-assessments ● careful construction and meaningful feedback ● Should be downloadable (text, AV clips) for offline use and revision
  • 5. Open Educational Resources (OER) ● OER can be useful and economical in MOOCs ● IF relevant OER exist AND ● they're quality-controlled (teaching and technical) AND ● open licences permit reuse AND ● resources can be copied locally ● Example: BBC footage* used in Climate Change MOOC ● A collegiate gesture would be to make MOOC resources available as OER for the community * Not strictly OER, I know...
  • 6. Community ● Discussion and reflection important ● MOOC should not be a solely passive experience ● students need to feel part of a learning community, even if they stay schtumm and just lurk ● Facilitators useful to start and steer conversations (and keep them on-topic!) ● 'Follow' and threading helpful when 000s of students participating in fora ● Social media feeds (eg Twitter) useful for mobile students
  • 7. Student experience ● Interface preset mostly (totally?) by FutureLearn environment ● Getting started guides (FL has produced a ' 'crowdsourced guide to learning'') ● Stage guidance - what should I do now?
  • 8. References ● MOOCs @ Edinburgh 2013: Report 1 (Coursera) ● MOOC report 2013 (University of London) (Coursera) ● MOOCs and Quality (QAA, 2015) ● Experiences of MOOCs (HEA, 2015) (FutureLearn) ● MOOCs and beyond (Open Education Europa)
  • 9. POSTSCRIPT ● the quality of the content is of paramount importance. It doesn't matter how high quality a video clip is if its contents is mediocre. Need high calibre, experienced staff providing up-to-date materials for delivery in a variety of formats. ● as a new user I found it all a bit overwhelming, knowing there were several thousand people registered. I appreciated some good practical advice - about not trying to read everything, just enough to be able to engage in discussion, and to follow some people, including the course staff and people whose comments you liked - but had to search for it. ● Also appreciated fairly explicit guidance about what was required at each stage. Some of this guidance directed you to get stuck into the discussion - eg select two comments you found interesting and respond to them - and that helped you get involved ● Also liked the way you could access how you were progressing - how much you'd done, percentage remaining. ● Really liked the variety of formats, text, video clips of talking heads, video clips of role play, multiple choice questions, websites, articles etc ● For a longer, accredited course presumably you'd be writing essays etc. Guidance on note taking would probably be useful, so you could refer back to points more easily that having to trawl through the online stuff again ● the opportunity for personalised feedback from the tutor is pretty useful, I received a couple of feedback comments and questions which were useful. An experienced, encouraging and knowledgeable tutor is an important asset. The following are comments from a first-time MOOC student of mature years on a two-week course in Mental Health under the FutureLearn platform:
  • 10. POSTSCRIPT ● the quality of the content is of paramount importance. It doesn't matter how high quality a video clip is if its contents is mediocre. Need high calibre, experienced staff providing up-to-date materials for delivery in a variety of formats. ● as a new user I found it all a bit overwhelming, knowing there were several thousand people registered. I appreciated some good practical advice - about not trying to read everything, just enough to be able to engage in discussion, and to follow some people, including the course staff and people whose comments you liked - but had to search for it. ● Also appreciated fairly explicit guidance about what was required at each stage. Some of this guidance directed you to get stuck into the discussion - eg select two comments you found interesting and respond to them - and that helped you get involved ● Also liked the way you could access how you were progressing - how much you'd done, percentage remaining. ● Really liked the variety of formats, text, video clips of talking heads, video clips of role play, multiple choice questions, websites, articles etc ● For a longer, accredited course presumably you'd be writing essays etc. Guidance on note taking would probably be useful, so you could refer back to points more easily that having to trawl through the online stuff again ● the opportunity for personalised feedback from the tutor is pretty useful, I received a couple of feedback comments and questions which were useful. An experienced, encouraging and knowledgeable tutor is an important asset. The following are comments from a first-time MOOC student of mature years on a two-week course in Mental Health under the FutureLearn platform: