SlideShare a Scribd company logo
Modelling and Managing Student Satisfaction:
Use of student feedback to enhance learning experience
Vicky Marsh / Nai Li / Steph Lay/ Bart Rienties
Vicky.Marsh@open.ac.uk
Nai.Li@open.ac.uk
Stephanie.lay@open.ac.uk
Bart.Rienties@open.ac.uk
Modelling and Managing Student Satisfaction:
Use of student feedback to enhance learning experience
2 Research to Date
1 Overview of the Project
Case study: OU QA
3
Next steps4
Background of QAA Study
• HE increasingly competitive market: student satisfaction has become an important
component of Quality Assurance (QA) and Quality Enhancement (QE, Kember & Ginns, 2012;
Rienties, 2014).
• Measurement of student satisfaction is important to pinpoint strengths and identify areas for
improvement (Coffey & Gibbs, 2001; Zerihun, Beishuizen, & Os, 2012).
• Potential benefits and drawbacks of student evaluations have been well-documented in the
literature (see for example Bennett & De Bellis, 2010; Crews & Curtis, 2011),
o Recent research continues to suggest strong resistance amongst academic staff (Crews & Curtis,
2011; Rienties, 2014).
o Most student survey instruments lack of focus on key elements of rich learning, such as
interaction, assessment and feedback.
• With the increased importance of NSS and institutional surveys on academic and educational
practice, there is a need for a critical review of how these data are used for QA and QE.
Key Questions of the Project
1. To what extent are institutions using insights from NSS and institutional surveys to transform
their students’ experience?
2. What are the key enablers and barriers for integrating student satisfaction data with QA and
QE
3. How are student experiences influencing quality enhancements
a) What influences students’ perceptions of overall satisfaction the most? Are student
characteristics or module/presentation related factors more predictive than
satisfaction with other aspects of their learning experience?
b) Is the student cohort homogenous when considering satisfaction key drivers? For
example are there systematic differences depending on the level or programme of
study?
Two Phases
Phase One: Literature review of link
student satisfaction surveys with QA/QE
• In-depth and critical desk review of
available resources, including academic
journal publications, ‘grey’ literature
and institutional websites,
• Good and best practice of students
satisfaction data and QA
– Informal discussions with staff
– Panel of Evasys student evaluation
conference
Phase Two: Case-study Open University
QA
• Explore the construct of student
satisfaction based on data collected via
an internal survey conducted by the
Open University (200.000+ students)
• Identify which aspects of the student
experience are most associated with
their overall expression of satisfaction
• How these findings are translated into
QA and QE.
Basic “bible” of how
to design and
evaluate effective
student surveys
Most universities
share data
primarily with
teachers and
departments, but
limited feedback
returned to
students
“students must have
confidence that their
feedback is part of a
wider and effective
system of
enhancement in which
students have a
meaningful stake”
Debbie McVitty
(National Union of
students)
Key challenges for HE
• How to provide student feedback
back to students (close-the-loop)
• How to provide feedback to staff to
enhance their practice (academic
development)
• How to provide feedback to senior
management (professional
development)
Case Study: Student Experience on a Module (SEaM) 2015
Analysis of Overall Satisfaction
• The purpose of this analysis is to identify the key
drivers of student satisfaction, ascertain whether
these drivers vary by student type or level of study
and in particular to determine whether
satisfaction with learning design is still important
once student and module characteristics have
been accounted for.
• to see whether satisfaction with learning design
remains important once student socio-
demographics, OU study history &
module/presentation information has been taken
into account.
• Robust and replicable analysis confirming the key
drivers of UG & PG student satisfaction, with clear
priorities for action to improve overall satisfaction.
Case study:
OU QA
3
Next Steps
4
Overview the
Project
1
Research to
date2
10
• Revised Survey in place for modules that started from 2012J+
– Every student on every module will be surveyed
– Integrated survey including the student feedback on their tutor (DALS) and on their module (EoM)
• Three themed sets of questions which cover
– The module overall
– Teaching, learning and assessment
– Feedback on the tutor (Tutor supported modules only)
• Students are sent an invitation to participate two to three weeks before the end of the module
• Coverage
– includes presentations that have ended between 1st August 2013 and 31st July 2014, who had results available by 13th
August 2014
– There are a selection of short course, residential school and overseas modules included in AQR that were not surveyed,
these modules are not included.
– All students regardless of their completion status are included - all previous SEaM results were based on students who
completed only.
• Reliability
– Consideration should be given to response rates (34%) and the number of responding students when reviewing SEaM
results.
– Non-response bias
Student Experience on a Module
(SEaM) 2015 Survey
Methodology (Logistic Regression)
& Validation
Step 1: A descriptive analysis was conducted to
discount variables that were unsuitable for
satisfaction modelling.
Step 1 also identified highly correlated
predictors and methodically selected
the most appropriate.
Module
Presentation
Student
Concurrency
Study history
Overall
Satisfaction
SEaM
UG new, UG continuing, PG new
and PG continuing students were
modelled separately at Step 2.
Step 2: Each subset of variables
was modelled in groups. The
variables that were statistically
significant from each subset
were then combined and
modelled to identify the final list
of key drivers
We found at Step 3 that the combined
scale provided the simplest and most
interpretable solution for PG students
and the whole scale for UG students.
The solution without the KPI’s included
was much easier to use in terms of
identifying clear priorities for action.
Step 3 Validation: all models have
been verified by using subsets of the
whole data to ensure the solutions
are robust. A variety of model fit
statistics have also been used to
identify the optimum solutions.
Satisfaction Modelling:
Undergraduate Continuing Students
% planned
life cycle
15
Module:
Examinable
Component
14
Module:
Level of
study
13
Module:
Credits
12
Q6 Method
of delivery
11
Q11
Assignment
completion
09
Q23 Tutor
knowledge
07
Q3 Advice
& guidance
05
Q13
Qualificatio
n aim
03
KPI-05
Teaching
materials
01
KPI-06
Workload
10
Q9
Assignment
instructions
08
Q14 Career
relevance
06
Q5
Integration
of
materials
04
Q36
Assessment
02
Importance to Overall Satisfaction
Satisfaction Modelling:
Undergraduate New Students
Age
07
Q14 Career
relevance
05
Q3 Advice
& guidance
03
KPI-05
Teaching
materials
01
Q13
Qualification
aim
06
Q5
Integration
of
materials
04
Q36
Assessment
02
Importance to Overall Satisfaction
Satisfaction Modelling :
UG Continuing VS New Students
• Both the models are dominated by the survey
questions, confirming that satisfaction with learning
design is a better driver for overall satisfaction.
• The UG continuing model is the only one where
level is a significant driver.
• The drivers of new UG student are very similar to
continuing students with the exception of age
group.
• Satisfaction with teaching materials, assessment and
advice and guidance are absolutely key for UG
students when predicting overall satisfaction.
Satisfaction Modelling:
Postgraduate Continuing Students
Credit
transfer
09
Study
motivation
08
Module:
Result
07
Q6 Method
of delivery
05
Q36
Assessment
03
KPI-05
Teaching
materials
01
Number if
tutor groups
06
Q5
Integration
of
materials
04
Q30
Assessment
feedback
02
Importance to Overall Satisfaction
Satisfaction Modelling:
Postgraduate New Students
Q16 Tutor
contact at
start
05
Q36
Assignment
03
Q11
Assignment
completion
01
Q22
Tutor help
with online
06
Q12
Collaborative
activities
04
Q6 Method
of delivery
02
Importance to Overall Satisfaction
Satisfaction Modelling:
PG Continuing VS New Students
• Satisfaction with particular aspects of the student
experience remain key for PG students,
• PG continuing students who are motivated by
personal development are most likely to be satisfied
with their overall experience.
• The PG continuing model is much more similar to
the UG models than the PG new.
• This is not surprising as there are a smaller number
of students available to model for PG new,
therefore, this is the least stable of the four models
and would benefit from the addition of another
cohort of students to validate it robustly.
Student Experience on a Module (SEaM) 2015
Analysis of Overall Satisfaction: Key Findings
• Satisfaction with assessment, teaching materials, integration of materials or method of delivery
consistently appear as the most important key drivers of overall student satisfaction.
• These findings are irrespective of student type e.g. new or continuing and module/ presentation
information such as level of study (UG/PG), faculty and subject area.
• Previous study experience with the OU and socio-demographics such as gender, ethnicity,
socio-economic status and disability are also not predictive of overall satisfaction once
satisfaction with the learning design of the module is accounted for.
• The relationship between UG study level and satisfaction is not clear. This needs to be
investigated further in order to establish clear recommendations. Ideally with an additional
student cohort of data – this analysis was based on respondents to SEaM in the 2013/14
academic year.
Student Experience on a Module (SEaM) 2015
Analysis of Overall Satisfaction
• Add the SEaM survey questions to the pass rate
model to verify the key drivers of pass compared
to satisfaction.
• Further investigate the relationship between UG
level e.g. 1-3 and satisfaction.
• Replicate the analysis for satisfaction, pass and
retention with the new cohort of SEaM data for
2014/15 in order to validate these findings.
• Disseminate the findings more widely.
Case study:
OU QA
3
Next steps
4
Overview the
Project
1
Research to
date2

More Related Content

What's hot

The ‘assessment for learning’ pedagogical approach in an Academic Integrity o...
The ‘assessment for learning’ pedagogical approach in an Academic Integrity o...The ‘assessment for learning’ pedagogical approach in an Academic Integrity o...
The ‘assessment for learning’ pedagogical approach in an Academic Integrity o...
Neda Zdravkovic
 
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
EduSkills OECD
 
Sera conference 2012 student evaluations - making them work
Sera conference 2012   student evaluations - making them workSera conference 2012   student evaluations - making them work
Sera conference 2012 student evaluations - making them work
j.lodge
 
Study on students dropouts in advanced certificate in pre school education pr...
Study on students dropouts in advanced certificate in pre school education pr...Study on students dropouts in advanced certificate in pre school education pr...
Study on students dropouts in advanced certificate in pre school education pr...
The Open University of Sri Lanka
 
Do q
Do qDo q
Authentic assessment
Authentic assessmentAuthentic assessment
Authentic assessment
David Carless
 
Recommendations on Formative Assessment and Feedback Practices for stronger e...
Recommendations on Formative Assessment and Feedback Practices for stronger e...Recommendations on Formative Assessment and Feedback Practices for stronger e...
Recommendations on Formative Assessment and Feedback Practices for stronger e...
Open Education Global (OEGlobal)
 
Connecticut mesuring and modeling growth
Connecticut   mesuring and modeling growthConnecticut   mesuring and modeling growth
Connecticut mesuring and modeling growth
John Cronin
 
Connecticut mesuring and modeling growth
Connecticut   mesuring and modeling growthConnecticut   mesuring and modeling growth
Connecticut mesuring and modeling growth
John Cronin
 
Connecticut mesuring and modeling growth
Connecticut   mesuring and modeling growthConnecticut   mesuring and modeling growth
Connecticut mesuring and modeling growth
John Cronin
 
Post 7. comparative and non comparative evaluation in educational technology
Post 7. comparative and non comparative evaluation in educational technologyPost 7. comparative and non comparative evaluation in educational technology
Post 7. comparative and non comparative evaluation in educational technology
mazin
 
1.vina serevina ahmad rampiki
1.vina serevina ahmad rampiki1.vina serevina ahmad rampiki
1.vina serevina ahmad rampiki
vinaserevina
 
Summative assessment( advantages vs. disadvantages)
Summative assessment( advantages vs. disadvantages)Summative assessment( advantages vs. disadvantages)
Summative assessment( advantages vs. disadvantages)
Love Joy Amargo
 
Formative and summative assessments
Formative and summative assessmentsFormative and summative assessments
Formative and summative assessments
Kelly Hedges
 
Standardized Tests, by Kathy and Mary
Standardized Tests, by Kathy and MaryStandardized Tests, by Kathy and Mary
Standardized Tests, by Kathy and Mary
marz_bar_angel_9999
 
Assessments for Programs and Learning
Assessments for Programs and LearningAssessments for Programs and Learning
Assessments for Programs and Learning
Lisa MacLeod
 
Formative and summative assessments unit 3 revised without references
Formative and summative assessments unit 3 revised without referencesFormative and summative assessments unit 3 revised without references
Formative and summative assessments unit 3 revised without references
pbingham1
 
Non-cognitive Skills_CES_FF_161203_Final
Non-cognitive Skills_CES_FF_161203_FinalNon-cognitive Skills_CES_FF_161203_Final
Non-cognitive Skills_CES_FF_161203_Final
Michael M. Brownstein, M.B.A., Ed.M.
 
Feedback requests in ELT and beyond
Feedback requests in ELT and beyondFeedback requests in ELT and beyond
Feedback requests in ELT and beyond
David Carless
 
Models of Evaluation in Educational Technology
Models of Evaluation in Educational TechnologyModels of Evaluation in Educational Technology
Models of Evaluation in Educational Technology
Alaa Sadik
 

What's hot (20)

The ‘assessment for learning’ pedagogical approach in an Academic Integrity o...
The ‘assessment for learning’ pedagogical approach in an Academic Integrity o...The ‘assessment for learning’ pedagogical approach in an Academic Integrity o...
The ‘assessment for learning’ pedagogical approach in an Academic Integrity o...
 
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outc...
 
Sera conference 2012 student evaluations - making them work
Sera conference 2012   student evaluations - making them workSera conference 2012   student evaluations - making them work
Sera conference 2012 student evaluations - making them work
 
Study on students dropouts in advanced certificate in pre school education pr...
Study on students dropouts in advanced certificate in pre school education pr...Study on students dropouts in advanced certificate in pre school education pr...
Study on students dropouts in advanced certificate in pre school education pr...
 
Do q
Do qDo q
Do q
 
Authentic assessment
Authentic assessmentAuthentic assessment
Authentic assessment
 
Recommendations on Formative Assessment and Feedback Practices for stronger e...
Recommendations on Formative Assessment and Feedback Practices for stronger e...Recommendations on Formative Assessment and Feedback Practices for stronger e...
Recommendations on Formative Assessment and Feedback Practices for stronger e...
 
Connecticut mesuring and modeling growth
Connecticut   mesuring and modeling growthConnecticut   mesuring and modeling growth
Connecticut mesuring and modeling growth
 
Connecticut mesuring and modeling growth
Connecticut   mesuring and modeling growthConnecticut   mesuring and modeling growth
Connecticut mesuring and modeling growth
 
Connecticut mesuring and modeling growth
Connecticut   mesuring and modeling growthConnecticut   mesuring and modeling growth
Connecticut mesuring and modeling growth
 
Post 7. comparative and non comparative evaluation in educational technology
Post 7. comparative and non comparative evaluation in educational technologyPost 7. comparative and non comparative evaluation in educational technology
Post 7. comparative and non comparative evaluation in educational technology
 
1.vina serevina ahmad rampiki
1.vina serevina ahmad rampiki1.vina serevina ahmad rampiki
1.vina serevina ahmad rampiki
 
Summative assessment( advantages vs. disadvantages)
Summative assessment( advantages vs. disadvantages)Summative assessment( advantages vs. disadvantages)
Summative assessment( advantages vs. disadvantages)
 
Formative and summative assessments
Formative and summative assessmentsFormative and summative assessments
Formative and summative assessments
 
Standardized Tests, by Kathy and Mary
Standardized Tests, by Kathy and MaryStandardized Tests, by Kathy and Mary
Standardized Tests, by Kathy and Mary
 
Assessments for Programs and Learning
Assessments for Programs and LearningAssessments for Programs and Learning
Assessments for Programs and Learning
 
Formative and summative assessments unit 3 revised without references
Formative and summative assessments unit 3 revised without referencesFormative and summative assessments unit 3 revised without references
Formative and summative assessments unit 3 revised without references
 
Non-cognitive Skills_CES_FF_161203_Final
Non-cognitive Skills_CES_FF_161203_FinalNon-cognitive Skills_CES_FF_161203_Final
Non-cognitive Skills_CES_FF_161203_Final
 
Feedback requests in ELT and beyond
Feedback requests in ELT and beyondFeedback requests in ELT and beyond
Feedback requests in ELT and beyond
 
Models of Evaluation in Educational Technology
Models of Evaluation in Educational TechnologyModels of Evaluation in Educational Technology
Models of Evaluation in Educational Technology
 

Viewers also liked

Keynote PBL, Transfer and New Media
Keynote PBL, Transfer and New MediaKeynote PBL, Transfer and New Media
Keynote PBL, Transfer and New Media
Bart Rienties
 
Discussant SRHE Symposium "A cross-institutional perspective on merits and ch...
Discussant SRHE Symposium "A cross-institutional perspective on merits and ch...Discussant SRHE Symposium "A cross-institutional perspective on merits and ch...
Discussant SRHE Symposium "A cross-institutional perspective on merits and ch...
Bart Rienties
 
TALIS Presentation: The impact of learning design on student behaviour, satis...
TALIS Presentation: The impact of learning design on student behaviour, satis...TALIS Presentation: The impact of learning design on student behaviour, satis...
TALIS Presentation: The impact of learning design on student behaviour, satis...
Bart Rienties
 
La rienties sirikt_27_05_2015
La rienties sirikt_27_05_2015La rienties sirikt_27_05_2015
La rienties sirikt_27_05_2015
Bart Rienties
 
Are emotions driving better university courses?
Are emotions driving better university courses?Are emotions driving better university courses?
Are emotions driving better university courses?
Bart Rienties
 
ESRC International Distance Education and African Students Advisory Panel Mee...
ESRC International Distance Education and African Students Advisory Panel Mee...ESRC International Distance Education and African Students Advisory Panel Mee...
ESRC International Distance Education and African Students Advisory Panel Mee...
Bart Rienties
 
Keynote address Analytics4Action Evaluation Framework: a review of evidence-...
Keynote address  Analytics4Action Evaluation Framework: a review of evidence-...Keynote address  Analytics4Action Evaluation Framework: a review of evidence-...
Keynote address Analytics4Action Evaluation Framework: a review of evidence-...
Bart Rienties
 
SRHE2016: Multilevel Modelling of Learning Gains: The Impact of Module Partic...
SRHE2016: Multilevel Modelling of Learning Gains: The Impact of Module Partic...SRHE2016: Multilevel Modelling of Learning Gains: The Impact of Module Partic...
SRHE2016: Multilevel Modelling of Learning Gains: The Impact of Module Partic...
Bart Rienties
 
Keynote H818 The Power of (In)formal learning: a learning analytics approach
Keynote H818 The Power of (In)formal learning: a learning analytics approachKeynote H818 The Power of (In)formal learning: a learning analytics approach
Keynote H818 The Power of (In)formal learning: a learning analytics approach
Bart Rienties
 
Affective behaviour cognition learning gains project presentation
Affective behaviour cognition learning gains project presentationAffective behaviour cognition learning gains project presentation
Affective behaviour cognition learning gains project presentation
Bart Rienties
 
The power of learning analytics for UCL: lessons learned from the Open Univer...
The power of learning analytics for UCL: lessons learned from the Open Univer...The power of learning analytics for UCL: lessons learned from the Open Univer...
The power of learning analytics for UCL: lessons learned from the Open Univer...
Bart Rienties
 
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
Bart Rienties
 
The power of learning analytics to measure learning gains: an OU, Surrey and ...
The power of learning analytics to measure learning gains: an OU, Surrey and ...The power of learning analytics to measure learning gains: an OU, Surrey and ...
The power of learning analytics to measure learning gains: an OU, Surrey and ...
Bart Rienties
 
Global experiences with e-learning and data
Global experiences with e-learning and dataGlobal experiences with e-learning and data
Global experiences with e-learning and data
Bart Rienties
 
Learning design meets learning analytics: Dr Bart Rienties, Open University
Learning design meets learning analytics: Dr Bart Rienties, Open UniversityLearning design meets learning analytics: Dr Bart Rienties, Open University
Learning design meets learning analytics: Dr Bart Rienties, Open University
Bart Rienties
 
Ppt on retail management
Ppt on retail managementPpt on retail management
Ppt on retail management
pawan_sharma
 
Retail management
Retail managementRetail management
Retail management
Anirban Mazumdar
 

Viewers also liked (17)

Keynote PBL, Transfer and New Media
Keynote PBL, Transfer and New MediaKeynote PBL, Transfer and New Media
Keynote PBL, Transfer and New Media
 
Discussant SRHE Symposium "A cross-institutional perspective on merits and ch...
Discussant SRHE Symposium "A cross-institutional perspective on merits and ch...Discussant SRHE Symposium "A cross-institutional perspective on merits and ch...
Discussant SRHE Symposium "A cross-institutional perspective on merits and ch...
 
TALIS Presentation: The impact of learning design on student behaviour, satis...
TALIS Presentation: The impact of learning design on student behaviour, satis...TALIS Presentation: The impact of learning design on student behaviour, satis...
TALIS Presentation: The impact of learning design on student behaviour, satis...
 
La rienties sirikt_27_05_2015
La rienties sirikt_27_05_2015La rienties sirikt_27_05_2015
La rienties sirikt_27_05_2015
 
Are emotions driving better university courses?
Are emotions driving better university courses?Are emotions driving better university courses?
Are emotions driving better university courses?
 
ESRC International Distance Education and African Students Advisory Panel Mee...
ESRC International Distance Education and African Students Advisory Panel Mee...ESRC International Distance Education and African Students Advisory Panel Mee...
ESRC International Distance Education and African Students Advisory Panel Mee...
 
Keynote address Analytics4Action Evaluation Framework: a review of evidence-...
Keynote address  Analytics4Action Evaluation Framework: a review of evidence-...Keynote address  Analytics4Action Evaluation Framework: a review of evidence-...
Keynote address Analytics4Action Evaluation Framework: a review of evidence-...
 
SRHE2016: Multilevel Modelling of Learning Gains: The Impact of Module Partic...
SRHE2016: Multilevel Modelling of Learning Gains: The Impact of Module Partic...SRHE2016: Multilevel Modelling of Learning Gains: The Impact of Module Partic...
SRHE2016: Multilevel Modelling of Learning Gains: The Impact of Module Partic...
 
Keynote H818 The Power of (In)formal learning: a learning analytics approach
Keynote H818 The Power of (In)formal learning: a learning analytics approachKeynote H818 The Power of (In)formal learning: a learning analytics approach
Keynote H818 The Power of (In)formal learning: a learning analytics approach
 
Affective behaviour cognition learning gains project presentation
Affective behaviour cognition learning gains project presentationAffective behaviour cognition learning gains project presentation
Affective behaviour cognition learning gains project presentation
 
The power of learning analytics for UCL: lessons learned from the Open Univer...
The power of learning analytics for UCL: lessons learned from the Open Univer...The power of learning analytics for UCL: lessons learned from the Open Univer...
The power of learning analytics for UCL: lessons learned from the Open Univer...
 
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
 
The power of learning analytics to measure learning gains: an OU, Surrey and ...
The power of learning analytics to measure learning gains: an OU, Surrey and ...The power of learning analytics to measure learning gains: an OU, Surrey and ...
The power of learning analytics to measure learning gains: an OU, Surrey and ...
 
Global experiences with e-learning and data
Global experiences with e-learning and dataGlobal experiences with e-learning and data
Global experiences with e-learning and data
 
Learning design meets learning analytics: Dr Bart Rienties, Open University
Learning design meets learning analytics: Dr Bart Rienties, Open UniversityLearning design meets learning analytics: Dr Bart Rienties, Open University
Learning design meets learning analytics: Dr Bart Rienties, Open University
 
Ppt on retail management
Ppt on retail managementPpt on retail management
Ppt on retail management
 
Retail management
Retail managementRetail management
Retail management
 

Similar to QAA Modelling and Managing Student Satisfaction: Use of student feedback to enhance learning experience

Keynote: 7th eSTEeM Annual Conference Critical discussion of Student Evaluati...
Keynote: 7th eSTEeM Annual Conference Critical discussion of Student Evaluati...Keynote: 7th eSTEeM Annual Conference Critical discussion of Student Evaluati...
Keynote: 7th eSTEeM Annual Conference Critical discussion of Student Evaluati...
Bart Rienties
 
GROUP 3 BTMbnvvvvvbcccccccccbxfhffdddhhhhhhhggggggggggggggggg.pptx
GROUP 3 BTMbnvvvvvbcccccccccbxfhffdddhhhhhhhggggggggggggggggg.pptxGROUP 3 BTMbnvvvvvbcccccccccbxfhffdddhhhhhhhggggggggggggggggg.pptx
GROUP 3 BTMbnvvvvvbcccccccccbxfhffdddhhhhhhhggggggggggggggggg.pptx
abusunabakali
 
Assessment Literacy - Simon Roberts
Assessment Literacy - Simon RobertsAssessment Literacy - Simon Roberts
Assessment Literacy - Simon Roberts
mdxaltc
 
VERSITIES_EYE_OPENER
VERSITIES_EYE_OPENERVERSITIES_EYE_OPENER
VERSITIES_EYE_OPENER
Dr. Sunil Deshpande
 
CQI through assessing LO
CQI through assessing LO  CQI through assessing LO
CQI through assessing LO
SHAKINAZ DESA
 
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'DonoghueLearning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
mdxaltc
 
Effective Pedagogy
Effective PedagogyEffective Pedagogy
Interrogating evaluation 2015 induction
Interrogating evaluation 2015 inductionInterrogating evaluation 2015 induction
Interrogating evaluation 2015 induction
Rita Ndagire Kizito
 
Interrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionbInterrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionb
Rita Ndagire Kizito
 
HowULearn_2016_presentation
HowULearn_2016_presentationHowULearn_2016_presentation
HowULearn_2016_presentation
Anna Parpala
 
Examination reform
Examination reformExamination reform
Examination reform
goggigupta
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many faces
leesha roberts
 
unit- 8.pdf
unit- 8.pdfunit- 8.pdf
unit- 8.pdf
Hafiz20006
 
Continuous and comprehensive evaluation (cce)
Continuous and comprehensive evaluation (cce)Continuous and comprehensive evaluation (cce)
Continuous and comprehensive evaluation (cce)
Waheeda Bushra
 
Evaluating the impact of the Pandemic on departmental uses of learning techno...
Evaluating the impact of the Pandemic on departmental uses of learning techno...Evaluating the impact of the Pandemic on departmental uses of learning techno...
Evaluating the impact of the Pandemic on departmental uses of learning techno...
RichardM_Walker
 
Continuous Assessment
Continuous AssessmentContinuous Assessment
Continuous Assessment
Markos Mulat G
 
ADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdfADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdf
ADOVH-University of South Africa
 
teaching material
teaching material teaching material
teaching material
Kadek Astiti
 
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptxUNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
Elieser Sheya
 
Continuous and comprehensive evaluation
Continuous and comprehensive evaluationContinuous and comprehensive evaluation
Continuous and comprehensive evaluation
The Gandhigram Rural Institute (Deemed to be University)
 

Similar to QAA Modelling and Managing Student Satisfaction: Use of student feedback to enhance learning experience (20)

Keynote: 7th eSTEeM Annual Conference Critical discussion of Student Evaluati...
Keynote: 7th eSTEeM Annual Conference Critical discussion of Student Evaluati...Keynote: 7th eSTEeM Annual Conference Critical discussion of Student Evaluati...
Keynote: 7th eSTEeM Annual Conference Critical discussion of Student Evaluati...
 
GROUP 3 BTMbnvvvvvbcccccccccbxfhffdddhhhhhhhggggggggggggggggg.pptx
GROUP 3 BTMbnvvvvvbcccccccccbxfhffdddhhhhhhhggggggggggggggggg.pptxGROUP 3 BTMbnvvvvvbcccccccccbxfhffdddhhhhhhhggggggggggggggggg.pptx
GROUP 3 BTMbnvvvvvbcccccccccbxfhffdddhhhhhhhggggggggggggggggg.pptx
 
Assessment Literacy - Simon Roberts
Assessment Literacy - Simon RobertsAssessment Literacy - Simon Roberts
Assessment Literacy - Simon Roberts
 
VERSITIES_EYE_OPENER
VERSITIES_EYE_OPENERVERSITIES_EYE_OPENER
VERSITIES_EYE_OPENER
 
CQI through assessing LO
CQI through assessing LO  CQI through assessing LO
CQI through assessing LO
 
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'DonoghueLearning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
 
Effective Pedagogy
Effective PedagogyEffective Pedagogy
Effective Pedagogy
 
Interrogating evaluation 2015 induction
Interrogating evaluation 2015 inductionInterrogating evaluation 2015 induction
Interrogating evaluation 2015 induction
 
Interrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionbInterrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionb
 
HowULearn_2016_presentation
HowULearn_2016_presentationHowULearn_2016_presentation
HowULearn_2016_presentation
 
Examination reform
Examination reformExamination reform
Examination reform
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many faces
 
unit- 8.pdf
unit- 8.pdfunit- 8.pdf
unit- 8.pdf
 
Continuous and comprehensive evaluation (cce)
Continuous and comprehensive evaluation (cce)Continuous and comprehensive evaluation (cce)
Continuous and comprehensive evaluation (cce)
 
Evaluating the impact of the Pandemic on departmental uses of learning techno...
Evaluating the impact of the Pandemic on departmental uses of learning techno...Evaluating the impact of the Pandemic on departmental uses of learning techno...
Evaluating the impact of the Pandemic on departmental uses of learning techno...
 
Continuous Assessment
Continuous AssessmentContinuous Assessment
Continuous Assessment
 
ADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdfADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdf
 
teaching material
teaching material teaching material
teaching material
 
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptxUNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
UNIT 6 CURRICULUM ASSESSMENT AND EVALUATION NOTES (1).pptx
 
Continuous and comprehensive evaluation
Continuous and comprehensive evaluationContinuous and comprehensive evaluation
Continuous and comprehensive evaluation
 

More from Bart Rienties

Applying and translating learning design and analytics approaches in your ins...
Applying and translating learning design and analytics approaches in your ins...Applying and translating learning design and analytics approaches in your ins...
Applying and translating learning design and analytics approaches in your ins...
Bart Rienties
 
Keynote Presentation: Implementing learning analytics and learning design at ...
Keynote Presentation: Implementing learning analytics and learning design at ...Keynote Presentation: Implementing learning analytics and learning design at ...
Keynote Presentation: Implementing learning analytics and learning design at ...
Bart Rienties
 
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
Bart Rienties
 
How can you use learning analytics in your own research and practice: an intr...
How can you use learning analytics in your own research and practice: an intr...How can you use learning analytics in your own research and practice: an intr...
How can you use learning analytics in your own research and practice: an intr...
Bart Rienties
 
SAAIR: Implementing learning analytics at scale in an online world: lessons l...
SAAIR: Implementing learning analytics at scale in an online world: lessons l...SAAIR: Implementing learning analytics at scale in an online world: lessons l...
SAAIR: Implementing learning analytics at scale in an online world: lessons l...
Bart Rienties
 
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
Bart Rienties
 
Keynote Learning & Innovation Maastricht University
Keynote Learning & Innovation Maastricht UniversityKeynote Learning & Innovation Maastricht University
Keynote Learning & Innovation Maastricht University
Bart Rienties
 
Education 4.0 and Computer Science: A European perspective
Education 4.0 and Computer Science: A European perspectiveEducation 4.0 and Computer Science: A European perspective
Education 4.0 and Computer Science: A European perspective
Bart Rienties
 
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
Bart Rienties
 
Keynote Data Matters JISC What is the impact? Six years of learning analytics...
Keynote Data Matters JISC What is the impact? Six years of learning analytics...Keynote Data Matters JISC What is the impact? Six years of learning analytics...
Keynote Data Matters JISC What is the impact? Six years of learning analytics...
Bart Rienties
 
What have we learned from 6 years of implementing learning analytics amongst ...
What have we learned from 6 years of implementing learning analytics amongst ...What have we learned from 6 years of implementing learning analytics amongst ...
What have we learned from 6 years of implementing learning analytics amongst ...
Bart Rienties
 
Using Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open UniversityUsing Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open University
Bart Rienties
 
Using student data to transform teaching and learning
Using student data to transform teaching and learningUsing student data to transform teaching and learning
Using student data to transform teaching and learning
Bart Rienties
 
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
Bart Rienties
 
Lecture series: Using trace data or subjective data, that is the question dur...
Lecture series: Using trace data or subjective data, that is the question dur...Lecture series: Using trace data or subjective data, that is the question dur...
Lecture series: Using trace data or subjective data, that is the question dur...
Bart Rienties
 
How to analyse questionnaire data: an advanced session
How to analyse questionnaire data: an advanced sessionHow to analyse questionnaire data: an advanced session
How to analyse questionnaire data: an advanced session
Bart Rienties
 
Questionnaire design for beginners (Bart Rienties)
Questionnaire design for beginners (Bart Rienties)Questionnaire design for beginners (Bart Rienties)
Questionnaire design for beginners (Bart Rienties)
Bart Rienties
 
Learning analytics adoption in Higher Education: Reviewing six years of exper...
Learning analytics adoption in Higher Education: Reviewing six years of exper...Learning analytics adoption in Higher Education: Reviewing six years of exper...
Learning analytics adoption in Higher Education: Reviewing six years of exper...
Bart Rienties
 
«Learning Analytics at the Open University and the UK»
 «Learning Analytics at the Open University and the UK» «Learning Analytics at the Open University and the UK»
«Learning Analytics at the Open University and the UK»
Bart Rienties
 
Presentation LMU Munich: The power of learning analytics to unpack learning a...
Presentation LMU Munich: The power of learning analytics to unpack learning a...Presentation LMU Munich: The power of learning analytics to unpack learning a...
Presentation LMU Munich: The power of learning analytics to unpack learning a...
Bart Rienties
 

More from Bart Rienties (20)

Applying and translating learning design and analytics approaches in your ins...
Applying and translating learning design and analytics approaches in your ins...Applying and translating learning design and analytics approaches in your ins...
Applying and translating learning design and analytics approaches in your ins...
 
Keynote Presentation: Implementing learning analytics and learning design at ...
Keynote Presentation: Implementing learning analytics and learning design at ...Keynote Presentation: Implementing learning analytics and learning design at ...
Keynote Presentation: Implementing learning analytics and learning design at ...
 
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
 
How can you use learning analytics in your own research and practice: an intr...
How can you use learning analytics in your own research and practice: an intr...How can you use learning analytics in your own research and practice: an intr...
How can you use learning analytics in your own research and practice: an intr...
 
SAAIR: Implementing learning analytics at scale in an online world: lessons l...
SAAIR: Implementing learning analytics at scale in an online world: lessons l...SAAIR: Implementing learning analytics at scale in an online world: lessons l...
SAAIR: Implementing learning analytics at scale in an online world: lessons l...
 
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
 
Keynote Learning & Innovation Maastricht University
Keynote Learning & Innovation Maastricht UniversityKeynote Learning & Innovation Maastricht University
Keynote Learning & Innovation Maastricht University
 
Education 4.0 and Computer Science: A European perspective
Education 4.0 and Computer Science: A European perspectiveEducation 4.0 and Computer Science: A European perspective
Education 4.0 and Computer Science: A European perspective
 
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
 
Keynote Data Matters JISC What is the impact? Six years of learning analytics...
Keynote Data Matters JISC What is the impact? Six years of learning analytics...Keynote Data Matters JISC What is the impact? Six years of learning analytics...
Keynote Data Matters JISC What is the impact? Six years of learning analytics...
 
What have we learned from 6 years of implementing learning analytics amongst ...
What have we learned from 6 years of implementing learning analytics amongst ...What have we learned from 6 years of implementing learning analytics amongst ...
What have we learned from 6 years of implementing learning analytics amongst ...
 
Using Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open UniversityUsing Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open University
 
Using student data to transform teaching and learning
Using student data to transform teaching and learningUsing student data to transform teaching and learning
Using student data to transform teaching and learning
 
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
 
Lecture series: Using trace data or subjective data, that is the question dur...
Lecture series: Using trace data or subjective data, that is the question dur...Lecture series: Using trace data or subjective data, that is the question dur...
Lecture series: Using trace data or subjective data, that is the question dur...
 
How to analyse questionnaire data: an advanced session
How to analyse questionnaire data: an advanced sessionHow to analyse questionnaire data: an advanced session
How to analyse questionnaire data: an advanced session
 
Questionnaire design for beginners (Bart Rienties)
Questionnaire design for beginners (Bart Rienties)Questionnaire design for beginners (Bart Rienties)
Questionnaire design for beginners (Bart Rienties)
 
Learning analytics adoption in Higher Education: Reviewing six years of exper...
Learning analytics adoption in Higher Education: Reviewing six years of exper...Learning analytics adoption in Higher Education: Reviewing six years of exper...
Learning analytics adoption in Higher Education: Reviewing six years of exper...
 
«Learning Analytics at the Open University and the UK»
 «Learning Analytics at the Open University and the UK» «Learning Analytics at the Open University and the UK»
«Learning Analytics at the Open University and the UK»
 
Presentation LMU Munich: The power of learning analytics to unpack learning a...
Presentation LMU Munich: The power of learning analytics to unpack learning a...Presentation LMU Munich: The power of learning analytics to unpack learning a...
Presentation LMU Munich: The power of learning analytics to unpack learning a...
 

Recently uploaded

BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
Katrina Pritchard
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
TechSoup
 
Cognitive Development Adolescence Psychology
Cognitive Development Adolescence PsychologyCognitive Development Adolescence Psychology
Cognitive Development Adolescence Psychology
paigestewart1632
 
clinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdfclinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdf
Priyankaranawat4
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Fajar Baskoro
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
Himanshu Rai
 
Life upper-Intermediate B2 Workbook for student
Life upper-Intermediate B2 Workbook for studentLife upper-Intermediate B2 Workbook for student
Life upper-Intermediate B2 Workbook for student
NgcHiNguyn25
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
Celine George
 
The basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptxThe basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptx
heathfieldcps1
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
GeorgeMilliken2
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
amberjdewit93
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Excellence Foundation for South Sudan
 
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdfবাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
eBook.com.bd (প্রয়োজনীয় বাংলা বই)
 
How to deliver Powerpoint Presentations.pptx
How to deliver Powerpoint  Presentations.pptxHow to deliver Powerpoint  Presentations.pptx
How to deliver Powerpoint Presentations.pptx
HajraNaeem15
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
Priyankaranawat4
 
How to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP ModuleHow to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP Module
Celine George
 
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptxNEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
iammrhaywood
 
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptxChapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Denish Jangid
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
Celine George
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 

Recently uploaded (20)

BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
 
Cognitive Development Adolescence Psychology
Cognitive Development Adolescence PsychologyCognitive Development Adolescence Psychology
Cognitive Development Adolescence Psychology
 
clinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdfclinical examination of hip joint (1).pdf
clinical examination of hip joint (1).pdf
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
 
Life upper-Intermediate B2 Workbook for student
Life upper-Intermediate B2 Workbook for studentLife upper-Intermediate B2 Workbook for student
Life upper-Intermediate B2 Workbook for student
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
 
The basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptxThe basics of sentences session 6pptx.pptx
The basics of sentences session 6pptx.pptx
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
 
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdfবাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
 
How to deliver Powerpoint Presentations.pptx
How to deliver Powerpoint  Presentations.pptxHow to deliver Powerpoint  Presentations.pptx
How to deliver Powerpoint Presentations.pptx
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
 
How to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP ModuleHow to Add Chatter in the odoo 17 ERP Module
How to Add Chatter in the odoo 17 ERP Module
 
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptxNEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
 
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptxChapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptx
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 

QAA Modelling and Managing Student Satisfaction: Use of student feedback to enhance learning experience

  • 1. Modelling and Managing Student Satisfaction: Use of student feedback to enhance learning experience Vicky Marsh / Nai Li / Steph Lay/ Bart Rienties Vicky.Marsh@open.ac.uk Nai.Li@open.ac.uk Stephanie.lay@open.ac.uk Bart.Rienties@open.ac.uk
  • 2. Modelling and Managing Student Satisfaction: Use of student feedback to enhance learning experience 2 Research to Date 1 Overview of the Project Case study: OU QA 3 Next steps4
  • 3. Background of QAA Study • HE increasingly competitive market: student satisfaction has become an important component of Quality Assurance (QA) and Quality Enhancement (QE, Kember & Ginns, 2012; Rienties, 2014). • Measurement of student satisfaction is important to pinpoint strengths and identify areas for improvement (Coffey & Gibbs, 2001; Zerihun, Beishuizen, & Os, 2012). • Potential benefits and drawbacks of student evaluations have been well-documented in the literature (see for example Bennett & De Bellis, 2010; Crews & Curtis, 2011), o Recent research continues to suggest strong resistance amongst academic staff (Crews & Curtis, 2011; Rienties, 2014). o Most student survey instruments lack of focus on key elements of rich learning, such as interaction, assessment and feedback. • With the increased importance of NSS and institutional surveys on academic and educational practice, there is a need for a critical review of how these data are used for QA and QE.
  • 4. Key Questions of the Project 1. To what extent are institutions using insights from NSS and institutional surveys to transform their students’ experience? 2. What are the key enablers and barriers for integrating student satisfaction data with QA and QE 3. How are student experiences influencing quality enhancements a) What influences students’ perceptions of overall satisfaction the most? Are student characteristics or module/presentation related factors more predictive than satisfaction with other aspects of their learning experience? b) Is the student cohort homogenous when considering satisfaction key drivers? For example are there systematic differences depending on the level or programme of study?
  • 5. Two Phases Phase One: Literature review of link student satisfaction surveys with QA/QE • In-depth and critical desk review of available resources, including academic journal publications, ‘grey’ literature and institutional websites, • Good and best practice of students satisfaction data and QA – Informal discussions with staff – Panel of Evasys student evaluation conference Phase Two: Case-study Open University QA • Explore the construct of student satisfaction based on data collected via an internal survey conducted by the Open University (200.000+ students) • Identify which aspects of the student experience are most associated with their overall expression of satisfaction • How these findings are translated into QA and QE.
  • 6. Basic “bible” of how to design and evaluate effective student surveys Most universities share data primarily with teachers and departments, but limited feedback returned to students “students must have confidence that their feedback is part of a wider and effective system of enhancement in which students have a meaningful stake” Debbie McVitty (National Union of students)
  • 7.
  • 8. Key challenges for HE • How to provide student feedback back to students (close-the-loop) • How to provide feedback to staff to enhance their practice (academic development) • How to provide feedback to senior management (professional development)
  • 9. Case Study: Student Experience on a Module (SEaM) 2015 Analysis of Overall Satisfaction • The purpose of this analysis is to identify the key drivers of student satisfaction, ascertain whether these drivers vary by student type or level of study and in particular to determine whether satisfaction with learning design is still important once student and module characteristics have been accounted for. • to see whether satisfaction with learning design remains important once student socio- demographics, OU study history & module/presentation information has been taken into account. • Robust and replicable analysis confirming the key drivers of UG & PG student satisfaction, with clear priorities for action to improve overall satisfaction. Case study: OU QA 3 Next Steps 4 Overview the Project 1 Research to date2
  • 10. 10 • Revised Survey in place for modules that started from 2012J+ – Every student on every module will be surveyed – Integrated survey including the student feedback on their tutor (DALS) and on their module (EoM) • Three themed sets of questions which cover – The module overall – Teaching, learning and assessment – Feedback on the tutor (Tutor supported modules only) • Students are sent an invitation to participate two to three weeks before the end of the module • Coverage – includes presentations that have ended between 1st August 2013 and 31st July 2014, who had results available by 13th August 2014 – There are a selection of short course, residential school and overseas modules included in AQR that were not surveyed, these modules are not included. – All students regardless of their completion status are included - all previous SEaM results were based on students who completed only. • Reliability – Consideration should be given to response rates (34%) and the number of responding students when reviewing SEaM results. – Non-response bias Student Experience on a Module (SEaM) 2015 Survey
  • 11.
  • 12. Methodology (Logistic Regression) & Validation Step 1: A descriptive analysis was conducted to discount variables that were unsuitable for satisfaction modelling. Step 1 also identified highly correlated predictors and methodically selected the most appropriate. Module Presentation Student Concurrency Study history Overall Satisfaction SEaM UG new, UG continuing, PG new and PG continuing students were modelled separately at Step 2. Step 2: Each subset of variables was modelled in groups. The variables that were statistically significant from each subset were then combined and modelled to identify the final list of key drivers We found at Step 3 that the combined scale provided the simplest and most interpretable solution for PG students and the whole scale for UG students. The solution without the KPI’s included was much easier to use in terms of identifying clear priorities for action. Step 3 Validation: all models have been verified by using subsets of the whole data to ensure the solutions are robust. A variety of model fit statistics have also been used to identify the optimum solutions.
  • 13. Satisfaction Modelling: Undergraduate Continuing Students % planned life cycle 15 Module: Examinable Component 14 Module: Level of study 13 Module: Credits 12 Q6 Method of delivery 11 Q11 Assignment completion 09 Q23 Tutor knowledge 07 Q3 Advice & guidance 05 Q13 Qualificatio n aim 03 KPI-05 Teaching materials 01 KPI-06 Workload 10 Q9 Assignment instructions 08 Q14 Career relevance 06 Q5 Integration of materials 04 Q36 Assessment 02 Importance to Overall Satisfaction
  • 14. Satisfaction Modelling: Undergraduate New Students Age 07 Q14 Career relevance 05 Q3 Advice & guidance 03 KPI-05 Teaching materials 01 Q13 Qualification aim 06 Q5 Integration of materials 04 Q36 Assessment 02 Importance to Overall Satisfaction
  • 15. Satisfaction Modelling : UG Continuing VS New Students • Both the models are dominated by the survey questions, confirming that satisfaction with learning design is a better driver for overall satisfaction. • The UG continuing model is the only one where level is a significant driver. • The drivers of new UG student are very similar to continuing students with the exception of age group. • Satisfaction with teaching materials, assessment and advice and guidance are absolutely key for UG students when predicting overall satisfaction.
  • 16. Satisfaction Modelling: Postgraduate Continuing Students Credit transfer 09 Study motivation 08 Module: Result 07 Q6 Method of delivery 05 Q36 Assessment 03 KPI-05 Teaching materials 01 Number if tutor groups 06 Q5 Integration of materials 04 Q30 Assessment feedback 02 Importance to Overall Satisfaction
  • 17. Satisfaction Modelling: Postgraduate New Students Q16 Tutor contact at start 05 Q36 Assignment 03 Q11 Assignment completion 01 Q22 Tutor help with online 06 Q12 Collaborative activities 04 Q6 Method of delivery 02 Importance to Overall Satisfaction
  • 18. Satisfaction Modelling: PG Continuing VS New Students • Satisfaction with particular aspects of the student experience remain key for PG students, • PG continuing students who are motivated by personal development are most likely to be satisfied with their overall experience. • The PG continuing model is much more similar to the UG models than the PG new. • This is not surprising as there are a smaller number of students available to model for PG new, therefore, this is the least stable of the four models and would benefit from the addition of another cohort of students to validate it robustly.
  • 19. Student Experience on a Module (SEaM) 2015 Analysis of Overall Satisfaction: Key Findings • Satisfaction with assessment, teaching materials, integration of materials or method of delivery consistently appear as the most important key drivers of overall student satisfaction. • These findings are irrespective of student type e.g. new or continuing and module/ presentation information such as level of study (UG/PG), faculty and subject area. • Previous study experience with the OU and socio-demographics such as gender, ethnicity, socio-economic status and disability are also not predictive of overall satisfaction once satisfaction with the learning design of the module is accounted for. • The relationship between UG study level and satisfaction is not clear. This needs to be investigated further in order to establish clear recommendations. Ideally with an additional student cohort of data – this analysis was based on respondents to SEaM in the 2013/14 academic year.
  • 20. Student Experience on a Module (SEaM) 2015 Analysis of Overall Satisfaction • Add the SEaM survey questions to the pass rate model to verify the key drivers of pass compared to satisfaction. • Further investigate the relationship between UG level e.g. 1-3 and satisfaction. • Replicate the analysis for satisfaction, pass and retention with the new cohort of SEaM data for 2014/15 in order to validate these findings. • Disseminate the findings more widely. Case study: OU QA 3 Next steps 4 Overview the Project 1 Research to date2