Enhancing the First Year Student
Experience at MMU:
Clearing a path & interpreting digital footprints
Professor Mark Stubb...
Context | An interesting place to work!
• Large, popular, multi-campus university
– 36,000+ students | 1,000+ courses | co...
Context | Strategic improvement imperative
Student Retention
Success &
Satisfaction
Student Intake
(Aspirations, Attitude
...
CSI | Student Experience
Careful diagnosis of (diverse) learning experiences
• Recurrent messages
– NSS analysis: course o...
CSI | Student Retention & Success
Reflect on…
+ Assumptions
+ Interventions
Examine data…
+ Focus Groups
+ Surveys
+ Journ...
Coordinating our response
B
Improve satisfaction, retention & success
Great
Online Experience
(Seamless, personalised)
Gre...
• A coordinated strike for step-change improvement
EQAL
New Curriculum
• designing new units, …
New Admin Systems & Proces...
MISSION:
868
L3+L4
modules
1
Wrapping the institution around the learner
Student ID
Timetable
This work is licensed under a Attribution-
NonCommercia...
Pre-entry access to timetables
Wrapping the institution around the learner
Student ID (+ Unit code)
Deadlines / extensions /
feedback return dates / prov...
Wrapping the institution around the learner
Unit code
Resource list
Relevant resource
This work is licensed under a Attrib...
Wrapping the institution around the learner
Unit code
Past exam papers
Past exam paper
This work is licensed under a Attri...
MyMMU App
m-admin
Summary | we cleared a
path to the information our
learners needed…
Engaging our
students
Providing
business
intelligence
Automating
our
processes
Are we in a better place now?
… we can now begin to
interpret some digital
footprints
Using the data
2. Identify
relevant data
sources
3.Summarise
individual
data sources
4 Join on
common
identifiers
5 Prep t...
Understanding student satisfaction
2. Identify
relevant data
sources
3.Summarise
individual
data sources
4 Join on
common
...
Understanding student success
2. Identify
relevant data
sources
3.Summarise
individual
data sources
4 Join on
common
ident...
Conditional Inference Trees
Party
Library
Limitations
1. Confirmation bias
2. Meaningful comparison
3. Quantitative V Qualitative
4. Data quality
5. Correlation ≠ c...
Continuous monitoring & improvement
MDL SRS TT
Data Warehouse Analysis
Cubes
Undergraduate Dental TechnologyNetwork (11209...
Change management lessons
1. Understand important dynamics
2. Be clear what needs to be done
3. Set high-level goals
4. Un...
LRT Talks 20140610 EFYE2014 Nottingham
LRT Talks 20140610 EFYE2014 Nottingham
Upcoming SlideShare
Loading in …5
×

LRT Talks 20140610 EFYE2014 Nottingham

206 views
146 views

Published on

Summary of work undertaken at Manchester Metropolitan University to enhance the student experience, beginning with a rewrite of the first year undergraduate curriculum and including the delivery of personalised systems that wrap institutional resources around the learner

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
206
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

LRT Talks 20140610 EFYE2014 Nottingham

  1. 1. Enhancing the First Year Student Experience at MMU: Clearing a path & interpreting digital footprints Professor Mark Stubbs Head of Learning & Research Technologies http://twitter.com/thestubbs http://slideshare.net/markstubbs Nottingham | Jun 2014 #EFYE2014
  2. 2. Context | An interesting place to work! • Large, popular, multi-campus university – 36,000+ students | 1,000+ courses | consolidating from 7 sites • Pursuing an ambitious transformation initiative – New Buildings, New Curriculum, New Admin Processes & Systems, New Learning & Mobile Tech, New Quality Processes…
  3. 3. Context | Strategic improvement imperative Student Retention Success & Satisfaction Student Intake (Aspirations, Attitude & Abilities) Learning, Teaching, Assessment & Personal Development Processes, Facilities & Resources Reputation Marketing & Recruitment Processes All Year Numbers Resource allocation League table rankingsA A Recruit to target B B Improve satisfaction, retention & success C C Inform decision-makers
  4. 4. CSI | Student Experience Careful diagnosis of (diverse) learning experiences • Recurrent messages – NSS analysis: course organisation determines Q22 – Mobile surveys: deadlines, timetables… (m-admin) – Focus groups: consistent, easy to find info • Great (and not-so great) expectations – “engaging, well-organised courses” – “inspirational tutors who know me”
  5. 5. CSI | Student Retention & Success Reflect on… + Assumptions + Interventions Examine data… + Focus Groups + Surveys + Journey journals + Observations + National data Review literature… + Multi-dimensional + Belonging + Habitus + Polishing + … B Improve satisfaction, retention & success Literature Journeys Wed 9, N31
  6. 6. Coordinating our response B Improve satisfaction, retention & success Great Online Experience (Seamless, personalised) Great Learning Spaces Great Teaching Simplify Unwieldy Curriculum £350M
  7. 7. • A coordinated strike for step-change improvement EQAL New Curriculum • designing new units, … New Admin Systems & Processes • personal timetabling, … New Virtual Learning Environment • Moodle & myMMU web/mobile, Talis Aspire… New QA & QE Processes • facilitating curriculum transformation In the current climate Diminishing unit of resource Everything depends on everything else We are large and risk averse
  8. 8. MISSION:
  9. 9. 868 L3+L4 modules
  10. 10. 1 Wrapping the institution around the learner Student ID Timetable This work is licensed under a Attribution- NonCommercial-ShareAlike 2.0 licence Sync to personal device
  11. 11. Pre-entry access to timetables
  12. 12. Wrapping the institution around the learner Student ID (+ Unit code) Deadlines / extensions / feedback return dates / provisional marks Personalised submission sheet This work is licensed under a Attribution- NonCommercial-ShareAlike 2.0 licence
  13. 13. Wrapping the institution around the learner Unit code Resource list Relevant resource This work is licensed under a Attribution- NonCommercial-ShareAlike 2.0 licence
  14. 14. Wrapping the institution around the learner Unit code Past exam papers Past exam paper This work is licensed under a Attribution- NonCommercial-ShareAlike 2.0 licence
  15. 15. MyMMU App m-admin
  16. 16. Summary | we cleared a path to the information our learners needed…
  17. 17. Engaging our students Providing business intelligence Automating our processes Are we in a better place now?
  18. 18. … we can now begin to interpret some digital footprints
  19. 19. Using the data 2. Identify relevant data sources 3.Summarise individual data sources 4 Join on common identifiers 5 Prep the data for analysis 6.Analyse & visualise 1.Appreciate the issue Refining understanding of a problem space
  20. 20. Understanding student satisfaction 2. Identify relevant data sources 3.Summarise individual data sources 4 Join on common identifiers 5 Prep the data for analysis 6.Analyse & visualise 1.Appreciate the issue Refining understanding of student satisfaction Student demographics Entry profiles Internal survey responses Join on student ID Random Forests analysis Satisfaction predictors ↗ Confidence ↘ Organisation →Teaching Sum entry points & qual type Handle missing values, collapse categories…
  21. 21. Understanding student success 2. Identify relevant data sources 3.Summarise individual data sources 4 Join on common identifiers 5 Prep the data for analysis 6.Analyse & visualise 1.Appreciate the issue Refining understanding of student continuation HESA PI League Tables Join on UK PRN Random Forests Regression Tree Predictors YNG NSSEC4-7 Entry Tariff NSS Add UKPRN Handle missing values, collapse categories…
  22. 22. Conditional Inference Trees Party Library
  23. 23. Limitations 1. Confirmation bias 2. Meaningful comparison 3. Quantitative V Qualitative 4. Data quality 5. Correlation ≠ causation Reality of our current data warehouse build: careful thought about error handling + painstaking checking of joins!
  24. 24. Continuous monitoring & improvement MDL SRS TT Data Warehouse Analysis Cubes Undergraduate Dental TechnologyNetwork (11209A) Overview Students Success Satisfaction Engagement Standards Applications Employment Head count [now] of [all]studentsfor [all modes][all enrolments] Enrolled 268 (95%) Withdrawn 0 (0%) Suspended 0 (0%) Repeat w/o attend 14 (5%) #STUDENTS TOTAL L3 L4 L5 YO L6 L7 Undergraduate Dental Technology Network (11029A) 268 83 73 67 45 - BSc(Hons)Dental Technology (6266) 184 73 67 44 + BSc(Hons) Dental Technology (6266_1F) 73 73 + BSc(Hons) Dental Technology (6266_2F) 67 67 + BSc(Hons) Dental Technology (6266_3F) 44 44 + BSc(Hons)Dental Technology (6267) 1 1 + FDSc Dental Technology (621C) 62 62 + FDSc Dental Technology (6264) 21 21 How has my studentcohort changed? Higher than faculty average Lower than last year 5%-5% 5% -5% PLP Parents in HE Mature Live at home Higher than last year Lower than faculty average Live at home 12% PLP 4% Mature 6% Disability 3% BME 8% Male 42% International 4% In response to this information,I intend [to highlightthe followinggood practice] Previously,the Programme Leader committed to… On 21/03/13 Done? On 22/02/13 raisewith the Dean targets for the part-time courses Complete CMI: Undergraduate Dental TechnologyNetwork(11209A) Overview Students Success Satisfaction Engagement Standards Applications Employme Satisfaction [onall ISS] of [all]studentsfor [all modes][all enrolments] Course Satisfaction 0% 100%50%25% 75% 69% #Enrolled Response Explanation Feedback Advice Organisation Resources Confidence Overall Undergraduate Dental Technology Network (11029A) 268 30% 100% 93% 93% 87% 96% 95% 100% - BSc(Hons)Dental Technology (6266) 184 30% 100% 93% 93% 87% 96% 95% 100% - 6266_1F 73 27% 100% 95% 95% 95% 95% 100% 100% - 6266_2F 67 31% 100% 100% 95% 81% 100% 95% 100% - 6266_3F 44 32% 100% 79% 86% 86% 93% 86% 100% 60.0% 65.0% 70.0% 75.0% 80.0% 85.0% 90.0% 95.0% 100.0% 2011 2012 2013 2011 2012 2013 2011 2012 2013 2011 2012 2013 2011 2012 2013 2011 2012 2013 2011 2012 2013 EXPLANATION FEEDBACK ADVICE ORGANISATION RESOURCES CONFIDENCE OVERALL C
  25. 25. Change management lessons 1. Understand important dynamics 2. Be clear what needs to be done 3. Set high-level goals 4. Understand where change is required 5. Be bold and plan holistically 6. Ensure you’ve got the right team to drive 7. Make ‘big asks’ as small as possible 8. Make it stick with reinforcing change http://tinyurl.com/jiscmmusrcCurriculum Design Assessment & Feedback http://tinyurl.com/jiscmmutraffic

×