SlideShare a Scribd company logo
TRansforming Assessment &
Feedback For Institutional Change:
our journey so far…
Birmingham | May 2013
Professor Mark Stubbs
Head of Learning & Research Technologies
m.stubbs@mmu.ac.uk http://twitter.com/thestubbs
http://slideshare.net/markstubbs
Strand A : Goal = institution-wide impact
• Hitched TRAFFIC to the EQAL delivery wagon
• Took our baseline report to committees that matter
• Influenced ICP on Assessment of Students
• Analysed assessment data & appeals
EQAL: new rules for summative assessment
• Aim to address over-assessment in FT UG provision
– Max 2 summative elements per 30 credit module
– Rolling out year-by-year to all UGs from Sep 2011
2011/12 (n=8,708) 2012/13 (n=8,646)
FB SATISFCN HAND-INS BUNCHING FB SATISFCN HAND-INS BUNCHING
L4 3.75 5.61 1.29 3.79 (+1%) 5.59 (0%) 1.25 (-3%)
L5 3.70 10.47 1.38 3.77 (+2%) 5.76 (-45%) 1.25 (-10%)
L6 3.72 7.81 1.30 3.8 (+2%) 7.86 (+1%) 1.26 (-3%)
FB SATISFCN = response (5=Agree Strongly...1=Disagree Strongly) to
Feedback on my work helped me to clarify things I did not understand
BUNCHING = HAND-INS / WEEKS_WITH_HAND_INS
A&F Analytics
• Statistical analysis of ~17,000 cases of
student satisfaction, attainment &
assignment submission patterns
– Satisfaction with course organisation predicts
overall satisfaction
– Satisfaction with feedback NOT a predictor of
overall satisfaction
– Satisfaction with feedback NOT a predictor of
average marks
– Assignment bunching NOT a predictor of
average marks but partial dependence plot is
interesting
BUNCHING = HAND-INS
WEEKS_WITH_HAND-INS
Deadlines & marks web-service weekly hits
0
50000
100000
150000
200000
250000
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 2 5 8 11 14 17
2012 2013
+ = 8.3M hits
(since Jan 1, 2012)
Where TRAFFIC goes next …
Open
source
EAM
A&F
Analytics
A&F
Lifecycle
Webinar
May 15
Find out
more from
our blog
Moodle 2.4
pilot planned
for Sep
Linking
Moodle &
SRS
Notify
SRS of
Moodle
submits
Notify
SRS of
Moodle
marks
EAM

More Related Content

Similar to LRT Talks 2013-05-08 TRAFFIC

Project management
Project managementProject management
Project management
smumbahelp
 
Talis Insight Asia-Pacific 2017: Simon Bedford, University of Wollongong
Talis Insight Asia-Pacific 2017: Simon Bedford, University of WollongongTalis Insight Asia-Pacific 2017: Simon Bedford, University of Wollongong
Talis Insight Asia-Pacific 2017: Simon Bedford, University of Wollongong
Talis
 
Master of Science in Statistics
Master of Science in StatisticsMaster of Science in Statistics
Master of Science in Statistics
Sunil S. Shirvaiker
 
EMPLOYEE PERFORMANCE APPRAISAL (1)
EMPLOYEE PERFORMANCE APPRAISAL (1)EMPLOYEE PERFORMANCE APPRAISAL (1)
EMPLOYEE PERFORMANCE APPRAISAL (1)
Divya Sugumar
 
Aligning Enrollment Management with Performance-Based Budget Planning, Marsha...
Aligning Enrollment Management with Performance-Based Budget Planning, Marsha...Aligning Enrollment Management with Performance-Based Budget Planning, Marsha...
Aligning Enrollment Management with Performance-Based Budget Planning, Marsha...
Scott Marshall
 
LRT Talks 20140611 EUNIS Umea
LRT Talks 20140611 EUNIS UmeaLRT Talks 20140611 EUNIS Umea
LRT Talks 20140611 EUNIS Umea
Mark Stubbs
 
Disrupted Futures 2023 | Reduced youth disengagement post-16
Disrupted Futures 2023 | Reduced youth disengagement post-16Disrupted Futures 2023 | Reduced youth disengagement post-16
Disrupted Futures 2023 | Reduced youth disengagement post-16
EduSkills OECD
 
E-Rate Informational Meeting
E-Rate Informational MeetingE-Rate Informational Meeting
E-Rate Informational Meeting
acorder2011
 
mobile university: learning and teaching landscape
mobile university: learning and teaching landscapemobile university: learning and teaching landscape
mobile university: learning and teaching landscape
andyramsden
 
studentprojectupdate.pptx
studentprojectupdate.pptxstudentprojectupdate.pptx
studentprojectupdate.pptx
HaneenMohammad10
 
Data Collection and Analysis Overview - Martin Furner
Data Collection and Analysis Overview - Martin FurnerData Collection and Analysis Overview - Martin Furner
Data Collection and Analysis Overview - Martin Furner
IMI PQ NET Romania
 
NTLT 2012 - ALNAT Assessment tool – What you need to know!
NTLT 2012 - ALNAT Assessment tool – What you need to know!NTLT 2012 - ALNAT Assessment tool – What you need to know!
NTLT 2012 - ALNAT Assessment tool – What you need to know!
NTLT Conference
 
lady-ann-KPI-2022-1.pptx
lady-ann-KPI-2022-1.pptxlady-ann-KPI-2022-1.pptx
lady-ann-KPI-2022-1.pptx
hendrix18
 
Force field analysis ppt
Force field analysis ppt Force field analysis ppt
Force field analysis ppt
Health Innovation Wessex
 
Student support-seminar
Student support-seminarStudent support-seminar
Student support-seminar
ppp73
 
Developmental Education Program Survey (DEPS)
Developmental Education Program Survey (DEPS)Developmental Education Program Survey (DEPS)
Developmental Education Program Survey (DEPS)
Colby Stoever
 
Best Practices for Implementation of ExamSoft in a Nursing Education Environment
Best Practices for Implementation of ExamSoft in a Nursing Education EnvironmentBest Practices for Implementation of ExamSoft in a Nursing Education Environment
Best Practices for Implementation of ExamSoft in a Nursing Education Environment
ExamSoft
 
Seda 2016
Seda 2016Seda 2016
Seda 2016
Rachel Forsyth
 
Learning analytics for assessment and feedback
Learning analytics for assessment and feedbackLearning analytics for assessment and feedback
Learning analytics for assessment and feedback
jisc-elearning
 
Planning Cycle and Use of Results
Planning Cycle and Use of ResultsPlanning Cycle and Use of Results
Planning Cycle and Use of Results
Bradley Vaden
 

Similar to LRT Talks 2013-05-08 TRAFFIC (20)

Project management
Project managementProject management
Project management
 
Talis Insight Asia-Pacific 2017: Simon Bedford, University of Wollongong
Talis Insight Asia-Pacific 2017: Simon Bedford, University of WollongongTalis Insight Asia-Pacific 2017: Simon Bedford, University of Wollongong
Talis Insight Asia-Pacific 2017: Simon Bedford, University of Wollongong
 
Master of Science in Statistics
Master of Science in StatisticsMaster of Science in Statistics
Master of Science in Statistics
 
EMPLOYEE PERFORMANCE APPRAISAL (1)
EMPLOYEE PERFORMANCE APPRAISAL (1)EMPLOYEE PERFORMANCE APPRAISAL (1)
EMPLOYEE PERFORMANCE APPRAISAL (1)
 
Aligning Enrollment Management with Performance-Based Budget Planning, Marsha...
Aligning Enrollment Management with Performance-Based Budget Planning, Marsha...Aligning Enrollment Management with Performance-Based Budget Planning, Marsha...
Aligning Enrollment Management with Performance-Based Budget Planning, Marsha...
 
LRT Talks 20140611 EUNIS Umea
LRT Talks 20140611 EUNIS UmeaLRT Talks 20140611 EUNIS Umea
LRT Talks 20140611 EUNIS Umea
 
Disrupted Futures 2023 | Reduced youth disengagement post-16
Disrupted Futures 2023 | Reduced youth disengagement post-16Disrupted Futures 2023 | Reduced youth disengagement post-16
Disrupted Futures 2023 | Reduced youth disengagement post-16
 
E-Rate Informational Meeting
E-Rate Informational MeetingE-Rate Informational Meeting
E-Rate Informational Meeting
 
mobile university: learning and teaching landscape
mobile university: learning and teaching landscapemobile university: learning and teaching landscape
mobile university: learning and teaching landscape
 
studentprojectupdate.pptx
studentprojectupdate.pptxstudentprojectupdate.pptx
studentprojectupdate.pptx
 
Data Collection and Analysis Overview - Martin Furner
Data Collection and Analysis Overview - Martin FurnerData Collection and Analysis Overview - Martin Furner
Data Collection and Analysis Overview - Martin Furner
 
NTLT 2012 - ALNAT Assessment tool – What you need to know!
NTLT 2012 - ALNAT Assessment tool – What you need to know!NTLT 2012 - ALNAT Assessment tool – What you need to know!
NTLT 2012 - ALNAT Assessment tool – What you need to know!
 
lady-ann-KPI-2022-1.pptx
lady-ann-KPI-2022-1.pptxlady-ann-KPI-2022-1.pptx
lady-ann-KPI-2022-1.pptx
 
Force field analysis ppt
Force field analysis ppt Force field analysis ppt
Force field analysis ppt
 
Student support-seminar
Student support-seminarStudent support-seminar
Student support-seminar
 
Developmental Education Program Survey (DEPS)
Developmental Education Program Survey (DEPS)Developmental Education Program Survey (DEPS)
Developmental Education Program Survey (DEPS)
 
Best Practices for Implementation of ExamSoft in a Nursing Education Environment
Best Practices for Implementation of ExamSoft in a Nursing Education EnvironmentBest Practices for Implementation of ExamSoft in a Nursing Education Environment
Best Practices for Implementation of ExamSoft in a Nursing Education Environment
 
Seda 2016
Seda 2016Seda 2016
Seda 2016
 
Learning analytics for assessment and feedback
Learning analytics for assessment and feedbackLearning analytics for assessment and feedback
Learning analytics for assessment and feedback
 
Planning Cycle and Use of Results
Planning Cycle and Use of ResultsPlanning Cycle and Use of Results
Planning Cycle and Use of Results
 

More from Mark Stubbs

PFHEA Presentation - Mark Stubbs
PFHEA Presentation - Mark StubbsPFHEA Presentation - Mark Stubbs
PFHEA Presentation - Mark Stubbs
Mark Stubbs
 
EMA improvements
EMA improvementsEMA improvements
EMA improvements
Mark Stubbs
 
Edtech Visualisations
Edtech VisualisationsEdtech Visualisations
Edtech Visualisations
Mark Stubbs
 
LRT Assessment 20210922_v2
LRT Assessment 20210922_v2LRT Assessment 20210922_v2
LRT Assessment 20210922_v2
Mark Stubbs
 
JISC Digital Experience Insights Presentation 20210519
JISC Digital Experience Insights Presentation 20210519JISC Digital Experience Insights Presentation 20210519
JISC Digital Experience Insights Presentation 20210519
Mark Stubbs
 
LRT Talks 201611209 GCU Learning and Teaching Celebration
LRT Talks 201611209 GCU Learning and Teaching CelebrationLRT Talks 201611209 GCU Learning and Teaching Celebration
LRT Talks 201611209 GCU Learning and Teaching Celebration
Mark Stubbs
 
LRT Talks 20161012 Jisc Student Experience Experts Group
LRT Talks 20161012 Jisc Student Experience Experts GroupLRT Talks 20161012 Jisc Student Experience Experts Group
LRT Talks 20161012 Jisc Student Experience Experts Group
Mark Stubbs
 
LRT Talks 20150415 Talis Insight Birmingham
LRT Talks 20150415 Talis Insight BirminghamLRT Talks 20150415 Talis Insight Birmingham
LRT Talks 20150415 Talis Insight Birmingham
Mark Stubbs
 
Data Warehouse Tube Map Update
Data Warehouse Tube Map UpdateData Warehouse Tube Map Update
Data Warehouse Tube Map Update
Mark Stubbs
 
Data Warehouse Map for MMU's Continuous Monitoring & Improvement Project Board
Data Warehouse Map for MMU's Continuous Monitoring & Improvement Project BoardData Warehouse Map for MMU's Continuous Monitoring & Improvement Project Board
Data Warehouse Map for MMU's Continuous Monitoring & Improvement Project Board
Mark Stubbs
 
LRT Talks 20140610 EFYE2014 Nottingham
LRT Talks 20140610 EFYE2014 NottinghamLRT Talks 20140610 EFYE2014 Nottingham
LRT Talks 20140610 EFYE2014 Nottingham
Mark Stubbs
 
LRT Talks 20140327 JISC RSC HECon14
LRT Talks 20140327 JISC RSC HECon14LRT Talks 20140327 JISC RSC HECon14
LRT Talks 20140327 JISC RSC HECon14
Mark Stubbs
 
LRT Talks 20130725 Services Away Day
LRT Talks 20130725 Services Away DayLRT Talks 20130725 Services Away Day
LRT Talks 20130725 Services Away Day
Mark Stubbs
 
LRT Talks 20130703 ULCC Moodle HE User Group: our Upgrade to Moodle2.4
LRT Talks 20130703 ULCC Moodle HE User Group: our Upgrade to Moodle2.4LRT Talks 20130703 ULCC Moodle HE User Group: our Upgrade to Moodle2.4
LRT Talks 20130703 ULCC Moodle HE User Group: our Upgrade to Moodle2.4
Mark Stubbs
 
LRT Talks 2013-03-27 HEA Social Mobility
LRT Talks 2013-03-27 HEA Social MobilityLRT Talks 2013-03-27 HEA Social Mobility
LRT Talks 2013-03-27 HEA Social Mobility
Mark Stubbs
 
LRT Talks 20130319 Kaltura User Group
LRT Talks 20130319 Kaltura User GroupLRT Talks 20130319 Kaltura User Group
LRT Talks 20130319 Kaltura User Group
Mark Stubbs
 
LRT Talks 2013-03-12 CETIS
LRT Talks 2013-03-12 CETISLRT Talks 2013-03-12 CETIS
LRT Talks 2013-03-12 CETIS
Mark Stubbs
 
LRT talks 20130129 XCRI Aston
LRT talks 20130129 XCRI AstonLRT talks 20130129 XCRI Aston
LRT talks 20130129 XCRI Aston
Mark Stubbs
 
LRT Talks 20130108 Strategic Change Programme Sheffield
LRT Talks 20130108 Strategic Change Programme SheffieldLRT Talks 20130108 Strategic Change Programme Sheffield
LRT Talks 20130108 Strategic Change Programme Sheffield
Mark Stubbs
 
LRT Away Day 20121130
LRT Away Day 20121130LRT Away Day 20121130
LRT Away Day 20121130
Mark Stubbs
 

More from Mark Stubbs (20)

PFHEA Presentation - Mark Stubbs
PFHEA Presentation - Mark StubbsPFHEA Presentation - Mark Stubbs
PFHEA Presentation - Mark Stubbs
 
EMA improvements
EMA improvementsEMA improvements
EMA improvements
 
Edtech Visualisations
Edtech VisualisationsEdtech Visualisations
Edtech Visualisations
 
LRT Assessment 20210922_v2
LRT Assessment 20210922_v2LRT Assessment 20210922_v2
LRT Assessment 20210922_v2
 
JISC Digital Experience Insights Presentation 20210519
JISC Digital Experience Insights Presentation 20210519JISC Digital Experience Insights Presentation 20210519
JISC Digital Experience Insights Presentation 20210519
 
LRT Talks 201611209 GCU Learning and Teaching Celebration
LRT Talks 201611209 GCU Learning and Teaching CelebrationLRT Talks 201611209 GCU Learning and Teaching Celebration
LRT Talks 201611209 GCU Learning and Teaching Celebration
 
LRT Talks 20161012 Jisc Student Experience Experts Group
LRT Talks 20161012 Jisc Student Experience Experts GroupLRT Talks 20161012 Jisc Student Experience Experts Group
LRT Talks 20161012 Jisc Student Experience Experts Group
 
LRT Talks 20150415 Talis Insight Birmingham
LRT Talks 20150415 Talis Insight BirminghamLRT Talks 20150415 Talis Insight Birmingham
LRT Talks 20150415 Talis Insight Birmingham
 
Data Warehouse Tube Map Update
Data Warehouse Tube Map UpdateData Warehouse Tube Map Update
Data Warehouse Tube Map Update
 
Data Warehouse Map for MMU's Continuous Monitoring & Improvement Project Board
Data Warehouse Map for MMU's Continuous Monitoring & Improvement Project BoardData Warehouse Map for MMU's Continuous Monitoring & Improvement Project Board
Data Warehouse Map for MMU's Continuous Monitoring & Improvement Project Board
 
LRT Talks 20140610 EFYE2014 Nottingham
LRT Talks 20140610 EFYE2014 NottinghamLRT Talks 20140610 EFYE2014 Nottingham
LRT Talks 20140610 EFYE2014 Nottingham
 
LRT Talks 20140327 JISC RSC HECon14
LRT Talks 20140327 JISC RSC HECon14LRT Talks 20140327 JISC RSC HECon14
LRT Talks 20140327 JISC RSC HECon14
 
LRT Talks 20130725 Services Away Day
LRT Talks 20130725 Services Away DayLRT Talks 20130725 Services Away Day
LRT Talks 20130725 Services Away Day
 
LRT Talks 20130703 ULCC Moodle HE User Group: our Upgrade to Moodle2.4
LRT Talks 20130703 ULCC Moodle HE User Group: our Upgrade to Moodle2.4LRT Talks 20130703 ULCC Moodle HE User Group: our Upgrade to Moodle2.4
LRT Talks 20130703 ULCC Moodle HE User Group: our Upgrade to Moodle2.4
 
LRT Talks 2013-03-27 HEA Social Mobility
LRT Talks 2013-03-27 HEA Social MobilityLRT Talks 2013-03-27 HEA Social Mobility
LRT Talks 2013-03-27 HEA Social Mobility
 
LRT Talks 20130319 Kaltura User Group
LRT Talks 20130319 Kaltura User GroupLRT Talks 20130319 Kaltura User Group
LRT Talks 20130319 Kaltura User Group
 
LRT Talks 2013-03-12 CETIS
LRT Talks 2013-03-12 CETISLRT Talks 2013-03-12 CETIS
LRT Talks 2013-03-12 CETIS
 
LRT talks 20130129 XCRI Aston
LRT talks 20130129 XCRI AstonLRT talks 20130129 XCRI Aston
LRT talks 20130129 XCRI Aston
 
LRT Talks 20130108 Strategic Change Programme Sheffield
LRT Talks 20130108 Strategic Change Programme SheffieldLRT Talks 20130108 Strategic Change Programme Sheffield
LRT Talks 20130108 Strategic Change Programme Sheffield
 
LRT Away Day 20121130
LRT Away Day 20121130LRT Away Day 20121130
LRT Away Day 20121130
 

Recently uploaded

The basics of sentences session 7pptx.pptx
The basics of sentences session 7pptx.pptxThe basics of sentences session 7pptx.pptx
The basics of sentences session 7pptx.pptx
heathfieldcps1
 
How to Predict Vendor Bill Product in Odoo 17
How to Predict Vendor Bill Product in Odoo 17How to Predict Vendor Bill Product in Odoo 17
How to Predict Vendor Bill Product in Odoo 17
Celine George
 
A Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two HeartsA Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two Hearts
Steve Thomason
 
Présentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptx
Présentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptxPrésentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptx
Présentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptx
siemaillard
 
Nutrition Inc FY 2024, 4 - Hour Training
Nutrition Inc FY 2024, 4 - Hour TrainingNutrition Inc FY 2024, 4 - Hour Training
Nutrition Inc FY 2024, 4 - Hour Training
melliereed
 
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
National Information Standards Organization (NISO)
 
Mule event processing models | MuleSoft Mysore Meetup #47
Mule event processing models | MuleSoft Mysore Meetup #47Mule event processing models | MuleSoft Mysore Meetup #47
Mule event processing models | MuleSoft Mysore Meetup #47
MysoreMuleSoftMeetup
 
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
Nguyen Thanh Tu Collection
 
MDP on air pollution of class 8 year 2024-2025
MDP on air pollution of class 8 year 2024-2025MDP on air pollution of class 8 year 2024-2025
MDP on air pollution of class 8 year 2024-2025
khuleseema60
 
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptxChapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Denish Jangid
 
Skimbleshanks-The-Railway-Cat by T S Eliot
Skimbleshanks-The-Railway-Cat by T S EliotSkimbleshanks-The-Railway-Cat by T S Eliot
Skimbleshanks-The-Railway-Cat by T S Eliot
nitinpv4ai
 
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
TechSoup
 
Bossa N’ Roll Records by Ismael Vazquez.
Bossa N’ Roll Records by Ismael Vazquez.Bossa N’ Roll Records by Ismael Vazquez.
Bossa N’ Roll Records by Ismael Vazquez.
IsmaelVazquez38
 
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptxRESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
zuzanka
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
GeorgeMilliken2
 
skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)
Mohammad Al-Dhahabi
 
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skillsspot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
haiqairshad
 
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
ImMuslim
 
Pharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brubPharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brub
danielkiash986
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
TechSoup
 

Recently uploaded (20)

The basics of sentences session 7pptx.pptx
The basics of sentences session 7pptx.pptxThe basics of sentences session 7pptx.pptx
The basics of sentences session 7pptx.pptx
 
How to Predict Vendor Bill Product in Odoo 17
How to Predict Vendor Bill Product in Odoo 17How to Predict Vendor Bill Product in Odoo 17
How to Predict Vendor Bill Product in Odoo 17
 
A Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two HeartsA Visual Guide to 1 Samuel | A Tale of Two Hearts
A Visual Guide to 1 Samuel | A Tale of Two Hearts
 
Présentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptx
Présentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptxPrésentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptx
Présentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptx
 
Nutrition Inc FY 2024, 4 - Hour Training
Nutrition Inc FY 2024, 4 - Hour TrainingNutrition Inc FY 2024, 4 - Hour Training
Nutrition Inc FY 2024, 4 - Hour Training
 
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"
 
Mule event processing models | MuleSoft Mysore Meetup #47
Mule event processing models | MuleSoft Mysore Meetup #47Mule event processing models | MuleSoft Mysore Meetup #47
Mule event processing models | MuleSoft Mysore Meetup #47
 
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
 
MDP on air pollution of class 8 year 2024-2025
MDP on air pollution of class 8 year 2024-2025MDP on air pollution of class 8 year 2024-2025
MDP on air pollution of class 8 year 2024-2025
 
Chapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptxChapter wise All Notes of First year Basic Civil Engineering.pptx
Chapter wise All Notes of First year Basic Civil Engineering.pptx
 
Skimbleshanks-The-Railway-Cat by T S Eliot
Skimbleshanks-The-Railway-Cat by T S EliotSkimbleshanks-The-Railway-Cat by T S Eliot
Skimbleshanks-The-Railway-Cat by T S Eliot
 
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
Elevate Your Nonprofit's Online Presence_ A Guide to Effective SEO Strategies...
 
Bossa N’ Roll Records by Ismael Vazquez.
Bossa N’ Roll Records by Ismael Vazquez.Bossa N’ Roll Records by Ismael Vazquez.
Bossa N’ Roll Records by Ismael Vazquez.
 
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptxRESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
RESULTS OF THE EVALUATION QUESTIONNAIRE.pptx
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
 
skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)skeleton System.pdf (skeleton system wow)
skeleton System.pdf (skeleton system wow)
 
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skillsspot a liar (Haiqa 146).pptx Technical writhing and presentation skills
spot a liar (Haiqa 146).pptx Technical writhing and presentation skills
 
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
Geography as a Discipline Chapter 1 __ Class 11 Geography NCERT _ Class Notes...
 
Pharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brubPharmaceutics Pharmaceuticals best of brub
Pharmaceutics Pharmaceuticals best of brub
 
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit InnovationLeveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
 

LRT Talks 2013-05-08 TRAFFIC

  • 1. TRansforming Assessment & Feedback For Institutional Change: our journey so far… Birmingham | May 2013 Professor Mark Stubbs Head of Learning & Research Technologies m.stubbs@mmu.ac.uk http://twitter.com/thestubbs http://slideshare.net/markstubbs
  • 2. Strand A : Goal = institution-wide impact • Hitched TRAFFIC to the EQAL delivery wagon • Took our baseline report to committees that matter • Influenced ICP on Assessment of Students • Analysed assessment data & appeals
  • 3. EQAL: new rules for summative assessment • Aim to address over-assessment in FT UG provision – Max 2 summative elements per 30 credit module – Rolling out year-by-year to all UGs from Sep 2011 2011/12 (n=8,708) 2012/13 (n=8,646) FB SATISFCN HAND-INS BUNCHING FB SATISFCN HAND-INS BUNCHING L4 3.75 5.61 1.29 3.79 (+1%) 5.59 (0%) 1.25 (-3%) L5 3.70 10.47 1.38 3.77 (+2%) 5.76 (-45%) 1.25 (-10%) L6 3.72 7.81 1.30 3.8 (+2%) 7.86 (+1%) 1.26 (-3%) FB SATISFCN = response (5=Agree Strongly...1=Disagree Strongly) to Feedback on my work helped me to clarify things I did not understand BUNCHING = HAND-INS / WEEKS_WITH_HAND_INS
  • 4. A&F Analytics • Statistical analysis of ~17,000 cases of student satisfaction, attainment & assignment submission patterns – Satisfaction with course organisation predicts overall satisfaction – Satisfaction with feedback NOT a predictor of overall satisfaction – Satisfaction with feedback NOT a predictor of average marks – Assignment bunching NOT a predictor of average marks but partial dependence plot is interesting BUNCHING = HAND-INS WEEKS_WITH_HAND-INS
  • 5. Deadlines & marks web-service weekly hits 0 50000 100000 150000 200000 250000 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 2 5 8 11 14 17 2012 2013 + = 8.3M hits (since Jan 1, 2012)
  • 6. Where TRAFFIC goes next … Open source EAM A&F Analytics A&F Lifecycle Webinar May 15 Find out more from our blog Moodle 2.4 pilot planned for Sep Linking Moodle & SRS Notify SRS of Moodle submits Notify SRS of Moodle marks EAM