SlideShare a Scribd company logo
Enhancing the
assessment
experience through
closer integration
between the SRS
and VLE
University of York, UK
Dr Richard Walker
bett 2015
January 21 - 24
York’s journey
2004
Establishing an
institutional LT
infrastructure:
Implementation: delivering
efficiencies in scale & support
Phased rollout of Institutional LMS, CMS & Community
System (Blackboard Academic Suite): self-managed
SITS integration
Integration of reading list software
Development of anonymous e-submission
2007
2008
Consolidation
Embedding, integrating
& extending LT services
VLE strategic review
Launch of Video streaming service
Shibbolizing VLE (outreach, admissions & transition)
Mobile Learn, lecture capture & e-assessment (QMP) trials
2011
2012
Renewal
Re-envisioning LT services:
‘Empowering the learner’
Launch of cloud services:
Google Apps for Education; Echo 360; Bb Collaborate and
inline grading
Release of E-learning vision statement (June 2013):
setting the agenda for next Learning & Teaching Strategy
York’s service portfolio
York’s technology adoption cycle
Adapted from the Gartner Hype Cycle http://www.gartner.com/technology/research/methodologies/hype-cycle.jsp
York’s technology adoption cycle
Would you like to see an online submission option made available for all
assessed work that you need to turn in to your department for marking?
Response Percent Response Count
Yes 76% 354
No 11% 54
Not applicable 13% 59
Agree Neutral Disagree
Not
Appropriate
Submission of student work 83% 10% 5% 2%
Management & allocation of work for
markers
51% 34% 10% 6%
Marking 66% 17% 12% 5%
Creation of feedback 66% 22% 10% 2%
Return of work/marks/feedback to
students
68% 25% 5% 2%
Source: University of York Technology Enhanced Learning Student Survey 2014
Source: University of York Technology Enhanced Learning Staff Survey 2014
It is important for the University to provide
online support for all assessed work turned
in by your students for marking
“It is important for the
University to provide *GOOD*
online support for the listed
activities. I don't believe this
is sufficiently the case.”
Joining up SRS and assessment systems
 A challenging problem for the HE sector:
‘Despite the relatively limited nature
of the core product set, the key
integration points between these
technologies remain problematic and
a source of considerable manual
intervention.’ (Jisc, 2014: p12)
Jisc (2014). Electronic Management of Assessment (EMA): a landscape review.
http://repository.jisc.ac.uk/5599/ (pdf)
Original anonymous submission and feedback
workflow (summative assessment)
 Replacing file name with student exam
number from SITS eVision:
Who Original Process (2007 – 2013)
Students Submit work online through VLE, automated e-mailed
receipt
VLE instructors Download anonymised, work and summary sheet
Markers Mark work, create feedback, record marks
Admin Archive work, individually match and return feedback and
marks (through e-Vision or office)
Students Access / collect feedback and marks
Enhanced anonymous submission and feedback
workflow (Phase 1: 2013-14)
Who Process
Students Submit work online through VLE, automated e-mailed
receipt
VLE instructors Download anonymised work, summary sheet, individual
feedback forms* and mark-sheet
Markers Mark work with disability info, complete feedback forms,
record marks in mark-sheet
Admin Archive work, batch upload feedback & marks to SITS / e-
Vision
Students Access / collect feedback and marks from e-Vision
E-Assignment architecture
Revised workflow
Plan
Assessment
• Assessment
created
• Coded in SITS
Anonymous
Assignment
• Set up
submission point
• Associate with
SITS assessment
Student
Submission
• Students submit
work
Marking
• Feedback
documents
downloaded
• Marks
spreadsheet
download
• Disability stickers
and information
included
• Department
sends documents
to markers
Uploading
into SITS
• Documents
uploaded into
SITS
• Feedback and
marks released
to students
E-Assessment, marking and feedback work-flow
Workflow benefits
 Generation of (configurable) feedback docs
(MS Word) inheriting exam ID and disability sticker
fields, bundled with assignment scripts in zip file
– faster work allocation to markers
 Batch upload of marks and feedback docs to SITS
– Speeds up return of feedback and marks to students
 1 week’s administrative time saved across Politics
department (for mark entry for 1600 submissions)
– use of feedback template *may* lead to greater transparency
in marking process (standardisation & quality)
 Summer pilots have led to the following
enhancements…..
Enhancements to the anonymous submission &
feedback workflow (Phase 2: 2014-15)
 file submissions restricted to a specific file type
(pre-selected by the assessment manager)
 assessment manager(s) alerted when late
submissions have been made
 reporting on SITS registered students who have not
yet submitted
 facility for markers to annotate / insert comments
into file submissions as student feedback to be
batch uploaded to SITS
 Student view of all previously submitted files
Next steps: Phase 3 - enhancing the management and
practice of online marking (2015 - )
 Processes to support work allocation:
– Automated allocation of feedback sheets
and scripts to markers
 Enhancements to marking experience
– Blind marking (student IDs concealed)
– Automatic plagiarism checks (Safe Assign & Turnitin)
 Assessment management
– Reporting & moderation screen
 Support for supervisor’s access to
marks & feedback
Building on SITS – Blackboard data integration (based on LIS 2.0 standards development)??
Next steps: Phase 3 - building a
student feedback hub (2015 - )
Creation of individual marks & feedback hub for each
student; automatically drawing on formative and
summative records stored in VLE Grade Centre, with hooks
for data ingest from other sources
Supervisor sets
key questions
/ reflection
template
Automated
transfer of
assessment
feedback /
marks to
individual hub
Student
reflects on
mark /
feedback (feed
forward)
Supervisor
reviews &
comments on
student's
progress
Questions?
University of York, UK
Richard Walker
Reports and summaries on e-assignment workflow
management and marking provision are available at:
http://elearningyork.wordpress.com
@RichardM_Walker richard.walker@york.ac.uk

More Related Content

What's hot

Tnc21: Combining waves of innovation. A superposition for student mobility.
Tnc21: Combining waves of innovation. A superposition for student mobility.Tnc21: Combining waves of innovation. A superposition for student mobility.
Tnc21: Combining waves of innovation. A superposition for student mobility.
Frans Ward
 
Client Insights - Sheffield Hallam University: Assessment Journey
Client Insights - Sheffield Hallam University: Assessment JourneyClient Insights - Sheffield Hallam University: Assessment Journey
Client Insights - Sheffield Hallam University: Assessment Journey
BlackboardEMEA
 
The Solent experience - migration to Moodle and beyond
The Solent experience - migration to Moodle and beyondThe Solent experience - migration to Moodle and beyond
The Solent experience - migration to Moodle and beyond
JISC RSC Southeast
 
Sakai la-ewsv2
Sakai la-ewsv2Sakai la-ewsv2
Sakai la-ewsv2
rjgbrown
 
Roger Williams University: Using Sakai to meet accreditation standards
Roger Williams University: Using Sakai to meet accreditation standardsRoger Williams University: Using Sakai to meet accreditation standards
Roger Williams University: Using Sakai to meet accreditation standardsrSmart
 
Effects of the_internet_on_education_and_training
Effects of the_internet_on_education_and_trainingEffects of the_internet_on_education_and_training
Effects of the_internet_on_education_and_trainingDr. TJ Wolfe
 
Teacamp_assessment_Euca_Online_EACEA_workshop
Teacamp_assessment_Euca_Online_EACEA_workshopTeacamp_assessment_Euca_Online_EACEA_workshop
Teacamp_assessment_Euca_Online_EACEA_workshopAirina Volungeviciene
 
Education, training and career development in online analytics
Education, training and career development in online analyticsEducation, training and career development in online analytics
Education, training and career development in online analyticsOptimics s.r.o.
 
Mentoring & Evaluation
Mentoring & EvaluationMentoring & Evaluation
Mentoring & Evaluation
Lisa Bunkowski
 
Uq elearning capabilitiesoct2013-4hos
Uq elearning capabilitiesoct2013-4hosUq elearning capabilitiesoct2013-4hos
Uq elearning capabilitiesoct2013-4hosScolls100
 
2010 Edu tools
2010 Edu tools2010 Edu tools
2010 Edu toolsWCET
 
Moco eng
Moco engMoco eng
Strijker, A. (2005 12 06). Piloting Sakai In A Master Course Does It Really...
Strijker, A. (2005 12 06). Piloting Sakai In A Master Course   Does It Really...Strijker, A. (2005 12 06). Piloting Sakai In A Master Course   Does It Really...
Strijker, A. (2005 12 06). Piloting Sakai In A Master Course Does It Really...
Saxion
 
Course Sites Powerpoint
Course Sites PowerpointCourse Sites Powerpoint
Course Sites Powerpoint
arpope
 
Updating Teaching Techonologies - Real World Impact!
Updating Teaching Techonologies - Real World Impact!Updating Teaching Techonologies - Real World Impact!
Updating Teaching Techonologies - Real World Impact!
afacct
 
Content Sharing Website PPT
Content Sharing Website PPTContent Sharing Website PPT
Content Sharing Website PPT
anushkashastri
 
LTI guide to E assessment
LTI guide to E assessmentLTI guide to E assessment
LTI guide to E assessment
LTI_Support
 
Developing Online Programs Today To Prepare Educators For Tomorrow V3[1]
Developing Online Programs Today To Prepare Educators For Tomorrow V3[1]Developing Online Programs Today To Prepare Educators For Tomorrow V3[1]
Developing Online Programs Today To Prepare Educators For Tomorrow V3[1]
RandyHansen
 
ConnectEDU Course Evaluation Solution: CoursEval
ConnectEDU Course Evaluation Solution: CoursEvalConnectEDU Course Evaluation Solution: CoursEval
ConnectEDU Course Evaluation Solution: CoursEvalConnectEDU
 

What's hot (19)

Tnc21: Combining waves of innovation. A superposition for student mobility.
Tnc21: Combining waves of innovation. A superposition for student mobility.Tnc21: Combining waves of innovation. A superposition for student mobility.
Tnc21: Combining waves of innovation. A superposition for student mobility.
 
Client Insights - Sheffield Hallam University: Assessment Journey
Client Insights - Sheffield Hallam University: Assessment JourneyClient Insights - Sheffield Hallam University: Assessment Journey
Client Insights - Sheffield Hallam University: Assessment Journey
 
The Solent experience - migration to Moodle and beyond
The Solent experience - migration to Moodle and beyondThe Solent experience - migration to Moodle and beyond
The Solent experience - migration to Moodle and beyond
 
Sakai la-ewsv2
Sakai la-ewsv2Sakai la-ewsv2
Sakai la-ewsv2
 
Roger Williams University: Using Sakai to meet accreditation standards
Roger Williams University: Using Sakai to meet accreditation standardsRoger Williams University: Using Sakai to meet accreditation standards
Roger Williams University: Using Sakai to meet accreditation standards
 
Effects of the_internet_on_education_and_training
Effects of the_internet_on_education_and_trainingEffects of the_internet_on_education_and_training
Effects of the_internet_on_education_and_training
 
Teacamp_assessment_Euca_Online_EACEA_workshop
Teacamp_assessment_Euca_Online_EACEA_workshopTeacamp_assessment_Euca_Online_EACEA_workshop
Teacamp_assessment_Euca_Online_EACEA_workshop
 
Education, training and career development in online analytics
Education, training and career development in online analyticsEducation, training and career development in online analytics
Education, training and career development in online analytics
 
Mentoring & Evaluation
Mentoring & EvaluationMentoring & Evaluation
Mentoring & Evaluation
 
Uq elearning capabilitiesoct2013-4hos
Uq elearning capabilitiesoct2013-4hosUq elearning capabilitiesoct2013-4hos
Uq elearning capabilitiesoct2013-4hos
 
2010 Edu tools
2010 Edu tools2010 Edu tools
2010 Edu tools
 
Moco eng
Moco engMoco eng
Moco eng
 
Strijker, A. (2005 12 06). Piloting Sakai In A Master Course Does It Really...
Strijker, A. (2005 12 06). Piloting Sakai In A Master Course   Does It Really...Strijker, A. (2005 12 06). Piloting Sakai In A Master Course   Does It Really...
Strijker, A. (2005 12 06). Piloting Sakai In A Master Course Does It Really...
 
Course Sites Powerpoint
Course Sites PowerpointCourse Sites Powerpoint
Course Sites Powerpoint
 
Updating Teaching Techonologies - Real World Impact!
Updating Teaching Techonologies - Real World Impact!Updating Teaching Techonologies - Real World Impact!
Updating Teaching Techonologies - Real World Impact!
 
Content Sharing Website PPT
Content Sharing Website PPTContent Sharing Website PPT
Content Sharing Website PPT
 
LTI guide to E assessment
LTI guide to E assessmentLTI guide to E assessment
LTI guide to E assessment
 
Developing Online Programs Today To Prepare Educators For Tomorrow V3[1]
Developing Online Programs Today To Prepare Educators For Tomorrow V3[1]Developing Online Programs Today To Prepare Educators For Tomorrow V3[1]
Developing Online Programs Today To Prepare Educators For Tomorrow V3[1]
 
ConnectEDU Course Evaluation Solution: CoursEval
ConnectEDU Course Evaluation Solution: CoursEvalConnectEDU Course Evaluation Solution: CoursEval
ConnectEDU Course Evaluation Solution: CoursEval
 

Viewers also liked

Developing tutoring craft through cross-institutional peer exchange: reflecti...
Developing tutoring craft through cross-institutional peer exchange: reflecti...Developing tutoring craft through cross-institutional peer exchange: reflecti...
Developing tutoring craft through cross-institutional peer exchange: reflecti...
RichardM_Walker
 
Facilitating staff to design in active learning opportunities for students th...
Facilitating staff to design in active learning opportunities for students th...Facilitating staff to design in active learning opportunities for students th...
Facilitating staff to design in active learning opportunities for students th...
RichardM_Walker
 
British council new delhi_walkerfeb2016 wb
British council new delhi_walkerfeb2016 wbBritish council new delhi_walkerfeb2016 wb
British council new delhi_walkerfeb2016 wb
RichardM_Walker
 
Achieving flexibility? The rhetoric and reality of the role of learning techn...
Achieving flexibility? The rhetoric and reality of the role of learning techn...Achieving flexibility? The rhetoric and reality of the role of learning techn...
Achieving flexibility? The rhetoric and reality of the role of learning techn...
RichardM_Walker
 
Open and flexible learning opportunities for all? Findings from the 2016 UCIS...
Open and flexible learning opportunities for all? Findings from the 2016 UCIS...Open and flexible learning opportunities for all? Findings from the 2016 UCIS...
Open and flexible learning opportunities for all? Findings from the 2016 UCIS...
RichardM_Walker
 
Engaging learners in computer-based summative exams: Reflections on a partici...
Engaging learners in computer-based summative exams: Reflections on a partici...Engaging learners in computer-based summative exams: Reflections on a partici...
Engaging learners in computer-based summative exams: Reflections on a partici...
RichardM_Walker
 

Viewers also liked (6)

Developing tutoring craft through cross-institutional peer exchange: reflecti...
Developing tutoring craft through cross-institutional peer exchange: reflecti...Developing tutoring craft through cross-institutional peer exchange: reflecti...
Developing tutoring craft through cross-institutional peer exchange: reflecti...
 
Facilitating staff to design in active learning opportunities for students th...
Facilitating staff to design in active learning opportunities for students th...Facilitating staff to design in active learning opportunities for students th...
Facilitating staff to design in active learning opportunities for students th...
 
British council new delhi_walkerfeb2016 wb
British council new delhi_walkerfeb2016 wbBritish council new delhi_walkerfeb2016 wb
British council new delhi_walkerfeb2016 wb
 
Achieving flexibility? The rhetoric and reality of the role of learning techn...
Achieving flexibility? The rhetoric and reality of the role of learning techn...Achieving flexibility? The rhetoric and reality of the role of learning techn...
Achieving flexibility? The rhetoric and reality of the role of learning techn...
 
Open and flexible learning opportunities for all? Findings from the 2016 UCIS...
Open and flexible learning opportunities for all? Findings from the 2016 UCIS...Open and flexible learning opportunities for all? Findings from the 2016 UCIS...
Open and flexible learning opportunities for all? Findings from the 2016 UCIS...
 
Engaging learners in computer-based summative exams: Reflections on a partici...
Engaging learners in computer-based summative exams: Reflections on a partici...Engaging learners in computer-based summative exams: Reflections on a partici...
Engaging learners in computer-based summative exams: Reflections on a partici...
 

Similar to Enhancing the assessment experience through closer integration between the SRS and VLE

JISC assessment news, updates and development priorities
JISC assessment news, updates and development prioritiesJISC assessment news, updates and development priorities
JISC assessment news, updates and development priorities
University of Strathclyde
 
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
BlackboardEMEA
 
Evaluating Distance Education: Focus on Online Course Evaluation
Evaluating Distance Education: Focus on Online Course EvaluationEvaluating Distance Education: Focus on Online Course Evaluation
Evaluating Distance Education: Focus on Online Course Evaluation
Julia Parra
 
LRT Assessment 20210922_v2
LRT Assessment 20210922_v2LRT Assessment 20210922_v2
LRT Assessment 20210922_v2
Mark Stubbs
 
Online Exam Management System
Online Exam Management SystemOnline Exam Management System
Online Exam Management System
IRJET Journal
 
Vschool Implementation ppt for Client
Vschool Implementation ppt for ClientVschool Implementation ppt for Client
Vschool Implementation ppt for Client
Sanjay Talukdar
 
50320140502002
5032014050200250320140502002
50320140502002
IAEME Publication
 
Developing a system function future state for online management of assessment
Developing a system function future state for online management of assessmentDeveloping a system function future state for online management of assessment
Developing a system function future state for online management of assessment
BlackboardEMEA
 
eSkwela Report - SSM - July 2008
eSkwela Report - SSM - July 2008eSkwela Report - SSM - July 2008
eSkwela Report - SSM - July 2008Mel Tan
 
demo1
demo1demo1
Online Intelligent Semantic Performance Based Solution: The Milestone towards...
Online Intelligent Semantic Performance Based Solution: The Milestone towards...Online Intelligent Semantic Performance Based Solution: The Milestone towards...
Online Intelligent Semantic Performance Based Solution: The Milestone towards...
AM Publications
 
EvaSys module survey dashboard
EvaSys module survey dashboardEvaSys module survey dashboard
EvaSys module survey dashboard
David Mackland
 
Assessment 2 feb sarah davies
Assessment 2 feb sarah daviesAssessment 2 feb sarah davies
Assessment 2 feb sarah davies
University of Strathclyde
 
Quality Assurance Framework for the OpenVM E+ project
Quality Assurance Framework for the OpenVM E+ projectQuality Assurance Framework for the OpenVM E+ project
Quality Assurance Framework for the OpenVM E+ project
Gemma Tur
 
UAEU - UITS Update For Advisors To Chancellor V1 3
UAEU - UITS Update For Advisors To Chancellor V1 3UAEU - UITS Update For Advisors To Chancellor V1 3
UAEU - UITS Update For Advisors To Chancellor V1 3Michael Dobe, Ph.D.
 
Vle Forum06 11 09
Vle Forum06 11 09Vle Forum06 11 09
Vle Forum06 11 09
JISC RSC Eastern
 
Online Student Feedback System
Online Student Feedback SystemOnline Student Feedback System
Online Student Feedback System
EditorIJAERD
 
Electronic Management of Assessment
Electronic Management of AssessmentElectronic Management of Assessment
Electronic Management of Assessment
Jisc
 
Roots academy online examination system.pptx
Roots academy online examination system.pptxRoots academy online examination system.pptx
Roots academy online examination system.pptx
NakhabalaMaurice
 

Similar to Enhancing the assessment experience through closer integration between the SRS and VLE (20)

JISC assessment news, updates and development priorities
JISC assessment news, updates and development prioritiesJISC assessment news, updates and development priorities
JISC assessment news, updates and development priorities
 
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
 
Evaluating Distance Education: Focus on Online Course Evaluation
Evaluating Distance Education: Focus on Online Course EvaluationEvaluating Distance Education: Focus on Online Course Evaluation
Evaluating Distance Education: Focus on Online Course Evaluation
 
LRT Assessment 20210922_v2
LRT Assessment 20210922_v2LRT Assessment 20210922_v2
LRT Assessment 20210922_v2
 
Online Exam Management System
Online Exam Management SystemOnline Exam Management System
Online Exam Management System
 
Vschool Implementation ppt for Client
Vschool Implementation ppt for ClientVschool Implementation ppt for Client
Vschool Implementation ppt for Client
 
50320140502002
5032014050200250320140502002
50320140502002
 
50320140502002
5032014050200250320140502002
50320140502002
 
Developing a system function future state for online management of assessment
Developing a system function future state for online management of assessmentDeveloping a system function future state for online management of assessment
Developing a system function future state for online management of assessment
 
eSkwela Report - SSM - July 2008
eSkwela Report - SSM - July 2008eSkwela Report - SSM - July 2008
eSkwela Report - SSM - July 2008
 
demo1
demo1demo1
demo1
 
Online Intelligent Semantic Performance Based Solution: The Milestone towards...
Online Intelligent Semantic Performance Based Solution: The Milestone towards...Online Intelligent Semantic Performance Based Solution: The Milestone towards...
Online Intelligent Semantic Performance Based Solution: The Milestone towards...
 
EvaSys module survey dashboard
EvaSys module survey dashboardEvaSys module survey dashboard
EvaSys module survey dashboard
 
Assessment 2 feb sarah davies
Assessment 2 feb sarah daviesAssessment 2 feb sarah davies
Assessment 2 feb sarah davies
 
Quality Assurance Framework for the OpenVM E+ project
Quality Assurance Framework for the OpenVM E+ projectQuality Assurance Framework for the OpenVM E+ project
Quality Assurance Framework for the OpenVM E+ project
 
UAEU - UITS Update For Advisors To Chancellor V1 3
UAEU - UITS Update For Advisors To Chancellor V1 3UAEU - UITS Update For Advisors To Chancellor V1 3
UAEU - UITS Update For Advisors To Chancellor V1 3
 
Vle Forum06 11 09
Vle Forum06 11 09Vle Forum06 11 09
Vle Forum06 11 09
 
Online Student Feedback System
Online Student Feedback SystemOnline Student Feedback System
Online Student Feedback System
 
Electronic Management of Assessment
Electronic Management of AssessmentElectronic Management of Assessment
Electronic Management of Assessment
 
Roots academy online examination system.pptx
Roots academy online examination system.pptxRoots academy online examination system.pptx
Roots academy online examination system.pptx
 

More from RichardM_Walker

Evaluating the impact of the Pandemic on departmental uses of learning techno...
Evaluating the impact of the Pandemic on departmental uses of learning techno...Evaluating the impact of the Pandemic on departmental uses of learning techno...
Evaluating the impact of the Pandemic on departmental uses of learning techno...
RichardM_Walker
 
Developing sustainable staff development for online teachers: What works and ...
Developing sustainable staff development for online teachers: What works and ...Developing sustainable staff development for online teachers: What works and ...
Developing sustainable staff development for online teachers: What works and ...
RichardM_Walker
 
Encouraging academic skills development through social reading: A critical re...
Encouraging academic skills development through social reading: A critical re...Encouraging academic skills development through social reading: A critical re...
Encouraging academic skills development through social reading: A critical re...
RichardM_Walker
 
Building community through Slack: a student-owned digital space for connectiv...
Building community through Slack: a student-owned digital space for connectiv...Building community through Slack: a student-owned digital space for connectiv...
Building community through Slack: a student-owned digital space for connectiv...
RichardM_Walker
 
Inclusive learning design for Online Learners
Inclusive learning design for Online LearnersInclusive learning design for Online Learners
Inclusive learning design for Online Learners
RichardM_Walker
 
Nurturing curiosity and inquiry within the curriculum through the use of tech...
Nurturing curiosity and inquiry within the curriculum through the use of tech...Nurturing curiosity and inquiry within the curriculum through the use of tech...
Nurturing curiosity and inquiry within the curriculum through the use of tech...
RichardM_Walker
 
Facilitating peer-led group research
Facilitating peer-led group researchFacilitating peer-led group research
Facilitating peer-led group research
RichardM_Walker
 
Bridging the digital divide: academic skills and digital literacies to suppor...
Bridging the digital divide: academic skills and digital literacies to suppor...Bridging the digital divide: academic skills and digital literacies to suppor...
Bridging the digital divide: academic skills and digital literacies to suppor...
RichardM_Walker
 
How are students engaging with lecture recordings as a study resource?
How are students engaging with lecture recordings as a study resource?How are students engaging with lecture recordings as a study resource?
How are students engaging with lecture recordings as a study resource?
RichardM_Walker
 
Facilitating student-led teaching and content creation through technology: Us...
Facilitating student-led teaching and content creation through technology: Us...Facilitating student-led teaching and content creation through technology: Us...
Facilitating student-led teaching and content creation through technology: Us...
RichardM_Walker
 

More from RichardM_Walker (10)

Evaluating the impact of the Pandemic on departmental uses of learning techno...
Evaluating the impact of the Pandemic on departmental uses of learning techno...Evaluating the impact of the Pandemic on departmental uses of learning techno...
Evaluating the impact of the Pandemic on departmental uses of learning techno...
 
Developing sustainable staff development for online teachers: What works and ...
Developing sustainable staff development for online teachers: What works and ...Developing sustainable staff development for online teachers: What works and ...
Developing sustainable staff development for online teachers: What works and ...
 
Encouraging academic skills development through social reading: A critical re...
Encouraging academic skills development through social reading: A critical re...Encouraging academic skills development through social reading: A critical re...
Encouraging academic skills development through social reading: A critical re...
 
Building community through Slack: a student-owned digital space for connectiv...
Building community through Slack: a student-owned digital space for connectiv...Building community through Slack: a student-owned digital space for connectiv...
Building community through Slack: a student-owned digital space for connectiv...
 
Inclusive learning design for Online Learners
Inclusive learning design for Online LearnersInclusive learning design for Online Learners
Inclusive learning design for Online Learners
 
Nurturing curiosity and inquiry within the curriculum through the use of tech...
Nurturing curiosity and inquiry within the curriculum through the use of tech...Nurturing curiosity and inquiry within the curriculum through the use of tech...
Nurturing curiosity and inquiry within the curriculum through the use of tech...
 
Facilitating peer-led group research
Facilitating peer-led group researchFacilitating peer-led group research
Facilitating peer-led group research
 
Bridging the digital divide: academic skills and digital literacies to suppor...
Bridging the digital divide: academic skills and digital literacies to suppor...Bridging the digital divide: academic skills and digital literacies to suppor...
Bridging the digital divide: academic skills and digital literacies to suppor...
 
How are students engaging with lecture recordings as a study resource?
How are students engaging with lecture recordings as a study resource?How are students engaging with lecture recordings as a study resource?
How are students engaging with lecture recordings as a study resource?
 
Facilitating student-led teaching and content creation through technology: Us...
Facilitating student-led teaching and content creation through technology: Us...Facilitating student-led teaching and content creation through technology: Us...
Facilitating student-led teaching and content creation through technology: Us...
 

Recently uploaded

How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
Jisc
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
DeeptiGupta154
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
GeoBlogs
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
Col Mukteshwar Prasad
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
AzmatAli747758
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
bennyroshan06
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
Excellence Foundation for South Sudan
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
Balvir Singh
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
Celine George
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
Tamralipta Mahavidyalaya
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
RaedMohamed3
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
PedroFerreira53928
 

Recently uploaded (20)

How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
 

Enhancing the assessment experience through closer integration between the SRS and VLE

  • 1. Enhancing the assessment experience through closer integration between the SRS and VLE University of York, UK Dr Richard Walker bett 2015 January 21 - 24
  • 2. York’s journey 2004 Establishing an institutional LT infrastructure: Implementation: delivering efficiencies in scale & support Phased rollout of Institutional LMS, CMS & Community System (Blackboard Academic Suite): self-managed SITS integration Integration of reading list software Development of anonymous e-submission 2007 2008 Consolidation Embedding, integrating & extending LT services VLE strategic review Launch of Video streaming service Shibbolizing VLE (outreach, admissions & transition) Mobile Learn, lecture capture & e-assessment (QMP) trials 2011 2012 Renewal Re-envisioning LT services: ‘Empowering the learner’ Launch of cloud services: Google Apps for Education; Echo 360; Bb Collaborate and inline grading Release of E-learning vision statement (June 2013): setting the agenda for next Learning & Teaching Strategy
  • 4. York’s technology adoption cycle Adapted from the Gartner Hype Cycle http://www.gartner.com/technology/research/methodologies/hype-cycle.jsp
  • 5. York’s technology adoption cycle Would you like to see an online submission option made available for all assessed work that you need to turn in to your department for marking? Response Percent Response Count Yes 76% 354 No 11% 54 Not applicable 13% 59 Agree Neutral Disagree Not Appropriate Submission of student work 83% 10% 5% 2% Management & allocation of work for markers 51% 34% 10% 6% Marking 66% 17% 12% 5% Creation of feedback 66% 22% 10% 2% Return of work/marks/feedback to students 68% 25% 5% 2% Source: University of York Technology Enhanced Learning Student Survey 2014 Source: University of York Technology Enhanced Learning Staff Survey 2014 It is important for the University to provide online support for all assessed work turned in by your students for marking “It is important for the University to provide *GOOD* online support for the listed activities. I don't believe this is sufficiently the case.”
  • 6. Joining up SRS and assessment systems  A challenging problem for the HE sector: ‘Despite the relatively limited nature of the core product set, the key integration points between these technologies remain problematic and a source of considerable manual intervention.’ (Jisc, 2014: p12) Jisc (2014). Electronic Management of Assessment (EMA): a landscape review. http://repository.jisc.ac.uk/5599/ (pdf)
  • 7. Original anonymous submission and feedback workflow (summative assessment)  Replacing file name with student exam number from SITS eVision: Who Original Process (2007 – 2013) Students Submit work online through VLE, automated e-mailed receipt VLE instructors Download anonymised, work and summary sheet Markers Mark work, create feedback, record marks Admin Archive work, individually match and return feedback and marks (through e-Vision or office) Students Access / collect feedback and marks
  • 8. Enhanced anonymous submission and feedback workflow (Phase 1: 2013-14) Who Process Students Submit work online through VLE, automated e-mailed receipt VLE instructors Download anonymised work, summary sheet, individual feedback forms* and mark-sheet Markers Mark work with disability info, complete feedback forms, record marks in mark-sheet Admin Archive work, batch upload feedback & marks to SITS / e- Vision Students Access / collect feedback and marks from e-Vision
  • 10. Revised workflow Plan Assessment • Assessment created • Coded in SITS Anonymous Assignment • Set up submission point • Associate with SITS assessment Student Submission • Students submit work Marking • Feedback documents downloaded • Marks spreadsheet download • Disability stickers and information included • Department sends documents to markers Uploading into SITS • Documents uploaded into SITS • Feedback and marks released to students E-Assessment, marking and feedback work-flow
  • 11. Workflow benefits  Generation of (configurable) feedback docs (MS Word) inheriting exam ID and disability sticker fields, bundled with assignment scripts in zip file – faster work allocation to markers  Batch upload of marks and feedback docs to SITS – Speeds up return of feedback and marks to students  1 week’s administrative time saved across Politics department (for mark entry for 1600 submissions) – use of feedback template *may* lead to greater transparency in marking process (standardisation & quality)  Summer pilots have led to the following enhancements…..
  • 12. Enhancements to the anonymous submission & feedback workflow (Phase 2: 2014-15)  file submissions restricted to a specific file type (pre-selected by the assessment manager)  assessment manager(s) alerted when late submissions have been made  reporting on SITS registered students who have not yet submitted  facility for markers to annotate / insert comments into file submissions as student feedback to be batch uploaded to SITS  Student view of all previously submitted files
  • 13. Next steps: Phase 3 - enhancing the management and practice of online marking (2015 - )  Processes to support work allocation: – Automated allocation of feedback sheets and scripts to markers  Enhancements to marking experience – Blind marking (student IDs concealed) – Automatic plagiarism checks (Safe Assign & Turnitin)  Assessment management – Reporting & moderation screen  Support for supervisor’s access to marks & feedback Building on SITS – Blackboard data integration (based on LIS 2.0 standards development)??
  • 14. Next steps: Phase 3 - building a student feedback hub (2015 - ) Creation of individual marks & feedback hub for each student; automatically drawing on formative and summative records stored in VLE Grade Centre, with hooks for data ingest from other sources Supervisor sets key questions / reflection template Automated transfer of assessment feedback / marks to individual hub Student reflects on mark / feedback (feed forward) Supervisor reviews & comments on student's progress
  • 15. Questions? University of York, UK Richard Walker Reports and summaries on e-assignment workflow management and marking provision are available at: http://elearningyork.wordpress.com @RichardM_Walker richard.walker@york.ac.uk