Presentation on behalf of HeLF at the University of East London. Content covers the 2011 HeLF survey of its members which provided a unique HE sector snapshot of the adoption of eSubmission, eMarking and eFeedback.
ICT role in 21st century education and it's challenges.
eSubmission Sept 2011
1. eSubmission: HeLF Survey of
Policies, Practices and Attitudes
Andy Ramsden, University Campus, Suffolk
Barbara Newland, University of Brighton
Lindsey Martin, Edge Hill University
2. Overview
Bried introduction to HeLF
Why survey eSubmission?
eSubmission: our working definition
Survey – a snapshot of current policy
&practice
Results
Conclusions – so what, now what?
3. Who are HeLF?
Heads of eLearning Forum: a network of senior staff in
institutions engaged in promoting, supporting and
developing technology enhanced learning
Represents the interests of its members to various
national bodies and agencies including the Higher
Education Academy and JISC
Aims to share knowledge on the strategic implications of
developing and implementing e-learning
http://w01.helfcms.wf.ulcc.ac.uk/
4. Why survey eSubmission?
Sense of being on verge of a step-change from
experimental to mainstream adoption
Uptake driven largely on assumptions around
efficiency gains and improved student
experience
Institutional perspective from HeLF members
could provide a snapshot of current policy and
practice and identify key issues for wider
consideration
5. eSubmission: key activities
• eSubmission – online submission of an
assignment
• Plagiarism deterrence and detection
• eMarking – marking a paper online
• eFeedback- producing online feedback
which could be text, audio etc but not paper
• eReturn – online return of marks
6. Survey: a snapshot of policy & practice
Online survey circulated to HeLF members
March 2011
Aim to provide an institutional perspective on
eSubmission
A mixture of closed multiple choice, multiple
selection and open response
38 out of a possible 125 responses
30% response rate providing a representative
sample
7. Drivers for eSubmission
Five strong themes emerged:
Enhanced student experience*
Efficiency gains*
Green agenda
Responding to the student voice
Plagiarism detection
8. Who ‘owns’ eSubmission in your
institution?
Area of University Number of responses
Academic led, local & distributed 16
Central Services led 10
Head of Assessment 1
Standard Committee on
Assessment
1
Registry 1
Working groups/ collaborations 3
No one 4
12. Anxieties around eSubmission
processes
Themes identified
eMarking*
Adequacy/robustness of current systems/ infrastructure*
Additional workloads/ time demands
Staff skills
Back-up and archiving
Blind/anonymous/double marking
13. Scale of adoption across
institutions
Scale of adoption Responses
Approaching mainstream 3
Faculty/School 11
Patchy 20
No way of knowing 2
14. Role(s) of Head of eLearning icw
eSubmission
Roles of Head of eLearning icw eSubmission Occurrences
Awareness raising/Adviser/Champion/Staff
Development and Support
26
Technical input – where eSubmission intersects
with the VLE/ technical infrastructure
14
Driving Policy Development and Strategy 13
Co-ordination/ Project Management 7
15. Benefits of eSubmission
Benefits Occurrences
Student satisfaction 22
Quality and learning enhancements 21
Efficiencies from streamlined processes,
faster turnaround, reduced costs to the
University
17
Environmental – Green Agenda 4
16. Evidence base
Evidence drawn from:
• Student surveys, module evaluations, L&T
Committees, focus groups, staff surveys,
pilots, staff consultations, staff interviews,
benchmarking, anecdotal, help desk data
17. Conclusion – now what?
• A wide spread and increasing use of e-submission across the sector
suggests we are on the cusp of a step-change to more strategic, planned
adoption of eSubmission
• The process of implementation is generally occurring in departments and
Schools with institutional changes in policy and codes of practice following
afterwards
• Academic staff perceptions are relatively positive about eSubmission but
institutional change will need to address their negative attitude to
eMarking and eFeedback
• HeLF members recognise that that staff will require support through “this
major change in working practice” and are working towards providing this
• One HeLF member commented that it “needs a lot of different
stakeholders to work together to make it effective”
Editor's Notes
Membership of over 125 nominated Heads from UK Higher Education institutionsFor those of you wondering who HeLF are:We’re a broad churchA Network / Go To forum for support, approaches, benchmarkingOur theme for 2010-2011 was Strategy, Efficiency & Resource ManagementMost importantly re this survey, its members are well-placed to provide an institutional perspective on elearning issues
eSubmission is NOT a new initiative BUT …Usually a mix of paper and electronicNSS as a driver …Conversations between members online and at face to face meetingsWe wanted to know if the balance was changing
Free text responseReceived most comments
The most common technologies used are Turnitin integrated within the VLE or the institutional VLE rather than “home-grown” technologies.
The most common practice for currently being implemented is eSubmission and hard copy printed by student (63%), followed by eSubmission as the only form of submission (29%).13% both implement eMarking and eSubmission and hard copy printed by department. 11% implement eFeedback and students can choose to print hard copy.
However, academic attitudes towards eMarking show a sharp contrast to those for eSubmission and eFeedback.Only 13% have a positive attitude to emarking whereas 34% have a negative one.
Free text responsesAreas where there were most responsesEmarking 17 responsesBack-up etc 12 responsesOthers 5 comments or underStaff have spent their academic careers marking piles of papers. They have found ways of making this as effective and efficient as possible. Mark anywhere they can carry the papers from their office, to the garden or while travelling such on the train. In some institutions it is thought that academic anxieties about marking online are changing and “falling away slowly.” Many academics are anxious about the changeConnectivity - If the eMarking system is online then there can be issues with connectivity when away from the office. Health and safety issues such as “head ache, eye strain and back/posture issues.”Increase in workload - “downloading/re-uploading etc, audio feedback is also perceived by many to be time consuming.” However, many academics do not want to mark on screen as “mainly it is a preference from habit”HeLF members recognise that that staff will require support through “this major change in working practice.” TechnologyThe need for an “appropriate method for submission that is robust, reliable and secure” was recognised“Higher use of these processes demands highly resilient VLE infrastructure.” Interestingly, there may be a robust method but “staff sometimes are using other tools in ways we do not recommend which causes trouble. “
29 out of 38 have Departments have implemented eSubmission in some formSeems to be intent to be more strategic/systematic in adoptionVLE and Turnitin features a lot in responses
The responses reflect the diversity of roles and the location/remits of eLearning/TEL departments across the sector. Perceived roles in relation to eSubmission varied from “minimal – interested in where the e-submission system interacts with VLEs etc” to “Huge. I am one of the few people who talk to all those involved!”I particularly liked the following quote: “Acting as a virtual condom between academic colleagues and computing services.” Also suggestion [early indications] that it is impacting on other roles within institutions and promoting closer working:AdminAcademicsTechnologistsQA 1 response
1 response reported improved NSS results for assessment & feedbackStudent satisfaction:ConvenienceBetter quality feedback – including accessible and legibleLess travel (time)Reduced cost of printing/travelQuality/Learning EnhancementsEasier to give quality feedbackImprovements to moderation processesCentral collationReduction in error – greater understanding of need for data accuracy in VLEBetter management informationAudit trail – receiptingeArchiving of submissionsEfficiencies/streamliningFaster marking and feedback to studentsAdministrative efficiencies in handling/circulating assignmentsCosts in staff time/ printingStreamlines processes in respect of students taught off campusLess stressful for administrators Reduced cost of archival storageEnvironmentalLess paper!
Role for HeLF?:Sharing approachesGood practice guidelinesCase studies and evidence of impact/benefitsPolicy leadCollaborating with JISC etcSIG or review of good practice