Presenter: Joseph Gliddon
Organisation: Bristol University
Description: This session explores work implemented over several years at the University of Bristol to develop a scalable workflow for coursework assessment and feedback online.
The workflow combines technical and pedagogic planning to support lasting cultural change. This uses Blackboard packages, which can also support consistent provision of other activities across multiple courses.
This work was done to address key challenges in this area, including:
-meeting complex requirements in a consistent way
-needing a standard approach which is scalable across multiple courses
-ownership of the process by Schools to ensure sustainability
-easily updating content across many courses with minimum editing
Session covers policy, pedagogic approaches, engaging academic & administrative leads, and the process.
Measures of Dispersion and Variability: Range, QD, AD and SD
TLC2016 - Submit work here
1. "Submit work here"
Teaching and Learning Conference by Blackboard,
Groningen
Roger Gardner and Joseph Gliddon
Technology enhanced learning and education
development team
www.bris.ac.uk/tel
26 April 2016
1
2. About this session
26 April 2016
2
• Rationale
• People and planning
• Package contents and demo
• Approaches to feedback
• Support and training
• Impact, challenges, lessons
• Ideas for the future
3. About Bristol
26 April 2016
3
Image attribution: By Nic Trott (http://www.flickr.com/photos/nikon_nic/7519208704/ ) [CC BY 2.0
(http://creativecommons.org/licenses/by/2.0)], via Wikimedia Commons
4. About Bristol
26 April 2016
4
Image attribution: Adrian Pingstone - Photographed by Adrian Pingstone, Public Domain,
https://commons.wikimedia.org/w/index.php?curid=1336301
5. Question for discussion
What things would be useful to
have the same across multiple
Blackboard courses?
26 April 2016
5
6. 6
26 April 2016
Image attribution: https://www.flickr.com/photos/bitterjug/7670055210/in/photostream/
7. Rationale
• Consistency
• Better management of complex workflows
• Scalability
7
26 April 2016
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
8. People
• Important to have academic and admin leads
• Agree roles and responsibilities at the start
Roles and responsibilities template
8
26 April 2016
9. Project plan
9
26 April 2016
Image attribution: http://nyphotographic.com/ http://www.picserver.org/p/planning.html
Planning
template
Requirements
example
10. What’s in a package?
• Instructions
• Checklist quiz
• Assignments (with rubric attached)
• Extension group
• Adaptive releases
• Grade Centre columns
• Student access to My Grades
• Link to upload moderation forms
10
26 April 2016
11. Demo and how to copy package
• Instructions for bulk copy
11
26 April 2016
13. Support and training
• Responsibilities agreed in advance
• Separate session for admin teams and markers
• Build capacity by identifying and training up
leads in admin team
• Presence of academic and admin leads needed
as questions often about policies and processes
13
26 April 2016
15. Limits of packages
• Some things require post import tasks e.g.
setting due dates, or creating Smartviews for
multiple markers
• Limits on certain aspects of reusable items e.g.
titles
15
26 April 2016
17. Challenges – packages in general
• To package or not to package? (extent of
support for minor differences?)
• Reliance on Schools to provide accurate
information
17
26 April 2016
18. Challenges – electronic management
of assessment (EMA)
• Difference in the user experience when using
rubrics compared with inline grading
• Limitations in anonymous marking functionality
• Demand for more and better marking tools on
mobile devices e.g. mark offline and sync
18
26 April 2016
20. Other examples at Bristol
• Engineering support forum
• Reading lists
• Student rep spaces
• Contextual variables
20
26 April 2016
21. Key lessons learnt
• Spend time nailing the requirements
• Test imports with small numbers first
• Get sign off of data from the School
• Build capacity in Schools to be first point of call
for support calls and to maintain packages
• If changing several aspects, it is quicker to clear
out packages and import new ones
21
26 April 2016
22. Ideas for the future
22
26 April 2016
Image attribution: https://www.flickr.com/photos/buckaroobay/3721809183
what does a typical “Submit work here” package include?
Instructions for students and staff
A checklist quiz - used so that students have to agree to certain things before they submit work
Submission point(s) - with access linked to completion of the checklist via adaptive release
Rubrics for feedback
Groups for students with extensions with adaptive release which allows later access to submission point
Grade Centre columns for administration e.g. For application of penalties, comments e.g. to indicate extension and moderation
Student access to My Grades
A link for staff to upload completed Moderation forms