#jiscasses www.jisc.ac.uk/assessmentandfeedbacCAA – Closing Address Paul Bailey, JISC 11th July 2012
Links JISC - www.jisc.ac.uk/assessmentandfeedback Making Assessment Count, University of Westminster http://jiscdesignstudio.pbworks.com/w/page/23495173/Making %20Assessment%20Count%20Project PEER Project http://www.reap.ac.uk/peer.aspx Patch work assessment http://www.jisc.ac.uk/whatwedo/programmes/elearning/ltig/dep ta.aspx Uniqurate – http://uniqurate.kingston.ac.uk QTI Support Project - http://qti-support.gla.ac.uk IMS Learning Tools Interoperability - http://publications.cetis.ac.uk/2012/473
Mapping to Themes 5.13 Production Systems & Issues 5.5 Staffing issues 5.3 Departmental/faculty/institution wide initiatives 5.2 Identification and maintenance of best practice 4.8 Adaptive testing 4.5 Provision of effective student feedback 4.4 Pedagogical issues in question design and content 4.2 Higher order skills 4.1 Study skills, key skills, IT Skills 4 Assessing skills and enhancing student learning 3.13 Service Oriented Approaches 3.12 Open Source E-assessment Initiatives 3.11 E-assessment Architectures & Frameworks 3.9 Addressing the requirements of students with special needs 3.8 Collaborative assessment, E-moderation, Peer assisted… 3.7 Delivery systems not limited to Web/PC (mobile phone etc) 3.6 International Developments 3.4 Question banks and question sharing 3.3 Use of IT to underpin/drive innovation in the assessment… 3.2 Question Types (over and above objective questions) 3.1 Extending free-text assessment 1.5 Inter-institutional collaboration1.3 Comparisons between CAA Systems (Ease of use, cost, etc) 1.2 Student views about CAA 1 Evaluation 0 1 2 3 4 5 6 7 8 9
Simpler mapping to Themes 5 Strategic 2 Reporting Developments 1 Evaluation 4 , 13 ,1 ,9Assessing skills and enhancingstudent learning , 13 3 Innovation in CAA , 34
What’s Hot - Future/Emerging AreasDenise Whitelock My short list Free text entry Short answer/essay Adaptive Self and peer assessment testing/marking Learning analytics, Automated marking Gaming and simulations Advice for Action e-portfolios for assessment Learning analytics/Data Student Engagement mining Economic/impact Motivation Badges measures
Learning Analytics – supporting staff and students Pros - Assessment management systems that allow management and processing of results, learning analytics, formative and collaboration on feedback processes OpenMentor – feedback to tutors “assessing students” by gathering learning/open badges evidence..Denise Whitelock Cons – how data is used, measuring staff performance beware ethical issues
Measuring Economic Benefits and Impact ITEAM Project – University of Herts http://jiscdesignstudio.pbworks.com/w/page/55268839/e- Learning%20Webinars
Hosted Services – Costs and Benefits Benefits of hosted services such as Moodle or Question Mark on Demand – Reliability, scalability, etc. Emerging LTI Supported tools – VLEs and QMP – WebPA – MAC Tool – QTI Tools (in development....) Ease of access and plug-in to inst learning environmenthttp://www.jisc.ac.uk/whatwedo/topics/networkinfrastructure/cloud computing.aspx
Student Digital Experience and Engagement
JISC Assessment and Feedback Activities?www.jisc.ac.uk/assessmentandfeedback #JISCASSESS
Programme overviewStrand A Strand B Strand C8 Projects 8 projects 4 projects 6 months 9 months 3 years2011-2014 to 2 years to 2 years 2011-2013 2011-2013 Support and Synthesis Project
Strand A goals and objectives Improved student learning and progression Enhanced learning and teaching practice Integrated Increased strategies, po efficiency licies & processesOverarching goals from Strand A projects synthesised from their bid documents.
Themes and challenges
What are we learning about technology-enhanced assessment and feedback practices?www.jisc.ac.uk/assessmentandfeedback #JISCASSESS
Why baseline?Programme Level View of landscape & direction of travel Validate aims & rationale Shared understanding Identify synergies with other work Deliver effective support
Why baseline?Project Level View of landscape & direction of travel Validate scope Confirm/Identify challenges Identify stakeholders Manage & communicate scope Challenge mythsIdentify readiness for change Show evidence of improvementImportant stage of engagement/ownership
Sources of baseline evidence structured and semi- institutional QA structured interviews (some documentation video) reports by QAA, OFSTED & workshops and focus external examiners groups course evaluations process maps student surveys rich pictures quantitative analysis of key institutional (and devolved) data sets strategy & policy data from research projects documents questionnaires
Differences in emphasis
Differences in emphasis
Are our projects typical of the landscape?
Issues: strategy / policy / principlesFormal strategy/policy documents lag behind current thinkingEducational principles are rarely enshrined in strategy/policyDevolved responsibility makes it difficult to achieve parity of learner experience
Issues: stakeholder engagementLearners are not often actively engaged in developing practiceAssessment and feedback practice does not reflect the reality of working lifeAdministrative staff are often left out of the dialogue
Finding: assessment and feedback practiceTraditional forms such as essays/exams still predominateTimeliness of feedback is an issueCurriculum design issues inhibit longitudinal development
Innovating e-Learning 2012The 7th JISC international onlineconference takes place on 13th – 23rdNovember 2012Registration details announced shortly!#jiscel12www.jisc.ac.uk/elpconference12Digital literacies will be a key theme of theconference and opportunities to share yourwork in the conference activity weekI just want to say #jiscel11 was awesome...