Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The Assessment Journey

234 views

Published on

An overview of current practice and activities

Published in: Education
  • Be the first to comment

  • Be the first to like this

The Assessment Journey

  1. 1. 20/10/2016 The Assessment Journey: an overview of current practice and activities
  2. 2. Overview »The story so far »Assessment challenges »What we are doing to address those challenges »Links to tools and resources #jiscassess 20/10/2016
  3. 3. The story so far…… » 2011-2014: worked with over 30 institutions across a three year programme on assessment and feedback » 2012: baseline reviews of institutional practice » 2013: case studies, videos and briefings » 2014: Electronic management of assessment (EMA) project with HELF and UCISA » July 2014: initial landscape study into EMA published Summer 2014 » 2015: survey of FE and skills providers » 2016: FE guidance, case studies, benchmarking, all outputs from the EMA project Background and context 20/10/2016 CC BY-NC-SA 2.0 ©comedynose via Flickr
  4. 4. Assessment and feedback challenges › Highly devolved responsibility and inconsistent practices › Lack of developmental focus › Traditional practices dominate › Timeliness, quality and consistency of feedback › Learner in passive role › Lack of relevance to world of work Assessment and feedback institutional reviews (2012) » Over half had an e-assessment strategy, but lines of responsibility unclear and devolved » Lack of funding » Cultural concerns » Lack of leadership » Infrastructure and logistics » Technology FE and skills survey and conversations with digital leaders 2015) 20/10/2016
  5. 5. What has happened since » Awarding organisations through the Federation of Awarding Bodies and the eAssessmentAdvisory Group » The eAssessmentAssociation » Regulators, CCEA, QualificationsWales and SQA » With supporting statement from Ofqual Joint statement » Provide a consistent and positive message about the use of technology » Demonstrate the value and role of technology-enhanced assessment, and promote the end-to-end benefits » Ensure any potential barriers, perceived or real, to uptake are identified and removed » Explore where admin processes could be harmonised to ensure a consistent experience for providing organisations Agreeing to: 20/07/16 Technology-enhanced assessment in FE and skills – how is the sector doing? 5
  6. 6. New Jisc guide » Why technology? » Defining terms » Issues for FE and skills » A changing sector » Moving forward » Benefits › Organisations › Teaching and training › Learners » Case studies Enhancing assessment and feedback with technology: a guide for FE and skills 20/07/16 Available from bit.ly/Jisc-assessment- guide-FEandSkills Diagram adapted from an original by Manchester Metropolitan University Technology-enhanced assessment in FE and skills – how is the sector doing? 6
  7. 7. From e-assessment to technology-enhanced…. »More efficient management of the assessment process »Enabling more engaging assessments »Giving learners more control over their learning, developing critical self-assessment skills »Providing more timely, more consistent and richer feedback, from multiple audiences »Effective tracking of learners progress »Increasing learners employability and facilitating greater engagement with employers »Showcasing richer evidence of achievement » Flexibility over when and where assessments take place 20/10/2016
  8. 8. Case studies: Walsall College 20/07/16 Technology-enhanced assessment in FE and skills – how is the sector doing? End-to-end electronic management of assessment (EMA) » Benefits: › Increased learner control › Rated ‘outstanding’ by Ofsted and praised for the change in the learner voice › Enhanced quality of data › Enhanced feedback › Tens of thousands of hours of staff time saved » Drivers: › To address student passivity in relation to the assessment and feedback process » Solution: › Using an integrated suite of technologies to support the whole of its assessment and feedback lifecycle 8
  9. 9. Case studies: Swindon College » Drivers: › Need to provide learners with greater choice and flexibility over how evidence is presented for assessment › Need for a personal online space for students to reflect on and present achievements to employers » Solution: › Mahara e-portfolio Empowering learners 20/07/16 Technology-enhanced assessment in FE and skills – how is the sector doing? “Mahara is changing the way people view assessment. Learners own their e-portfolios so make personal choices over how they present themselves and their work.This in itself increases their responsibility, broadens their horizons and encourages thoughtful innovation.” LearningTechnologies Manager, Swindon College 9
  10. 10. Case studies: Basingstoke College ofTechnology »Drivers: › Employability › Achievement and retention »Solution: › Social media for the sharing, discussing, evaluating and showcasing student work Closing the feedback loop “Up to the point of submitting their e-portfolios, our learners are engaged in an endless loop of dialogue which gives them a far better opportunity to evidence their understanding.” Scott Hayden, specialist practitioner of social media and educational technology 20/10/2016
  11. 11. But what does ‘good’ look like? »Draft benchmarking tool »Introduces a set of good practice principles, and identifies what these could look like at different stages of maturity › First steps › Developing › Developed › Outstanding 20/10/2016
  12. 12. Clarifying business processes » Generic process descriptions facilitated clear definition of system requirements » Requirements validated with UCISA » Suppliers responded to requirements using a standard template 20/10/2016
  13. 13. Supplier comparisons 20/10/2016
  14. 14. Next steps: digital apprenticeships »New ‘Co-design theme’ »New project to underpin the theme › Looking to surface where technology can add value to the end to end management, delivery and assessment of apprenticeships 20/07/16 Technology-enhanced assessment in FE and skills – how is the sector doing? 14
  15. 15. Find out more » New guide for FE and skills, with accompanying case studies: bit.ly/Jisc-assessment-guide-FEandSkills › Report from the FE and skills e-assessment survey: ji.sc/eassessment-survey-final-report › Joint statement by key stakeholders: ji.sc/eassessment-survey-report-statement › Accompanying blog post: ji.sc/tech-enhanced-assessment-fe-skills 20/07/16 Technology-enhanced assessment in FE and skills – how is the sector doing? 15
  16. 16. Find out more » Transforming assessment and feedback with technology: http://ji.sc/transforming-assessment-feedback-guide » EMAprocessesand systemguide: http://ji.sc/ema-processes-systems-guide » Supplierresponsestosystemrequirements: http://ji.sc/supplier-responses-ema » The evolution of FELTAG: https://www.jisc.ac.uk/reports/the-evolution-of-feltag Other guides of interest 20/07/16 Technology-enhanced assessment in FE and skills – how is the sector doing? 16
  17. 17. Find out more 20/07/16 » Jointheconversationontheblog: ema.jiscinvolve.org/ » and ontwitter#jiscassess » Jointhemailinglist: jiscmail.ac.uk/tech-enhanced-assessment Technology-enhanced assessment in FE and skills – how is the sector doing? 17
  18. 18. Any questions?20/10/2016
  19. 19. jisc.ac.uk Except where otherwise noted, this work is licensed under CC-BY-NC-ND Find out more… Contact Lisa Gray Senior Co-Design Manager, Student Experience lisa.gray@jisc.ac.uk 20/10/2016
  20. 20. 20/10/2016
  21. 21. FE benchmarking tool »Hybrid origins: »Pedagogy from assessment & feedback work 2011-2014 »Covers effective management practice and use of technology »Self-assessment activity proven useful in HE »Matrix format from Jisc/NUS tool on digital student experience 20/10/2016
  22. 22. FE benchmarking activity »Which headings do you prefer? »Are the indicators in the right columns? »Are there other indicators/examples we should add? »Other suggestions to make the tool more useful to you 30 mins to review 20 mins feedback & discussion 20/10/2016
  23. 23. 20/10/2016
  24. 24. Identifying your challenges » Consider the main challenges facing you and your organisation / staff / students with any aspect of the assessment process »Write one challenge per post-it »Be as specific as you can: › What is the problem › Who does it affect › What is the impact of that problem »Consider what challenges we can impact on: › i.e. not funding/time/Brexit! 20/10/2016
  25. 25. 20/10/2016
  26. 26. Digital Apprentice: New co-design theme 20/10/2016
  27. 27. 1 Discuss emerging challenges 2 Prioritise ideas 3 Announce successful ideas 4 Report progress Identify ideas 31st Oct – 24th Nov 4th Jan– 30th Jan 6th Feb Apr/May Release 6 challenge areas and invite Jisc members and other experts to discuss Audience: managers, consumers, some leaders, other experts Present ideas for activities Jisc could do and ask members which they support Audience: managers, consumers, some leaders Release 6 challenge areas and invite Jisc members and other experts to discuss Audience: everyone who followed the challenge Release 6 challenge areas and invite Jisc members and other experts to discuss Audience: everyone who followed the challenge
  28. 28. The intelligent campus Should we gather more data on students, staff and buildings that would allow us to deliver better experiences? Next generation learning environments We think it is time for a new type of learning environment, but what would this look like? The digital apprentice What would a truly digital apprenticeship look like? Data driven learning gains Can we make better use of data to improve learning, teaching and student outcomes? Digital skills for researchers How do we equip researchers and related staff with the skills they need for the future of research? Next generation research environments We think it is time for a next generation research environment, but what would it look like?
  29. 29. The intelligent campus The digital apprentice Next generation learning environment Data driven learning gains Next generation research environment Digital skills for research Should we gather more data on students, staff and buildings that would allow us to deliver better experiences? We think it is time for a new type of learning environment, but what would this look like? We think it is time for a new type of learning environment, but what would this look like? What would a truly digital apprenticeship look like? Can we make better use of data to improve learning, teaching and student outcomes? How do we equip researchers and related staff with the skills they need for the future of research?
  30. 30. We think it’s time we had fully digital apprenticeships – to meet the needs of employers and apprentices in the 21st Century. • What are the issues and problems you have identified in embedding technology in delivery and assessment of apprenticeships? • What are the opportunities to exploit technology to deliver high quality apprenticeships more effectively? • How can a data-driven approach lead to improved decision making by apprentices, employers and providers? • Can we provide a total digital experience for all apprentices to enhance and support their learning and assessment? • Can a digital approach help provide improved careers advice for apprentices and their parents? The digital apprentice
  31. 31. New Digital Apprentice project »Map the high level processes involved › End to end management, delivery, and assessment »Surface ‘good practice’ points relating to each process »Identify where technology can add value »Detail the system requirements »Suppliers response clarifying how systems meet the needs »Timeframe: › November 2016 to March 2017 »Working group informing the direction of travel › Please sign up today! 20/10/2016
  32. 32. Apprenticeship lifecycle activity »On your tables, draw an apprenticeship lifecycle (or the apprentice’s learning journey if you prefer) › What are the high level processes involved? › Highlight the key pain points from a learning provider perspective 20/10/2016
  33. 33. 20/10/2016
  34. 34. Next steps: what solutions are needed? »Group around a challenge cluster »Explore possible ‘solution’ ideas that might help to address that challenge › Be clear – what does the idea look like?Who is it for? Draw pictures! »Or join the ‘digital apprentice’ table Activity 20/10/2016

×