JISC assessment news, updates and development priorities


Published on

Myles Danson, JISC programme manager.

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

JISC assessment news, updates and development priorities

  1. 1. e-Assessment Initiatives Myles Danson JISC Programme Manager (e-Learning)
  2. 2. e-Assessment – Myles <ul><ul><li>Myles – Who? </li></ul></ul><ul><ul><li>My portfolio: </li></ul></ul><ul><ul><li>T&S, CETIS, Programme Level Activities….. </li></ul></ul><ul><ul><li>e-Assessment lead </li></ul></ul><ul><ul><li>JISC – what’s it all about? http:// www.jisc.ac.uk/aboutus/strategy.aspx </li></ul></ul><ul><ul><li>e-Learning Programme http://www.jisc.ac.uk/whatwedo/themes/elearning/programme_elearning.aspx </li></ul></ul>
  3. 3. e-Assessment – JISC Definition <ul><ul><li>The end-to-end electronic assessment processes where ICT is used for the presentation of assessment and the recording of responses. </li></ul></ul>
  4. 4. e-Assessment Examples <ul><ul><li>Automated marking of Objective Questions </li></ul></ul><ul><ul><ul><li>Variants of Objective questions </li></ul></ul></ul><ul><ul><ul><li>Confidence level Assessment </li></ul></ul></ul><ul><ul><ul><li>Assertion Reason </li></ul></ul></ul><ul><ul><ul><li>Numerical input </li></ul></ul></ul><ul><ul><li>Automated marking of non-objective questions </li></ul></ul><ul><ul><ul><li>Peer Assessment </li></ul></ul></ul><ul><ul><ul><li>Simulations </li></ul></ul></ul><ul><ul><ul><li>Free text marking </li></ul></ul></ul><ul><ul><ul><li>Use of Web 2.0 technologies </li></ul></ul></ul><ul><ul><li>Scenarios </li></ul></ul><ul><ul><ul><li>Self assessment (assessment of learning for learning sake) </li></ul></ul></ul><ul><ul><ul><li>Formal summative assessment (performance measure, norm or criterion referenced) </li></ul></ul></ul><ul><ul><ul><li>Diagnostic assessment </li></ul></ul></ul>
  5. 5. Related activities <ul><li>ePortfolios: </li></ul><ul><ul><li>Formal documentation of eassessment outcomes and results </li></ul></ul><ul><ul><li>Informal personal portfolios for supporting learning and development </li></ul></ul><ul><ul><li>Recording achievement and activities to support lifelong learning and continuing professional development </li></ul></ul><ul><li>Repositories: </li></ul><ul><ul><li>Storage of eassessment material in secure and open repositories </li></ul></ul><ul><ul><li>Discovery, retrieval and reuse of assessment materials </li></ul></ul><ul><li>eAdmin: </li></ul><ul><ul><li>Integration with institutional reporting procedures </li></ul></ul><ul><ul><li>Scheduling of assessment activities, room bookings, etc </li></ul></ul><ul><ul><li>Security </li></ul></ul><ul><ul><li>Attainment records supporting progression / life long learner </li></ul></ul><ul><ul><li>Flexible infrastructure to support these </li></ul></ul><ul><li>eFramework: ( http:// www.elearning.ac.uk/news_folder/eframeworkpaper ) </li></ul>
  6. 6. National E-Assessment Drivers and Environment <ul><li>Flexibility </li></ul><ul><li>Personalisation </li></ul><ul><li>National Drivers and policies </li></ul><ul><ul><li>DfES unified e-learning strategy www.dfes.gov.uk/elearningstrategy / ‘Using technology to streamline assessment procedures and enable online assessment on-demand is a long term objective ’ </li></ul></ul><ul><ul><li>14-19 Government White Paper www.14-19reform.gov.uk ‘We will seek to maximise the potential of e-assessment’ </li></ul></ul><ul><ul><li>QCA http://www.qca.org.uk/qca_5412.aspx ‘QCA are currently reviewing the aims for e-assessment in line with qualification and curriculum developments ’ QCA Regulatory Principles for e-Assessment (April 2007) http://www.qca.org.uk/qca_10475.aspx </li></ul></ul><ul><ul><li>HEFCE Strategy for e-Learning (under review with JISC) http://www.hefce.ac.uk/pubs/HEFCE/2005/05_12/ ‘Encourage the use of technology to enable electronic assessment’ </li></ul></ul>
  7. 7. JISC e-Assessment Objectives <ul><li>To explore and develop effective practice on the use of e-assessment systems and tools </li></ul><ul><li>Through the development of standards and piloting of e-assessment related technologies </li></ul><ul><li>To provide guidance for institutions on effective practice in this area </li></ul>
  8. 8. E-Assessment JISC Work Done to Date <ul><li>a wide range of tools and software </li></ul><ul><li>case studies </li></ul><ul><li>exploratory reports </li></ul><ul><li>a reference model </li></ul><ul><li>a glossary and a roadmap </li></ul><ul><li>Projects: REAP reengineering assessment practice FREMA framework reference model for assessment IBIS Item Bank Infrastructure Study APIS assessment provision through interoperable segments ASAP automated system for the assessment of programming CATS constructing assessments using tools and services, ISIS, Open Mentor, PyAssess, Web PA….. </li></ul>
  9. 9. e-Assessment JISC Work Underway <ul><li>AQURATE Feb 07 – March 08 QTI2 authoring tool (Kingston University) </li></ul><ul><li>Minibix Feb 07 – March 08 QTI2 Item Bank (Cambridge University) </li></ul><ul><li>ASDEL Feb 07 – March 08 Assessment delivery engine for QTI2 questions (Southampton University) </li></ul><ul><li>MCQFM Jan 07 – Aug 07 Web Service for Rapid Creation of QTI2 questions (Hertfordshire University) </li></ul><ul><li>XMARKS Jan 07 – Oct 07 Web Service for exposing assessment and marks data </li></ul><ul><li>http://www.jisc.ac.uk/whatwedo/programmes/programme_capital/capital_funded/capital_elearning_0406funded.aspx </li></ul>
  10. 10. e-Assessment JISC Priorities <ul><li>http://www.jisc.ac.uk/whatwedo/themes/elearning/programme_elearning.aspx </li></ul><ul><li>Investigate discipline-specific use of assessment </li></ul><ul><li>Automatic marking of free-text assessments </li></ul><ul><li>Web 2.0 and pedagogy / innovation </li></ul><ul><li>Further development of domain mapping </li></ul><ul><li>Tangible benefits </li></ul><ul><li>QTI – user needs; support tools development, validation, dialects etc </li></ul><ul><li>Large scale demonstrators of existing toolkits </li></ul><ul><li>Further toolkit development, test administration, accessibility, quality </li></ul><ul><li>Standardised assessment data transfer </li></ul><ul><li>Cross stakeholder and partner initiatives </li></ul><ul><li>Item Banking </li></ul><ul><li>Institutional InfoKit </li></ul>
  11. 11. JISC e-Assessment How to Contribute <ul><li>[email_address] </li></ul><ul><li>Assessment SIG coordinator & SIG </li></ul><ul><li>Expert consultant </li></ul><ul><li>Jiscmail lists (e-Assessment, CETIS-QTI-SIG, JISC-Announce) </li></ul><ul><li>Assessment related events…. </li></ul><ul><li>Open call </li></ul><ul><li>Guide to bidding http://www.jisc.ac.uk/fundingopportunities/bidguide.aspx </li></ul>
  12. 12. JISC Assessment Expert Consultant <ul><li>Expert Consultant ( details ) </li></ul><ul><li>Support the JISC programme manager in: </li></ul><ul><ul><li>core set of documents for each activity area: </li></ul></ul><ul><ul><ul><ul><li>Definition and scope </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Overview of recent and current JISC-funded activities </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Overview of other significant initiatives or developments in the sector </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Stakeholder map </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Summary of progress to date on description and modelling of the area, such as through reference models or domain maps. </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Baseline description of current sector practice and JISC-funded developments, with a gap analysis of potential areas for future work </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Development priorities for the activity area </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Providing feedback to projects on their plans and reports…. </li></ul></ul></ul></ul>