• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Jisc Programme Developments

Jisc Programme Developments



John Winkley of AlphaPlus discusses some forthcoming JISC funding opportunties in the area of assessment

John Winkley of AlphaPlus discusses some forthcoming JISC funding opportunties in the area of assessment



Total Views
Views on SlideShare
Embed Views



1 Embed 1

http://wiki.cetis.ac.uk 1


Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment

    Jisc Programme Developments Jisc Programme Developments Presentation Transcript

    • E-Assessment SIG 22 May 2008 Glasgow 03/06/09 | Supporting education and research | Slide Joint Information Systems Committee Supporting education and research JISC Programme Developments John Winkley
    • New Projects & Activities for 2008
      • Formative Assessment Study about to commence
      • A new demonstrator call in early June 08
      • Two new studies tendering in early June 08
      • Ongoing programme work:
        • Evaluation of progress, baselines
        • Roadmap and development planning
    • Demonstrator Project Assessment Tools
      • “ composite applications using existing components from existing JISC Toolkits and elsewhere”
      • At least 2 toolkits/components
      • leverage existing assessment content resources
      • Broaden the uptake and usage of QTI2 and support the developer community.
    • Demonstrator Project Assessment Tools (2)
      • Let via a JISC Circular: “HE institutions funded via HEFCE and HEFCW, and by FE institutions in England that teach HE to more than 400 FTEs”
      • Up to 4 projects, each up to a maximum of £45k. Each with an available £15k additional funding for the toolkit provider(s) to support the project.
      • Work to be completed by end March 2009
      • “ risk-managed setting”
    • Demonstrator Project Assessment Tools (3)
      • Possible Applications include :
      • Workflow applications for item production and banking processes such as quality assurance, editorial, etc.
      • Orchestration of test creation and assembly applications
      • Loading/converting of existing item bank content to a QTI2 item bank
      • Wider assessment applications (eg online surveys)
      • Adapting components/groups of components to alternative requirements for example formative assessment delivery applications
      • Multi-standard player application (eg SCORM2004, QTI1.x, QTI2.x)
      • Integration of/connection of existing components into other information systems, eg learning environments, administration and student record systems
      • Integration with e-portfolio services
    • Design Principles for Studies
      • Benefits of e-assessment well documented
      • But take-up not as fast as expected. Why is this?
      • Need to broaden the pool of participants
      • Need to broaden the vision for e-assessment services
    • Study Project Advanced e-assessment techniques
      • Scoping study of the state-of-the-art in e-assessment techniques across the world and in all education sectors.
      • Designed to underpin roadmap and framework/information knowledgebase component specification developments.
      • All aspects of e-assessment including on-screen presentation and marking, but excluding e-portfolio. Summative or formative assessment. Assessment in professional and academic domains. UK and international applications.
      • 6 month project
      • Up to £40,000 including VAT and expenses
      • Let via an open tender : any organisation can bid.
    • Study Project Advanced e-assessment techniques (2)
      • Look at specific e-assessment technology and more general techniques and technologies. Examples might include:
      • Computer marking of free text responses (sentences, paragraphs, essays)
      • Response with and assessment of complex mathematical responses
      • Computer marking of other complex responses (eg source code, diagrams)
      • Integration of computer-marking with streamlined human marking, expert and judgement support systems
      • Peer and Group Assessment
      • Associated services such as detection of plagiarism and other cheating
      • Data mining, Fuzzy Logic and Pattern Matching
      • Multi User Virtual Environments (MUVEs) and virtual worlds
      • Serious gaming (to some extent would be covered by (e) above)
      • Web 2.0 technologies such as Flickr
    • Study Project Quality of e-assessment
      • Mixed methods study to look at qualitative and quantitative measures of fitness for purpose in the e-assessments used in the JISC community today.
      • Applying
      • 6 month project
      • Up to £40,000 including VAT and expenses
      • Let via an open tender : any organisation can bid.
    • Study Project Quality of e-assessment (2)
      • Consensus that e-assessment offers considerable potential to improve assessment quality, but e-assessment also presents some risks to quality, notably:
        • multiple choice objective tests may lead to impoverishment.
        • Multiple choice objective tests tend to emphasise memorisation and factual recall.
        • Multiple choice objective tests require particular attention to be paid to the authoring and item performance evaluation process.
      • Thoroughly explored in literature, this study aims to investigate the quality of actual items in use.
    • JISC Programme Developments QUESTIONS Myles Danson JISC Programme Manager [email_address] 07796 336319