E-Assessment SIG 22 May 2008 Glasgow 03/06/09   |  Supporting education and research  |  Slide  Joint Information Systems ...
New Projects & Activities for 2008 <ul><li>Formative Assessment Study about to commence </li></ul><ul><li>A new demonstrat...
Demonstrator Project Assessment Tools <ul><li>“ composite applications using existing components from existing JISC Toolki...
Demonstrator Project Assessment Tools (2) <ul><li>Let via a JISC Circular:  “HE institutions funded via HEFCE and HEFCW, a...
Demonstrator Project Assessment Tools (3) <ul><li>Possible Applications include : </li></ul><ul><li>Workflow applications ...
Design Principles for Studies <ul><li>Benefits of e-assessment well documented </li></ul><ul><li>But take-up not as fast a...
Study Project Advanced e-assessment techniques <ul><li>Scoping study  of the state-of-the-art in e-assessment techniques a...
Study Project Advanced e-assessment techniques (2) <ul><li>Look at  specific e-assessment technology  and  more general te...
Study Project Quality of e-assessment <ul><li>Mixed methods study  to look at qualitative and quantitative measures of  fi...
Study Project Quality of e-assessment (2) <ul><li>Consensus that e-assessment offers considerable potential to improve ass...
JISC Programme Developments QUESTIONS Myles Danson JISC Programme Manager [email_address] 07796 336319
Upcoming SlideShare
Loading in …5
×

Jisc Programme Developments

493
-1

Published on

John Winkley of AlphaPlus discusses some forthcoming JISC funding opportunties in the area of assessment

Published in: Economy & Finance, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
493
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Jisc Programme Developments

  1. 1. E-Assessment SIG 22 May 2008 Glasgow 03/06/09 | Supporting education and research | Slide Joint Information Systems Committee Supporting education and research JISC Programme Developments John Winkley
  2. 2. New Projects & Activities for 2008 <ul><li>Formative Assessment Study about to commence </li></ul><ul><li>A new demonstrator call in early June 08 </li></ul><ul><li>Two new studies tendering in early June 08 </li></ul><ul><li>Ongoing programme work: </li></ul><ul><ul><li>Evaluation of progress, baselines </li></ul></ul><ul><ul><li>Roadmap and development planning </li></ul></ul>
  3. 3. Demonstrator Project Assessment Tools <ul><li>“ composite applications using existing components from existing JISC Toolkits and elsewhere” </li></ul><ul><li>At least 2 toolkits/components </li></ul><ul><li>leverage existing assessment content resources </li></ul><ul><li>Broaden the uptake and usage of QTI2 and support the developer community. </li></ul>
  4. 4. Demonstrator Project Assessment Tools (2) <ul><li>Let via a JISC Circular: “HE institutions funded via HEFCE and HEFCW, and by FE institutions in England that teach HE to more than 400 FTEs” </li></ul><ul><li>Up to 4 projects, each up to a maximum of £45k. Each with an available £15k additional funding for the toolkit provider(s) to support the project. </li></ul><ul><li>Work to be completed by end March 2009 </li></ul><ul><li>“ risk-managed setting” </li></ul>
  5. 5. Demonstrator Project Assessment Tools (3) <ul><li>Possible Applications include : </li></ul><ul><li>Workflow applications for item production and banking processes such as quality assurance, editorial, etc. </li></ul><ul><li>Orchestration of test creation and assembly applications </li></ul><ul><li>Loading/converting of existing item bank content to a QTI2 item bank </li></ul><ul><li>Wider assessment applications (eg online surveys) </li></ul><ul><li>Adapting components/groups of components to alternative requirements for example formative assessment delivery applications </li></ul><ul><li>Multi-standard player application (eg SCORM2004, QTI1.x, QTI2.x) </li></ul><ul><li>Integration of/connection of existing components into other information systems, eg learning environments, administration and student record systems </li></ul><ul><li>Integration with e-portfolio services </li></ul>
  6. 6. Design Principles for Studies <ul><li>Benefits of e-assessment well documented </li></ul><ul><li>But take-up not as fast as expected. Why is this? </li></ul><ul><li>Need to broaden the pool of participants </li></ul><ul><li>Need to broaden the vision for e-assessment services </li></ul>
  7. 7. Study Project Advanced e-assessment techniques <ul><li>Scoping study of the state-of-the-art in e-assessment techniques across the world and in all education sectors. </li></ul><ul><li>Designed to underpin roadmap and framework/information knowledgebase component specification developments. </li></ul><ul><li>All aspects of e-assessment including on-screen presentation and marking, but excluding e-portfolio. Summative or formative assessment. Assessment in professional and academic domains. UK and international applications. </li></ul><ul><li>6 month project </li></ul><ul><li>Up to £40,000 including VAT and expenses </li></ul><ul><li>Let via an open tender : any organisation can bid. </li></ul>
  8. 8. Study Project Advanced e-assessment techniques (2) <ul><li>Look at specific e-assessment technology and more general techniques and technologies. Examples might include: </li></ul><ul><li>Computer marking of free text responses (sentences, paragraphs, essays) </li></ul><ul><li>Response with and assessment of complex mathematical responses </li></ul><ul><li>Computer marking of other complex responses (eg source code, diagrams) </li></ul><ul><li>Integration of computer-marking with streamlined human marking, expert and judgement support systems </li></ul><ul><li>Peer and Group Assessment </li></ul><ul><li>Associated services such as detection of plagiarism and other cheating </li></ul><ul><li>Data mining, Fuzzy Logic and Pattern Matching </li></ul><ul><li>Multi User Virtual Environments (MUVEs) and virtual worlds </li></ul><ul><li>Serious gaming (to some extent would be covered by (e) above) </li></ul><ul><li>Web 2.0 technologies such as Flickr </li></ul>
  9. 9. Study Project Quality of e-assessment <ul><li>Mixed methods study to look at qualitative and quantitative measures of fitness for purpose in the e-assessments used in the JISC community today. </li></ul><ul><li>Applying </li></ul><ul><li>6 month project </li></ul><ul><li>Up to £40,000 including VAT and expenses </li></ul><ul><li>Let via an open tender : any organisation can bid. </li></ul>
  10. 10. Study Project Quality of e-assessment (2) <ul><li>Consensus that e-assessment offers considerable potential to improve assessment quality, but e-assessment also presents some risks to quality, notably: </li></ul><ul><ul><li>multiple choice objective tests may lead to impoverishment. </li></ul></ul><ul><ul><li>Multiple choice objective tests tend to emphasise memorisation and factual recall. </li></ul></ul><ul><ul><li>Multiple choice objective tests require particular attention to be paid to the authoring and item performance evaluation process. </li></ul></ul><ul><li>Thoroughly explored in literature, this study aims to investigate the quality of actual items in use. </li></ul>
  11. 11. JISC Programme Developments QUESTIONS Myles Danson JISC Programme Manager [email_address] 07796 336319

×