Using online workshops to enhance student content evaluation skills for VLE learning communities De Montfort University  RITA project 2008 – 2009 Mike Leigh, Lucy Mathers & Kaye Towlson
Session coverage Background Methodology Results Connections Future Applications
Background Cross faculty/department RITA bid  Build on work of previous RITA funded project by Mike Leigh and Lucy Mathers revealed a significant gap between information evaluation skills acknowledged by students and those manifest in work. Wanted to develop an evaluative framework and publish on VLE for use when posting selected subject materials.
Methodology: Strand 1 Lectures and Labs Embedded in curriculum.  2 different modules Similar assessment task group or individual wiki Post material, mainly from the internet to aid understanding of a negotiated topic. Evaluate material posted.  Group or peer evaluation of material article review
Methodology Strand 1 Lectures and Labs Session re: information evaluation “ Skill for life”,  real life examples, 5W’s, 4C’s Lab sessions run to enable the creation and development of wikis Lab sessions run to enable peer evaluation of articles followed by feedback
Development of ISEM Anecdotal feedback reveals improvement in quality of materials posted Used criteria specified in info evaluation sessions (5 W’s) to develop Information Source Evaluation Matrix (ISEM) Needed to test ISEM
Methodology Strand 2:  UG and PG Workshops Self-assessment of info evaluation skills (Likert Scale) “before and after” Presentation/ refresher of the “5 Ws” Intro to the ISEM Application of ISEM to subject specific material Revised self-assessment Comments on ISEM application
Workshop Results 1 UG and PG ISEM Feedback Use of the ISEM positively received by UGs and PGs All engaged with the matrix, its purpose and application Recognition of importance of relevance and reliability Some criteria valued more than others
Workshop results 2 Suggestions for  ISEM improvement All suggestions were positive Some suggested a variation in points allocation to reflect importance of individual criteria Use of colour coding Inclusion of space for annotations, especially useful for future comparison Inclusion of space for citation
Connections With existing work: Learner developed wiki of sources for module UCPD: Researching business information  Working with different communities Academics and students from Faculty of Technology Doing library stuff but not as “The Library”…student engagement Confirmations….smugness not allowed
Project Results… so far Project aim :  To develop an evaluative framework, publish on VLE for use when posting selected subject materials.  ISEM is offered as the pilot framework Self-assessment Likert Scale to be adjusted in the light of workshops Clear potential for developing information evaluation skills as matrix clearly raises awareness and forces application
Future Applications Develop online tools, make available via VLE Offer as a generic tool? Scope for future research: Application and implication of ISEM in different subject areas and at different levels May identify key criteria for specific subject areas

Student Content Evaluation UC & R April 2009

  • 1.
    Using online workshopsto enhance student content evaluation skills for VLE learning communities De Montfort University RITA project 2008 – 2009 Mike Leigh, Lucy Mathers & Kaye Towlson
  • 2.
    Session coverage BackgroundMethodology Results Connections Future Applications
  • 3.
    Background Cross faculty/departmentRITA bid Build on work of previous RITA funded project by Mike Leigh and Lucy Mathers revealed a significant gap between information evaluation skills acknowledged by students and those manifest in work. Wanted to develop an evaluative framework and publish on VLE for use when posting selected subject materials.
  • 4.
    Methodology: Strand 1Lectures and Labs Embedded in curriculum. 2 different modules Similar assessment task group or individual wiki Post material, mainly from the internet to aid understanding of a negotiated topic. Evaluate material posted. Group or peer evaluation of material article review
  • 5.
    Methodology Strand 1Lectures and Labs Session re: information evaluation “ Skill for life”, real life examples, 5W’s, 4C’s Lab sessions run to enable the creation and development of wikis Lab sessions run to enable peer evaluation of articles followed by feedback
  • 6.
    Development of ISEMAnecdotal feedback reveals improvement in quality of materials posted Used criteria specified in info evaluation sessions (5 W’s) to develop Information Source Evaluation Matrix (ISEM) Needed to test ISEM
  • 7.
    Methodology Strand 2: UG and PG Workshops Self-assessment of info evaluation skills (Likert Scale) “before and after” Presentation/ refresher of the “5 Ws” Intro to the ISEM Application of ISEM to subject specific material Revised self-assessment Comments on ISEM application
  • 8.
    Workshop Results 1UG and PG ISEM Feedback Use of the ISEM positively received by UGs and PGs All engaged with the matrix, its purpose and application Recognition of importance of relevance and reliability Some criteria valued more than others
  • 9.
    Workshop results 2Suggestions for ISEM improvement All suggestions were positive Some suggested a variation in points allocation to reflect importance of individual criteria Use of colour coding Inclusion of space for annotations, especially useful for future comparison Inclusion of space for citation
  • 10.
    Connections With existingwork: Learner developed wiki of sources for module UCPD: Researching business information Working with different communities Academics and students from Faculty of Technology Doing library stuff but not as “The Library”…student engagement Confirmations….smugness not allowed
  • 11.
    Project Results… sofar Project aim : To develop an evaluative framework, publish on VLE for use when posting selected subject materials. ISEM is offered as the pilot framework Self-assessment Likert Scale to be adjusted in the light of workshops Clear potential for developing information evaluation skills as matrix clearly raises awareness and forces application
  • 12.
    Future Applications Developonline tools, make available via VLE Offer as a generic tool? Scope for future research: Application and implication of ISEM in different subject areas and at different levels May identify key criteria for specific subject areas

Editor's Notes

  • #2 Good morning, I would like to tell you about the research informed teaching award work I have been engaged in with colleagues from the faculty of technology. The project has worked to develop online workshops……and I shall expand on that as we go along. Unfortunately, Lucy and Mike are unable to be with us today , so you will be getting a Librarian’s perspective on this. If you wonder about the image of the mortar board and scroll it is there to represent the graduate nature of the required content evaluation skills.