EASTER: Evaluating Subject Tools
    for Enhancing Retrieval
                         Michael Day
            Research and...
Presentation outline
• Project aims and objectives
• Value and impact




 www.ukoln.ac.uk
 A centre of expertise in digit...
Project aims and objectives (1)
• Problems that the project is trying to explore:
    – The testing and evaluation of exis...
Project aims and objectives (2)
• Why is EASTER important?
   – Manual generation of subject metadata and application of
 ...
Project aims and objectives (3)
• What is the envisaged final project output?
    – Indexing perspectives:
        • A fra...
Potential value and impact
• Exploring the value of subject metadata and
  controlled vocabularies for digital collection
...
Upcoming SlideShare
Loading in …5
×

EASTER project

1,380 views

Published on

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,380
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

EASTER project

  1. 1. EASTER: Evaluating Subject Tools for Enhancing Retrieval Michael Day Research and Development Team Leader UKOLN, University of Bath Automatic Metadata Generation and Text Mining Projects Meeting, London, 25 May 2010 UKOLN is supported by: www.ukoln.ac.uk A centre of expertise in digital information management
  2. 2. Presentation outline • Project aims and objectives • Value and impact www.ukoln.ac.uk A centre of expertise in digital information management
  3. 3. Project aims and objectives (1) • Problems that the project is trying to explore: – The testing and evaluation of existing automated subject metadata generation tools • Creating subject metadata using controlled terms from vocabularies • The enrichment of metadata records – The potential implementation of these tools in metadata creation workflows (e.g. Intute) – How enhanced metadata influences quality of retrieval – Evaluation methodologies – the lack of consistent approach means that it is difficult to compare tools www.ukoln.ac.uk A centre of expertise in digital information management
  4. 4. Project aims and objectives (2) • Why is EASTER important? – Manual generation of subject metadata and application of controlled vocabularies is time-consuming and expensive – Many tools available – need for evaluation methodologies (e.g., quality of retrieval, indexing quality) • To whom is EASTER important? – Digital collection providers - many potential application domains for the automatic generation of subject metadata – Those implementing tools or developing new ones (evaluation methodologies) www.ukoln.ac.uk A centre of expertise in digital information management
  5. 5. Project aims and objectives (3) • What is the envisaged final project output? – Indexing perspectives: • A framework for the evaluation of automated subject indexing tools (report) – Based on comparison of indexing quality with manually created ‘gold standard’ metadata (ground-truth)- reviewing things like exhaustivity, correctness and consistency – Evaluation report on tools • Workflow integration (demonstrator) – User perspectives: • End-user retrieval testing (report) www.ukoln.ac.uk A centre of expertise in digital information management
  6. 6. Potential value and impact • Exploring the value of subject metadata and controlled vocabularies for digital collection providers: – Use of tools in metadata generation workflows – Faster / higher-quality subject metadata generation • Enhanced support for retrieval: – Metadata consistency, contextualisation of subject terms • Number of potential application areas: – Repositories, OER, large-scale digitisation programmes, etc. • Evaluation methodologies for tools www.ukoln.ac.uk A centre of expertise in digital information management

×