Your SlideShare is downloading. ×
Mining Research Publication Networks for Impact
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Mining Research Publication Networks for Impact

249
views

Published on

Published in: Technology, Education

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
249
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Needed to: - Make sense of the available literature - Recognise the key important researchHow do you filter what you read?How do you filter the best material for your interests?
  • Not possible to use across disciplines
  • Fulltextdrivnebyl availableIs it possible to evaluate research based on what people say about it?
  • Transcript

    • 1. Mining ResearchPublication Networks forImpactDrahomira HerrmannovaKnowledge Media InstituteSupervisors: Dr Zdenek ZdrahalMr Petr Knoth04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk1
    • 2. The Title• Mining Research Publication Networks for Impact04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk2
    • 3. Background• How to evaluate quality of research?• It is highly relevant to• Researchers – what to read, career progression• Librarians – subscriptions• Universities and other institutions – grants, promotions,…• Publishers – promoting their journals04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk3
    • 4. Background• At what granularity do you want to evaluate thequality of research?• Papers• Journals• Researchers• Research groups / institutions• Metrics created for evaluating at one level ofgranularity are often used for evaluating otherlevels04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk4
    • 5. Current situation• Many current widely used measures depend oncitation analysis• Well known examples• Journal Impact Factor (journals)• Citation counts (individuals, papers)• H-Index (individuals)• Advantages• Simple and clear metrics• Well available04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk5
    • 6. Current situation04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk6
    • 7. Concerns• Not an accurate evidence of quality of a paper• Traditional methods often ignore• Reasons for citation• Co-authorship• Self-citation• Article type• Citation half-life• …04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk7
    • 8. Concerns• Many papers are never cited at all (Garfield, 2005)• “Citation half-life”• Can be up to several years long (Arnold, 2010)• “When metric becomes a target, it ceases to be agood metric” (Arnold, 2010)• Citation-based metrics are easily manipulated• Relationship between the paper and relatedliterature rests on the author04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk8
    • 9. Available data• Many possible types of data that can be used toevaluate research output• Citations• Usage• Blog coverage• Discussion threads• Social bookmarking• …04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk9• Fulltext of publication• Expert reviewIs it possible to evaluateresearch based just on whatpeople say about it?
    • 10. Methods• Metrics based on web data (altmetrics,webometrics)• File accesses and downloads• Mentions, comments and annotations• Citations and bookmarks• …• Methods based on analysing fulltext of papers• Semantic relatedness of papers• Context of citation04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk10
    • 11. Methods• Methods based on citations• Citation graph• Co-authorship network of researchers• Other methods• Using patent information• …04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk11
    • 12. Methods• Despite the number of possibilities still nostandard solution that would help up to addressthe issues• Bridge the time gap between publishing a paper andreceiving first citations• Explain the reason and meaning of quality of a paper• …04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk12
    • 13. Project topic• Design new methods for improving evaluation ofquality of research which will address thementioned challenges04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk13
    • 14. Questions and goals• Evaluate how the impact measures based oncitations represent the quality of a paper• Analyse which other factors, in addition tocitations, affect the quality of a publication04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk14
    • 15. Questions and goals• Design new methods for improving evaluation ofquality of research which will address thementioned challenges using• Fulltext of publications• Citation graph• Networks of researchers• Patent information• …04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk15
    • 16. Questions and goals• Analyse how these new methods can be used in other disciplines suchas• information retrieval• exploratory search• digital libraries• …• How they can be used to investigate trends in the development ofscientific disciplines• How they can be used by each group of people• Researchers• Librarians• Universities• …04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk16
    • 17. References• Douglas N Arnold and Kristine K Fowler. Nefariousnumbers. Notices of the American MathematicalSociety, 58(3):434-437, 2010.• Eugene Garfield. The agony and the ecstasy thehistory and meaning of the journal impact factor.pages 1-22, 2005.04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk17
    • 18. Questions04/06/2013 Drahomira Herrmannova d.herrmannova@open.ac.uk18