Supporting Bibliometrics


Published on

Supporting Bibliometrics by Jenny Delasalle, Academic Support Manager (Research), University of Warwick. Presentation at the Research Evaluation: Is It Our Business? The Role of Librarians in the Brave New World of Research Evaluation 29 June 2011, University of Birmingham, Edgbaston Campus.

Published in: Education, Technology
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • I am a Librarian! Former repository manager and former Project officer and former Assistant Subject Librarian. Also a secondment to our Careers service.
  • Beyond our expertise?: standing in the field, relevance to the article, publication lead times, rejection rates, etc
  • Elsevier SciVal or TR InCites can make this much quicker/easier to do.
  • Scimago publishes an h-index for a journal. Easier to generate a report on WoK, Scopus or Publish or Perish and have this analysis done for you!
  • Example: better to have one article cited a hundred times or ten articles each cited ten times?
  • What your peers are doing: do you want to do the same?“We investigated the kinds of outputs being produced by activeresearchers through a bibliometric analysis of the outputsproduced in 2003 and 2008 by a sample of authors who wereincluded in the last two RAEs. A key point to be stressed is howmany of these researchers, across all disciplines, did not produceany publications at all in those two years. Despite intensivesearches across a wide range of sources, bibliographic databasesand websites, we could find no traceable outputs for 52% of oursample in 2003, and for 45% in 2008. Somewhat surprisingly,the proportions of non-publishers were as high in the life sciencesand physical sciences as in the humanities and social sciences.”Also: (LISU slides) report a slight increase in the no. of publications per author in 2008 compared to 2003, but a significant increase in no. of multiple-author works. These are multi-institutional and international. No apparent difference in citation behaviours.
  • NB Collaborative publication practices: great variety in acknowledgement through order of names: might be greatest contribution 1st or alphabetical or most senior grant holder last. Leads to problems when crossing disciplines?
  • Supporting Bibliometrics

    1. 1. JIBS - “Research evaluation - is it our business? Librarians' roles in the brave new world of research evaluation” Supporting BibliometricsJenny DelasalleAcademic Support Manager (Research)<br />
    2. 2. I will cover…<br />Some background information about University of Warwick and about me.<br />Bibliometrics in use: how they can be relevant to researchers<br />Understanding bibliometrics: stuff I tell researchers!<br />
    3. 3. About me & my role at Warwick<br />Academic Support Librarian (Research)<br />Head of<br />Academic Services <br />Research Exchange Advisers, Co-ordinator, Assistant., Ambassadors<br />
    4. 4.
    5. 5. What the Library offers to Researchers<br />Subject expert ASLs who liaise with departments about their needs & deliver information skills training, enquiries support, etc<br />Specialist collections, including MRC (Archive)<br />Information Management strand on the Research Student Skills Programme<br />One-off, tailored workshops and presentations.<br />WRAP repository & NEW Publications Service<br />Expertise on advanced information skills… including bibliometrics, copyright, publishing, Web 2.0<br />The Wolfson Research Exchange<br />
    6. 6. Liaison with ….<br />IT Services<br />Student Careers and Skills - for training students (including PhD students)<br />Graduate School – administration of post-graduate students (including PhD students)<br />Institute for Advanced Studies – early career fellowships<br />Learning and Development Centre - part of HR, for training staff.<br />Research Support Services – help with grant applications but also managing fincances throughout project<br />Management & Planning office – handle REF return but also provide HoDs with information.<br />Communications Office – promoting Warwick research<br />Legal Compliance – guidance on copyright, data protection, etc<br />
    7. 7. Routes to reach researchers at Warwick<br />RSF – Research Staff Forum<br />Research Committee<br />Faculty Research Forum (chairs)<br />(Heads of) Research Centres/ Institutes <br />(Heads of) Doctoral training centres<br />Directors of Graduate studies <br />PhD supervisers’ training<br />Direct e-mail (list from HR)<br />Via ASLs, Graduate SSLCs and Library reps<br />Communications Office newsletter every week & monthly magazine & the Uni Intranet<br />LDC newsletter<br />WRAP newsletter<br />Library website, Research Exchange website, blogs, Facebook<br />
    8. 8. An interest in bibliometrics!<br />Journals to keep/withdraw<br />Repository management: advocacy messages that OA publishing boosts citations.<br />Does repository deposit make a difference to citations?<br />Will the REF include citation measurements?<br />Web of Knowledge training free, through Mimas<br />JiscmailLis-bibliometrics list.<br />
    9. 9. Our Approach to bibliometrics<br />Understanding of bibliometrics is a key information skill<br />Best not to refer to the term “bibliometrics” itself?<br />Cover elements of these in other workshops:<br />“Getting Published”<br />“Literature Searching”<br />Use the controversy around publication “strategy” to engage audience: workshop at a doctoral centre.<br />Publicise our expertise: amongst researchers and University management.<br />Online material to complement our offer. <br />REx website: Researcher to Researcher approach<br />
    10. 10.
    11. 11.
    12. 12.
    13. 13.
    14. 14. Bibliometrics in use<br />Considering where to publish.<br />What do we do about the REF?<br />Benchmarking a department.<br />Evidence for a job application/grant application/salary review, etc<br />Measurements in University rankings.<br />
    15. 15. Appraising journals when considering publication<br />Librarians: <br />Know the data sources (WoK Ifs, SciMago SJR, RePec, Anne-WilHarzing’s website)<br />Know about Open Access<br />Know where journals are indexed & which indexes are important to a discipline<br />Other than impact factors, we have knowledge of:<br />Features of journals such as letter, blogs, reviews, etc<br />Copyright agreements<br />Publicising your work using Web 2.0<br />Other publication channels than journals: how to measure them!<br />Cross-disciplinary perspective.<br />
    16. 16. Impact Factors : JCR and SciMago<br />
    17. 17. What can we say about REF 2014 and bibliometrics?<br />Not much – yet!<br />Watch for announcements this summer.<br />Work with department which gathers our return.<br />Ensure that publications data is properly recorded.<br />Medicine, Science and Engineering most likely candidates.<br />
    18. 18. Benchmarking a department<br />No. of papers published by a department in a given period, for example:<br />Source:<br />NB how do you define which papers to be included for each set?<br />No. of citations: total or per paper?<br />
    19. 19. Evidence about an individual – h-index<br />h-index of 4 means there are 4 published papers each with at least 4 citations<br />OR: Professor X has a total of 10 publications<br /> <br />Publication 1 20 cites<br />Publication 2 18 cites<br />Publication 3 11 cites<br />Publication 4 7 cites<br />----------------------------------------------------------- h-index: 4<br />Publication 5 4 cites<br />Publication 6 3 cites<br />Publications 7,8,9,10 0 cites<br />
    20. 20. Evidence about an individual (2)<br />Egghe's g-index – aims to improve on the H-index by giving more weight to highly-cited articles.<br /> <br />Contemporary h-index - aims to improve on the H-index by giving more weight to recent articles and therefore rewards academics who maintain a steady level of activity.<br />Be wary of others’ declared h-index scores: which data sets are they based on? <br />Context is everything!<br />
    21. 21. Measurement in University Rankings<br />Which ones matter to your University?<br />Academic Ranking of World Universities (ARWU) - also known as ‘The Shanghai Rankings’ <br />Times Higher Education (THE) World University Rankings <br />The QS World University Rankings <br />Webometrics Ranking of World Universities <br />A good ranking… <br />helps universities attract the most talented researchers.<br />university can set higher fees and attract more funding for research.<br />BUT how they are calculated might not mean that a high h-index is the thing to ask of your researchers…<br />!<br />
    22. 22. Understanding Bibliometrics<br />Not one “bibliometric” measure but many: <br />Paper counts<br />journal impact factors <br />The h-index<br />citation scores at article level <br />visitor numbers (or other info) for online articles <br />Motivations for publication.<br />Motivations for citation.<br />Effects of collaboration? Discipline? <br />Differences in data sources: their coverage/collection, the measures they publish and the graphs/analysis they offer. <br />
    23. 23. RAE: what was submitted?<br />All institutions 2008 RAE journal articles: 167,831<br />All institutions 2008 RAE all types: 222,177<br /><br />
    24. 24. RIN (September 2009). Communicating knowledge: How and why UK researchers publish and disseminate their findings, Research Information Network; JISC.<br />
    25. 25. Collaboration effects<br />Other researchers – own discipline, or other disciplines? <br />Peer review practices vary: in the Arts can take upwards of 6 months.<br />With industry – publication good for them?<br />Agreement on what to publish & where<br />Acknowledging contributions: variety of practice<br />Negotiation skills!<br />
    26. 26. Some motivations for citations<br />Paying homage to experts<br />Especially those likely to be peer reviewers!<br />Credit to peers whose work you have built upon<br />Lend weight to own claims<br />Provide background reading<br />Criticising/correcting previous work<br />Sign-posting under-noticed work <br />(own paper which would affect your h-index!)<br />Self citations!<br />
    27. 27. Citation patterns<br />Most publications have little or no citations.<br />Variety across the disciplines.<br />Therefore comparisons within a discipline are most useful.<br />Percentages against a world average within each discipline are more useful than basic numbers.<br />
    28. 28. Sceptical and informed!<br />