Demystifying research impact metrics and library support
•Download as PPTX, PDF•
1 like•807 views
This presentation to the Western Sydney School of Business was part of a research forum 'Demystifying Research Impact'. The aim was to look at research metrics - or academic contribution to the field (both via traditional citation counts and altmetrics), how to manage your academic researcher identity and show how the Library has the tools and expertise to assist.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Demystifying research impact metrics and library support
Similar to Demystifying research impact metrics and library support (20)
More from Western Sydney University
More from Western Sydney University (7)
Recently uploaded
Recently uploaded (20)
Demystifying research impact metrics and library support
- 2. DEMYSTIFYING RESEARCH IMPACT METRICS, IMPACT and LIBRARY SUPPORT Paul Jewell – Business Librarian
- 3. PAGE 3 Outline Metrics Altmetrics Identity Management Library Support Research Lifecycle Journal Finder Source: Wordle created at http://www.wordle.net/create
- 4. PAGE 4 Research Impact – New Era Research Research Impact Impact now refers to the outcomes of research. Metrics provide evidence to demonstrate a researcher’s academic contribution to their field. The Australian Research Council definition of Research Impact: Research impact is the demonstrable contribution that research makes to the economy, society, culture, national security, public policy or services, health, the environment, or quality of life, beyond academia. Image Source: Flickr - http://bit.ly/1iVnCUB (cc) Some rights reserved by Ewa Rozkosz
- 5. PAGE 5 Measuring Your Contribution to the Business Field Article Metrics Journal Metrics Author Metrics Other Image Source: photo by PJewell (author)
- 6. PAGE 6 Scopus Web of Science Google Scholar Book Reviews H-Index Citation and Author Metrics Image Source: Flickr - http://bit.ly/1NWhOoZ (CC) some rights reserved by Futureatlas.com
- 7. PAGE 7 Journal Citation Reports (JCR) ERA List Ulrichs Open Access downloads ABDC Journal Metrics Image Source: Flickr - http://bit.ly/1FCpuva (CC) some rights reserved by Ruth L
- 8. PAGE 8 Broadening Your Contribution to the Business Field Altmetrics Scopus Altmetrics Bookmarklet New Forms of Research Dissemination Slideshare Figshare Wordpress Twitter Some examples Image Source: Flickr - http://bit.ly/1jp3ZEl (cc) some rights reserved Stephen Poff
- 9. PAGE 9 Connecting with the Research Community Academia.edu ResearchGate Linkedin Mendeley ORCID Social Media blogging twitter Image Source: Flickr - http://bit.ly/1FuSh59 (cc) some rights reserved by Herbalizer
- 10. PAGE 10 Library Role Source: http://libraryconnect.elsevier.com/articles/2014-06/librarians-and-research-impact-download-and-share-new-infographic-0 School Librarian Library Research Team Metric Report Library Website
- 11. PAGE 11 Research Lifecycle Secure Funding – Research Metrics Service Publishing – Professional and Institutional benefits Image Source: http://researchdirect.westernsydney.edu.au/
- 12. PAGE 12 Research Metrics Service Promotion Grant Application Research Metric Report
- 14. PAGE 14 Open Access Why open access? How? Support? Image Source: http://library.westernsydney.edu.au/uws_library/researchers/open-access
- 15. 15 Education Librarian: Lily Collison l.collison@westernsydney.edu.au Computing, Engineering & Mathematics Librarian: Linda Thornely l.thornely@westernsydney.edu.au Nursing & Midwifery School Librarian: Melissa Burley melissa.burley@westernsydney.edu.au Business Librarian: Paul Jewell p.jewell@westernsydney.edu.au Humanities and Communications Librarian: Kaysha Russell k.j.russell@westernsydney.edu.au Law Librarian: David Sinfield D.Sinfield@westernstdney.edu.au Medical Librarian: Geoff Lattimore g.lattimore@westernsydney.edu.au Science and Health Librarian: Katrina Chaudhary k.chaudhary@westernsydney.edu.au Social Sciences & Psychology Librarian: Narelle Oliver n.oliver@westernsydney.edu.au Research Services Co-ordinator: Susan Robbins s.robbins@westernsydney.edu.au Your School Librarian
- 16. PAGE 16 Thankyou
Editor's Notes
- We will cover metrics, altmetrics…and tools used to measure these metrics. We will define: Metrics as the raw data used to measure research output Look at your personal academic brand and your PLN (Personal Learning Network) Library support via library webpage such as research lifecycle and journal finder
- Change in terms Western Sydney University is using new terminology around research impact to reflect changes in the national and international arena The focus now is not so much impact but academic contribution to the field What is research impact? What is research – new knowledge and new information How can it have an impact – by changing knowledge and by changing behaviour Changing Knowledge – a lot of research knowledge is contained/represented in academic publications influence research has on changing knowledge is ‘measured’ by examining how one publication has influenced/changed that papers that came after By citing others researchers give an indication of how much it has changed knowledge Measuring impact is tricky. It is an abstract concept and is like measuring ‘cool’. However stubbornly wants to answer the question. Outcomes are measurable in various ways which we will discuss. Often it is down to the impact stories and conversation afterwards. Metrics could include: Journal metrics (journal quality indicators such as the ABDL of journals, citation counts etc) Book metrics (citations, number of copies in libraries, book sales, book reviews etc) Researcher metrics (h-index, alternative metrics such as Twitter followers, media interviews etc) Altmetrics (articles downloads, twitter mentions, blog mentions etc) Impact may be aspirational or realised and could include: Changes to policy or practice Health benefits Etc
- The impact of researchers is measured to determine employment/promotion/funding suitability/collaboration potential. It is measured in three main ways: Assessing the publication source (e.g. journal or book) Assessing the research (e.g. citation analysis) Assessing the researcher Categories of metrics: 1 metrics focused on individual scholarly contribution – ie number of times article cited 2 metrics focused on the venues that produce scholarly contribution i.e journal 3 metrics focused on author output over time e.g. H-index 4 Metrics focused on institution reporting - HERDC
- Citation counts (Your cites per paper compared to field) are seen as the best approximation of academic standing in the field. We can count citations, book and article bibliographies – this is just information about citation patterns – however we need to tell stories around these metrics to see real impact. Counting jelly beans…and the number of times your beans (article) have been taken and used in another jar (Journal). Scopus and Google Scholar are two of the largest databases covering citation tracking. H-Index is a widely used indicator of research career performance, particularly in fields where journal publications are the accepted indicator of high impact. The higher the h-index the better but should be used in the context of your field. An h-index of 10 means 10 of your publications have been cited 10 times or more.
- What do we mean by journal metrics. When a journal has an impact factor of three what we mean is that in the last three years this journal averaged three citations per published article. Continuing metaphor – journal is the venue storing articles or beans – metrics is showing how many times in other jars. The research quality of journal articles may be measured in many ways including: Journal quality (Official Impact Factor / appearance on ERA list are two measures) Live demo in JCR… Coverage by abstracting services available from Ulrich's Periodicals Directory Live demo of Ulrichs… Citation analysis (number of citations and analysis of citing sources e.g. who is citing your work and where, cites per paper). Open access publishing provides new standards and levels of dissemmination. ABDC (Australian Business Deans Council) list is also another measure of journal quality.
- Researchers will need to move beyond the limits of citation-based impact indicators. The landscape of academic knowledge is rapidly changing – e.g. more interdisciplinary, more online, more pressure to do research. To meet changes in scholarly practice, audiences and scholarly environment we need to embrace a fuller spectrum of impact available to academics. For instance we can incorporate alternative web-based metrics into our scholarly practice and portfolios. Need to understand the value Altmetrics can have for mapping modern impact landscape. Means to collect metrics different from past and opportunity to understand in new context. Altmetrics can assist promotional discussions around academic connecting and collaborating with others. Also can look for influence outside of formal scholarly communities and assist with information overload. Live demo Scopus search and Altmetric indicator e.g. Suzan Burton new smoke spots article tweeted 18 times, show Tobacco Control article 2015, vol 24 issue 3. Live demo of Sheree Twitter account – conversation article – show twitter retweets and Linkedin shares.
- It’s important to manage your identity to ensure others have a complete picture of your research output and metrics. Creating and Maintaining an ORCID ID and a Google Scholar profile are good ways to achieve this. Get visible or vanish’ is as important as ‘publish or perish’. Academic Social Networking Sites such as ResearchGate and Linkedin are useful tools to increase visibility. ORCID – provides a persistent digital identifier that distinguishes you from other researchers. Your Business Librarian can assist with setting these up and maintaining.
- Library is well placed to assist as we work with the information based tools, provide research impact reports to assist with promotion and our research team work with admin for grant applications.
- Show research lifecycle Funding – Research Metrics Service Publishing – Publishing Strategic publishing of your research findings has professional and institutional implications: Professional Increases the visibility of your research and raises your research profile. Is a consideration when applying for grants, promotions or new positions. Is often a requirement or expectation of employment in an academic or research institution. Institutional Directly impacts government funding HERDC Directly impacts reputation Excellence for Research in Australia (ERA)
- Library can provide metrics reports for grant applications with 4 weeks notice. With the metrics reports explain how to cherry-pick the best information to create their narratives. Check out who has cited their work – better to say professor x the leading expert in the field has cited my work rather than I have 5 citations. Library can also assist with your narratives to focus on the right metrics and highlight best impact.
- Journal Finder is a new useful tool to assist with targeting where to publish. The portal brings together author metrics, journal citation tracking and other journal publishing links. Deciding where to publish in the first place is the first step towards a good track record. Ask the Business Librarian for a demonstration
- New Western Sydney Uni open access policy is now being consulted. Several studies have shown making your work openly available can increase citations. Any queries here to lib-research@uws.edu.au Show link to library website – research – open access http://library.westernsydney.edu.au/uws_library/researchers/open-access
- See your specialist Business Librarian or Research Services Co-ordinator.
- Support always available…