Practical Applications of Altmetrics

1. Practical Applications of Altmetrics

2. Practical Applications of Altmetrics Presentation prepared for the EUROPEAN SUMMER SCHOOL FOR SCIENTOMETRICS by Nicolás Robinson-Garcia doi:10.5281/zenodo.3355276 http://nrobinsongarcia.com @nrobinsongarcia 2 This work is licensed under a Creative Commons Attribution-ShareALike 4.0 International License

4. The promises of altmetrics ◉ Diversity Indicators and results ◉ Speed Immediate impact ◉ Openness Indicators and results ◉ Beyond scientific impact Societal impact Wouters & Costas, 2012 4 Escher, 1935

5. In the beginning all most studies on altmetrics were about… ◉ Data source analyses ◉ Description and definition of indicators ◉ Lots of promises… … and many correlations 5

6. … and now? 6 Conceptual limitations ◉ Attribution problem ◉ Passive approach Technical limitations ◉ Disparity ◉ Manipulation ◉ Volatility

7. Is it the end of altmetrics? the potential of social media data for impact assessment lies in that it may help understand the social interactions of researchers, both within and outside the scientific sphere Robinson-Garcia et al 2018 Many data and indicators […] that make up the altmetric universe are actually data about social media use, reception, and impact Wouters et al 2018 7

8. 8 New approaches New methods Reinterpreting results

9. Some considerations 9 01 0302 0 Data sources Indicators Design

10. Which data source? ◉ Wide and diverse range of indicators ◉ Each source offers its own set of indicators ◉ Each source shows different results based on the same indicators ◉ These differences are not errors but are derived from the data collection process 10

11. “ “Altmetrics is the study and use of scholarly impact measures based on activity in online tools and environments” Priem, Groth & Taraborelli, 2012 11

12. 12

13. 13

14. 14

15. Types of altmetric sources BY SOURCE ◉ Mendeley ◉ Twitter ◉ Facebook ◉ ResearchGate 15 ALL IN ONE ◉ Altmetric.com ◉ PlumX Analytics ◉ CrossRef EventData ◉ Lagotto

16. Types of altmetric sources BY SOURCE ◉ Mendeley ◉ Twitter ◉ Facebook ◉ ResearchGate 16 ALL IN ONE ◉ Altmetric.com ◉ PlumX Analytics ◉ CrossRef EventData ◉ Lagotto Springer Nature Elsevier Plos

17. Sources and indicators 17 Social networks • Twitter, Facebook, Google Plus… Tweets, retweets, likes, users Social tagging • Mendeley, Zotero, ReadCube… Bookmarks, collections, readers Scientific blogging • Publishers, institutional, personal… Mentions, comments, links Open content • PLOS journals, DataCite, Github… Downloads, comments, views

18. 18 ALTMETRIC.COM ◉ Public policy documents ◉ Blogs ◉ Mainstream media ◉ Citations (web of science / scopus) ◉ Online reference managers (mendeley) ◉ Research highlights (F1000) ◉ Peer review platforms (pubpeer, publons) ◉ Social Media (Facebook public pages, Twitter, Google+, LinkedIn, Sina, Weibo and Pinterest) ◉ Open Syllabus Project ◉ Multimedia and others (YouTube, Reddit )

19. 19 PLUMX

20. 20 LAGOTTO Viewed • PubMed Central Usage Stats • Copernicus Discussed • Facebook, Twitter • Blogs • Wikipedia • Reddit • OpenEdition Saved • CiteULike • Mendeley Cited • CrossRef, PubMed • Scopus • WoS • DataCite • Europe PMC Recommended • F1000 Prime Only PLOS • Usage • Figshare usage • Comments

21. 21 CROSS REF EVENT DATA

22. Differences on coverage 22 Zahedi & Costas, 2018

23. Differences on coverage ◉ Data collection. Use of different APIs when accessing primary sources. ◉ Aggregation and presentation. Different strategies to identify mentions and document versions (DOI, URL, PMID, etc.) ◉ Update. Different periodicity by source and platform 23 Zahedi & Costas, 2018

24. Tweeting different versions of the same paper 24

25. Unifying different versions of the same paper in Altmetric.com 25

26. Some considerations 26 02 0403 Indicators Design Implementation

27. Selecting indicators ◉ What is the goal of the analysis? ◉ Is the indicator a reasonable proxy of what we aim to analyse? ◉ Are our indicators reliable and consistent? ◉ Is our approach appropriate? 27

28. 28 Case I. Twitter as an indicator of consumption of scientific literature ◉ There is too much noise. No clear signal of scientific consumption ◉ Indicator and proxy are not aligned Robinson-Garcia et al., 2017

29. 29 Case II. Twitter as an indicator of social attention on scientific literature ◉ Indicator and proxy are aligned but for the wrong reasons Costas @ ESSS Granada 2016

30. 30 Case III. Syllabi mentions to analyse academic impact ◉ Indicator and proxy are aligned ◉ They capture the phenomenon under analysis ◉ But results are not consistent Torres-Salinas et al 2018

31. Some considerations 31 03 04 Design Implementation

32. 32 Monitoring ◉ Exploratory or descriptive ◉ We assume certain levels of uncertainty Assessment ◉ Intervention ◉ Altmetrics as complementary ◉ Starting point for qualitative analyses

33. What do we want to capture? 33 Academics SMEs, Non-profits, Hospital, Gov. Agencies, Associations, Large firms Society Altmetrics

34. 34 vsAltmetric approach Relational approach

35. Some considerations 35 04 Implementation

36. Applications of altmetrics 36 • Proactive attitude towards social context • Research linked to societal challenges Scientists’ social engagement • Social attention on scientific topics • Social controversies on scientific topics Socially relevant topics • Actors consumming scientific literature • Social perception of science Communities of attention

37. Altmetrics in practice Let’s check some examples… 37

38. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 38 http://profiles.impactstory.org/ Setting up your profile

39. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 39 http://knowmetrics.org/

40. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 40 D’Este et al 2018

41. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 41 Robinson-Garcia et al 2018

42. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 42 Robinson-Garcia et al 2017

43. Socially relevant topics ◉ Scientists ○ Selecting research lines ◉ Institutions ○ Identifying social interest on science ○ Understanding social reception ◉ Librarians ○ Collection development 43 Robinson-Garcia et al 2019

44. Socially relevant topics ◉ Scientists ○ Selecting research lines ◉ Institutions ○ Identifying social interest on science ○ Understanding social reception ◉ Librarians ○ Collection development 44 Robinson-Garcia 2017

45. Socially relevant topics ◉ Scientists ○ Selecting research lines ◉ Institutions ○ Identifying social interest on science ○ Understanding social reception ◉ Librarians ○ Collection development 45 Torres-Salinas et al 2017

46. Communities of attention ◉ Funding agencies ○ Identifying potentially interested non-academic stakeholders ◉ Librarians and journals ○ Users’ studies ◉ Scientists ○ Searching for collaboration opportunities ○ Social reception 46 Joubert & Costas 2019

47. Communities of attention ◉ Funding agencies ○ Identifying potentially interested non-academic stakeholders ◉ Librarians and journals ○ Users’ studies ◉ Scientists ○ Searching for collaboration opportunities ○ Social reception 47 Zahedi & van Eck, 2014

48. Communities of attention ◉ Funding agencies ○ Identifying potentially interested non-academic stakeholders ◉ Librarians and journals ○ Users’ studies ◉ Scientists ○ Searching for collaboration opportunities ○ Social reception 48 Diaz-Faes et al 2019

49. An example with the Altmetric Explorer Downloading altmetric data 49 Click here to watch the demo!

50. Practical applications of altmetrics Thanks! 50 Nicolas Robinson-Garcia You can find me at @nrobinsongarcia and http://nrobinsongarcia.com

Practical Applications of Altmetrics

You are reading a preview.

Check these out next

Practical Applications of Altmetrics

More Related Content

Slideshows for you (20)

Similar to Practical Applications of Altmetrics (20)

More from Nicolas Robinson-Garcia (20)

Recently uploaded (20)

Practical Applications of Altmetrics