Altmetrics, metrics, data visualization
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Altmetrics, metrics, data visualization

on

  • 449 views

Slides presented at IATUL2014 in Espoo, Finland, on 3rd June 2014. Because all text is in notes, a more readable version is here http://tuijasonkkila.fi/iatul2014.htm

Slides presented at IATUL2014 in Espoo, Finland, on 3rd June 2014. Because all text is in notes, a more readable version is here http://tuijasonkkila.fi/iatul2014.htm

Statistics

Views

Total Views
449
Views on SlideShare
446
Embed Views
3

Actions

Likes
2
Downloads
3
Comments
2

2 Embeds 3

http://www.slideee.com 2
https://twitter.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

CC Attribution-ShareAlike LicenseCC Attribution-ShareAlike License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • Thank you for taking the time to look into and comment my slide deck.
    Are you sure you want to
    Your message goes here
    Processing…
  • Altmetrics are a useful way to promote trivial research. They are a corrupting influence on science. All that's needed to get a high score is to write anything about diet and health, or to include 'penis' in the title. Altmetrics are a branch of PR, not of science. That's easy to see if you look at the contents of papers with high altmetric scores as at http://www.dcscience.net/?p=156 and http://www.dcscience.net/?p=6369
    The huge mistake made by all bibliometricians is that they fail to read the papers.
    '
    Bibliometrics are for people who aren’t prepared to take the time (or lack the mental capacity) to evaluate research by reading about it, or in the case of software or databases, by using them. The use of surrogate outcomes in clinical trials is rightly condemned. Bibliometrics are all about surrogate outcomes.'
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Good afternoon. <br /> <br /> In my presentation, I will look at altmetrics visualizations from three perspectives <br /> <br /> As Metrics <br /> As Discovery and <br /> As Communication <br />
  • In his course Data Literacy and Data Visualization, professor Braumoeller from the Ohio State University divides visualizations into four categories <br /> spatial (that is, related to space) <br /> time series <br /> relational, and <br /> graphical narratives <br /> <br /> Let’s have a look at the brief history of altmetrics. <br /> <br /> What types of visualizations can we find? <br /> <br />
  • ReaderMeter by Dario Taraborelli was the first example of a graphical narrative or infographic of author-level and article-level metrics. A scientific business card. <br /> <br /> ReaderMeter was a mashup built on readership data from the reference management and document sharing tool Mendeley. <br /> <br /> Today, ReaderMeter is no longer operable, although Taraborelli has said that he might open it up again. <br />
  • 2011, the UK-based Altmetric company introduced a donut-shaped badge . Today, it is a de-facto standard. An Executive Summary of altmetrics, concise and carefully branded. <br /> <br /> The badge is a combination of a relational graph and a graphical narrative. What the numerical value stands for, is not fully known, but in their own ranking, the bigger the better. <br /> <br /> A recent novelty from this year is a donut without a score, an enhancement that has been on the wish list of their clientele. <br /> <br /> <br />
  • You can add badges with JavaScript to almost any web page. All you need to know, is the ID of the scientific output, often a DOI. <br /> <br /> This example is from the WordPress blog platform with a special Altmetric plugin. The popup gives an overview of the underlying metrics.
  • Badges are available in two different shapes,: <br /> the donut and , <br /> as in this example of mine, a small rectangular box.
  • Clicking on the badge, we come to the landing page at Altmetric dot com. <br /> Here, we can continue looking at details of various sources. <br /> Among them is some spatial visualization, the map of tweeters. <br />
  • In November 2012, Public Library of Science and ImpactStory co-sponsored an Altmetrics Hackathon. <br /> <br /> In there, Juan Alperin and few other people, coded ALM Viz. <br /> <br /> This is a handy tool, when you need a concise, interactive time series of a PLOS article. There are both monthly and yearly timelines. <br /> <br /> Here we have a screenshot of HTML views of one particular article.
  • Around the same time, ImpactStory launched its open application programming interface. <br /> <br /> From the API, and with a special embedded JavaScript code, you could build your own altmetrics smorgasboard of ImpactStory badges. There is even some normalization in the form of percentiles. As a reference set, ImpactStory uses articles indexed by Web of Science on the same year. <br /> <br /> This example here is from my web application for the 18th Nordic Workshop on Bibliometrics and Research Policy in Stockholm. <br /> <br /> Visually, the ImpactStory badges are nicely designed to avoid the so-called chartjunk. With only two colors, blue and green, they deliver information both about the actors, and about the magnitude of interest. <br /> <br /> <br />
  • In May, Public Library of Science launched a special Metrics page to their articles. <br /> <br /> The page is a combination of different metrics, arranged around a skeleton of different categories of public attention: Viewed, Cited, Saved and Discussed. <br /> The only visual element on the Metrics page is a time series with a stacked barchart. It shows a monthly cumulative view statistics, drilling down the total scores presented on top of the page. <br /> <br /> Hovering above the chart brings up a tooltip that contains a table with detailed statistics in different formats. <br /> <br /> As a bonus, you can compare figures to a number of reference sets, visualized as a green line on the same chart. In other words, this is field-normalized metrics in action. <br /> <br /> We can argue if the barchart in its present form adds or blurs our understanding of the information. In this respect, the new PLoS ALM Reports is a step forward . <br /> <br />
  • <br /> Reports saw daylight in June. <br /> <br /> Now query results are visualized with bubble charts, treemaps and geo charts. Spatial, time series and relational visualizations , all on the same page. <br /> The underlying code comes from the Google Chart API. <br /> <br /> On this slide we have a bubble chart , showing the usage and citation status of articles published by authors from Aalto University . <br /> <br /> I would imagine that university repositories and CRIS platforms will offer this type of visualizations very soon, if not already. Ready-made software librries are a big time and money saver in visualization where there is no limit on how much you can spend on high-quality computer graphics.
  • In October, sociologist Deborah Lupton wrote in her blog that she had realized how the Quantified Self movement and academic life have much in common. <br /> <br /> She writes:”As part of configuring our metric assemblages, we are quantifying our professional selves.”
  • When you make a Google image search with ’quantified self visualization’ you will find numerous examples from this field. <br /> <br /> Here we have a timeline in the form of a spiral graph. <br /> <br /> This graph type is visually very near to the so-called sunburst or treepie graph.
  • Plum Analytics is the for-profit US altmetrics company , now part of EBSCO. <br /> <br /> In Febrary 2013, Plum Analytics had already introduced sunburts . <br /> <br /> The sample researcher profile comes from University of Pittsburgh. <br /> <br /> The company blog posting says:”With this visualization, the works that have less impact fade into the background, and the works that have the most engagement have a “larger slice of pie.” <br /> <br /> The amount of information and interactivity is impressive. <br /> <br /> However, it is not immediately clear to me, what do the different colours stand for, and whether there is any difference between the rings. <br /> <br /> <br />
  • In September, the Scholarly Kitchen blog made a notable contribution to the discussion on visualizing altmetrics. <br /> <br /> Instead of watching at fixed lists of scores, users need more freedom, was the message. <br /> <br /> As a good example of this approach, the Better Life Index by OECD was mentioned. <br /> <br /> In an interactive application, you can select and rank different variables with the help of a visual metaphor of a flower. The higher the flower, the better life is supposed to be in this country. The longer the flower petal, the better this dimension is compared to other countries. <br /> <br /> In Braumoeller’s categories, this is a prime example of a relational visualization . <br /> <br /> Applications of this magnitude are typically crafted by a professional data artist, or someone aiming to become one. <br /> <br />
  • Jeremy Boy is a French PhD student in graphical design. <br /> <br /> This interactive web application is part of his portfolio. Data is from OECD as well, this time visualized in small multiples with radar charts. You can <br /> <br /> drag a country to the big radar below, like under a magnifying glass <br /> Select one dimension of life out of 11 radar antennas <br /> and compare countries by putting them as transparent layers on top of each other <br /> <br /> Relational visualization is enhanced here by narrative elements. <br /> <br /> However, constellations are fixed, and all you can do is play with the visual elements. <br /> <br /> Still, I would imagine that there is a growing need for a solution like this, where you can compare the status of a number of objects along certain pre-defined metrics. Instead of countries, we would use research outputs or scientists. <br /> <br /> Of course, I am not alone with these thoughts. <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br />
  • Egon is a postdoc at Maastricht University, the Netherlands.
  • When and by whom did the research output got what attention? <br /> <br /> In his doctoral thesis on citing, Nelhans suggests case studies in scientific practice, something that is a healthy exercise in altmetrics, too. At this conference, we have had the opportunity to hear findings from some of them. <br /> <br /> With directed network graphs by HistCite, so-called historiographs, Nelhans shows how different citation patterns form a citation topology. <br /> <br /> Here, networks are read as top-down charts of ancestors. The horizontal dimension is not used. <br /> <br /> With altmetrics data, we could mimick these networks by applying the horizontal axis, say, for swimlines that represent different types of sources. <br />
  • The open API of ImpactStory was closed early this year. <br /> <br /> Now, their badges are available only within the context of ImpactStory web profiles. <br /> <br /> Here, the narrative aspect is even more prominent. <br /> <br /> Outputs are grouped in different categories very much like document chapters, with badges acting as punctuation or comments. <br /> <br /> There is also a small timeline: new activity in the last 7 days, is marked as flags at the end of the respective badge. <br />
  • Although the focus of the ImpactStory profile is in humans, one can assign a profile to other entities as well, such as projects. <br /> <br />
  • Moritz Stefaner is one of the leading data artists in Europe. <br /> <br /> In his keynote at the European Communication Summit last year, he reminded us about the time of the first space travels. <br /> <br /> Expectations ran high to see the Moon from close. But what happened was that our eyes were turned to the Earth. For the first time, we were able to see our planet from above as a coherent organism. <br /> <br /> Perhaps altmetrics will become an eye-opener too. To quote Kraker: <br /> Similarly to citations, altmetrics can create pathways through science. After all, a citation is nothing else but a link to another paper. <br /> <br />
  • As part of of his doctoral thesis, Kraker published an application for visualizing scientific domains. <br /> <br /> Demonstration data consist of articles from Mendeley. <br /> <br /> Kraker’s hypothesis is that the more often two papers are read together, the closer they are subject-wise.
  • A physical metaphor can be useful. <br /> <br /> Stefaner explains how he applied it while building an interactive web application of risk assessment for World Economic Forum. <br /> <br /> Positioned on same-centric circles around the risk we like to examine, the closer the circle, the closer related it is to the one in the middle. <br />
  • From the perspective of user interface design, when uncertainty is a virtue rather than a problem, we need solutions that favour exploring. <br /> <br /> One example is the search intent prototype made in the Finnish project Revolution of Knowledge Work. <br /> <br /> Here, the radar-shaped universe of evolving search results is related to the same visual thinking as in the works by Kraker and Stefaner above. <br />
  • This is a screenshot from PivotPaths, a demo application by Marian Dörk, built to allow casual exploration on an information space, typically a database. <br /> <br /> The layout is three-banded. The resources, articles here, are the green ones in the middle. <br /> <br /> On top, persons, - here, authors - , and at the bottom, facets. Keywords, in this case. <br /> <br /> On far left, is the present anchor, in my example the keyword ’human brain’. So, this is a selection of articles containing that keyword. <br /> <br /> Here, I am hovering above one particular author which reveals all articles he is a coauthor in, within this ”brain” context, and their respective keywords. <br />
  • If I click the name of the author, it replaces the ’human brain’ keyword on the left, becomes the new anchor, and all related data is now pivoted around this author. <br /> <br /> So now the layout shows all articles of this author in the database. <br /> <br /> As Dörk has pointed out, the app has a number of caveats. For example, there is only so much space on the browser canvas. The article base can easily grow too big, and the number of coauthors as well. <br /> <br /> Still, a nice demo, and something to think about when choosing a tool for visualizing, say, a subset of local artefacts and their citations or other metrics.
  • However, the user interface of information retrieval is not a completely new research topic. <br /> <br /> Ever since the birth of the modern personal computer, we have tried to solve that problem. <br /> <br /> Max Kemman is a junior researcher at Erasmus University Rotterdam, specialised in scholarly use of digital research tools.
  • These are interesting times. <br /> <br /> After all these years of written culture, we are back in learning how to communicate with pictures, and it is hard. <br /> <br /> Miikka Lehtonen, who recently defended his doctoral thesis at Aalto University with the name ”Visual knowing and visualizing knowledge in knowledge-intensive organizations”, goes as far as claiming that academia suffers from text fetisism. <br /> <br /> Metrics, on the other hand, is a world dominated by numbers. <br /> <br /> How to communicate altmetrics? <br />
  • At OpenVis 2013, Mike Bostock , father of one of the most influential web graphic library of recent times, D3, talked about the difficulty of his field. Interestingly, he referred to it as a search problem, which he explained as follows: <br /> <br /> ”We have these principles of design and they are necessary to guide us but they are also not sufficient, they don’t dictate what a successful design would be. They are not blueprints. There are ultimately too many unkowns for the principles to be sufficient to tell us exactly what we need to do. <br /> <br /> So what we need in a successful design process is to be able to explore as many of these possibilities as efficiently as possible so that in whatever time that we have, because we are always facing particular deadlines, we need to be able to spend a lot of time exploring things that are not going to work in order to find things that do work.” <br /> <br /> <br />
  • Altmetrics is only a couple of years old. We need more time to find things that work. <br /> <br /> From today’s perspective, it seems to me that Braumoeller’s last category, graphical narratives or storytelling, will be the next big thing. <br /> <br /> And who knows, maybe stories might work. After all, there are people behind the numbers. <br />
  • Sarah Slobin is a senior graphics editor at The Wall Street Journal. <br /> <br /> Here she warns us about the hype and our blind spots when we work with person-related data and with fancy technical tools. <br /> <br /> So how would narrative stories look like? <br />
  • Limn is a new kind of storytelling journal. As the editorial board describes, <br /> <br /> “Limn is somewhere between a scholarly journal and an art magazine. It is an attempt to communicate and display ongoing scholarly research.” <br /> <br /> Articles in thematic issues are juxtaposed so that the reader can quickly get an overview of the whole spectrum. <br /> <br /> I’ll conclude with a question: who will be telling illustrated altmetric stories about researchers ? <br /> <br /> <br /> <br />
  • Some of us perhaps?
  • Future scientists themselves?
  • or maybe an algorithm?
  • Thank you for listening!

Altmetrics, metrics, data visualization Presentation Transcript

  • 1. Metrics, altmetrics, data visualization Tuija Sonkkila, Aalto University Library
  • 2. Metrics Discovery Communication
  • 3. 2010 2011 2012 2013 2014 ____|_____|______|______|_____|____
  • 4. https://www.flickr.com/photos/mendeley/7839392988/
  • 5. 2010 2011 2012 2013 2014 ____|_____|______|______|_____|____
  • 6. http://www.altmetric.com/details.php?citation_id=170171
  • 7. Blog posting not published
  • 8. http://m.lib.aalto.fi/dev/d3/plosandbadge.html
  • 9. http://www.altmetric.com/details.php?citation_id=170171
  • 10. 2010 2011 2012 2013 2014 ____|_____|______|______|_____|____
  • 11. http://jalperin.github.io/almviz/
  • 12. http://spark.rstudio.com/ttso/altm/ Screenshot of legacy version
  • 13. 2010 2011 2012 2013 2014 ____|_____|______|______|_____|____
  • 14. http://www.plosone.org/article/metrics/info%3Adoi%2F10.1371%2Fjournal.pone.0064489
  • 15. PLOS ALM Reports * Tooltip added to this presentation Aalto University on PLOS *
  • 16. http://simplysociology.wordpress.com/2013/10/14/the-academic-quantified-self/
  • 17. http://oaklab.org/qs-spiral-visualizing-periodic-quantified-self-data/
  • 18. https://plu.mx/u/lcollister?artifact_display=SUNBURST
  • 19. http://www.oecd.org/statistics/datalab/bli.htm
  • 20. http://peopleviz.gforge.inria.fr/trunk/oecd_BLI_radar_chart/
  • 21. https://twitter.com/egonwillighagen/status/468994787186843648
  • 22. Nelhans (2013) p. 185 http://gup.ub.gu.se/publication/184221
  • 23. 2010 2011 2012 2013 2014 ____|_____|______|______|_____|____
  • 24. https://impactstory.org/CarlBoettiger
  • 25. https://impactstory.org
  • 26. https://impactstory.org/iSEEM2 http://iseem2.wordpress.com/
  • 27. Metrics Discovery Communication
  • 28. Photo: NASA
  • 29. http://labs.mendeley.com/headstart/
  • 30. http://moritz.stefaner.eu/projects/world-economic-forum/
  • 31. http://research.ics.aalto.fi/mi/online-papers/Ruotsalo13cikm.pdf
  • 32. http://mariandoerk.de/pivotpaths/demo/
  • 33. http://mariandoerk.de/pivotpaths/demo/
  • 34. Metrics Discovery Communication
  • 35. Lascaux II Wikimedia Commons
  • 36. YouTube
  • 37. Storytelling
  • 38. https://source.opennews.org/en-US/learning/what-if-data-visualization-actually-people/ Sarah Slobin
  • 39. www.limn.it
  • 40. https://www.flickr.com/photos/30976576@N07/6035931517
  • 41. https://www.flickr.com/photos/kcolwell/2854702332
  • 42. Slate.com
  • 43. Slate.com Thank you for listening! Links: https://www.diigo.com/user/sonkkilat/iatul2014