Presenting the background and plan for the research project titled "Measuring the societal impact of open science". Financed by the Ministry of Education and Culture in Finland (2015-2016). #altmetrics #impact #research #project #OpenScience

1. Kim Holmberg
Research Unit for the Sociology of Education
University of Turku
(e) kim.j.holmberg@utu.fi
(w3) http://kimholmberg.fi
@kholmber

2. 0
1000
2000
3000
4000
5000
6000
7000
8000
9000
201420132012201120102009200820072006200520042003200220012000199919981997199619951994
The increase of publications about bibliometrics as indexed by Web of Science
between 1994 and 2014 (data retrieved from Web of Science on 9 February, 2015).
Bibliometrics
“the study of quantitative aspects
of the production, dissemination,
and use of recorded information”
(Tague-Sufcliffe, 1992)

3. Problems with
citation-based indicators

4. Problem 1:
Time

5. 0 2 4 6 8 10 12 14 16 18 20
Time after publication (Years)
Citations
Time of research assessment
Option 1: Journal impact factor, Julkaisufoorumi, …
Potential
future
impact

6. 0 2 4 6 8 10 12 14 16 18 20
Time after publication (Years)
Citations
Time of research assessment
Option 2: Citations (after n years)
Past
success and
impact

7. 0 2 4 6 8 10 12 14 16 18 20
Time after publication (Years)
Citations How can we measure
impact in realtime?

8. Problem 2:
Journals

10. Fenner, M. & Lin, J. (2013). Altmetrics in Evolution: Defining & Redefining the Ontology of Article-Level Metrics.
http://dx.doi.org/10.3789/isqv25no2.2013.04

20. Problem 3:
Impact

21. Science
IMPACT ON:

22. Science
Society
Environment
Culture
Economy
Education
IMPACT ON:

23. Altmetrics
the study and use of scholarly impact
measures based on activity in online
tools and environments
Priem, J. (2014). Altmetrics. In Cronin, B. & Sugimoto, C.R.
(Eds.). Beyond Bibliometrics: Harnessing Multidimensional
Indicators of Scholarly Impact. MIT Press, 2014.

25. Created by
researchers
Created by
the public
Altmetrics

26. Altmetrics
Provide a more nuanced
image of the total impact
that research has made?

27. Altmetrics and
open science?

28. Research project:
Measuring the societal impact of open science
Project is financed by the Ministry of Education and
Culture in Finland (2015-2016).

29. Goals of the research project:
1) Investigate altmetrics (at country-level, i.e.
Finland) and create a prototype to demonstrate
them
2) Develop methods to map societal impact of
research (and to analyze the stories behind the
altmetrics)

30. Kim Holmberg
kim.j.holmberg@utu.fi
http://kimholmberg.fi
@kholmber
Thank you