Evaluation in OpenAIRE
OpenAIRE - factsheet
Open Access Infrastructure for Research in
Europe
Programme: FP7 – Research Infrastructures
Starting ...
FP7 OA Pilot
The European Commission launched the open
access pilot in August 2008 in seven thematic
research areas and it...
ERC OA guidelines
The ERC Scientific Council's Statement on Open Access of December
2006 stressed the fundamental importan...
European Helpdesk
Promote FP7-pilot and ERC OA guidelines
National Open Access Desks (27 countries)
Provide OA “toolkits” ...
Reaching out to EC members
Region 1 North
(DTU)
Denmark
(Technical
University of
Denmark)
Denmark
(Technical
University of...
OpenAIRE infrastrucure basics
Builds on European OA Repository infrastructure
Researchers deposit once
– Harvest from Open...
OpenAIRE in a nutshell
OpenAIRE overall
overview:
functionalities
and domains
served
OpenAIRE overall
overview:
functional...
CERIF Data Model
9
OpenAIREDataModel
10
OpenAIRE Controlled Vocs
11
NationalitiesAuthors
Countries
Organization
s
LicenseKindsArticles
Languages
DataSource
Typolo...
OpenAIRE Guidelines
DC DRIVER guidelines +:
projectID – dc:relation
accessRights – dc:rights
embargoEndDate – dc:date
12
Measuring success of OA in FP7
Document statistics for OA deposition
– % rate of OA deposition
Usage statistics on FP7 OA ...
Funders requirements (EC)
Open Access evaluation: the following stats will be broken down by research
area, programme, ERC...
Usage statistics
15 Davichi / David Oliva, http://creativecommons.org/licenses/by/2.0/
Strategy for recording usage
Based PRIUS model slightly adapted to
OpenAIRE
Basically the normalization will be
done centr...
Usage statistics service for FP7
publications
17
Usage statistics service
components
Harvester/aggregator from OpenAIRE compliant
repositories
Service for processing usage...
OpenAIRE compliant repositories
Definition of OpenAIRE compliant repositories
– OpenAIRE guidelines for usage statistics
A...
OpenAIRE partners expertise
UNIBI, UGOE, SURF
– National initiatives – OA-stat
– PEER project
– Knowledge Exchange
Univ. o...
Services to repository managers
& funders
21
Web graphical tool
Statistics provided by publication
22
Web graphical tool
Statistics provided by publication
23
Other article level stats
Citations
Web usage
Expert ratings
Social bookmarking
Community rating
Media/blog coverage
Comme...
Thank you
25 http://creativecommons.org/licenses/by/2.0/ by ky_olsen
Open Issues
Unique/persistent identifiers of publications
– Publications on different repositories
– Capture different ver...
OpenAIRE workplan & timeline
May-July, 2010
– OpenAIRE internal specifications for usage
data and transfer specs
November,...
Upcoming SlideShare
Loading in …5
×

OpenAIRE presentation at EuroCRIS Seminar "Evaluation of Research using a CRIS"

327 views
216 views

Published on

Presentated by Mikael K. Elbæk at the euroCRIS seminar "Evaluation of Research using a CRIS" 13 September 2010.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
327
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

OpenAIRE presentation at EuroCRIS Seminar "Evaluation of Research using a CRIS"

  1. 1. Evaluation in OpenAIRE
  2. 2. OpenAIRE - factsheet Open Access Infrastructure for Research in Europe Programme: FP7 – Research Infrastructures Starting date: December 1, 2009 Duration: 36 months Budget: 4.1 Million 38 partners covering all European member- states – To be reached at www.openaire.eu 2
  3. 3. FP7 OA Pilot The European Commission launched the open access pilot in August 2008 in seven thematic research areas and it will run until the end of FP7: – Energy – Environment (including Climate Change) – Health – Information and Communication Technologies (Cognitive Systems, Interaction, Robotics) – Research Infrastructures (e-infrastructures) – Science in society – Socio-economic sciences and the humanities Special clause 39 : “In addition to Article II.30.4, beneficiaries shall deposit an electronic copy of the published version or the final manuscript accepted for publication of a scientific publication relating to foreground published before or after the final report in an institutional or subject-based repository at the moment of publication.“ 3
  4. 4. ERC OA guidelines The ERC Scientific Council's Statement on Open Access of December 2006 stressed the fundamental importance of peer-review in ensuring the certification and dissemination of high-quality scientific research, as well as the importance of wide access and efficient dissemination of research results. In December 2007, the ERC Scientific Council followed this up with Guidelines for Open Access. These Guidelines state that: – The ERC requires that all peer-reviewed publications from ERC- funded research projects be deposited on publication into an appropriate research repository where available, such as PubMed Central, ArXiv or an institutional repository, and subsequently made Open Access within 6 months of publication. – The ERC considers essential that primary data - which in the life sciences for example could comprise data such as nucleotide/protein sequences, macromolecular atomic coordinates and anonymized epidemiological data - are deposited to the relevant databases as soon as possible, preferably immediately after publication and in any case not later than 6 months after the date of publication. 4
  5. 5. European Helpdesk Promote FP7-pilot and ERC OA guidelines National Open Access Desks (27 countries) Provide OA “toolkits” for – Researchers – Institutions – Repository managers Setup 24/7 portal for deposit, search of OA publications Liaison with – Other European OA initiatives – Publishers – CRIS systems 5
  6. 6. Reaching out to EC members Region 1 North (DTU) Denmark (Technical University of Denmark) Denmark (Technical University of Denmark) Finland (University of Helsinki) Finland (University of Helsinki) Sweden (National Library of Sweden) Sweden (National Library of Sweden) Region 2 South (UMINHO) Cyprus (Universtity of Cyprus) Cyprus (Universtity of Cyprus) Greece (National Documentation Center) Greece (National Documentation Center) Italy (CASPAR) Italy (CASPAR) Malta (Malta Council for Science & Technology) Malta (Malta Council for Science & Technology) Portugal (University of Minho) Portugal (University of Minho) Spain (FECYT) Spain (FECYT) Region 3 East (eIFL) Bulgaria (Bulgarian Academy of Sciences) Bulgaria (Bulgarian Academy of Sciences) Czech Republic (Technical University of Ostrava) Czech Republic (Technical University of Ostrava) Estonia (University of Tartu) Estonia (University of Tartu)Hungary (HUNOR)Hungary (HUNOR) Latvia (University of Latvia) Latvia (University of Latvia) Lithuania (Kaunas Technical University) Lithuania (Kaunas Technical University) Poland (ICM – University of Warsaw) Poland (ICM – University of Warsaw) Romania (Kosson) Romania (Kosson) Slovakia (university Library of Bratislava) Slovakia (university Library of Bratislava) Slovenia (University of Ljubljana) Slovenia (University of Ljubljana) Region 4 West (UGENT) France (Couperin) France (Couperin) Germany (University of Kostanz) Germany (University of Kostanz) Ireland (Trinity College) Ireland (Trinity College) Netherlands (Utrecht University) Netherlands (Utrecht University) UK (SHERPA) UK (SHERPA) Austria (University of Wien) Austria (University of Wien) Belgium (Universtiy of Gent) Belgium (Universtiy of Gent) Norway (University of Tromsoe) Norway (University of Tromsoe) National Open Access Desks evaluating and disseminating policies & best practices National Open Access Desks evaluating and disseminating policies & best practices 6
  7. 7. OpenAIRE infrastrucure basics Builds on European OA Repository infrastructure Researchers deposit once – Harvest from OpenAIRE compliant repositories – OpenAIRE provides “Orphan” repository Extend DRIVER guidelines for repository managers Based on DRIVER developed D-NET software toolkit Access to scientific publications – Search, browse – Visualization tools Provide monitoring tools for – Document/depositing statistics – Usage statistics from repository infrastructure Interoperation with other infrastructures 7
  8. 8. OpenAIRE in a nutshell OpenAIRE overall overview: functionalities and domains served OpenAIRE overall overview: functionalities and domains served 8
  9. 9. CERIF Data Model 9
  10. 10. OpenAIREDataModel 10
  11. 11. OpenAIRE Controlled Vocs 11 NationalitiesAuthors Countries Organization s LicenseKindsArticles Languages DataSource Typologies DataSources FP7Subjects Projects _FP7subjects Projects nationality license_kind language country_of_origin typology
  12. 12. OpenAIRE Guidelines DC DRIVER guidelines +: projectID – dc:relation accessRights – dc:rights embargoEndDate – dc:date 12
  13. 13. Measuring success of OA in FP7 Document statistics for OA deposition – % rate of OA deposition Usage statistics on FP7 OA publications – Impact of OA deposited publications One WP dedicated in development of usage statistics service 13
  14. 14. Funders requirements (EC) Open Access evaluation: the following stats will be broken down by research area, programme, ERC, contract type (NoE, IP, etc.) country, institution, – total number of articles published in FP7 after August 2008 – total number of open access articles – average number of articles per project – total/average number of articles of SC39 projects – number of articles still in embargo period (those in 6 months embargo, those in 12 months, those with no embargo, i.e., gold) Project evaluation based on OA publication, broken down by research area, programme, funding (e.g., big vs. small projects), maturity of project (how long has it been going for), etc. – number of projects that have not published any articles – number of projects in the pilot that have not published any articles Overall compliance with the mandate (how many are, how many are not) – this in relative numbers 14
  15. 15. Usage statistics 15 Davichi / David Oliva, http://creativecommons.org/licenses/by/2.0/
  16. 16. Strategy for recording usage Based PRIUS model slightly adapted to OpenAIRE Basically the normalization will be done centrally – When – What – Who – Which 16
  17. 17. Usage statistics service for FP7 publications 17
  18. 18. Usage statistics service components Harvester/aggregator from OpenAIRE compliant repositories Service for processing usage data and produce meaningful statistics Provide web and graphical tools for – Managers – Funders – Researchers Service can easily be adopted to non FP7 publications (e.g. in DRIVER, …) 18
  19. 19. OpenAIRE compliant repositories Definition of OpenAIRE compliant repositories – OpenAIRE guidelines for usage statistics Align with current initiatives Support major usage data formats – Interoperability is important Support multiple transfer protocols OpenAIRE orphan repository (Invenio/CERN) to comply with guidelines 19
  20. 20. OpenAIRE partners expertise UNIBI, UGOE, SURF – National initiatives – OA-stat – PEER project – Knowledge Exchange Univ. of Minho – DSpace statistics plugin University of Athens – Processing of web server & application logs – Usage statistics application in TELPlus – Personalized applications in DRIVER & TELPlus 20
  21. 21. Services to repository managers & funders 21
  22. 22. Web graphical tool Statistics provided by publication 22
  23. 23. Web graphical tool Statistics provided by publication 23
  24. 24. Other article level stats Citations Web usage Expert ratings Social bookmarking Community rating Media/blog coverage Commenting activity More sophisticated types of usage metrics Tracking ‘conversations’ outside of the publisher Reputation metrics for users Tagging and more… Mark Patterson – PLoS.org - www.ape2010.eu/ppt_wednesday/15_Pa 24
  25. 25. Thank you 25 http://creativecommons.org/licenses/by/2.0/ by ky_olsen
  26. 26. Open Issues Unique/persistent identifiers of publications – Publications on different repositories – Capture different versions/formats of same publication Exclusion of robots Repository platform specific implementations – Uniform approach? When? – What happens in thematic repositories? Volume of usage stats – OpenAIRE sets? 26
  27. 27. OpenAIRE workplan & timeline May-July, 2010 – OpenAIRE internal specifications for usage data and transfer specs November, 2010 – Usage data exchange guidelines for OpenAIRE compliant repositories – Harvester, aggregator service July, 2011 – Usage statistics service – Web usage statistics graphical tools 27

×