Apresentação no Congresso Ecosistemas del Conocimiento Abierto (ECA 2017) - 25 de outubro de 2017

1. Infrastructures forOpen Science in
Europe: the power ofRepositories
Salamanca, 25 October 2017
PedroPrincipe
UniversidadedoMinho

2. 1
REPOSITORIOS COMO
INFRAESTRUCTURA
OpenAIREyELPODERDE
LOSREPOSITORIOS
2
This is where you type in the event 2

3. Nuestrosrepositorios
puedenserlostesorosde
nuestrainstitución...
Peronopuedenser
islasdeltesoro...

4. Cada repositorio individualmente puede ser
valioso para su institución o comunidad.
Pero cada repositorio solo tiene un valor
muy limitado…
EL VALOR DE LOS REPOSITORIOS

5. El valor real de los repositorios recae en el
potencial de interconexión para crear una red
de repositorios, una red que puede proveer
un acceso unificado a los resultados de la
investigación y son (re-) utilizados por las
máquinas y los investigadores.
ElcasodeInteroperabilidadparaRepositoriosdeAccesoAbierto-COARBriefingPaper

6. Para lograr este potencial de crear un cuerpo unificado de
resultados de la investigación necesitamos…
Contenidos OA
Interoperabilidad
6

8. Logramoslasredes…pero…
Devolver elcontrol del sistema de comunicación científica a la
comunidad investigadora yacadémica!
Fortalecer yampliarelpapeldelainstitución enlacomunicación científica.
Losrepositorios sonherramientas importantes paraactualizar esta visión.
This is where you type in the event 8

9. Futuro de las Bibliotecas, Oct 2016:
Massachusetts Institute of Technology

10. Next generation repositories
Visión
Posicionar los repositorios (y sus instituciones) como la
base para una infraestructura de comunicación académica
y científica distribuida y globalmente interconectada.

11. Next generation repositories
Dos ideas central para actualizar nuestra vision
•Mejorar la funcionalidad de los repositorios:
–Ser de, y no solamente estar en, La Web.
–Interoperabilidad global.
–Repositorios pro-activos.
•Suportar el desarrollo de servicios de valor agregado
(recommender Systems, Open Peer Review, Usage stats).

12. Next generation repositories

13. Next generation repositories

14. It is potential for interoperation which
elevates the institutional repository from a
local system, to a networked system"
Repositories as Infrastructure – PaulWalk

15. Tecnologiaenevolución.
FuerteapoyodelaComunidad.
Controlodistribuido.
Repositories as Infrastructure!

16. Públicosdiversos. Diferentesfunciones.
Híbridos(catch-all). Redes.
REPOSITORIOS COMO INFRAESTRUCTURA

17. Una mirada:
Servicesandrecent/futuredevelopments
forfundersandcontent providers.
OpenAIRE
This is where you type in the event 17

19. onestopshop for
OpenAIRE data
providers
forfriends…
“therepositorymanagers dashboard”
Dashboardforcontenteproviders

20. OpenAIRE’s e-infrastructure Commons
Publications
repositories
Research Data
repositories
CRIS
systems
Registries
(e.g. projects)
OA
Journals
Software
Repositories
Validation
Cleaning De-duplication
Enrichment
By inference
CONTENT PROVIDERS
INFO SPACE SERVICES
Project initiative
FunderFunding
Result
Publication Data Software
Organization
GUIDE
LINES
TERMS
OF USE
Repositories in OpenAIRE may
be interested to acquire
metadata information about
publications that are
“potentially of interest
to them”
i.e. be part of their collection:
add new records, enrich the
records with extra metadata
information.

21. THE CHALLENGE
•Enrichment is straightforward
•Harvesting from repository and return to repository its records if they
have been “enriched” by deduplication and/or inference
•Addition is less obvious
•Based on relationships, in turn identified by inference algorithms
•Must be augmented with notion of “trust” to enable “tuning” options in
order to reduce false positive notifications
Literature broker service
21

22. OpenAIRE Broker sketch
OpenAIRE
Notification Broker
OpenAIRE Information Space
Graph
(deduplication,
Inference,
Aggregation)
…
Subscriptions
Potential
Notifications
subscribe
notifyrepository
admin
OpenAIRE Data
Sources
Identifying “events”
relevant to repositories
(enrichments & additions)
Sending
events
Delivered
Notifications
Event (potential notification):
• Message
• Topic
• TargetRepository
• Trust

23. Repositories cansubscribe totheserviceandreceivenotifications about recordsof
potential interest andspecify
• whatmetadatafieldstheywouldliketobenotifiedof
• howtobenotified.
Theservicecannotify therepositories indifferent ways
• viacustom(OpenAIREdefined) repositoryAPIsformetadata ingestion
• viaemailtotherepositorymanagersandviawebinterface.
Subscription & notification
23
Broker services available via a specific dashboard
for content providers…

24. Content Provider Dashboard
24
REGISTER
&
UPDATE
registration service
VALIDATE
&
MONITOR
validation service
ENRICHMENTS
&
NOTIFICATIONS
broker service
METRICS
USAGE
STATISTICS
usage stats service

25.  Datasource registration
 Validation (againstguidelines)
 Content enrichment andfixing
 Content notifications
 Datasourceusagestatistics
Dashboard Functionalities

26. Content events - enrichments & alerts
@OSFAIR2017 26

27. 27

28. Services for Funders
Align Open Science policies.
Sync infrastructures.
Monitor and report.
OpenAIREhelpsyoumeasure
researchfundingimpactand
supportsmonitoringofOpenAccess

29. Open Access & Open Research Data in H2020
29

30. OpenAIRE monitoring for EC
OA with DOIs
reports

31. EC projects and funding streams pages and stats

32. Funders related activities in OpenAIRE
SyncinfrastructuresandSupport
nationale-infrastructures
Guidelinesformetadatafundinginfo
Monitormandatecompliance
AlignandsupportOApolicies
Textminingandinference
Statisticsandreporting
Analyticsandtrends
APIswithprojectslistfor
repositorysoftware

33. www.openaire.euBETA

34. Funders Integration status (Oct. 2017) 34
Funder Country Status
European Commission (FP7 & H2020) EU Production
Portuguese Foundation for Science and Technology (FCT) Portugal Production
Wellcome trust (WT) UK Production
National Science Foundation (NSF) US Production
National Health and Medical Research Council (NHMRC) Australia Production
Australian Research Council (ARC) Australia Production
Ministry of Education, Science and Technological Development (MESTD) Serbia Production
Ministry of Science Education and Sport (MZOS/MSES) Croatia Production
Croatia Science Foundation (HRZZ/CSF) Croatia Production
Netherlands Organisation for Scientific Research (NWO) Nederlands Production
Science Foundation Ireland (SFI) Ireland Production
National Institute of Health (NIH) US Production
Swiss National Science Foundation (SNSF) Switzerland Production
Austrian Science Fund (FWF) Austria Production
Research Council UK (RCUK) UK BETA
Tara Expedition Foundation (TARA) France BETA
Scientific and Technological Research Council of Turkey (Tubitak) Turkey BETA
Academy of Finland Finland BETA
CONICYT Chile BETA
Ministry of Economy, Industry and Competitiveness Spain BETA
German Research Foundation (DFG) Germany Pilot

35. Funder integration in OpenAIRE: simplified workflow
35
1. Obtain list of projects
2. Data analysis for
integration and inference
module
3. Integration on DB
4. IIS module integration
5. Inference
6. Data provision on beta
7. Quality check
Results available on the
OpenAIRE portal

36. ESPAÑA: 2 funding streams, 4623 projects = 4622 publications
(provisional results – testing)
36

37. Funded projects metadata info in OpenAIRE
@OSFAIR2017 37
Collect metadata
including project
grantID from
OpenAIRE compliant
repositories
Metadata
publications record
enrichments by
OpenAIRE
deduplication
Link Publications to
projects by
inference (text
mining procedures)
Link Publications to
projects using the
end-user service:
claim publications

38. TheAPIs offercustom access tometadataaboutprojects fundedbyallfunders
integratedintheOpenAIREinfospace(Dspace,Eprints,otherrepository platforms).
(E.g.FundersProjectsListDspaceAdd-on)
OpenAIRE API (1/3)
38

39. ‘Claim’ functionality available for all national funders
Link research results portal facilities (2/3)
39
Link publication or datasets to projects:
Identify the project, select publications or
datasets and set the access rights.

40. Zenodo – extended grant support (3/3)
40

41. Usage metrics for
OpenAIREContentProviders
A Usage Statistics Hub for
Responsible Metrics
UsageStatisticsService

42. • Tracking of views and downloads / collecting COUNTER reports
• PushorPullcollectionworkflows.
• Anonymisation of IP-addresses.
• metadata deduplication enables accumulation of views and
downloads for same documents
• COUNTER Code of Practice compatibility.
• standardsbasedusagestatistics.
• enablescomparability withstatisticsfromotherdatasources.
Usage Statistics Service Features
42

43. • World's leading open-source analytics platform.
• Valuable insightsinto website traffic and visitors activity.
• Piwik collects andstores PII (personallyidentifiable information).
• Keepsfull dataownershipand can control who has access.
• Robot filtering plugin.
• Compliant with EUregulations.
• Recommended byprivacy organizations suchas ULD (Germany)
andCNIL (France).
Piwik Analytics platform
This is where you type in the event 43

44. 2-Tiers Collection Workflows for Usage Statistics
Metadata-Index
UsageStatistics-DB
● Repository
● CRIS
● eJournal
● National
Statistics Node
● Publisher
PULL
COUNTER Report
PUSH
tracked event
IP-Anonym.
processing script
processing script

45. • Aninstitutional repository is registered inPiwik.
• Two tracking options:
• Clientside:AsmallJavascriptsnippetembeddedinwebpages.
• Serverside:Aplugin,usingPiwik’sHTTPAPI,developedforDSpace(patch)andEprints.
• Usage Activity istracked andlogged atPiwik platform inreal time.
• Ιnformation istransferred offline, using Piwik’s API, to OpenAire’s
DBs for statistical analysis.
• Statistics aredeployed via OpenAire’s Portal or Sushi-Lite API.
Tier-1: Push Usage Statistics Tracking Workflow

46. • Client Side Javascript snippet
• Easyconfigurable.
• Canbeappliedtoanytypeofrepositoryinfrastructure.
• Information canbeblockedbyjavascriptblockers.
• “Direct”downloadsaremissed.
• Server Side plugin
• Moreaccuratetracking.
• Tacklesmissing “direct”downloadsproblem.
• Acustomplugin shouldbedevelopedforeachrepositoryinfrastructure.
Tier-1 Usage Statistics Tracking Workflow

47. • Applying dataprocessing rules according to COUNTER Code of
Practice:
• ie.countingrequestsdependingonsessionduration,tracingdouble-clicks
• Bot filtering
• PiwikBotPlugin
• COUNTERRobotsWorkingGroup
• Link of usage event with metadata record inOpenAIRE
• Accumulate views andcounts of deduplicated records
Cleaning and Consolidation

48. • Gathering of consolidated statistics reports from
aggregation services, such as IRUS-UK, using protocols such
as SUSHI-Lite.
• Statistics are stored to OpenAire’s DB for statistical analysis.
• Statistics are deployed via OpenAire’s Portal or Sushi-Lite
API.
Tier-2: Collecting (Pull) Consolidated Usage Statistics Reports

49. ● three steps to join OpenAIRE Usage Statistics
○ enable“usagemetrics”foryourdatasource
○ download&configuretrackingplugininyourdatasource
○ confirmationbyOpenAIREonceusageeventsaretrackedinPIWIK
● or enter SUSHI endpoint tolet OpenAIRE collect COUNTER reports
Metrics in the OpenAire Repository Manager Dashboard
Download
tracker
Configure Deploy & Test
Validation &
Confirmation

50. Content Provider Dashboard - Start Page

51. Enable Metrics for selected Datasource

52. Summarized Usage Statistics on the content provider level

53. • Quantitativeindicatorsforresearch
• Governance
• Management
• Assessment
• Dimensions
• Robustmetricsintermsofaccuracyandscope;
• Humblemetricsrecognizingthatquantitativeevaluationshouldsupportqualitative,expertassessment;
• OpenandTransparentmetrics;
• Diversemetricsbyfieldinordertosupportthepluralityofresearchandresearchercareerpathsacrossthesystem;
• Reflexiblemetricsforrecognising,anticipatingandupdatingthesystemicandpotentialeffectsofindicators.
OpenAIRE: A Usage Statistics Hub for Responsible Metrics

54. OpenScience as-a-Service
OpenAIRE-connect
ResearchCommunityDashboard
Catch-All-NotificationBroker

55. OpenScienceas-a-ServiceintheOpenAIREinfrastructure
Facilitate Research Communities adoption of
Open Science publishing principles by
supporting publishing tools as-a-Service
Facilitate repositories at moving towards Open
Science publishing by supporting notification-
based research communication as-a-Service

56. OpenSciencepublishing
Supportingreproducibilityandtransparentevaluation
Research
data
Research
methods
e-infra
Tools & Services
Research
data
Scientific process
Research literature:
Articles, docs, white papers
Publishing
01101010
01100001
11010010
01101010
01100001
11010010
Publication
Repository
01101010
01100001
11010010
Data
Repository
Software
Repository
01101010
01100001
11010010
01101010
01100001
11010010
Package
RepositoryEnabling
Reproducibility
citation
citation
Enabling
Transparent
evaluation
Other products:
methods, workflows,
protocols

57. OpenSciencePublishing:barriers
Repositories
lack support to
Open Science
publishing
No support for integration of repositories for software, methods, or
packages
Minimal or no support for links between artefacts in different repositories
No support for keeping repositories with up-to-date links between
artefacts
Research
communities
lack culture of
Open Science
publishing
Lack of e-infrastructure and tools for Open Science: e.g. repository limits
above, exchange formats, workflows
Difficulties to self-organize and sustain research communication
solutions: e.g. identify the problems, see the benefits, devise solutions,
applying economy of scale

58. OpenScienceas-a-Service(OSaaS)
Catch-All-Notification
Broker
Software
Packages
Articles DataProjects
Research Community
Dashboard
Harvesting
Search-Browse-Monitor-
Research Impact
Subscription & Notification
Articles
Data
Researchers
Content Providers
Articles
Data
Projects
Methods
Software

59. Open Scienceas-a-Service
Research Community
Dashboard
59

60. DashboardforResearchCommunities
01101010
01100001
11010010
01101010
01100001
11010010
01101010
01100001
11010010
01101010
01100001
11010010
fund
Harvest Harmonize
De-duplicate Inference
Repositories of publications, datasets, projects, methods, packages
Research Community Service
Research
Community
Operator
01101010
01100001
11010010
fund
Request
Dashboard
for Community

61. DashboardforResearchCommunities
01101010
01100001
11010010
01101010
01100001
11010010
01101010
01100001
11010010
01101010
01100001
11010010
fund
Harvest Harmonize
Deduplicate Inference
Repositories of publications, datasets, projects, methods, packages
Research Community Service
Research
Community
Operator
Researchers
01101010
01100001
11010010
• Deposit (DOI)
• Claim
• Stats: research impact & OA
• Manage users
• Configure stats
• Configure inference
fund

62. ResearchCommunitiesandOpenSciencebenefits
• Can continue their publishing practices, but, if needed they have support for
deposition of any artefact
Common repository for publishing (deposition) of
datasets, methods, and packages
• Community information space to share, discovery, and reuse (reproduce)
scientific results
Collaborative curation of a community-specific
research communication domain
• Scientific reward strategies can be developed
Research impact and statistics

63. Open Scienceas-a-Service
Catch-All Broker
Service
63

64. SubscriptionandNotificationforRepositories
01101010
01100001
11010010
01101010
01100001
11010010
01101010
01100001
11010010
01101010
01100001
11010010
fund
Harvest Harmonize
De-duplicate Inference
Repositories of publications, datasets, projects, methods, packages
Catch-All Notification Broker Service
01101010
01100001
11010010
fund
Repository
Manager
Request
Notification
Workspace

65. SubscriptionandNotificationforRepositories
01101010
01100001
11010010
01101010
01100001
11010010
01101010
01100001
11010010
01101010
01100001
11010010
fund
Harvest Harmonize
Deduplicate Inference
Repositories of publications, datasets, projects, methods, packages
Catch-All Notification Broker Service
01101010
01100001
11010010
fund
Repository
Manager
• Subscription: enrichment or
additions to repository
• Notification management
Notifications
• Mail
• APIs
• UIs
?

66. Repositories:OpenSciencebenefits
• Enabling addition of links to artefacts of any kind
Extending repository metadata models to
Open Science
• “Almost real-time” exchange of information: notifications about links to other
artefacts, missing properties, and missing artefacts
Keeping their collection up-to-date:
enrichments and additions
• Enabling repositories to be notified of content of interest, enabling
construction of research-focused aggregators by notifications
Fostering notification-based and federated
dissemination of knowledge

67. OpenAIRE Advancing
OpenScholarship
OpenAIRE Advance 2018-2020
OpenAIREadvancewillbuildonthe
outcomesoftheCOARNext
GenerationRepositories

68. Repositories forming adistributed global knowledge network havethepotential to
promote the transformation ofthescholarly communication ecosystem.
Oneofthebarriersisalackofweb-basedintegrationwithotherinnovative scholarlyservices.
Thereisaclearneedforrepositoryplatformstoadoptmodernweb-technologiesandprotocols
thatwillallowthemtobetterinteractwithmoreinnovativeandsophisticatedscholarly
networkedtoolsandservices.
OpenAIREadvancewillbuildontheoutcomesoftheCOARNextGenerationRepositories
WorkingGroupandsupporttheimplementationofnewfunctionalities.
Next generation repositories
This is where you type in the event 68

69. NextGenerationRepositoriesinOpenAIREadvance
1. Improving discovery and content transfer.
2. Open Metrics for repositories
3. Annotation service
This is where you type in the event 69

70. www.openaire.eu
@openaire_eu
facebook.com/groups/openaire
pedroprincipe@sdum.uminho.pt