www.cineca.it
~
Integrate external services in
DSpace submission process
How to make self-deposit easy and improve
metada...
Topics
⁄ Some context:
⁄ CINECA a brief overview
⁄ DSpace as part of a CRIS solution
www.cineca.it | Integrate external se...
⁄ Owned companies: Kion, SCS.
⁄ Employees: 400 (+150 Kion)
⁄ Total turnover:  70M€
The Company
⁄ Interuniversity Consorti...
⁄ Owned companies: Kion, SCS.
⁄ Employees: 400 (+150 Kion)
⁄ Total turnover:  70M€
The Company
⁄ Interuniversity Consorti...
⁄ Owned companies: Kion, SCS.
⁄ Employees: 400 (+150 Kion)
⁄ Total turnover:  70M€
The Company
⁄ Interuniversity Consorti...
⁄ The “merging process” of the three Italian Consortia started in September 2012
⁄ It was concluded in July 1st 2013 (last...
⁄ The “merging process” of the three Italian Consortia started in September 2012
⁄ It was concluded in July 1st 2013 (last...
Higher Education
• Solutions & Services for the University Administration
• Services for the Ministry of Education, Univer...
•Cineca Board of Directors
Product
Managers
Board
U-GOV &
SURplus
Restricted Board
Customer
Service
Board
Technical &
Deli...
Solutions for HE
= ERP = Best of Breed
www.cineca.it | Integrate external services in DSpace submission process | OR2013| ...
Solutions for HE
= ERP = Best of Breed
www.cineca.it | Integrate external services in DSpace submission process | OR2013| ...
SURplus: CINECA’ CRIS System
⁄ An interoperable infrastructure made of different components
⁄ Ingestion of data from any l...
SURplus: Dimension
⁄ Beginning of activities: 2004
⁄ 9 institutions
⁄ 22 institutional repositories
⁄ Total modules: 77
ww...
Topics
⁄ Integration of external services:
⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc.
⁄ Publishers po...
CINECA is a registered service provider at DuraSpace
Long-term collaboration with DSpace community, since 2003
DSpace: SUR...
CINECA is a registered service provider at DuraSpace
Long-term collaboration with DSpace community, since 2003
Upgrades ar...
“dissemination of
entities’ descriptions in
the research
environment which go
beyond publications”
DSpace-CRIS: SURplus’ E...
IR as part of a CRIS system: what
change?
www.cineca.it | Integrate external services in DSpace submission process | OR201...
IR as part of a CRIS system: what
change?
www.cineca.it | Integrate external services in DSpace submission process | OR201...
IR as part of a CRIS system: what
change?
www.cineca.it | Integrate external services in DSpace submission process | OR201...
IR as part of a CRIS system: what
change?
www.cineca.it | Integrate external services in DSpace submission process | OR201...
Topics
⁄ Integration of external services:
⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc.
⁄ Publishers po...
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Fre...
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Ava...
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Ava...
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Ava...
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Loo...
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Loo...
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Loo...
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Loo...
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
New first submission step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
For...
Modal box publication details
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Modal box publication details
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Modal box publication details
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013...
Modal box publication details
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013...
Manual submission
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Manual submission
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
When lookup...
Batch import from external source
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July ...
Batch import from external source
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July ...
Batch import from external source
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July ...
Batch import from external source
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July ...
Batch import from external source
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July ...
Batch import from external source
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July ...
Enhanced Describe step: showing
metadata source
www.cineca.it | Integrate external services in DSpace submission process |...
Enhanced Describe step: showing
metadata source
www.cineca.it | Integrate external services in DSpace submission process |...
Technical details
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
arXiv ...
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
arXiv ...
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
PubMed...
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
PubMed...
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
PubMed...
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
PubMed...
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
PubMed...
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
PubMed...
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
PubMed...
Translationlogic
originalnormalized
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submissi...
Translationlogic
originalnormalized
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submissi...
Translationlogic
originalnormalized
PubMed Lookup Provider
www.cineca.it | Integrate external services in DSpace submissi...
Topics
⁄ Integration of external services:
⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc.
⁄ Publishers po...
Enhanced upload step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Using th...
Enhanced upload step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Enhanced upload step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Enhanced upload step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Enhanced upload step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Access p...
Enhanced upload step
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Access p...
Topics
⁄ Integration of external services:
⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc.
⁄ Publishers po...
What is the problem?
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
(very) l...
What is the problem?
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
(very) l...
How we plan to mitigate the
problem?
www.cineca.it | Integrate external services in DSpace submission process | OR2013| Ju...
Implementation idea
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
Allow the...
DSpace-CRIS: Researcher profile
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 20...
DSpace-CRIS: Researcher profile
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 20...
DSpace-CRIS: Researcher profile
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 20...
Who are the potential targets?
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 201...
Who are the potential targets?
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 201...
The repository as source of
missing content?
www.cineca.it | Integrate external services in DSpace submission process | OR...
The repository as source of
missing content?
www.cineca.it | Integrate external services in DSpace submission process | OR...
The repository as source of
missing content?
www.cineca.it | Integrate external services in DSpace submission process | OR...
Current implementation: claim/unclaim
publications in the repository
www.cineca.it | Integrate external services in DSpace...
Current implementation: claim/unclaim
publications in the repository
www.cineca.it | Integrate external services in DSpace...
Current implementation: claim/unclaim
publications in the repository
www.cineca.it | Integrate external services in DSpace...
Current implementation: claim/unclaim
publications in the repository
www.cineca.it | Integrate external services in DSpace...
Current implementation: claim/unclaim
publications in the repository
www.cineca.it | Integrate external services in DSpace...
Current implementation: claim/unclaim
publications in the repository
www.cineca.it | Integrate external services in DSpace...
Current implementation: claim/unclaim
publications in the repository
www.cineca.it | Integrate external services in DSpace...
Topics
⁄ Integration of external services:
⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc.
⁄ Publishers po...
Improve fulltext presence
www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
⁄ U...
127.000+ items
65.000+ items
9,4% 17,2%
Sherpa/Romeo Statistics (Example)
www.cineca.it | Integrate external services in D...
127.000+ items
65.000+ items
9,4% 17,2%
Sherpa/Romeo Statistics (Example)
www.cineca.it | Integrate external services in D...
www.cineca.it | Innovative Open Source Technologies for a CRIS: SURplus | euroCRIS | May 2013
SURplus: prevision 2014
⁄ 50...
www.cineca.it
~
Thank you!
Andrea Bollini
a.bollini@cineca.it
SURplus - http://www.cineca.it/en/content/surplus
DSpace-CR...
Upcoming SlideShare
Loading in …5
×

Integrate external bibliographic services in DSpace submission process to make self-deposit easy and improve metadata quality and presence of full-text

765 views

Published on

Open Repositories 2013. Charlottetown, Prince Edward Island from July 8 - 12.
DSpace User Group Session

One of the most difficult challenges for Institutional Repositories is to find ways to encourage deposit from the researchers. When an IR is part of the Current Research Information System (CRIS) of a University there may be mandates from the University top management to assure that researchers are required, to deposit their publications in the Repository, primarily for evaluation purposes. However also in this ideal scenario there is an issue: Researchers see the Repository as an administrative fulfillment. To change this perception and make the IR be seen as a useful tool for research, it is very important to facilitate the deposit procedure and improve data quality as far as possible.
As many publications databases already exists around the world and most of them offer APIs to access and reuse data, we have decided to revise the DSpace submission process to benefit of existent information as much as possible. One of the best known commercial bibliographic databases is Scopus that offers API access as part of the standard contract grant permission to reuse these data in IRs.
CINECA has therefore developed a generic infrastructure that allows easy integration of such services in the DSpace submission process. At the moment Scopus, PubMed, arXiv and CrossRef APIs are supported.
The first step of the submission has been replaced by a form where the user can enter one or more unique identifiers (DOI, PubMed ID, arXiv ID, etc.) and/or a combination of title, authors and year of her publication. The system will query all configured sources and present all results to the user. At this point she can confirm and proceed with the deposit using one of the system proposals or forcing the creation of a new publication from scratch. The system will use information related to the user (authorization) and metadata available in the external systems to suggest the most appropriate collection where to deposit the item, but the user is free to choose a different collection.
When available, the system will use the DOI to merge data from different external data sources in a single richer record, this allows for example to get the abstract of a publication in PubMed and combine other metadata from the standard Scopus API that does not provide this information out-of-box.
More at http://or2013.net/sessions/integrate-external-bibliographic-services-dspace-submission-process-make-self-deposit-easy-

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
765
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Integrate external bibliographic services in DSpace submission process to make self-deposit easy and improve metadata quality and presence of full-text

  1. 1. www.cineca.it ~ Integrate external services in DSpace submission process How to make self-deposit easy and improve metadata quality and presence of full-text Andrea Bollini – Susanna Mornati
  2. 2. Topics ⁄ Some context: ⁄ CINECA a brief overview ⁄ DSpace as part of a CRIS solution www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄Make the repository an active actor: ⁄Discovering missing content ⁄Improve Fulltext presence ⁄Integration of external services: ⁄Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc. ⁄Publishers policy: Sherpa/Romeo
  3. 3. ⁄ Owned companies: Kion, SCS. ⁄ Employees: 400 (+150 Kion) ⁄ Total turnover:  70M€ The Company ⁄ Interuniversity Consortium ⁄ No-Profit ⁄ Founded in 1969 ⁄ Headquarter in Bologna ⁄ 57 Members ⁄ 54 Universities ⁄ 2 Research institutes ⁄ MIUR www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  4. 4. ⁄ Owned companies: Kion, SCS. ⁄ Employees: 400 (+150 Kion) ⁄ Total turnover:  70M€ The Company ⁄ Interuniversity Consortium ⁄ No-Profit ⁄ Founded in 1969 ⁄ Headquarter in Bologna ⁄ 57 Members ⁄ 54 Universities ⁄ 2 Research institutes ⁄ MIUR www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  5. 5. ⁄ Owned companies: Kion, SCS. ⁄ Employees: 400 (+150 Kion) ⁄ Total turnover:  70M€ The Company ⁄ Interuniversity Consortium ⁄ No-Profit ⁄ Founded in 1969 ⁄ Headquarter in Bologna ⁄ 57 Members ⁄ 54 Universities ⁄ 2 Research institutes ⁄ MIUR as last week! www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  6. 6. ⁄ The “merging process” of the three Italian Consortia started in September 2012 ⁄ It was concluded in July 1st 2013 (last week!) The Merge www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  7. 7. ⁄ The “merging process” of the three Italian Consortia started in September 2012 ⁄ It was concluded in July 1st 2013 (last week!) The Merge 2.0 ⁄ 67 Members ⁄ More than 700 employees (+ 150 Kion) ⁄ The only Italian Interuniversity Consortium www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  8. 8. Higher Education • Solutions & Services for the University Administration • Services for the Ministry of Education, University and Research (MIUR) Scientific Research • High Performance Computing – FERMI: 2° in EU / 7° WW) • Scientific Visualization & Interactive Virtual Environments Technological Innovation • Data Center • Information and Knowledge Management Services • Health Care Systems What CINECA does www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  9. 9. •Cineca Board of Directors Product Managers Board U-GOV & SURplus Restricted Board Customer Service Board Technical & Delivery Board Apps Road Map Tech Road Map •University Customers •Focus Groups •University Customers •Cineca Technical Board How we work with Universities www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  10. 10. Solutions for HE = ERP = Best of Breed www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  11. 11. Solutions for HE = ERP = Best of Breed www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  12. 12. SURplus: CINECA’ CRIS System ⁄ An interoperable infrastructure made of different components ⁄ Ingestion of data from any legacy systems adopted by an institution ⁄ Maintenance of specific functional requirements, data model and preferred technologies at the level of applications ⁄ Data warehouse and Business Intelligence tools to facilitate aggregations of data and the application of measurement parameters and algorithms www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  13. 13. SURplus: Dimension ⁄ Beginning of activities: 2004 ⁄ 9 institutions ⁄ 22 institutional repositories ⁄ Total modules: 77 www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  14. 14. Topics ⁄ Integration of external services: ⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc. ⁄ Publishers policy: Sherpa/Romeo www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ Make the repository an active actor: ⁄ Discovering missing content ⁄ Improve Fulltext presence ⁄ Some context: ⁄ CINECA a brief overview ⁄ DSpace as part of a CRIS solution
  15. 15. CINECA is a registered service provider at DuraSpace Long-term collaboration with DSpace community, since 2003 DSpace: SURplus’ Open Archive Module www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  16. 16. CINECA is a registered service provider at DuraSpace Long-term collaboration with DSpace community, since 2003 Upgrades are periodically released to the open source community DSpace: SURplus’ Open Archive Module ⁄ Manages collection and dissemination of research results ⁄ Simplifies data collection’s processes ⁄ Service Integration The OA Module, developed on DSpace: www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  17. 17. “dissemination of entities’ descriptions in the research environment which go beyond publications” DSpace-CRIS: SURplus’ Expertise & Skills DSpace-CRIS: designed together with the Hong Kong University & released as open-source www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  18. 18. IR as part of a CRIS system: what change? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄Benefits: ⁄Strong deposit mandate ⁄More funding ⁄Issues to mitigate: ⁄IR become a critical application ⁄Author have a “requirements” perception  Wasting time  Late submission
  19. 19. IR as part of a CRIS system: what change? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄Benefits: ⁄Strong deposit mandate ⁄More funding ⁄Issues to mitigate: ⁄IR become a critical application ⁄Author have a “requirements” perception  Wasting time  Late submission Professional support HA infrastructure Dedicated team
  20. 20. IR as part of a CRIS system: what change? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄Benefits: ⁄Strong deposit mandate ⁄More funding ⁄Issues to mitigate: ⁄IR become a critical application ⁄Author have a “requirements” perception  Wasting time  Late submission Professional support HA infrastructure Dedicated team advocacy
  21. 21. IR as part of a CRIS system: what change? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄Benefits: ⁄Strong deposit mandate ⁄More funding ⁄Issues to mitigate: ⁄IR become a critical application ⁄Author have a “requirements” perception  Wasting time  Late submission Professional support HA infrastructure Dedicated team advocacy Make the submission process easy The information already exists in other database!
  22. 22. Topics ⁄ Integration of external services: ⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc. ⁄ Publishers policy: Sherpa/Romeo www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ Make the repository an active actor: ⁄ Discovering missing content ⁄ Improve Fulltext presence ⁄ Some context: ⁄ CINECA a brief overview ⁄ DSpace as part of a CRIS solution
  23. 23. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  24. 24. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Free search form
  25. 25. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Available providers: each provider is a spring service Free search form
  26. 26. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Available providers: each provider is a spring service Free search form Main metadata common to all publication types (article, book, etc.) Title of the contribution Year Authors/Editors
  27. 27. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Available providers: each provider is a spring service Free search form Main metadata common to all publication types (article, book, etc.) Title of the contribution Year Authors/Editors
  28. 28. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  29. 29. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Lookup by unique identifier
  30. 30. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Lookup by unique identifier Each provider declares which identifiers is able to manage
  31. 31. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Lookup by unique identifier Each provider declares which identifiers is able to manage
  32. 32. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Lookup by unique identifier Each provider declares which identifiers is able to manage
  33. 33. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  34. 34. New first submission step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 For each result providers are shown that match the record. Grouping is done via DOI
  35. 35. Modal box publication details www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  36. 36. Modal box publication details www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  37. 37. Modal box publication details www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Records from different providers are merged to get richer metadata The system guesses a collection for the submission but the user can change it if required
  38. 38. Modal box publication details www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Records from different providers are merged to get richer metadata The system guesses a collection for the submission but the user can change it if required
  39. 39. Manual submission www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  40. 40. Manual submission www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 When lookup fails the user can always proceed manually
  41. 41. Batch import from external source www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  42. 42. Batch import from external source www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Import data (identifiers or structured text) can be inputed manually or uploaded as a file
  43. 43. Batch import from external source www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Import data (identifiers or structured text) can be inputed manually or uploaded as a file Format/provider must be specified by the user
  44. 44. Batch import from external source www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄Request are processed: ⁄Inline for specific providers and/or within configured data limits  Submitter can immediately complete the pre-filled submissions  
  45. 45. Batch import from external source www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄Request are processed: ⁄Inline for specific providers and/or within configured data limits  Submitter can immediately complete the pre-filled submissions ⁄In a background process  Submitter will receive a summary email with import result  Pre-filled submissions are available as in-progress submission in the MyDSpace
  46. 46. Batch import from external source www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄Request are processed: ⁄Inline for specific providers and/or within configured data limits  Submitter can immediately complete the pre-filled submissions ⁄In a background process  Submitter will receive a summary email with import result  Pre-filled submissions are available as in-progress submission in the MyDSpace The legacy batch import feature for JSPUI has been already shared as pull request on GitHub, see DS-1252
  47. 47. Enhanced Describe step: showing metadata source www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  48. 48. Enhanced Describe step: showing metadata source www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  49. 49. Technical details www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  50. 50. PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 arXiv Lookup Provider Scopus Lookup Provider …
  51. 51. PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 arXiv Lookup Provider Scopus Lookup Provider … <bean name="pubmedLookupProvider" class=“...lookup.PubmedLookupProvider"> <property name="pubmedService" ref="pubmedService"/> </bean> implements SubmissionLookupProvider
  52. 52. PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record arXiv Lookup Provider Scopus Lookup Provider … <bean name="pubmedService" class=“...service.PubmedService"/> <bean name="pubmedLookupProvider" class=“...lookup.PubmedLookupProvider"> <property name="pubmedService" ref="pubmedService"/> </bean> implements SubmissionLookupProvider
  53. 53. PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record arXiv Lookup Provider Scopus Lookup Provider … <bean name="pubmedService" class=“...service.PubmedService"/> <bean name="pubmedLookupProvider" class=“...lookup.PubmedLookupProvider"> <property name="pubmedService" ref="pubmedService"/> </bean> implements SubmissionLookupProvider WGET http://eutils.ncbi.nlm.nih.gov/entrez/eutils/efetch.fcgi ?db=pubmed&id=23297105&retmode=xml&rettype=full
  54. 54. PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record arXiv Lookup Provider Scopus Lookup Provider … <bean name="pubmedService" class=“...service.PubmedService"/> <bean name="pubmedLookupProvider" class=“...lookup.PubmedLookupProvider"> <property name="pubmedService" ref="pubmedService"/> </bean> implements SubmissionLookupProvider
  55. 55. PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record JAVA Bean Mapping file arXiv Lookup Provider Scopus Lookup Provider … <bean name="pubmedService" class=“...service.PubmedService"/> <bean name="pubmedLookupProvider" class=“...lookup.PubmedLookupProvider"> <property name="pubmedService" ref="pubmedService"/> </bean> implements SubmissionLookupProvider public class PubmedLookupProvider extends ConfigurableLookupProvider public abstract class ConfigurableLookupProvider
  56. 56. PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record JAVA Bean Mapping file arXiv Lookup Provider Scopus Lookup Provider … <bean name="pubmedService" class=“...service.PubmedService"/> <bean name="pubmedLookupProvider" class=“...lookup.PubmedLookupProvider"> <property name="pubmedService" ref="pubmedService"/> </bean> implements SubmissionLookupProvider public class PubmedLookupProvider extends ConfigurableLookupProvider public abstract class ConfigurableLookupProvider public class PubmedItem { private String pubmedID; private String doi; private String issn; private String eissn; private String journalTitle; private String title; private String pubblicationModel; private String year; private String volume; private String issue; private String language; private List<String> type; private List<String> primaryKeywords; private List<String> secondaryKeywords; …
  57. 57. PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record JAVA Bean Mapping file arXiv Lookup Provider Scopus Lookup Provider … <bean name="pubmedService" class=“...service.PubmedService"/> <bean name="pubmedLookupProvider" class=“...lookup.PubmedLookupProvider"> <property name="pubmedService" ref="pubmedService"/> </bean> implements SubmissionLookupProvider public class PubmedLookupProvider extends ConfigurableLookupProvider public abstract class ConfigurableLookupProvider
  58. 58. PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record JAVA Bean Mapping file arXiv Lookup Provider arXiv record JAVA Bean Mapping file Scopus Lookup Provider Scopus record JAVA Bean Mapping file … <bean name="pubmedService" class=“...service.PubmedService"/> <bean name="pubmedLookupProvider" class=“...lookup.PubmedLookupProvider"> <property name="pubmedService" ref="pubmedService"/> </bean> implements SubmissionLookupProvider public class PubmedLookupProvider extends ConfigurableLookupProvider public abstract class ConfigurableLookupProvider
  59. 59. Translationlogic originalnormalized PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record JAVA Bean Mapping file Normalized record arXiv Lookup Provider arXiv record JAVA Bean Mapping file Scopus Lookup Provider Scopus record JAVA Bean Mapping file …
  60. 60. Translationlogic originalnormalized PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record JAVA Bean Mapping file Normalized record Enhancer plugins Split, aggregate fields Derive data ISSN  Journal title … arXiv Lookup Provider arXiv record JAVA Bean Mapping file Scopus Lookup Provider Scopus record JAVA Bean Mapping file …
  61. 61. Translationlogic originalnormalized PubMed Lookup Provider www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 PubMed record JAVA Bean Mapping file DSpace Item Normalized record Enhancer plugins Split, aggregate fields Derive data ISSN  Journal title … arXiv Lookup Provider arXiv record JAVA Bean Mapping file Scopus Lookup Provider Scopus record JAVA Bean Mapping file … Translationlogic NormalizedRepository Mapping file
  62. 62. Topics ⁄ Integration of external services: ⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc. ⁄ Publishers policy: Sherpa/Romeo www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ Make the repository an active actor: ⁄ Discovering missing content ⁄ Improve Fulltext presence ⁄ Some context: ⁄ CINECA a brief overview ⁄ DSpace as part of a CRIS solution
  63. 63. Enhanced upload step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Using the ISSN or EISSN provided in the describe step the upload form is improved showing on the right side the publisher policy from the Sherpa/Romeo database
  64. 64. Enhanced upload step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  65. 65. Enhanced upload step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  66. 66. Enhanced upload step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  67. 67. Enhanced upload step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Access policy for the bitstream: Open access, embargo, intranet, etc.
  68. 68. Enhanced upload step www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Access policy for the bitstream: Open access, embargo, intranet, etc. Deposit of fulltext to the national database for individual CVs
  69. 69. Topics ⁄ Integration of external services: ⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc. ⁄ Publishers policy: Sherpa/Romeo www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ Make the repository an active actor: ⁄ Discovering missing content ⁄ Improve Fulltext presence ⁄ Some context: ⁄ CINECA a brief overview ⁄ DSpace as part of a CRIS solution
  70. 70. What is the problem? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 (very) late submissions produce some issues for the repository both at technical and organization level: / The system is subjected to periods of intense input activities. DSpace, but in general IR software, scales well for read operations less well for write operations / IR staff involved in workflow get lot of task to perform in small period
  71. 71. What is the problem? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 (very) late submissions produce some issues for the repository both at technical and organization level: / The system is subjected to periods of intense input activities. DSpace, but in general IR software, scales well for read operations less well for write operations / IR staff involved in workflow get lot of task to perform in small period Get researcher aware Remind researcher about IR presence Intercept early new content
  72. 72. How we plan to mitigate the problem? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Citation databases provide APIs to perform search (we already use them for the lookup) and in some cases they provide additional APIs or search filters/indexes to make more raffinated search and allow scanning of the database. The interesting filters/indexes are: / Time based (much better if related to insertion in the citation database) / Author ID (better if related to a «standard/common» identifier as ORCID) / Affiliation / Subject category
  73. 73. Implementation idea www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 Allow the researcher to store personal preferences about scanning: / Enabled providers (e.g disable arXiv if you are not a physicist) / Frequencies / Subject categories filters AuthorIDs will be stored/retrieved from the Researcher profile. Subject categories could be proposed from previous items or researcher profile.
  74. 74. DSpace-CRIS: Researcher profile www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  75. 75. DSpace-CRIS: Researcher profile www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  76. 76. DSpace-CRIS: Researcher profile www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  77. 77. Who are the potential targets? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ ORCID ⁄ Scopus ⁄ Web of Science ⁄ arXiv ⁄ PubMed Central ⁄ DBLP ⁄ REPEC
  78. 78. Who are the potential targets? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ ORCID ⁄ Scopus ⁄ Web of Science ⁄ arXiv ⁄ PubMed Central ⁄ DBLP ⁄ REPEC The Repository itself!
  79. 79. The repository as source of missing content? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ The submitter has to match authors of publication with the University staff to higthlight internal authors ⁄ Sometimes matches are missing ⁄ Othertimes matches are wrong (homonymous) ⁄ External authors could become «internal» at some point in the future
  80. 80. The repository as source of missing content? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ Send email to internal «co-authors» when a submission is done  prevent wrong attribution (and reduce duplication) ⁄ Allow researcher to unclaim publications from her profile  last chance to fix wrong attribution ⁄ Allow researcher to claim publications  fix missing attribution and/or engagement of new researcher
  81. 81. The repository as source of missing content? www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ Send email to internal «co-authors» when a submission is done  prevent wrong attribution (and reduce duplication) ⁄ Allow researcher to unclaim publications from her profile  last chance to fix wrong attribution ⁄ Allow researcher to claim publications  fix missing attribution and/or engagement of new researcher The last two features are included in the DSpace-CRIS addon
  82. 82. Current implementation: claim/unclaim publications in the repository www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  83. 83. Current implementation: claim/unclaim publications in the repository www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 This is the current status of the publication U  Unlinked
  84. 84. Current implementation: claim/unclaim publications in the repository www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 This is the current status of the publication U  Unlinked You can claim it A  Active, simple claim S  Make it a selected publication H  Claim it but hide from you public profile
  85. 85. Current implementation: claim/unclaim publications in the repository www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  86. 86. Current implementation: claim/unclaim publications in the repository www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 You can unclaim a publication U  Unlink
  87. 87. Current implementation: claim/unclaim publications in the repository www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  88. 88. Current implementation: claim/unclaim publications in the repository www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013
  89. 89. Topics ⁄ Integration of external services: ⁄ Bibliographic database: Scopus, PubMed, CrossRef, ArXiv, etc. ⁄ Publishers policy: Sherpa/Romeo www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ Make the repository an active actor: ⁄ Discovering missing content ⁄ Improve Fulltext presence ⁄ Some context: ⁄ CINECA a brief overview ⁄ DSpace as part of a CRIS solution
  90. 90. Improve fulltext presence www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 ⁄ Use the Sherpa/Romeo policy database to analyze repository content ⁄ Use external database API to find an actual fulltext (arXiv, pubmed, ...why not the publisher version via library subscription?) ⁄ Send email to researcher to validate found PDFs or ask for an «author» versions ⁄ Use statistics to encourage upload
  91. 91. 127.000+ items 65.000+ items 9,4% 17,2% Sherpa/Romeo Statistics (Example) www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 51% ISSN 36% Not in Sherpa 24.000 items 32% green 21.000 items
  92. 92. 127.000+ items 65.000+ items 9,4% 17,2% Sherpa/Romeo Statistics (Example) www.cineca.it | Integrate external services in DSpace submission process | OR2013| July 2013 51% ISSN 36% Not in Sherpa 24.000 items 7,3% have a fulltext… 5,3% open access 32% green 21.000 items
  93. 93. www.cineca.it | Innovative Open Source Technologies for a CRIS: SURplus | euroCRIS | May 2013 SURplus: prevision 2014 ⁄ 50+ institutional repositories (DSpace) ⁄ 10 research portals (DSpace-CRIS)
  94. 94. www.cineca.it ~ Thank you! Andrea Bollini a.bollini@cineca.it SURplus - http://www.cineca.it/en/content/surplus DSpace-CRIS - http://cilea.github.com/dspace-cris

×