• Like
Research Attribution Using ORCID, FundRef, and Ringgold

Research Attribution Using ORCID, FundRef, and Ringgold



Carol Anne Meyer discusses CrossRef Funding Data, FundRef, at the Editorial Manager Users Group (EMUG), Boston, June 20 2014

Carol Anne Meyer discusses CrossRef Funding Data, FundRef, at the Editorial Manager Users Group (EMUG), Boston, June 20 2014



Total Views
Views on SlideShare
Embed Views



4 Embeds 85

https://twitter.com 49
http://www.scoop.it 32
http://www.slideee.com 3
https://storify.com 1


Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment
  • Today I’m going to be introducing and explaining the FundRef service from CrossRef.
  • First just a few words about CrossRef for anyone who isn’t a member or might not be familiar with us as an organization. CrossRef is a not-for-profit membership organization of international scholarly publishers.
  • Why is membership growing steadily? Because publishers think that having DOIs will increase their visibility in the scholarly community.
  • Basic journal citation metadata:
  • ORCID is the Open Researcher ID <br /> CrossMark is our update and version identification service <br /> Text and Data Mining is the artist previously known as Prospect
  • ORCID is the Open Researcher ID
  • FundRef launched in May 2013. FundRef’s purpose is pretty simple - it has been developed to provide a standard way of reporting funding sources for published scholarly research. I’m going to start by covering why this is important.
  • Let’s take a look at some sample articles. Many journals and other publications include the authors’ acknowledgement of funding sources, but where and how this information is displayed varies widely. In this article it’s at the end just before the reference section under Acknowledgements, and it tells you the source of the funding and the grant numbers.
  • ...in this PDF article it’s just below the abstract in a section labelled “Funding”. It names the organisation that funded the research, but doesn’t include a grant number.
  • There are a couple of issues with the formatting of funding information in publications. One is that it’s mostly very hard to retrieve in any technical way - if you want to extract this information as part of the article’s metadata, or to search on it you will struggle because many publishers don’t mark this information up in their XML. <br /> Here’s an article with funding information at the top with the other metadata. It has its own section and heading, so it stands out to the reader browsing the page, but if you look at the XML all of the information is grouped together as free text in a paragraph tag. This is not helpful to a machine or search engine that might be looking for this information.
  • And even when publishers do tag up funding information in their XML, as in this example, there are still problems. The tags are likely to vary from publisher to publisher - this publisher uses “Grant Sponsor” and “Grant Num”. Another might use “Funding Source” and “Award Number”. And not all publishers are making this information mandatory on submission, so there will be gaps where authors leave out grant numbers. <br /> <br /> On top of this there’s the lack of standardization in naming of the funding bodies themselves...
  • So why is this important? Without any central database or standard way to store or search this data, all of the stakeholders struggle to get the information they need to fully analyze the outputs of funded research, and this impacts funding bodies, publishers and institutions. And any kind of large-scale analysis is extramely hard without a means to get hold of the data in a machine-readable format
  • When funding information is entered as free-form text by the author you are going to have inconsistencies - people will use abbreviations or alternative names or will misspell things. There’s no guarantee that you’ll be able to match up or de-duplicate the funding bodies and so a search for NIH might not return any publications that had research supported by National Institutes of Health, and so on… Also, NIH itself is ambiguous. Which nations are we talking about?
  • So FundRef is a collaborative solution to this problem, devised by both publishers and funders. It can benefit publishers, funders, research institutions, researchers, and the public. All parties have an interest in the outcomes of FundRef, and many have well-established processes for recording the distribution of funds and monitoring the research process, and the other for ingesting, processing and publishing the outcomes of the research. The piece that has been missing is the one that links these two sets of processes, and that is where FundRef comes in, recording this link and making it more visible.
  • We ran a year-long FundRef pilot that ran until March 2013, and involved these organisations - the publishers on the left, and the funding bodies on the right. On successful completion of the pilot project the CrossRef board approved the FundRef service to go into production, which we did with our launch on May 28th.
  • One of the key things that came out of the pilot and is central to the project is an agreed taxonomy of funding bodies. The FundRef Registry has been created from a list donated to the project by Elsevier, and currently consists of around 6500 international funder names, up 35% since our May 2013 launch. The list data is and will be freely available under a CC0 license waiver. The Registry is updated monthly, and new organizations suggested by publishers or funding bodies themselves are added after curation. This is the list that publishers should use to collect information from authors on submission.
  • To put this into context and explain in more detail how the process works: CrossRef hosts the funder registry which provides standard funder names to publisher submission systems. Publishers ask authors, at submission, to provide the name or names of the funding bodies and accompanying grant numbers. This funding information goes in to publishers’ production systems where it is stored as tagged XML and submitted to CrossRef with all of the other deposited metadata for each piece of content. <br /> Once the funding information is in the CrossRef database it becomes a searchable, either through our search interfaces or via one of our APIs, and publishers, funders, and other interested parties can query on a funding organisation or grant number to discover the resultant publications, or can look up a piece of content using other metadata and find out the funding sources. <br /> Publishers will be able to display this funding information in a structured way. For those publishers who are participating in CrossMark, the funding data will automatically appear in the Record tab of the CrossMark dialogue box. We strongly encourage publishers submitting FundRef information to also participate in CrossMark, as this further standardises the location of the information for readers, but of course it can also be displayed on the publisher’s site in metadata and full text.
  • But the key piece is that the funding information is now centrally stored in the CrossRef database and can be queried. These three pieces of information - the DOI, the funding source or sources and award numbers are tied together in the metadata, making each of them discoverable via any of the other. <br /> Taking this a step further, once this information is in the CrossRef database and ORCIDs are also being deposited, you have a scenario in which you can look up a researcher, find their publications, and see how their research was funded, or look up a grant number, see its associated DOIs and which researchers contributed to those publications. I’ll come back to querying the data later…. <br /> <br /> [Note: in the future if funders decide to assign CrossRef DOIs to grants, we could relate ORCIDs directly with awards in addition to go through a published document.
  • The first thing that publishers need to do is collect the funding data from authors when they submit their paper. Submission of grant numbers should be encouraged but isn’t mandatory, and of course the author will need to be able to submit multiple grant numbers and multiple funders. There will need to be an option for “no funding source” and also the opportunity for authors to select “other” and input the name of the organization if their source isn’t found in the Registry. If they do this, the name they input will be stored in the CrossRef metadata and will be added to a list to be verified and added to the Registry. <br /> <br /> ejournal press announced their fund ref integration in November.
  • The funder name that the author submits should come from the FundRef Registry and should be the standardised version of that name. In our FundRef Search we use an auto-complete function as the user types.
  • The second issue is that funding agencies are eager to see FundRef data populated and associated with publication records. So by definition, capturing the data at submission means that there is a pipeline delay for FundRef data being associated with published literature as these submissions make their way through the peer review process.
  • If you do have backfile content with funding information that you have already extracted, we’ve put together a tool to help you match the funding names in your content with the FundRef Registry. It uses Google Reconcile and is available on CrossRef Labs at this URL - there’s a really handy tutorial video that will talk you through how to use the tools to add FundRef IDs to your metadata.
  • If you do deposit within CrossMark, this is an example of what it will look like. You can see here that were we’ve got a very simple CrossMark deposit - the basic required information, and the FundRef data for one grant from one funding organisation, the National Science Foundation. The funder name and funder identifier are taken from the FundRef Registry, and you’ll notice that these funder identifiers are DOIs, for uniqueness and persistence. The funder name and funder identifier are required, the award number is optional. <br /> <br /> If an author submits a funder name that is not present in the Registry you *can* deposit it with CrossRef without an associated ID. Please don’t try to send us your own internal IDs because they will be rejected. Deposits with funder_names that aren’t in the Registry will be flagged to us and will be reviewed manually before being added to expand the registry. But I would stress that wherever a funder name does appear in the Registry it must be matched and deposited with it’s FundRef Funder ID. If you don’t submit the funder ID numbers your content will not appear in FundRef Search. <br />
  • I should mention at this point that if you are holding off joining CrossMark because you’re working out what additional metadata you will deposit and how to get hold of that metadata, it’s perfectly acceptable to join CrossMark without the additional metadata in order to get FundRef information showing for your content. <br /> In this CrossMark example the publisher has supplied publication dates. You don’t have to have any of this extra metadata ready - you can always deposit any additional CrossMark data at a later date, but take advantage of CrossMark to ensure that funding information is prominently displayed,
  • Then, when this data is in the CrossRef database, institutions, publishers, funders, and other interested parties can search on it, either through our FundRef Search interface or using one of our query APIs. FundRef Search is an interface specifically for looking up funding bodies and seeing papers that have resulted from their grants. If you want to look up award numbers or papers you will need to use CrossRef Metadata Search, which I will come to in a moment.
  • FundRef Search directs the user to search using one of the funding body names in the registry. It handles acronyms so NIH will bring up the National Institutes of Health as in this example. You’ll see that countries are listed - which is important because more than one country has a “National Science Foundation”...
  • Here I’ve used FundRef Search to look up the US NIH. You can see that it has returned a list of articles that have the NIH listed as a funder. In the first result we have the NIH listed as the funder but with no grant number. The second and third results show one grant number and then several. And the fourth article has NIH listed as one of three funding bodies, each with their own related award numbers. <br /> Looking to the left of the screen you can see the hierarchy of funding bodies taken from the Registry. The NIH falls under the US Dept of Health and Human Services, and below are all of the subsidiary funding bodies of the NIH itself. The default results are research funded by the organisation you searched on - but you have the option to include all subsidiary organisations too by checking the box at the top of the list. Then you will see results that list NIH and all of its subsidiary organisations. <br /> We’ve just added this heirarchical browsing in so it’s a little bit of a work in progress and we’re missing the heirarchies for a few organisations, but it should give some really useful options for viewing a wider or narrower group of related funding bodies.
  • As I said the FundRef Search interface lets you look up on funder names only - this is to allow us to pre-populate the standard names in the FundRef Registry as search terms. If you have other metadata and want to search on something else, you should use CrossRef Metadata Search, which as you might expect searches across all of the metadata in the CrossRef database.
  • Here I’ve entered a grant number and it has returned the associated journal article.
  • Or you can enter a CrossRef DOI and get the corresponding article metadata, including the funding information where it’s available.
  • Or you can enter an ORCID and return that author’s papers with the funding information included. While I’m explaining all of this I must include the obvious caveat: FundRef has been running for a little over 6 months now and while the data is growing we still have relatively little funding information in our database - around 50,000 DOIs have funding data at present, so if you search on a funding body and don’t see any results please don’t be alarmed - as more publishers deposit funding metadata you will start to see these results appear. The same is true of ORCIDs - a relatively small number of publisher depositing ORCIDs at this time, but again this will grow in the course of the year. <br /> So we really need our member publishers to join and start depositing as soon as possible in order to make this a useful resource. I hope that these examples give you an idea of the huge potential for discovery that FundRef is going to offer.
  • This is up from 28K in October. We are adding funder names to the database.
  • These are the CrossRef members who have signed up to FundRef so far (39) - those in bold have deposited metadata for more than 1000 records. Incidentally, 47 pubishers have depositing funding metadata, so Please do ensure that you sign the FundRef agreement before you start depositing so that we can list you as an official participant.

Research Attribution Using ORCID, FundRef, and Ringgold Research Attribution Using ORCID, FundRef, and Ringgold Presentation Transcript

  • Carol Anne Meyer Business Development and Marketing CrossRef @meyercarol ORCID: 0000-0003-2443-2804 Using ORCID, FundRef, and Ringgold Editorial Manager Users’ Group (EMUG) 20 June 2014
  • A not-for-profit trade association of global scholarly publishers
  • Improving scholarly communication through community collaboration 6-Word Mission
  • 1900 Members Representing 4600 Publishers
  • From 81 Countries
  • CrossRef Metadata Services CrossRef Metadata Search Multiple Resolution CrossRef APIs Bibliographic Management Document Delivery Link Resolvers CrossCheck CrossMark Article Level Metrics PreScore Powered by iThenticate Enables Reference Linking Cited-by Linking Linking Linked Data FundRef Text and Data Mining Threaded Publications NISO OA Indicator Journal Article Tag Set (JATS) Discovery and Delivery Evaluating Collaboration
  • CrossRef Metadata Services CrossRef Metadata Search CrossRef Multiple Resolution CrossRef APIs Bibliographic Management Document Delivery Link Resolvers CrossRef Plagiarism Check CrossRef Publication Record CrossRef Funding Data Article Level Metrics PreScore Enables CrossRef Reference Linking CrossRef Cited-by Linking Linking CrossRef Linked Data CrossRef Funding Data CrossRef Text and Data Mining Threaded Publications NISO OA Indicator Journal Article Tag Set (JATS) Discovery and Delivery Evaluating Collaboration
  • http://xkcd.com/285 /
  • • author (s) • journal title • article title • volume • issue • publication date • ISSN • page numbers • article IDs • internal identifiers • URL • DOI Sample CrossRef Bibliographic Metadata
  • Additional CrossRef Metadata • ORCID • CrossMark Updates (related CrossRef DOIs) Publication record information • Text and Data Mining Data • NISO Open Access Identifier
  • Additional Metadata for • 3 simple tags: funder_name funder_identifier award_number FundRef
  • A standard way of reporting funding sources for published scholarly research Launched May 2013 FundRef CrossRef Funding Data
  • The Funding Attribution Problem
  • <fn fn-type="financial-disclosure"> <p>This work was supported in part by NIH grant R01 GM094800B to G.J.J., a gift to Caltech from the Gordon and Betty Moore Foundation, and a stipend from the Bayerische Forschungsstiftung to M.P. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</p> </fn> </fn-group> </back> </article>
  • <body> ... <sec> <title>Funding</title> <p>This work was supported by the <grant-sponsor xlink:href="http://www.grf.org" id="GS1">Generic Research Foundation</grant-sponsor>, the <grant-sponsor xlink:href="http://www.energy.gov" id="GS2">Department of Energy</grant- sponsor> Office of Science grant number <grant-num rid="GS2">DE-FG02- 04ER63803</grant-num>, and the <grant- sponsor xlink:href="http://www.nih.gov" id="GS3">National Institutes of Health</grant-sponsor>. </p> </sec> </body>
  • Funding bodies cannot easily track the published output of funding Publishers cannot easily report which articles result from research supported by specific funders or grants Institutions cannot easily link funding received to published output Lack of standard metadata for funding sources makes it difficult to analyze or mine the data Why does this matter?
  • National Institutes of Health NIH? N.I.H.? National Institute of Health? Abbreviations, misspellings, translations...
  • The Solution
  • Publishe rs Relationship with authors submitting manuscripts Established publishing and peer-review systems Funders Relationship with researchers funded by agencies Established award systems and research management processes Institutions Funder compliance education Track funding received The Public Authors Want accountability for how contributions/taxes spent Have funding information at submission FundRef CrossRefFunding Data
  • FundRef Links Together Publishers and Funders
  • The FundRef Registry is taxonomy of 6500 funder names www.crossref.org/fundref/fundref_registry.html
  • FundRef Registry Publisher Submission System Grant Number Funder Production Systems CrossRef Database & Query APIs Funders Researchers Institutions Publishers SHARE
  • DOI Funding Source Award Number
  • Workflow
  • Collect
  • Collect1. Collect funding data from authors on submission using FundRef Registry taxonomy
  • http://labs.crossref.org
  • Deposit funding data at CrossRef
  • Display
  • Discover http://search.crossref.org/fundref
  • Search http://search.crossref.org/fundref
  • Results
  • Search by Other Metadata http://search.crossref.org
  • Search by Grant Number
  • Search by CrossRef DOI
  • Search by ORCID
  • Participate • Encourage researchers to submit CrossRef Funding Data at manuscript submission. (Hint: Ask for ORCIDs too!) • Use FundRef Search, CrossRef Metadata Search & CrossRef APIs to retrieve funding information • Provide feedback on tools • Use FundRef Registry for funding analysis • Always use CrossRef DOIs and ORCIDs when citing research output
  • • 128,000+ unique documents with funding data • 65% of the funder names from these relationships are in the FundRef Registry How Are We Doing?
  • AAAS ACSESS American Chemical Society American Diabetes Association American Institute of Physics American Psychiatric Publishing American Psychological Association American Physical Society American Society of Neuroradiology Association for Computing Machinery BioMed Central Bioscientifica Copernicus GmBH eLife Sciences Publications Elsevier FapUNIFESP (SciELO) Grupo Comunicar Hindawi Publishing Corporation Institute of Electrical & Electronics Engineers International Union of Crystallography Internet Medical Publishing IOP Publishing Journal of Humanity Journal of Rehabilitation Research & Development Just Medical Media, Ltd. KAMJE Kowsar Medical Institute Landes Bioscience MDPI AG National Library of Serbia Optical Society of America Oxford University Press Royal Society of Chemistry ScienceOpen Spandidos Publications Taylor & Francis The Royal Society Wiley-Blackwell http://www.crossref.org/fundref/fundref_agreement.html These 39 publishers have signed up
  • • CrossRef (with FundRef) provides the social and technology standards and practices that makes CHORUS and SHARE possible. • CrossRef DOIs directs interested parties to the correct documents • CrossRef’s existing metadata database will hold data about ORCID, FundRef, Open Access Indicators, Text and Data mining • CrossRef’s Application Programming Interfaces (APIs) and search interfaces will serve these new types of data. What Does CrossRef Funding Data Have to Do With Public Access?
  • www.crossref.org/fundref cmeyer@crossref.org Thank you!