Our involvement with REF stems from the work we did on the RAE. The library assisted in the administration of the RA2 element of the RAE for the university.2 key tasks1. Validating and sometimes adding metadata for selected publications – needed to understand publication Metadata and HEFCE field requirements2. Sourcing full text items, either by constructing links ( DOI or obtaining publications e.g. books). Money set aside to purchase items where necessary.There was a recognition we had relevant skills.
There was a recognition that in order to meet the emerging requirements of REF we would need to do thinks differently. The University has made improving its research performance on of its key priorities. Part of this is the recognition that we would need to develop our processes and our information systems in order to meet the emerging requirements of REF. The library with P & D and CSD put together a business case is to embed the repository within the RMS – called TULIP/IRIS at Liverpool - to meet the requirements for REF and to allow open access to publications. There is a recognition in the Uni that there is an advantage, a not only a citation advantage, to have publications disseminated as a widely as possible.The business case was accepted and funding from this September; we’re in the early stages of this project.
Rightscom (2009) A project to identify successful models for embedding repositories in research management systems and processes within higher education institutions . London: Rightscom.Find no implementation of a research management system with embedded repository; where both RMS and IR’s do exits in the same HEI they are not well integrated.We’re trying to do something new, although I’m aware we’re not the only ones e.g. Southampton.
Integrate the Institutional Repository (IR) seamlessly with TULIP, ensuring that academic staff only have to input data once.Ensure that all research publication outputs are deposited in the IR.Ensure that control of the integrity of the data and the metadata in the IR is maintained by the Library, and not dependent upon the (inevitably variable) efforts of individual academic staff members.Ensure that the bibliometric requirements of REF can be easily supplied from the repository/system and that the data it contains can easily be re-purposed for other functions – for example departmental web pages.Ensure that the University can meet the requirements of research councils and other grant-giving bodies that require publications resulting from funded work to be made available on open access
Capture and management of the full text and associated metadata of all research publications produced by academic staff and doctoral students.This includes small data sets, images and electronic media and the recoding of details on other objects where they are not already defined within TULIP/IRIS e.g. artifacts. This excludes long term digital preservation, large data sets and learning materials. Production of management information and reports. The data collected will be included as part of the REF return. Data will be exported to citation systems to enable benchmarking and performance management. Reports will be supplied to Head’s of Department and other nominated staff to enable them to monitor compliance with the requirement to contribute data to the Research Archive.Open access to research publications of University staff and doctoral students. The full text of all research publications will be made available on open access, subject to copyright. Automated collection of publication and citation data.The capacity to link the Research Archive to collect data linked to university staff from externals sources such as Pubmed, Scopus and Web of Science.A searchable web research oracle. Included are criteria for providing rankings and the provision of identification of the searcher. Excluded is the potential to harvest such preferences and provide customized screens or communications. Integration of E-Prints with core University systems including TULIP and IRIS (Oracle based)
The first stage of the project is analyse how academic departments collect, store an manage bibliographic metadata; design and begin to develop appropriate data collection tools and processes Identify external sources of bibliographic metadata and begin to develop tools and processes to enable them to be used to supplement data inputted by academic staffFor output data, the RAE specifications were again used. Some additional fields were requested to help in matching outputs to citation databases. A comprehensive list of outputs (in addition to journal articles) was sought, to provide a context for benchmarking indicators and tracking publication behaviour. A third necessary and central part of the data requirement for the REF pilot project was the association of output data with named staff for the author-model. Institutions were asked to provide a pair-wise association between staff and publication IDs
Key principal of the development is that the data should only need to be entered once.The Portfolio of Activity requires staff enter details of all of their publications in the previous year; its a key Part of the Professional Development Review which is one of the mechanisms for improving research performance. The integration of the IR and RMS should mean that data collected can be re-used in a variety of
Link research interests; availability for consultancy; awards; biography; publications and pull it all together flexibly into a profile.Similarly, publications data element will re-used data from the repository.
Citation countsAPI from Scopus, can also use WoS
Summary metrics Citation Metrics,Disciplinarity Metrics, Collaboration MetricsVizualizations of expected citation counts, standing in comparison to benchmarksAn intuitive Web interfaceMetrics based on objective and respected Web of Science® dataStandard analytics and benchmark dataCustomer-specific datasets and metricsReporting functionality, summarization, and visualizationLinks to Web of Science records Exporting of data and graphs, and PDF creation
We’re also asking researchers what they would like the data for? Inclusion in grant applications, CV’s, personal web pages, Endnote or other reference management sites, academic social network sites,Look at the work PLOS are doing on article level metrics – going beyond citations and trying to track the conversation happening online around research. We’re going to ask them but perhaps we can have an API so that people can develop their own applications to re-use the data?
This quote comes from the RIN report Ensuring a bright future for research libraries. I doubt you’d find a librarian that would disagree with this, who doesn’t believe that a good library is an essential underpinning for research and that cutting back on the library would have a negative impact on research performance.But there are dissenting voices asking what is the relevance of the library?
The ACRL say the relevance of the library is under question and have commissioned a report - Value of Academic Libraries Comprehensive Research Review and Report – intended to evidence or to identify gaps in the evidence about the performance of academic libraries.Specifically on research they are seeking evidence to enable them to answer two questions. How does the library increase the amount of funding for research granted to the campus through its departments?How does the library increase the output of the institution’s researchers?
Journal use and expenditure correlate with research outcomes. Per capita expenditure and use of e-journals is strongly and positively correlated with paperspublished, numbers of PhD awards, and research grants and contracts income.These correlations are independent of institutional size. Per capita use of e-journals is nearly three times as high in Russell Group universities as it is in the new universities, although there is no signifcant difference in cost per download.
And if we don’t do it others will – This is from a recent announcement made by the Wellcome Trust – note that they intend to enable data and text mining of UKPMC
Another of PMR’s points. Close the science library, it will close soon anyway and move the staff into departments where they are close to the people they need to helpThere is a model for this. The Clinical Librarian (CL) Service at UHL NHS Trust takes information services into the clinical setting, responding to information needs that arise there. Information professionals join the multidisciplinary team at ward rounds and in clinical meetings and work in partnership with health professionals, promoting a questioning and learning culture in the organisation. The CL Service thus offers a mechanism for getting research evidence into practice and for clinical governance at the trust to be supported.
Librarians offer bespoke support in expert literature searching and reference management for any group undertaking a systematic review. This could be funded research or postgraduate students undertaking the review as assessed work. The level of support is adapted and customised to meet the needs of research groups and individuals. Clinical librarians embedded in research teams link back to PMR?Summary of library support activities: ■ Attendance at initial meetings and input into scoping of the review ■ Supported the bid process – providing broad search terms and advised on resources to search ■ Developed expert search strategy and translated terminology and operators for searching 8 subject specific bibliographic databases ■ Trained review group in use of advanced search operators ■ Set up customized reference software database to meet the groups information management needs for the project. Including output styles and tagging ■ Trained review group in using the reference software ■ Devised test exercise for recruitment of a research assistant to the review group ■ Supported research assistant in maintaining current awareness searches and using reference software ■ Ongoing advice and troubleshooting Staff resource and time: ■ Work was undertaken as business as usual with no additional resource provided (part of a portfolio of research support activity) ■ Additional staff time commitment needs to be negotiated and balanced within general workload ■ Approximately 15 hours to develop the search strategy and set up current awareness services. ■ Additional time commitment in ongoing support. ■ Library staff involved are cited as a member of the review group in any papers produced. Effects of support and impact on research: Library staff are an integral part of the project team at every stage, contributing to the initial successful bid and ongoing review work of the project team. This service is rolled out to other research groups and individuals, as new reviews are considered.
UKRDSLack of skills
The University of Reading has a large number of important repositories of archival data and collections of useful information. We will create a unified system that provides a single virtual interface for searching across all the repositories’ and collections, this will not only make the data and information more readily available, but also ensure that all the resources that need to be accessed would be easier to find and interact with. Within this project we will also integrate a social network for researchers within the University of Reading that will show that such a system can help researchers get to know each other, enable collaboration and ensure that it is possible to work more closely together on cross-disciplinary projects. We believe that it is important that new and existing researchers get to meet each other virtually in a secure environment and also share information about their own research and development too.
Library Support For Ref
Libraries and the Research Evaluation Framework<br />David Clay<br />NOWAL Board, Preston<br />23rd October 2009<br />
Outline<br />Systems and processes to support the Research Evaluation Framework <br />The relevance of academic libraries to research<br />
The library was involved with the administration of the RA2 element of the RAE<br />
Moving on to REF <br />The Library, Planning and Development and CSD and the Library submitted a business case for implementing systems to enable the University to meet the bibliographic requirements of REF and to allow open access to research publications<br />
An aside ….<br />Rightscom (2009) A project to identify successful models for embedding repositories in research management systems and processes within higher education institutions . London: Rightscom.<br />http://ie-repository.jisc.ac.uk/408/2/embedding_repositories_in_research_management_systems_final_report_20090923.pdf<br />
Project aims<br />Provide the required publication framework to support REF<br />Provide the university with an institutional repository of all research publications<br />Provide open access to research publications of University staff and doctoral students <br />Provide a single comprehensive source of quality metadata on research publications<br />Provide an searchable website or “oracle” of research excellence<br />
Project Workstreams<br />develop appropriate tools and process for the collection and quality assurance of the full text of publications and their associated metadata , including consideration of external data sources<br />develop a searchable ‘oracle’ and redevelop the web staff profile<br />Migrate publication metadata from TULIP; redevelop methods of data capture and presentation to integrate with ePrints. <br />consider the emerging requirements for REF and monitor data structures, data availability and data quality and adjust minor objectives of the other work streams. <br />
Migrating data from the existing EPrints MYSQL repository into Oracle<br />Oracle Open World San Francisco 2009. Larry Ellison and the Sun Oracle Database Machine. http://www.flickr.com/photos/oracleopenworld09/4013685670/<br />
Develop appropriate tools and processes for data collection <br />
Data re-used in Portfolio’s of Activity, part of the Performance Management process<br />
Develop a searchable ‘Oracle of Research Excellence” and <br />redevelop staff profile<br />
Searchable worldwide access to publications<br />
Citation counts embedded into the University of Liverpool Research Archive using the Scopus API<br />
Many pre-defined reports are presented for immediate use.<br />Citation Metrics provide fundamental information on the papers within a dataset and their collective citation influence. <br />Integration with citation analysis tools<br />Slides from Thompson Research Analytics presentation, Jon Stroll, March 2009<br />14<br />
Enable data to be re-used by researchers<br />
Deposit into specified repositories to comply with grant conditions<br />
The relevance of academic libraries to research performance<br />Good library and information services are an essential underpinning for research, just as they are for successful teaching and learning. Success in research, at both national and institutional levels, depends critically on the quality of the information services to which researchers have access.<br />RIN (2008 ) Ensuring a bright future for research libraries.<br />http://www.rin.ac.uk/our-work/using-and-accessing-information-resources/ensuring-bright-future-research-libraries <br />
Value of Academic Libraries Comprehensive Research Review and Report<br />How does the library increase the amount of funding for research granted to the campus through its departments?<br />How does the library increase the output of the institution’s researchers?<br />http://www.acrl.org/ala/mgrps/divs/acrl/issues/ACRL_RFP_Value.pdf<br />
E-journals: their use, value and impact<br />RIN & CIBER (2008) E-journals: their use, value and impact. London, RIN<br />http://www.rin.ac.uk/our-work/communicating-and-disseminating-research/e-journals-their-use-value-and-impact <br />
Peter Murray-Rust’s 12 Action Points for Librarians<br />Peter Murray-Rust (2009) Keynote presentation given at Internet Librarian International.<br />http://www.vimeo.com/7130694<br />
Text and Data mining<br />Wellcome Trust calls for greater transparency from journals on open access costs http://www.wellcome.ac.uk/News/Media-office/Press-releases/2009/WTX057058.htm<br />
Take the librarians out of the library and into the lab<br />