This is the Chinese word for ‘CRISIS’ The first symbol represents ‘Danger’ – libraries are facing a lot of them: Baby Boomer retirements Budget cuts/downsizing Lack of corporate knowledge retention Old school librarians focused on preservation of the status quo Managers that are focused on bottom line IT starting to recognize that they aren’t simply ‘pipes’ – taxonomies, etc. The second symbol is ‘Opportunity’ – we have several of them ahead of us, depending upon our perspective and response to the changing environment: Library positioned as objective authority in organization Lots of retirements = opportunities to hire new people with new ideas Advantage of government works and copyright Semantic Web requires authoritative data sources to ‘mashup’ – the Feds have tons of it! Digitization could become common with OCA and Google efforts Teleworking will REQUIRE a digital library All major content will be available online in 10-15 years Science is becoming global Federal libraries will consolidate to the agency level Data mining of full text will be the next big tool of choice Working for the Federal Government allows you to do something that really makes a difference, something of value
Need to know what your organization needs in order to produce the right measures. The balanced scorecard is a strategic planning and management system that is used extensively in business and industry, government, and nonprofit organizations worldwide to align business activities to the vision and strategy of the organization, improve internal and external communications, and monitor organization performance against strategic goals. It was originated by Drs. Robert Kaplan (Harvard Business School) and David Norton as a performance measurement framework that added strategic non-financial performance measures to traditional financial metrics to give managers and executives a more &apos;balanced&apos; view of organizational performance. While the phrase balanced scorecard was coined in the early 1990s, the roots of the this type of approach are deep, and include the pioneering work of General Electric on performance measurement reporting in the 1950’s and the work of French process engineers (who created the Tableau de Bord – literally, a &quot;dashboard&quot; of performance measures) in the early part of the 20th century.
The Naval Research Laboratory is the corporate research lab for the Navy and Marine Corps – Industrially funded (meaning they get funding from other government funding agencies, including the Office of Naval Research) – primarily based in DC, but with remote locations across the country. NRL’s mission is to prevent surprise on battlefield and ensure overwhelming dominance. NRL invented radar, GPS, the first spy satellite and shipboard fire suppression systems. Recognizing that most federal research is no longer captured in research reports but instead resides in commercial publications, conference proceedings, US patent applications, MS Word files, and PowerPoint slides, the NRL Research Library has expanded our efforts to capture as much of this information as possible. Much of this was captured using API access to the Thomson-Reuters Web of Science database and the Elsevier Science Scopus database.
Having a list of publications for your customer based, you can create objective reports like this mock-up. http://becker.wustl.edu/impact/assessment/index.html There are several ways to measure research impact: By the numbers – counting how many publications were made Referenced - determining if the research was referenced, including counting how many references were made to those publications Measure individuals or groups Capture the ‘intellectual output’ of the organization Capturing already published info – no author intervention required + historical info Can capture traditional and non-traditional publications including notebooks, presentations, etc. Should involve/integrate with approval chain to capture new thru required processes Should reduce effort of approvers and authors to be successful Providing easy web tool for reviews & promotions (annual summary) Bragging rights of Top 25 most cited publications Expertise list by reviewing pubs and citation counts – can search keywords Creating compendium of pubs for retiring scientists before leaving A form of digital preservation Can provide an analysis of publishing patterns to influence collection development Can also inform authors of publishing strategies to ensure maximum impact of research Objective Analysis of publications and impact (citations) Publication strategies
The Scopus Journal Analyzer enables you to search for journals within a specific field, identify which are the most influential and find out who publishes them. This will help you to decide where to publish to get the best visibility for your work and how to prioritize your submissions. It can also help you decide which journal you would like to review for publications. Journal Citation Reports® offers a systematic, objective means to critically evaluate the world&apos;s leading journals, with quantifiable, statistical information based on citation data. By compiling articles&apos; cited references, JCR Web helps to measure research influence and impact at the journal and category levels, and shows the relationship between citing and cited journals. Available in Science and Social Sciences editions.
The RePORT (Research Portfolio Online Reporting Tools) website provides access to a variety of reporting tools, reports, data, and analyses of NIH research activities. One of the tools available on the RePORT site is the RePORTER (RePORT Expenditures and Results) module. RePORTER is an electronic tool that allows users to search a repository of NIH-funded research projects and access publications and patents resulting from NIH funding. The RePORT Expenditures and Results (RePORTER) system is an electronic tool that allows users to search a repository of both intramural and extramural NIH-funded research projects from the past 25 years and access publications (since 1985) and patents resulting from NIH funding. In addition to NIH-funded research, the system provides access to research supported by the Centers for Disease Control and Prevention (CDC), the Agency for Healthcare Research and Quality (AHRQ), the Health Resources and Services Administration (HRSA), the Substance Abuse and Mental Health Services Administration (SAMHSA), and the U.S. Department of Veterans Affairs (VA). RePORTER retains all of the search capabilities of the former CRISP system, while providing additional query fields, hit lists that can be sorted and downloaded to Excel, NIH funding for each project (expenditures), and the publications and patents that have acknowledged support from each project (results). For many years, one of the most common ways for the public to find information on NIH research programs was to search for projects in the NIH CRISP (Computer Retrieval of Information on Scientific Projects) system. With a new legislative mandate, included in the NIH Reform Act of 2006, to provide access to publications and patents resulting from NIH expenditures, and the additional requirement to provide an electronic system for consistently classifying NIH research projects into categorical areas of research, the CRISP system has undergone a major overhaul. The new system is called the RePORT Expenditures and Results module, RePORTER. RePORTER retains all of the search capabilities of the CRISP system it replaces, while providing additional query fields, hit lists that can be sorted and downloaded to Excel, NIH funding for each project (expenditures), and the publications and patents that have acknowledged support from each project (results). RePORTER also provides links to PubMed Central, PubMed, and the US Patent & Trademark Office Patent Full Text and Image Database for more information on research results. The query form allows the user to generate queries by entering terms or making fielded selections, and the results of the query are returned in a project listing that includes the project number, subproject identifier (if applicable), project title, contact principal investigator, performing organization, fiscal year of funding, NIH administering and funding Institutes and Centers (IC), and the fiscal year total costs provided by each funding IC. The project number, subproject id, and the project title are clickable and linked to more detailed information on several Project Information tabs, including Description, Details, Results, and Subprojects (for multi-project grants only).
eSPA: Evaluating the Outputs and Impact of NIH Funding eSPA supports the NIH mission by providing a comprehensive solution for program planning and evaluation staff and NIH leadership to search, build, and collaboratively review and analyze portfolios of NIH research projects. eSPA combines modern search and business intelligence reporting tools to provide indicators on quality, relevance, and impact using data from IMPACII, iEdison, NIDB, NLM MEDLINE, Thomson Reuters Web of Science and Journal Citation Reports, and USPTO Patent Applications and Grants. An eSPA user can analyze the outputs and outcomes associated with a project or a “group” of projects called portfolios. An eSPA user builds a portfolio by searching eSPA and adding the projects returned to a portfolio or by importing a list of grant numbers which are then associated with the appropriate projects and then added to a portfolio. Once established, a portfolio’s outputs and outcomes can be analyzed or exported to Excel for reporting purposes. eSPA is currently in use by over 850 NIH staff at 22 NIH ICs.
Impact & Productivity Measurements in
a Changing Research Environment
Oct. 27, 2010
Renaissance Washington, DC DuPont Circle Hotel
James King, DC/SLA President
The library’s (potential) role inThe library’s (potential) role in
creating research metrics for theircreating research metrics for their
These slides represent the work and opinions of the
presenter and do not constitute official positions of the
Naval Research Laboratory (NRL), the U.S. Navy, the
National Institutes of Health (NIH) or the Department
of Health and Human Services (HHS).
References to any specific commercial products by
trade name, trademark, manufacturer, or otherwise,
does not necessarily constitute or imply its
endorsement, recommendation, or favoring by NRL, the
U.S. Navy, NIH, or HHS.
No animals were harmed making this presentation
“It ought to be remembered that
there is nothing more difficult to take
in hand, more perilous to conduct, or
more uncertain in its success, than to
take the lead in the introduction of a
new order of things. ” - Machiavelli
“It is time for a new generation of leadership to
cope with new problems and new opportunities.
For there is a new world to be won.”
- John F. Kennedy
Electronic Scientific Portfolio AssistantElectronic Scientific Portfolio Assistant
Multi-Dimensional Science Management ToolMulti-Dimensional Science Management Tool
eSPA supports the NIH mission
by providing a comprehensive
solution for program planning
and evaluation staff and NIH
leadership to search, build, and
collaboratively review and
analyze portfolios of NIH
Information Wants to Be FreeInformation Wants to Be Free
“On the one hand information wants to be
expensive, because it's so valuable. The
right information in the right place just
changes your life. On the other hand,
information wants to be free, because the
cost of getting it out is getting lower and
lower all the time. So you have these two
fighting against each other.”
First Hackers' Conference in 1984
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.