King jame(3)


Published on

Published in: Health & Medicine, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Must get the disclaimers out of the way…
  • This is the Chinese word for ‘CRISIS’
    The first symbol represents ‘Danger’ – libraries are facing a lot of them:
    Baby Boomer retirements
    Budget cuts/downsizing
    Lack of corporate knowledge retention
    Old school librarians focused on preservation of the status quo
    Managers that are focused on bottom line
    IT starting to recognize that they aren’t simply ‘pipes’ – taxonomies, etc.
    The second symbol is ‘Opportunity’ – we have several of them ahead of us, depending upon our perspective and response to the changing environment:
    Library positioned as objective authority in organization
    Lots of retirements = opportunities to hire new people with new ideas
    Advantage of government works and copyright
    Semantic Web requires authoritative data sources to ‘mashup’ – the Feds have tons of it!
    Digitization could become common with OCA and Google efforts
    Teleworking will REQUIRE a digital library
    All major content will be available online in 10-15 years
    Science is becoming global
    Federal libraries will consolidate to the agency level
    Data mining of full text will be the next big tool of choice
    Working for the Federal Government allows you to do something that really makes a difference, something of value
  • Need to know what your organization needs in order to produce the right measures.
    The balanced scorecard is a strategic planning and management system that is used extensively in business and industry, government, and nonprofit organizations worldwide to align business activities to the vision and strategy of the organization, improve internal and external communications, and monitor organization performance against strategic goals. It was originated by Drs. Robert Kaplan (Harvard Business School) and David Norton as a performance measurement framework that added strategic non-financial performance measures to traditional financial metrics to give managers and executives a more 'balanced' view of organizational performance.  While the phrase balanced scorecard was coined in the early 1990s, the roots of the this type of approach are deep, and include the pioneering work of General Electric on performance measurement reporting in the 1950’s and the work of French process engineers (who created the Tableau de Bord – literally, a "dashboard" of performance measures) in the early part of the 20th century.
  • The Naval Research Laboratory is the corporate research lab for the Navy and Marine Corps – Industrially funded (meaning they get funding from other government funding agencies, including the Office of Naval Research) – primarily based in DC, but with remote locations across the country.
    NRL’s mission is to prevent surprise on battlefield and ensure overwhelming dominance. NRL invented radar, GPS, the first spy satellite and shipboard fire suppression systems.
    Recognizing that most federal research is no longer captured in research reports but instead resides in commercial publications, conference proceedings, US patent applications, MS Word files, and PowerPoint slides, the NRL Research Library has expanded our efforts to capture as much of this information as possible. Much of this was captured using API access to the Thomson-Reuters Web of Science database and the Elsevier Science Scopus database.
  • Having a list of publications for your customer based, you can create objective reports like this mock-up.
    There are several ways to measure research impact:
    By the numbers – counting how many publications were made
    Referenced - determining if the research was referenced, including counting how many references were made to those publications
    Measure individuals or groups
    Capture the ‘intellectual output’ of the organization
    Capturing already published info – no author intervention required + historical info
    Can capture traditional and non-traditional publications including notebooks, presentations, etc.
    Should involve/integrate with approval chain to capture new thru required processes
    Should reduce effort of approvers and authors to be successful
    Providing easy web tool for reviews & promotions (annual summary)
    Bragging rights of Top 25 most cited publications
    Expertise list by reviewing pubs and citation counts – can search keywords
    Creating compendium of pubs for retiring scientists before leaving
    A form of digital preservation
    Can provide an analysis of publishing patterns to influence collection development
    Can also inform authors of publishing strategies to ensure maximum impact of research
    Objective Analysis of publications and impact (citations)
    Publication strategies
  • The Scopus Journal Analyzer enables you to search for journals within a specific field, identify which are the most influential and find out who publishes them. This will help you to decide where to publish to get the best visibility for your work and how to prioritize your submissions. It can also help you decide which journal you would like to review for publications.
    Journal Citation Reports® offers a systematic, objective means to critically evaluate the world's leading journals, with quantifiable, statistical information based on citation data. By compiling articles' cited references, JCR Web helps to measure research influence and impact at the journal and category levels, and shows the relationship between citing and cited journals. Available in Science and Social Sciences editions.
  • The RePORT (Research Portfolio Online Reporting Tools) website provides access to a variety of reporting tools, reports, data, and analyses of NIH research activities. One of the tools available on the RePORT site is the RePORTER (RePORT Expenditures and Results) module. RePORTER is an electronic tool that allows users to search a repository of NIH-funded research projects and access publications and patents resulting from NIH funding.
    The RePORT Expenditures and Results (RePORTER) system is an electronic tool that allows users to search a repository of both intramural and extramural NIH-funded research projects from the past 25 years and access publications (since 1985) and patents resulting from NIH funding. In addition to NIH-funded research, the system provides access to research supported by the Centers for Disease Control and Prevention (CDC), the Agency for Healthcare Research and Quality (AHRQ), the Health Resources and Services Administration (HRSA), the Substance Abuse and Mental Health Services Administration (SAMHSA), and the U.S. Department of Veterans Affairs (VA).  RePORTER retains all of the search capabilities of the former CRISP system, while providing additional query fields, hit lists that can be sorted and downloaded to Excel, NIH funding for each project (expenditures), and the publications and patents that have acknowledged support from each project (results).
    For many years, one of the most common ways for the public to find information on NIH research programs was to search for projects in the NIH CRISP (Computer Retrieval of Information on Scientific Projects) system. With a new legislative mandate, included in the NIH Reform Act of 2006, to provide access to publications and patents resulting from NIH expenditures, and the additional requirement to provide an electronic system for consistently classifying NIH research projects into categorical areas of research, the CRISP system has undergone a major overhaul. The new system is called the RePORT Expenditures and Results module, RePORTER. RePORTER retains all of the search capabilities of the CRISP system it replaces, while providing additional query fields, hit lists that can be sorted and downloaded to Excel, NIH funding for each project (expenditures), and the publications and patents that have acknowledged support from each project (results). RePORTER also provides links to PubMed Central, PubMed, and the US Patent & Trademark Office Patent Full Text and Image Database for more information on research results. The query form allows the user to generate queries by entering terms or making fielded selections, and the results of the query are returned in a project listing that includes the project number, subproject identifier (if applicable), project title, contact principal investigator, performing organization, fiscal year of funding, NIH administering and funding Institutes and Centers (IC), and the fiscal year total costs provided by each funding IC. The project number, subproject id, and the project title are clickable and linked to more detailed information on several Project Information tabs, including Description, Details, Results, and Subprojects (for multi-project grants only).
  • eSPA: Evaluating the Outputs and Impact of NIH Funding
    eSPA supports the NIH mission by providing a comprehensive solution for program planning and evaluation staff and NIH leadership to search, build, and collaboratively review and analyze portfolios of NIH research projects.
    eSPA combines modern search and business intelligence reporting tools to provide indicators on quality, relevance, and impact using data from IMPACII, iEdison, NIDB, NLM MEDLINE, Thomson Reuters Web of Science and Journal Citation Reports, and USPTO Patent Applications and Grants.
    An eSPA user can analyze the outputs and outcomes associated with a project or a “group” of projects called portfolios.  An eSPA user builds a portfolio by searching eSPA and adding the projects returned to a portfolio or by importing a list of grant numbers which are then associated with the appropriate projects and then added to a portfolio. Once established, a portfolio’s outputs and outcomes can be analyzed or exported to Excel for reporting purposes.
    eSPA is currently in use by over 850 NIH staff at 22 NIH ICs.
  • King jame(3)

    1. 1. Impact & Productivity Measurements in a Changing Research Environment Oct. 27, 2010 Renaissance Washington, DC DuPont Circle Hotel James King, DC/SLA President The library’s (potential) role inThe library’s (potential) role in creating research metrics for theircreating research metrics for their organizationorganization
    2. 2. DisclaimerDisclaimer  These slides represent the work and opinions of the presenter and do not constitute official positions of the Naval Research Laboratory (NRL), the U.S. Navy, the National Institutes of Health (NIH) or the Department of Health and Human Services (HHS).  References to any specific commercial products by trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favoring by NRL, the U.S. Navy, NIH, or HHS.  No animals were harmed making this presentation
    3. 3. “It ought to be remembered that there is nothing more difficult to take in hand, more perilous to conduct, or more uncertain in its success, than to take the lead in the introduction of a new order of things. ” - Machiavelli “It is time for a new generation of leadership to cope with new problems and new opportunities. For there is a new world to be won.” - John F. Kennedy
    4. 4. Balanced ScorecardBalanced Scorecard
    5. 5. Capturing corporate knowledgeCapturing corporate knowledge
    6. 6. Measuring Research ImpactMeasuring Research Impact
    7. 7.
    8. 8. Self-Service ToolsSelf-Service Tools
    9. 9. Research Portfolio Online Reporting ToolsResearch Portfolio Online Reporting Tools (RePORT)(RePORT)
    10. 10. 10 Electronic Scientific Portfolio AssistantElectronic Scientific Portfolio Assistant Multi-Dimensional Science Management ToolMulti-Dimensional Science Management Tool eSPA supports the NIH mission by providing a comprehensive solution for program planning and evaluation staff and NIH leadership to search, build, and collaboratively review and analyze portfolios of NIH research projects. 10
    11. 11. Information Wants to Be FreeInformation Wants to Be Free “On the one hand information wants to be expensive, because it's so valuable. The right information in the right place just changes your life. On the other hand, information wants to be free, because the cost of getting it out is getting lower and lower all the time. So you have these two fighting against each other.” Stewart Brand First Hackers' Conference in 1984
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.