Research performance measurement


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Research performance measurement

  1. 1. ResearchperformanceMeasurementMiss Elham AbiedPublic services Supervisor
  2. 2. RPM DefinitionIt Concerned with measuring the performance of:1. A researcher2. A collection of selected articles (specialized in onesubject)3. A journal or an institute.
  3. 3. RPM Uses• Identifying Research Trends: Researchers need to be able toidentify trends through citation analysis.• Tenure and Promotion: Administrators and heads of faculty needto evaluate a researcher’s performance.• Funding and Grant Applications: Authors need documentation todemonstrate their performance.• Research Tracking and Benchmarking: Institutions need to beable to track the performance of their faculty and benchmark theresearch output of their institution against other institutions.• Policy Setting: Policy makers need RPM data to ensure that thedecisions they make are informed and based on unbiased, credibleresearch.• Peer-Review Process: Editors need RPM data to aid in the selectionof editorial board members and reviewers.
  4. 4. H IndexIt’s an index that attempts to measure boththe productivity and impact of the publishedwork of a scientist or scholar.It is based on the set of the scientists mostcited papers and the number of citations thatthey have received in other peoplespublications.
  5. 5. H Index (Cont.)It can also be applied to the productivityand impact of a group of scientists such as:»Department»University»Country»Subject
  6. 6. H Index (Cont.)A scholar with an index of H has published# papers each of which has been cited byothers at least # times.Thus, the h-index reflects both the numberof publications and the number of citations perpublication.
  7. 7. The meaning of the h-index can be explainedas follows:1. 1 scientist has 15 publications2. 10 of them cited at least 10 times or more notless by others.So, h-index of the scientist is 10, indicatingthat the other 5 publications may have lessthan 10 citations.H Index : How to calculate
  8. 8. Sources where from you can collect your worksand it’s citation are (Web of Science, GoogleScholar and Scopus)1. Find the citations of each of your publication periodicallyfrom different sources (Web of Science, Google Scholar andScopus). Available only if you subscribed to2. Rank them according to the number of citations received.3. Pick up the top h publications with a minimum of hcitations.This will give you the h-index of your scientific output.H Index : How to calculate
  9. 9. H Index : E-Tools to calculate it1. Quadsearch: available at: example: see the following screen shoots:
  10. 10. H Index : E-Tools to calculate it2. Publish or Perish: Publish or Perish is a software programthat retrieves and analyzes academic citations. It usesGoogle scholar to obtain the raw citations, then analyzesthese and presents the following statistics:Total number of papersTotal number of citationsAverage number of citations per paperAverage number of citations per authorAverage number of papers per authorAverage number of citations per yearHirschs h-index and related parametersEgghes g-indexAvailable to download at:
  11. 11. 3. Scopus Citation Tracker:a tool to collect a scientist works and create the H-index for him or for hispublication within time period or a specific subject field.Note: Available only if you subscribed to individually or through your organization.A help documents explaining how to use is available at: Index : E-Tools to calculate it
  12. 12. 1. The value of h will vary between subjects which should be takeninto account when comparing authors.2. To have a reasonably good h-index it is not sufficient to have afew publications with hundreds of citations.The use of h-index aims at identifying researchers with morepapers and relevant impact over a period of time.3. The h-index does not take into account the physical age of theauthors being evaluated.So it grows as citations accumulate and thus it depends onthe academic age of a researcher.About the H-Index
  13. 13. About the H-Index4. A scientist with a high h-index may have stoppedpublishing some time ago whereas a currently activeresearcher with a low h-index has the potential to behighly cited at some point in the future.This means that when, for example, two scientistsare being evaluated for grant allocation, it is possiblethat a seasoned scientist might be favored over thenew ‘hot’ talent in the field as a result of time.
  14. 14. Impact FactorThe impact factor (IF) is a measurereflecting the average number of citations toarticles published in journals.It is frequently used as an indicator for:– Determine the relative importance of a journalwithin its field.– Compare them to each other in the same field.
  15. 15. Calculating Impact FactorsE.g., the 2009 Impact factor for a journal =Number of citations in the current year (2009) fora journal–––––––––-––––––––––––––––––––––––––––––––Number items published in the journal for the last 2years (2007 & 2008)
  16. 16. Other Related indices• Immediacy index:Rapid rate of citation process for articles published in a specific journalin the current yearnumber of citations the articles in a journal receive in a given yearnumber of articles published• cited half-life:the median age of the articles that were cited in Journal Citation Reports each year(The number of years that the total citations takes to decline to 50% of its value)• the aggregate impact factor for a subject category:Number of citations in the current year for all journals in a specific subjectNumber items published in the journal for the last 2 yearsNote: Comparisons of impact factors should only be made for journals inthe same subject area.
  17. 17. The value of the impact factor is affectedby:• Sociological factors include the :1. Subjectivity:• fundamental and pure subject areas have higher averageimpact factor than specialized or applied ones.• Multiple Authorship (Average number of authors per paper)varies according to subject area (social or life science)Affecting Factors
  18. 18. Affecting Factors2. The type of journal• review articles can raise the impact factor of the journalrather than research reports or papers.• Internal cross referral or self-citation can have an effect onthe impact factor of a journal. So its urgent to know the realone by excluding self-cites from the total cites.• Rapid publication time
  19. 19. Where we can findImpact factors are listed in Journal CitationReports JCR)You can easily get to the JCR from the Web of scienseIf you want to see the IF for many journals go to:
  20. 20. Thanks,Practice an assignment