Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

I-Metrics: biblio-, web-, alt- & usage- metrics


Published on

A atual revolução na avaliação de pesquisa é devido a uma série de fatores que estão presentes há vários anos, mas que agora estão convergindo para oferecer um novo cenário onde a presença na web das iniciativas em Acesso Aberto, dos repositórios institucionais, dos portais de periódicos e dos pesquisadores individuais desempenha um papel muito importante. O ranking de Universidades Webometrics há muito tempo antecipou muitas das novidades teóricas e práticas e suas ferramentas ainda são valiosas para descrever os novos processos científicos e sociais que estão afetando não só a academia, mas a todos os atores ligados de alguma forma para o avanço científico, a disseminação das atividades, a divulgação dos resultados e implementação socioeconômica das inovações.

The current revolution in research assessment is due to a series of factors that have been present for several years but that now are converging for offering a new scenario where the Open Access initiatives, the institutional repositories, the portals of journals and the researchers individual web presence are to play a very important role. Webometrics long ago anticipated many of the theoretical and practical novelties and its tools are still valuable for describing the new scientific and social processes that are affecting not only to the academia but to all the actors linked in one or other way to the scientific advance, dissemination of the activities, popularization of the results and the socio-economic of the implementation of the innovations.

La revolución actual en la evaluación de la investigación se debe a una serie de factores que han estado presentes durante varios años, pero que ahora están convergiendo para ofrecer un nuevo escenario en el que las iniciativas de Acceso Abierto, los repositorios institucionales, los portales de revistas y la presencia individual de los investigadores en el Web, van a jugar un papel muy importante. La webometría hace mucho tiempo ha anticipado muchas de las novedades teóricas y prácticas y sus herramientas siguen siendo valiosas para describir los nuevos procesos científicos y sociales que afectan no sólo a la academia sino a todos los actores vinculados de una u otra manera con el avance científico, la difusión de las actividades, la divulgación de los resultados y el desarrollo socio-económico de la aplicación de las innovaciones.

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

I-Metrics: biblio-, web-, alt- & usage- metrics

  1. 1. I-Metrics biblio-, web-, alt- & usagemetrics Isidro F. Aguillo
  2. 2. AGENDA  BORED – Journal-level Metrics (infamous Impact Factor) – Citation-only Analysis (unreliable h-Index) – Metadata focused repositories  COOL – Identifiers – Article Level Metrics (ALM) – Altmetrics (not only ALM)  BETA – Profiles • Composite indicators • Visualization • Rankings 2
  3. 3. Current situation  Priorities for editors, librarians, intermediaries – Journal is the unit: continent not content focused – Article is the unit: the bibliographic record, its metadata description – Journals Portals: emphasis is on open access • Unreliable biased metrics (Redalyc)  Priorities for scientists, academicians, policy managers – Visibility: Barriers to crawling in most of the repositories: Huge gaps in Google Scholar coverage – Evaluation: Metrics are relevant at author or institutional level • Not exactly PLoS model: Article-level metrics (also by Altmetric) • A big issue is the lack of identifiers – Intellectual property • OA priority as an excuse for abuses in personal and institutional attributions (moral rights) 3
  5. 5. A Plea for Personal Profiles  Sources – Commercial bibliographic databases (WoS, Scopus,…) – Public Web search engines, incl. academic ones (GS, MS AS, Mendeley) – Social Web platforms (, ResearchGate, LinkedIn, Wikipedia, YouTube, Twitter, …) – Personal (and group) webpages – Repositories  Metrics – Activity: Formal (peer-reviewed papers/chapters/monographs), Informal – Visibility: Inclusion in repositories, bibliographic databases/search engines – Impact: Citations, Links, Mentions (incl. likes, discussions & similar) – Usage: Visits, Visitors (incl. followers), Downloads  Integration (and visualization) – A model like … ImpactStory Plus or PlumX 5
  6. 6. A model for I-Metrics BIBLIOMETRICS WEBOMETRICS Number of times the bibliographic record (identifier) of a paper/book is cited in another similar formally published paper Number of times the URL of a document/author webpage is linked from another webpage Document-level metrics Title Source:Journal/Book/Patent Publication Year Citations Identifier: URL/DOI/Handle Subject/Tags Author-level metrics ALTMETRICS Number of times the elements are mentioned (shared) in websites, wikis, blogs, soci al bookmarks and networks (incl. Twitter) or search engines 6 Author(s) Institution (Affiliation) Publication Year Discipline/Tags Web profiles Web 2.0 profiles USAGEMETRICS Number of times the document is read/visited/downloaded from its publishing place (incl. websites)
  7. 7. Personal (Bibliometric) Profiles (I) 7
  8. 8. Rankings 8
  9. 9. Hey, Google Scholar We badly need an API!! 9
  10. 10. Personal (Bibliometric) Profiles (II) 10
  11. 11. Visualization 11
  12. 12. New actors (I) 12
  13. 13. New actors (II) 13
  14. 14. Webometrics for individuals, not yet? … 14
  15. 15. Altmetrics for individuals, not yet? … 15
  16. 16. (Super)Repositories for individuals, not yet? … 16
  17. 17. Usagemetrics for individuals, not yet? … 17
  18. 18. Not against intermediaries, but Institutions & authors FIRST! 18
  19. 19. IMHO … Personal Institutional Webpage  From Profile to Portfolio – Institutionally hosted • Prestige, authority, long-term preservation – Caring about Identifiers – Not only Metrics • Beyond CV: Narrative introduction • Updated frequently: Twitter, Blog or similar • Outlinks rich  But also Metrics – APIs based: Objectivity, Reliability • Absolute and relative (rankings) figures – Network visualization: topics, colleagues, institutions – Public (interactive) dashboard • Current standard Google Analytics needs to (publicly) emerge 19
  20. 20. Powered by Harvard’s 20
  21. 21. Combined with … PlumX 21
  22. 22. Open forum Thank you! 22