Cobiss.net regional network for supporting knowledge and evaluating research performance

799 views
719 views

Published on

Presented during the Ministerial Round Table on Science and Higher Education. From Bilateral to pan-European Cooperation held over 21-22 May 2010 in Tirana, Albania

Published in: Art & Photos, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
799
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Cobiss.net regional network for supporting knowledge and evaluating research performance

  1. 1. COBISS.Net Regional Network for Supporting Knowledge and Evaluating Research Performance Slovenian Research Agency (ARRS) Dr. Franci Demšar, Director Institute of Information Science Mag. Tomaž Seljak, Director South Eastern European Expert Meeting 21th of May 2010 Tirana INSTITUTE OF INFORMATION SCIENCE
  2. 2. Ever-Relevant Questions • How much does each country contribute to the world treasury of knowledge? • How much does each country invest into research and development (R&D)? • How to record and promote country's research potential? - Role of transparency - Role of evaluation procedures • How to implement transparency and boost regional cooperation in the area of R&D? INSTITUTE OF INFORMATION SCIENCE
  3. 3. Web of Science INSTITUTE OF INFORMATION SCIENCE
  4. 4. Publications in Web of Science (2005 - 2010) 70.000 69.353 60.000 50.000 40.000 30.000 20.000 16.075 16.063 16.026 12.505 10.000 2.990 1.676 1.632 474 0 Montenegro Macedonia Herzegovina Austria Albania Slovenia Serbia Croatia Bulgaria Bosnia and INSTITUTE OF INFORMATION SCIENCE
  5. 5. Publications in Web of Science (per 1000 inhabitants) 9,00 8,32 7,93 8,00 7,00 6,00 4,82 5,00 4,00 3,63 3,00 2,17 2,00 1,57 1,00 0,80 0,44 0,15 0,00 Montenegro Herzegovina Macedonia Austria Slovenia Albania Serbia Croatia Bulgaria Bosnia and INSTITUTE OF INFORMATION SCIENCE
  6. 6. Ever-Relevant Questions • How much does each country contribute to the world treasury of knowledge? • How much does each country invest into research and development (R&D)? • How to record and promote country's research potential? - Role of transparency - Role of evaluation procedures • How to implement transparency and boost regional cooperation in the area of R&D? INSTITUTE OF INFORMATION SCIENCE
  7. 7. R&D as Percentage of GDP Source: Eurostat, http://epp.eurostat.ec.europa.eu/portal/page/portal/science_technology_innovation/introduction INSTITUTE OF INFORMATION SCIENCE
  8. 8. Annual Budget of the Slovenian Research Agency (ARRS) Mio. € 200 180 160 140 120 100 80 60 40 20 0 2004 2005 2006 2007 2008 2009 2010 INSTITUTE OF INFORMATION SCIENCE
  9. 9. Institutional Design and Position of ARRS Strategic Government of Science & level the RS technology council Other Policy level Ministry of MHEST Defence ministries Operational level TIA ARRS Executive level Scientific Community INSTITUTE OF INFORMATION SCIENCE
  10. 10. ARRS’s Main Areas of Operation Promotion of excellent and applicative research Monitoring and analysing Objective evaluation Funding of research INSTITUTE OF INFORMATION SCIENCE
  11. 11. Ever-Relevant Questions • How much does each country contribute to the world treasury of knowledge? • How much does each country invest into research and development (R&D)? • How to record and promote country's research potential? - Role of transparency - Role of evaluation procedures • How to implement transparency and boost regional cooperation in the area of R&D? INSTITUTE OF INFORMATION SCIENCE
  12. 12. ARRS's Information Infrastructure for Transparency of Research Results • ARRS’s Web Portal • SICRIS information system • COBISS.SI bibliographic system • WoS international citation indexes • Videolectures.com portal • Digital Library of Slovenia INSTITUTE OF INFORMATION SCIENCE
  13. 13. ARRS’s Web Portal INSTITUTE OF INFORMATION SCIENCE
  14. 14. Monthly Financial Overview INSTITUTE OF INFORMATION SCIENCE
  15. 15. SICRIS SlovenIan Current Research Information System • Developed and maintained by the Institute of Information Science (IZUM) and ARRS • Currently presented entities (databases): 800 research organisations 1300 research groups 13600 researchers 5200 research projects 300 research programs • Direct link to the COBISS bibliographic system through researcher's codes INSTITUTE OF INFORMATION SCIENCE
  16. 16. SICRIS: Presentation of a Researcher Personal bibliography Quantitative evaluation of bibliographic units Citations in WoS by year Data for ARRS’s tenders INSTITUTE OF INFORMATION SCIENCE
  17. 17. COBISS.SI Co-operative Online Bibliographic System and Services INSTITUTE OF INFORMATION SCIENCE
  18. 18. Bibliographic Records in the Union Bibliographic Database COBIB.SI Total number of bibliographic records 3,671,033 100% Monographs and other completed works 60% Serials 3% Articles and other component parts 35% Performed works 2% Number of records with at least one author 1,035,697 28% with the researcher's code Registering of bibliographies within COBISS.SI is mandatory for Slovenian researchers! INSTITUTE OF INFORMATION SCIENCE
  19. 19. Classification of Bibliographic Units in COBIB.SI • Classification of bibliographic units is based on the unique typology (definition) of documents/works: – Articles and other component parts (1.xx) 21 types – Monographs and other completed works (2.xx) 28 types – Performed works – events (3.xx) 7 types Examples: 1.01 Original Scientific Article, 1.02 Review Article, 1.04 Professional Article, 2.01 Scientific Monograph, etc. • Classification of units is done by authors or experts on the subject, whereas the classification is verified by specialised information centres for individual science disciplines INSTITUTE OF INFORMATION SCIENCE
  20. 20. Portal Videolectures.net INSTITUTE OF INFORMATION SCIENCE
  21. 21. Digital Library of Slovenia INSTITUTE OF INFORMATION SCIENCE
  22. 22. Funding of Research: Two-Step Evaluation Process ENTRANCE BIBLIOMETRIC CRITERIA DRAFT APPLICATIONS (Outline Proposals) PRE-SELECTION BIBLIOMETRIC CRITERIA A B ~ 100 % PROJECTS ON THE REJECTED PROJECTS BASIS OF PROJECT QUALITY ~ 100 % PHASE 1 PHASE 2 CALL FOR SUBMISSION OF FULL PROPOSALS Only selected Assessments are projects are invited sent to applicants EVALUATION MADE BY THE PANEL ON THE BASIS OF PEER REVIEW (international peers) – 2 per project FINAL LIST OF APPROVED PROJECTS Panel: scientific body & international peers Scientific Council of the Agency INSTITUTE OF INFORMATION SCIENCE
  23. 23. Quantitative Evaluation of Bibliographic Indicators in Slovenia • Bibliographies are evaluated when researchers apply for tenders issued by the Slovenian Research Agency and when they are elected to university titles • Methodology for the evaluation of bibliographic indicators of research performance (categorisation and rating by points) is defined by the regulations of ARRS and universities • Procedures related to the bibliographic unit categorisation and rating by points are automated, and are based on the interlinking of the SICRIS, COBISS.SI and WoS systems • Evaluation results are available to the public within the SICRIS system through researchers' and program/project groups' web pages INSTITUTE OF INFORMATION SCIENCE
  24. 24. Categorisation of Bibliographic Units in Terms of Quantitative Evaluation • Articles are categorised based on the journal impact factor, on whether they are indexed in different databases, on the number of citations, etc. • Monographs are categorised based on the publisher, scope, etc. • Conference proceedings are categorised based on the type and the importance of the conference • Patents are categorised based on the country granting a patent and/or the type of testing • … INSTITUTE OF INFORMATION SCIENCE
  25. 25. INSTITUTE OF INFORMATION SCIENCE
  26. 26. INSTITUTE OF INFORMATION SCIENCE
  27. 27. INSTITUTE OF INFORMATION SCIENCE
  28. 28. Publications in Scientific Journals with ISI Index 20000 18000 16000 14000 12000 10000 8000 6000 4000 2000 0 3 94 95 96 97 98 99 00 01 02 03 04 05 99 19 19 19 19 19 19 20 20 20 20 20 20 1 ar ar ar ar ar ar ar ar ar ar ar ar ar ye ye ye ye ye ye ye ye ye ye ye ye ye INSTITUTE OF INFORMATION SCIENCE
  29. 29. Ever-Relevant Questions • How much does each country contribute to the world treasury of knowledge? • How much does each country invest into research and development (R&D)? • How to record and promote country's research potential ? - Role of transparency - Role of evaluation procedures • How to implement transparency and boost regional cooperation in the area of R&D? INSTITUTE OF INFORMATION SCIENCE
  30. 30. COBISS.Net Regional network of national library information systems and current research information systems Information infrastructure for science, education and culture Support to knowledge and intercultural dialogue Project of international development cooperation INSTITUTE OF INFORMATION SCIENCE
  31. 31. From the COBISS System Concept to the Regional Library Network • The COBISS system was conceived in 1987 when the then Association of the Yugoslav National Libraries accepted the concept of shared cataloguing as the common basis of the library information system and the system of scientific and technological information of Yugoslavia; the role of the information and bibliographic utility was taken over by the Institute of Information Science (IZUM) from Maribor • After the breakup of Yugoslavia, libraries (55) outside Slovenia stopped participating in the shared cataloguing system, but almost all of them have gradually renewed the cooperation with IZUM • In 2003, the Agreement on the establishment of the COBISS.Net network and the free exchange of bibliographic records, created in autonomous library information systems of the participating countries, was signed between IZUM and the national libraries from Bosnia and Herzegovina, Macedonia, Montenegro, Serbia and Slovenia; in 2006, the aforementioned Agreement was also signed by the Bulgarian national library INSTITUTE OF INFORMATION SCIENCE
  32. 32. COBISS.Net Number of participating libraries Slovenia 393 Serbia 117 Macedonia 43 Bosnia and Herzegovina 40 Montenegro 26 Bulgaria 1 Total (30 April 2010) 620 INSTITUTE OF INFORMATION SCIENCE
  33. 33. Exchange of bibliographic records 11 November 2004 – 10 May 2010 Downloaded Downloaded Downloaded Downloaded Downloaded COBISS.Net from from from from from Total COBIB.SI COBIB.SR COBIB.MK COBIB.CG COBIB.BH COBISS.SI - 6,946 688 175 371 8,180 COBISS.SR 22,225 - 2,053 2,787 5,292 32,357 COBISS.MK 11,083 21,855 - 51 290 33,279 COBISS.CG 3,860 95,743 164 - 1,028 100,795 COBISS.BH 5,560 28,065 139 277 - 34,041 Total 42,728 152,609 3,044 3,290 6,981 208,652 Total saving: 100,000 working hours of cataloguers INSTITUTE OF INFORMATION SCIENCE
  34. 34. UNESCO Workshop on Organizing Information on Research Potentials and Research Results Maribor (Slovenia), 17 – 18 March 2006 Conclusions and Recommendations: • (1) The transparency of the results of scientific work is a starting point for organising information on research potentials and research results. This is a prerequisite for it to positively affect not only the state of mind and use of new knowledge but also the image of the South Eastern European countries. Without it, it is impossible to provide a thorough on-going evaluation of research results that constitute the basis of an effective research policy. • (4) The participating countries were offered the possibility to use E-CRIS application developed by IZUM with the aim of setting up national CRIS systems. In this regard, a special emphasis was laid on the appropriateness of being linked to national library systems. INSTITUTE OF INFORMATION SCIENCE
  35. 35. Current Research Information Systems (10 May 2010) Slovenia Serbia Macedonia Montenegro B&H Albania No. of entities SICRIS E-CRIS.SR E-CRIS.MK E-CRIS.CG E-CRIS.BH E-CRIS.AL Research 818 150 78 24 78 8 organisations Researchers 13,638 8,075 2,010 942 1,677 667 The E-CRIS systems in Serbia, Macedonia, Montenegro, Bosnia and Herzegovina and Albania are still in a pilot stage. INSTITUTE OF INFORMATION SCIENCE
  36. 36. www.cobiss.net INSTITUTE OF INFORMATION SCIENCE
  37. 37. What Does IZUM Offer within COBISS.Net? • Proven organisational solutions and software support to set up the national library information system and to automate library functions • Proven methodology and software to set up the national research information system and to evaluate researchers' bibliographies • Assistance in obtaining funds for development projects (international support to development) INSTITUTE OF INFORMATION SCIENCE
  38. 38. Development Aid of Slovenia to Albanian Libraries in 2009 • Purchase of computer equipment for and setup of local area networks in 10 public libraries, the Scientific Library of the Polytechnic University of Tirana and one faculty library • Purchase of literature for 10 public libraries and one faculty library • Financing of post-graduate study of librarianship at the University in Ljubljana (17 students) • Financing of travel costs for 50 participants of the COBISS 2009 Conference EUR 372,700 INSTITUTE OF INFORMATION SCIENCE
  39. 39. Incentives for Further Cooperation • To persuade the National Library of Albania to organise the inclusion of Albanian libraries in COBISS.Net and to take over the role of the National COBISS Centre • To upgrade the Agreement on Cooperation in Developing the Information Infrastructure to Support Research and Educational Activities in Albania, signed in 2007 by the Ministry of Education and Science of the Republic of Albania and IZUM • To help the new Agency of Research, Technology and Innovation upgrade the national research information system E-CRIS.AL and implement the transparent evaluation system INSTITUTE OF INFORMATION SCIENCE
  40. 40. Thank you for your attention! SICRIS & E-CRIS COBISS Web of Science INSTITUTE OF INFORMATION SCIENCE

×