Cobiss.net regional network for supporting knowledge and evaluating research performance

INSTITUTE OF INFORMATION SCIENCE

Slovenian Research AgencySlovenian Research Agency (ARRS)(ARRS)Dr. Franci DemDr. Franci Demššar, Directorar, Director

Institute of Information ScienceInstitute of Information ScienceMag. TomaMag. Tomažž Seljak, DirectorSeljak, Director

South Eastern European Expert MeetingSouth Eastern European Expert Meeting2121thth of May 2010of May 2010TiranaTirana

COBISS.NetCOBISS.Net Regional Network for Regional Network for Supporting Knowledge and Evaluating Supporting Knowledge and Evaluating Research PerformanceResearch Performance


Ever-Relevant Questions

• How much does each country contribute to the world treasury of knowledge?

• How much does each country invest into research and development (R&D)?

• How to record and promote country's research potential? - Role of transparency - Role of evaluation procedures

• How to implement transparency and boost regional cooperation in the area of R&D?


Web of Science


Publications in Web of Science(2005 - 2010)

69.353

16.075 16.063 16.02612.505

2.990 1.676 1.632 4740

10.000

20.000

30.000

40.000

50.000

60.000

70.000Au

stria

Ser

bia

Cro

atia

Slo

veni

a

Bul

garia

Mon

tene

gro

Bosn

ia a

ndH

erze

govi

na

Mac

edon

ia

Alba

nia


Publications in Web of Science (per 1000 inhabitants)

8,32

2,17

3,63

7,93

1,57

4,82

0,440,80

0,150,00

1,00

2,00

3,00

4,00

5,00

6,00

7,00

8,00

9,00A

ustri

a

Ser

bia

Cro

atia

Slov

enia

Bulg

aria

Mon

tene

gro

Bos

nia

and

Her

zego

vina

Mac

edon

ia

Alba

nia








R&D as Percentage of GDP

Source: Eurostat, http://epp.eurostat.ec.europa.eu/portal/page/portal/science_technology_innovation/introduction


Annual Budget of the Slovenian Research Agency (ARRS)

020406080

100120140160180200

2004 2005 2006 2007 2008 2009 2010

Mio. €


Institutional Design and Position of ARRS

TIA

Operational level

Science & technology council

Government of the RS

Strategic level

MHEST Other ministries

Policy levelMinistry of

Defence

ARRS

Executive level

Scientific Community


ARRS’s Main Areas of Operation

Promotion of excellent

and applicative research

Monitoring and analysing

Funding of research

Objectiveevaluation








ARRS's Information Infrastructurefor

Transparency of Research Results

• ARRS’s Web Portal

• SICRIS information system

• COBISS.SI bibliographic system

• WoS international citation indexes

• Videolectures.com portal

• Digital Library of Slovenia


ARRS’s Web Portal


Monthly Financial Overview


SICRISSlovenIan Current Research Information System

• Developed and maintained by the Institute of Information Science (IZUM) and ARRS

• Currently presented entities (databases):800 research organisations

1300 research groups13600 researchers5200 research projects300 research programs

• Direct link to the COBISS bibliographic system through researcher's codes


SICRIS: Presentation of a Researcher

Personal bibliographyQuantitative evaluation of bibliographic units Citations in WoS by yearData for ARRS’s tenders


COBISS.SICo-operative Online Bibliographic System and Services


Bibliographic Records in the Union Bibliographic Database COBIB.SI

Registering of bibliographies within COBISS.SI is mandatory for Slovenian researchers!

Total number of bibliographic records 3,671,033 100%

Monographs and other completed works 60%

Serials 3%

Articles and other component parts 35%

Performed works 2%

Number of records with at least one author with the researcher's code 1,035,697 28%


• Classification of bibliographic units is based on the uniquetypology (definition) of documents/works:

– Articles and other component parts (1.xx) 21 types– Monographs and other completed works (2.xx) 28 types– Performed works – events (3.xx) 7 types

Examples: 1.01 Original Scientific Article, 1.02 Review Article, 1.04 Professional Article, 2.01 Scientific Monograph, etc.

• Classification of units is done by authors or experts on the subject, whereas the classification is verified by specialised information centres for individual science disciplines

Classification of Bibliographic Units in COBIB.SI


Portal Videolectures.net


Digital Library of Slovenia


PRE-SELECTIONBIBLIOMETRIC CRITERIA

~ 100 %

DRAFT APPLICATIONS (Outline Proposals)

APROJECTS ON THEBASIS OF PROJECT

QUALITY~ 100 %

B

REJECTED PROJECTS

CALL FOR SUBMISSION OF FULL PROPOSALS

EVALUATION MADE BY THE PANEL ON THE BASIS OF PEER REVIEW

(international peers) – 2 per project

FINAL LIST OF APPROVED PROJECTSPanel: scientific body & international peers

Scientific Council of the Agency

Only selected projects are invited

Assessments are sent to applicants

PHASE 1

PHASE 2

Funding of Research: Two-Step Evaluation ProcessENTRANCE

BIBLIOMETRIC CRITERIA


Quantitative Evaluation of Bibliographic Indicators in Slovenia

• Bibliographies are evaluated when researchers apply for tenders issued by the Slovenian Research Agency and when they are elected to university titles

• Methodology for the evaluation of bibliographic indicators of research performance (categorisation and rating by points) is defined by the regulations of ARRS and universities

• Procedures related to the bibliographic unit categorisation and rating by points are automated, and are based on the interlinking of the SICRIS, COBISS.SI and WoS systems

• Evaluation results are available to the public within the SICRIS system through researchers' and program/project groups' web pages


Categorisation of Bibliographic Units in Terms of Quantitative Evaluation

• Articles are categorised based on the journal impact factor, on whether they are indexed in different databases, on the number of citations, etc.

• Monographs are categorised based on the publisher, scope, etc.

• Conference proceedings are categorised based on the type and the importance of the conference

• Patents are categorised based on the country granting a patent and/or the type of testing

• …





Publications in Scientific Journals with ISI Index

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

20000

year

1993

year

1994

year

1995

year

1996

year

1997

year

1998

year

1999

year

2000

year

2001

year

2002

year

2003

year

2004

year

2005





• How to record and promote country's research potential ? - Role of transparency - Role of evaluation procedures



COBISS.Net

Regional network of national library information systems and

current research information systems

Information infrastructure for science, education and culture

Support to knowledge and intercultural dialogue

Project of international development cooperation


From the COBISS System Concept to the Regional Library Network

• The COBISS system was conceived in 1987 when the then Association of the Yugoslav National Libraries accepted the concept of shared cataloguing as the common basis of the library information system and the system of scientific and technological information of Yugoslavia; the role of the information and bibliographic utility was taken over by the Institute of Information Science (IZUM) from Maribor

• After the breakup of Yugoslavia, libraries (55) outside Sloveniastopped participating in the shared cataloguing system, but almost all of them have gradually renewed the cooperation with IZUM

• In 2003, the Agreement on the establishment of the COBISS.Netnetwork and the free exchange of bibliographic records, created in autonomous library information systems of the participating countries,was signed between IZUM and the national libraries from Bosnia and Herzegovina, Macedonia, Montenegro, Serbia and Slovenia; in 2006, the aforementioned Agreement was also signed by the Bulgarian national library


COBISS.Net

Number of participating librariesSlovenia 393Serbia 117Macedonia 43Bosnia and Herzegovina 40Montenegro 26Bulgaria 1Total (30 April 2010) 620


Exchange of bibliographic records 11 November 2004 – 10 May 2010

COBISS.NetDownloaded

from COBIB.SI

Downloaded from

COBIB.SR

Downloaded from

COBIB.MK

Downloaded from

COBIB.CG

Downloaded from

COBIB.BHTotal

COBISS.SI - 6,946 688 175 371 8,180

COBISS.SR 22,225 - 2,053 2,787 5,292 32,357

COBISS.MK 11,083 21,855 - 51 290 33,279

COBISS.CG 3,860 95,743 164 - 1,028 100,795

COBISS.BH 5,560 28,065 139 277 - 34,041

Total 42,728 152,609 3,044 3,290 6,981 208,652

Total saving: 100,000 working hours of cataloguers


UNESCO Workshop onOrganizing Information on Research Potentials and

Research ResultsMaribor (Slovenia), 17 – 18 March 2006

Conclusions and Recommendations:• (1) The transparency of the results of scientific work is a starting point

for organising information on research potentials and research results. This is a prerequisite for it to positively affect not only the state of mind and use of new knowledge but also the image of theSouth Eastern European countries. Without it, it is impossible to provide a thorough on-going evaluation of research results that constitute the basis of an effective research policy.

• (4) The participating countries were offered the possibility to use E-CRIS application developed by IZUM with the aim of setting up national CRIS systems. In this regard, a special emphasis was laid on the appropriateness of being linked to national library systems.


Current Research Information Systems(10 May 2010)

No. of entitiesSloveniaSICRIS

SerbiaE-CRIS.SR

MacedoniaE-CRIS.MK

MontenegroE-CRIS.CG

B&HE-CRIS.BH

AlbaniaE-CRIS.AL

Research organisations 818 150 78 24 78 8

Researchers 13,638 8,075 2,010 942 1,677 667

The E-CRIS systems in Serbia, Macedonia, Montenegro, Bosnia and Herzegovina and Albania are still in a pilot stage.


www.cobiss.net


What Does IZUM Offerwithin COBISS.Net?

• Proven organisational solutions and software support to set up the national library information system and to automate library functions

• Proven methodology and software to set up the national research information system and to evaluate researchers' bibliographies

• Assistance in obtaining funds for development projects (international support to development)


Development Aid of Slovenia to Albanian Libraries in 2009

• Purchase of computer equipment for and setup of local area networks in 10 public libraries, the Scientific Library of the Polytechnic University of Tirana and one faculty library

• Purchase of literature for 10 public libraries and one faculty library

• Financing of post-graduate study of librarianship at the University in Ljubljana (17 students)

• Financing of travel costs for 50 participants of the COBISS 2009 Conference

EUR 372,700


Incentives for Further Cooperation

• To persuade the National Library of Albania to organise the inclusion of Albanian libraries in COBISS.Net and to take over the role of the National COBISS Centre

• To upgrade the Agreement on Cooperation in Developing the Information Infrastructure to Support Research and Educational Activities in Albania, signed in 2007 by the Ministry of Education and Science of the Republic of Albania and IZUM

• To help the new Agency of Research, Technology and Innovation upgrade the national research information system E-CRIS.AL and implement the transparent evaluation system


Web of ScienceCOBISS

SICRIS&

E-CRIS

Thank you for your attention!

Cobiss.net regional network for supporting knowledge and evaluating research performance

Art & Photos