1 Emanuel Kulczycki Scholarly Communication Research Group Adam Mickiewicz University in Poznań Poland Short Term Scientific Mission (STSM) Report COST ACTION 15137 European Network for Research Evaluation in the Social Sciences and the Humanities (ENRESSH) Topic 3: Comparison of national and regional databases of social sciences and humanities research outcomes TSM Reference Number: COST-STSM-CA15137-35312, CA15137 1. Summary The main objective of the STSM ENRESSH is aimed at strengthening existing networks and fostering collaborations by facilitating researchers participating in a COST Action to visit an institution in another Participating COST Country. My STSM was carried out at the University of Antwerp. The visit took place from 5th and 18th February 2017. During the visit, I worked with and learned from researchers working at the Flemish Centre for R&D Monitoring (ECOOM Antwerp). We have confronted the productivity and the outputs structure in various SSH disciplines, using data from the national information systems: The VABB-SHW (Flanders) and the PBN (Poland). We have analyzed characteristics of the diverse dissemination channels used in the SSH and focused on the publication patterns in SSH. During my STSM main activities consisted of the meetings with the staff members of the ECOOM Antwerp, presentations of their current research tasks, discussing the design and structure of the Flemish and the Polish databases.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1
EmanuelKulczycki
ScholarlyCommunicationResearchGroup
AdamMickiewiczUniversityinPoznań
Poland
ShortTermScientificMission(STSM)
Report
COSTACTION15137
EuropeanNetworkforResearchEvaluationintheSocialSciencesandtheHumanities
(ENRESSH)
Topic3:Comparisonofnationalandregionaldatabasesofsocialsciencesand
humanitiesresearchoutcomes
TSMReferenceNumber:COST-STSM-CA15137-35312,CA15137
1. Summary ThemainobjectiveoftheSTSMENRESSHisaimedat strengtheningexistingnetworks
andfosteringcollaborationsbyfacilitatingresearchersparticipatinginaCOSTActionto
visitaninstitutioninanotherParticipatingCOSTCountry.
MySTSMwascarriedoutattheUniversityofAntwerp.Thevisittookplacefrom5thand
18th February 2017. During the visit, I worked with and learned from researchers
working at the Flemish Centre for R&D Monitoring (ECOOM Antwerp). We have
confrontedtheproductivityandtheoutputsstructureinvariousSSHdisciplines,using
data from the national information systems: The VABB-SHW (Flanders) and the PBN
(Poland).Wehaveanalyzedcharacteristicsofthediversedisseminationchannelsused
intheSSHandfocusedonthepublicationpatternsinSSH.
DuringmySTSMmainactivitiesconsistedofthemeetingswiththestaffmembersofthe
ECOOMAntwerp, presentations of their current research tasks, discussing the design
andstructureoftheFlemishandthePolishdatabases.
2
2. ContributiontotheGoalsoftheENRESSHactionMySTSMhascontributedtoTasks1and2ofWorkgroup3:“Confrontproductivityand
structureofoutputs invariousSSHdisciplines,usingdatafromexistingdatabasesand
repositories (identify dissemination profiles, clusters and hybrids)” and “Analyse
characteristicsofdiversedisseminationchannelsusedintheSSH.”
3. DescriptionofthemainresultsobtainedTheaimofmySTSMworkwastwofold:toshowwhatkindofdataareavailableonthepublications of Polish scholars in the social sciences and humanities (SSH) and toidentify such elements in the structures of the Flemish and the Polish databases thatmight be compared. Below, I have described a process of preparing the data for acomparativeanalysis.
PARTI:PolishScholarlyBibliography
PolishScholarlyBibliography(PBN)–thePolishCRIS
PolskaBibliografiaNaukowa[PBN](PolishScholarlyBibliography)https://pbn-ms.opi.org.pl/Institution:Ośrodek Przetwarzania Informacji –Państwowy Instytut Badawczy (NationalInformationProcessingInstitute)Thehighereducationinstitutionshavetosubmitthedataevery6months.However,thedatabase is daily updated by the PBN editors and the administrators in the highereducationinstitutions.The publication lists and the metadata are validated by the PBN editors and theadministratorsinthehighereducationinstitutions.
Inasinglerecordofpublication(e.g.article),therearemetadataabout:journal,title,authors,institution,ISSN,articletype,volume,year,startandendpages,language,DOI(ifavailable),andsometimesotherdata.
3
LegalframeworkofthedatabaseThePBNisapartofthePOL-onsystem.TherearemanyregulationsandactsdesignedfordifferentpartsofthePOL-on.TherearetwothemostimportantactsforthePBN:
1. Ustawazdnia30kwietnia2010r.ozasadachfinansowanianauki(Dz.U.2010nr96poz.615)
2. RozporządzenieMinistraNaukiiSzkolnictwaWyższegozmieniającerozporządzeniewsprawieSystemuInformacjioNauce.Zdnia26lutego2016r.(Dz.U.2016poz.309)
3. RozporządzenieMinistraNaukiiSzkolnictwaWyższegowsprawieSystemuInformacjioNaucezdnia29czerwca2015r.(Dz.U.2015poz.944)
Officiallydeclaredusesofthedatabase
1. Tocreateapublicbibliographyofapersonoraninstitution2. TogettoknowtheachievementsofPolishscholars3. TogettoknowtheachievementsofPolishscholarlyinstitutions4. Tosubmitajournalquestionnaireduringanevaluationperiod(forthePolish
JournalRankingpurposes)5. Toenableuserstodepositfulltextsofscholarlypublicationsincentralrepository6. TointegratethePBNresourceswiththeinstitutionalrepositoriesofthePolish
universitiesandscientificunits7. Toallowuserstoadjustpersonalandinstitutionalbibliographiesaccordingto
therequirementsofotherinstitutions.
4
PARTII:PublicationtypesandcriteriaforinclusionintheVABB-SHWandthePBNPublicationTypesandCriteriaforInclusion
InTable1,IhavecomparedthepublicationtypesandcriteriaforinclusionintheVABB-SHWandthePBN.
FinalsinglepublicationrecordinthePBNA singlepublication record includes various information.However, thedataquality isnotsogood.Therefore,Ihavereducedthedataforsuchaninformation:Singlepublicationrecord
1. ID2. Author3. Institute(i.e.affiliationassignedtoapublicationwhichidentifiesascientificunit)4. LanguageofPublication5. TitleofPublication6. Numberofallauthorsofthepublication7. Typeofpublication8. Year9. JointEvaluationGroup(inPolish:GrupaWspólnejOceny)[JEG]10. OECDfield
5
Table1.PublicationtypesandcriteriaforinclusionintheVABB-SHWandthePBN.
VABB-SHW Criteriaforinclusion PBN Criteriaforinclusion
Journalarticle• Bepubliclyaccessible• BeunambiguouslyidentifiablebyanISBNoran
ISSNnumber• Makeacontributiontothedevelopmentofnew
insightsortoapplicationsresultingfromtheseinsights
• Havebeensubjected,priortopublication,toademonstrablepeer-reviewprocessbyscholarswhoareexpertsinthe(sub)fieldtowhichthepublicationbelongs.Peerreviewshouldbecarriedoutbyaneditorialboard,apermanentreadingcommittee,externalrefereesorbyacombinationofthese.Thereviewshouldcontaininputfromoutsidetheauthor(s)’sresearchteamandshouldbeindependentfromtheauthor(s).Theauthorcannotorganizethepeerreviewofherorhisowndraftmanuscript*
Journalarticle
1. ArticlesinjournalsindexedonthePolishJournalRankingpreparedbytheMinistryofScienceandHigherEducationinPoland.Thisrankingorganizesjournalsintothreelists—A,B,andC:
• TheAlist:journalsindexedintheJournalCitationReports(from15to50points)
• TheBlist:Polish(until2014,alsoforeign)journalswithoutanimpactfactor(from1to15points)
• TheClist:journalsindexedintheEuropeanReferenceIndexfortheHumanities(from10to25points).
2. Articlesinforeignjournals(atleast½authorsheetlong).
Monograph Monograph• ithastobescientificpaper• ithastopresentanoriginalresearchproblem,• ithastobereviewed,• ithastocontainabibliography(orfootnotes/endnotes):this
criterionisnotobligatoryforthemaps.• itslengthshouldbeatleastsixauthorsheets,• ithastobepublishedasastandalonevolume(itisnot
obligatoryforthemaps)andcopiesofpublicationweresenttothelibrariesorapublicationispublishedon-line,
• ithastobeidentifiablebyanISBN,ISMN,ISSNorDOI.
Editedbook Editedbook
Conference
proceedingBookchapter
1. Thelengthofchapter(ormap)shouldbeatleastahalfanauthorsheet.
2. Entriesinencyclopediasanddictionariesshouldbeatleast0,25authorsheet
3. IfabookchapterisclassifiedasconferenceproceedingsindexedintheWebofScience,thenthelengthofchapterdoesnotmatter.
Bookchapter
Note: * Extra criterion for individual publications eligible for inclusion introduced by the Gezaghebbend Panel (Authoritative Panel): at least four pages long.
6
Fields&DisciplinesclassificationTwoPolishFieldsclassificationandOECDFieldsInPoland,twoclassificationsofthedisciplinesareused.
Thefirstclassificationis forteachingandacademicpromotionpurposes. Inthisclassification,thereare8areas,22fields,and102disciplines.
The other classification is for the performance-based research funding system(PRFS) purposes. In this classification – in the most cases – a few disciplines arecombinedintoaJointEvaluationGroup(JEG).Thus,22fieldsaremergedinto4fields,and102disciplinesaremergedinto29JEGs.SomeJEGsaremultipliedforeachtypeofscientificunit.Forinstance,thereisaJEGcalled‘History’forfourtypesofscientificunits(afaculty,aninstituteofthePolishAcademyofSciences,aresearchinstitute,andother).Finally,therearefour‘History’JEGs.Below,IprovideamoredetailedexplanationhowthisclassificationinthePRFSactuallyworks.NoneofthisclassificationisbasedontheOECDfields.
ScientificunitandfieldsofsciencesIn thePolishresearchevaluationsystem,eachscientificunit isassignedto: (1)oneoffourfieldsofsciences(e.g.,SSH:socialsciencesandhumanities),(2)oneoffourtypesofscientificunits(e.g.,facultiesandresearchinstitutes)(seeFigure1).
Figure1.Fieldsofsciencesandtypesofscientificunits.
7
Moreover, as Figure2 shows, eachunit is assigned to a JEG (Joint EvaluationGroup).Finally,eachunitischaracterizedby:type,fieldofsciences,JEG.Forexample,facultiesofphilosophy were assigned to a single JEG (“Philosophy and theology”) designed forfacultiesfromtheSSHfield.
Figure2.Characteristicsofscientificunits.Finally,allscientificunitsaremappedto60JEGs(29uniqueJEGsintermsofdisciplines).
JEGsintheSSHTwofieldsfromthePolishPRFScovertheSSH:(1)socialsciences&humanitiesand(2)artsciences&artisticproduction.Inthesetwofields,thereare11uniqueJEGs(intermsofdisciplines):HumanitiesandSocialSciences
1. Philosophyandtheology2. Economics&Business3. History4. SocialSciences5. Language,Bibliology,CultureStudies6. Law
8
Artsciencesandartisticproduction
7. Music8. Arts9. Performingarts10. Theatre11. Plasticarts
AssigningthePublicationstotheJEGsandtheOECDfieldsAllpublicationsfromasinglescientificunitareassignedtooneJEG.Tothebestofmyknowledge,thereisnootherwayforthepublicationclassificationbydisciplines.Intheoriginalsetof60JEGsusedinthe2013evaluation,thereare963scientificunits.Inourdata,wehave1011scientificunits.Thisdifferenceresultsfromthescientificunittransformations(splittingormergingthefaculty). IhaveassumedthatinouranalysiswedonotusepublicationsnotassignedtotheJEGs.For the analyse purpose, I have mapped all the JEGS to the OECD fields.Inthisway,wecouldmapallpublicationsfromthePBNtosixOECDfields.TheJEGsmappingtotheOECDfieldwasbasedontheexpert-baseddecision.
Figure3.Mapping11JEGswithintwofieldsofsciencestotheOECDfields.
Table2presentstheresultofmappingtheJointEvaluationGroupsontheOECDFieldsinthesocialsciencesandhumanities.
9
Table2.MappingtheJointEvaluationGroups(classifiedaccordingtothePolishfieldsclassification)ontheOECDFieldsinthesocial
sciencesandhumanities.Note:RI:ResearchInstitute,PAN:PolishAcademyofSciences.
IDField of Science (Polish research
evaluationsystem)
Typeof
scientific
unit
Numberof
Scientific
Units
JEGnam(Englishtranslation) JEGname OECDField
HS1EK HumanitiesandSocialSciences faculty 93 Economics&Business NaukiekonomiczneSocial
Sciences
HS1FBHumanitiesandSocial
Sciencesfaculty 29
Language,bibliology,culture
studies
Naukifilologiczne,bibliologia,naukio
kulturzeHumanities
HS1FT HumanitiesandSocialSciences faculty 16 Philosophyandteology Filozofiainaukiteologiczne Humanities
HS1HS HumanitiesandSocialSciences faculty 20 History Naukihistoryczne Humanities
HS1PR HumanitiesandSocialSciences faculty 25 Law NaukiprawneSocial
Sciences
HS1SP HumanitiesandSocialSciences faculty 93 SocialSciences NaukispołeczneSocial
Sciences
HS2EK HumanitiesandSocialSciences PAN 2 Economics&Business NaukiekonomiczneSocial
Sciences
HS2FB HumanitiesandSocialSciences PAN 3Language,bibliology,culture
studies
Naukifilologiczne,bibliologia,naukio
kulturze
Humanities
HS2HS HumanitiesandSocialSciences PAN 5 History Naukihistoryczne Humanities
HS2PR HumanitiesandSocialSciencesPAN
1 Law NaukiprawneSocial
Sciences
HS2SP HumanitiesandSocialSciences PAN 3 SocialSciences Naukispołeczne Social
10
Sciences
HS3EK HumanitiesandSocialSciences RI 4 Economics&Business NaukiekonomiczneSocial
Sciences
HS3HS HumanitiesandSocialSciences RI 4 History Naukihistoryczne Humanities
HS3SP HumanitiesandSocialSciences RI 1 SocialSciences NaukispołeczneSocial
Sciences
HS4EK HumanitiesandSocialSciences other 2 Economics&Business NaukiekonomiczneSocial
Sciences
HS4HS HumanitiesandSocialSciences other 1 History Naukihistoryczne Humanities
HS4SP HumanitiesandSocialSciences other 1 SocialSciences NaukispołeczneSocial
Sciences
TA1MZArtsSciencesandArtistic
Productionfaculty 35 Music Naukimuzyczne
Humanities
TA1PKArtsSciencesandArtistic
Productionfaculty 39 Arts Sztukipiękneikonserwacja
Humanities
TA1PRArtsSciencesandArtistic
Productionfaculty 14 Performingarts Sztukiprojektowe
Humanities
TA1TFArtsSciencesandArtistic
Productionfaculty 14 Theatre Sztukiteatralneifilmowe
Humanities
TA4PRArtsSciencesandArtistic
Productionother 1 PlasticArts Sztukiplastyczneiużytkowe
Humanities
11
AsTable3shows, Ihavecompared thedisciplineclassification fromtheVABB-SHWwith
the JEGs from the Polish PRFS. In my opinion, we can compare and confront three
disciplines (history, law, economics & business) and two other if we decide to merge
‘philosophy’and‘theology’.
Table 3. Matching the discipline classification in VABB-SHW with the Joint Evaluation
Groupsinthesocialsciencesandhumanities.
DisciplinesinVABB-SHW JEGsinthePolishsystemthatcouldbematched
Archeology
Arthistory
Communicationstudies
History History
Law Law
Linguistics
Literature
PhilosophyPhilosophyandtheology
Theology
Criminology
Economics&Business Economics&Business
Educationalsciences
Politicalscience
Psychology
SocialHealthSciences
Sociology
12
DatafromthePBN
Ihave1011files(XMLformat)fromthePBN.
1file=publicationsfrom1scientificunit
XMLschemeintheXSDwaspublishedbytheNationalInformationProcessingInstituteon30thofJuly2016(https://pbn-ms.opi.org.pl).Thegoodqualitydataisforthe2009-2015period.
ThreedatasetsSETA:thewholedatasetwithduplicates
Variables:
11. ID12. Author13. Institute(i.e.affiliationassignedtoapublicationwhichidentifiesascientificunit)14. LanguageofPublication15. TitleofPublication16. Numberofallauthorsofthepublication17. Typeofpublication18. Year19. JEG20. OECD
Ifapublicationispublishedby3authorsfromagivenscientificunit,theninourdata,there
arethreerecordsforthesamepublicationassignedforthisscientificunit(onlytheAuthor
variablehasadifferentvalue).
Ifapublicationispublishedby6authors:3authorswerefromtheAscientificunitand3
authors from the B scientific unit, then in our data there are six records for the same
publicationassignedtotwoscientificunits(onlytheAuthorvariablehasadifferentvalue).
Finalnumbersinwholedataset(aftermerging1011filesbutbeforedatacleaning)
Numberofrecords:1,580,325
13
SETB:thewholedatasetwithoutduplicatesonascientificunitlevel
Variables:
1. ID2. Institute(i.e.affiliationassignedtoapublicationwhichidentifiesascientificunit)3. LanguageofPublication4. TitleofPublication5. Numberofallauthorsofthepublication6. Typeofpublication7. Year8. JEGs9. OECD
In the SET B, there are no duplicated records for a single publication. Itmeans that if a
publicationwaspublishedby3authorsfromagivenscientificunit,theninourdata,thereis
onlyasinglerowforthispublication.
IntheSETB,however,ifapublicationispublishedbyauthorsfrom2scientificunits,then
inthedatasettherearetworecords:eachforonescientificunit.Wedonotavoidduplicated
records between the scientific units because a publication can be published by scholars
fromthesocialsciencesandfromthenaturalsciences.Inthefinalset,thispublicationwill
beassignedtothebothfields.
Ifapublicationwaspublishedby6authors:3authorswerefromtheAscientificunitand3
authors from the B scientific unit, then in our data there are two records for the same
publicationassignedtotwoscientificunits(onlytheAuthorvariablehasadifferentvalue).
Finalnumbersinwholedataset(afterremovingduplicateswithinscientificunitsandafter
merging1011filesbutbeforedatacleaning)
Numberofrecords:445,894
14
SETC:thewholedatasetwithoutduplicates
Variables:
1. ID2. LanguageofPublication3. TitleofPublication4. Numberofallauthorsofthepublication5. Typeofpublication(book,article,chapter)6. Year7. JEGs8. OECD
In the SET C, there are no duplicated records for a single publication in the data set. It
means that ifapublicationwaspublishedby6authors fromoneormorescientificunits,
theninourdatathereisonlyasinglerowforthispublication.
SETChasnoduplicatedrecordsforamulti-authoredsinglepublication.Oncontrary,SETB
hasduplicatedrecordsforamulti-authoredsinglepublicationifauthorsarefromdifferent
Polishscientificunits.
4.Resultsofcomparison
Table 4. Number and percentage publications per publication types in the social sciences and humanities in the 2009–2014 period
Flanders(N) Flanders(%) Poland(N) Poland(%)
Article 44,419 57.0 35,091 26.2
Monograph 4,445 5.7 14,611 10.9
Editedbooks 3,652 4.7 9,565 7.1
Chapter 25,354 32.6 74,844 55.8
Total 77,870 100.0 134,111 100.0
15
Figure 4. Publication types as a percentage of the total publications in Flanders and Poland which includes publications in all languages.
Figure 5. Publications in English, local and other languages as a percentage of the total, which includes publications in all types of publications (articles, monographs, edited books, chapters).
0% 10% 20% 30% 40% 50% 60% 70%
2009 2010 2011 2012 2013 2014
Publications types as share of the total in Flanders
Article Monograph
Edited volume Chapter
0% 10% 20% 30% 40% 50% 60% 70%
2009 2010 2011 2012 2013 2014
Publications types as share of the total in Poland
Article Monograph
Edited volume Chapter
0% 20% 40% 60% 80%
100%
2009 2010 2011 2012 2013 2014
Publication language as a share of the total in Poland
English Local Other
0% 20% 40% 60% 80%
100%
2009 2010 2011 2012 2013 2014
Publications languageas share of the total in Flanders
English Local Other
16
Table 5. Publications per publication type in the social sciences and humanities in Flanders and Poland by discipline in the 2009–2014 period.
PublicationType CountryEconomics&
BusinessHistory Law
Philosophy
&Theology
ArticleFlanders 6,153 1,745 7,793 3,553
Poland 9,264 3,945 6,775 1,179
MonographFlanders 633 313 1,208 321
Poland 2,474 2,127 2,444 975
EditedbooksFlanders 370 247 1,007 393
Poland 2,201 1,172 1,534 470
ChapterFlanders 2,798 1,849 5,445 2,440
Poland 14,312 10,151 12,823 3,212
TotalFlanders 9,954 4,154 15,453 6,707
Poland 28,152 17,395 17,740 5,836
Figure 6. Publications in English, local and other languages as a percentage of the total, which includes publications in all types of publications (articles, monographs, edited books, chapters).
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
100%
2009 2010 2011 2012 2013 2014 2009 2010 2011 2012 2013 2014
Flanders Poland
Economy&Business
English Local Other
17
Figure 7. Publications in English, local and other languages as a percentage of the total, which includes publications in all types of publications (articles, monographs, edited books, chapters).
Figure 7. Publications in English, local and other languages as a percentage of the total, which includes publications in all types of publications (articles, monographs, edited books, chapters).
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
100%
2009 2010 2011 2012 2013 2014 2009 2010 2011 2012 2013 2014
Flanders Poland
History
English Local Other
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
100%
2009 2010 2011 2012 2013 2014 2009 2010 2011 2012 2013 2014
Flanders Poland
Law
English Local Other
18
Figure 8. Publications in English, local and other languages as a percentage of the total, which includes publications in all types of publications (articles, monographs, edited books, chapters).
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
100%
2009 2010 2011 2012 2013 2014 2009 2010 2011 2012 2013 2014
Flanders Poland
PhilosophyandTheology
English Local Other
19
Figure 9. Publications in English as a percentage of the total, which includes publications in all types of publications (articles, monographs, chapters, conference proceedings) by discipline.
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
100%
2009 2010 2011 2012 2013 2014
Economy & Business
Flanders Poland
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
100%
2009 2010 2011 2012 2013 2014
History
Flanders Poland
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
100%
2009 2010 2011 2012 2013 2014
Law
Flanders Poland
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
100%
2009 2010 2011 2012 2013 2014
Philosophy and Theology
Flanders Poland
Related Documents
