Sustainability in University Rankings 21 October 2013, Venice (Italy) Rankings and Sustainability Stefano PALEARI University of Bergamo, Rector and CRUI, President Results are from the research project: “Le università nel nuovo secolo: nuovi modelli per una società in trasformazione” Team Higher Education UnBG-CRUI
23
Embed
Sustainability in University Rankings · Sustainability in University Rankings 21 October 2013, Venice (Italy) ... Results are from the research project: “Le università nel nuovo
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Sustainability in University Rankings
21 October 2013, Venice (Italy)
Rankings and Sustainability
Stefano PALEARI
University of Bergamo, Rector and CRUI, President
Results are from the research project: “Le università nel nuovo secolo: nuovi modelli per una società in trasformazione”
Team Higher Education UnBG-CRUI
Stefano Paleari, Venice, 21/10/2013 Rankings and sustainability
• Sustainability issues are to be contextualized
– Why do we use measures (rankings) in Higher Education?
– Sustainability in Higher Education
– Measures (Rankings) and Sustainability
Our approach
2
Stefano Paleari, Venice, 21/10/2013 Rankings and sustainability
• Efficient allocation of limited resources
• Accountability towards funders and society
– Universities are (also) financed by the state
• Transparency of results
• Main World University Rankings:
– Academic Ranking of World Universities (ARWU) - 2003
– Quacquarelli Symonds (QS) - 2004
– Times Higher Education Ranking (THE) – 2010
Why do we need measures for HE?
3
Stefano Paleari, Venice, 21/10/2013 Rankings and sustainability
ARWU
4
Criteria Indicator Weight
Quality of EducationAlumni of an institution winning Nobel Prizes and
Fields Medals10%
Staff of an institution winning Nobel Prizes and
Fields Medals20%
Highly cited researchers in 21 broad subject
categories20%
Papers published in Nature and Science* 20%
Papers indexed in Science Citation Index-expanded
and Social Science Citation Index20%
Per Capita Performance Per capita academic performance of an institution 10%
Total 100%
Quality of Faculty
Research Output
Stefano Paleari, Venice, 21/10/2013 Rankings and sustainability
QS
5
Criteria Indicator Weight
Teaching Faculty Student Ratio 20%
Academic Peer Review from global survey 40%
Recruiter Review from global survey 10%
Research Citations per Faculty from Sciverse Scopus 20%
Percentage of intanational students 5%
Percentage of intanational staff 5%
Total 100%
Reputation
International Orientation
Stefano Paleari, Venice, 21/10/2013 Rankings and sustainability
THE
6
Criteria Indicator Weight 2011
Reputational survey - teaching 15% 15% =
PhD awards per academic 6% 6% =
Undergraduates admitted per academic 4,5% 4,5% =
Income per academic 2,25% 2,25% =
PhD awards/ bachelor's awards 2,25% 2,25% =
Citations ResearchCitations impact (normalised avarage citations per
paper) from Scopus32,5% 30% ↓
Reputational survey - research 19,5% 18% ↓
Research income (scaled) 5,25% 6% ↑
Papers per academic and research staff 4,5% 6% ↑
Ratio of international to domestic staff 0,75% 2,5% ↑
Ratio of international to domestic students 3% 2,5% ↓
Proportion of internationally co-authored research
papers 2% 2,5% ↑
Industry Income - innovationResearch income from industry (per academic
staff)2,5% 2,5% =
Total 100% 100%
Weight 2012
Research - volume, income and
reputation
International Outlook - staff,
students and research
Teaching - the learning
environment
Stefano Paleari, Venice, 21/10/2013 Rankings and sustainability
• Methodological issues
– Subjective measures
• i.e.: Subjectivity of weights and indicators
– Biased measures
• Rankings favour hard science and publications in English language
– Reputation vs. Contemporaneous performance measures
• Advantage for big universities
• Advantage for historical universities (Nobel prize winners)
– Measures affected by exogenous factors
• Total income of institutions
Worldwide University Ranking
7
Stefano Paleari, Venice, 21/10/2013 Rankings and sustainability
World University Ranking Correlation
• Spearman coefficient:
• High level of correlation among top-100 ranked institutions
(Sample: 137 universities listed in all the three rankings)
8
ARWU 2011 THE 2011 QS 2011
ARWU 2011 1,000
THE 2011 0,684 1,000
QS 2011 0,421 0,614 1,000
Spearman correlation Matrix in year 2011 and among different rankings and among the same ranking in 2011 and 2012
di: difference among the position of the i university
n: number of universities listed
ARWU 0,994
THE 0,957
QS 0,989
2011-2012 Correlation
Stefano Paleari, Venice, 21/10/2013 Rankings and sustainability
• Top 10 universities in Times Higher Education Ranking 2012
9
“Best” University according to THE 1/2
Rank Università Students Faculty Student / Faculty
1 California Institute of Technology 2.175 425 5
2 University of Oxford 20.466 4.962 4
2 Stanford University 15.666 1.910 8
4 Harvard University 21.229 2.242 9
5 Massachusetts Institute of Technology (MIT) 10.384 1.009 10
6 Princeton University 7.567 1.172 6
7 University of Cambridge 18.396 2.957 6
8 Imperial College London 15.215 3.594 4
9 University of California, Berkeley 36.142 2.393 15
10 University of Chicago 15.438 2.168 7
Average students number "top 10" 16.268
Average students per faculty "top 10" 7
Avarage students per faculty in Italy 30
Top 10 universities in Times Higher Education Ranking 2012
Stefano Paleari, Venice, 21/10/2013 Rankings and sustainability
• Top university by country in THE 2012
“Best” University according to THE 2/2
10
Istituzione Studenti DocentiStudent to
faculty ratio
% studenti
internazionali
% graduate
students
California Institute of Technology 2.130 425 5,0 25,0% 55,4%
University of Oxford 18.703 4.962 3,8 29,2% 35,8%
ETH Zürich 14.116 1.150 12,3 33,1% 50,2%
University of Toronto 71.100 10.650 6,7 10,3% 18,8%
University of Tokyo 27.821 4.719 5,9 7,6% 49,5%
University of Melbourne 34.046 3.595 9,5 28,5% 27,3%
National University of Singapore 30.244 5.252 5,8 36,3% 21,0%
University of Hong Kong 15.863 3.046 5,2 30,0% 41,7%
Karolinska Institute 7.051 1.371 5,1 7,1% 51,6%
Peking University 38.228 2.900 13,2 5,6% 51,0%
Ludwig-Maximilians-Universität München 49.180 3.576 13,8 14,1% 14,0%
Pohang University of Science and Technology 3.217 429 7,5 1,6% 48,0%