1
Presented by:
U-Multirank A Multi-dimensional International
Ranking
Moscow Ranking Seminar, April 2015
Gero Federkeil, CHE Centre for Higher Education
• What is new about U-Multirank?
• Facts and figures
• Russian institutions in U-Multirank
@UMultirank 2
Presentation
• Transparency about the diversity in higher education
• Existing global rankings include only one type of HEI: the internationally oriented (comprehensive) research
university which represents 3-5 % of al HEIs in the world
• This is legitimate, but
• does not reflect the diversity of HEOs with diverse missions and institutional profiles
• is not very informative to most users
• The aim of U-Multirank is to
• provide transparency about the diversity of HEIs
• make visible the diversity of multiple excellences beyond research excellence only
@UMultirank 3
What is new about U-Multirank?
• Comparing-like-with like
• Link to mapping indicators allowing identification of institutions with similar institutional profiles
@UMultirank 4
What is new about U-Multirank?
5
Comparing like with like
Selection of a particular institutional profile reduces number of institutions included into comparison to similar institutions
• Balanced rankings of whole universities and field level rankings
• 2015: seven fields;
@UMultirank 6
Combining institutional and field-based rankings
@UMultirank 7
What is new about U-Multirank?
New fields in 2015
• Balanced rankings of whole universities and field level rankings
• 2015: seven fields;
• 2016 : plus six new fields: mathematics, chemistry, biology, history, sociology, social work
• 35+ indicators on field level, including field-specific indicators (e.g. laboratories in engineering; quality of bedside teaching in medicine)
@UMultirank 8
Combining institutional and field-based rankings
9
With this approach U-Multirank creates
multidimensional performance profiles: At a glance
performance profiles
10
As well as detailed views on strengths and weaknesses
No across the board „A“ nor „E“ performance !
Specific profiles with specific strengths and weaknesses
• What is new about U-Multirank?
• Facts and figures
• Russian institutions in U-Multirank
@UMultirank 11
Agenda
U-Multirank is done by a consortium of partners combining different functions and expertise
• Coordination/lead and rankings
• CHE Centre for Higher Education, Germany
• CHEPS Center for Higher Education Policy Studies, The Netherlands
• CWTS Centre for Science and Technology Studies, The Netherlands
• Partners
• Data collection: Incentim: International Centre for Research on Entrepreneurship, Technology and Innovation Management, KU Leuven, Benedetto Lepori, University Lugano
• Web tool experts: folge3, Johnny Rich (Push)
• Business model: Elsevier, Bertelsmann Foundation
• Associate partners
• National rankings: OST (France); Perspektywy (Poland) and Fundación CYD (Spain)
• Stakeholder organisations: Business Europe, ESU, CESAER, IRUN, UASNet, ESN
@UMultirank 12
U-Multirank combines different data sources to provide a multi-perspective ranking
• Data from verified data bases
– Thomson Reuters (bibliometric data; 8 indicators) – PATSTAT (patent data; 3 Indicators)
• Self reported data
– Institutional Ranking: Online questionnaire – Field-based Rankings: Online questionnaires
• Student survey
– Survey among current students about their learning experience (total > 80,000 students)
– Important and unique perspective for student users of U- Multirank
@UMultirank 13
Why U-Multirank does not use reputation indicators
• U-Multirank is about actual performance, not about reputation
• Rankings affect the reputation of universities. If they do this by measuring this very reputation, this is a circular procedure!
• Doubts about validity and reliability of international reputation surveys
– Volatile to manipulation: self-delivery of peer lists
– Reputation is heavily dependent on regions and fields
– Reputation is rather stable yet there are big jumps in rankings from one year to another
@UMultirank 14
The scope of U-Multirank
• 2015:
– 1,200 institutions included – 683 provided full data set
– Additional 450 research universities with data from verified data bases (bibliometric & patent data)
– Seven fields: mechanical engineering, electrical engineering, physics, business studies (2014), computer science, medicine, psychology (2015)
– Update of fields: every three years – Publication 30 March
• 2016:
– Plus 200 institutions (target)
– Six new fields: mathematics, chemistry, biology, sociology, history, social work
@UMultirank 15
The U-Multirank web tool: Ranking 2.0
• User driven comparisons:
– Step 1: Selection of a particular institutional profile a user is interested in
– Step 2: Selection of indicators by users according to personal preferences and priorities
– Step 3: Sorting by users’ preferences
• Full transparency about methodology
– Indicator book
– Description of rank group procedures
@UMultirank 16
The U-Multirank web tool: Ranking 2.0 www.umultirank.org
@UMultirank 17
• What is new about U-Multirank?
• Facts and figures
• Russian institutions in U-Multirank
@UMultirank 18
Agenda
Institutional Ranking:
25 participants from Russia
@UMultirank 19 19
@UMultirank
National Research University - Higher School of Economics Inst. TechMO University
Kazan (Volga Region) Federal University
Lobachevsky State University of Nizhni Novgorod Lomonosow Moscow State University
National Research Nuclear University "Moscow Physics and Engineering Institute"
Moscow Aviation Institute (National Research University) Moscow Institute of Physics and Technology
Moscow State University of economics, statistics and informatics (MESI) Moscow University for Industry and Finance "Synergy"
National Research Tomsk Polytechnic University (NR TPU)
Nizhny Novgorod State Technical University R.E. Alekseev (NNSTU) Penza State University
People's Friendship University of Russia Pyatigorsk State Linguistic University
Russian Presidential Academy of National Economy and Public Administration
Russian Foreign Trade Academy of the Ministry for Economic Development of the Russian Federation Samara State Aerospace University (SSAU)
Siberian Federal University
Siberian Institute for Business, Management and Psychology South Ural State University
Southern Federal University Tomsk State University Transbaikal State University Ural Federal University
9 out of 15
5top100 universities
Participants from Russia in fields
@UMultirank 20 20
@UMultirank
Field Number of Russian
departments/faculties Business Studies 16
Computer Science 20 Electrical Engineering 5 Mechanical Engineering 6
Medicine 2
Physics 4
Psychology 7
Results Field-based Ranking
@UMultirank 21 21
@UMultirank
7 6 5 5 4 3 3 3 2 2 1 1
0 5 10 15 20 25 30
Pyatigorsk State Linguistic University Tomsk State University Inst. TechMO University Lobachevsky State University of Nizhni Novgorod
South Ural State University Inst. TechMO University Kazan (Volga Region) Federal University
Pyatigorsk State Linguistic University People's Friendship University of Russia National Research Tomsk Polytechnic University (NR TPU)
Samara State Aerospace University (SSAU) Ural Federal University
A scores Indicators total
Computer Science– Number of A scores
Results Field-based Ranking
@UMultirank 22 22
@UMultirank
Physics – Number of A scores
4 4 4 2
0 5 10 15 20 25 30 35
Moscow Aviation Institute (National Research University)
Southern Federal University Lomonosow Moscow State University Lobachevsky State University of Nizhni Novgorod
A scores Indicators total
Results Field-based Ranking
@UMultirank 23 23
@UMultirank
3 2
0 2 4 6 8 10 12 14
People's Friendship University of Russia
Kazan (Volga Region) Federal University
A scores Indicators total
Medicine – Number of A scores
Results Field-based Ranking
@UMultirank 24 24
@UMultirank
6 5 3 1
0 5 10 15 20 25 30 35
Southern Federal University Lobachevsky State University of Nizhni Novgorod Moscow Aviation Institute (National Research
University)
Moscow Institute of Physics and Technology
A scores Indicators total
Electrical Engineering – Number of A scores
Results Field-based Ranking
@UMultirank 25 25
@UMultirank
Mechanical Engineering – Number of A scores
7 7 4 3 3
0 5 10 15 20 25 30
Lomonosow Moscow State University Lomonosow Moscow State University Moscow Aviation Institute (National Research
University)
Southern Federal University Lobachevsky State University of Nizhni Novgorod
A scores Indicators total
Results Field-based Ranking
@UMultirank 26 26
@UMultirank
7 5 5 4 4 2
0 5 10 15 20 25 30 35
Tomsk State University Pyatigorsk State Linguistic University Siberian Federal University South Ural State University Lobachevsky State University of Nizhni Novgorod People's Friendship University of Russia
A scores Indicators total
Psychology – Number of A scores
Results Field-based Ranking
@UMultirank 27 27
@UMultirank
Business Studies – Number of A scores
8 5 4 3 3 2 2 2 1
0 5 10 15 20 25 30
Lomonosow Moscow State University Moscow Aviation Institute (National Research University)
Southern Federal University Moscow State University of economics, statistics and…
Moscow University for Industry and Finance "Synergy"
Moscow State University of economics, statistics and…
Moscow State University of economics, statistics and…
Lobachevsky State University of Nizhni Novgorod National Research University - Higher School of…
A scofres Indicators total
Summary and Outlook
• U-Multirank takes field-based rankings serious (35+
indicators)
• Data show the performance profile in five dimensions
• Participation of Russian universities is relatively low in field-based rankings
• Data incompleteness: U-Multirank offers help in coordination on data requirements among Russian participants
• Universities are invited to participate !
@UMultirank 28
Information/Contact
• For more information on U-Multirank visit, like and follow us, at
• www.u-multirank.eu
• /U-Multirank
• @UMultirank
• UMulitrank
• Contact/Expression of interest in participation
@UMultirank 29
30
Presented by:
U-Multirank A Multi-dimensional International
Ranking
Moscow Ranking Seminar, April 2015
Gero Federkeil, CHE Centre for Higher Education
