How University Rankings Work: What the Big Three Tables Measure

Every year, a familiar ritual plays out: new editions of the world’s university rankings are published, a handful of famous names shuffle at the top, and universities everywhere issue press releases celebrating a climb — or quietly ignore a fall. The QS World University Rankings, the Times Higher Education (THE) World University Rankings and the Academic Ranking of World Universities (ARWU), known as the Shanghai Ranking, are the three lists that matter most. But few people who cite them understand what they actually measure — or what they leave out.
The three rankings that matter
Each of the big three comes from a different tradition. QS, produced by the British education company Quacquarelli Symonds, leans heavily on surveys of academics and employers. THE, published by Times Higher Education magazine, builds a composite score across teaching, research and international outlook. ARWU, compiled by researchers in Shanghai, is the most purely research-focused, counting prizes, citations and publications with little interest in reputation surveys.
Because their recipes differ, so do their results — though the same cluster of wealthy, research-intensive universities tends to dominate all three.
What they actually measure
Strip away the branding and the rankings are built from a handful of ingredients:
- Reputation surveys. QS and THE ask thousands of academics (and, for QS, employers) which universities they rate most highly. These surveys carry heavy weight and are the most subjective input.
- Research output and citations. All three count publications and how often they are cited, treating citations as a proxy for research influence.
- Faculty and student ratios. Measures such as staff-to-student ratios and the share of international staff and students feed into QS and THE.
- Prizes and elite markers. ARWU counts Nobel Prizes and Fields Medals won by alumni and staff, plus researchers it classes as highly cited.
- Industry and income. THE factors in income from industry as a proxy for real-world impact; newer QS editions add employment outcomes and sustainability.
Notice what dominates: research prestige and reputation. Undergraduate teaching quality barely registers.
Why the same names keep winning
Rankings reward the resources that produce rankings. Enormous endowments buy star researchers, who publish in high-impact journals, which lifts citation scores, which burnishes reputation, which attracts more funding. It is a feedback loop, and it strongly favours older, wealthier institutions in English-speaking countries, where the major journals and citation databases are concentrated.
Reputation surveys amplify the effect: academics tend to name the universities they already know are famous, so fame becomes self-perpetuating regardless of what is happening on campus today.
What the rankings miss
For all their precision, the big tables are blind to much of what makes a university good for a student. Teaching quality, class sizes, student support, graduate employability in specific fields, affordability and campus life are measured poorly or not at all. The arts, humanities and many professional disciplines count for little beside the citation-heavy sciences. And universities serving their own regions brilliantly — training the doctors, teachers and engineers a country actually needs — can be effectively invisible in a system built around global research prestige.
How universities play the game
Where there are rankings, there is gaming. Institutions have been known to hire highly cited researchers on short-term contracts to boost citation counts, to encourage favourable survey responses, and to restructure or rebrand to look better on specific indicators. Some of this shades into outright manipulation — and ranking organisations periodically adjust their methodologies in response, which is one reason year-to-year comparisons can mislead.
None of this means the underlying universities are bad. It means the number is measuring strategy as well as substance.
How to actually use a ranking
Treat rankings as one data point, not a verdict. If you are choosing where to study, subject-level rankings matter more than the overall table — a university ranked 200th overall may be top-20 in your field. Read the methodology: a ranking driven by reputation surveys answers a different question from one driven by citations. And supplement the numbers with what rankings cannot show — talking to students, visiting campuses, and weighing cost against likely outcomes.
The best question is not “which university is ranked highest?” but “ranked highest at what, for whom, and measured how?”
FAQs
Which ranking is the most reliable?
None is authoritative — they measure different things. ARWU is the most objective but narrowest, focused on research. QS and THE blend in reputation surveys, which are broader but subjective. Comparing all three gives a fuller picture than trusting any one.
Why do rankings change so little at the top?
The advantages are structural: endowments, reputation feedback loops and citation concentration change slowly. Movement is more common in the middle of the table, where smaller methodological tweaks can shift positions noticeably.
Do employers care about rankings?
Some do, especially for first jobs and in certain industries and countries — QS even includes an employer reputation survey. But most hiring decisions rest on skills, experience and interviews, and many excellent careers begin at unranked universities.
Are there rankings just for my subject?
Yes. QS, THE and others publish subject-level rankings covering fields from engineering to literature. These are usually far more useful than the overall table for choosing where to study a particular discipline.
Compiled by the Khabar 24h Editorial Desk from publicly available sources.
Leave a Reply