You are here

Methodology
Find out more about the methodology behind the QS

World University Content by Subject 2017

.

This year's QS World University Content by Subject features four new subjects, taking the total number of disciplines included to 46. The four new subjects are Anatomy & PhysiologyHospitality & Leisure ManagementSports-related Subjects and Theology, Divinity & Religious Studies.

As well as the rankings for 46 different subjects, this year’s QS World University Content by Subject also includes five rankings for broad subject areas: Arts & HumanitiesEngineering & TechnologyLife Sciences & MedicineNatural Sciences and Social Sciences & Management.

The QS World University Content by Subject ranks the world’s top universities in individual subject areas, covering 46 subjects as of 2017. The rankings aim to help prospective students identify the world’s leading schools in their chosen field, with the list of subjects extended each year in response to high demand for subject-level comparisons.

Each of the subject rankings is compiled using four sources. The first two of these are QS’s global surveys of academics and employers, which are used to assess institutions’ international reputation in each subject. The second two indicators assess research impact, based on research citations per paper and h-index in the relevant subject. These are sourced from Elsevier’s  database, the world’s most comprehensive research citations database. 

These four components are combined to produce the results for each of the subject rankings, with weightings adapted for each discipline.

1. Academic reputation

QS’s global survey of academics has been at the heart of the QS World University Content® since their inception in 2004. In 2017, the QS World University Content by Subject draws on responses from 74,651 academics worldwide.

Having provided their name, contact details, job title and the institution where they are based, respondents identify the countries, regions and faculty areas they are most familiar with, and up to two narrower subject disciplines in which they have expertise. For each of the (up to five) faculty areas they identify, respondents are asked to list up to 10 domestic and 30 international institutions which they consider to be excellent for research in the given area. They are not able to select their own institution.

For the QS World University Content by Subject, the results of the survey are filtered according to the narrow area of expertise identified by respondents. While academics can select up to two narrow areas of expertise, greater emphasis is placed on respondents who have identified only one.

2. Employer reputation

The QS World University Content are unique in incorporating employability as a key factor in the evaluation of international universities. In 2017, the QS World University Content by Subject draws on 40,643 survey responses from graduate employers worldwide.

The employer reputation survey works on a similar basis to the academic one, but without the channelling for different faculty areas. Employers are asked to identify up to 10 domestic and 30 international institutions they consider excellent for the recruitment of graduates. They are also asked to identify the disciplines from which they prefer to recruit. By examining the intersection of these two questions, we can infer a measure of excellence in a given discipline.

3. Research citations per paper

For the QS World University Content by Subject we measure citations per paper, rather than citations per faculty member. This is due to the impracticality of reliably gathering faculty numbers broken down by discipline for each institution.

A minimum publication threshold is set for each subject to avoid potential anomalies stemming from small numbers of highly cited papers. Both the minimum publications threshold and the weighting applied to the citations indicator are adapted in order to best reflect prevalent publication and citation patterns in a given discipline. All citations data is sourced from the , spanning a five-year period.

4. H-index

Since 2013, a score based on ‘h-index’ has also been incorporated in the QS World University Content by Subject. The h-index is a way of measuring both the productivity and impact of the published work of a scientist or scholar. The index is based on the set of the academic’s most cited papers and the number of citations that they have received in other publications.

The h-index can also be applied to the productivity and impact of a group of scientists, such as a department, university or country, as well as a scholarly journal. The index was suggested by Jorge E. Hirsch, a physicist at UCSD, as a tool for determining theoretical physicists’ relative quality, and is sometimes called the Hirsch index or Hirsch number.

How are large research collaborations assessed?

In 2016, QS introduced an improvement to the way research papers with authors from an exceptionally large number of institutions are assessed. Situations such as these occur most frequently in scientific subjects such as high-energy physics, cosmology, or genomics, where large-scale international collaborations are common.

If each institution involved in papers such as these receives full credit for the citations, even very important and worthwhile papers can end up having a disproportionately large impact on the ranking results. Yet it is equally undesirable to give each institution a share of the credit, as this could discourage research collaborations among groups of any size.

With the support of the QS Global Academic Advisory Board, the solution adopted was to omit any paper with more than 99.9% of the average number of institutional affiliations for the subject in question. This replaces the previous approach of omitting all papers with more than 10 institutional affiliations, which unfairly penalised certain scientific fields, such as medicine.

Weightings

As research cultures and publication rates vary significantly across academic disciplines, the QS World University Content by Subject applies a different weighting of the above indicators in each subject. For example, in medicine, where publication rates are very high, research citations and the h-index account for 25% of each university’s total score. On the other hand, in areas with much lower publication rates such as history, these research-related indicators only account for 15% of the total ranking score. Meanwhile in subjects such as art and design, where there are too few papers published to be statistically significant, the ranking is based solely on the employer and academic surveys.

Further details can be found on the  website. 

This article was originally published in February 2014. It was last updated in March 2017.

Want more content like this? Register for free site membership to get regular updates and your own personal content feed.

Related categories:

Chris M, Tefo T & 3 others saved this
Written by Craig OCallaghan
As editor of TopUniversities.com, Craig oversees the site's editorial content and network of student contributors. He also plays a key editorial role in the publication of several guides and reports, including the QS Top Grad School Guide.

Want to leave a comment?

Please login or register to post
comment above our articles

0 Comment