Skip to main content

Using Google Scholar Institutional Level Data to Evaluate the Quality of University Research

Mingers, John, O'Hanley, Jesse R., Okunola, Musbaudeen (2017) Using Google Scholar Institutional Level Data to Evaluate the Quality of University Research. Scientometrics, 113 (3). pp. 1627-1643. ISSN 0138-9130. E-ISSN 1588-2861. (doi:10.1007/s11192-017-2532-6) (KAR id:63635)

Abstract

In recent years, the extent of formal research evaluation, at all levels from the individual to the multiversity has increased dramatically. At the institutional level, there are world university rankings based on an ad hoc combination of different indicators. There are also national exercises, such as those in the UK and Australia that evaluate research outputs and environment through peer review panels. These are extremely costly and time consuming. This paper evaluates the possibility of using Google Scholar (GS) institutional level data to evaluate university research in a relatively automatic way. Several citation-based metrics are collected from GS for all 130 UK universities. These are used to evaluate performance and produce university rankings which are then compared with various rankings based on the 2014 UK Research Excellence Framework (REF). The rankings are shown to be credible and to avoid some of the obvious problems of the REF ranking, as well as being highly efficient and cost effective. We also investigate the possibility of normalizing the results for the university subject mix since science subjects generally produce significantly more citations than social science or humanities.

Item Type: Article
DOI/Identification number: 10.1007/s11192-017-2532-6
Uncontrolled keywords: scientometrics, research evaluation, research excellence framework (REF), Google Scholar
Divisions: Divisions > Kent Business School - Division > Department of Analytics, Operations and Systems
Depositing User: Jesse O'Hanley
Date Deposited: 28 Sep 2017 11:21 UTC
Last Modified: 19 Sep 2023 15:03 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/63635 (The current URI for this page, for reference purposes)

University of Kent Author Information

Mingers, John.

Creator's ORCID: https://orcid.org/0000-0002-4102-4696
CReDIT Contributor Roles:

O'Hanley, Jesse R..

Creator's ORCID: https://orcid.org/0000-0003-3522-8585
CReDIT Contributor Roles:

Okunola, Musbaudeen.

Creator's ORCID:
CReDIT Contributor Roles:
  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.