Skip to main content

Using Google Scholar Institutional Level Data to Evaluate the Quality of University Research

Mingers, John, O'Hanley, Jesse R., Okunola, Musbaudeen (2017) Using Google Scholar Institutional Level Data to Evaluate the Quality of University Research. Scientometrics, 113 (3). pp. 1627-1643. ISSN 0138-9130. E-ISSN 1588-2861. (doi:10.1007/s11192-017-2532-6) (KAR id:63635)

PDF Author's Accepted Manuscript
Language: English


Creative Commons Licence
This work is licensed under a Creative Commons Attribution 4.0 International License.
Download (492kB) Preview
[img]
Preview
Official URL
http://dx.doi.org/10.1007/s11192-017-2532-6

Abstract

In recent years, the extent of formal research evaluation, at all levels from the individual to the multiversity has increased dramatically. At the institutional level, there are world university rankings based on an ad hoc combination of different indicators. There are also national exercises, such as those in the UK and Australia that evaluate research outputs and environment through peer review panels. These are extremely costly and time consuming. This paper evaluates the possibility of using Google Scholar (GS) institutional level data to evaluate university research in a relatively automatic way. Several citation-based metrics are collected from GS for all 130 UK universities. These are used to evaluate performance and produce university rankings which are then compared with various rankings based on the 2014 UK Research Excellence Framework (REF). The rankings are shown to be credible and to avoid some of the obvious problems of the REF ranking, as well as being highly efficient and cost effective. We also investigate the possibility of normalizing the results for the university subject mix since science subjects generally produce significantly more citations than social science or humanities.

Item Type: Article
DOI/Identification number: 10.1007/s11192-017-2532-6
Uncontrolled keywords: scientometrics, research evaluation, research excellence framework (REF), Google Scholar
Divisions: Faculties > Social Sciences > Kent Business School > Management Science
Faculties > Social Sciences > Kent Business School > Centre for Logistics and Heuristic Organisation (CLHO)
Depositing User: Jesse O'Hanley
Date Deposited: 28 Sep 2017 11:21 UTC
Last Modified: 15 Jul 2019 12:50 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/63635 (The current URI for this page, for reference purposes)
Mingers, John: https://orcid.org/0000-0002-4102-4696
O'Hanley, Jesse R.: https://orcid.org/0000-0003-3522-8585
  • Depositors only (login required):

Downloads

Downloads per month over past year