To What Extent is Inclusion in the Web of Science an Indicator of Journal ‘Quality’?

47 Pages Posted: 24 Oct 2018

See all articles by Diego Andrés Chavarro

Diego Andrés Chavarro

University of Sussex - Science and Technology Policy Research Unit (SPRU)

Ismael Rafols

Ingenio (CSIC-UPV), Universitat Politècnica de València; Leiden University - Centre for Science and Technology Studies; SPRU (Science Policy Research Unit), University of Sussex

Puay Tang

University of Sussex

Date Written: January 2019

Abstract

The assessment of research based on the journal in which it is published is a widely adopted practice. Some research assessments use the Web of Science (WoS) to identify “high quality” journals, which are assumed to publish excellent research. The authority of WoS on journal quality stems from its selection of journals based on editorial standards and scientific impact criteria. These can be considered as universalistic criteria, meaning that they can be applied to any journal regardless of its place of publication, language, or discipline. In this article we examine the coverage by WoS of journals produced in Latin America, Spain, and Portugal. We use a logistic regression to examine the probability of a journal to be covered by WoS given universalistic criteria (editorial standards and scientific impact of the journal) and particularistic criteria (country, language, and discipline of the journal). We find that it is not possible to predict the inclusion of journals in WoS only through the universalistic criteria because particularistic variables such as country of the journal, its discipline and language are also related to inclusion in WoS. We conclude that using WoS as a universalistic tool for research assessment can disadvantage science published in journals with adequate editorial standards and scientific merit. We discuss the implications of these findings within the research evaluation literature, specifically for countries and disciplines not extensively covered by WoS.

Suggested Citation

Chavarro, Diego Andrés and Rafols, Ismael and Tang, Puay, To What Extent is Inclusion in the Web of Science an Indicator of Journal ‘Quality’? (January 2019). SWPS 2019-03, Available at SSRN: https://ssrn.com/abstract=3321197 or http://dx.doi.org/10.2139/ssrn.3321197

Diego Andrés Chavarro (Contact Author)

University of Sussex - Science and Technology Policy Research Unit (SPRU) ( email )

Mantell Building
Falmer
Brighton BN1 9RH UK, Sussex
United Kingdom

Ismael Rafols

Ingenio (CSIC-UPV), Universitat Politècnica de València ( email )

Camí de Vera s/n, Edif.8E, Univ.Politec.Valencia
València, País Valencià 46022
Spain

Leiden University - Centre for Science and Technology Studies ( email )

Leiden
Netherlands

SPRU (Science Policy Research Unit), University of Sussex ( email )

Brighton
United Kingdom

Puay Tang

University of Sussex ( email )

Sussex House
Falmer
Brighton, Sussex BNI 9RH
United Kingdom

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
35
Abstract Views
470
PlumX Metrics