Letter: The unbearable lightness of the evaluation of research projects: do we need to regularize the professional activity of research evaluation?

Authors

DOI:

https://doi.org/10.3145/epi.2021.sep.13

Keywords:

Research evaluation, Bibliometrics, Research projects, Public funding of science, Science of science, Metaresearch, Regional research calls, Science management

Abstract

This letter aims to highlight severe inconsistencies in the scientific evaluation of regionally publicly funded research projects, uncovering structural failures related to the public management of science that go beyond technical aspects of bibliometrics. This problem is exemplified through an illustrative case study (the public grants program to emerging research groups funded by the regional government of the Valencian region, Spain, NUTS-2), describing three complementary aspects of this call (the evaluation system, the evaluation process, and the communication of the evaluation). The problems illustrated by this case study lead to a general problem related to the nonstrategic use of science. Finally, the national and international regularization of the professional activity of research evaluation in general, and bibliometrics in particular, is proposed as a route to avoid mismanagement of science (and scientific evaluation).

Downloads

Download data is not yet available.

References

Aguillo, Isidro F. (2021). "Respuesta a Delgado-López-Cózar et al. Factor de impacto: Muchas declaraciones y pocos resultados. Letter". Profesional de la información, v. 30, n. 3, e300315. https://doi.org/10.3145/epi.2021.may.15

Codina, Lluí­s (2021). "Carta: por un cambio en la evaluación de la investigación cientí­fica: "˜no tirar al niño junto con el agua sucia´. Profesional de la información, v. 30, n. 4, e300418. https://doi.org/10.3145/epi.2021.jul.18

Delgado-López-Cózar, Emilio; Ràfols, Ismael; Abadal, Ernest (2021). "Letter: A call for a radical change in research evaluation in Spain". Profesional de la información, v. 30, n. 3, e300309. https://doi.org/10.3145/epi.2021.may.09

DORA. San Francisco Declaration on Research Assessment (2012). https://sfdora.org/read

Hicks, Diana; Wouters, Paul; Waltman, Ludo; De-Rijcke, Sarah; Ràfols, Ismael (2015). "Bibliometrics: The Leiden Manifesto for research metrics". Nature, n. 520, pp. 429-431. https://doi.org/10.1038/520429a

Jappe, Arlette; Heinze, Thomas (2020). "Jurisdiction of bibliometrics". In: Ball, Rafael (ed.). Handbook bibliometrics. Berlin: De Gruyter Saur, pp. 91-98. ISBN: 978 3 11 064227 8 https://doi.org/10.1515/9783110646610-010

Published

2021-09-09

How to Cite

Enrique. (2021). Letter: The unbearable lightness of the evaluation of research projects: do we need to regularize the professional activity of research evaluation?. Profesional De La información, 30(5). https://doi.org/10.3145/epi.2021.sep.13