Letter: The unbearable lightness of the evaluation of research projects: do we need to regularize the professional activity of research evaluation?
DOI:
https://doi.org/10.3145/epi.2021.sep.13Keywords:
Research evaluation, Bibliometrics, Research projects, Public funding of science, Science of science, Metaresearch, Regional research calls, Science managementAbstract
This letter aims to highlight severe inconsistencies in the scientific evaluation of regionally publicly funded research projects, uncovering structural failures related to the public management of science that go beyond technical aspects of bibliometrics. This problem is exemplified through an illustrative case study (the public grants program to emerging research groups funded by the regional government of the Valencian region, Spain, NUTS-2), describing three complementary aspects of this call (the evaluation system, the evaluation process, and the communication of the evaluation). The problems illustrated by this case study lead to a general problem related to the nonstrategic use of science. Finally, the national and international regularization of the professional activity of research evaluation in general, and bibliometrics in particular, is proposed as a route to avoid mismanagement of science (and scientific evaluation).
Downloads
References
Aguillo, Isidro F. (2021). "Respuesta a Delgado-López-Cózar et al. Factor de impacto: Muchas declaraciones y pocos resultados. Letter". Profesional de la información, v. 30, n. 3, e300315. https://doi.org/10.3145/epi.2021.may.15
Codina, Lluís (2021). "Carta: por un cambio en la evaluación de la investigación científica: "˜no tirar al niño junto con el agua sucia´. Profesional de la información, v. 30, n. 4, e300418. https://doi.org/10.3145/epi.2021.jul.18
Delgado-López-Cózar, Emilio; Ràfols, Ismael; Abadal, Ernest (2021). "Letter: A call for a radical change in research evaluation in Spain". Profesional de la información, v. 30, n. 3, e300309. https://doi.org/10.3145/epi.2021.may.09
DORA. San Francisco Declaration on Research Assessment (2012). https://sfdora.org/read
Hicks, Diana; Wouters, Paul; Waltman, Ludo; De-Rijcke, Sarah; Ràfols, Ismael (2015). "Bibliometrics: The Leiden Manifesto for research metrics". Nature, n. 520, pp. 429-431. https://doi.org/10.1038/520429a
Jappe, Arlette; Heinze, Thomas (2020). "Jurisdiction of bibliometrics". In: Ball, Rafael (ed.). Handbook bibliometrics. Berlin: De Gruyter Saur, pp. 91-98. ISBN: 978 3 11 064227 8 https://doi.org/10.1515/9783110646610-010
Downloads
Published
How to Cite
Issue
Section
License
Dissemination conditions of the articles once they are published
Authors can freely disseminate their articles on websites, social networks and repositories
However, the following conditions must be respected:
- Only the editorial version should be made public. Please do not publish preprints, postprints or proofs.
- Along with this copy, a specific mention of the publication in which the text has appeared must be included, also adding a clickable link to the URL: http://www.profesionaldelainformacion.com
- Only the final editorial version should be made public. Please do not publish preprints, postprints or proofs.
- Along with that copy, a specific mention of the publication in which the text has appeared must be included, also adding a clickable link to the URL: http://revista.profesionaldelainformacion.com
Profesional de la información journal offers the articles in open access with a Creative Commons BY license.