Letter: A call for a radical change in research evaluation in Spain
DOI:
https://doi.org/10.3145/epi.2021.may.09Keywords:
Research evaluation, Performance assessment of researchers, Research policy, Bibliometric indicators, San Francisco Declaration on Research and Assessment, DORA, Leiden Manifesto, Journal Impact Factor, Journal level metrics, Citation counts, Scientific Journals, Scholarly publishing, Scientific ethicsAbstract
This letter is a call to the Spanish scientific authorities to abandon current research evaluation policies, which are based on an excessive and indiscriminate use of bibliometric indicators for nearly all areas of scientific activity. This narrow evaluation focus is especially applied to assess the individual performance of researchers. To this end, we first describe the contexts in which the journal impact factor (JIF) and other bibliometric indicators are being used. We then consider the toxic effects of this abuse of indicators. Finally, we outline some significant transformations and initiatives being introduced in various academic fields and regions of the world. These international initiatives offer alternatives to bibliometrics that can improve evaluation processes, and we urge political leaders in Spain to adopt and develop them.
Downloads
References
Aneca (2009). Informe sobre el estado de la evaluación externa de la calidad en las universidades españolas. Madrid: Aneca. http://deva.aac.es/include/files/deva/informes/evaluacion_externa/Informe_Calidad_2009.pdf
Delgado-López-Cózar, Emilio (2021). Sexenios 2020: Una revisión de estilo y un insólito a la par que loable esfuerzo de transparencia en el reino de los índices de impacto. https://doi.org/10.13140/RG.2.2.14771.14885
Delgado-López-Cózar, Emilio; Martín-Martín, Alberto (2019). "El factor de impacto de las revistas científicas sigue siendo ese número que devora la ciencia española: ¿hasta cuándo?". Anuario ThinkEPI, v. 13. https://doi.org/10.3145/thinkepi.2019.e13e09
De-Moya-Anegón, Félix (2020). Frecuencia de publicación e impacto de la producción científica mundial. Scimago Lab. https://www.scimagolab.com/blog/2020/frecuencia-de-publicacion-e-impacto-de-la-produccion-cientifica-mundial
De-Rijcke, Sarah; Wouters, Paul F.; Rushforth, Alex D.; Franssen, Thomas P.; Hammarfelt, Bjí¶rn (2016). "Evaluation practices and effects of indicator use: a literature review". Research evaluation, v. 25, n. 2, pp. 161-169. https://doi.org/10.1093/reseval/rvv038
Feenstra, Ramón A.; Delgado-López-Cózar, Emilio (2021). The footprint of a metrics-based research evaluation system on Spanish philosophical scholarship: an analysis of researchers perceptions. https://arxiv.org/abs/2103.11987
Feenstra, Ramón A.; Delgado-López-Cózar, Emilio; Pallarés-Domínguez, Daniel (2021). "Research misconduct in the fields of ethics and philosophy: researchers´ perceptions in Spain". Science and engineering ethics, v. 27, n. 1, pp. 1-21. https://doi.org/10.1007/s11948-021-00278-w
Fernández-Cano, Antonio (2021). "Publish, publish"¦ cursed!". Scientometrics, v. 126, n. 4, pp. 3673-3682. https://doi.org/10.1007/s11192-020-03833-7
Hicks, Diana; Wouters, Paul; Waltman, Ludo; De-Rijcke, Sarah; Ràfols, Ismael (2015). "Bibliometrics: the Leiden Manifesto for research metrics". Nature, v. 520, n. 7548, pp. 429-431. https://doi.org/10.1038/520429a
López-Piñeiro, Carla; Hicks, Diana (2015). "Reception of Spanish sociology by domestic and foreign audiences differs and has consequences for evaluation". Research evaluation, v. 24, n. 1, pp. 78-89. https://doi.org/10.1093/reseval/rvu030
Martin, Ben R. (2013). "Whither research integrity? Plagiarism, self-plagiarism and coercive citation in an age of research assessment". Research policy, v. 42, n. 5, pp. 1005-1014. https://doi.org/10.1016/j.respol.2013.03.011
Rodríguez-Bravo, Blanca; Nicholas, David (2019). "Reputación y comunicación científica: investigadores españoles en el inicio de su carrera". Profesional de la información, v. 28, n. 2, e280203. https://doi.org//10.3145/epi.2019.mar.03
Rodríguez-Navarro, Alonso (2009). "Sound research, unimportant discoveries: research, universities, and formal evaluation of research in Spain". Journal of the American Society for Information Science and Technology, v. 60, n. 9, pp. 1845-1858. https://doi.org/10.1002/asi.21104
Welpe, Isabell M.; Wollersheim, Jutta; Ringelhan, Stefanie; Osterloh, Margit (eds.) (2015). Incentives and performance. Heidelberg: Springer. ISBN: 978 3 319 09785 5
Wilsdon, James; Allen, Liz; Belfiore, Eleonora; Campbell, Philip; Curry, Stephen; Hill, Steven; Jones, Richard; Kain, Roger; Kerridge, Simon R.; Thelwall, Mike; Tinkler, Jane; Viney, Ian; Wouters, Paul (2016). The metric tide: Independent review of the role of metrics in research assessment and management. https://doi.org/10.13140/RG.2.1.4929.1363
Wilsdon, James; Bar-Ilan, Judit; Frodeman, Robert; Lex, Elisabeth; Peters, Isabella; Wouters, Paul (2017). Next-generation metrics: Responsible metrics and evaluation for open science. Report of the European Commission Expert Group on Altmetrics. Brussels: European Commission. https://op.europa.eu/en/publication-detail/-/publication/b858d952-0a19-11e7-8a35-01aa75ed71a1
Zhang, Lin; Sivertsen, Gunnar (2020). "The new research assessment reform in China and its implementation". Scholarly assessment reports, v. 2, n. 1. https://www.scholarlyassessmentreports.org/articles/10.29024/sar.15
Downloads
Published
How to Cite
Issue
Section
License
Dissemination conditions of the articles once they are published
Authors can freely disseminate their articles on websites, social networks and repositories
However, the following conditions must be respected:
- Only the editorial version should be made public. Please do not publish preprints, postprints or proofs.
- Along with this copy, a specific mention of the publication in which the text has appeared must be included, also adding a clickable link to the URL: http://www.profesionaldelainformacion.com
- Only the final editorial version should be made public. Please do not publish preprints, postprints or proofs.
- Along with that copy, a specific mention of the publication in which the text has appeared must be included, also adding a clickable link to the URL: http://revista.profesionaldelainformacion.com
Profesional de la información journal offers the articles in open access with a Creative Commons BY license.
