How to reform research evaluation in Spain. Institutional accreditation as a response to the European Agreement on research assessment. Letter

Autores/as

DOI:

https://doi.org/10.3145/epi.2022.nov.01

Palabras clave:

Research evaluation, Qualitative evaluation, Institutional accreditation, Evaluation, Research, Organic Law of the University System (LOSU), Accreditation agencies, Indicators, Metrics, Promotion, Researchers, Spain

Resumen

The reform of evaluation proposed at European level in the recent Agreement on Reforming Research Assessment represents a window of opportunity to reform the Spanish evaluation system, at a moment when the new Organic Law of the University System (LOSU) is being debated. This agreement establishes the primacy of peer review based on qualitative criteria in order to be able to recognize the diversity of contributions and research careers, and advocates to stop the inappropriate use of journal-based metrics. How can evaluation in Spain, heavily based on these metrics, be reformed to align with these principles? In this letter we propose that it is not possible to move towards the principles of the European agreement without making structural changes in the governance of evaluation, with a return of autonomy to the universities. We advocate that individual evaluations by agencies outside the university should be limited, and that, instead, institutional evaluation should be encouraged. We collect a proposal for ‘institutional accreditation’ as a public control mechanism for the hiring and promotion of professors at the university. 

Referencias

Ahedo-Gurrutxaga, Igor; Martínez-Palacios, Jone; Ormazabal-Gaston, Andere (2022). “Letter: Central nodes in the reform of the Spanish Universities Law”. Profesional de la información, v. 31, n. 3, e310309. https://doi.org/10.3145/epi.2022.may.09

Cañibano, Carolina; Vilardell, Immaculada; Corona, Carmen; Benito-Amat, Carlos (2018). “The evaluation of research excellence and the dynamics of knowledge production in the humanities: The case of history in Spain“. Science and public policy, v. 45, n. 6. https://doi.org/10.1093/scipol/scy025

Cruz-Castro, Laura; Rodríguez-Navarro, Alonso; Sanz-Menéndez, Luis (2022). “¡Que veinte años no es nada (en investigación)! La situación de la investigación no mejora como sería deseable”. En: Informe CYD 2021 sobre la contribución de las universidades al desarrollo económico y social, Barcelona: Fundación CYD.

Delgado-López-Cózar, Emilio; Martín-Martín, Alberto (2022). Detectando patrones anómalos de publicación científica en España: Más sobre el impacto del sistema de evaluación científica. Research Gate preprint. https://shorturl.at/clny1

Delgado-López-Cózar, Emilio; Ràfols, Ismael; Abadal, Ernest (2021). “Letter: A call for a radical change in research evaluation in Spain“. Profesional de la información, v. 30, n. 3, e300309. https://doi.org/10.3145/epi.2021.may.09

DEVA (2022). Propuestas de DEVA-AAC para una reforma del sistema de acreditación del profesorado universitario. Documento del Comité Técnico de Evaluación y Acreditación, Dirección de Evaluación y Acreditación (DEVA). Agencia Andaluza del Conocimiento.

European Commission (2021). Towards a reform of the research assessment system: scoping report, European Commission, Directorate-General for Research and Innovation. https://data.europa.eu/doi/10.2777/707440

Hicks, Diana; Wouters, Paul; Waltman, Ludo; De-Rijcke, Sarah; Ràfols, Ismael (2015). “Bibliometrics: the Leiden Manifesto for research metrics“. Nature, v. 520, n. 7548. https://doi.org/10.1038/520429a

Janssen, Matthijs J.; Bergek, Anna; Wesseling, Joeri H. (2022). “Evaluating systemic innovation and transition programmes: Towards a culture of learning“. PLoS sustainability and transformation, v. 1, n. 3. https://doi.org/10.1371/journal.pstr.0000008

Ministerio de Universidades (2022). Datos y cifras del Sistema Universitario Español. Publicación 2021-2022, Ministerio de Universidades. https://www.universidades.gob.es/stfls/universidades/Estadisticas/ficheros/DyC_2021_22.pdf

Moher, David; Bouter, Lex; Kleinert, Sabine; Glasziou, Paul; Sham, Mai-Har; Barbour, Virginia; Coriat, Anne-Marie; Foeger, Nicole; Dirnagl, Ulrich (2020). “The Hong Kong Principles for assessing researchers: Fostering research integrity“. PLoS Biology, v. 18, n. 7. https://doi.org/10.1371/journal.pbio.3000737

Molas-Gallart, Jordi; Boni, Alejandra; Giachi, Sandro; Schot, Johan (2021). “A formative approach to the evaluation of Transformative Innovation Policies”. Research evaluation, v. 30, n. 4, pp. 431-442. https://doi.org/10.1093/reseval/rvab016

Osuna, Carmen; Cruz-Castro, Laura; Sanz-Menéndez, Luis (2011). “Overturning some assumptions about the effects of evaluation systems on publication performance“. Scientometrics, v. 86, n. 3. https://doi.org/10.1007/s11192-010-0312-7

Ràfols, Ismael (2019). “S&T indicators in the wild: Contextualization and participation for responsible metrics”. Research evaluation, v. 28, n. 1. https://doi.org/10.1093/reseval/rvy030

Rodríguez-Navarro, Alonso (2021). “La evaluación de la investigación: España suspende“. Revista española de física, v. 35, n. 2.

Saenen, Bregt; Morais, Rita; Gaillard, Vinciane; Borrell-Damián, Lidia (2019). Research assessment in the transition to open science, European University Association (EUA). https://eua.eu/resources/publications/888:research-assessment-in-the-transition-to-open-science.html

Scott, James (1998). Seeing like a state. How certain schemes to improve the human condition have failed, New Haven; London: Yale University Press.

Weingart, Peter (2005). “Impact of bibliometrics upon the science system: Inadvertent consequences?”. Scientometrics, v. 62, n. 1. https://doi.org/10.1007/s11192-005-0007-7

Descargas

Publicado

2022-11-01

Cómo citar

Ràfols, I., & Molas-Gallart, J. (2022). How to reform research evaluation in Spain. Institutional accreditation as a response to the European Agreement on research assessment. Letter. Profesional De La información, 31(6). https://doi.org/10.3145/epi.2022.nov.01

Descargas

La descarga de datos todavía no está disponible.

Métricas

Cargando métricas ...