Perspective and challenges for scientific evaluators and bibliometrics professionals

Authors

DOI:

https://doi.org/10.3145/epi.2018.may.01

Keywords:

Indicators, Spain, Latin America, New indicators, Altmetrics, Metrics, Social impact, Research evaluation, Science evaluation, Professionals, Aneca, Cneai.

Abstract

The current landscape on indicators is characterized by its great activity with new data sources emerging and new indicators being proposed. However, national evaluation processes in Spain and Latin America are characterized by the use of indicators and criteria defined by a conservative view of science becoming ever more updated and with a narrow vision of the scientific activity. In this text we reflect on this paradox and we put forward ideas on how we could work from the bibliometric community, both academic and professional, to connect these two worlds, new indicators and evaluation processes, that are so related and increasingly distant.

Downloads

Download data is not yet available.

References

Adam, Paula; Ovseiko, Pavel V.; Grant, Jonathan et al. (2018). "Isria statement: Ten-point guidelines for an effective process of research assessment". Health research policy and systems, v. 16, n. 8. https://dx.doi.org/10.1186%2Fs12961-018-0281-5

Gorraiz, Juan (2018). "Los mil y un reflejos de las publicaciones en el laberinto de espejos de las nuevas métricas". El profesional de la información, v. 27, n. 2, pp. 231-236. https://doi.org/10.3145/epi.2018.mar.01

Hicks, Diana; Wouters, Paul; Waltman, Ludo; De-Rijcke, Sarah; Rafols, Ismael (2015). "Bibliometrics: The Leiden manifesto for research metrics". Nature, v. 520, n. 7548, pp. 429-431. https://www.nature.com/news/bibliometrics-the-leiden-manifesto-for-research-metrics-1.17351

Larivière, Vincent; Ni, Chaoqun; Gingras, Yves; Cronin, Blaise; Sugimoto, Cassidy R. (2013). "Bibliometrics: Global gender disparities in science". Nature, v. 504, n. 7479, pp. 211-213. http://doi.org/10.1038/504211a

Rafols, Ismael; Ciarli, Tommaso; Van Zwanenberg, Patrick; Stirling, Andy (2012). Towards indicators for "˜opening up´ science and technology policy. http://2012.sticonference.org/Proceedings/vol2/Rafols_Towards_675.pdf

Rafols, Ismael; Molas-Gallart, Jordi; Chavarro, Diego-Andrés; Robinson-Garcí­a, Nicolás (2016). On the dominance of quantitative evaluation in "˜peripheral´ countries: Auditing research with technologies of distance. Agosto, 2016. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2818335

Rafols, Ismael; Yegros, Alfredo (2018). Is research responding to health needs?. March 2018. https://observatoriosociallacaixa.org/en/-/responde-la-investigacion-a-las-necesidades-de-salud

Robinson-Garcí­a, Nicolás; Amat, Carlos B. (2018). "¿Tiene sentido limitar la coautorí­a cientí­fica? No existe inflación de autores en Ciencias Sociales y Educación en España". Revista española de documentación cientí­fica, v. 41, n. 2, e201. http://doi.org/10.3989/redc.2018.2.1499

Robinson-Garcí­a, Nicolás; Costas, Rodrigo; Isett, Kimberley R.; Melkers, Julia; Hicks, Diana (2017). "The unbearable emptiness of tweeting - About journal articles". Plos one, v. 12, n. 8, e0183551. http://doi.org/10.1371/journal.pone.0183551

Robinson-Garcí­a, Nicolás; Van-Leeuwen, Thed N.; Rafols, Ismael (2018). "Using altmetrics for contextualised mapping of societal impact: From hits to networks". Science and public policy. http://doi.org/10.1093/scipol/scy024

Sugimoto, Cassidy R.; Robinson-Garcí­a, Nicolás; Murray, Dakota; Yegros-Yegros, Alfredo; Costas, Rodrigo; Larivière, Vincent (2017). "Scientists have most impact when they´re free to move". Nature, v. 550, pp. 29-31. http://doi.org/10.1038/550029a

Torres-Salinas, Daniel; Jiménez-Contreras, Evaristo (2012). "Hacia las unidades de bibliometrí­a en las universidades: modelo y funciones". Revista española de documentación cientí­fica, v. 35, n. 3, pp. 469-480. http://doi.org/10.3989/redc.2012.3.959

Torres-Salinas, Daniel; Jiménez-Contreras, Evaristo (2015). "El efecto Cajal: análisis bibliométrico del Programa Ramón y Cajal en la Universidad de Granada". Revista española de documentación cientí­fica, v. 38, n. 1, e075. http://doi.org/10.3989/redc.2015.1.1127

Torres-Salinas, Daniel; Robinson-Garcí­a, Nicolás; Herrera-Viedma, Enrique; Jiménez-Contreras, Evaristo (2018). "Consideraciones metodológicas sobre el uso del impacto normalizado en las convocatorias Severo Ochoa y Marí­a de Maetzu". El profesional de la información, v. 27, n. 2, pp. 367-374. http://doi.org/10.3145/epi.2018.mar.15

Wouters, Paul; Zahedi, Zohreh; Costas, Rodrigo (2018). "Social media metrics for new research evaluation". En: Glí¤nzel, Wolfang; Moed, Hank; Schmoch, Ulrich; Thelwall, Mike (eds). Handbook of Quantitative Science and Technology Research. Springer.

Downloads

Published

2018-06-17

How to Cite

Robinson-Garcí­a, N., Repiso, R., & Torres-Salinas, D. (2018). Perspective and challenges for scientific evaluators and bibliometrics professionals. Profesional De La información, 27(3), 461–466. https://doi.org/10.3145/epi.2018.may.01

Issue

Vol. 27 No. 3 (2018): Indicadores II / Libro electrónico

Section

Editorial

License

Dissemination conditions of the articles once they are published
Authors can freely disseminate their articles on websites, social networks and repositories
However, the following conditions must be respected:
- Only the editorial version should be made public. Please do not publish preprints, postprints or proofs.
- Along with this copy, a specific mention of the publication in which the text has appeared must be included, also adding a clickable link to the URL: http://www.profesionaldelainformacion.com
- Only the final editorial version should be made public. Please do not publish preprints, postprints or proofs.
- Along with that copy, a specific mention of the publication in which the text has appeared must be included, also adding a clickable link to the URL: http://revista.profesionaldelainformacion.com

Profesional de la información journal offers the articles in open access with a Creative Commons BY license.