Testing the Secaba-Rank tool: Validating its methodology to measure the efficiency of libraries versus Data Envelopment Analysis (DEA) and the Finland method

Authors

DOI:

https://doi.org/10.3145/epi.2019.may.16

Keywords:

Academic libraries, Public libraries, Library evaluation, Efficiency, Secaba-Rank, Data Envelopment Analysis (DEA), Indicators, Methodologies, Library rankings, Benchmarking.

Abstract

The purpose of this article is to validate the Secaba-Rank methodology based on the System Potency indicator to measure the efficiency of libraries. It is carried out a comparison of the efficiency results according to three methods: Secaba-Rank methodology, Data Envelopment Analysis (DEA), and the Finland method. These three methods have been used to measure the efficiency of the public libraries at the level of autonomous communities and provinces, and the Spanish public university libraries. The method used for the comparison of the results is the analysis of the linear correlation coefficients for each pair of variables. The results are very close to 1 or -1 and statistically significant in all the cases. Thus, it can be concluded that the different methods, including the Secaba-Rank methodology, measure the efficiency. Finally, some advantages for the Secaba-Rank methodology are presented and argued.

Downloads

Download data is not yet available.

Author Biographies

Pedro Lázaro-Rodrí­guez, Universidad de Granada

Contratado predoctoral FPU. Departamento de Información y Comunicación.

Javier López-Gijón, Universidad de Granada

Departamento de Información y Comunicación. Profesor titular

Enrique Herrera-Viedma, Universidad de Granada

Departamento de Ciencias de la Computación e Inteligencia Artificial. Catedrático y Vicerrector de Investigación y transferencia.

References

Bar-Ilan, Judit (2005). "Comparing rankings of search results on the Web". Information processing & management, v. 41, n. 6, pp. 1511-1519. https://doi.org/10.1016/j.ipm.2005.03.008

Bustos-González, Atilio (2007). "Bibliotecas universitarias: ¿sabemos medir sus resultados e impactos?". El profesional de la información, v. 16, n. 4, pp. 281-286. https://doi.org/10.3145/epi.2007.jul.01

Charnes, Abraham; Cooper, William-Wager; Rhodes, Edwardo (1978). "Measuring the efficiency of decision making units". European journal of operational research, v. 2, n. 6, pp. 429-444. https://doi.org/10.1016/0377-2217(78)90138-8

Chen, Tser-yieth (1997). "A measurement of the resource utilization efficiency of university libraries". International journal of production economics, v. 53, n. 1, pp. 71-80. https://doi.org/10.1016/S0925-5273(97)00102-3

Chen, Yao; Morita, Hiroshi; Zhu, Joe (2005). "Context-dependent DEA with an application to Tokyo public libraries". International journal of information technology & decision making, v. 4, n. 3, pp. 385-394. https://doi.org/10.1142/S0219622005001635

De-Carvalho, Frederico A.; José-Jorge, Marcelino; Filgueiras-Jorge, Marina; De-Oliveira-Medeiros, Renata (2013). "Análise de eficiíªncia e desempenho no longo prazo: ilustraí§í£o empí­rica de um modelo para avaliaí§í£o de bibliotecas públicas". Investigación bibliotecológica: Archivonomí­a, bibliotecologí­a e información, v. 27, n. 60, pp. 71-95. https://doi.org/10.1016/S0187-358X(13)72544-9

Elkins, Mark R.; Maher, Christopher G.; Herbert, Robert D.; Moseley, Anne M.; Sherrington, Catherine (2010). "Correlation between the Journal Impact Factor and three other journal citation indices". Scientometrics, v. 85, n. 1, pp. 81-93. https://doi.org/10.1007/s11192-010-0262-0

Faccin-Camargo, Bruna; Lobán-Acero, Lidia; Garcí­a-Lacalle, Javier (2018). "Medición de la eficiencia en las bibliotecas de universidades públicas españolas". Revista gesto, v. 6, n. 1, p. 89. https://doi.org/10.31512/rg.v6i1.2670

Fernández, Sergio; Rubio, Francisco (2013). "¿El dinero importa? Relación entre el presupuesto de la biblioteca y la productividad investigadora de la Universitat Politècnica de València". Revista española de documentación cientí­fica, v. 36, n. 4, e023. https://doi.org/10.3989/redc.2013.4.1043

Hammond, Christopher J. (2002). "Efficiency in the provision of public services: A data envelopment analysis of UK public library systems". Applied economics, v. 34, n. 5, pp. 649-657. https://doi.org/10.1080/00036840110053252

ISO (2014). ISO 11620:2014 - Information and documentation -- Library performance indicators. https://www.iso.org/standard/56755.html

Lázaro-Rodrí­guez, Pedro; López-Gijón, Javier; Alonso, Sergio; Martí­nez-Sánchez, Marí­a-Ángeles; Herrera-Viedma, Enrique (2018). "Secaba-Rank, herramienta online para analizar y evaluar bibliotecas". El profesional de la información, v. 27, n. 2, pp. 278-288. https://doi.org/10.3145/epi.2018.mar.06

Lázaro-Rodrí­guez, Pedro; López-Gijón, Javier; Herrera-Viedma, Enrique (2018). "Visibilidad de las bibliotecas públicas y la lectura en medios de comunicación españoles frente a otros hechos de la cultura y relación con su uso: medidas para su mayor promoción y difusión". BiD: textos universitaris de biblioteconomia i documentació, n. 40. https://doi.org/10.1344/BiD2018.40.7

Lázaro-Rodrí­guez, Pedro; Vakkari, Pertti (2018). "Modelizando el uso de las bibliotecas públicas a través de sus caracterí­sticas: estudio comparativo entre España y Finlandia para los préstamos y las visitas". Revista española de documentación cientí­fica, v. 41, n. 4, e216. https://doi.org/10.3989/redc.2018.4.1544

Ling-Feng, Hsieh; Jiung-Bin, Chin; Mu-Chen, Wu (2014). "Cost efficiency and service effectiveness for university e-libraries in Taiwan". The electronic library, v. 32, n. 3, pp. 308-321. https://doi.org/10.1108/EL-10-2011-0146

Liu, Shiang-Tai; Chuang, Mang (2009). "Fuzzy efficiency measures in fuzzy DEA/AR with application to university libraries". Expert systems with applications, v. 36, n. 2, Part 1, pp. 1105-1113. https://doi.org/10.1016/j.eswa.2007.10.013

López-Gijón, Javier (2003). La red de lectura pública de Andalucí­a: un análisis sistémico. Tesis doctoral. Granada: Universidad de Granada. http://digibug.ugr.es/bitstream/10481/29141/1/Lopez-GijonJavier.pdf

Luque-Martí­nez, Teodoro; Faraoni, Nina; Doña-Toledo, Luis (2018). "Meta-ranking de universidades. Posicionamiento de las universidades españolas". Revista española de documentación cientí­fica, v. 41, n. 1, e198. https://doi.org/10.3989/redc.2018.1.1456

Martí­n-Martí­n, Alberto; Orduña-Malea, Enrique; Ayllón, Juan M.; Delgado-López-Cózar, Emilio (2016). "Un panorama académico de dos caras: retrato de los documentos altamente citados en Google Scholar (1950-2013)". Revista española de documentación cientí­fica, v. 39, n. 4, e149. https://doi.org/10.3989/redc.2016.4.1405

Martin-Martin, Alberto; Orduña-Malea, Enrique; Harzing, Anne-Wil; Delgado-López-Cózar, Emilio (2017). "Can we use Google Scholar to identify highly-cited documents?". Journal of informetrics, v. 11, n. 1, pp. 152-163. https://doi.org/10.1016/j.joi.2016.11.008

MECD (2018). Bibliotecas públicas españolas en cifras - Ministerio de Educación, Cultura y Deporte. http://www.mecd.gob.es/cultura-mecd/areas-cultura/bibliotecas/mc/ebp/portada.html

Rebiun (2018). Estadí­sticas Rebiun. Red de Bibliotecas Universitarias Españolas. http://rebiun.um.es

Reichmann, Gerhard (2007). "Measuring university library efficiency using data envelopment analysis". Libri, v. 54, n. 2, pp. 136-146. https://doi.org/10.1515/LIBR.2004.136

Reichmann, Gerhard; Sommersguter-Reichmann, Margit (2006). "University library benchmarking: An international comparison using DEA". International journal of production economics, v. 100, n. 1, pp. 131-147. https://doi.org/10.1016/j.ijpe.2004.10.007

Simón-De-Blas, Clara; Arias-Coello, Alicia; Simón-Martí­n, José (2007). "Aplicación de la técnica DEA en la medición de la eficiencia de las bibliotecas de la Universidad Complutense de Madrid". Revista española de documentación cientí­fica, v. 30, n. 1, pp. 9-23. https://doi.org/10.3989/redc.2007.v30.i1.366

Simon-Martí­n, José; Simon-De-Blas, Clara; Arias-Coello, Alicia (2011). "Changes in productivity of Spanish university libraries". Omega, v. 39, n. 5, pp. 578-588. https://doi.org/10.1016/j.omega.2010.12.003

Simón-Martí­n, José; Simón-De-Blas, Clara; Arias-Coello, Alicia (2016). "Ranking de las bibliotecas universitarias españolas en la gestión del personal". Revista española de documentación cientí­fica, v. 39, n. 1, e119. https://doi.org/10.3989/redc.2016.1.1259

Sin, Sei-Ching-Joanna; Vakkari, Pertti (2015). "Perceived outcomes of public libraries in the U.S." Library & information science research, v. 37, n. 3, pp. 209-219. https://doi.org/10.1016/j.lisr.2015.04.009

Stroobants, Jesse; Bouckaert, Geert (2014). "Benchmarking local public libraries using non-parametric frontier methods: A case study of Flanders". Library & information science research, v. 36, n. 3, pp. 211-224. https://doi.org/10.1016/j.lisr.2014.06.002

SYKT (2018). Suomen yleisten kirjastojen tilastot. Finnish Public Libraries Statistics Database. https://tilastot.kirjastot.fi/?lang=en

Tavares, Rafael-Santos; Drumond, Geisa-Meirelles; Angulo-Meza, Lidia; Méxas, Mirian-Picinini (2018). "Efficiency assessment in university libraries". Transinformaí§í£o, v. 30, n. 1, pp. 65-79. https://doi.org/10.1590/2318-08892018000100006

Vakkari, Pertti; Aabí¸, Svanhild; Audunson, Ragnar; Huysmans, Frank; Oomes, Marjolein (2014). "Perceived outcomes of public libraries in Finland, Norway and the Netherlands". Journal of documentation, v. 70, n. 5, pp. 927-944. https://doi.org/10.1108/JD-06-2013-0072

Vakkari, Pertti; Aabí¸, Svanhild; Audunson, Ragnar; Huysmans, Frank; Kwon, Nahyun; Oomes, Marjolein; Sin, Sei-Ching-Joanna (2016). "Patterns of perceived public library outcomes in five countries". Journal of documentation, v. 72, n. 2, pp. 342-361. https://doi.org/10.1108/JD-08-2015-0103

Published

2019-03-05

How to Cite

Lázaro-Rodrí­guez, P., López-Gijón, J., & Herrera-Viedma, E. (2019). Testing the Secaba-Rank tool: Validating its methodology to measure the efficiency of libraries versus Data Envelopment Analysis (DEA) and the Finland method. Profesional De La información, 28(3). https://doi.org/10.3145/epi.2019.may.16