A further step forward in measuring journals’ technological factor




Palabras clave:

Technological impact, Indicators, Journal technological factor, Journals, Scholarly journals, Patents, Patstat, Citations, Research performance, Bibliometrics, Non-patent references, NPR, Non-patent literature, NPL


A new indicator of technological impact of a scientific journal is presented, based on citations in patent applications to papers published in that journal. Key characteristics are that patent citations are aggregated by patent family, and that not all citations are considered equal. To each family citation a weight is assigned that is proportional to the Gross Domestic Product (GDP) of the countries in which protection is requested, to take into account the costs and expected benefits of patenting, and inversely proportional to the number of cited references in a patent family, as a way to correct for differences in citation frequencies in patent applications among technological fields. Around one third of journals indexed in Scopus have at least one citation from patent applications in a 5-year citation window. The distribution of the technological impact scores among journals can be modelled as a power law distribution, with the slope being a little smoother than that of common scientific impact indicators SJR and JIF. However, the correlations between technological and scientific impact indicators are mostly low or moderate, which shows that they measure quite different aspects of journal or research performance.


Archambault, Éric; Campbell, David; Gingras, Yves; Larivière, Vincent (2009). “Comparing bibliometric statistics obtained from the Web of Science and Scopus”. Journal of the American Society for Information Science and Technology (Jasist), v. 60, n. 7, pp. 1320-1326. https://doi.org/10.1002/asi.21062

Bergstrom, Carl T. (2007). “Eigenfactor: Measuring the value and prestige of scholarly journals”. College and research libraries news, v. 68, n. 5, pp. 314-316. https://doi.org/10.5860/crln.68.5.7804

Bornmann, Lutz; Daniel, Hans-Dieter (2008). “What do citation counts measure? A review of studies on citing behavior”. Journal of documentation, v. 64, n. 1, pp. 45-80. https://doi.org/10.1108/00220410810844150

Callaert, Julie; Van-Looy, Bart; Verbeek, Arnold; Debackere, Koenraad; Thijs, Bart (2006). “Traces of prior art: An analysis of non-patent references found in patent documents”. Scientometrics, v. 69, n. 1, pp. 3-20. https://doi.org/10.1007/s11192-006-0135-8

Callon, Michel; Courtial, Jean-Pierre; Penan, Hervé (1993). La scientométrie. Paris: PUF. ISBN: 2130452493

De-Moya-Anegón, Félix; Chinchilla-Rodríguez, Zaida; Vargas-Quesada, Benjamín; Corera-Álvarez, Elena; Muñoz-Fernández, Francisco-José; González-Molina, Antonio; Herrero-Solana, Víctor (2007). “Coverage analysis of Scopus: A journal metric approach”. Scientometrics, v. 73, n. 1, pp. 53-78. https://doi.org/10.1007/s11192-007-1681-4

De-Moya-Anegón, Félix; Guerrero-Bote, Vicente P.; López-Illescas, Carmen; Moed, Henk F. (2018). “Statistical relationships between corresponding authorship, international co-authorship and citation impact of national research systems”. Journal of informetrics, v. 12, n. 4, pp. 1251-1262. https://doi.org/10.1016/j.joi.2018.10.004

De-Moya-Anegón, Félix; Guerrero-Bote, Vicente P.; López-Illescas, Carmen; Moed, Henk F. (2020). “The citation impact of social sciences and humanities upon patentable technology”. Scientometrics (in press).

European Patent Office (2018). Data catalog Patstat global. Version 5.11. EPO Patstat customers. https://www.epo.org

Garfield, Eugene (1955). “Citation indexes for science: A new dimension in documentation through association of ideas”. Science, v. 122, n. 3159, pp. 108-111. https://doi.org/10.1126/science.122.3159.108

Garfield, Eugene (1972). “Citation analysis as a tool in journal evaluation”. Science, v. 178, pp. 471-479. https://doi.org/10.1126/science.178.4060.471

González-Pereira, Borja; Guerrero-Bote, Vicente P.; De-Moya‐Anegón, Félix (2010). A new approach to the metric of journals’ scientific prestige: The SJR indicator. Journal of informetrics, v. 4, n. 3, pp. 379-391. https://doi.org/10.1016/j.joi.2010.03.002

Gorraiz, Juan; Gumpenberger, Christian; Wieland, Martin (2011). “Galton 2011 revisited: a bibliometric journey in the footprints of a universal genius”. Scientometrics, v. 88, n. 2, pp. 627-652. https://doi.org/10.1007/s11192-011-0393-y

Guerrero‐Bote, Vicente P.; De-Moya‐Anegón, Félix (2012). “A further step forward in measuring journals’ scientific prestige: The SJR2 indicator”. Journal of Informetrics, v. 6, n. 4, pp. 674-688. https://doi.org/10.1016/j.joi.2012.07.001

Guerrero-Bote, Vicente P.; De-Moya-Anegón, Félix (2015). “Analysis of scientific production in food science from 2003 to 2013”. Journal of food science, v. 80, n. 12, pp. R2619-R2626. https://doi.org/10.1111/1750-3841.13108

Guerrero‐Bote, Vicente P.; Moed, Henk F.; De-Moya‐Anegón, Félix (2021). “New indicators of technological impact of scientific production”. Journal of data and information science (accepted).

Guerrero‐Bote, Vicente P.; Sánchez-Jiménez, Rodrigo; De-Moya‐Anegón, Félix (2019). “The citation from patents to scientific output revisited: a new approach to Patstat / Scopus matching”. El profesional de la información, v. 28, n. 4, e280401. https://doi.org/10.3145/epi.2019.jul.01

Halevi, Gali; Moed, Henk F. (2012). “The technological impact of library science research: A patent analysis”. In: Archambault, E.; Gingras, Y.; Larivière, V. (eds.). Proceedings of 17th International conference on science and technology indicators (v. 1, pp. 371-380), Montréal: Science-Metrix and OST. https://www.ost.uqam.ca/en/publications/proceedings-of-17th-international-conference-on-science-and-technology-indicators

Hane, Paula J. (2004). “Elsevier announces Scopus service”. Information today. http://newsbreaks.infotoday.com/nbreader.asp?ArticleID=16494

Huang, Mu-Hsuan; Huang, Wei-Tzu; Chen, Dar-Zen (2014). “Technological impact factor: An indicator to measure the impact of academic publications on practical innovation”. Journal of informetrics, v. 8, n. 1, pp. 241-251. https://doi.org/10.1016/j.joi.2013.12.004

Jacsó, Péter (2011). “The h-index, h-core citation rate and the bibliometric profile of the Scopus database”. Online information review, v. 35, n. 3, pp. 492-501. https://doi.org/10.1108/14684521111151487

Jefferson, Osmat A.; Jaffe, Adam; Ashton, Doug; Warren, Ben; Koellhofer, Deniz; Dulleck, Uwe; Bilder, G.; Ballagh, Aaron; Moe, John; DiCuccio, Michael; Ward, Karl; Bilder, Geoff; Dolby, Kevin; Jefferson, Richard A. (2018). “Mapping the global influence of published research on industry and innovation”. Nature biotechnology, v. 36, n. 1, pp. 31-39. https://doi.org/10.1038/nbt0818-772a

Kang, Byeongwoo; Tarasconi, Gianluca (2016). “Patstat revisited: Suggestions for better usage”. World patent information, v. 46, pp. 56-63. https://doi.org/10.1016/j.wpi.2016.06.001

Leydesdorff, Loet; De-Moya Anegón, Félix; Guerrero-Bote, Vicente P. (2010). “Journal maps on the basis of Scopus data: A comparison with the Journal Citation Reports of the ISI”. Journal of the American Society for Information Science and Technology, v. 61, n. 2, pp. 352-369. https://doi.org/10.1002/asi.21250

Liaw, Yi-Ching; Chan, Te-Yi; Fan, Chin-Yuan; Chiang, Cheng-Hsin (2014). “Can the technological impact of academic journals be evaluated? The practice of non-patent reference (NPR) analysis”. Scientometrics, v. 101, n. 1, pp. 17-37. https://doi.org/10.1007/s11192-014-1337-0

Martínez, Catalina (2011). “Patent families: When do different definitions really matter?”. Scientometrics, v. 86, pp. 39-63. https://doi.org/10.1007/s11192-010-0251-3

Merton, Robert K. (1957). “Priorities in scientific discovery: a chapter in the sociology of science”. American sociological review, v. 22, n. 6, pp. 635-659. https://doi.org/10.2307/2089193

Moed, Henk F. (2005). Citation analysis in research evaluation. Springer. ISBN: 978 1 4020 3713 9 https://doi.org/10.1007/1-4020-3714-7

Moed, Henk F. (2010). “Measuring contextual citation impact of scientific journals”. Journal of informetrics, v. 4, n. 3, pp. 265-277. https://doi.org/10.1016/j.joi.2010.01.002

Narin, Francis; Hamilton, Kimberley S.; Olivastro, Dominic (1997). “The increasing linkage between US technology and public science”. Research policy, v. 26, n. 3, pp. 317-330. https://doi.org/10.1016/s0048-7333(97)00013-9

Narin, Francis; Olivastro, Dominic (1992). “Status report: Linkage between technology and science”. Research policy, v. 21, n. 3, pp. 237-249. https://doi.org/10.1016/0048-7333(92)90018-y

Pickering, Bobby (2004). “Elsevier prepares Scopus to rival ISI Web of science”. Information world review, n. 8.

Pinski, Gabriel; Narin, Francis (1976). “Citation influence for journal aggregates of scientific publications: theory, with application to the literature of physics”. Information processing and management, v. 12, n. 5, pp. 297-312. https://doi.org/10.1016/0306-4573(76)90048-0

Price, Derek J. De-Solla (1963). Little science, big science. New York: Columbia University Press. ISBN: 978 0 231918442 https://doi.org/10.7312/pric91844

Salkind, Neil J.; Rainwater, Terese (2003). Exploring research. Upper Saddle River, NJ: Prentice Hall. ISBN: 978 9353068677

Van-Raan, Anthony F. J. (2017). “Patent citations analysis and its value in research evaluation: A review and a new approach to map technology-relevant research”. Journal of data and information science, v. 2, n. 1, pp. 13-50. https://doi.org/10.1515/jdis-2017-0002

Verbeek, Arnold; Debackere, Koenraad; Luwel, Marc; Andries, Petra; Zimmermann, Edwin; Deleus, Filip (2002). “Linking science to technology: Using bibliographic references in patents to build linkage schemes”. Scientometrics, v. 54, n. 3, pp. 399-420. https://doi.org/10.1023/a:1016034516731

Waltman, Ludo; Van-Eck, Nees-Jan; Van Leeuwen, Thed N.; Visser, Martijn S. (2013). “Some modifications to the SNIP journal impact indicator”. Journal of informetrics, v. 7, n. 2, pp. 272-285. https://doi.org/10.1016/j.joi.2012.11.011

Zitt, Michel; Small, Henry (2008). “Modifying the journal impact factor by fractional citation weighting: The audience factor”. Journal of The American Society for Information Science and Technology, v. 59, n. 11, pp. 1856-1860. https://doi.org/10.1002/asi.20880




Cómo citar

Guerrero-Bote, V. P., Moed, N., & De-Moya-Anegón, F. (2021). A further step forward in measuring journals’ technological factor. Profesional De La Información, 30(4). https://doi.org/10.3145/epi.2021.jul.06


La descarga de datos todavía no está disponible.