A further step forward in measuring journals´ technological factor
DOI:
https://doi.org/10.3145/epi.2021.jul.06Keywords:
Technological impact, Indicators, Journal technological factor, Journals, Scholarly journals, Patents, Patstat, Citations, Research performance, Bibliometrics, Non-patent references, NPR, Non-patent literature, NPLAbstract
A new indicator of technological impact of a scientific journal is presented, based on citations in patent applications to papers published in that journal. Key characteristics are that patent citations are aggregated by patent family, and that not all citations are considered equal. To each family citation a weight is assigned that is proportional to the Gross Domestic Product (GDP) of the countries in which protection is requested, to take into account the costs and expected benefits of patenting, and inversely proportional to the number of cited references in a patent family, as a way to correct for differences in citation frequencies in patent applications among technological fields. Around one third of journals indexed in Scopus have at least one citation from patent applications in a 5-year citation window. The distribution of the technological impact scores among journals can be modelled as a power law distribution, with the slope being a little smoother than that of common scientific impact indicators SJR and JIF. However, the correlations between technological and scientific impact indicators are mostly low or moderate, which shows that they measure quite different aspects of journal or research performance.
Downloads
References
Archambault, í‰ric; Campbell, David; Gingras, Yves; Larivière, Vincent (2009). "Comparing bibliometric statistics obtained from the Web of Science and Scopus". Journal of the American Society for Information Science and Technology (Jasist), v. 60, n. 7, pp. 1320-1326. https://doi.org/10.1002/asi.21062
Bergstrom, Carl T. (2007). "Eigenfactor: Measuring the value and prestige of scholarly journals". College and research libraries news, v. 68, n. 5, pp. 314-316. https://doi.org/10.5860/crln.68.5.7804
Bornmann, Lutz; Daniel, Hans-Dieter (2008). "What do citation counts measure? A review of studies on citing behavior". Journal of documentation, v. 64, n. 1, pp. 45-80. https://doi.org/10.1108/00220410810844150
Callaert, Julie; Van-Looy, Bart; Verbeek, Arnold; Debackere, Koenraad; Thijs, Bart (2006). "Traces of prior art: An analysis of non-patent references found in patent documents". Scientometrics, v. 69, n. 1, pp. 3-20. https://doi.org/10.1007/s11192-006-0135-8
Callon, Michel; Courtial, Jean-Pierre; Penan, Hervé (1993). La scientométrie. Paris: PUF. ISBN: 2130452493
De-Moya-Anegón, Félix; Chinchilla-Rodríguez, Zaida; Vargas-Quesada, Benjamín; Corera-Álvarez, Elena; Muñoz-Fernández, Francisco-José; González-Molina, Antonio; Herrero-Solana, Víctor (2007). "Coverage analysis of Scopus: A journal metric approach". Scientometrics, v. 73, n. 1, pp. 53-78. https://doi.org/10.1007/s11192-007-1681-4
De-Moya-Anegón, Félix; Guerrero-Bote, Vicente P.; López-Illescas, Carmen; Moed, Henk F. (2018). "Statistical relationships between corresponding authorship, international co-authorship and citation impact of national research systems". Journal of informetrics, v. 12, n. 4, pp. 1251-1262. https://doi.org/10.1016/j.joi.2018.10.004
De-Moya-Anegón, Félix; Guerrero-Bote, Vicente P.; López-Illescas, Carmen; Moed, Henk F. (2020). "The citation impact of social sciences and humanities upon patentable technology". Scientometrics (in press).
European Patent Office (2018). Data catalog Patstat global. Version 5.11. EPO Patstat customers. https://www.epo.org
Garfield, Eugene (1955). "Citation indexes for science: A new dimension in documentation through association of ideas". Science, v. 122, n. 3159, pp. 108-111. https://doi.org/10.1126/science.122.3159.108
Garfield, Eugene (1972). "Citation analysis as a tool in journal evaluation". Science, v. 178, pp. 471-479. https://doi.org/10.1126/science.178.4060.471
González-Pereira, Borja; Guerrero-Bote, Vicente P.; De-Moya"Anegón, Félix (2010). A new approach to the metric of journals´ scientific prestige: The SJR indicator. Journal of informetrics, v. 4, n. 3, pp. 379-391. https://doi.org/10.1016/j.joi.2010.03.002
Gorraiz, Juan; Gumpenberger, Christian; Wieland, Martin (2011). "Galton 2011 revisited: a bibliometric journey in the footprints of a universal genius". Scientometrics, v. 88, n. 2, pp. 627-652. https://doi.org/10.1007/s11192-011-0393-y
Guerrero"Bote, Vicente P.; De-Moya"Anegón, Félix (2012). "A further step forward in measuring journals´ scientific prestige: The SJR2 indicator". Journal of Informetrics, v. 6, n. 4, pp. 674-688. https://doi.org/10.1016/j.joi.2012.07.001
Guerrero-Bote, Vicente P.; De-Moya-Anegón, Félix (2015). "Analysis of scientific production in food science from 2003 to 2013". Journal of food science, v. 80, n. 12, pp. R2619-R2626. https://doi.org/10.1111/1750-3841.13108
Guerrero"Bote, Vicente P.; Moed, Henk F.; De-Moya"Anegón, Félix (2021). "New indicators of technological impact of scientific production". Journal of data and information science (accepted).
Guerrero"Bote, Vicente P.; Sánchez-Jiménez, Rodrigo; De-Moya"Anegón, Félix (2019). "The citation from patents to scientific output revisited: a new approach to Patstat / Scopus matching". El profesional de la información, v. 28, n. 4, e280401. https://doi.org/10.3145/epi.2019.jul.01
Halevi, Gali; Moed, Henk F. (2012). "The technological impact of library science research: A patent analysis". In: Archambault, E.; Gingras, Y.; Larivière, V. (eds.). Proceedings of 17th International conference on science and technology indicators (v. 1, pp. 371-380), Montréal: Science-Metrix and OST. https://www.ost.uqam.ca/en/publications/proceedings-of-17th-international-conference-on-science-and-technology-indicators
Hane, Paula J. (2004). "Elsevier announces Scopus service". Information today. http://newsbreaks.infotoday.com/nbreader.asp?ArticleID=16494
Huang, Mu-Hsuan; Huang, Wei-Tzu; Chen, Dar-Zen (2014). "Technological impact factor: An indicator to measure the impact of academic publications on practical innovation". Journal of informetrics, v. 8, n. 1, pp. 241-251. https://doi.org/10.1016/j.joi.2013.12.004
Jacsó, Péter (2011). "The h-index, h-core citation rate and the bibliometric profile of the Scopus database". Online information review, v. 35, n. 3, pp. 492-501. https://doi.org/10.1108/14684521111151487
Jefferson, Osmat A.; Jaffe, Adam; Ashton, Doug; Warren, Ben; Koellhofer, Deniz; Dulleck, Uwe; Bilder, G.; Ballagh, Aaron; Moe, John; DiCuccio, Michael; Ward, Karl; Bilder, Geoff; Dolby, Kevin; Jefferson, Richard A. (2018). "Mapping the global influence of published research on industry and innovation". Nature biotechnology, v. 36, n. 1, pp. 31-39. https://doi.org/10.1038/nbt0818-772a
Kang, Byeongwoo; Tarasconi, Gianluca (2016). "Patstat revisited: Suggestions for better usage". World patent information, v. 46, pp. 56-63. https://doi.org/10.1016/j.wpi.2016.06.001
Leydesdorff, Loet; De-Moya Anegón, Félix; Guerrero-Bote, Vicente P. (2010). "Journal maps on the basis of Scopus data: A comparison with the Journal Citation Reports of the ISI". Journal of the American Society for Information Science and Technology, v. 61, n. 2, pp. 352-369. https://doi.org/10.1002/asi.21250
Liaw, Yi-Ching; Chan, Te-Yi; Fan, Chin-Yuan; Chiang, Cheng-Hsin (2014). "Can the technological impact of academic journals be evaluated? The practice of non-patent reference (NPR) analysis". Scientometrics, v. 101, n. 1, pp. 17-37. https://doi.org/10.1007/s11192-014-1337-0
Martínez, Catalina (2011). "Patent families: When do different definitions really matter?". Scientometrics, v. 86, pp. 39-63. https://doi.org/10.1007/s11192-010-0251-3
Merton, Robert K. (1957). "Priorities in scientific discovery: a chapter in the sociology of science". American sociological review, v. 22, n. 6, pp. 635-659. https://doi.org/10.2307/2089193
Moed, Henk F. (2005). Citation analysis in research evaluation. Springer. ISBN: 978 1 4020 3713 9 https://doi.org/10.1007/1-4020-3714-7
Moed, Henk F. (2010). "Measuring contextual citation impact of scientific journals". Journal of informetrics, v. 4, n. 3, pp. 265-277. https://doi.org/10.1016/j.joi.2010.01.002
Narin, Francis; Hamilton, Kimberley S.; Olivastro, Dominic (1997). "The increasing linkage between US technology and public science". Research policy, v. 26, n. 3, pp. 317-330. https://doi.org/10.1016/s0048-7333(97)00013-9
Narin, Francis; Olivastro, Dominic (1992). "Status report: Linkage between technology and science". Research policy, v. 21, n. 3, pp. 237-249. https://doi.org/10.1016/0048-7333(92)90018-y
Pickering, Bobby (2004). "Elsevier prepares Scopus to rival ISI Web of science". Information world review, n. 8.
Pinski, Gabriel; Narin, Francis (1976). "Citation influence for journal aggregates of scientific publications: theory, with application to the literature of physics". Information processing and management, v. 12, n. 5, pp. 297-312. https://doi.org/10.1016/0306-4573(76)90048-0
Price, Derek J. De-Solla (1963). Little science, big science. New York: Columbia University Press. ISBN: 978 0 231918442 https://doi.org/10.7312/pric91844
Salkind, Neil J.; Rainwater, Terese (2003). Exploring research. Upper Saddle River, NJ: Prentice Hall. ISBN: 978 9353068677
Van-Raan, Anthony F. J. (2017). "Patent citations analysis and its value in research evaluation: A review and a new approach to map technology-relevant research". Journal of data and information science, v. 2, n. 1, pp. 13-50. https://doi.org/10.1515/jdis-2017-0002
Verbeek, Arnold; Debackere, Koenraad; Luwel, Marc; Andries, Petra; Zimmermann, Edwin; Deleus, Filip (2002). "Linking science to technology: Using bibliographic references in patents to build linkage schemes". Scientometrics, v. 54, n. 3, pp. 399-420. https://doi.org/10.1023/a:1016034516731
Waltman, Ludo; Van-Eck, Nees-Jan; Van Leeuwen, Thed N.; Visser, Martijn S. (2013). "Some modifications to the SNIP journal impact indicator". Journal of informetrics, v. 7, n. 2, pp. 272-285. https://doi.org/10.1016/j.joi.2012.11.011
Zitt, Michel; Small, Henry (2008). "Modifying the journal impact factor by fractional citation weighting: The audience factor". Journal of The American Society for Information Science and Technology, v. 59, n. 11, pp. 1856-1860. https://doi.org/10.1002/asi.20880
Downloads
Published
How to Cite
Issue
Section
License
Dissemination conditions of the articles once they are published
Authors can freely disseminate their articles on websites, social networks and repositories
However, the following conditions must be respected:
- Only the editorial version should be made public. Please do not publish preprints, postprints or proofs.
- Along with this copy, a specific mention of the publication in which the text has appeared must be included, also adding a clickable link to the URL: http://www.profesionaldelainformacion.com
- Only the final editorial version should be made public. Please do not publish preprints, postprints or proofs.
- Along with that copy, a specific mention of the publication in which the text has appeared must be included, also adding a clickable link to the URL: http://revista.profesionaldelainformacion.com
Profesional de la información journal offers the articles in open access with a Creative Commons BY license.
