Trajectories and regimes in research versus knowledge evaluations: Contributions to an evolutionary theory of citation

Autores/as

  • Loet Leydesdorff University of Amsterdam, Amsterdam School of Communication Research
  • Lin Zhang Wuhan University
  • Paul Wouters Leiden University, Centre for Science and Technology Studies (CWTS)

DOI:

https://doi.org/10.3145/epi.2023.ene.03

Palabras clave:

Interdisciplinarity, Synergy, Theory of citation, Bibliographic coupling, Co-citation, Research evaluation, Knowledge evaluation, Evolutionary theory of citation, Scholarly communication, Scientific journals, Indicators, Journal Citation Reports, JCR

Resumen

Citation analysis can provide us with models of the evolutionary dynamics in scholarly and scientific communication. We propose to distinguish between institutional research evaluation (usually, ex post) and knowledge evaluation ex ante, in relation to directionality in citation analysis. We discuss the theoretical literature on communication systems which distinguishes between information and meaning, in which the concept of redundancy plays an important role as measure of the potential of a communication system. This is the basis for a model of knowledge dynamics which differentiates between observable variation and latent selection environments. We use indicators at the journal level and analyze the citation environments of journals in both the cited and citing directions. Among journals, the citing direction can be analyzed by co-citation and indicates the integration of knowledge from different fields. The cited direction can analogously be analyzed by bibliographic coupling and represents the extent to which the cited journal has become relevant for different disciplines, hence indicates knowledge diffusion. We apply this analysis on three different case studies of journal-journal relations: a small scale study of the journal Public Understanding of Science, a random sample of 100 journals, and a large-scale analysis of the set of JCR 2016 journals. Combined, the results seem to confirm the hypothesis that interdisciplinarity cannot be captured by one-dimensional citation analysis. Both citing and cited directions are relevant for knowledge and research evaluations, respectively. We raise the question whether indicators of interdisciplinarity can be developed by combining both directions in citation analysis, indicate further research, and discuss the normative implications of our preliminary results.

Referencias

Abbasi, Alireza; Hossain, Liaquat; Leydesdorff, Loet (2012). “Betweenness centrality as a driver of preferential attachment in the evolution of research collaboration networks”. Journal of informetrics, v. 6, n. 3, pp. 403-412. https://doi.org/10.1016/j.joi.2012.01.002

Andersen, Esben-Sloth (1992). Artificial economic evolution and Schumpeter. Aalborg: Institute for Production, University of Aalborg.

Audretsch, David B.; Feldman, Maryann P. (1996). “R&D spillovers and the geography of innovation and production”. The American economic review, v. 86, n. 3, pp. 630-640. http://links.jstor.org/sici?sici=0002-8282%28199606%2986%3A3%3C630%3ARSATGO%3E2.0.CO%3B2-Z

Bak, Per; Tang, Chao; Wiesenfeld, Kurt (1987). “Self-organized criticality: An explanation of the 1/f noise”. Physical review letters, v. 59, n. 4, pp. 381-384. https://doi.org/10.1103/PhysRevLett.59.381

Boschma, Ron; Balland, Pierre-Alexandre; Kogler, Dieter (2014). Relatedness and technological change in cities: The rise and fall of technological knowledge in U.S. metropolitan areas from 1981 to 2010. No 1316, Papers in evolutionary economic geography (PEEG), Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography. https://econpapers.repec.org/paper/eguwpaper/1316.htm

Boulding, Elise (1978). “Futuristics and the imaging capacity of the West”. In: Maruyama, Magoroh; Harkins, Arthur M. (eds.). Cultures of the future. De Gruyter Mouton. https://doi.org/10.1515/9783110800067

Brooks, Daniel R.; Wiley, Edward O. (1986). Evolution as entropy. Chicago/London: University of Chicago Press. ISBN: 978 0 226075747

Bruckner, Eberhard; Ebeling, Werner O.; Miguel A. Jiménez-Montano; Scharnhorst, Andrea (1994). “Hyperselection and innovation described by a stochastic model of technological evolution”. In: Leydesdorff, Loet; Van-den-Besselaar, Peter (eds.). Evolutionary economics and chaos theory: New directions in technology studies, pp. 79-90. London: Pinter. ISBN: 978 0 312122188

Carter, Vicki (1996). “Do media influence learning? Revisiting the debate in the context of distance education”. Open learning: The journal of open, distance and e-learning, v. 11, n. 1, pp. 31-40. https://doi.org/10.1080/0268051960110104

Casson, Mark (1997). Information and organization: A new perspective on the theory of the firm. Oxford: Clarendon Press. ISBN: 978 0 198297802

Dosi, Giovanni (1982). “Technological paradigms and technological trajectories: A suggested interpretation of the determinants and directions of technical change”. Research policy, v. 11, n. 3, pp. 147-162. https://doi.org/10.1016/0048-7333(82)90016-6

Feldman, Maryann; Storper, Michael (2016). Economic growth and economic development: Geographic dimensions, definition & disparities. https://maryannfeldman.web.unc.edu/wp-content/uploads/sites/1774/2011/11/Economic_Growth_and_Economic_Development_2016_Feldman_Storper.pdf

Fujigaki, Yuko (1998). “Filling the gap between discussions on science and scientists’ everyday activities: Applying the autopoiesis system theory to scientific knowledge”. Social science information, v. 37, n. 1, pp. 5-22. https://doi.org/10.1177/053901898037001001

Garfield, Eugene (1964). “Science Citation Index - A new dimension in indexing”. Science, v. 144, n. 3619, pp. 649-654. https://doi.org/10.1126/science.144.3619.649

Garfield, Eugene (1971). “The mystery of the transposed journal lists - wherein Bradford’s Law of Scattering is generalized according to Garfield’s Law of Concentration”. Current contents, v. 3, n. 33, pp. 5-6. Reprinted in Essays of an information scientist, v. 1. Philadelphia: ISI Press, pp. 222-223, 1977. http://www.garfield.library.upenn.edu/essays/V1p222y1962-73.pdf

Gibbons, Michael; Limoges, Camille; Nowotny, Helga; Schwartzman, Simon; Scott, Peter; Trow, Martin (1994). The New production of knowledge: The dynamics of science and research in contemporary societies. London: Sage. ISBN: 978 0 803977945

Giddens, Anthony (1984). The constitution of society. Cambridge: Polity Press. ISBN: 978 0 520057289

Gleick, James (2011). The information: A history, a theory, a flood. Knopf Doubleday Publishing Group. ISBN: 978 0 307 37957 3

Godin, Benoît (2006). “The knowledge-based economy: Conceptual framework or buzzword?”. Journal of technology transfer, v. 31, n. 1, pp. 17-30. https://doi.org/10.1007/s10961-005-5010-x

Griliches, Zvi (1994). “Explanations of productivity growth: Is the glass half-empty?”. American economic review, v. 84, n. 1.

Husserl, Edmund ([1935/36] 1962). Die Krisis der Europäischen Wissenschaften und die Transzendentale Phänomenologie. Den Haag: Martinus Nijhoff. ISBN: 978 9401013369

Ivanova, Inga A.; Leydesdorff, Loet (2014). “Rotational symmetry and the transformation of innovation systems in a triple helix of university-industry-government relations”. Technological forecasting and social change, v. 86, pp. 143-156. https://doi.org/10.1016/j.techfore.2013.08.022

Kessler, Maxwell-Mirton (1963). “Bibliographic coupling between scientific papers”. American documentation, v. 14, n. 1, pp. 10-25. https://doi.org/10.1002/asi.5090140103

Kuhn, Thomas S. (1977). The essential tension: Selected studies in scientific tradition and change. Chicago: University of Chicago Press. ISBN: 978 0 226458052

Langford, Cooper H.; Hall, Jeremy K. (2005). “Complexity in cluster development: Towards an evolutionary theory to guide policy development”. https://www.semanticscholar.org/paper/49cd670d11aafc8d2e20df0ce3ade7bd2b1ec7ef

Langford, Cooper H.; Hall, Jeremy K.; Josty, Peter; Matos, Stelvia; Jacobson, A. (2006). “Indicators and outcomes of Canadian university research: Proxies becoming goals?”. Research policy, v. 35, n. 10, pp. 1586-1598. https://doi.org/10.1016/j.respol.2006.09.021

Leydesdorff, Loet (2000). “Luhmann, Habermas and the theory of communication”. Systems research and behavioral science, v. 17, n. 3, pp. 273-288. https://doi.org/10.1002/(SICI)1099-1743(200005/06)17:3<273::AID-SRES329>3.0.CO;2-R

Leydesdorff, Loet (2007). “Betweenness centrality as an indicator of the interdisciplinary of scientific journals”. Journal of the American Society for Information Science and Technology, v. 58, n. 9, pp. 1303-1319. https://doi.org/10.1002/asi.20614

Leydesdorff, Loet; Ivanova, Inga A. (2014). “Mutual redundancies in interhuman communication systems: Steps toward a calculus of processing meaning”. Journal of the Association for Information Science and Technology, v. 65, n. 2, pp. 386-399. https://doi.org/10.1002/asi.22973

Leydesdorff, Loet; Ivanova, Inga A. (2021). “The measurement of ‘interdisciplinarity’ and ‘synergy’ in scientific and extra-scientific collaborations”. Journal of the Association for Information Science and Technology, v. 72, pp. 347-402. https://doi.org/10.1002/asi.24416

Leydesdorff, Loet; Ràfols, Ismael; Milojević, Staša (2020). “Bridging the divide between qualitative and quantitative science studies”. Quantitative science studies, v. 1, n. 3, pp. 918-926. https://doi.org/10.1162/qss_e_00061

Leydesdorff, Loet; Wagner, Caroline S.; Bornmann, Lutz (2018). “Discontinuities in citation relations among journals: Self-organized criticality as a model of scientific revolutions and change”. Scientometrics, v. 116, n. 1, pp. 623-644. https://doi.org/10.1007/s11192-018-2734-6

Leydesdorff, Loet; Wagner, Caroline S.; Bornmann, Lutz (2019). “Interdisciplinarity as diversity in citation patterns among journals: Rao-Stirling diversity, relative variety, and the Gini coefficient”. Journal of informetrics, v. 13, n. 1, pp. 255-269. https://doi.org/10.1016/j.joi.2018.12.006

Leydesdorff, Loet; Wagner, Caroline S.; Zhang, Lin (2021). “Are university rankings statistically significant? A comparison among Chinese universities and with the USA”. Journal of data and information science, v. 6, n. 2, pp. 67-95. https://doi.org/10.2478/jdis-2021-0014

Leydesdorff, Loet; Ward, Janelle (2005). “Science shops: a kaleidoscope of science–society collaborations in Europe”. Public understanding of science, v. 14, n. 4. https://doi.org/10.1177/0963662505056612

Li, Tien-Yien; Yorke, James A. (1975). “Period three implies chaos”. The American mathematical monthly, v. 82, n. 10, pp. 985-992.

Luhmann, Niklas (1990a). “The cognitive program of constructivism and a reality that remains unknown”. In: W. Krohn; G. Küppers; H. Nowotny (eds.). Selforganization. Portrait of a scientific revolution, pp. 64-85. Dordrecht: Reidel. ISBN: 978 9 048140732 https://luhmann.ir/wp-content/uploads/2021/07/The-Cognitive-Program-of-Constructivism-and-a-Reality-that-Remains-Unknown.pdf

Luhmann, Niklas (1990b). Die Wissenschaft der Gesellschaft. Frankfurt a.M.: Suhrkamp. ISBN: 978 3 18580653

Luhmann, Niklas (1996). “On the scientific context of the concept of communication”. Social science information, v. 35, n. 2, pp. 257-267. https://doi.org/10.1177/053901896035002005

Luhmann, Niklas (2012). Theory of society, v. 1. Stanford, CA: Stanford University Press. ISBN: 978 0 804739504

Malerba, Franco; Nelson, Richard; Orsenigo, Luigi; Winter, Sidney G. (1999). “‘History-friendly’ models of industry evolution: The computer industry”. Industrial and corporate change, v. 8, n. 1, pp. 3-35. https://doi.org/10.1093/icc/8.1.3

Marres, Noortje; De-Rijcke, Sarah (2020). “From indicators to indicating interdisciplinarity: A participatory mapping methodology for research communities in-the-making”. Quantitative science studies, v. 1, n. 3, pp. 1041-1055. https://doi.org/10.1162/qss_a_00062

Marshakova, Irena V. (1973). “Bibliographic coupling system based on references”. Nauchno-Tekhnicheskaya informatsiya seriya, Ser. 2, n. 6, pp. 3-8.

Maturana, Humberto R. (1978). “Biology of language: the epistemology of reality”. In: Miller, George A.; Lenneberg, Elizabeth (eds.). Psychology and biology of language and thought. Essays in honor of Eric Lenneberg (pp. 27-63). New York: Academic Press. ISBN: 978 1 483258140 https://sites.evergreen.edu/arunchandra/wp-content/uploads/sites/395/2018/05/BofLanguage.pdf

Meireles, Magali-Rezende-Gouvea; Valadares-Cendon, Beatriz; De-Almeida, Paulo E. M. (2014). “Bibliometric knowledge organization: A domain analytic method using artificial neural network”. Knowledge organization, v. 41. https://doi.org/10.5771/0943-7444-2014-2-145

Nelson, Richard R.; Winter, Sidney G. (1977). “In search of useful theory of innovation”. Research policy, v. 6, n. 1, pp. 35-76. https://doi.org/10.1016/0048-7333(77)90029-4

Nelson, Richard R.; Winter, Sidney G. (1982). An evolutionary theory of economic change. Cambridge, MA: Belknap Press of Harvard University Press. ISBN: 978 0 674272286

Nonaka, Ikujiro; Takeuchi, Hirotaka (1995). The knowledge creating company. Oxford/New York: Oxford University Press. ISBN: 978 0 195092691

Petersen, Alexander M.; Rotolo, Daniele; Leydesdorff, Loet (2016). “A triple helix model of medical innovations: supply, demand, and technological capabilities in terms of Medical Subject Headings”. Research policy, v. 45, n. 3, pp. 666-681. https://doi.org/10.1016/j.respol.2015.12.004

Popper, Karl R. ([1935] 1959). The logic of scientific discovery. London: Hutchinson. ISBN: 978 0 091117214

Ràfols, Ismael (2021). “‘Measuring’ interdisciplinarity: from indicators to indicating”. Integration and implementation insights (blogpost). https://i2insights.org/2021/2002/2009/measuring-interdisciplinarity

Ràfols, Ismael; Leydesdorff, Loet; O’Hare, Alice; Nightingale, Paul; Stirling, Andy (2012). “How journal rankings can suppress interdisciplinary research: A comparison between innovation studies and business and management”. Research policy, v. 41, n. 7, pp. 1262-1282. https://doi.org/10.1016/j.respol.2012.03.015

Ràfols, Ismael; Meyer, Martin (2010). “Diversity and network coherence as indicators of interdisciplinarity: Case studies in bionanoscience”. Scientometrics, v. 82, n. 2, pp. 263-287. https://doi.org/10.1007/s11192-009-0041-y

Sahal, Devendra (1981). Patterns of technological innovation. Addison-Wesley. ISBN: 978 0 201066302

Schumpeter, Joseph A. (1939). Business cycles. A theoretical, historical and statistical analysis of the capitalist process. https://www.mises.at/static/literatur/Buch/schumpeter-business-cycles-a-theoretical-historical-and-statistical-analysis-of-the-capitalist-process.pdf

Shannon, Claude E. (1948). “A mathematical theory of communication”. The Bell System technical journal, v. 27, n. 3, pp. 379-423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x

Small, Henry (1973). “Co-citation in the scientific literature: A new measure of the relationship between two documents”. Journal of the American Society for Information Science, v. 24, n. 4, pp. 265-269. https://doi.org/10.1002/asi.4630240406

Stirling, Andy (2007). “A general framework for analysing diversity in science, technology and society”. Journal of the Royal Society interface, v. 4, n. 15, pp. 707-719. https://doi.org/10.1098/rsif.2007.0213

Whitley, Richard D. (1984). The intellectual and social organization of the sciences. Oxford: Oxford University Press. ISBN: 978 0 199240456

Zhang, Lin; Leydesdorff, Loet (2021). “The scientometric measurement of interdisciplinarity and diversity in research portfolios of Chinese universities”. Journal of data and information science, v. 6, n. 4, pp. 13-35. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3798519

Zhang, Lin; Rousseau, Ronald; Glänzel, Wolfgang (2016). “Diversity of references as an indicator of the interdisciplinarity of journals: Taking similarity between subject fields into account”. Journal of the Association for Information Science and Technology, v. 67, n. 5, pp. 1257-1265. https://doi.org/10.1002/asi.23487

Zitt, Michel; Small, Henry (2008). “Modifying the journal impact factor by fractional citation weighting: The audience factor”. Journal of the American Society for Information Science and Technology, v. 59, n. 11, pp. 1856-1860. https://doi.org/10.1002/asi.20880

Publicado

2022-12-29

Cómo citar

Leydesdorff, L., Zhang, L., & Wouters, P. (2022). Trajectories and regimes in research versus knowledge evaluations: Contributions to an evolutionary theory of citation. Profesional De La información, 32(1). https://doi.org/10.3145/epi.2023.ene.03

Número

Sección

Artículos de investigación / Research articles

Descargas

La descarga de datos todavía no está disponible.

Métricas

Cargando métricas ...