Trajectories and regimes in research versus knowledge evaluations: Contributions to an evolutionary theory of citation


  • Loet Leydesdorff University of Amsterdam, Amsterdam School of Communication Research
  • Lin Zhang Wuhan University
  • Paul Wouters Leiden University, Centre for Science and Technology Studies (CWTS)


Palabras clave:

Interdisciplinarity, Synergy, Theory of citation, Bibliographic coupling, Co-citation, Research evaluation, Knowledge evaluation, Evolutionary theory of citation, Scholarly communication, Scientific journals, Indicators, Journal Citation Reports, JCR


Citation analysis can provide us with models of the evolutionary dynamics in scholarly and scientific communication. We propose to distinguish between institutional research evaluation (usually, ex post) and knowledge evaluation ex ante, in relation to directionality in citation analysis. We discuss the theoretical literature on communication systems which distinguishes between information and meaning, in which the concept of redundancy plays an important role as measure of the potential of a communication system. This is the basis for a model of knowledge dynamics which differentiates between observable variation and latent selection environments. We use indicators at the journal level and analyze the citation environments of journals in both the cited and citing directions. Among journals, the citing direction can be analyzed by co-citation and indicates the integration of knowledge from different fields. The cited direction can analogously be analyzed by bibliographic coupling and represents the extent to which the cited journal has become relevant for different disciplines, hence indicates knowledge diffusion. We apply this analysis on three different case studies of journal-journal relations: a small scale study of the journal Public Understanding of Science, a random sample of 100 journals, and a large-scale analysis of the set of JCR 2016 journals. Combined, the results seem to confirm the hypothesis that interdisciplinarity cannot be captured by one-dimensional citation analysis. Both citing and cited directions are relevant for knowledge and research evaluations, respectively. We raise the question whether indicators of interdisciplinarity can be developed by combining both directions in citation analysis, indicate further research, and discuss the normative implications of our preliminary results.


Abbasi, Alireza; Hossain, Liaquat; Leydesdorff, Loet (2012). “Betweenness centrality as a driver of preferential attachment in the evolution of research collaboration networks”. Journal of informetrics, v. 6, n. 3, pp. 403-412.

Andersen, Esben-Sloth (1992). Artificial economic evolution and Schumpeter. Aalborg: Institute for Production, University of Aalborg.

Audretsch, David B.; Feldman, Maryann P. (1996). “R&D spillovers and the geography of innovation and production”. The American economic review, v. 86, n. 3, pp. 630-640.

Bak, Per; Tang, Chao; Wiesenfeld, Kurt (1987). “Self-organized criticality: An explanation of the 1/f noise”. Physical review letters, v. 59, n. 4, pp. 381-384.

Boschma, Ron; Balland, Pierre-Alexandre; Kogler, Dieter (2014). Relatedness and technological change in cities: The rise and fall of technological knowledge in U.S. metropolitan areas from 1981 to 2010. No 1316, Papers in evolutionary economic geography (PEEG), Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography.

Boulding, Elise (1978). “Futuristics and the imaging capacity of the West”. In: Maruyama, Magoroh; Harkins, Arthur M. (eds.). Cultures of the future. De Gruyter Mouton.

Brooks, Daniel R.; Wiley, Edward O. (1986). Evolution as entropy. Chicago/London: University of Chicago Press. ISBN: 978 0 226075747

Bruckner, Eberhard; Ebeling, Werner O.; Miguel A. Jiménez-Montano; Scharnhorst, Andrea (1994). “Hyperselection and innovation described by a stochastic model of technological evolution”. In: Leydesdorff, Loet; Van-den-Besselaar, Peter (eds.). Evolutionary economics and chaos theory: New directions in technology studies, pp. 79-90. London: Pinter. ISBN: 978 0 312122188

Carter, Vicki (1996). “Do media influence learning? Revisiting the debate in the context of distance education”. Open learning: The journal of open, distance and e-learning, v. 11, n. 1, pp. 31-40.

Casson, Mark (1997). Information and organization: A new perspective on the theory of the firm. Oxford: Clarendon Press. ISBN: 978 0 198297802

Dosi, Giovanni (1982). “Technological paradigms and technological trajectories: A suggested interpretation of the determinants and directions of technical change”. Research policy, v. 11, n. 3, pp. 147-162.

Feldman, Maryann; Storper, Michael (2016). Economic growth and economic development: Geographic dimensions, definition & disparities.

Fujigaki, Yuko (1998). “Filling the gap between discussions on science and scientists’ everyday activities: Applying the autopoiesis system theory to scientific knowledge”. Social science information, v. 37, n. 1, pp. 5-22.

Garfield, Eugene (1964). “Science Citation Index - A new dimension in indexing”. Science, v. 144, n. 3619, pp. 649-654.

Garfield, Eugene (1971). “The mystery of the transposed journal lists - wherein Bradford’s Law of Scattering is generalized according to Garfield’s Law of Concentration”. Current contents, v. 3, n. 33, pp. 5-6. Reprinted in Essays of an information scientist, v. 1. Philadelphia: ISI Press, pp. 222-223, 1977.

Gibbons, Michael; Limoges, Camille; Nowotny, Helga; Schwartzman, Simon; Scott, Peter; Trow, Martin (1994). The New production of knowledge: The dynamics of science and research in contemporary societies. London: Sage. ISBN: 978 0 803977945

Giddens, Anthony (1984). The constitution of society. Cambridge: Polity Press. ISBN: 978 0 520057289

Gleick, James (2011). The information: A history, a theory, a flood. Knopf Doubleday Publishing Group. ISBN: 978 0 307 37957 3

Godin, Benoît (2006). “The knowledge-based economy: Conceptual framework or buzzword?”. Journal of technology transfer, v. 31, n. 1, pp. 17-30.

Griliches, Zvi (1994). “Explanations of productivity growth: Is the glass half-empty?”. American economic review, v. 84, n. 1.

Husserl, Edmund ([1935/36] 1962). Die Krisis der Europäischen Wissenschaften und die Transzendentale Phänomenologie. Den Haag: Martinus Nijhoff. ISBN: 978 9401013369

Ivanova, Inga A.; Leydesdorff, Loet (2014). “Rotational symmetry and the transformation of innovation systems in a triple helix of university-industry-government relations”. Technological forecasting and social change, v. 86, pp. 143-156.

Kessler, Maxwell-Mirton (1963). “Bibliographic coupling between scientific papers”. American documentation, v. 14, n. 1, pp. 10-25.

Kuhn, Thomas S. (1977). The essential tension: Selected studies in scientific tradition and change. Chicago: University of Chicago Press. ISBN: 978 0 226458052

Langford, Cooper H.; Hall, Jeremy K. (2005). “Complexity in cluster development: Towards an evolutionary theory to guide policy development”.

Langford, Cooper H.; Hall, Jeremy K.; Josty, Peter; Matos, Stelvia; Jacobson, A. (2006). “Indicators and outcomes of Canadian university research: Proxies becoming goals?”. Research policy, v. 35, n. 10, pp. 1586-1598.

Leydesdorff, Loet (2000). “Luhmann, Habermas and the theory of communication”. Systems research and behavioral science, v. 17, n. 3, pp. 273-288.<273::AID-SRES329>3.0.CO;2-R

Leydesdorff, Loet (2007). “Betweenness centrality as an indicator of the interdisciplinary of scientific journals”. Journal of the American Society for Information Science and Technology, v. 58, n. 9, pp. 1303-1319.

Leydesdorff, Loet; Ivanova, Inga A. (2014). “Mutual redundancies in interhuman communication systems: Steps toward a calculus of processing meaning”. Journal of the Association for Information Science and Technology, v. 65, n. 2, pp. 386-399.

Leydesdorff, Loet; Ivanova, Inga A. (2021). “The measurement of ‘interdisciplinarity’ and ‘synergy’ in scientific and extra-scientific collaborations”. Journal of the Association for Information Science and Technology, v. 72, pp. 347-402.

Leydesdorff, Loet; Ràfols, Ismael; Milojević, Staša (2020). “Bridging the divide between qualitative and quantitative science studies”. Quantitative science studies, v. 1, n. 3, pp. 918-926.

Leydesdorff, Loet; Wagner, Caroline S.; Bornmann, Lutz (2018). “Discontinuities in citation relations among journals: Self-organized criticality as a model of scientific revolutions and change”. Scientometrics, v. 116, n. 1, pp. 623-644.

Leydesdorff, Loet; Wagner, Caroline S.; Bornmann, Lutz (2019). “Interdisciplinarity as diversity in citation patterns among journals: Rao-Stirling diversity, relative variety, and the Gini coefficient”. Journal of informetrics, v. 13, n. 1, pp. 255-269.

Leydesdorff, Loet; Wagner, Caroline S.; Zhang, Lin (2021). “Are university rankings statistically significant? A comparison among Chinese universities and with the USA”. Journal of data and information science, v. 6, n. 2, pp. 67-95.

Leydesdorff, Loet; Ward, Janelle (2005). “Science shops: a kaleidoscope of science–society collaborations in Europe”. Public understanding of science, v. 14, n. 4.

Li, Tien-Yien; Yorke, James A. (1975). “Period three implies chaos”. The American mathematical monthly, v. 82, n. 10, pp. 985-992.

Luhmann, Niklas (1990a). “The cognitive program of constructivism and a reality that remains unknown”. In: W. Krohn; G. Küppers; H. Nowotny (eds.). Selforganization. Portrait of a scientific revolution, pp. 64-85. Dordrecht: Reidel. ISBN: 978 9 048140732

Luhmann, Niklas (1990b). Die Wissenschaft der Gesellschaft. Frankfurt a.M.: Suhrkamp. ISBN: 978 3 18580653

Luhmann, Niklas (1996). “On the scientific context of the concept of communication”. Social science information, v. 35, n. 2, pp. 257-267.

Luhmann, Niklas (2012). Theory of society, v. 1. Stanford, CA: Stanford University Press. ISBN: 978 0 804739504

Malerba, Franco; Nelson, Richard; Orsenigo, Luigi; Winter, Sidney G. (1999). “‘History-friendly’ models of industry evolution: The computer industry”. Industrial and corporate change, v. 8, n. 1, pp. 3-35.

Marres, Noortje; De-Rijcke, Sarah (2020). “From indicators to indicating interdisciplinarity: A participatory mapping methodology for research communities in-the-making”. Quantitative science studies, v. 1, n. 3, pp. 1041-1055.

Marshakova, Irena V. (1973). “Bibliographic coupling system based on references”. Nauchno-Tekhnicheskaya informatsiya seriya, Ser. 2, n. 6, pp. 3-8.

Maturana, Humberto R. (1978). “Biology of language: the epistemology of reality”. In: Miller, George A.; Lenneberg, Elizabeth (eds.). Psychology and biology of language and thought. Essays in honor of Eric Lenneberg (pp. 27-63). New York: Academic Press. ISBN: 978 1 483258140

Meireles, Magali-Rezende-Gouvea; Valadares-Cendon, Beatriz; De-Almeida, Paulo E. M. (2014). “Bibliometric knowledge organization: A domain analytic method using artificial neural network”. Knowledge organization, v. 41.

Nelson, Richard R.; Winter, Sidney G. (1977). “In search of useful theory of innovation”. Research policy, v. 6, n. 1, pp. 35-76.

Nelson, Richard R.; Winter, Sidney G. (1982). An evolutionary theory of economic change. Cambridge, MA: Belknap Press of Harvard University Press. ISBN: 978 0 674272286

Nonaka, Ikujiro; Takeuchi, Hirotaka (1995). The knowledge creating company. Oxford/New York: Oxford University Press. ISBN: 978 0 195092691

Petersen, Alexander M.; Rotolo, Daniele; Leydesdorff, Loet (2016). “A triple helix model of medical innovations: supply, demand, and technological capabilities in terms of Medical Subject Headings”. Research policy, v. 45, n. 3, pp. 666-681.

Popper, Karl R. ([1935] 1959). The logic of scientific discovery. London: Hutchinson. ISBN: 978 0 091117214

Ràfols, Ismael (2021). “‘Measuring’ interdisciplinarity: from indicators to indicating”. Integration and implementation insights (blogpost).

Ràfols, Ismael; Leydesdorff, Loet; O’Hare, Alice; Nightingale, Paul; Stirling, Andy (2012). “How journal rankings can suppress interdisciplinary research: A comparison between innovation studies and business and management”. Research policy, v. 41, n. 7, pp. 1262-1282.

Ràfols, Ismael; Meyer, Martin (2010). “Diversity and network coherence as indicators of interdisciplinarity: Case studies in bionanoscience”. Scientometrics, v. 82, n. 2, pp. 263-287.

Sahal, Devendra (1981). Patterns of technological innovation. Addison-Wesley. ISBN: 978 0 201066302

Schumpeter, Joseph A. (1939). Business cycles. A theoretical, historical and statistical analysis of the capitalist process.

Shannon, Claude E. (1948). “A mathematical theory of communication”. The Bell System technical journal, v. 27, n. 3, pp. 379-423.

Small, Henry (1973). “Co-citation in the scientific literature: A new measure of the relationship between two documents”. Journal of the American Society for Information Science, v. 24, n. 4, pp. 265-269.

Stirling, Andy (2007). “A general framework for analysing diversity in science, technology and society”. Journal of the Royal Society interface, v. 4, n. 15, pp. 707-719.

Whitley, Richard D. (1984). The intellectual and social organization of the sciences. Oxford: Oxford University Press. ISBN: 978 0 199240456

Zhang, Lin; Leydesdorff, Loet (2021). “The scientometric measurement of interdisciplinarity and diversity in research portfolios of Chinese universities”. Journal of data and information science, v. 6, n. 4, pp. 13-35.

Zhang, Lin; Rousseau, Ronald; Glänzel, Wolfgang (2016). “Diversity of references as an indicator of the interdisciplinarity of journals: Taking similarity between subject fields into account”. Journal of the Association for Information Science and Technology, v. 67, n. 5, pp. 1257-1265.

Zitt, Michel; Small, Henry (2008). “Modifying the journal impact factor by fractional citation weighting: The audience factor”. Journal of the American Society for Information Science and Technology, v. 59, n. 11, pp. 1856-1860.



Cómo citar

Leydesdorff, L., Zhang, L., & Wouters, P. (2022). Trajectories and regimes in research versus knowledge evaluations: Contributions to an evolutionary theory of citation. Profesional De La información, 32(1).



Artículos de investigación / Research articles


La descarga de datos todavía no está disponible.


Cargando métricas ...