Trajectories and regimes in research versus knowledge evaluations: Contributions to an evolutionary theory of citation
DOI:
https://doi.org/10.3145/epi.2023.ene.03Palabras clave:
Interdisciplinarity, Synergy, Theory of citation, Bibliographic coupling, Co-citation, Research evaluation, Knowledge evaluation, Evolutionary theory of citation, Scholarly communication, Scientific journals, Indicators, Journal Citation Reports, JCRResumen
Citation analysis can provide us with models of the evolutionary dynamics in scholarly and scientific communication. We propose to distinguish between institutional research evaluation (usually, ex post) and knowledge evaluation ex ante, in relation to directionality in citation analysis. We discuss the theoretical literature on communication systems which distinguishes between information and meaning, in which the concept of redundancy plays an important role as measure of the potential of a communication system. This is the basis for a model of knowledge dynamics which differentiates between observable variation and latent selection environments. We use indicators at the journal level and analyze the citation environments of journals in both the cited and citing directions. Among journals, the citing direction can be analyzed by co-citation and indicates the integration of knowledge from different fields. The cited direction can analogously be analyzed by bibliographic coupling and represents the extent to which the cited journal has become relevant for different disciplines, hence indicates knowledge diffusion. We apply this analysis on three different case studies of journal-journal relations: a small scale study of the journal Public Understanding of Science, a random sample of 100 journals, and a large-scale analysis of the set of JCR 2016 journals. Combined, the results seem to confirm the hypothesis that interdisciplinarity cannot be captured by one-dimensional citation analysis. Both citing and cited directions are relevant for knowledge and research evaluations, respectively. We raise the question whether indicators of interdisciplinarity can be developed by combining both directions in citation analysis, indicate further research, and discuss the normative implications of our preliminary results.
Descargas
Citas
Abbasi, Alireza; Hossain, Liaquat; Leydesdorff, Loet (2012). "Betweenness centrality as a driver of preferential attachment in the evolution of research collaboration networks". Journal of informetrics, v. 6, n. 3, pp. 403-412. https://doi.org/10.1016/j.joi.2012.01.002
Andersen, Esben-Sloth (1992). Artificial economic evolution and Schumpeter. Aalborg: Institute for Production, University of Aalborg.
Audretsch, David B.; Feldman, Maryann P. (1996). "R&D spillovers and the geography of innovation and production". The American economic review, v. 86, n. 3, pp. 630-640. http://links.jstor.org/sici?sici=0002-8282%28199606%2986%3A3%3C630%3ARSATGO%3E2.0.CO%3B2-Z
Bak, Per; Tang, Chao; Wiesenfeld, Kurt (1987). "Self-organized criticality: An explanation of the 1/f noise". Physical review letters, v. 59, n. 4, pp. 381-384. https://doi.org/10.1103/PhysRevLett.59.381
Boschma, Ron; Balland, Pierre-Alexandre; Kogler, Dieter (2014). Relatedness and technological change in cities: The rise and fall of technological knowledge in U.S. metropolitan areas from 1981 to 2010. No 1316, Papers in evolutionary economic geography (PEEG), Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography. https://econpapers.repec.org/paper/eguwpaper/1316.htm
Boulding, Elise (1978). "Futuristics and the imaging capacity of the West". In: Maruyama, Magoroh; Harkins, Arthur M. (eds.). Cultures of the future. De Gruyter Mouton. https://doi.org/10.1515/9783110800067
Brooks, Daniel R.; Wiley, Edward O. (1986). Evolution as entropy. Chicago/London: University of Chicago Press. ISBN: 978 0 226075747
Bruckner, Eberhard; Ebeling, Werner O.; Miguel A. Jiménez-Montano; Scharnhorst, Andrea (1994). "Hyperselection and innovation described by a stochastic model of technological evolution". In: Leydesdorff, Loet; Van-den-Besselaar, Peter (eds.). Evolutionary economics and chaos theory: New directions in technology studies, pp. 79-90. London: Pinter. ISBN: 978 0 312122188
Carter, Vicki (1996). "Do media influence learning? Revisiting the debate in the context of distance education". Open learning: The journal of open, distance and e-learning, v. 11, n. 1, pp. 31-40. https://doi.org/10.1080/0268051960110104
Casson, Mark (1997). Information and organization: A new perspective on the theory of the firm. Oxford: Clarendon Press. ISBN: 978 0 198297802
Dosi, Giovanni (1982). "Technological paradigms and technological trajectories: A suggested interpretation of the determinants and directions of technical change". Research policy, v. 11, n. 3, pp. 147-162. https://doi.org/10.1016/0048-7333(82)90016-6
Feldman, Maryann; Storper, Michael (2016). Economic growth and economic development: Geographic dimensions, definition & disparities. https://maryannfeldman.web.unc.edu/wp-content/uploads/sites/1774/2011/11/Economic_Growth_and_Economic_Development_2016_Feldman_Storper.pdf
Fujigaki, Yuko (1998). "Filling the gap between discussions on science and scientists´ everyday activities: Applying the autopoiesis system theory to scientific knowledge". Social science information, v. 37, n. 1, pp. 5-22. https://doi.org/10.1177/053901898037001001
Garfield, Eugene (1964). "Science Citation Index - A new dimension in indexing". Science, v. 144, n. 3619, pp. 649-654. https://doi.org/10.1126/science.144.3619.649
Garfield, Eugene (1971). "The mystery of the transposed journal lists - wherein Bradford´s Law of Scattering is generalized according to Garfield´s Law of Concentration". Current contents, v. 3, n. 33, pp. 5-6. Reprinted in Essays of an information scientist, v. 1. Philadelphia: ISI Press, pp. 222-223, 1977. http://www.garfield.library.upenn.edu/essays/V1p222y1962-73.pdf
Gibbons, Michael; Limoges, Camille; Nowotny, Helga; Schwartzman, Simon; Scott, Peter; Trow, Martin (1994). The New production of knowledge: The dynamics of science and research in contemporary societies. London: Sage. ISBN: 978 0 803977945
Giddens, Anthony (1984). The constitution of society. Cambridge: Polity Press. ISBN: 978 0 520057289
Gleick, James (2011). The information: A history, a theory, a flood. Knopf Doubleday Publishing Group. ISBN: 978 0 307 37957 3
Godin, Benoí®t (2006). "The knowledge-based economy: Conceptual framework or buzzword?". Journal of technology transfer, v. 31, n. 1, pp. 17-30. https://doi.org/10.1007/s10961-005-5010-x
Griliches, Zvi (1994). "Explanations of productivity growth: Is the glass half-empty?". American economic review, v. 84, n. 1.
Husserl, Edmund ([1935/36] 1962). Die Krisis der Europí¤ischen Wissenschaften und die Transzendentale Phí¤nomenologie. Den Haag: Martinus Nijhoff. ISBN: 978 9401013369
Ivanova, Inga A.; Leydesdorff, Loet (2014). "Rotational symmetry and the transformation of innovation systems in a triple helix of university-industry-government relations". Technological forecasting and social change, v. 86, pp. 143-156. https://doi.org/10.1016/j.techfore.2013.08.022
Kessler, Maxwell-Mirton (1963). "Bibliographic coupling between scientific papers". American documentation, v. 14, n. 1, pp. 10-25. https://doi.org/10.1002/asi.5090140103
Kuhn, Thomas S. (1977). The essential tension: Selected studies in scientific tradition and change. Chicago: University of Chicago Press. ISBN: 978 0 226458052
Langford, Cooper H.; Hall, Jeremy K. (2005). "Complexity in cluster development: Towards an evolutionary theory to guide policy development". https://www.semanticscholar.org/paper/49cd670d11aafc8d2e20df0ce3ade7bd2b1ec7ef
Langford, Cooper H.; Hall, Jeremy K.; Josty, Peter; Matos, Stelvia; Jacobson, A. (2006). "Indicators and outcomes of Canadian university research: Proxies becoming goals?". Research policy, v. 35, n. 10, pp. 1586-1598. https://doi.org/10.1016/j.respol.2006.09.021
Leydesdorff, Loet (2000). "Luhmann, Habermas and the theory of communication". Systems research and behavioral science, v. 17, n. 3, pp. 273-288. https://doi.org/10.1002/(SICI)1099-1743(200005/06)17:3<273::AID-SRES329>3.0.CO;2-R
Leydesdorff, Loet (2007). "Betweenness centrality as an indicator of the interdisciplinary of scientific journals". Journal of the American Society for Information Science and Technology, v. 58, n. 9, pp. 1303-1319. https://doi.org/10.1002/asi.20614
Leydesdorff, Loet; Ivanova, Inga A. (2014). "Mutual redundancies in interhuman communication systems: Steps toward a calculus of processing meaning". Journal of the Association for Information Science and Technology, v. 65, n. 2, pp. 386-399. https://doi.org/10.1002/asi.22973
Leydesdorff, Loet; Ivanova, Inga A. (2021). "The measurement of "˜interdisciplinarity´ and "˜synergy´ in scientific and extra-scientific collaborations". Journal of the Association for Information Science and Technology, v. 72, pp. 347-402. https://doi.org/10.1002/asi.24416
Leydesdorff, Loet; Ràfols, Ismael; Milojević, StaÅ¡a (2020). "Bridging the divide between qualitative and quantitative science studies". Quantitative science studies, v. 1, n. 3, pp. 918-926. https://doi.org/10.1162/qss_e_00061
Leydesdorff, Loet; Wagner, Caroline S.; Bornmann, Lutz (2018). "Discontinuities in citation relations among journals: Self-organized criticality as a model of scientific revolutions and change". Scientometrics, v. 116, n. 1, pp. 623-644. https://doi.org/10.1007/s11192-018-2734-6
Leydesdorff, Loet; Wagner, Caroline S.; Bornmann, Lutz (2019). "Interdisciplinarity as diversity in citation patterns among journals: Rao-Stirling diversity, relative variety, and the Gini coefficient". Journal of informetrics, v. 13, n. 1, pp. 255-269. https://doi.org/10.1016/j.joi.2018.12.006
Leydesdorff, Loet; Wagner, Caroline S.; Zhang, Lin (2021). "Are university rankings statistically significant? A comparison among Chinese universities and with the USA". Journal of data and information science, v. 6, n. 2, pp. 67-95. https://doi.org/10.2478/jdis-2021-0014
Leydesdorff, Loet; Ward, Janelle (2005). "Science shops: a kaleidoscope of science-society collaborations in Europe". Public understanding of science, v. 14, n. 4. https://doi.org/10.1177/0963662505056612
Li, Tien-Yien; Yorke, James A. (1975). "Period three implies chaos". The American mathematical monthly, v. 82, n. 10, pp. 985-992.
Luhmann, Niklas (1990a). "The cognitive program of constructivism and a reality that remains unknown". In: W. Krohn; G. Kí¼ppers; H. Nowotny (eds.). Selforganization. Portrait of a scientific revolution, pp. 64-85. Dordrecht: Reidel. ISBN: 978 9 048140732 https://luhmann.ir/wp-content/uploads/2021/07/The-Cognitive-Program-of-Constructivism-and-a-Reality-that-Remains-Unknown.pdf
Luhmann, Niklas (1990b). Die Wissenschaft der Gesellschaft. Frankfurt a.M.: Suhrkamp. ISBN: 978 3 18580653
Luhmann, Niklas (1996). "On the scientific context of the concept of communication". Social science information, v. 35, n. 2, pp. 257-267. https://doi.org/10.1177/053901896035002005
Luhmann, Niklas (2012). Theory of society, v. 1. Stanford, CA: Stanford University Press. ISBN: 978 0 804739504
Malerba, Franco; Nelson, Richard; Orsenigo, Luigi; Winter, Sidney G. (1999). ""˜History-friendly´ models of industry evolution: The computer industry". Industrial and corporate change, v. 8, n. 1, pp. 3-35. https://doi.org/10.1093/icc/8.1.3
Marres, Noortje; De-Rijcke, Sarah (2020). "From indicators to indicating interdisciplinarity: A participatory mapping methodology for research communities in-the-making". Quantitative science studies, v. 1, n. 3, pp. 1041-1055. https://doi.org/10.1162/qss_a_00062
Marshakova, Irena V. (1973). "Bibliographic coupling system based on references". Nauchno-Tekhnicheskaya informatsiya seriya, Ser. 2, n. 6, pp. 3-8.
Maturana, Humberto R. (1978). "Biology of language: the epistemology of reality". In: Miller, George A.; Lenneberg, Elizabeth (eds.). Psychology and biology of language and thought. Essays in honor of Eric Lenneberg (pp. 27-63). New York: Academic Press. ISBN: 978 1 483258140 https://sites.evergreen.edu/arunchandra/wp-content/uploads/sites/395/2018/05/BofLanguage.pdf
Meireles, Magali-Rezende-Gouvea; Valadares-Cendon, Beatriz; De-Almeida, Paulo E. M. (2014). "Bibliometric knowledge organization: A domain analytic method using artificial neural network". Knowledge organization, v. 41. https://doi.org/10.5771/0943-7444-2014-2-145
Nelson, Richard R.; Winter, Sidney G. (1977). "In search of useful theory of innovation". Research policy, v. 6, n. 1, pp. 35-76. https://doi.org/10.1016/0048-7333(77)90029-4
Nelson, Richard R.; Winter, Sidney G. (1982). An evolutionary theory of economic change. Cambridge, MA: Belknap Press of Harvard University Press. ISBN: 978 0 674272286
Nonaka, Ikujiro; Takeuchi, Hirotaka (1995). The knowledge creating company. Oxford/New York: Oxford University Press. ISBN: 978 0 195092691
Petersen, Alexander M.; Rotolo, Daniele; Leydesdorff, Loet (2016). "A triple helix model of medical innovations: supply, demand, and technological capabilities in terms of Medical Subject Headings". Research policy, v. 45, n. 3, pp. 666-681. https://doi.org/10.1016/j.respol.2015.12.004
Popper, Karl R. ([1935] 1959). The logic of scientific discovery. London: Hutchinson. ISBN: 978 0 091117214
Ràfols, Ismael (2021). ""˜Measuring´ interdisciplinarity: from indicators to indicating". Integration and implementation insights (blogpost). https://i2insights.org/2021/2002/2009/measuring-interdisciplinarity
Ràfols, Ismael; Leydesdorff, Loet; O´Hare, Alice; Nightingale, Paul; Stirling, Andy (2012). "How journal rankings can suppress interdisciplinary research: A comparison between innovation studies and business and management". Research policy, v. 41, n. 7, pp. 1262-1282. https://doi.org/10.1016/j.respol.2012.03.015
Ràfols, Ismael; Meyer, Martin (2010). "Diversity and network coherence as indicators of interdisciplinarity: Case studies in bionanoscience". Scientometrics, v. 82, n. 2, pp. 263-287. https://doi.org/10.1007/s11192-009-0041-y
Sahal, Devendra (1981). Patterns of technological innovation. Addison-Wesley. ISBN: 978 0 201066302
Schumpeter, Joseph A. (1939). Business cycles. A theoretical, historical and statistical analysis of the capitalist process. https://www.mises.at/static/literatur/Buch/schumpeter-business-cycles-a-theoretical-historical-and-statistical-analysis-of-the-capitalist-process.pdf
Shannon, Claude E. (1948). "A mathematical theory of communication". The Bell System technical journal, v. 27, n. 3, pp. 379-423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
Small, Henry (1973). "Co-citation in the scientific literature: A new measure of the relationship between two documents". Journal of the American Society for Information Science, v. 24, n. 4, pp. 265-269. https://doi.org/10.1002/asi.4630240406
Stirling, Andy (2007). "A general framework for analysing diversity in science, technology and society". Journal of the Royal Society interface, v. 4, n. 15, pp. 707-719. https://doi.org/10.1098/rsif.2007.0213
Whitley, Richard D. (1984). The intellectual and social organization of the sciences. Oxford: Oxford University Press. ISBN: 978 0 199240456
Zhang, Lin; Leydesdorff, Loet (2021). "The scientometric measurement of interdisciplinarity and diversity in research portfolios of Chinese universities". Journal of data and information science, v. 6, n. 4, pp. 13-35. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3798519
Zhang, Lin; Rousseau, Ronald; Glí¤nzel, Wolfgang (2016). "Diversity of references as an indicator of the interdisciplinarity of journals: Taking similarity between subject fields into account". Journal of the Association for Information Science and Technology, v. 67, n. 5, pp. 1257-1265. https://doi.org/10.1002/asi.23487
Zitt, Michel; Small, Henry (2008). "Modifying the journal impact factor by fractional citation weighting: The audience factor". Journal of the American Society for Information Science and Technology, v. 59, n. 11, pp. 1856-1860. https://doi.org/10.1002/asi.20880
Descargas
Publicado
Cómo citar
Número
Sección
Licencia
Derechos de autor 2022 Profesional de la información
Esta obra está bajo una licencia internacional Creative Commons Atribución 4.0.
Condiciones de difusión de los artículos una vez son publicados
Los autores pueden publicitar libremente sus artículos en webs, redes sociales y repositorios
Deberán respetarse sin embargo, las siguientes condiciones:
- Solo deberá hacerse pública la versión editorial. Rogamos que no se publiquen preprints, postprints o pruebas de imprenta.
- Junto con esa copia ha de incluirse una mención específica de la publicación en la que ha aparecido el texto, añadiendo además un enlace clicable a la URL: http://revista.profesionaldelainformacion.com
La revista Profesional de la información ofrece los artículos en acceso abierto con una licencia Creative Commons BY.
