Altmetrics for the identification of scientific controversies: The case of NeuroGenderings and neurosexism


  • María Aguilar-Soto Universidad de Granada
  • Nicolás Robinson-Garcí­a Universidad de Granada
  • Benjamín Vargas-Quesada Universidad de Granada


Palabras clave:

Neurosexism, Scientific controversies, Altmetrics, Sentiment analysis, News, Blogs, Social media, Wikipedia, Reddit, Facebook, Science mapping, Neuroscience, Gender, Sex, Neurogenderings


This work presents a methodological proposal for the analysis of social controversies related to scientific literature. This methodology consists of three clearly differentiated parts. First, we identify the cognitive structure of a set of scientific works. To do this, a historiogram is created through the analysis of references cited by seminal works. This allows us to expand the set of works to work with, subsequently conducting a co-word analysis to identify the cognitive structure of the scientific field to be explored. Secondly, we obtain social mentions of this scientific literature using so-called altmetrics. This allows us to extract mentions made to each scientific document from non-academic environments. Finally, we apply sentiment analysis techniques to these mentions to identify focal points of negative sentiment. We test this methodology on the case study of NeuroGenderings, a movement in the field of neuroscience that denounces the lack of scientific evidence in works that claim the existence of brain differences driven by the biological sex of the subjects. Our results confirm the viability of these types of approaches that enable the identification of research areas with greater controversy. Although our study is limited to the analysis of controversies in news, blogs, Facebook, Wikipedia, and Reddit, the methodology can be applied to other domains and social platforms.


Los datos de descargas todavía no están disponibles.


Arroyo-Machado, Wenceslao (2023). “La gran apuesta, ¿cuánto afectan los cambios de Twitter a la comunicación científica?”. Anuario ThinkEPI, v. 17.

Arroyo-Machado, Wenceslao; Torres-Salinas, Daniel; Costas, Rodrigo (2022). “Wikinformetrics: Construction and description of an open Wikipedia knowledge graph data set for informetric purposes”. Quantitative science studies, v. 3, n. 4, pp. 931-952.

Boyack, Kevin W.; Börner, Katy; Klavans, Richard (2009). “Mapping the structure and evolution of chemistry research”. Scientometrics, v. 79, n. 1, pp. 45-60.

Butler, Judith (1990). Gender Trouble: Feminism and the subversion of identity. New York: Routledge. ISBN: 0415389550

Butler, Judith (1993). Bodies that matter: On the discursive limits of “sex”. New York, London: Routledge. ISBN: 978 0 203760079

Callon, Michel; Courtial, Jean-Pierre; Turner, William A.; Bauin, Serge (1983). “From translations to problematic networks: An introduction to co-word analysis”. Social science information, v. 22, n. 2, pp. 191-235.

Choudhury, Suparna; Nagel, Saska-Kathi; Slaby, Jan (2009). “Critical neuroscience: Linking neuroscience and society through critical practice”. BioSocieties, v. 4, n. 1, pp. 61-77.

Cole, Stephen (1983). “The hierarchy of the sciences?” American journal of sociology, v. 89, n. 1, pp. 111-139.

Fanelli, Danielle; Glänzel, Wolfgang (2013). “Bibliometric evidence for a hierarchy of the sciences”. PLoS one, v. 8, n. 6, e66938.

Fine, Cordelia (2010). Delusions of gender: how our minds, society, and neurosexism create difference. Norton & Company. ISBN: 0393340244

Friedrich, Natalie; Bowman, Timothy D.; Stock, Wolfgang G.; Haustein, Stefanie (2015). “Adapting sentiment analysis for tweets linking to scientific papers”. In: Salah, A. A.; Y. Tonta; A.A. Akdag Salah; C. Sugimoto; U. Al (eds.). Proceedings of ISSI 2015 Istanbul: 15th International Society for Scientometrics and Informetrics Conference. Istambul (Turkey), 29 June - 3 July, Bogaziçi University Printhouse, pp. 107-108.

Griffin, Andrew (2008). New strategies for reputation management: gaining control of issues, crises & corporate social repsonsibility. London: Kogan Page Publishers. ISBN: 978 0 749450076

Hassan, Saaed-Ul; Saleem; Aneela; Soroya, Saira Hanif; Sader, Iqra; Iqbal, Sehrish; Jamil, Saqib; Bukhari, Faisal; Aljohani, Naif Radi; Nawaz, Raheel (2021). “Sentiment analysis of tweets through Altmetrics: A machine learning approach”. Journal of information science, v. 47, n. 6, pp. 712-726.

Hyde, Janet-Shibley (2005). “The gender similarities hypothesis”. American psychologist, v. 60, n. 6, pp. 581-592.

Hyde, Janet-Shibley (2014). “Gender similarities and differences”. Annual review of psychology, v. 65, pp. 373-398.

Jordan-Young, Rebecca; Rumiati, Raffaella. I. (2012). “Hardwired for sexism? Approaches to sex/gender in neuroscience”. Neuroethics, v. 5, n. 3, pp. 305-315.

Kaiser, Anelis (2012). “Re-conceptualizing ‘sex’ and ‘gender’ in the human brain”. Zeitschrift fur Psychologie / Journal of psychology, v. 220, n. 2, pp. 130-136.

Kaiser, Anelis; Haller, Sven; Schmitz, Sigrid; Nitsch, Cordula (2009). “On sex/gender related similarities and differences in fMRI language research”. Brain research reviews, v. 61, n. 2, pp. 49-59.

Kostoff, Ronald; Shlesinger, Michael F. (2005). “CAB: Citation-assisted-background”. Scientometrics, v. 62, n. 2, pp. 199-212.

Kuhn, Thomas S. (1962). The structure of scientific revolutions. Chicago: University of Chicago Press. ISBN: 978 0 226458113

Lamers, Wout S.; Boyack, Kevin; Larivière, Vincent; Sugimoto, Cassidy R.; van Eck, Nees Jan; Waltman, Ludo; Murray, Dakota (2021). “Meta-research: Investigating disagreement in the scientific literature”. eLife, v. 10, e72737.

Levay, Simon (1991). “A difference in hypothalmic structure between heterosexual and homosexual men”. Science, v. 253, pp. 1034-1037.

Leydesdorff, Loet; Ràfols, Ismael (2012). “Interactive overlays: A new method for generating global journal maps from Web-of-Science data”. Journal of informetrics, v. 6, n. 3, pp. 318-332.

Muñoz-Écija, Teresa; Vargas-Quesada, Benjamín; Chinchilla-Rodríguez, Zaida (2017). “Identification and visualization of the intellectual structure and the main research lines in nanoscience and nanotechnology at the worldwide level”. Journal of nanoparticle research, v. 19, n. 2.

Muñoz-Écija, Teresa; Vargas-Quesada, Benjamín; Chinchilla-Rodríguez, Zaida (2019). “Coping with methods for delineating emerging fields: Nanoscience and nanotechnology as a case study”. Journal of informetrics, v. 13, n. 4, 100976.

Muñoz-Écija, Teresa; Vargas-Quesada, Benjamin; Chinchilla-Rodríguez, Zaida (2022). “Unveiling cognitive structure and comparative advantages of countries in knowledge domains”. Journal of information science.

Nane, Gabriela F.; Van-Schalkwyk, François; Dudek, Jonathan; Torres-Salinas, Daniel; Costas, Rodrigo; Robinson-García, Nicolás (2021). “The role of scientific output in public debates in times of crisis: A case study of the reopening of schools during the Covid-19 pandemic”. In: Berube, D. M. (ed.). Pandemic communication and resilience. Risk, systems and decisions. Cham: Springer. ISBN: 978 3 030773441

Nicholson, Josh M.; Mordaunt, Milo; Lopez, Patrice; Uppala, Ashish; Rosati, Domenic; Rodrigues, Neves P.; Grabitz, Peter; Rife, Sean C. (2021). “Scite: A smart citation index that displays the context of citations and classifies their intent using deep learning”. Quantitative science studies, v. 2, n. 3, pp. 882-898.

North, Anna (2019). “‘I am a woman and I am fast’: what Caster Semenya’s story says about gender and race in sports”. Vox.

Phoenix, Charles H.; Goy, Robert W.; Gerall, Arnold A.; Young, William C. (1959). “Organizing action of prenatally administered testosterone propionate on the tissues mediating mating behaviour in the female guinea pig”. Endocrinology, v. 65, n. 3, pp. 369-382.

Popper, Karl (2002). The logic of scientific discovery. London: Routledge. ISBN: 978 0 203994627

Priem, Jason; Taraborelli, Dario; Groth, Paul; Neylon, Cameron (2010), Altmetrics: A manifesto, 26 October 2010.

Proellochis, Nicolas; Feuerriegel, Stefan (2021). “Sentiment analysis: Dictionary-based sentiment analysis”. R package version 1.3-4.

R Core Team (2023). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.

Reverter-Bañón, Sonia (2017). “El neurofeminismo frente a la investigación sobre la diferencia sexual”. Daimon, v. 72, pp. 95-110.

Rippon, Gina; Jordan-Young, Rebecca; Kaiser, Anelis; Fine, Cordelia (2014). “Recommendations for sex/gender neuroimaging research: Key principles and implications for research design, analysis, and interpretation”. Frontiers in human neuroscience, v. 8.

Rippon, Gina; Jordan-Young, Rebecca; Kaiser, Anelis; Joel, Daphna; Fine, Cordelia (2017). “Journal of neuroscience research policy on addressing sex as a biological variable: Comments, clarifications, and elaborations”. Journal of Neuroscience Research, v. 95, n. 7, pp. 1357-1359.

Robinson-García, Nicolás; Ràfols, Ismael; Van-Leeuwen, Thed N. (2018). “Using altmetrics for contextualised mapping of societal impact: From hits to networks”. Science and public policy, v. 45, n. 6, pp. 815-826.

Robinson-García, Nicolás; Torres-Salinas, Daniel; Zahedi, Zohreh; Costas, Rodrigo (2014). “New data, new possibilities: Exploring the insides of”. El profesional de la información, v. 24, n. 4, pp. 359-366. https://10.3145/epi.2014.jul.03

Scott, John (1988). “Social network analysis”. Sociology, v. 22, n. 1, pp. 109-127.

Thelwall, Mike (2020). “Measuring societal impacts of research with altmetrics? Common problems and mistakes”. Journal of economic surveys, v. 35, n. 5, pp. 1302-1314.

Torres-Salinas, Daniel; Cabezas-Clavijo, Álvaro; Jiménez-Contreras, Evaristo (2013). “Altmetrics: nuevos indicadores para la comunicación científica en la Web 2.0”. Comunicar, v. 41.

Torres-Salinas, Daniel; Docampo, Domingo; Arroyo-Machado, Wenceslao; Robinson-García, Nicolás (2023). The many publics of science: Using altmetrics to identify common communication channels by scientific field.

Traag, Vincent A.; Waltman, Ludo; Van-Eck, Nees-Jan (2019). “From Louvain to Leiden: guaranteeing well-connected communities”. Scientific reports, v. 9, 5233. https://10.1038/s41598-019-41695-z

Van-Eck, Nees-Jan; Waltman, Ludo (2010). “Software survey: VOSviewer, a computer program for bibliometric mapping”. Scientometrics, v. 84, n. 2, pp. 523-538.

Van-Eck, Nees-Jan; Waltman, Ludo (2014). “CitNetExplorer: A new software tool for analyzing and visualizing citation networks”. Journal of informetrics, v. 8, n. 4, pp. 802-823.

Van-Schalkwyk, François; Dudek, Jonathan; Costas, Rodrigo (2020) “Communities of shared interests and cognitive bridges: the case of the anti-vaccination movement on Twitter”. Scientometrics, v. 125, pp. 1499-1516.

Vargas-Quesada, Benjamín; Chinchilla-Rodríguez, Zaida; Rodríguez, Noel (2017). “Identification and visualization of the intellectual structure in graphene research”. Frontiers in research metrics and analytics, v. 2.

Vargas-Quesada, Benjamín; De-Moya-Anegón, Félix (2007). Visualizing the structure of science. Springer. ISBN: 3540697276

Vargas-Quesada, Benjamín; De-Moya-Anegón, Félix; Chinchilla-Rodríguez, Zaida; González-Molina, Antonio (2010). “Showing the essential science structure of a scientific domain and its evolution”. Information visualization, v. 9, n. 4, pp. 288-300.

Wasserman, Stanley; Faust, Katherine (1998). Social network analysis: methods and applications. Cambridge: Cambridge University Press. ISBN: 978 0 511815478

Zumbach, David; Bauer, Paul C. (2022). “deeplr: Interface to the ‘DeepL’ translation API”. R package version 2.0.0.



Cómo citar

Aguilar-Soto, M., Robinson-Garcí­a, N., & Vargas-Quesada, B. (2023). Altmetrics for the identification of scientific controversies: The case of NeuroGenderings and neurosexism. Profesional De La información Information Professional, 32(6).



Artí­culos de investigación / Research articles