Content analysis and level of evidence of the most cited scientific articles on Covid-19 on the Web of Science

Authors

DOI:

https://doi.org/10.3145/epi.2021.nov.17

Keywords:

Covid-19, Coronavirus, 2019-nCoV, SARS-CoV-2, Content analysis, Level of evidence, SIGN, Impact, Pandemics, Health information, Scientific publications, Scientific articles, Web of Science, WoS

Abstract

The scientific literature on Covid-10 has seen unprecedented growth, being published so rapidly as to question its quality and the peer review process. This research analyzes the characteristics of the publications on Covid-19 with the greatest impact, mainly considering their content and the quality and level of evidence of the studies. The Web of Science Core Collection was searched for articles containing the terms "Covid-19" and "SARS-CoV-2," and the 100 most cited articles published in 2020 were selected. The data extracted included bibliographic data, journal submission, acceptance, and publication dates, the main topics covered, the type of study, and the level of evidence according to the SIGN scale, as well as the existence of corrections. Half of the articles were published in three journals, most of them in the early months of 2020. The most frequent types of studies were case series, narrative reviews, and expert opinions, with only one randomized controlled clinical trial. The articles focused mainly on the clinical characteristics and complications of patients, diagnostic and treatment methods, as well as the epidemiology and characteristics of the virus. The design of these studies reflects a low level of evidence, and data and scientific quality may be affected by how quickly they are published and the peer review process is performed.

Downloads

Download data is not yet available.

References

Afshar, Ahmadreza; Trabrizi, Ali (2020). "Bibliometric analysis of the 100 highly-cited articles about Covid-19". The archives of bone and joint surgery, v. 8, n. 6, pp. 748-756. https://doi.org/10.22038/abjs.2020.51846.2556

Alba-Ruiz, Rubén (2020). "Covid-19, coronavirus pandemic: aproximación bibliométrica y revisión de los resultados". Zenodo, 31 marzo. https://doi.org/10.5281/zenodo.3734062

Amat, Carlos B. (2008). "Editorial and publication delay of papers submitted to 14 selected food research journals. Influence of online posting". Scientometrics, v. 74, n. 3, pp. 379-389. https://doi.org/10.1007/s11192-007-1823-8

Armstrong, Stephen (2020). "Research on Covid-19 is suffering "˜imperfect incentives at every stage´". British medical journal, v. 369, m2045. https://doi.org/10.1136/bmj.m2045

Baird, A. Gordon; Lawrence, James R. (2014). "Guidelines: Is bigger better? A review of SIGN guidelines". Bristish medical journal open, v. 4, n. 2, e004278. https://doi.org/10.1136/bmjopen-2013-004278

Bjí¶rk, Bo-Christer; Solomon, David (2013). "The publishing delay in scholarly peer-reviewed journals". Journal of informetrics, v. 7, n. 4, pp. 914-923. https://doi.org/10.1016/j.joi.2013.09.001

Borku-Uysal, Betul; Sami-Islamoglu, Mehmet; Koc, Suna; Karadag, Mehmet; Dokur, Mehmet (2021). "Most notable 100 articles of Covid-19: an altmetric study based on bibliometric analysis". Irish journal of medical science, n. 190, pp. 1335-1341. https://doi.org/10.1007/s11845-020-02460-8

Bornmann, Lutz; Thor, Andreas; Marx, Werner; Schier, Hermann (2016). "The application of bibliometrics to research evaluation in the Humanities and Social Sciences: An exploratory study using normalized Google Scholar data for the publications of a research institute". Journal of the American Society for Information Science and Technology, v. 67, n. 11, pp. 2778-2789. https://doi.org/10.1002/asi.23627

Brainard, Jeffrey (2020). "Scientists are drowning in Covid-19 papers. Can new tools keep them afloat?". Science, v. 80. https://doi.org/10.1126/science.abc7839

Da-Motta-Reis, José-Salvador; De-Oliveira-Silva, Fernanda; Espuny, Maximilian; Lescura-Alexandre, Larah-Giffoni; Motta-Marbosa, Luis-César-Ferreira; Munhoz-Bonassa, Ana-Claudia; Marcondex-Faria, Amanda; De-Souza-Sampaio, Nilo-Antonio; Santos, Gilberto; De-Oliveira, Otávio-José (2020). "The rapid escalation of publications on Covid-19: A snapshot of trends in the early months to overcome the pandemic and to improve life quality". International journal for quality research, v. 14, n. 3, pp. 951-968. https://doi.org/10.24874/IJQR14.03-19

Deng, Ziqin; Chen, Junsheng; Wang, Ting (2020). "Bibliometric and visualization analysis of human coronaviruses: Prospects and implications for Covid-19 research". Frontiers in cellular and infection microbiology, v. 10, 581404. https://doi.org/10.3389/fcimb.2020.581404

Djulbegovic, Benjamin; Guyatt, Gordon H. (2017). "Progress in evidence-based medicine: a quarter century on". The lancet, v. 390, n. 10092, pp. 415-423. https://doi.org/10.1016/S0140-6736(16)31592-6

ElHawary, Hassan; Salimi, Ali; Diab, Nermin; Smith, Lee (2020). "Bibliometric analysis of early Covid-19 research: The top 50 cited papers". Infectious diseases: research and treatment, v. 13, 1178633720962935. https://doi.org/10.1177/1178633720962935

Estrada-Lorenzo, José-Manuel; Medino-Muñoz, Juan; Rebollo-Rodrí­guez, Marí­a-José; Campos-Asensio, Concepción; Primo-Peña, Elena (2021). "Consecuencias en la producción cientí­fica de la Covid-19". Revista española de salud pública, v. 95, e202105072. https://www.mscbs.gob.es/biblioPublic/publicaciones/recursos_propios/resp/revista_cdrom/VOL95/C_ESPECIALES/RS95C_202105072.pdf

Fan, Jingchun; Gao, Ya; Zhao, Na; Dai, Runjing; Zhang, Hailiang; Feng, Xiaoyan; Shi, Guoxiu; Tian, Jinhui; Chen, Che; Hambly, Brett D. (2020). "Bibliometric analysis on Covid-19: A comparison of research between English and Chinese studies". Frontiers in public health, v. 8, 477. https://doi.org/10.3389/fpubh.2020.00477

Farooq, Rai K.; Rehman, Shafiq-Ur; Ashiq, Murtaza; Siddique, Nadeem; Ahmad, Shakil (2021). "Bibliometric analysis of coronavirus disease (Covid-19) literature published in Web of Science 2019-2020". Journal of family and community medicine, v. 28, n. 1. https://doi.org/10.4103/jfcm.JFCM_332_20

Furstenau, Leonardo B.; Rabaioli, Bruna; Kremer-Sott, Michele; Cossul, Danielli; Sott-Bender, Mariluza; Moreno-Júdice-de-Mattos-Farina, Eduardo; Novaes-Barcellos-Filho, Fabiano; Paola-Severo, Priscilla; Dohan, Michael S.; Luigi-Bragazzi, Nicola (2021). "A bibliometric network analysis of coronavirus during the first eight months of Covid-19 in 2020". International journal of environmental research and public health, v. 18, n. 3, 952. https://doi.org/10.3390/ijerph18030952

Ghebreyesus, Tedros-Adhanom; Swaminathan, Soumya (2020). "Scientists are sprinting to outpace the novel coronavirus". The lancet, v. 395, n. 10226, pp. 762-764. https://doi.org/10.1016/S0140-6736(20)30420-7

Grammes, Nadja; Millenaar, Dominic; Fehlmann, Tobias; Kern, Fabian; Bí¶hm, Michael; Mahfoud, Felix; Keller, Andreas (2020). "Research output and international cooperation among countries during the Covid-19 pandemic: Scientometric analysis". Journal of medical internet research, v. 22, n. 12, e35414. https://doi.org/10.2196/24514

Greenhalgh, Trisha (2016). Cómo leer un artí­culo cientí­fico. Las bases de la medicina basada en la evidencia. 5ª edición. Barcelona: Elsevier España. ISBN: 978 84 9022 945 3

Haghani, Milad; Bliemer, Michiel C. J. (2020). "Covid-19 pandemic and the unprecedented mobilisation of scholarly efforts prompted by a health crisis: Scientometric comparisons across SARS, MERS and 2019-nCoV literature". Scientometrics, n. 125, pp. 2695-2726. https://doi.org/10.1007/s11192-020-03706-z

Haghani, Milad; Bliemer, Michiel C. J.; Goerland, Floris; Li, Jie (2020). "The scientific literature on coronaviruses, Covid-19 and its associated safety-related research dimensions: A scientometric analysis and scoping review". Safety science, v. 129, 104806. https://doi.org/10.1016/j.ssci.2020.104806

Horbach, Serge P. J. M. (2020). "Pandemic publishing: Medical journals strongly speed up their publication process for Covid-19". Quantitative science studies, v. 1, n. 3, pp. 1056-1067. https://doi.org/10.1162/qss_a_00076

Huang, Chaolin; Wang, Yeming; Li, Xingwang; Ren, Lili; Zhao, Jianping; Hu, Yi; Zhang, Li; Fan, Guohui; Xu, Jiuyang; Gu, Xiaoying; Cheng, Zhenshun; Yu, Ting; Xia, Jiaan; Wei, Yuan; Wu, Wenjuan; Xie, Xuelei; Yin, Wen; Li, Hui; Liu, Min; Xiao, Yan; Gao, Hong; Guo, Li; Xie, Jungang; Wang, Guangfa; Jiang, Rongmeng; Gao, Zhancheng; Jin, Qi; Wang, Jianwei; Cao, Bin (2020). "Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China". The lancet, v. 395, n. 10223, pp. 497-506. https://doi.org/10.1016/S0140-6736(20)30183-5

Jacimovic, Jelena; Jakovljevic, Aleksandar; Nagendrababu, Venkateshbabu; Fergus-Duncan, Henry; Dummer, Paul M. H. (2021). "A bibliometric analysis of the dental scientific literature on Covid-19". Clinical oral investigations, n. 25, pp. 6171-6183. https://doi.org/10.1007/s00784-021-03916-6

Ji, Bin; Zhao, Yaqian; Wei, Ting; Kang, Peiying (2021). "Water science under the global epidemic of Covid-19: Bibliometric tracking on Covid-19 publication and further research needs". Journal of environmental chemical engineering, v. 9, n. 4, 105357. https://doi.org/10.1016/j.jece.2021.105357

Kambakamba, Patrik; Geoghegan, Jemma; Hoti, Emir (2020) "The peer review at high risk from Covid-19 - Are we socially distancing from scientific quality control?". British journal of surgery, v. 107, n. 9, e334-e335. https://doi.org/10.1002/bjs.11785

Kodvanj, Ivan; Homolak, Jan; Virag, Davor; Trkulja, Vladimir (2020). "Publishing of Covid-19 preprints in peer-reviewed journals, preprinting trends, public discussion and quality issues". bioRxiv. https://doi.org/10.1101/2020.11.23.394577

Lander, Bryn; Balka, Ellen (2019). "Exploring how evidence is used in care through an organizational ethnography of two teaching hospitals". Journal of medical internet research, v. 21, n. 3, e10769. https://doi.org/10.2196/10769

National Library of Medicine (2021). PubMed user guide. https://pubmed.ncbi.nlm.nih.gov/help/#searching-specific-field

Pericàs, Juan M.; Arenas, Andrea; Torrallardona-Murphy, Orla; Valero, Helena; Nicolás, David (2020). "Published evidence on Covid-19 in top-ranked journals: A descriptive study". European journal of internal medicine, v. 79, pp. 120-122. https://doi.org/10.1016/j.ejim.2020.07.005

Phelan, Alexandra L.; Katz, Rebecca; Gostin, Lawrence O. (2020). "The novel coronavirus originating in Wuhan, China: Challenges for global health governance". Journal of the American Medical Association, v. 323, n. 8, pp. 709-710. https://doi.org/10.1001/jama.2020.1097

SIGN. Scottish Intercollegiate Guidelines Network (2011). SIGN 50. A guideline developer´s handbook. https://www.sign.ac.uk/our-guidelines/sign-50-a-guideline-developers-handbook

Sohrabi, Catrin; Alsafi, Zaid; O´Neill, Niamh; Khan, Mehdi; Kerwan, Ahmed; Aljabir, Ahmed; Iosifidis, Christos; Agha, Riaz (2020). "World Health Organization declares global emergency: A review of the 2019 novel coronavirus (Covid-19)". International journal of surgery, v. 76, pp. 71-76. https://doi.org/10.1016/j.ijsu.2020.02.034

Soltani, Parisa; Patini, Romeo (2020). "Retracted Covid-19 articles: a side-effect of the hot race to publication". Scientometrics, v. 125, n. 1, pp. 819-822. https://doi.org/10.1007/s11192-020-03661-9

Torres-Salinas, Daniel (2020). "Ritmo de crecimiento diario de la producción cientí­fica sobre Covid-19. Análisis en bases de datos y repositorios en acceso abierto". El profesional de la información, v. 29, n. 2, e290215. https://doi.org/10.3145/epi.2020.mar.15

Wang, Jing; Deng, Huan; Liu, Bagntao; Hu, Anbin; Liang, Jun; Fab, Lingye; Zheng, Xu; Wang, Tong; Lei, Jianbo (2020). "Systematic evaluation of research progress on natural language processing in medicine over the past 20 years: Bibliometric study on Pubmed". Journal of medical internet research, v. 22, n. 1, e16816. https://doi.org/10.2196/16816

World Health Organization (2020). Coronavirus disease (Covid-19) Pandemic. https://www.who.int/emergencies/diseases/novel-coronavirus-2019

Yang, Fan; Zhang, Shuaijie; Wang, Qing; Zhang, Qi; Han, Junming; Wang, Lijie; Wu, Xinying; Xue, Fuzhong (2020). "Analysis of the global situation of Covid-19 research based on bibliometrics". Health information science and systems, v. 8, n. 1, 30. https://doi.org/10.1007/s13755-020-00120-w

Yu, Yuetian; Li, Tujie; Zhang, Zhongheng; Gu, Zhichun; Zhong, Han; Zha, Qiongfang; Yang, Luyu; Zhu, Cheng; Chen, Erzhen (2020). "A bibliometric analysis using VOSviewer of publications on Covid-19". Annals of translational medicine, v. 8, n. 13, pp. 816-816. https://doi.org/10.21037/atm-20-4235

Zdravkovic, Marco; Berger-Estilita, Joana; Zdravkovic, Bogdan; Berger, David (2020). "Scientific quality of Covid-19 and SARS CoV-2 publications in the highest impact medical journals during the early phase of the pandemic: A case control study". Plos one, v. 16, n. 4. https://doi.org/10.1371/journal.pone.0241826

Zhou, Yi; Chen, Liyu (2020). "Twenty-year span of global coronavirus research trends: A bibliometric analysis". International journal of environmental research and public health, v. 17, n. 9, 3082. https://doi.org/10.3390/ijerph17093082

Published

2021-12-15

How to Cite

Salvador-Oliván, J.-A., Marco-Cuenca, G., & Arquero-Avilés, R. (2021). Content analysis and level of evidence of the most cited scientific articles on Covid-19 on the Web of Science. Profesional De La información, 30(6). https://doi.org/10.3145/epi.2021.nov.17

Issue

Section

Research articles