Impactful publications of critical care medicine research in China: A bibliometric analysis

Qiang Wei, Chuan Xiao, Zhe Li, Yang Li, Feng Shen, Lin Zeng, Penglin MaFrontiers in Medicine 2022 · DOI

TL;DR

Chinese critical care medicine (CCM) research has seen a rapid increase in publications over the past two decades, but the impact and quality of this research lag behind international benchmarks, particularly compared to the US. This study identifies key factors contributing to this gap, including insufficient research training, limited collaboration, and underfunding, offering insights for future improvements.

What Problem Does This Paper Address?

Critical care medicine (CCM) is vital for managing critically ill patients and responding to public health emergencies. While China has made significant strides in CCM, its research output has historically been less impactful than that of other leading nations. Previous bibliometric analyses indicated a lower volume and quality of CCM publications from China compared to the US and other developed countries. Despite efforts to boost research, including the establishment of research groups and training initiatives, questions remain about the quality and influence of Chinese CCM research. This paper aims to bridge this knowledge gap by conducting a comprehensive bibliometric analysis to understand the current status of impactful CCM publications from China and identify the factors that either hinder or facilitate their production.

Methods

The researchers employed a bibliometric analysis approach, utilizing the Web of Science Core Collection (WoSCC) database. They retrieved publications from 2001 to 2020 authored by individuals affiliated with critical care medicine (CCM) or intensive care unit (ICU) departments in Chinese hospitals. To establish a comparative baseline, they also collected data for CCM/ICU publications from American hospitals using a similar search strategy. The analysis involved statistical methods to identify factors influencing impactful publications. Key metrics examined included the number of publications, journal impact factors, citation frequency, and the proportion of articles in top-tier journals. They also analyzed keyword co-occurrence to understand research trends and collaboration networks among authors, institutions, and countries.

Datasets

The primary dataset for this study was derived from the Web of Science Core Collection (WoSCC) database, covering publications from January 1, 2001, to December 31, 2020. The search focused on articles with affiliations related to Critical Care Medicine (CCM) or Intensive Care Units (ICU) in Chinese hospitals. A comparative dataset was also collected for American hospitals using the same timeframe and affiliation criteria.

Key Insights and Ideas

  • Rapid Growth, Limited Impact: Chinese CCM research has experienced a dramatic increase in publication volume over the last 20 years, mirroring the growth in citations. However, this quantitative surge hasn't translated into a proportional increase in research impact, as evidenced by lower publication rates in high-impact journals and lower citation frequencies compared to international peers.
  • The "Impact Factor" Divide: A significant disparity exists in the publication of impactful articles. Chinese authors are considerably less likely to publish in journals with high impact factors (IF ≥ 5 or IF ≥ 10) or in the top 10 CCM journals compared to their American counterparts.
  • Geographic Disparities: CCM research output is not evenly distributed across China. Beijing stands out as a major hub, with a disproportionately high number of publications, while many other provinces contribute minimally, suggesting regional imbalances in research capacity.
  • COVID-19's Influence: The COVID-19 pandemic appears to have spurred the publication of more impactful research from China, particularly in high-impact journals, highlighting the potential for public health crises to drive research output.
  • Academic Evaluation as a Driver: The study suggests that China's academic evaluation system, which heavily weights publications in SCI journals for career advancement, plays a significant role in driving research output. This is supported by the concentration of research in academic hospitals and regions with strong academic institutions.
  • Collaboration Gaps: While collaboration is crucial for impactful research, the study indicates that collaborations among Chinese CCM researchers are limited, often confined to authors within the same ICU. This contrasts with international trends where interagency collaborations are more common for large clinical trials.

Key Results

  • Out of 13,487 retrieved articles, 6,622 were from Chinese authors.
  • The annual publication count by Chinese authors has rapidly increased since 2008.
  • Chinese authors' proportion of global CCM publications was significantly lower than American authors (M (IQR): 1.9 vs. 27.8, p < 0.001).
  • Impactful articles were significantly less published by Chinese authors (e.g., in top 10 journals: 5.4% vs. 13.4%, p < 0.001).
  • Average citation frequency was lower for Chinese authors (M (IQR): 17.0 vs. 27.8, p = 0.012).
  • Academic background of authors' affiliations, funding support, COVID-19 events, and collaboration were identified as factors influencing impactful publications.
  • Beijing was the only province with over 1,000 publications.
  • 206 (11.94%) of 1,724 publications in 2020 focused on COVID-19, with a higher proportion appearing in impactful journals.
  • 34.84% of Chinese publications reported funding support.

Limitations and Future Work

The authors acknowledge several limitations:

  • Database Scope: The study relied solely on the Web of Science Core Collection, potentially missing publications from other databases like PubMed, Embase, Cochrane Library, and Chinese-language databases (CNKI, CQVIP, Wanfang).
  • Author Name Variations: Inconsistencies in author affiliations (e.g., different hospital names for the same author) could lead to undercounting or misattribution.
  • Software Limitations: The software used for analysis had default settings that could not be easily altered, potentially affecting data recognition and requiring manual adjustments.
  • Exclusion Criteria: While efforts were made to exclude non-CCM research, a small number of projects led by experts in related fields (respiratory, anesthesiology, emergency medicine) might have been inadvertently included.

Future work could involve expanding the database search to include a wider range of sources, developing more robust methods for handling author name variations, and refining the analysis to better distinguish between core CCM research and related disciplines. The study also implicitly suggests a need for targeted interventions to improve research training, foster collaboration, and secure adequate funding for CCM research in China to enhance its global impact.

Summary updated

Abstract

Our results demonstrated that CCM research in China grew rapidly in the recent 20 years. However, the impactful publications remained limited, largely owing to the shortage of comprehensive research training, inactive collaboration, and underfunded CCM research.
BibTeX
@inproceedings{wei2022impactful,
  author = {Qiang Wei and Chuan Xiao and Zhe Li and Yang Li and Feng Shen and Lin Zeng and Penglin Ma},
  title = {{Impactful publications of critical care medicine research in China: A bibliometric analysis}},
  booktitle = {Frontiers in Medicine},
  year = {2022},
  doi = {10.3389/fmed.2022.974025},
}
Figure