Comment on ‘bibliometric insights into systemic sclerosis with renal involvement: trends, contributions, and future directions’

Yiran Chen, Jingyuan ZhangRenal 2025 · DOI

TL;DR

This comment on a bibliometric study of systemic sclerosis with renal involvement highlights potential issues with data transparency and interpretation. The authors suggest that a more detailed disclosure of methodology, including specific data and statistical parameters, would enhance the reproducibility and reliability of such analyses, ultimately aiding researchers in navigating the field.

What Problem Does This Paper Address?

The authors of this comment are addressing a common challenge in bibliometric studies: the reproducibility and interpretability of findings. While the original study by Huang et al. aimed to provide bibliometric insights into systemic sclerosis with renal involvement, the comment points out that the disclosure of the retrieval strategy alone is often insufficient. Researchers need access to the specific data and detailed methodological parameters to independently verify and build upon the study's conclusions. Furthermore, the comment raises concerns about potential biases introduced by the selection of databases and the interpretation of complex visualizations like dual-map overlays, which can obscure the true landscape of research trends.

Methods

The comment doesn't introduce new methods but rather critiques the methods used in the original study and suggests improvements for future bibliometric analyses. Key points include:

  • Data Transparency: The authors emphasize the need for disclosing the specific data used, not just the retrieval strategy. This includes details about the databases consulted and the exact search queries.
  • Database Selection: The comment highlights the potential confusion arising from combining data from different databases (e.g., Web of Science Core Collection and Scopus) with varying improvement timelines, which can skew keyword frequency and trend analysis.
  • Interpretation of Visualizations: The authors suggest that visualizations like the "dual-map overlay" require more thorough explanation, particularly regarding the heterogeneity of knowledge flow between fields. They propose that the "Z index" for knowledge flow, while a useful metric, needs to be presented with more context and supporting data.
  • Statistical Standards: The comment advocates for the disclosure of specific statistical parameters used in bibliometric analysis, such as the clustering algorithms employed, the number of keywords included in thematic maps, minimum frequency thresholds, and min-weight index values.

Datasets

Not discussed in the paper. The comment refers to the use of databases like Web of Science Core Collection and Scopus in the original study but does not detail specific datasets or new benchmarks.

Key Insights and Ideas

  • Reproducibility is Paramount: The core message is that bibliometric studies, to be truly valuable, must be reproducible. This requires more than just stating a search strategy; it demands the sharing of the actual data and detailed methodological parameters.
  • Database Choice Matters: The selection of bibliometric databases is not a trivial matter. Differences in coverage, indexing, and improvement timelines can significantly impact the results, leading to potentially misleading conclusions if not carefully managed and disclosed.
  • Visualizations Need Context: While visualizations like dual-map overlays are powerful tools, their interpretation can be complex. A deeper explanation of the underlying metrics and the nature of the relationships depicted is crucial for accurate understanding.
  • The "Z index" as a Metric: The comment acknowledges the utility of the "Z index" for quantifying knowledge flow but stresses the need for its clear presentation and interpretation within the broader context of citation frequency and interdisciplinary connections.

Key Results

The comment does not present new quantitative results. Instead, it points out areas where the original study's results could be strengthened through better data disclosure and interpretation. For example, it mentions specific "Z index" values for knowledge flow between certain fields (e.g., 'MEDICINE, MEDICAL, CLINICAL' and 'MOLECULAR, BIOLOGY, GENETICS' at 4.216238) but notes that other data were difficult to obtain due to figure occlusion in the original paper.

Limitations and Future Work

  • Limitations:
    • The original study's data and specific statistical parameters were not fully disclosed, hindering independent verification.
  • The interpretation of complex visualizations like dual-map overlays was deemed insufficient.
  • Data from different databases with varying improvement timelines could introduce confusion.
  • Some figures in the original research were occluded, making it difficult to obtain all necessary data.
  • Future Work:
    • Future bibliometric studies should prioritize complete data transparency, including the specific datasets used, search queries, and all relevant statistical parameters.
  • Researchers should provide more in-depth explanations of complex visualizations and metrics used.
  • Careful consideration and disclosure of database selection strategies are needed to avoid misinterpretations of research trends.
  • The authors suggest that disclosing thematic map details (clustering algorithms, keyword counts, frequency thresholds) would significantly enhance understanding.

Summary updated

BibTeX
@inproceedings{chen2025comment,
  author = {Yiran Chen and Jingyuan Zhang},
  title = {{Comment on ‘bibliometric insights into systemic sclerosis with renal involvement: trends, contributions, and future directions’}},
  booktitle = {Renal},
  year = {2025},
  doi = {10.1080/0886022x.2025.2486563},
}
Figure