The evaluation of the reporting quality of observational studies in Master of Public Health’s dissertations in China

ShuangYang Dai, Xiaobin Zhou, Hong Xu, Beibei Li, JinGao ZhangResearch 2020 · DOI

Abstract

Observational studies are fundamental to public health research but require transparent reporting to mitigate inherent biases. This study evaluates the reporting quality of 165 Master of Public Health (MPH) dissertations in China using the STROBE checklist. Results indicate a median compliance rate of 74.79%, with significant deficiencies in reporting methodological details such as missing data and sensitivity analyses. Factors such as funding and prior publication history were strong predictors of higher reporting quality.

Introduction

In the hierarchy of medical evidence, Randomized Controlled Trials (RCTs) are often prioritized, yet observational studies remain the backbone of public health research due to ethical and practical considerations. In China, the majority of Master of Public Health (MPH) dissertations utilize observational designs. However, these studies are prone to information bias, necessitating rigorous and transparent reporting. The Strengthening the Reporting of Observation Studies in Epidemiology (STROBE) statement provides an international standard for such reporting, but its application in Chinese graduate education has not been extensively studied.

Methods

A systematic review was conducted using the Wanfang database, targeting MPH dissertations from 2014 to 2019. The final sample included 165 original observational studies (61 cross-sectional, 66 case-control, and 38 cohort studies). Each dissertation was evaluated against the 22-item STROBE checklist by two independent investigators. Scoring was standardized: 1 point for full reporting, 0.5 for partial, and 0 for non-reporting. Multivariate logistic regression was employed to identify variables associated with high-quality reporting.

Results

The analysis revealed a mean STROBE score of 14.29 (SD 1.84) out of a possible 22. While introductory elements like study background and objectives were universally reported (100% compliance), critical methodological and result-oriented items were frequently omitted.

Table 1: Compliance rates for STROBE items 1 through 14 in the sampled dissertations.

Key findings regarding reporting gaps include:

  • Missing Data: Only 6.67% of studies explained how missing data were addressed.
  • Sensitivity Analyses: Only 3.63% reported these analyses.
  • Flow Diagrams: Only 15.15% utilized flow diagrams to describe participant progression.
  • Absolute Risk: 0% of relevant studies reported absolute risk estimates.

Conversely, certain factors were associated with "high reporting quality" (defined as the top quartile of scores). Cohort studies (OR=3.41), funded research (OR=4.37), and students with two or more prior publications (OR=3.46) were significantly more likely to produce high-quality reports.

Discussion

The "Intro vs. Method" divide suggests that while students are well-trained in identifying research problems, they lack the technical expertise or guidance required for rigorous reporting of complex methodologies. The strong correlation between funding and quality implies that external oversight and the competitive nature of grant-seeking drive better documentation. Similarly, the "practice makes perfect" effect of prior publication highlights the value of the peer-review process in teaching reporting standards.

Conclusion

The reporting quality of observational studies in Chinese MPH dissertations is currently suboptimal. To improve scientific transparency, academic institutions should consider adopting the STROBE statement as a formal requirement for dissertation submission. Enhanced training in methodological reporting, particularly regarding data handling and bias assessment, is essential for the next generation of public health researchers.

Summary updated

Abstract

Abstract Backgrounds Master of public health (MPH) plays an important role in Chinese medical education, and the dissertations is an important part of MPH education. In MPH dissertations, most are observational studies. Compared with randomized controlled trial (RCT), observational studies are more prone to information bias. So, the reporting of the observational studies should be transparent and standard. But, no research on evaluating the reporting quality of the MPH dissertation has been found. Methods A systematic literature search was performed in the Wanfang database from January 1, 2014 to May 31, 2019. The Strengthening the Reporting of Observation Studies in Epidemiology (STROBE) statement was adopted to evaluate the reporting quality of the selected studies. Articles that met the following criteria were selected: (1) observational studies, including cross-sectional studies, case-control studies, and cohort studies; (2) original articles; (3) studies on humans, including both adults and children. Results The Median of compliance to individual STROBE items was 74.79%. The mean (standard deviation) of STROBE score was 14.29 (1.84). Five items/sub-items were 100% reported (“reported” and “partly reported” were combined): background, objectives, study design, report numbers of individuals at each stage, and key result. Fifteen items/sub-items were reported by 75% or more. Reporting of methods and results was often omitted: missing data (6.67%), sensitivity analyses (3.63%), flow diagram (15.15%), and absolute risk (0%). Logistic regression analysis indicated that cohort studies (OR=3.41, 95% CI=1.27-9.16), funding support (OR=4.37, 95% CI=1.27-9.16) and more published papers during postgraduate period (OR=3.46, 95% CI=1.40-8.60) were related to high reporting quality. Conclusion In short, the reporting quality of observational studies in MPH’s dissertations in China is suboptimal. However, it’s necessary to improve the reporting of method and results sections. We recommend that authors should be stricter to adhere STROBE statement when conducting observational studies.
BibTeX
@inproceedings{dai2020evaluation,
  author = {ShuangYang Dai and Xiaobin Zhou and Hong Xu and Beibei Li and JinGao Zhang},
  title = {{The evaluation of the reporting quality of observational studies in Master of Public Health’s dissertations in China}},
  booktitle = {Research},
  year = {2020},
  doi = {10.21203/rs.2.15451/v4},
}
Figure