Empirical Comparison of Tests for One-Factor ANOVA Under Heterogeneity and Non-Normality: A Monte Carlo Study

Diep Nguyen, Eunsook Kim, Yan Wang, Thanh Vinh Pham, Yi‐Hsin Chen, Jeffrey D. KromreyJournal of Modern Applied Statistical Methods 2020 · DOI

Abstract

Although the Analysis of Variance (ANOVA) F test is one of the most popular statistical tools to compare group means, it is sensitive to violations of the homogeneity of variance (HOV) assumption. This simulation study examines the performance of thirteen tests in one-factor ANOVA models in terms of their Type I error rate and statistical power under numerous (82,080) conditions. The results show that when HOV was satisfied, the ANOVA F or the Brown-Forsythe test outperformed the other methods in terms of both Type I error control and statistical power even under non-normality. When HOV was violated, the Structured Means Modeling (SMM) with Bartlett or SMM with Maximum Likelihood was strongly recommended for the omnibus test of group mean equality.
BibTeX
@article{nguyen2020empirical,
  author = {Diep Nguyen and Eunsook Kim and Yan Wang and Thanh Vinh Pham and Yi‐Hsin Chen and Jeffrey D. Kromrey},
  title = {{Empirical Comparison of Tests for One-Factor ANOVA Under Heterogeneity and Non-Normality: A Monte Carlo Study}},
  journal = {Journal of Modern Applied Statistical Methods},
  year = {2020},
  doi = {10.22237/jmasm/1604190000},
}

Loading related content...

Figure