Advancing Research on Unconscious Priming: When can Scientists Claim an\n Indirect Task Advantage?

Sascha Meyen, Iris A. Zerweck, Catarina Amado, Ulrike von Luxburg, Volker H. Franz

Abstract

Current literature holds that many cognitive functions can be performed outside consciousness, often evidenced by unconscious priming. In typical experiments, masked stimuli result in near-chance performance in direct identification tasks, yet significantly influence responses in indirect tasks (e.g., reaction times). This "standard reasoning" interprets significant indirect effects as evidence of unconscious sensitivity. However, this paper demonstrates that this logic is flawed. By reanalyzing 15 influential studies using a rigorous sensitivity-based framework, the authors show that most evidence for an "indirect task advantage" (ITA) disappears when sensitivities are calculated appropriately.

The Problem: Flawed Reasoning in Priming Research

For decades, cognitive scientists have relied on a specific experimental design to prove unconscious processing. Participants are presented with "masked" stimuli—images or words shown so briefly they are not consciously perceived.

The proof typically involves two tasks:

  1. Direct Task: Participants attempt to identify the masked stimulus. Performance is usually near chance, suggesting zero conscious sensitivity.
  2. Indirect Task: Participants respond to a visible target stimulus. Their performance is influenced by the preceding masked "prime" (e.g., faster responses when the prime and target match).

Researchers often conclude that because the indirect effect is statistically significant while the direct identification is not, the unconscious mind possesses a unique sensitivity advantage. This paper identifies this as the "fallacy of standard reasoning."

The standard reasoning fallacy in unconscious priming research.

The fallacy lies in ignoring that a significant group average in an indirect task does not necessarily imply higher trial-by-trial sensitivity than a non-significant direct task, especially when the latter is underpowered.

A New Framework for Sensitivity

To address this, the authors propose directly comparing the sensitivities ($d'$) of both tasks. They developed a method to convert continuous indirect measures, like reaction times, into binary classifications using an "optimal classifier." This allows for the calculation of a $d'$ value for the indirect task that is mathematically comparable to the direct task.

Furthermore, they created a statistical method to estimate these sensitivities from published summary statistics (like $t$ or $F$ values), enabling the re-evaluation of landmark studies where raw data is no longer available.

The "Baby Weights" Fallacy

To illustrate the flaw in standard reasoning, the authors use a simple analogy involving infant birth weights.

The Baby Weights Fallacy: High statistical significance does not equal high sensitivity.

If you try to guess a single baby's sex based only on its weight, you will often be wrong because the weight distributions for boys and girls overlap significantly (low sensitivity, as seen in panel a). However, if you compare the average weight of 3,000 boys to 3,000 girls, the means will be statistically different with extreme precision (high significance, as seen in panel b).

Standard reasoning would wrongly conclude that "averaging" is a more sensitive way to detect sex than "guessing," even though both rely on the exact same underlying data. In priming research, the indirect task often acts like the "averaging" process, creating an illusion of superior sensitivity.

Re-evaluating the Literature

The authors applied their framework to a replication of a landmark number-priming study (Dehaene et al., 1998) and a meta-analysis of 15 highly cited studies (totaling over 3,000 citations).

  • Replication Results: Fresh behavioral data showed that direct task sensitivity ($d' = 0.26$) was nearly identical to indirect task sensitivity ($d' = 0.25$). There was no evidence of an indirect task advantage.
  • Meta-analysis Results: Out of 44 experimental conditions reanalyzed, 35 showed no evidence for an ITA. In the few cases where an advantage was found, results were often inconsistent across experiments within the same study.

Conclusion

The findings suggest that the current evidence for superior unconscious processing is much weaker than previously thought. The authors do not claim unconscious priming is impossible, but rather that its true boundary conditions remain unknown due to flawed logical foundations. They call for a community-wide effort to share raw data and adopt rigorous sensitivity comparisons to advance the scientific understanding of consciousness.

Summary updated

Abstract

Current literature holds that many cognitive functions can be performed\noutside consciousness. Evidence for this view comes from unconscious priming.\nIn a typical experiment, visual stimuli are masked, such that participants are\nclose to chance when directly asked to which of two categories the stimuli\nbelong. This close-to-zero sensitivity is seen as evidence that participants\ncannot consciously report the category of the masked stimuli. Nevertheless, the\ncategory of the masked stimuli can indirectly affect responses to other stimuli\n(e.g., reaction times or brain activity). Priming is therefore seen as evidence\nthat there is still some (albeit unconscious) sensitivity to the stimulus\ncategories, thereby indicating processing outside consciousness. Although this\n"standard reasoning of unconscious priming" has been used in many studies, we\nshow that it is flawed: Sensitivities are not calculated appropriately, hereby\ncreating the wrong impression that priming indicated better sensitivity than\nthe close-to-zero sensitivity of the direct discrimination. We describe the\nappropriate way to determine sensitivities, replicate the behavioral part of a\nlandmark study, develop a method to estimate sensitivities for published\nstudies from reported summary statistics, and use this method to reanalyze 15\nhighly influential studies. Results show that the interpretations of many\nstudies need to be changed and that a community effort to reassess the vast\nliterature on unconscious priming is needed. This process will allow scientists\nto learn more about the true boundary conditions of unconscious priming,\nthereby advancing the scientific understanding of consciousness.\n
BibTeX
@article{meyen2021advancing,
  author = {Sascha Meyen and Iris A. Zerweck and Catarina Amado and Ulrike von Luxburg and Volker H. Franz},
  title = {{Advancing Research on Unconscious Priming: When can Scientists Claim an\textbackslash\{\}n Indirect Task Advantage?}},
  journal = {Journal of Experimental Psychology General},
  year = {2021},
  doi = {10.1037/xge0001065},
}
Figure