When does selecting out conscious trials create regression to the mean?
Wed-HS1-Talk VII-05
Presented by: Zoltan Dienes
In implicit cognition research a standard strategy is to measure the conscious status of knowledge on each trial (e.g. with confidence or visual clarity ratings (PAS), or structural knowledge attributions) and then sub-select the trials where the knowledge is measured to be unconscious. If the accuracy is above chance that is taken to be evidence for unconscious knowledge. David Shanks has pointed out the problem of regression to the mean when people or trials are sub-selected: Because of the ubiquitous possibility of error in measurement, when a selection is made on the basis of one variable (e.g. conscious vs unconscious structural knowledge), the actual value of that variable will be closer to the mean than the measured value. Thus, trials selected to be based on unconscious structural knowledge will actually have some conscious structural knowledge. Does this critique undermine the use of trial by trial measurement, such as structural knowledge attributions in implicit learning (or confidence or PAS in subliminal perception)? I show that it does not. I show how to quantify the actual effect size that could be produced by regression to the mean in any given situation, how it may be so small as to be meaningless, and how to deal with it when it is of a decent size, using Bayes factors with an interval null hypothesis.
Keywords: implicit cognition, regression to mean, Bayes factor