Power Analysis and Meta-Analysis are Falsely Reassuring Solutions for Concerns about Statistical Power

Transparency, disclosure, and preregistration have revealed that some statistically underpowered studies may be propped up by selective reporting and p-hacking. Conscientious researchers therefore have renewed investment in statistical power. One approach is to conduct traditional power analysis to correctly set the sample size. I argue that this tool is not helpful and often biased toward samples which are too small. A different approach is to conduct underpowered studies, but meta-analyze across a collection. I argue that this tool is strikingly prone to false-positive inferences. Statistical power is a hugely important problem, but the most widely suggested tools do not offer a helpful solution.

Room: 
5101
Event Type: 
Colloquium
Location: 
Tolman Hall
Date: 
Wednesday, April 19, 2017
Time: 
12:10:00
Event Sponsor: 
Personality and Social Research, Institute of
Event Speakers: 
Leif Nelson