RT Journal Article
SR Electronic
T1 Evaluating replicability of laboratory experiments in economics
JF Science
JO Science
FD American Association for the Advancement of Science
DO 10.1126/science.aaf0918
A1 Camerer, Colin F.
A1 Dreber, Anna
A1 Forsell, Eskil
A1 Ho, Teck-Hua
A1 Huber, Jürgen
A1 Johannesson, Magnus
A1 Kirchler, Michael
A1 Almenberg, Johan
A1 Altmejd, Adam
A1 Chan, Taizan
A1 Heikensten, Emma
A1 Holzmeister, Felix
A1 Imai, Taisuke
A1 Isaksson, Siri
A1 Nave, Gideon
A1 Pfeiffer, Thomas
A1 Razen, Michael
A1 Wu, Hang
YR 2016
UL http://science.sciencemag.org/content/early/2016/03/02/science.aaf0918.abstract
AB The reproducibility of scientific findings has been called into question. To contribute data about reproducibility in economics, we replicate 18 studies published in the American Economic Review and the Quarterly Journal of Economics in 2011-2014. All replications follow predefined analysis plans publicly posted prior to the replications, and have a statistical power of at least 90% to detect the original effect size at the 5% significance level. We find a significant effect in the same direction as the original study for 11 replications (61%); on average the replicated effect size is 66% of the original. The reproducibility rate varies between 67% and 78% for four additional reproducibility indicators, including a prediction market measure of peer beliefs.