Table 1 Summary of reproducibility rates and effect sizes for original and replication studies overall and by journal/discipline.

df/N refers to the information on which the test of the effect was based (for example, df of t test, denominator df of F test, sample size –3 of correlation, and sample size for z and χ2). Four original results had P values slightly higher than 0.05 but were considered positive results in the original article and are treated that way here. Exclusions (explanation provided in supplementary materials, A3) are “replications P < 0.05” (3 original nulls excluded; n = 97 studies); “mean original and replication effect sizes” (3 excluded; n = 97 studies); “meta-analytic mean estimates” (27 excluded; n = 73 studies); “percent meta-analytic (P < 0.05)” (25 excluded; n = 75 studies); and, “percent original effect size within replication 95% CI” (5 excluded, n = 95 studies).

Effect size comparisonOriginal and replication combined
Replications P < 0.05 in original directionPercentMean (SD) original effect sizeMedian original df/NMean (SD) replication effect sizeMedian replication df/NAverage replication powerMeta-analytic mean (SD) estimatePercent meta-analytic (P < 0.05)Percent original effect size within replication 95% CIPercent subjective “yes” to “Did it replicate?”
Overall35/97360.403 (0.188)540.197 (0.257)680.920.309 (0.223)684739
JPSP, social7/31230.29 (0.10)730.07 (0.11)1200.910.138 (0.087)433425
JEP:LMC, cognitive13/27480.47 (0.18)36.50.27 (0.24)430.930.393 (0.209)866254
PSCI, social7/24290.39 (0.20)760.21 (0.30)1220.920.286 (0.228)584032
PSCI, cognitive8/15530.53 (0.2)230.29 (0.35)210.940.464 (0.221)926053