Digital Gems

Digital Gems

2421 bookmarks
Custom sorting
Publication bias in the social sciences: Unlocking the file drawer
Publication bias in the social sciences: Unlocking the file drawer
Experiments that produce null results face a higher barrier to publication than those that yield statistically significant differences. Whether this is a problem depends on how many null but otherwise valid results might be trapped in the file drawer. Franco et al. use a Time-sharing Experiments in the Social Sciences archive of nearly 250 peer-reviewed proposals of social science experiments conducted on nationally representative samples. They find that only 10 out of 48 null results were published, whereas 56 out of 91 studies with strongly significant results made it into a journal. Science , this issue p. [1502][1] We studied publication bias in the social sciences by analyzing a known population of conducted studies—221 in total—in which there is a full accounting of what is published and unpublished. We leveraged Time-sharing Experiments in the Social Sciences (TESS), a National Science Foundation–sponsored program in which researchers propose survey-based experiments to be run on representative samples of American adults. Because TESS proposals undergo rigorous peer review, the studies in the sample all exceed a substantial quality threshold. Strong results are 40 percentage points more likely to be published than are null results and 60 percentage points more likely to be written up. We provide direct evidence of publication bias and identify the stage of research production at which publication bias occurs: Authors do not write up and submit null findings. [1]: /lookup/doi/10.1126/science.1255484
Publication bias in the social sciences: Unlocking the file drawer
Which Findings Should Be Published?
Which Findings Should Be Published?
(Forthcoming Article) - Given a scarcity of journal space, what is the optimal rule for whether an empirical finding should be published? Suppose publications inform the public about a policy-relevant state. Then journals should publish extreme results, meaning ones that move beliefs sufficiently. This optimal rule may take the form of a one- or a two-sided test comparing a point estimate to the prior mean, with critical values determined by a cost-benefit analysis. Consideration of future studies may additionally justify the publication of precise null results. If one insists that standard inference remain valid, however, publication must not select on the study’s findings.
Which Findings Should Be Published?
Only one in five workers are working from home due to COVID: Black and Hispanic workers are less likely to be able to telework | Economic Policy Institute
Only one in five workers are working from home due to COVID: Black and Hispanic workers are less likely to be able to telework | Economic Policy Institute
Key takeaways: At the beginning of the pandemic, we showed that not everybody can work from home, with the ability to telework differing enormously by race and ethnicity. As with the pre-pandemic period, there remains a large disparity between the share of Black and Hispanic workers who are able to telework during the pandemic, compared…
Only one in five workers are working from home due to COVID: Black and Hispanic workers are less likely to be able to telework | Economic Policy Institute
The Donut Effect of Covid-19 on Cities | NBER
The Donut Effect of Covid-19 on Cities | NBER
Founded in 1920, the NBER is a private, non-profit, non-partisan organization dedicated to conducting economic research and to disseminating research findings among academics, public policy makers, and business professionals.
The Donut Effect of Covid-19 on Cities | NBER
Eurozone Inflation Above Target Sooner Than The ECB Expected
Eurozone Inflation Above Target Sooner Than The ECB Expected
The annual rate of inflation hit the European Central Bank’s target for the first time since late 2018, as energy prices surged in response to a strengthening recovery in the global economy.
Eurozone Inflation Above Target Sooner Than The ECB Expected