Non-Standard Errors
Research output: Preprint/Documentation/Report › Working paper
Contributors
Abstract
In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants.
Details
Original language | English |
---|---|
Publication status | Published - 23 Nov 2021 |
Publication series
Series | SSRN eLibrary / Social Science Research Network |
---|---|
ISSN | 1556-5068 |
No renderer: customAssociatesEventsRenderPortal,dk.atira.pure.api.shared.model.researchoutput.WorkingPaper
External IDs
ORCID | /0000-0003-4359-987X/work/142255145 |
---|
Keywords
Keywords
- non-standard errors, multi-analyst approach, liquidity