Robust tests should be the default, not the backup

preprint OA: closed Public-Domain
🔓 Open OA copy View at publisher
AI-generated summary by claude@2026-07, 2026-07-14

Robust statistical tests, superior to standard tests, should be the default to avoid issues with data anomalies and achieve simpler analysis.

One-sentence paraphrase of the abstract; not a substitute for reading it. No clinical advice. How this works

Abstract

This opinion piece summarizes the epistemic benefits of using robust statistical tests in the falsificationist tradition over standard tests such as the t-test, ANOVA, and conventional tests in ordinary least squares regression. Robust alternatives like robust linear regression do not hinge on assumptions like normally distributed errors with equal variances or the inconsequentiality of extreme values and outliers. Tests with these broad robustness features act agains nonreplication that occurs solely because data anomalies arise differently across studies. Using them from the outset sidesteps the pitfalls of making a data-based decision about whether a standard test is applicable. The common practice of conducting them in addition, commonly in response to data inspection, yields multiple test results. I argue that these should be avoided when a binary decision must be reached, for example, conducting further research on the basis on the assumption that an effect exists. Practically, using a single test simplifies analysis. While R offers numerous robust methods, the ones that provide broad robustness are largely restricted to linear models.

My notes (saved in your browser only)

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2025) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00
unpaywall
last seen: 2026-06-05T02:00:03.366016+00:00
License: Public-Domain