A Consensus-Based Tool for Evaluating Threats to the Validity of Empirical Research

We introduce a tool to aid reviewers in identifying potential threats to the validity of empirical research. This tool was developed through a three-wave process that elicited consensus-based expert feedback. The threats identified through this process rely on the Four Validities framework (Shadish et al., 2002) and are primarily intended for use in evaluating research in the social sciences. Reviewers can visit seaboat.io to use the tool and generate reports of identified validity threats that can be shared alongside traditional peer review reports or in post-publication peer review.