Thinking Beyond RVCN: Addressing the Complexity of Replication Target Selection

Isager, van ’t Veer and Lakens (2021) proposed a quantitative operationalization of replication value (denoted RVCN), using average yearly citation count and sample size as proxies for value and uncertainty, respectively. In this commentary, we suggest that the approach of Isager et al., while a good theoretical departure point, oversimplifies the complex decision-making process that underpins replication target selection in practice. We present what we view as some issues with RVCN, notably the use of citation count and ambiguity as to whether RVCN is prescriptive or descriptive. We also present preliminary empirical evidence that RVCN diverges on its performance as a replication target selection method, compared with existing selection methods (such as those published by us in the past). We conclude with the recommendation that going forward, approaches should emphasize the multifaceted nature of replication target selection to maximize their practical utility.