No data left behind

Infant research notoriously suffers from small samples, resulting in low power. Beyond increasing sample sizes, improving the reliability of our measurements can also increase power and help find more reliable effects. Byers-Heinlein, Bergmann and Savalei (2021) provide both an analysis of the problem of (low) reliability and a number of valuable recommendations. One of the recommendations is to ‘exclude unreliable data’. Although this may increase the effect size found in the remaining data, it can also unjustifiably bias the estimates when it is unknown what the cause of the unreliability is. In such cases, it is better to embrace the variability and use it to characterize the population: variability is also informative. Modern analytical techniques can be used to deal with variability and with missing data. No data should be left behind!