Balancing data quality and bias: Investigating functional connectivity exclusions in the Adolescent Brain Cognitive Development℠ (ABCD Study®) across quality control pathways

Analysis of resting state fMRI (rs-fMRI) typically excludes images substantially degraded by subject motion. However, data quality, including degree of motion, relates to a broad set of participant characteristics, particularly in pediatric neuroimaging (Cosgrove et al., 2022; Gard et al., 2023; Power et al., 2012). Consequently, when planning quality control (QC) procedures researchers must balance data quality concerns against the possibility of biasing results by eliminating data. In order to explore how researcher QC decisions might bias rs-fMRI findings and inform future research design, we investigated how a broad spectrum of participant characteristics in the Adolescent Brain and Cognitive Development (ABCD) study were related to participant inclusion/exclusion across versions of the dataset (the ABCD Community Collection and ABCD Release 4) and QC choices (specifically, motion scrubbing thresholds). Across all these conditions, we found that the odds of a participant’s exclusion related to a broad spectrum of behavioral, demographic, and health-related variables, with the consequence that rs-fMRI analyses using these variables are likely to produce biased results. Consequently, we recommend that missing data be formally accounted for when analyzing rs-fMRI data and interpreting results. Our findings demonstrate the urgent need for better data acquisition and analysis techniques which minimize the impact of motion on data quality. Additionally, we strongly recommend including detailed information about quality control in open datasets such as ABCD.