Use of Sociodemographic Information in Clinical Vignettes of Multiple-Choice Questions for Preclinical Medical Students

Purpose To characterize the use of demographic data in multiple-choice questions from a commercial preclinical question bank and determine if there is appropriate use of different distractors. Background Multiple-choice questions for medical students often include vignettes describing a patient’s presentation to help guide students to a diagnosis, but overall patterns of usage between different types of nonmedical patient information in question stems has yet to be determined. Methods 380 of 453 randomly selected questions were included for analysis after determining they contained a clinical vignette and required a diagnosis. The vignettes and following explanations were then examined for the presence/absence of 11 types of demographic information, including age, sex/gender, and socioeconomic status. We compared both the usage frequency and relevance between the 11 information types. Results Most information types were present in less than 10% of clinical vignettes, but age and sex/gender were present in over 95% of question stems. Over 50% of questions included irrelevant information about age and sex/gender, but 75% of questions did not include any irrelevant information of other types. Patient weight and environmental exposures were significantly more likely to be relevant than age or sex/gender. Discussion Students using the questions in this study will frequently gain practice incorporating age and sex/gender into their clinical reasoning while receiving little exposure to other demographic information. Based on our findings, we posit that questions could include more irrelevant information, outside age and sex/gender, to better approximate real clinical scenarios and ensure students do not overvalue certain demographic data.