Evaluating the assessment metrics of the Integrated Cognitive Simulator’s laparoscopic appendicectomy module

Background: Simtics Integrated Cognitive Simulator (ICS) is a software learning environment, previously demonstrated to be of use to surgical trainees in learning the cognitive aspects of procedural skills. It also includes a Test-Mode, which has not previously been assessed for its ability to discriminate between experienced and non-experienced operators. Methods: 10 experienced and 10 non-experienced participants performed a laparoscopic appendicectomy using the ICS laparoscopic appendicectomy (LA) module. Total score, total time, and four further metrics (incorrect hand, incorrect instrument, incorrect location, time > 15s per step) were recorded for each individual, across the four sections and nine steps of the simulation. Results: Median total score was greater amongst surgically experienced participants than surgically inexperienced participants (26.5 %, p = 0.023). Instrument use was a significant discriminator between these groups in 2 of 4 of the ICS LA sections.