Impact of peer-delivered tuition/feedback on appointment to United Kingdom Higher Surgical Training

Impact of peer-delivered tuition/feedback on appointment to United Kingdom Higher Surgical Training | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research article Impact of peer-delivered tuition/feedback on appointment to United Kingdom Higher Surgical Training Wen Ling Choong, Melvin Joy, Marta Madurska, Benjie Tang, Brian Ip This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-63538/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract Background In the United Kingdom, Core Surgical Trainees (or equivalent) undergo a rigorous National Selection (NS) process to secure a ST3 Training Post in General or Vascular Surgery. Despite a decrease in competition ratio from 3:1 in 2012 to 1.48:1 in 2017, many applicants were unable to secure ST3 Training Posts. We hypothesise that this is due to applicant performance anxiety rather than lack of clinical experience. Methods This is a prospective observational study following 27 delegates who have completed a 2-day course consisting of didactic lecture and interactive practice with a 1:1 faculty:delegate ratio. The course was delivered by surgical consultants and trainees. A specific mentor was nominated to oversee the delegate’s progress throughout and post course. Personalised feedback was given by the entire faculty throughout the course. Delegates were asked to complete evaluation forms to track their perceived confidence levels of success at NS at different timeframes, measured by a visual analogue scale. Paired t -test was performed to compare the mean confidence level pre- and post- course. Results Evaluation forms were received from all (n = 27) delegates. Delegate self-reported confidence increased significantly for all domains except Professional Communication. 23 (85%) of the participants were successful in the NS post course. There was no statistically significant difference between UK and non-UK graduates; and first time and not-first-time applicants. Conclusions Peer-delivered teaching, practice and feedback as a structured interview practice course can significantly improve applicants’ overall confidence levels in preparing for the UK ST3 General and Vascular Surgery NS. Improvement in confidence levels translates to high attrition rate of ST3 Training Posts. Communication skills require longer practice time extending beyond the duration of the 2-day course. Educational Philosophy and Theory General Surgery UK Higher Surgical Training interview course peer-delivered tuition/feedback mentoring performance feedback communication skills Figures Figure 1 Figure 2 Figure 3 Figure 4 Background Appointment to higher surgical training in the UK (Specialty Training (ST) from Core Surgical Training is competitive. Since 2011, eligible Core Surgical Trainees (or equivalent) wishing to obtain certification (Certificate of Complete Training (CCT)) in General or Vascular Surgery apply to undergo a 3-hour structured interview at a National Selection Centre. The interview is hosted by Health Education England (HEE) on behalf of the Vascular Surgery and General Surgery Specialty Advisory Committees (SAC) ( 1 ). The structure of the ST3 General and Vascular Surgery Interview puts emphasis on 6 different domains: (i) Clinical Scenario, (ii) Clinical Management, (iii) Professional Communication, (iv) Portfolio, (v) Academic Knowledge, (vi) Teaching and Technical Skills. Until 2018 Patient Communication and Leadership Skills were also included. Simulated cases based on each assessed domain are designed to closely mirror real life surgical practice. Candidates who have achieved an overall score which exceeds a defined threshold are deemed appointable. They are matched to training posts within the UK depending on availability. Despite a decrease in ST3 competition ratio from 1.68:1 in 2016 ( 2 ) to 1.48:1 in 2017 ( 3 ), many applicants were unable to secure a National Training Number (NTN). Whilst such observation may be explained by lack of real life clinical or leadership experience, some candidates were hampered by poor interview technique. We hypothesised that poor interview techniques and the applicant’s own psychological barriers limit performance on the day of interview. We developed a structured peer-delivered interview preparation course to address these barriers. Peer-delivered learning was chosen as it has been demonstrated to improve confidence and effective ( 4 ). The aim of this study is to evaluate the effectiveness of our course in improving the self-reported confidence of the applicants at the UK ST3 General and Vascular Surgery Interview. The secondary aim is to evaluate the impact of the course on non-UK medical graduates and not-first- time applicants, for whom there is anecdotal evidence of being disadvantaged. Methods Prospective applicants who intended to apply to the UK ST3 General and Vascular Interview applied voluntarily to attend the paid course between February 2017 and February 2018. The 2-day interview preparation course was designed with a maximum delegate number of ten per course (Fig. 1 ). It was run over two days in the Clinical Skills Centre, Ninewells Hospital, University of Dundee, United Kingdom. The number of delegates was kept to a maximum of ten which allowed for a 1:1 delegate to tutor ratio. Each delegate was assigned a mentor at the beginning of the course serving as a single point of contact over the entire course. The course faculty consisted of surgical consultants and trainees (ranging from ST3 to ST8), all of whom had successfully passed the same ST3 General and Vascular Surgery Interview as applicants and appointed into training programmes. The first day began with didactic lectures focusing on each domain within the interview process: Portfolio, Clinical Skills, Clinical Management, Professional Communication skills, Academic, Technical Skills and Teaching. This was followed by moulage which allowed for practice and immediate feedback on performance. The second half of day one involved peer-delivered teaching and practice on selected technical skills as used for the interview process. Delegates worked in pairs, allowing them to observe each other’s performance. In addition to verbal feedback each delegate was scored individually using a structured scoring sheet with scores of 1–5. This score sheet mirrors the one used in the real-life interview. Day two began with an Objective Structured Clinical Examination (OSCE) simulating the entire interview process. Each delegate rotated into stations representing each assessed domain. Each station was manned by one faculty member, who delivered verbal and written feedback at the end of the station. Following review and discussion by the faculty, the delegate was individually called into a private meeting with the faculty. Led by the delegate’s mentor, constructive formative feedback was delivered with contributions from the rest of the faculty. Following this a further OSCE was conducted with written scoring and no verbal feedback to simulate the actual interview process. The delegate was given the opportunity to review all collated personalised feedback at the end of the course. Delegates were also encouraged to contact their individual mentors after the course for future support. A pre-course evaluation form was used to collect delegate demographic data including current level of training, duration of preparation, methods of preparation, number of previous ST3 interview attempts as well as self-evaluation using a visual analog scale (VAS) on perceived confidence level of success in National Selection. VAS was chosen as a self-assessment tool due to its ease of use, reliability and the ability to assess change over time ( 5 ). The evaluation consisted of a subjective assessment of the participants overall confidence for performance in the interview as well as confidence at each of the specific components: Portfolio, Clinical Scenario, Management, Professional Communication, Academic, Technical and Teaching Skills. Delegates scored themselves by placing an ‘X’ along the VAS line to denote their perceived level of confidence, ranging from low to high (Fig. 2 ). Each line measured 10 cm with one end being “no marks/not confident” and the other end, “full marks/very confident”. Data on confidence were gathered using the VAS tool pre- and post course. Data was collated per delegate by measuring in centimeters to one decimal point to assess the level of confidence and compare progression of this parameter through the course. All delegates consented to their data being used in anonymised manner for the purpose of improving the course. Statistical Analysis Analysis was performed using the SPSS Statistical program for Mac version 26 (IBM, Chicago, Ill). Normality testing was performed in order to determine data distribution. As data showed a normal distribution. Continuous data is presented using mean and standard deviation and categorical data is presented using %. Paired samples t -test was performed to compare means before and after the course completion. Statistical significance was set at p value of < 0.05. Results 27 Delegates completed the full 2-day course and submitted evaluation. Demographic data is presented in Table 1 . 44% of the course participants were at Core Trainee (CT) level, 30% were at level of Locum in Training (LAT) ST3, with the remaining participants (26%) above ST3 level (including Locum in Service (LAS), ST, clinical fellow posts or others). 16 (59%) participants have not attempted the interview before, 8 (30%) had one previous failed attempt, and 3 people (11%) had more than 1 failed attempts ( 2 – 3 ). Non-UK graduates accounted for 37% (n = 10) of the cohort. Table 1 Participant Demographics Participants N % Level of training CT2 12 44% LAT ST3 8 30% above of ST3 equivalent 7 26% Number of previous attempts 0 16 59% 1 8 30% > 1 3 11% Following the course, delegate self-reported confidence increased significantly for the Portfolio station (5.35 ± 2.03 vs 6.60 ± 2.08, p = 0.008). Confidence score improved after completion of both Clinical and Management stations (6.54 ± 1.70 vs 7.43 ± 1.41, p = 0.004, and 6.64 ± 1.48 ± 7.43 ± 1.36, p = 0.012 respectively). Similarly, there were improvements in confidence in the Technical and Teaching Skills station (6.03 ± 2.04 vs 7.24 ± 1.92, p = 0.007) as well as the Academic station (4.93 ± 2.21 ± vs 6.66 ± 1.75, p = 0.004). While there was an overall increase in confidence in the Professional Communication station, this was not statistically significant (p = 0.063). Overall confidence of success at National Selection has increased significantly (4.32 ± 2.05 vs 6.43 ± 1.81, p < 0.001) (Table 2 and Fig. 3 ). Table 2 Levels of confidence before and after the course. Station Before mean (SD) After mean (SD p Portfolio 5.35 (2.03) 6.60 (2.08) 0.008 Clinical Scenario 6.54 (1.70) 7.43 (1.41) 0.004 Clinical Management 6.64 (1.48) 7.43 (1.36) 0.012 Professional Communication 6.12 (1.75) 7.10 (1.69) 0.063 Academic 4.93 (2.21) 6.66 (1.75) 0.004 Technical Skills & Teaching 6.03 (2.04) 7.24 (1.92) 0.007 Overall Confidence 4.32 (2.05) 6.43 (1.81) < 0.001 The change in overall confidence did not differ between UK graduates and non- UK graduates (p = 0.538), nor between first time and not-first-time applicants (p = 0.893) (Fig. 4 A and Fig. 4 B). 23 (85%) of the course participants were successful in obtaining a national training number at the interview following the course. The success rates for non-UK graduates and non-first-time applicants were 70% (7/10) and 67% (8/12) respectively. Discussion In this study, we believed that peer-delivered teaching, practice and feedback translated to increased confidence levels as perceived by the delegates. With the exception of Professional Communication, statistical significance was reached in all other stations. The biggest increase was observed in the Academic Station. Anecdotal feedback from delegates suggested this station represented the greatest psychological barrier due to its perceived complexity and knowledge gap. We have consistently received good qualitative feedback from the course delegates. Improved confidence achieved at the course translated to success at National Selection rate – 85% of course delegates obtained training posts in General or Vascular Surgery in the UK. The concept for this course resulted from informal ‘interview practice’ sessions with many non-UK graduates and non-first-time applicants. There is a perception amongst these groups that they are disadvantaged by individual factors ( 6 ). Non-UK graduates struggle to communicate their knowledge effectively in a time-limited, pressurised environment ( 7 ). This is evident in the lower reported confidence scores by non-UK graduates in the Professional Communication domain. Our course achieved a 70% success rate for non-UK graduates. For most non-UK graduates, achieving a NTN provides the most reliable pathway to CCT and independent consultant practice. The current alternative to Specialist Registration (‘Article 14’/CESR) is widely known to be a frustrating process ( 8 ). Not-first-time applicants are hampered by memories of their previous performance failure. They often find it difficult to part with their negative mentality in order to succeed. However, as we found that there was no statistically significant difference between first time and not-first-time applicants, this means that all groups responded well to the course number of applications. Our course achieved a 67% success rate for non-first-time applicants. We note a decrease confidence was reported by UK graduates and first-time applicants in the Technical and Teaching domain. Under the Technical and Teaching stations, five technical skills were selected based on previous application in real life interview: excision of skin lesion, small bowel resection, basic laparoscopy, arteriotomy and vein patch. Assessment of these skills in the course, as in simulated or real-life training exercises, were carried out using Procedural Based Assessments (PBAs). Despite PBAs being readily accessible by surgical trainees on the Intercollegiate Surgical Curriculum Project (ISCP) portal, very few delegates took the effort to revise PBAs prior to the course. We believed that non-UK graduates and not-first-time applicants reported more experience in carrying out or assisting in these procedures, therefore putting them at a higher baseline for confidence and learning. In contrast, UK-graduates and first-time applicants may have felt overwhelmed and alienated by the knowledge and technical skills required to perform a simulated task in a limited timeframe for preparation. Our course utilised OSCE style learning with minimal lecture based teaching. OSCEs have been used since the 1970s in medical education to prepare healthcare students for real clinical practice in a safe environment, allow application and reinforcement of theoretical learning and real-time feedback on areas for improvement ( 9 ). By emphasising a safe, non-judgemental learning environment, delegates reframe their mindset to overcome their anxiety barrier. This is due to the perception that “the stakes are not as high” in the mock environment ( 10 ). Currently, numerous interview preparation courses of differing formats are available in the UK. Although most courses covered similar content, they lack the practical aspect of OSCE style interviews as well as one-to-one peer mentoring during and after the course. As these teaching methods are resource intensive, most of these courses run in a pure didactic lecture format. Such passive format fails to assess the candidates understanding with little personalized feedback. In addition, most if not all other courses are run by Consultants who have not experienced the National Selection Interview as applicants. Delegates therefore experience less empathy. In contrast, this course provides immediate verbal feedback after the OSCE style interview on the first day as well as written feedback throughout both days about the candidates’ performance. Faculty feedback on Day 2 to individual delegates ensures the process is holistic and unbiased. Delegates are given opportunities to reflect on their strengths and weakness throughout the course. We did not demonstrate an improvement in confidence reaching statistical difference in Professional Communication. We believed that communication skills require longer practice time extending beyond the duration of the 2-day course. Some advocate that communication skills should be taught formally especially to healthcare professionals ( 11 ). In the future, we plan to expand the communication element in the course through OSCE style learning. Limitations of our study include small number of cohort of 27. Confidence scores were only self-reported, with no objective scoring to correlate with the observed positive trend in confidence levels. The delegates were a self-selected group, suggesting a degree of insight and motivation in their preparation approach. Fatigue experiences by delegates during the 2-day course may also influence their self-reported scores. Finally, this study only assessed confidence which is subjective. Therefore, an improvement to the methodology would be to compare objective performance score provided by the interviewer in each station to the delegates confidence scores. In the near future, we expect a move to a digital platform due to new social distancing measures resulting from the COVID-19 pandemic. This will significantly alter the way delegates experience the course. Conclusion Our study concluded that peer-delivered teaching, practice and feedback delivered as a structured interview practice course can significantly improve the applicants’ overall confidence levels in preparing for the UK ST3 General and Vascular Surgery National Selection. Improvement in confidence levels translates to high attrition rate of ST3 Training Posts. Communication skills require longer practice time extending beyond the duration of the 2-day course. (2183 words) Abbreviations ST: Specialty Training; CCT:Certificate of Complete Training; HEE:Health Education England; SAC:Surgery Specialty Advisory Committees; NTN:National Training Number Declarations Acknowledgements We would like to thank the Dundee Institute for Healthcare Simulation team and the course faculty members for their help in running the course. We would like to thank all of the course delegates who participated in this course for allowing us to use these data. Authors’ contributions WLC has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. MJ has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. MM has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. BT has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. BI has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved Funding There are no sources of funding required for this publication. Availability of data and materials The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request. Ethics approval and consent to participate Ethical approval for the delegates to participate in this study was obtained from the University Research Ethics Committee of the University of Dundee (Ref 15,240). It was advised by the ethic committee that the delegates should be informed clearly that participation in the study was purely voluntary. Verbal consent was given by the delegates to indicate that they fully understood the nature of this study and agreed to participate in this study. Consent for publication This manuscript does not contain any individual person’s data. Participation in this study included a statement of intent to publish. Competing interests There are no competing interests. References NHS Health Education England. Available from: https://specialtytraining.hee.nhs.uk [Accessed 14 th June 2020] NHS Health Education England. Available from: https://specialtytraining.hee.nhs.uk/Portals/1/Content/Resource%20Bank/Competition%20Ratio%27s/Competition%20Ratios%202016.pdf [Accessed 14 th June 2020] NHS Health Education England. Available from: https://specialtytraining.hee.nhs.uk/portals/1/Content/Resource%20Bank/Competition%20Ratio%27s/Competition%20Ratios%202017%20ST3.pdf [Accessed 14 th June 2020] Siddiqui S, Siddiqui S, Mustafa Q, Rizvi AF, Hossain IT. The benefits of a peer-assisted mock PACES. Clin Teach . 2018; 15(3): 221‐ Available from: doi.org/10.1111/tct.12658 Sung, Y, Wu, J. The Visual Analogue Scale for Rating, Ranking and Paired-Comparison (VAS-RRP): A new technique for psychological measurement. Behav Res . 2018; 50, 1694–171. Available from: doi.org/10.3758/s13428-018-1041-8 Pattinson J, Blow C, Sinha B , et al. Exploring reasons for differences in performance between UK and international medical graduates in the Membership of the Royal College of General Practitioners Applied Knowledge Test: a cognitive interview study. BMJ Open .2019; 9: Available from: doi.org/10.1136/bmjopen-2019-030341 Pilotto LS, Duncan GF, Anderson-Wurf J. Issues for clinicians training international medical graduates: a systematic review. Med J Aust . 2007; 187(4): 225-228. Available from: White C. Many CESR and CEGPR decisions take longer than the statutory three months. BMJ 2012; 345: e5289 Rushforth HE. Objective structured clinical examination (OSCE): review of literature and implications for nursing education. Nurse Educ Today . 2007; 27(5): 481‐ Available from: doi.org/10.1016/j.nedt.2006.08.009 Brown, J. Preparation for objective structured clinical examination: a student perspective. J of Perioper Pract . 2019; 29(6), 179- 184. Available from: org/10.1177/1750458918808985 Ranjan P, Kumari A, & Chakrawarty A. How can doctors improve their communication skills? J of Clin Diagn Res . 2015; 9 (3), JE01-4. Available from: doi.org/10.7860/JCDR/2015/12072.5712 Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-63538","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research article","associatedPublications":[],"authors":[{"id":1996829,"identity":"86a2ac6c-c195-4162-9972-b0728da5c2a9","order_by":0,"name":"Wen Ling Choong","email":"","orcid":"","institution":"Department of General Surgery, Ninewells Hospital and Medical School, Dundee","correspondingAuthor":false,"prefix":"","firstName":"Wen","middleName":"Ling","lastName":"Choong","suffix":""},{"id":1996830,"identity":"3d19f98b-bf8b-45b0-b5c3-00e930dc008d","order_by":1,"name":"Melvin Joy","email":"","orcid":"","institution":"Department of General Surgery, Ninewells Hospital and Medical School, Dundee","correspondingAuthor":false,"prefix":"","firstName":"Melvin","middleName":"","lastName":"Joy","suffix":""},{"id":1996831,"identity":"1b65f16f-8c96-4c31-8bed-ba4f3631ed27","order_by":2,"name":"Marta Madurska","email":"","orcid":"","institution":"R Adams Cowley Shock Trauma Center","correspondingAuthor":false,"prefix":"","firstName":"Marta","middleName":"","lastName":"Madurska","suffix":""},{"id":1996832,"identity":"4033ae1d-c5e5-400c-b8d5-9abb2b9c96dc","order_by":3,"name":"Benjie Tang","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA1klEQVRIiWNgGAWjYBACAwhlw9gAZzOwEdLCDKLSSNdymAQt5gz8Bz8X/Dovu+F288YHHxjs5Bkk0hLwarFsYGaWntl323jDnWPFhjMYkg0bJNIO4HfYAWYGad6e24kbbuSYSfMwMCcwSKQ3ENLC/Ju35xxIi/nvPwz1RGlhk+b5cQBsCzAkDgO1EHCYZTOzmTVvQ7LxzBtpxZI9BscN23ieJeDVYs7e+Pg2zx872b4byRs//KioludnTzPAqwUcLYxtcHcSjBUY+EOcslEwCkbBKBihAAC3LEM+08LSAwAAAABJRU5ErkJggg==","orcid":"https://orcid.org/0000-0001-5041-1869","institution":"University of Dundee","correspondingAuthor":true,"prefix":"","firstName":"Benjie","middleName":"","lastName":"Tang","suffix":""},{"id":1996833,"identity":"63f8b72f-fd65-4845-9ba3-b6916893dd3c","order_by":4,"name":"Brian Ip","email":"","orcid":"","institution":"Department of General Surgery, Ninewells Hospital and Medical School, Dundee","correspondingAuthor":false,"prefix":"","firstName":"Brian","middleName":"","lastName":"Ip","suffix":""}],"badges":[],"createdAt":"2020-08-21 11:11:41","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-63538/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-63538/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":2249113,"identity":"b2bcce97-b2db-42fd-bade-ba58e2131f79","added_by":"auto","created_at":"2020-09-04 15:25:15","extension":"jpg","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":155469,"visible":true,"origin":"","legend":"Course programme ","description":"","filename":"Figure1.jpg","url":"https://assets-eu.researchsquare.com/files/rs-63538/v1/Figure1.jpg"},{"id":2249114,"identity":"822b0b8c-cfc1-443c-b3e7-9c2ada9ba7b1","added_by":"auto","created_at":"2020-09-04 15:25:16","extension":"jpg","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":50612,"visible":true,"origin":"","legend":"Visual analog scale for self-assessment of confidence","description":"","filename":"Figure2.jpg","url":"https://assets-eu.researchsquare.com/files/rs-63538/v1/Figure2.jpg"},{"id":2249115,"identity":"f21a2aef-1ba0-4d86-a1e1-d6fe32f4b687","added_by":"auto","created_at":"2020-09-04 15:25:16","extension":"jpg","order_by":3,"title":"Figure 3","display":"","copyAsset":false,"role":"figure","size":47598,"visible":true,"origin":"","legend":"Graphical illustration of the level of confidence before and after the course","description":"","filename":"Figure3.jpg","url":"https://assets-eu.researchsquare.com/files/rs-63538/v1/Figure3.jpg"},{"id":2249116,"identity":"4b424e19-15eb-4661-8846-db384d49cb30","added_by":"auto","created_at":"2020-09-04 15:25:16","extension":"jpg","order_by":4,"title":"Figure 4","display":"","copyAsset":false,"role":"figure","size":55549,"visible":true,"origin":"","legend":"Difference in confidence score before and after the course presented in mean and standard deviation (SD) for each station as well as overall course. Comparison between: A. Non-UK Graduate and UK Graduate course participants; B. Participants who were first time applicants and those who have completed the recruitment process at least once before. P\u003e0.005 for each category. ","description":"","filename":"Figure4.jpg","url":"https://assets-eu.researchsquare.com/files/rs-63538/v1/Figure4.jpg"},{"id":13587902,"identity":"5ef63dcc-75c9-4c91-817f-9a337841c093","added_by":"auto","created_at":"2021-09-17 04:53:01","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":414547,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-63538/v1/f91de4d2-2907-42db-8ca2-72347dda786b.pdf"}],"financialInterests":"","formattedTitle":"Impact of peer-delivered tuition/feedback on appointment to United Kingdom Higher Surgical Training","fulltext":[{"header":"Background","content":" \u003cp\u003eAppointment to higher surgical training in the UK (Specialty Training (ST) from Core Surgical Training is competitive. Since 2011, eligible Core Surgical Trainees (or equivalent) wishing to obtain certification (Certificate of Complete Training (CCT)) in General or Vascular Surgery apply to undergo a 3-hour structured interview at a National Selection Centre. The interview is hosted by Health Education England (HEE) on behalf of the Vascular Surgery and General Surgery Specialty Advisory Committees (SAC) (\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e). The structure of the ST3 General and Vascular Surgery Interview puts emphasis on 6 different domains: (i) Clinical Scenario, (ii) Clinical Management, (iii) Professional Communication, (iv) Portfolio, (v) Academic Knowledge, (vi) Teaching and Technical Skills. Until 2018 Patient Communication and Leadership Skills were also included. Simulated cases based on each assessed domain are designed to closely mirror real life surgical practice. Candidates who have achieved an overall score which exceeds a defined threshold are deemed appointable. They are matched to training posts within the UK depending on availability. Despite a decrease in ST3 competition ratio from 1.68:1 in 2016 (\u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e) to 1.48:1 in 2017 (\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e), many applicants were unable to secure a National Training Number (NTN). Whilst such observation may be explained by lack of real life clinical or leadership experience, some candidates were hampered by poor interview technique.\u003c/p\u003e \u003cp\u003eWe hypothesised that poor interview techniques and the applicant\u0026rsquo;s own psychological barriers limit performance on the day of interview. We developed a structured peer-delivered interview preparation course to address these barriers. Peer-delivered learning was chosen as it has been demonstrated to improve confidence and effective (\u003cspan citationid=\"CR4\" class=\"CitationRef\"\u003e4\u003c/span\u003e).\u003c/p\u003e \u003cp\u003eThe aim of this study is to evaluate the effectiveness of our course in improving the self-reported confidence of the applicants at the UK ST3 General and Vascular Surgery Interview. The secondary aim is to evaluate the impact of the course on non-UK medical graduates and not-first- time applicants, for whom there is anecdotal evidence of being disadvantaged.\u003c/p\u003e "},{"header":"Methods","content":" \u003cp\u003eProspective applicants who intended to apply to the UK ST3 General and Vascular Interview applied voluntarily to attend the paid course between February 2017 and February 2018. The 2-day interview preparation course was designed with a maximum delegate number of ten per course (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e). It was run over two days in the Clinical Skills Centre, Ninewells Hospital, University of Dundee, United Kingdom. The number of delegates was kept to a maximum of ten which allowed for a 1:1 delegate to tutor ratio. Each delegate was assigned a mentor at the beginning of the course serving as a single point of contact over the entire course. The course faculty consisted of surgical consultants and trainees (ranging from ST3 to ST8), all of whom had successfully passed the same ST3 General and Vascular Surgery Interview as applicants and appointed into training programmes.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eThe first day began with didactic lectures focusing on each domain within the interview process: Portfolio, Clinical Skills, Clinical Management, Professional Communication skills, Academic, Technical Skills and Teaching. This was followed by moulage which allowed for practice and immediate feedback on performance. The second half of day one involved peer-delivered teaching and practice on selected technical skills as used for the interview process. Delegates worked in pairs, allowing them to observe each other\u0026rsquo;s performance. In addition to verbal feedback each delegate was scored individually using a structured scoring sheet with scores of 1\u0026ndash;5. This score sheet mirrors the one used in the real-life interview.\u003c/p\u003e \u003cp\u003eDay two began with an Objective Structured Clinical Examination (OSCE) simulating the entire interview process. Each delegate rotated into stations representing each assessed domain. Each station was manned by one faculty member, who delivered verbal and written feedback at the end of the station.\u003c/p\u003e \u003cp\u003eFollowing review and discussion by the faculty, the delegate was individually called into a private meeting with the faculty. Led by the delegate\u0026rsquo;s mentor, constructive formative feedback was delivered with contributions from the rest of the faculty. Following this a further OSCE was conducted with written scoring and no verbal feedback to simulate the actual interview process. The delegate was given the opportunity to review all collated personalised feedback at the end of the course. Delegates were also encouraged to contact their individual mentors after the course for future support.\u003c/p\u003e \u003cp\u003eA pre-course evaluation form was used to collect delegate demographic data including current level of training, duration of preparation, methods of preparation, number of previous ST3 interview attempts as well as self-evaluation using a visual analog scale (VAS) on perceived confidence level of success in National Selection. VAS was chosen as a self-assessment tool due to its ease of use, reliability and the ability to assess change over time (\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e). The evaluation consisted of a subjective assessment of the participants overall confidence for performance in the interview as well as confidence at each of the specific components: Portfolio, Clinical Scenario, Management, Professional Communication, Academic, Technical and Teaching Skills. Delegates scored themselves by placing an \u0026lsquo;X\u0026rsquo; along the VAS line to denote their perceived level of confidence, ranging from low to high (Fig.\u0026nbsp;\u003cspan refid=\"Fig2\" class=\"InternalRef\"\u003e2\u003c/span\u003e). Each line measured 10\u0026nbsp;cm with one end being \u0026ldquo;no marks/not confident\u0026rdquo; and the other end, \u0026ldquo;full marks/very confident\u0026rdquo;. Data on confidence were gathered using the VAS tool pre- and post course. Data was collated per delegate by measuring in centimeters to one decimal point to assess the level of confidence and compare progression of this parameter through the course. All delegates consented to their data being used in anonymised manner for the purpose of improving the course.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cdiv id=\"Sec3\" class=\"Section2\"\u003e \u003ch2\u003eStatistical Analysis\u003c/h2\u003e \u003cp\u003eAnalysis was performed using the SPSS Statistical program for Mac version 26 (IBM, Chicago, Ill). Normality testing was performed in order to determine data distribution. As data showed a normal distribution. Continuous data is presented using mean and standard deviation and categorical data is presented using %. Paired samples t -test was performed to compare means before and after the course completion. Statistical significance was set at p value of \u0026lt;\u0026thinsp;0.05.\u003c/p\u003e \u003c/div\u003e "},{"header":"Results","content":" \u003cp\u003e27 Delegates completed the full 2-day course and submitted evaluation. Demographic data is presented in Table\u0026nbsp;\u003cspan refid=\"Tab1\" class=\"InternalRef\"\u003e1\u003c/span\u003e. 44% of the course participants were at Core Trainee (CT) level, 30% were at level of Locum in Training (LAT) ST3, with the remaining participants (26%) above ST3 level (including Locum in Service (LAS), ST, clinical fellow posts or others). 16 (59%) participants have not attempted the interview before, 8 (30%) had one previous failed attempt, and 3 people (11%) had more than 1 failed attempts (\u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e). Non-UK graduates accounted for 37% (n\u0026thinsp;=\u0026thinsp;10) of the cohort.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab1\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eParticipant Demographics\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"3\"\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eParticipants\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eN\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003e%\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cspan type=\"BoldItalic\" class=\"BoldItalic\" name=\"Emphasis\"\u003eLevel of training\u003c/span\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eCT2\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e12\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e44%\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eLAT ST3\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e30%\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eabove of ST3 equivalent\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e7\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e26%\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cspan type=\"BoldItalic\" class=\"BoldItalic\" name=\"Emphasis\"\u003eNumber of previous attempts\u003c/span\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e0\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e16\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e59%\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e1\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e30%\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e\u0026gt;\u0026thinsp;1\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e11%\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eFollowing the course, delegate self-reported confidence increased significantly for the Portfolio station (5.35\u0026thinsp;\u0026plusmn;\u0026thinsp;2.03 vs 6.60\u0026thinsp;\u0026plusmn;\u0026thinsp;2.08, p\u0026thinsp;=\u0026thinsp;0.008). Confidence score improved after completion of both Clinical and Management stations (6.54\u0026thinsp;\u0026plusmn;\u0026thinsp;1.70 vs 7.43\u0026thinsp;\u0026plusmn;\u0026thinsp;1.41, p\u0026thinsp;=\u0026thinsp;0.004, and 6.64\u0026thinsp;\u0026plusmn;\u0026thinsp;1.48\u0026thinsp;\u0026plusmn;\u0026thinsp;7.43\u0026thinsp;\u0026plusmn;\u0026thinsp;1.36, p\u0026thinsp;=\u0026thinsp;0.012 respectively). Similarly, there were improvements in confidence in the Technical and Teaching Skills station (6.03\u0026thinsp;\u0026plusmn;\u0026thinsp;2.04 vs 7.24\u0026thinsp;\u0026plusmn;\u0026thinsp;1.92, p\u0026thinsp;=\u0026thinsp;0.007) as well as the Academic station (4.93\u0026thinsp;\u0026plusmn;\u0026thinsp;2.21\u0026thinsp;\u0026plusmn;\u0026thinsp;vs 6.66\u0026thinsp;\u0026plusmn;\u0026thinsp;1.75, p\u0026thinsp;=\u0026thinsp;0.004). While there was an overall increase in confidence in the Professional Communication station, this was not statistically significant (p\u0026thinsp;=\u0026thinsp;0.063). Overall confidence of success at National Selection has increased significantly (4.32\u0026thinsp;\u0026plusmn;\u0026thinsp;2.05 vs 6.43\u0026thinsp;\u0026plusmn;\u0026thinsp;1.81, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001) (Table\u0026nbsp;\u003cspan refid=\"Tab2\" class=\"InternalRef\"\u003e2\u003c/span\u003e and Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003e).\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab2\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 2\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eLevels of confidence before and after the course.\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"4\"\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eStation\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eBefore\u003c/p\u003e \u003cp\u003emean (SD)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eAfter\u003c/p\u003e \u003cp\u003emean (SD\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cem\u003ep\u003c/em\u003e\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ePortfolio\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e5.35 (2.03)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e6.60 (2.08)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.008\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eClinical Scenario\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e6.54 (1.70)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e7.43 (1.41)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.004\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eClinical Management\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e6.64 (1.48)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e7.43 (1.36)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.012\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eProfessional Communication\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e6.12 (1.75)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e7.10 (1.69)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.063\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eAcademic\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e4.93 (2.21)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e6.66 (1.75)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.004\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eTechnical Skills \u0026amp; Teaching\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e6.03 (2.04)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e7.24 (1.92)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.007\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cspan type=\"BoldItalic\" class=\"BoldItalic\" name=\"Emphasis\"\u003eOverall Confidence\u003c/span\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e4.32 (2.05)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e6.43 (1.81)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e\u0026lt;\u0026thinsp;0.001\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eThe change in overall confidence did not differ between UK graduates and non- UK graduates (p\u0026thinsp;=\u0026thinsp;0.538), nor between first time and not-first-time applicants (p\u0026thinsp;=\u0026thinsp;0.893) (Fig.\u0026nbsp;\u003cspan refid=\"Fig4\" class=\"InternalRef\"\u003e4\u003c/span\u003eA \u003cb\u003eand\u003c/b\u003e Fig.\u0026nbsp;\u003cspan refid=\"Fig4\" class=\"InternalRef\"\u003e4\u003c/span\u003eB). 23 (85%) of the course participants were successful in obtaining a national training number at the interview following the course. The success rates for non-UK graduates and non-first-time applicants were 70% (7/10) and 67% (8/12) respectively.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e "},{"header":"Discussion","content":" \u003cp\u003eIn this study, we believed that peer-delivered teaching, practice and feedback translated to increased confidence levels as perceived by the delegates. With the exception of Professional Communication, statistical significance was reached in all other stations. The biggest increase was observed in the Academic Station. Anecdotal feedback from delegates suggested this station represented the greatest psychological barrier due to its perceived complexity and knowledge gap. We have consistently received good qualitative feedback from the course delegates. Improved confidence achieved at the course translated to success at National Selection rate \u0026ndash; 85% of course delegates obtained training posts in General or Vascular Surgery in the UK.\u003c/p\u003e \u003cp\u003eThe concept for this course resulted from informal \u0026lsquo;interview practice\u0026rsquo; sessions with many non-UK graduates and non-first-time applicants. There is a perception amongst these groups that they are disadvantaged by individual factors (\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e). Non-UK graduates struggle to communicate their knowledge effectively in a time-limited, pressurised environment (\u003cspan citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e). This is evident in the lower reported confidence scores by non-UK graduates in the Professional Communication domain. Our course achieved a 70% success rate for non-UK graduates. For most non-UK graduates, achieving a NTN provides the most reliable pathway to CCT and independent consultant practice. The current alternative to Specialist Registration (\u0026lsquo;Article 14\u0026rsquo;/CESR) is widely known to be a frustrating process (\u003cspan citationid=\"CR8\" class=\"CitationRef\"\u003e8\u003c/span\u003e).\u003c/p\u003e \u003cp\u003eNot-first-time applicants are hampered by memories of their previous performance failure. They often find it difficult to part with their negative mentality in order to succeed. However, as we found that there was no statistically significant difference between first time and not-first-time applicants, this means that all groups responded well to the course number of applications. Our course achieved a 67% success rate for non-first-time applicants.\u003c/p\u003e \u003cp\u003eWe note a decrease confidence was reported by UK graduates and first-time applicants in the Technical and Teaching domain. Under the Technical and Teaching stations, five technical skills were selected based on previous application in real life interview: excision of skin lesion, small bowel resection, basic laparoscopy, arteriotomy and vein patch. Assessment of these skills in the course, as in simulated or real-life training exercises, were carried out using Procedural Based Assessments (PBAs). Despite PBAs being readily accessible by surgical trainees on the Intercollegiate Surgical Curriculum Project (ISCP) portal, very few delegates took the effort to revise PBAs prior to the course. We believed that non-UK graduates and not-first-time applicants reported more experience in carrying out or assisting in these procedures, therefore putting them at a higher baseline for confidence and learning. In contrast, UK-graduates and first-time applicants may have felt overwhelmed and alienated by the knowledge and technical skills required to perform a simulated task in a limited timeframe for preparation.\u003c/p\u003e \u003cp\u003eOur course utilised OSCE style learning with minimal lecture based teaching. OSCEs have been used since the 1970s in medical education to prepare healthcare students for real clinical practice in a safe environment, allow application and reinforcement of theoretical learning and real-time feedback on areas for improvement (\u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e). By emphasising a safe, non-judgemental learning environment, delegates reframe their mindset to overcome their anxiety barrier. This is due to the perception that \u0026ldquo;the stakes are not as high\u0026rdquo; in the mock environment (\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e).\u003c/p\u003e \u003cp\u003eCurrently, numerous interview preparation courses of differing formats are available in the UK. Although most courses covered similar content, they lack the practical aspect of OSCE style interviews as well as one-to-one peer mentoring during and after the course. As these teaching methods are resource intensive, most of these courses run in a pure didactic lecture format. Such passive format fails to assess the candidates understanding with little personalized feedback. In addition, most if not all other courses are run by Consultants who have not experienced the National Selection Interview as applicants. Delegates therefore experience less empathy. In contrast, this course provides immediate verbal feedback after the OSCE style interview on the first day as well as written feedback throughout both days about the candidates\u0026rsquo; performance. Faculty feedback on Day 2 to individual delegates ensures the process is holistic and unbiased. Delegates are given opportunities to reflect on their strengths and weakness throughout the course.\u003c/p\u003e \u003cp\u003eWe did not demonstrate an improvement in confidence reaching statistical difference in Professional Communication. We believed that communication skills require longer practice time extending beyond the duration of the 2-day course. Some advocate that communication skills should be taught formally especially to healthcare professionals (\u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e). In the future, we plan to expand the communication element in the course through OSCE style learning.\u003c/p\u003e \u003cp\u003eLimitations of our study include small number of cohort of 27. Confidence scores were only self-reported, with no objective scoring to correlate with the observed positive trend in confidence levels. The delegates were a self-selected group, suggesting a degree of insight and motivation in their preparation approach. Fatigue experiences by delegates during the 2-day course may also influence their self-reported scores. Finally, this study only assessed confidence which is subjective. Therefore, an improvement to the methodology would be to compare objective performance score provided by the interviewer in each station to the delegates confidence scores.\u003c/p\u003e \u003cp\u003eIn the near future, we expect a move to a digital platform due to new social distancing measures resulting from the COVID-19 pandemic. This will significantly alter the way delegates experience the course.\u003c/p\u003e "},{"header":"Conclusion","content":" \u003cp\u003eOur study concluded that peer-delivered teaching, practice and feedback delivered as a structured interview practice course can significantly improve the applicants\u0026rsquo; overall confidence levels in preparing for the UK ST3 General and Vascular Surgery National Selection. Improvement in confidence levels translates to high attrition rate of ST3 Training Posts. Communication skills require longer practice time extending beyond the duration of the 2-day course.\u003c/p\u003e \u003cp\u003e(2183 words)\u003c/p\u003e "},{"header":"Abbreviations","content":" \u003cdiv class=\"DefinitionList\"\u003e \u003cdiv class=\"DefinitionListEntry\"\u003e \u003cdiv class=\"Term\"\u003e\u003c/div\u003e \u003cdiv class=\"Description\"\u003e \u003cp\u003eST: Specialty Training; CCT:Certificate of Complete Training; HEE:Health Education England; SAC:Surgery Specialty Advisory Committees; NTN:National Training Number\u003c/p\u003e \u003c/div\u003e \u003c/div\u003e \u003c/div\u003e "},{"header":"Declarations","content":"\u003cp\u003e\u003cstrong\u003eAcknowledgements\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eWe would like to thank the Dundee Institute for Healthcare Simulation team and the course faculty members for their help in running the course. We would like to thank all of the course delegates who participated in this course for allowing us to use these data.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAuthors\u0026rsquo; contributions\u003c/strong\u003e\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003eWLC has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/li\u003e\n\u003cli\u003eMJ has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/li\u003e\n\u003cli\u003eMM has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/li\u003e\n\u003cli\u003eBT has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/li\u003e\n\u003cli\u003eBI has provided substantial contributions to the conception and design of the work; and the acquisition, analysis, and interpretation of data for the work; drafted the work and revising it critically for important intellectual content; involved in the final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved\u003c/li\u003e\n\u003c/ul\u003e\n\u003cp\u003e\u003cstrong\u003eFunding\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThere are no sources of funding required for this publication.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAvailability of data and materials\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eEthics approval and consent to participate\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eEthical approval for the delegates to participate in this study was obtained from the University Research Ethics Committee of the University of Dundee (Ref 15,240). It was advised by the ethic committee that the delegates should be informed clearly that participation in the study was purely voluntary. Verbal consent was given by the delegates to indicate that they fully understood the nature of this study and agreed to participate in this study.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eConsent for publication\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThis manuscript does not contain any individual person\u0026rsquo;s data. Participation in this study included a statement of intent to publish.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eCompeting interests\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThere are no competing interests.\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\n\u003cli\u003eNHS Health Education England. Available from: https://specialtytraining.hee.nhs.uk [Accessed 14\u003csup\u003eth\u003c/sup\u003e June 2020]\u003c/li\u003e\n\u003cli\u003eNHS Health Education England. Available from: https://specialtytraining.hee.nhs.uk/Portals/1/Content/Resource%20Bank/Competition%20Ratio%27s/Competition%20Ratios%202016.pdf [Accessed 14\u003csup\u003eth\u003c/sup\u003e June 2020]\u003c/li\u003e\n\u003cli\u003eNHS Health Education England. Available from: https://specialtytraining.hee.nhs.uk/portals/1/Content/Resource%20Bank/Competition%20Ratio%27s/Competition%20Ratios%202017%20ST3.pdf [Accessed 14\u003csup\u003eth\u003c/sup\u003e June 2020]\u003c/li\u003e\n\u003cli\u003eSiddiqui S, Siddiqui S, Mustafa Q, Rizvi AF, Hossain IT. The benefits of a peer-assisted mock PACES.\u0026nbsp;\u003cem\u003eClin Teach\u003c/em\u003e. 2018; 15(3): 221‐ Available from: doi.org/10.1111/tct.12658\u003c/li\u003e\n\u003cli\u003eSung, Y, Wu, J. The Visual Analogue Scale for Rating, Ranking and Paired-Comparison (VAS-RRP): A new technique for psychological measurement.\u0026nbsp;\u003cem\u003eBehav Res\u003c/em\u003e. 2018;\u003cstrong\u003e50,\u0026nbsp;\u003c/strong\u003e1694\u0026ndash;171. Available from: doi.org/10.3758/s13428-018-1041-8\u003c/li\u003e\n\u003cli\u003ePattinson\u0026nbsp;J,\u0026nbsp;Blow\u0026nbsp;C,\u0026nbsp;Sinha\u0026nbsp;B\u003cem\u003e, et al. \u003c/em\u003eExploring reasons for differences in performance between UK and international medical graduates in the Membership of the Royal College of General Practitioners Applied Knowledge Test: a cognitive interview study. \u003cem\u003eBMJ Open\u003c/em\u003e.2019; \u003cstrong\u003e9:\u003c/strong\u003e\u0026nbsp;Available from: doi.org/10.1136/bmjopen-2019-030341\u003c/li\u003e\n\u003cli\u003ePilotto LS, Duncan GF, Anderson-Wurf J. Issues for clinicians training international medical graduates: a systematic review.\u0026nbsp;\u003cem\u003eMed J Aust\u003c/em\u003e. 2007; 187(4): 225-228. Available from:\u003c/li\u003e\n\u003cli\u003eWhite\u0026nbsp;C.\u0026nbsp;Many CESR and CEGPR decisions take longer than the statutory three months. \u003cem\u003eBMJ\u0026nbsp;\u003c/em\u003e2012; 345: e5289\u003c/li\u003e\n\u003cli\u003eRushforth HE. Objective structured clinical examination (OSCE): review of literature and implications for nursing education.\u0026nbsp;\u003cem\u003eNurse Educ Today\u003c/em\u003e. 2007; 27(5): 481‐ Available from: doi.org/10.1016/j.nedt.2006.08.009\u003c/li\u003e\n\u003cli\u003eBrown, J. Preparation for objective structured clinical examination: a student perspective.\u003cem\u003eJ of Perioper Pract\u003c/em\u003e. 2019;\u0026nbsp;29(6), 179- 184. Available from: org/10.1177/1750458918808985\u003c/li\u003e\n\u003cli\u003eRanjan P, Kumari A, \u0026amp; Chakrawarty A. How can doctors improve their communication skills?\u0026nbsp;\u003cem\u003eJ of Clin \u003c/em\u003e\u003cem\u003eDiagn Res\u003c/em\u003e. 2015;\u0026nbsp;\u003cem\u003e9\u003c/em\u003e(3), JE01-4. Available from: doi.org/10.7860/JCDR/2015/12072.5712\u003c/li\u003e\n\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"UK Higher Surgical Training, interview course, peer-delivered tuition/feedback, mentoring, performance feedback, communication skills ","lastPublishedDoi":"10.21203/rs.3.rs-63538/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-63538/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003ch2\u003eBackground\u003c/h2\u003e \u003cp\u003eIn the United Kingdom, Core Surgical Trainees (or equivalent) undergo a rigorous National Selection (NS) process to secure a ST3 Training Post in General or Vascular Surgery. Despite a decrease in competition ratio from 3:1 in 2012 to 1.48:1 in 2017, many applicants were unable to secure ST3 Training Posts. We hypothesise that this is due to applicant performance anxiety rather than lack of clinical experience.\u003c/p\u003e\u003ch2\u003eMethods\u003c/h2\u003e \u003cp\u003eThis is a prospective observational study following 27 delegates who have completed a 2-day course consisting of didactic lecture and interactive practice with a 1:1 faculty:delegate ratio. The course was delivered by surgical consultants and trainees. A specific mentor was nominated to oversee the delegate\u0026rsquo;s progress throughout and post course. Personalised feedback was given by the entire faculty throughout the course. Delegates were asked to complete evaluation forms to track their perceived confidence levels of success at NS at different timeframes, measured by a visual analogue scale. Paired t -test was performed to compare the mean confidence level pre- and post- course.\u003c/p\u003e\u003ch2\u003eResults\u003c/h2\u003e \u003cp\u003eEvaluation forms were received from all (n\u0026thinsp;=\u0026thinsp;27) delegates. Delegate self-reported confidence increased significantly for all domains except Professional Communication. 23 (85%) of the participants were successful in the NS post course. There was no statistically significant difference between UK and non-UK graduates; and first time and not-first-time applicants.\u003c/p\u003e\u003ch2\u003eConclusions\u003c/h2\u003e \u003cp\u003ePeer-delivered teaching, practice and feedback as a structured interview practice course can significantly improve applicants\u0026rsquo; overall confidence levels in preparing for the UK ST3 General and Vascular Surgery NS. Improvement in confidence levels translates to high attrition rate of ST3 Training Posts. Communication skills require longer practice time extending beyond the duration of the 2-day course.\u003c/p\u003e","manuscriptTitle":"Impact of peer-delivered tuition/feedback on appointment to United Kingdom Higher Surgical Training","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2020-09-04 15:25:14","doi":"10.21203/rs.3.rs-63538/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"e20ac822-60c8-4306-bcaf-8ec43806db9b","owner":[],"postedDate":"September 4th, 2020","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[{"id":438443,"name":"Educational Philosophy and Theory"},{"id":438444,"name":"General Surgery"}],"tags":[],"updatedAt":"2021-01-06T16:50:37+00:00","versionOfRecord":[],"versionCreatedAt":"2020-09-04 15:25:14","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-63538","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-63538","identity":"rs-63538","version":["v1"]},"buildId":"_2-kVJe1T_tPrBINL-cwx","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}