High-Fidelity Hybrid Simulation Not Only Optimizes Skills Acquisition But Improves  Non-Technical Skills

High-Fidelity Hybrid Simulation Not Only Optimizes Skills Acquisition But Improves Non-Technical Skills | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article High-Fidelity Hybrid Simulation Not Only Optimizes Skills Acquisition But Improves Non-Technical Skills Cristián Ruz, Pablo Besa, Sebastián Irarrázaval, Catalina Vidal, and 5 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-110369/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract Introduction Knee arthrocentesis is frequently performed as a diagnostic or therapeutic procedure. Although considered a key competency for medical doctors, most students never execute the procedure during their training. We aimed to assess technical and nontechnical skills for knee arthrocentesis through high-fidelity hybrid simulation Methods Medical students and general physicians were recruited for training; orthopedic surgeons were recruited as experts. Trainees received educational documentation prior to training. Trainees took a medical history and obtained informed consent from a patient-actor, then encountered a simulated knee to execute the procedure. We adapted a direct observation scale to assess technical and nontechnical skill performance. Personalized feedback was received after each session. Performance among trainees (learning curves) and between trainees and experts was compared using a mixed-effects model. Results Trainees significantly improved from the first session to the second and third. The third session was the learning curve plateau. Performance obtained in the third and fourth sessions were similar to expert performance. The assessment tool evaluated technical and nontechnical skills with high internal consistency and showed high interobserver reliability. Discussion Learning curve analysis showed that high-fidelity simulation allowed trainees to become proficient in technical and nontechnical skills required to perform a safe knee arthrocentesis. Level of Evidence: Level II (Prospective Cohort Study) Orthopedic Surgery knee arthrocentesis medical education simulated training procedure skills nontechnical skills hybrid simulation DOPS scale Figures Figure 1 Figure 2 Introduction Knee arthrocentesis is a procedure performed to aspirate fluids or inject medications into the knee joint cavity. It can be used as a diagnostic or therapeutic procedure 1,2 . Diagnostically, knee arthrocentesis is a cornerstone in the differential diagnosis of inflammatory knee effusions 3 . As a treatment, joint injection of steroids or other medications plays a key role in the symptomatic relief of knee osteoarthritis (OA). The American Board of Orthopedic Surgery (ABOS) included arthrocentesis as a core competency for medical students 4 , meaning that they considered it a significant milestone to obtain during undergraduate medical degree formation. Other countries have also included knee arthrocentesis as a proficiency to be acquired during medical school 4,5 . In our postgraduate orthopedic program, only two of the last 16 accepted residents (13%) had performed a knee arthrocentesis at the undergraduate level. Most last-year medical students feel ill-prepared to execute the procedure 6 . Furthermore, previous studies have shown that the success rate of palpation-guided therapeutic knee arthrocentesis among orthopedic surgery residents can be as low as 55% 7,8 . Several medical education methodologies have been described to train knee arthrocentesis. These models have focused on the procedure’s technical aspects, leaving nontechnical dimensions out of the training scenario 9,10 . This leads to an incomplete and underperforming educational model 11,12 . The inclusion of nontechnical skills promotes meaningful experiences that have shown to improve learning 13 . Moreover, exclusion can induce the belief that nontechnical competencies are less relevant when approaching a patient for a procedure 13 . Additionally, previously published teaching models have lacked explicit instruments to assess trainees, limiting their reproducibility and external validity 4,10 . The aims of this study were to (1) design and implement a high-fidelity hybrid simulation scenario of knee arthrocentesis, (2) compare last-year medical students and general physicians through a four-session workshop with experts in the knee arthrocentesis procedure in a simulated environment, and (3) adapt a DOPS scale to assess technical and nontechnical skills related to knee arthrocentesis. Materials And Methods Institutional board review was obtained from the Medical Ethics Committee of the Pontifical Catholic University of Chile (Nº 190107005), in accordance with ethical guidelines. All subjects were above 18 years of age and gave informed consent. Last-year medical students and general physicians were recruited to complete four nonconsecutive training sessions in a three-month period. We recruited six orthopedic surgeons with experience in knee arthrocentesis as experts against whom we could compare trainee improvement. Five days before encountering their initial training session, trainees received instructional documentation including written directions and rationale for performing a diagnostic knee arthrocentesis, a description of the training scenario including the assessment tool used to evaluate performance in technical and nontechnical competencies, and a video describing the procedure step by step. Training scenario A high-fidelity hybrid simulation scenario was created. A patient-actor was trained with a script consisting of a 30-year-old patient arriving in the emergency department (ED) with two-day left knee pain associated with fever and joint inflammation. The patient-actor was stationed on a gurney; upon uncovering her left knee, trainees encountered a simulated knee (Sawbones©, Pacific Research Laboratories; Vashon, WA, USA). The model joint was a non-articulated knee with a partially mobile patella. On a side table, trainees had to select the required materials to perform the procedure, including hospital paperwork and informed consent. A health care assistant was posted to assist the trainee upon request but limited his participation to orders given by the trainee. During each session, trainees were required to take an abbreviated history and perform a physical examination of the patient. They had to explain the procedure and obtain written informed consent. After preparing the required implements, they had to execute the procedure and load the laboratory test tubes. Finally, they completed hospital exam forms and gave the patients postprocedure recommendations (figure 1). A single orthopedic surgeon evaluated all trainees, and sessions were recorded for secondary evaluation to determine the inter-rater reliability of the evaluation tool. We used a specific direct observation of procedural skills (DOPS) scale designed for the scenario (supplemental material files 1 and 2). After the procedure, all trainees were immediately conducted to a debriefing room to receive feedback from the surgeon who evaluated their performance. The surgeon had been previously trained to give effective feedback using the Pendleton model 13 . Feedback was also registered. Each trainee’s DOPS result constituted a point in their individual learning curve. Trainee learning curves were compared with expert performance to measure student proficiency in the training scenario. Proficiency was defined as the trainee’s ability to safely conduct the procedure with careful consideration for the patient and following the best practices outlined in the educational material they received measured through the de novo DOPS scale. 14 After feedback, each trainee completed a validated satisfaction scale. 15 This tool measured the trainees' perceptions regarding scenario realism, quality of the instructional material sent beforehand, feedback received, and perceived utility of the training session. One year after training, all participants were contacted to determine if they had performed any knee arthrocentesis. Those who had performed the procedure were given a questionnaire to measure how confident and prepared they felt to undertake the real-life procedure. Specifically, we asked if training had allowed them to perform patient consent and education, perform a safe knee arthrocentesis, fill laboratory tubes and paperwork, and explain postprocedure care to the patient. Additionally, we asked the trainees to assess the perceived utility of participating in the training sessions. DOPS adaptation and validation We adapted the new score from a DOPS previously validated in the same cultural setting 14 . The adaptation maintained the 11 items included in the original DOPS but adjusted their descriptors to assess knee arthrocentesis. We determined the content validity of the de novo DOPS by conducting a Delphi panel composed by experts in Orthopedic Surgery, Rheumatology and Emergency Medicine. Ratings and commentaries for each item were registered, and modifications were made for repeat expert assessment. We repeated expert consultation through the Delphi panel until we obtained at least 80% agreement on all items. With the second evaluation performed by another orthopedic surgeon, inter-rater reliability was assessed 19 . Validity analysis was carried out with DOPS scale applications in consecutive sessions for each trainee. The construct validity was determined through an exploratory and confirmatory factor analysis. The exploratory factor analysis detected latent variables or constructs underlying the base of the observed variables 20-21 . A confirmatory factor analysis was further performed to validate the factor structure identified in the prior exploratory analysis 21 . Statistical analysis Adaptation and validation of the DOPS scale Inter-rater reliability was measured with the weighted Kappa (wK) coefficient. Levels of agreement for wK were determined as proposed by Landis et al., considering wK values 0.00–0.20 as slight agreement; 0.21–0.40, fair agreement; 0.41–0.60, moderate agreement; 0.61–0.80, substantial agreement; and 0.81–1.00, almost perfect agreement 15 . In the exploratory factor analysis, the number of factors (or dimensions) was selected considering the Kaiser–Guttman 22 and Cattell 23 criteria. Thus, the factors with Eigenvalue above one, and those above the inflection point in the scree plot were retained. The determination coefficient (R 2 ) was estimated to quantify the percentage of the scale's items' variance explained by the two factors identified in the exploratory analysis. Internal consistency for each dimension detected in factor analysis was performed using Cronbach’s Alpha. Learning curve analysis A mixed-effects/multilevel model with a random intercept was constructed to study differences in consecutive DOPS results of each trainee. The use of multilevel models was based on the fact that each trainee's performance was assessed in repeated training sessions. Thus, as DOPS scores in consecutive sessions for the same subject are compared, a correlation among them is expected, producing biased estimates of the standard errors and confidence intervals. Mixed-effects/multilevel models can be used to obtain standard errors that take the clustering within subjects into account. Multilevel statistical modeling enables quantitative analysis of learning curves and has been proven to have higher statistical power than conventional repeated-measures analysis of variance (ANOVA) 16 . This statistical method has also been used in previous research to analyze how trainees acquire skills 29-31 . Given that residuals of the mixed-effects model did not have a normal distribution, the standard error was estimated using bootstrapping (10,000 replications). Thus, a 95% confidence interval (95% CI) was obtained using the bias-corrected and accelerated method. Mean scores and 95% CI were expressed for each training session. All analyses were conducted on Stata version 16 (StataCorp. 2019. Stata Statistical Software: Release 16. College Station, TX: StataCorp LLC). Results Adaptation and validation of the DOPS scale A Delphi panel composed of 17 orthopedic surgeons, four rheumatologists and two emergency department physicians. They received the 11-item DOPS with knee arthrocentesis descriptors. Two rounds were necessary to obtain over 80% agreement on every item. In the exploratory factor analysis, two factors (or dimensions) with an Eigenvalue greater than one were identified (bi-dimensional). These factors explained 91.7% of the variance observed in the de novo DOPS, and they could be classified into a technical domain (two items) and a nontechnical domain (nine items). Regarding the confirmatory factor analysis, all standardized factor loadings were above 0.3 (cut-off point) and statistically significant. The R 2 fluctuated between 0.28 (item one) and 0.93 (item ten). It means that at least 93% of the variability of item ten’ scores was explained by the factor identified. Internal consistency for each dimension was α=0.86 in the technical domain and α=0.70 in the nontechnical domain. Interrater reliability was almost perfect (wK 0.87). Learning curve analysis Twenty-eight trainees were recruited (10 last-year medical students and 18 general physicians). Only two of them (7%; both general physicians) had performed a single knee arthrocentesis prior to the training sessions. We also recruited six orthopedic surgeons to serve as experts. Performance significantly improved between the first session (mean score 5.89 [95% CI 5.70-6.07]) and second session (mean score 6.51 [95% CI 6.30-6.72]; p<0.01) and between the second and third session (mean score 6.80 [95% CI 6.59-7.00]; p<0.05). We found no difference between the third session and the fourth (mean score 6.78 [95% CI 6.48-7.00]; p=0.94) (figure 2). The second mixed-effects model was designed to compare each trainee session with the performance of the six expert orthopedic surgeons. We found that surgeons had a significantly higher mean score in their session (mean score 6.94 [95% CI 6.88-7.00]) than trainees did in their first (p<0.01), and second session (p<0.01). The third and fourth trainee sessions did not differ significantly with the experts’ performance (p=0.21 and 0.31, respectively). Training satisfaction survey and follow-up After debriefing, 24 of the 28 trainees (85%) answered a questionnaire to evaluate the training experience. They all agreed that (1) the instructional material they received prior to the training sessions was useful, (2) the training scenario allowed them adequate training, (3) they perceived the feedback received as useful, (4) the assessment tool allowed them to focus on improving specific tasks, (5) the addition of a clinical case at the beginning improved scenario fidelity, and (6) the use of a trained patient-actor allowed improvement of nontechnical (communication) skills. The only question that received less than 100% of agreement was the perception that the knee model used was realistic (only 19 of 24 agreed; 80%). Seven of the 28 trainees (25%) had performed a real-patient knee arthrocentesis by the one-year follow-up. All of the students thought that the training was useful and allowed them to perform the procedure safely. They felt confident regarding patient consent and education, performing the procedure and explaining postprocedure cares to the patient. The only item where two trainees (29%) felt insecure was selecting the correct laboratory tubes and completing paperwork. Discussion Our high-fidelity simulation scenario allowed student trainees to improve the technical and nontechnical skills required to perform a safe knee arthrocentesis. A key to training and learning is repetition. Previous studies have focused on proving differences between students prior to training and after training 4,10 or on measuring satisfaction after a single use 17 . Repeated training and evaluation increase student performance and avoid jumping to conclusions that could be due to chance 18,19 . This is the first study to determine how many training sessions are required to achieve proficiency in knee arthrocentesis. Students’ learning curves showed a learning plateau after three sessions. Measuring the fourth session allowed us to confirm that performance was sustained and not just a one-session peak 18 . The short learning curve could be explained by the detailed training documentation received prior to the sessions, the direct observation scale known to the trainees, and personalized feedback received after each session that allowed the trainees to focus on their mistakes and gave them advice on how to improve. This learning curve behavior is related to obtaining a proficiency in the scenario. Obtaining an expertise in knee arthrocentesis requires experience and hence is not obtainable in a brief simulated training course 20 . Teaching combined technical and nontechnical abilities has also proven to be effective through simulation 13,21 . Simulated procedures and situations offer a structured teaching method that is replicable, objective, and safe (for the patient and student) 22,23 . The inclusion of nontechnical aspects to a procedure usually considered technical has many proven benefits 13 . First, it allows for the teaching and learning of nontechnical aspects that are usually left out of technical training. Doctor-patient communication plays a key role in their relationship and in ideal clinical practice 24 . Furthermore, communication and nontechnical skills have been proven trainable 25 . Second, including these skills allowed us to incorporate the written consent as part of the procedure. The task of explaining the risks, benefits, and steps of the procedure to the patients helped our trainees incorporate significant theoretical concepts of knee arthrocentesis. Finally, as mentioned previously, hybrid training based on clinical scenarios adds meaning to the interaction. The presence of a real patient-actor increases the stakes for the student while remaining teaching friendly. This method has been proven to improve the learning experience 26 . Nontechnical aspects had not been trained in previous studies regarding knee arthrocentesis 9,10,17 . In our study, the nontechnical dimension also improved between training sessions. The scenario required creating an adaptation of a direct observation of procedure skills (DOPS) scale that proved to be consistent, reliable, and useful for trainee learning (assessment for learning) 27,28 . Designing a simulated training scenario requires an objective measurement tool. Other studies have used generic observation tools or unvalidated checklists 29 . The main limitation for the use of a non-procedure-specific tool is that it lacks the nuance of the procedure and certainly does not incorporate nontechnical skills, limiting specific item-by-item feedback and therefore improvement. We decided to adapt a similar tool. Delfino et al. had already created a direct observation tool for a specific technical procedure (tracheal intubation) including nontechnical skills in their tool 14 . We decided to adapt the scale, maintaining the 11 items but changing the descriptors used in each of them. First, we determined that the tool had internal consistency and external reliability (among observers). This determination is important because it assures the reproducibility of our results 30,31 . The tool we created also proved to be bidimensional. Obtaining two dimensions through exploratory and confirmatory factor analysis reaffirmed the notion that we were measuring technical and nontechnical competencies in the same procedure. Finally, we decided to make the DOPS scale available to trainees prior to the sessions. Traditionally, training and teaching scenarios prefer to maintain the items and descriptors of the scale away from the students. The use of the assessment tool for session preparation improves understanding of the key elements of each step, allowing students to learn from the assessment tool, thereby streamlining feedback and improvement 32 . This improvement might help explain the high initial rating for trainees' first session (mean score 5.89) and probably contributed to the steep learning curve they followed. A one-year follow-up found that trainees had performed the real-life procedures confidently given the abilities trained. Student perception has been proven to impact learning 33 . Positive perception leads to improved performance and increases the completion of training programs 34 ( 34 Kirkpatrick and Kirkpatrick)(34)343434. Our scenario had a positive trainee perception just after training and one-year posttraining. Trainees positively valued the feedback given to them in the debriefing room. The feedback was structured, and the surgeon giving the feedback received prior training regarding feedback structure and technique. We believe our experience and the previous literature 35–37 make the inclusion of personalized feedback a key element in simulated training. One of our main limitations was that the training sessions were not evenly spaced between students nor for single students. This is a frequent limitation when training has no curricular integration. After its initial success, the program will be included in student training, allowing for sessions at regular intervals. Secondarily, although subjective trainee evaluations rated the model favorably, the knee model used is relatively simple and did not allow the students to scope the impact knee variability has on increasing arthrocentesis difficulty. In this research, we have opted to apply multilevel statistical models to consider repeated measures obtained from each trainee and compare groups. Therefore, by using multilevel models, differences in DOPS performances between sessions, and among trainees and experts could be obtained. Identifying the point in the learning curve where the slope flattens out (inflection point) is critical 27 . This point represents a progressively higher effort to achieve trainees' learning gains before reaching a performance level similar to an expert 27 . Thus, using this statistical approach, we could graphically represent the learning curves and identified their critical points. Future research could be conducted incorporating an interaction between individual-level (e.g., last year medical student versus a specialist resident) and group-level variables (e.g., different simulations scenarios) through multilevel statistical models. Conclusion A high-fidelity simulation scenario allowed student trainees to improve the technical and nontechnical skills required to perform a safe knee arthrocentesis. After three training sessions, the trainee performance was similar to the experts we assessed. The scenario required creating an adaptation of a direct observation of procedure skills (DOPS) scale that proved to be consistent and reliable. Declarations Data availability The datasets generated during and analysed during the current study are available from the corresponding author upon request. Author Contributions CR: Substantial contributions to the conception of the work, the acquisition, analysis, and interpretation of data for the work; drafting the work; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. SI: Substantial contributions to the design of the work, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. PB: Substantial contributions to the conception and design of the work, the acquisition, analysis, and interpretation of data for the work; drafting the work; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. CV: Substantial contributions to the design of the work, the acquisition, analysis, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. CN: Substantial contributions to the design of the work, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. JV: Substantial contributions to the design of the work, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. IV: Substantial contributions to the design of the work, and analysis of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. EF: Substantial contributions to the design of the work, and analysis of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. AR: Substantial contributions to the design of the work, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. References Shimizu M, Higuchi H, Takagishi K, Shinozaki T, Kobayashi T. Clinical and biochemical characteristics after intra-articular injection for the treatment of osteoarthritis of the knee: Prospective randomized study of sodium hyaluronate and corticosteroid. J Orthop Sci. 2010;15(1):51–6. Sánchez M, Anitua E, Azofra J, Aguirre JJ, Andia I. Intra-articular injection of an autologous preparation rich in growth factors for the treatment of knee OA: A retrospective cohort study. Clin Exp Rheumatol. 2008;26:910–3. Margaretten ME, Kohlwes J, Moore D, Bent S. Does This Adult Patient Have Septic Arthritis? JAMA. 2007;297(13):1478–88. Seeley MA, Kazarian E, King B, Biermann JS, Carpenter JE, Caird MS, et al. Core concepts: Orthopedic intern curriculum boot camp. Orthopedics. 2016;39(1):e62–7. Altamirano P, Gonzalez R, Hanne C, Moreno R, Muñoz M, Pantoja MA. Perfil de Conocimientos EUNACOM. Segunda versión [Internet]. 2010;2:59. Available from: http://www.eunacom.cl/contenidos/PerfilNew.pdf Telias N. A, Innocenti D. P, Orrego G. F, Oliver C. N, Huidobro D. B, Orrego L. M. Evaluación de percepción de conocimientos y destrezas de alumnos de medicina en traumatología y ortopedia. Rev chil ortop traumatol. 2011;52(2):63–70. Curtiss HM, Finnoff JT, Peck E, Hollman J, Muir J, Smith J. Accuracy of Ultrasound-Guided and Palpation-Guided Knee Injections By an Experienced and Less-Experienced Injector Using a Superolateral Approach: A Cadaveric Study. PM R. 2011;3(6):507–15. Jackson DW, Evans NA, Thomas BM. Accuracy of needle placement into the intra-articular space of the knee. J Bone Jt Surg - Ser A. 2002;84–A:1522–7. Waikakul S, Chumtup W, Chotivichit A, Vanadurongwan B, Assawamongkolgul A, Rojanawanich V. A knee model for arthrocentesis simulation. J Med Assoc Thail. 2003;86(3):282–7. Chiowchanwisawakit P, Ratanarat R, Srinonprasert V. Improving sixth year medical students’ performance in knee arthrocentesis using a synthetic knee model. Int J Rheum Dis. 2015;18(7):742–50. Greenberg CC, Regenbogen SE, Studdert DM, Lipsitz SR, Rogers SO, Zinner MJ, et al. Patterns of Communication Breakdowns Resulting in Injury to Surgical Patients. J Am Coll Surg. 2007;204(4):533–40. Yule S, Flin R, Maran N, Rowley D, Youngson G, Paterson-Brown S. Surgeons’ non-technical skills in the operating room: Reliability testing of the NOTSS behavior rating system. World J Surg. 2008;32(4):548–56. Moulton C anne, Tabak D, Kneebone R, Nestel D, MacRae H, LeBlanc VR. Teaching communication skills using the integrated procedural performance instrument (IPPI): A randomized controlled trial. Am J Surg. 2009;197:113–8. Pendleton D, Schofield T, Tate P HP. The consultation: An Press, approach to learning and teaching. Oxford: Oxford University; 2003. Ramani S, Krackov SK. Twelve tips for giving feedback effectively in the clinical environment. Med Teach. 2012;34(10):787–91. Carraccio CL, Benson BJ, Nixon LJ, Derstine PL. From the educational bench to the clinical bedside: Translating the Dreyfus developmental model to the learning of clinical skills. Acad Med. 2008;83(8):761–7. Villagrán I, Tejos R, Chahuán J, Uslar T, Pizarro M, Varas J, et al. Percepción de estudiantes de pregrado de Medicina de talleres de simulación de procedimientos médico-quirúrgicos. 2018;146:649–58. Delfino AE, Chandratilake M, Altermatt FR, Delfino AE, Chandratilake M, Altermatt FR. Validation and piloting of direct observation of practical skills tool to assess intubation in the Chilean context Validation and piloting of direct observation of practical skills tool to assess intubation in the Chilean context. Med Teach. 2013;35:231–6. Landis JR, Koch GG. Landis amd Koch1977_agreement of categorical data. Biometrics. 1977;33(1):159–74. Memtsoudis SG. Beyond Repeated-Measures Analysis of Variance Data in Anesthesia Research. 2012;37(1):99–105. Berman JR, Ben-Artzi A, Fisher MC, Bass AR, Pillinger MH. A comparison of arthrocentesis teaching tools: Cadavers, synthetic joint models, and the relative utility of different educational modalities in improving Trainees’ comfort with procedures. J Clin Rheumatol. 2012;18(4):175–9. Hopper AN, Jamison MH, Lewis WG. Learning curves in surgical practice. Postgr Med J. 2007;83:777–9. Varas J, Mejía R, Riquelme A, Maluenda F, Buckel E, Salinas J, et al. Significant transfer of surgical skills obtained with an advanced laparoscopic training program to a laparoscopic jejunojejunostomy in a live porcine model: Feasibility of learning advanced laparoscopy in a general surgery residency. Surg Endosc Other Interv Tech. 2012;26(12):3486–94. LeBlanc VR, Tabak D, Kneebone R, Nestel D, MacRae H, Moulton CA. Psychometric properties of an integrated assessment of technical and communication skills. Am J Surg [Internet]. 2009;197(1):96–101. Atesok K, Mabrey JD, Jazrawi LM, Egol KA. Surgical simulation in orthopaedic skills training. J Am Acad Orthop Surg. 2012;20(7):410–22. Corvetto M, Bravo MP, Montaña R, Utili F, Escudero E, Boza C, et al. Simulación en educación médica: una sinopsis. Rev Med Chil [Internet]. 2013;141(1):70–9 Berner JE, Ewertz E. The importance of non-technical skills in modern surgical practice. Cir Esp. 2019;97(4):190–5. Ranjan P, Kumari A, Chakrawarty A. How can doctors improve their communication skills? J Clin Diagnostic Res. 2015;9(3):1–4. Stroud L, Cavalcanti RB. Hybrid simulation for knee arthrocentesis: Improving fidelity in procedures training. J Gen Intern Med. 2013;28(5):723–7. Epstein RM. Medical education - Assessment in medical education. N Engl J Med. 2007;356(4):387–96. Naeem N. Validity, reliability, feasibility, acceptability and educational impact of direct observation of procedural skills (DOPS). J Coll Physicians Surg. 2013;23(1):77–82. Downing SM. Validity: On the meaningful interpretation of assessment data. Medical Education. 2003. p. 37;830-837. Downing SM. the metric of medical education Reliability : on the reproducibility of assessment data. Med Educ. 2004;38:1006–12. Khan KZ, Ramachandran S, Gaunt K. The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part I: An historical and theoretical perspective. Med Teach. 2016;35(81):1437–46. Lockyer J, Carraccio C, Chan M, Hart D, Smee S, Touchie C, et al. Core principles of assessment in competency- based medical education. 2017;39(6):609–16. Schuwirth LWT, Van der Vleuten CPM. Programmatic assessment: From assessment of learning to assessment for learning. Med Teach [Internet]. 2011;33(6):478–85. Available from: http://www.tandfonline.com/doi/full/10.3109/0142159X.2011.565828 Johnston S, Coyer FM, Nash R. Kirkpatrick’s evaluation of simulation and debriefing in health care education: A systematic review. J Nurs Educ. 2018;57(7):393–8. Kirkpatrick, Donald L. Evaluating Training Programs: the Four Levels. 3 rd edition. San Francisco: Emeryville, CA: Berrett-Koehler; Publishers Group West, 1994. p 52 – 62 Norcini J, Burch V. 31 Workplace-based assessment as an educational tool: AMEE Guide. Med Teach. 2007;29(9–10):855–71. Herrmann-Werner A, Nikendei C, Keifenheim K, Bosse HM, Lund F, Wagner R, et al. “Best Practice” Skills Lab Training vs. a “see one, do one” Approach in Undergraduate Medical Education: An RCT on Students’ Long-Term Ability to Perform Procedural Clinical Skills. PLoS One. 2013;8(9):e76354. Farquharson AL, Cresswell AC, Beard JD, Chan P. Randomized trial of the effect of video feedback on the acquisition of surgical skills. Br J Surg. 2013;100:1448–53. Supplementary Files Supplemental1.pdf Supplemental File 1 Final direct observation of procedure skills scale used, Spanish (original) version Supplemental2.pdf Supplemental File 2 Final direct observation of procedure skills scale used, English (translation) version Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-110369","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":5375207,"identity":"272d8203-4759-4cf9-b100-b2e6f1767afa","order_by":0,"name":"Cristián Ruz","email":"","orcid":"","institution":"Pontifical Catholic University of Chile","correspondingAuthor":false,"prefix":"","firstName":"Cristián","middleName":"","lastName":"Ruz","suffix":""},{"id":5375208,"identity":"03f54f5d-c423-4a68-b05f-43c742c92bb7","order_by":1,"name":"Pablo Besa","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA1klEQVRIiWNgGAWjYFACHsYDjA1Amh1EGFgQpYUBooXnAEiLBClaJBJAPCK0mLOfPXDg4w4be/6Zz69u+FEgwcDf3p2AV4tlT17CwZln0hJn3M4pu9kDdJjEmbMb8GoxOJBjcJi37XACw+2ctBs8QC0GErkEtJx/A9Ly317+5pm0m3+I0nIDbMsBxg032I/dJsoWyxnvQH5JTtx4JofttoyBBA9Bv5jz5x588HGHnb3c8ePPbr75YyPH395LwGEIJg+YzYNXOZoW9gcEVY+CUTAKRsHIBAA/mE+SAtxUbgAAAABJRU5ErkJggg==","orcid":"","institution":"Pontifical Catholic University of Chile","correspondingAuthor":true,"prefix":"","firstName":"Pablo","middleName":"","lastName":"Besa","suffix":""},{"id":5375209,"identity":"f98b536f-6276-4c2f-a07b-9daa260fe0d1","order_by":2,"name":"Sebastián Irarrázaval","email":"","orcid":"","institution":"Pontifical Catholic University of Chile","correspondingAuthor":false,"prefix":"","firstName":"Sebastián","middleName":"","lastName":"Irarrázaval","suffix":""},{"id":5375210,"identity":"161cee65-5414-4ab3-be7e-d630df9986d8","order_by":3,"name":"Catalina Vidal","email":"","orcid":"","institution":"Pontifical Catholic University of Chile","correspondingAuthor":false,"prefix":"","firstName":"Catalina","middleName":"","lastName":"Vidal","suffix":""},{"id":5375211,"identity":"36a608b8-843c-4011-bf51-cd7c64b84f0b","order_by":4,"name":"Claudio Nazar","email":"","orcid":"","institution":"Pontifical Catholic University of Chile","correspondingAuthor":false,"prefix":"","firstName":"Claudio","middleName":"","lastName":"Nazar","suffix":""},{"id":5375212,"identity":"6549ce03-f1e1-4cec-a91b-3a214c923b90","order_by":5,"name":"Julián Varas","email":"","orcid":"","institution":"Pontifical Catholic University of Chile","correspondingAuthor":false,"prefix":"","firstName":"Julián","middleName":"","lastName":"Varas","suffix":""},{"id":5375213,"identity":"d981c7c3-c146-479b-a7c7-a301e07dbd4b","order_by":6,"name":"Ignacio Villagrán","email":"","orcid":"","institution":"Pontifical Catholic University of Chile","correspondingAuthor":false,"prefix":"","firstName":"Ignacio","middleName":"","lastName":"Villagrán","suffix":""},{"id":5375214,"identity":"97e10cf6-31d0-4c65-a162-17c8064ac892","order_by":7,"name":"Eduardo Fuentes-López","email":"","orcid":"","institution":"Pontifical Catholic University of Chile","correspondingAuthor":false,"prefix":"","firstName":"Eduardo","middleName":"","lastName":"Fuentes-López","suffix":""},{"id":5375215,"identity":"633165ff-0fd2-4cee-85e4-502dccb70ce2","order_by":8,"name":"Arnoldo Riquelme","email":"","orcid":"","institution":"Pontifical Catholic University of Chile","correspondingAuthor":false,"prefix":"","firstName":"Arnoldo","middleName":"","lastName":"Riquelme","suffix":""}],"badges":[],"createdAt":"2020-11-17 16:59:01","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-110369/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-110369/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":3958594,"identity":"9febb0fa-0a2b-43d2-8bdd-0debe94815ba","added_by":"auto","created_at":"2020-12-02 17:43:56","extension":"jpg","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":725255,"visible":true,"origin":"","legend":"Illustration showing key steps of the training scenario following the medical history and informed consent: (a) selecting required materials; (b) sterile environment preparation; (c) patient and skin preparation; (d) puncture site selection; (e) puncture and fluid extraction; and (f) tube filling and paperwork.","description":"","filename":"Figure1.jpg","url":"https://assets-eu.researchsquare.com/files/rs-110369/v1/3667e0b51296ad30fdf14ec8.jpg"},{"id":3958596,"identity":"e6238def-2127-41ac-a92a-073bbbcac52d","added_by":"auto","created_at":"2020-12-02 17:43:56","extension":"jpg","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":128501,"visible":true,"origin":"","legend":"Mean performance and standard error (vertical axis) for each trainee session (one through four of the horizontal axis) and the experts’ performance (“Experts” on the horizontal axis)","description":"","filename":"Figure2.jpg","url":"https://assets-eu.researchsquare.com/files/rs-110369/v1/43bf908b0bdeea42440c6d07.jpg"},{"id":13622538,"identity":"7748b17f-b2c8-4642-ac6c-bc4fb3244734","added_by":"auto","created_at":"2021-09-17 07:15:12","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":395676,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-110369/v1/d727c834-4c16-4a8d-b4c7-1391f23be026.pdf"},{"id":3958595,"identity":"e614a9bf-1573-472b-af4b-8b027d070aed","added_by":"auto","created_at":"2020-12-02 17:43:56","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"supplement","size":56385,"visible":true,"origin":"","legend":"Supplemental File 1 Final direct observation of procedure skills scale used, Spanish (original) version","description":"","filename":"Supplemental1.pdf","url":"https://assets-eu.researchsquare.com/files/rs-110369/v1/c920f3fd8a1e80fd42c26114.pdf"},{"id":3958597,"identity":"812eae61-9081-47e4-a978-77120b985b52","added_by":"auto","created_at":"2020-12-02 17:43:57","extension":"pdf","order_by":2,"title":"","display":"","copyAsset":false,"role":"supplement","size":56166,"visible":true,"origin":"","legend":"Supplemental File 2 Final direct observation of procedure skills scale used, English (translation) version","description":"","filename":"Supplemental2.pdf","url":"https://assets-eu.researchsquare.com/files/rs-110369/v1/4edebb7e6a4ab40c234e8112.pdf"}],"financialInterests":"","formattedTitle":"High-Fidelity Hybrid Simulation Not Only Optimizes Skills Acquisition But Improves Non-Technical Skills","fulltext":[{"header":"Introduction","content":"\u003cp\u003eKnee arthrocentesis is a procedure performed to aspirate fluids or inject medications into the knee joint cavity. It can be used as a diagnostic or therapeutic procedure\u003csup\u003e1,2\u003c/sup\u003e. Diagnostically, knee arthrocentesis is a cornerstone in the differential diagnosis of inflammatory knee effusions\u003csup\u003e3\u003c/sup\u003e. As a treatment, joint injection of steroids or other medications plays a key role in the symptomatic relief of knee osteoarthritis (OA).\u003c/p\u003e\n\u003cp\u003eThe American Board of Orthopedic Surgery (ABOS) included arthrocentesis as a core competency for medical students\u003csup\u003e4\u003c/sup\u003e, meaning that they considered it a significant milestone to obtain during undergraduate medical degree formation. Other countries have also included knee arthrocentesis as a proficiency to be acquired during medical school\u003csup\u003e4,5\u003c/sup\u003e. In our postgraduate orthopedic program, only two of the last 16 accepted residents (13%) had performed a knee arthrocentesis at the undergraduate level. Most last-year medical students feel ill-prepared to execute the procedure\u003csup\u003e6\u003c/sup\u003e. Furthermore, previous studies have shown that the success rate of palpation-guided therapeutic knee arthrocentesis among orthopedic surgery residents can be as low as 55%\u003csup\u003e7,8\u003c/sup\u003e.\u003c/p\u003e\n\u003cp\u003eSeveral medical education methodologies have been described to train knee arthrocentesis. These models have focused on the procedure\u0026rsquo;s technical aspects, leaving nontechnical dimensions out of the training scenario\u003csup\u003e9,10\u003c/sup\u003e. This leads to an incomplete and underperforming educational model\u003csup\u003e11,12\u003c/sup\u003e. The inclusion of nontechnical skills promotes meaningful experiences that have shown to improve learning\u003csup\u003e13\u003c/sup\u003e. Moreover, exclusion can induce the belief that nontechnical competencies are less relevant when approaching a patient for a procedure\u003csup\u003e13\u003c/sup\u003e. Additionally, previously published teaching models have lacked explicit instruments to assess trainees, limiting their reproducibility and external validity\u003csup\u003e4,10\u003c/sup\u003e.\u003c/p\u003e\n\u003cp\u003eThe aims of this study were to (1) design and implement a high-fidelity hybrid simulation scenario of knee arthrocentesis, (2) compare last-year medical students and general physicians through a four-session workshop with experts in the knee arthrocentesis procedure in a simulated environment, and (3) adapt a DOPS scale to assess technical and nontechnical skills related to knee arthrocentesis.\u003c/p\u003e"},{"header":"Materials And Methods","content":"\u003cp\u003eInstitutional board review was obtained from the Medical Ethics Committee of the Pontifical Catholic University of Chile (N\u0026ordm; 190107005), in accordance with ethical guidelines. All subjects were above 18 years of age and gave informed consent. Last-year medical students and general physicians were recruited to complete four nonconsecutive training sessions in a three-month period. We recruited six orthopedic surgeons with experience in knee arthrocentesis as experts against whom we could compare trainee improvement. Five days before encountering their initial training session, trainees received instructional documentation including written directions and rationale for performing a diagnostic knee arthrocentesis, a description of the training scenario including the assessment tool used to evaluate performance in technical and nontechnical competencies, and a video describing the procedure step by step.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cem\u003eTraining scenario\u003c/em\u003e\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eA high-fidelity hybrid simulation scenario was created. A patient-actor was trained with a script consisting of a 30-year-old patient arriving in the emergency department (ED) with two-day left knee pain associated with fever and joint inflammation. The patient-actor was stationed on a gurney; upon uncovering her left knee, trainees encountered a simulated knee (Sawbones\u0026copy;, Pacific Research Laboratories; Vashon, WA, USA). The model joint was a non-articulated knee with a partially mobile patella. On a side table, trainees had to select the required materials to perform the procedure, including hospital paperwork and informed consent. A health care assistant was posted to assist the trainee upon request but limited his participation to orders given by the trainee. During each session, trainees were required to take an abbreviated history and perform a physical examination of the patient. They had to explain the procedure and obtain written informed consent. After preparing the required implements, they had to execute the procedure and load the laboratory test tubes. Finally, they completed hospital exam forms and gave the patients postprocedure recommendations (figure 1). A single orthopedic surgeon evaluated all trainees, and sessions were recorded for secondary evaluation to determine the inter-rater reliability of the evaluation tool. We used a specific direct observation of procedural skills (DOPS) scale designed for the scenario (supplemental material files 1 and 2). After the procedure, all trainees were immediately conducted to a debriefing room to receive feedback from the surgeon who evaluated their performance. The surgeon had been previously trained to give effective feedback using the Pendleton model\u003csup\u003e13\u003c/sup\u003e. Feedback was also registered. Each trainee\u0026rsquo;s DOPS result constituted a point in their individual learning curve. Trainee learning curves were compared with expert performance to measure student proficiency in the training scenario. Proficiency was defined as the trainee\u0026rsquo;s ability to safely conduct the procedure with careful consideration for the patient and following the best practices outlined in the educational material they received measured through the \u003cem\u003ede novo \u003c/em\u003eDOPS scale.\u003csup\u003e14\u003c/sup\u003e\u003c/p\u003e\n\u003cp\u003eAfter feedback, each trainee completed a validated satisfaction scale.\u003csup\u003e15\u003c/sup\u003e This tool measured the trainees' perceptions regarding scenario realism, quality of the instructional material sent beforehand, feedback received, and perceived utility of the training session. One year after training, all participants were contacted to determine if they had performed any knee arthrocentesis. Those who had performed the procedure were given a questionnaire to measure how confident and prepared they felt to undertake the real-life procedure. Specifically, we asked if training had allowed them to perform patient consent and education, perform a safe knee arthrocentesis, fill laboratory tubes and paperwork, and explain postprocedure care to the patient. Additionally, we asked the trainees to assess the perceived utility of participating in the training sessions.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cem\u003eDOPS adaptation and validation\u003c/em\u003e\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eWe adapted the new score from a DOPS previously validated in the same cultural setting\u003csup\u003e14\u003c/sup\u003e. The adaptation maintained the 11 items included in the original DOPS but adjusted their descriptors to assess knee arthrocentesis. We determined the content validity of the \u003cem\u003ede novo \u003c/em\u003eDOPS by conducting a Delphi panel composed by experts in Orthopedic Surgery, Rheumatology and Emergency Medicine. Ratings and commentaries for each item were registered, and modifications were made for repeat expert assessment. We repeated expert consultation through the Delphi panel until we obtained at least 80% agreement on all items.\u003c/p\u003e\n\u003cp\u003eWith the second evaluation performed by another orthopedic surgeon, inter-rater reliability was assessed\u003csup\u003e19\u003c/sup\u003e. Validity analysis was carried out with DOPS scale applications in consecutive sessions for each trainee. The construct validity was determined through an exploratory and confirmatory factor analysis. The exploratory factor analysis detected latent variables or constructs underlying the base of the observed variables\u003csup\u003e20-21\u003c/sup\u003e. A confirmatory factor analysis was further performed to validate the factor structure identified in the prior exploratory analysis\u003csup\u003e21\u003c/sup\u003e.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cem\u003eStatistical analysis\u003c/em\u003e\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cem\u003eAdaptation and validation of the DOPS scale\u003c/em\u003e\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eInter-rater reliability was measured with the weighted Kappa (wK) coefficient. Levels of agreement for wK were determined as proposed by Landis et al., considering wK values 0.00\u0026ndash;0.20 as slight agreement; 0.21\u0026ndash;0.40, fair agreement; 0.41\u0026ndash;0.60, moderate agreement; 0.61\u0026ndash;0.80, substantial agreement; and 0.81\u0026ndash;1.00, almost perfect agreement \u003csup\u003e15\u003c/sup\u003e.\u003c/p\u003e\n\u003cp\u003eIn the exploratory factor analysis, the number of factors (or dimensions) was selected considering the Kaiser\u0026ndash;Guttman\u003csup\u003e22\u003c/sup\u003e and Cattell\u003csup\u003e23\u003c/sup\u003e criteria. Thus, the factors with Eigenvalue above one, and those above the inflection point in the scree plot were retained. The determination coefficient (R\u003csup\u003e2\u003c/sup\u003e) was estimated to quantify the percentage of the scale's items' variance explained by the two factors identified in the exploratory analysis. Internal consistency for each dimension detected in factor analysis was performed using Cronbach\u0026rsquo;s Alpha.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cem\u003eLearning curve analysis\u003c/em\u003e\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eA mixed-effects/multilevel model with a random intercept was constructed to study differences in consecutive DOPS results of each trainee. The use of multilevel models was based on the fact that each trainee's performance was assessed in repeated training sessions. Thus, as DOPS scores in consecutive sessions for the same subject are compared, a correlation among them is expected, producing biased estimates of the standard errors and confidence intervals. Mixed-effects/multilevel models can be used to obtain standard errors that take the clustering within subjects into account. Multilevel statistical modeling enables quantitative analysis of learning curves and has been proven to have higher statistical power than conventional repeated-measures analysis of variance (ANOVA)\u003csup\u003e16\u003c/sup\u003e. This statistical method has also been used in previous research to analyze how trainees acquire skills\u003csup\u003e29-31\u003c/sup\u003e.\u003c/p\u003e\n\u003cp\u003eGiven that residuals of the mixed-effects model did not have a normal distribution, the standard error was estimated using bootstrapping (10,000 replications). Thus, a 95% confidence interval (95% CI) was obtained using the bias-corrected and accelerated method. Mean scores and 95% CI were expressed for each training session.\u003c/p\u003e\n\u003cp\u003eAll analyses were conducted on Stata version 16 (StataCorp. 2019. Stata Statistical Software: Release 16. College Station, TX: StataCorp LLC).\u003c/p\u003e"},{"header":"Results","content":"\u003cp\u003e\u003cstrong\u003e\u003cem\u003eAdaptation and validation of the DOPS scale\u003c/em\u003e\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eA Delphi panel composed of 17 orthopedic surgeons, four rheumatologists and two emergency department physicians. They received the 11-item DOPS with knee arthrocentesis descriptors. Two rounds were necessary to obtain over 80% agreement on every item.\u003c/p\u003e\n\u003cp\u003eIn the exploratory factor analysis, two factors (or dimensions) with an Eigenvalue greater than one were identified (bi-dimensional). These factors explained 91.7% of the variance observed in the \u003cem\u003ede novo \u003c/em\u003eDOPS, and they could be classified into a technical domain (two items) and a nontechnical domain (nine items). Regarding the confirmatory factor analysis, all standardized factor loadings were above 0.3 (cut-off point) and statistically significant. The \u003cem\u003eR\u003csup\u003e2\u003c/sup\u003e\u003c/em\u003e fluctuated between 0.28 (item one) and 0.93 (item ten). It means that at least 93% of the variability of item ten\u0026rsquo; scores was explained by the factor identified. Internal consistency for each dimension was \u0026alpha;=0.86 in the technical domain and \u0026alpha;=0.70 in the nontechnical domain. Interrater reliability was almost perfect (wK 0.87).\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cem\u003eLearning curve analysis\u003c/em\u003e\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eTwenty-eight trainees were recruited (10 last-year medical students and 18 general physicians). Only two of them (7%; both general physicians) had performed a single knee arthrocentesis prior to the training sessions. We also recruited six orthopedic surgeons to serve as experts.\u003c/p\u003e\n\u003cp\u003ePerformance significantly improved between the first session (mean score 5.89 [95% CI 5.70-6.07]) and second session (mean score 6.51 [95% CI 6.30-6.72]; p\u0026lt;0.01) and between the second and third session (mean score 6.80 [95% CI 6.59-7.00]; p\u0026lt;0.05). We found no difference between the third session and the fourth (mean score 6.78 [95% CI 6.48-7.00]; p=0.94) (figure 2).\u003c/p\u003e\n\u003cp\u003eThe second mixed-effects model was designed to compare each trainee session with the performance of the six expert orthopedic surgeons. We found that surgeons had a significantly higher mean score in their session (mean score 6.94 [95% CI 6.88-7.00]) than trainees did in their first (p\u0026lt;0.01), and second session (p\u0026lt;0.01). The third and fourth trainee sessions did not differ significantly with the experts\u0026rsquo; performance (p=0.21 and 0.31, respectively).\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e\u003cem\u003eTraining satisfaction survey and follow-up\u003c/em\u003e\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eAfter debriefing, 24 of the 28 trainees (85%) answered a questionnaire to evaluate the training experience. They all agreed that (1) the instructional material they received prior to the training sessions was useful, (2) the training scenario allowed them adequate training, (3) they perceived the feedback received as useful, (4) the assessment tool allowed them to focus on improving specific tasks, (5) the addition of a clinical case at the beginning improved scenario fidelity, and (6) the use of a trained patient-actor allowed improvement of nontechnical (communication) skills. The only question that received less than 100% of agreement was the perception that the knee model used was realistic (only 19 of 24 agreed; 80%).\u003c/p\u003e\n\u003cp\u003eSeven of the 28 trainees (25%) had performed a real-patient knee arthrocentesis by the one-year follow-up. All of the students thought that the training was useful and allowed them to perform the procedure safely. They felt confident regarding patient consent and education, performing the procedure and explaining postprocedure cares to the patient. The only item where two trainees (29%) felt insecure was selecting the correct laboratory tubes and completing paperwork.\u003c/p\u003e"},{"header":"Discussion","content":"\u003cp\u003eOur high-fidelity simulation scenario allowed student trainees to improve the technical and nontechnical skills required to perform a safe knee arthrocentesis.\u003c/p\u003e\n\u003cp\u003eA key to training and learning is repetition. Previous studies have focused on proving differences between students prior to training and after training \u003csup\u003e4,10\u003c/sup\u003e or on measuring satisfaction after a single use\u003csup\u003e17\u003c/sup\u003e. Repeated training and evaluation increase student performance and avoid jumping to conclusions that could be due to chance\u003csup\u003e18,19\u003c/sup\u003e. This is the first study to determine how many training sessions are required to achieve proficiency in knee arthrocentesis. Students\u0026rsquo; learning curves showed a learning plateau after three sessions. Measuring the fourth session allowed us to confirm that performance was sustained and not just a one-session peak\u003csup\u003e18\u003c/sup\u003e. The short learning curve could be explained by the detailed training documentation received prior to the sessions, the direct observation scale known to the trainees, and personalized feedback received after each session that allowed the trainees to focus on their mistakes and gave them advice on how to improve. This learning curve behavior is related to obtaining a proficiency in the scenario. Obtaining an expertise in knee arthrocentesis requires experience and hence is not obtainable in a brief simulated training course\u003csup\u003e20\u003c/sup\u003e.\u003c/p\u003e\n\u003cp\u003eTeaching combined technical and nontechnical abilities has also proven to be effective through simulation\u003csup\u003e13,21\u003c/sup\u003e. Simulated procedures and situations offer a structured teaching method that is replicable, objective, and safe (for the patient and student)\u003csup\u003e22,23\u003c/sup\u003e. The inclusion of nontechnical aspects to a procedure usually considered technical has many proven benefits\u003csup\u003e13\u003c/sup\u003e. First, it allows for the teaching and learning of nontechnical aspects that are usually left out of technical training. Doctor-patient communication plays a key role in their relationship and in ideal clinical practice\u003csup\u003e24\u003c/sup\u003e. Furthermore, communication and nontechnical skills have been proven trainable\u003csup\u003e25\u003c/sup\u003e. Second, including these skills allowed us to incorporate the written consent as part of the procedure. The task of explaining the risks, benefits, and steps of the procedure to the patients helped our trainees incorporate significant theoretical concepts of knee arthrocentesis. Finally, as mentioned previously, hybrid training based on clinical scenarios adds meaning to the interaction. The presence of a real patient-actor increases the stakes for the student while remaining teaching friendly. This method has been proven to improve the learning experience\u003csup\u003e26\u003c/sup\u003e. Nontechnical aspects had not been trained in previous studies regarding knee arthrocentesis\u003csup\u003e9,10,17\u003c/sup\u003e. In our study, the nontechnical dimension also improved between training sessions.\u003c/p\u003e\n\u003cp\u003eThe scenario required creating an adaptation of a direct observation of procedure skills (DOPS) scale that proved to be consistent, reliable, and useful for trainee learning (assessment for learning)\u003csup\u003e27,28\u003c/sup\u003e. Designing a simulated training scenario requires an objective measurement tool. Other studies have used generic observation tools or unvalidated checklists\u003csup\u003e29\u003c/sup\u003e. The main limitation for the use of a non-procedure-specific tool is that it lacks the nuance of the procedure and certainly does not incorporate nontechnical skills, limiting specific item-by-item feedback and therefore improvement. We decided to adapt a similar tool. Delfino et al. had already created a direct observation tool for a specific technical procedure (tracheal intubation) including nontechnical skills in their tool\u003csup\u003e14\u003c/sup\u003e. We decided to adapt the scale, maintaining the 11 items but changing the descriptors used in each of them. First, we determined that the tool had internal consistency and external reliability (among observers). This determination is important because it assures the reproducibility of our results\u003csup\u003e30,31\u003c/sup\u003e. The tool we created also proved to be bidimensional. Obtaining two dimensions through exploratory and confirmatory factor analysis reaffirmed the notion that we were measuring technical and nontechnical competencies in the same procedure. Finally, we decided to make the DOPS scale available to trainees prior to the sessions. Traditionally, training and teaching scenarios prefer to maintain the items and descriptors of the scale away from the students. The use of the assessment tool for session preparation improves understanding of the key elements of each step, allowing students to learn from the assessment tool, thereby streamlining feedback and improvement \u003csup\u003e32\u003c/sup\u003e. This improvement might help explain the high initial rating for trainees' first session (mean score 5.89) and probably contributed to the steep learning curve they followed.\u003c/p\u003e\n\u003cp\u003eA one-year follow-up found that trainees had performed the real-life procedures confidently given the abilities trained. Student perception has been proven to impact learning\u003csup\u003e33\u003c/sup\u003e. Positive perception leads to improved performance and increases the completion of training programs\u003csup\u003e34\u003c/sup\u003e(\u003csup\u003e34\u003c/sup\u003eKirkpatrick and Kirkpatrick)(34)\u0026lt;sup\u0026gt;34\u0026lt;/sup\u0026gt;\u0026lt;sup\u0026gt;34\u0026lt;/sup\u0026gt;\u0026lt;sup\u0026gt;34\u0026lt;/sup\u0026gt;. Our scenario had a positive trainee perception just after training and one-year posttraining. Trainees positively valued the feedback given to them in the debriefing room. The feedback was structured, and the surgeon giving the feedback received prior training regarding feedback structure and technique. We believe our experience and the previous literature\u003csup\u003e35\u0026ndash;37\u003c/sup\u003e make the inclusion of personalized feedback a key element in simulated training.\u003c/p\u003e\n\u003cp\u003eOne of our main limitations was that the training sessions were not evenly spaced between students nor for single students. This is a frequent limitation when training has no curricular integration. After its initial success, the program will be included in student training, allowing for sessions at regular intervals. Secondarily, although subjective trainee evaluations rated the model favorably, the knee model used is relatively simple and did not allow the students to scope the impact knee variability has on increasing arthrocentesis difficulty.\u003c/p\u003e\n\u003cp\u003eIn this research, we have opted to apply multilevel statistical models to consider repeated measures obtained from each trainee and compare groups. Therefore, by using multilevel models, differences in DOPS performances between sessions, and among trainees and experts could be obtained. Identifying the point in the learning curve where the slope flattens out (inflection point) is critical\u003csup\u003e27\u003c/sup\u003e. This point represents a progressively higher effort to achieve trainees' learning gains before reaching a performance level similar to an expert\u003csup\u003e27\u003c/sup\u003e. Thus, using this statistical approach, we could graphically represent the learning curves and identified their critical points. Future research could be conducted incorporating an interaction between individual-level (e.g., last year medical student versus a specialist resident) and group-level variables (e.g., different simulations scenarios) through multilevel statistical models.\u003c/p\u003e"},{"header":"Conclusion","content":"\u003cp\u003eA high-fidelity simulation scenario allowed student trainees to improve the technical and nontechnical skills required to perform a safe knee arthrocentesis. After three training sessions, the trainee performance was similar to the experts we assessed. The scenario required creating an adaptation of a direct observation of procedure skills (DOPS) scale that proved to be consistent and reliable.\u003c/p\u003e"},{"header":"Declarations","content":"\u003cp\u003e\u003cstrong\u003eData availability\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe datasets generated during and analysed during the current study are available from the corresponding author upon request.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAuthor Contributions\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eCR: Substantial contributions to the conception of the work, the acquisition, analysis, and interpretation of data for the work; drafting the work; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/p\u003e\n\u003cp\u003eSI: Substantial contributions to the design of the work, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/p\u003e\n\u003cp\u003ePB: Substantial contributions to the conception and design of the work, the acquisition, analysis, and interpretation of data for the work; drafting the work; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/p\u003e\n\u003cp\u003eCV: Substantial contributions to the design of the work, the acquisition, analysis, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/p\u003e\n\u003cp\u003eCN: Substantial contributions to the design of the work, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/p\u003e\n\u003cp\u003eJV: Substantial contributions to the design of the work, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/p\u003e\n\u003cp\u003eIV: Substantial contributions to the design of the work, and analysis of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/p\u003e\n\u003cp\u003eEF: Substantial contributions to the design of the work, and analysis of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/p\u003e\n\u003cp\u003eAR: Substantial contributions to the design of the work, and interpretation of data for the work; revising it critically for important intellectual content; and final approval of the version to be published. Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\n\u003cli\u003eShimizu M, Higuchi H, Takagishi K, Shinozaki T, Kobayashi T. Clinical and biochemical characteristics after intra-articular injection for the treatment of osteoarthritis of the knee: Prospective randomized study of sodium hyaluronate and corticosteroid. J Orthop Sci. 2010;15(1):51\u0026ndash;6.\u003c/li\u003e\n\u003cli\u003eS\u0026aacute;nchez M, Anitua E, Azofra J, Aguirre JJ, Andia I. Intra-articular injection of an autologous preparation rich in growth factors for the treatment of knee OA: A retrospective cohort study. Clin Exp Rheumatol. 2008;26:910\u0026ndash;3.\u003c/li\u003e\n\u003cli\u003eMargaretten ME, Kohlwes J, Moore D, Bent S. Does This Adult Patient Have Septic Arthritis? JAMA. 2007;297(13):1478\u0026ndash;88.\u003c/li\u003e\n\u003cli\u003eSeeley MA, Kazarian E, King B, Biermann JS, Carpenter JE, Caird MS, et al. Core concepts: Orthopedic intern curriculum boot camp. Orthopedics. 2016;39(1):e62\u0026ndash;7.\u003c/li\u003e\n\u003cli\u003eAltamirano P, Gonzalez R, Hanne C, Moreno R, Mu\u0026ntilde;oz M, Pantoja MA. Perfil de Conocimientos EUNACOM. Segunda versi\u0026oacute;n [Internet]. 2010;2:59. Available from: http://www.eunacom.cl/contenidos/PerfilNew.pdf\u003c/li\u003e\n\u003cli\u003eTelias N. A, Innocenti D. P, Orrego G. F, Oliver C. N, Huidobro D. B, Orrego L. M. Evaluaci\u0026oacute;n de percepci\u0026oacute;n de conocimientos y destrezas de alumnos de medicina en traumatolog\u0026iacute;a y ortopedia. Rev chil ortop traumatol. 2011;52(2):63\u0026ndash;70.\u003c/li\u003e\n\u003cli\u003eCurtiss HM, Finnoff JT, Peck E, Hollman J, Muir J, Smith J. Accuracy of Ultrasound-Guided and Palpation-Guided Knee Injections By an Experienced and Less-Experienced Injector Using a Superolateral Approach: A Cadaveric Study. PM R. 2011;3(6):507\u0026ndash;15.\u003c/li\u003e\n\u003cli\u003eJackson DW, Evans NA, Thomas BM. Accuracy of needle placement into the intra-articular space of the knee. J Bone Jt Surg - Ser A. 2002;84\u0026ndash;A:1522\u0026ndash;7.\u003c/li\u003e\n\u003cli\u003eWaikakul S, Chumtup W, Chotivichit A, Vanadurongwan B, Assawamongkolgul A, Rojanawanich V. A knee model for arthrocentesis simulation. J Med Assoc Thail. 2003;86(3):282\u0026ndash;7.\u003c/li\u003e\n\u003cli\u003eChiowchanwisawakit P, Ratanarat R, Srinonprasert V. Improving sixth year medical students\u0026rsquo; performance in knee arthrocentesis using a synthetic knee model. Int J Rheum Dis. 2015;18(7):742\u0026ndash;50.\u003c/li\u003e\n\u003cli\u003eGreenberg CC, Regenbogen SE, Studdert DM, Lipsitz SR, Rogers SO, Zinner MJ, et al. Patterns of Communication Breakdowns Resulting in Injury to Surgical Patients. J Am Coll Surg. 2007;204(4):533\u0026ndash;40.\u003c/li\u003e\n\u003cli\u003eYule S, Flin R, Maran N, Rowley D, Youngson G, Paterson-Brown S. Surgeons\u0026rsquo; non-technical skills in the operating room: Reliability testing of the NOTSS behavior rating system. World J Surg. 2008;32(4):548\u0026ndash;56.\u003c/li\u003e\n\u003cli\u003eMoulton C anne, Tabak D, Kneebone R, Nestel D, MacRae H, LeBlanc VR. Teaching communication skills using the integrated procedural performance instrument (IPPI): A randomized controlled trial. Am J Surg. 2009;197:113\u0026ndash;8.\u003c/li\u003e\n\u003cli\u003ePendleton D, Schofield T, Tate P HP. The consultation: An Press, approach to learning and teaching. Oxford: Oxford University; 2003.\u003c/li\u003e\n\u003cli\u003eRamani S, Krackov SK. Twelve tips for giving feedback effectively in the clinical environment. Med Teach. 2012;34(10):787\u0026ndash;91.\u003c/li\u003e\n\u003cli\u003eCarraccio CL, Benson BJ, Nixon LJ, Derstine PL. From the educational bench to the clinical bedside: Translating the Dreyfus developmental model to the learning of clinical skills. Acad Med. 2008;83(8):761\u0026ndash;7.\u003c/li\u003e\n\u003cli\u003eVillagr\u0026aacute;n I, Tejos R, Chahu\u0026aacute;n J, Uslar T, Pizarro M, Varas J, et al. Percepci\u0026oacute;n de estudiantes de pregrado de Medicina de talleres de simulaci\u0026oacute;n de procedimientos m\u0026eacute;dico-quir\u0026uacute;rgicos. 2018;146:649\u0026ndash;58.\u003c/li\u003e\n\u003cli\u003eDelfino AE, Chandratilake M, Altermatt FR, Delfino AE, Chandratilake M, Altermatt FR. Validation and piloting of direct observation of practical skills tool to assess intubation in the Chilean context Validation and piloting of direct observation of practical skills tool to assess intubation in the Chilean context. Med Teach. 2013;35:231\u0026ndash;6.\u003c/li\u003e\n\u003cli\u003eLandis JR, Koch GG. Landis amd Koch1977_agreement of categorical data. Biometrics. 1977;33(1):159\u0026ndash;74.\u003c/li\u003e\n\u003cli\u003eMemtsoudis SG. Beyond Repeated-Measures Analysis of Variance Data in Anesthesia Research. 2012;37(1):99\u0026ndash;105.\u003c/li\u003e\n\u003cli\u003eBerman JR, Ben-Artzi A, Fisher MC, Bass AR, Pillinger MH. A comparison of arthrocentesis teaching tools: Cadavers, synthetic joint models, and the relative utility of different educational modalities in improving Trainees\u0026rsquo; comfort with procedures. J Clin Rheumatol. 2012;18(4):175\u0026ndash;9.\u003c/li\u003e\n\u003cli\u003eHopper AN, Jamison MH, Lewis WG. Learning curves in surgical practice. Postgr Med J. 2007;83:777\u0026ndash;9.\u003c/li\u003e\n\u003cli\u003eVaras J, Mej\u0026iacute;a R, Riquelme A, Maluenda F, Buckel E, Salinas J, et al. Significant transfer of surgical skills obtained with an advanced laparoscopic training program to a laparoscopic jejunojejunostomy in a live porcine model: Feasibility of learning advanced laparoscopy in a general surgery residency. Surg Endosc Other Interv Tech. 2012;26(12):3486\u0026ndash;94.\u003c/li\u003e\n\u003cli\u003eLeBlanc VR, Tabak D, Kneebone R, Nestel D, MacRae H, Moulton CA. Psychometric properties of an integrated assessment of technical and communication skills. Am J Surg [Internet]. 2009;197(1):96\u0026ndash;101.\u003c/li\u003e\n\u003cli\u003eAtesok K, Mabrey JD, Jazrawi LM, Egol KA. Surgical simulation in orthopaedic skills training. J Am Acad Orthop Surg. 2012;20(7):410\u0026ndash;22.\u003c/li\u003e\n\u003cli\u003eCorvetto M, Bravo MP, Monta\u0026ntilde;a R, Utili F, Escudero E, Boza C, et al. Simulaci\u0026oacute;n en educaci\u0026oacute;n m\u0026eacute;dica: una sinopsis. Rev Med Chil [Internet]. 2013;141(1):70\u0026ndash;9\u003c/li\u003e\n\u003cli\u003eBerner JE, Ewertz E. The importance of non-technical skills in modern surgical practice. Cir Esp. 2019;97(4):190\u0026ndash;5.\u003c/li\u003e\n\u003cli\u003eRanjan P, Kumari A, Chakrawarty A. How can doctors improve their communication skills? J Clin Diagnostic Res. 2015;9(3):1\u0026ndash;4.\u003c/li\u003e\n\u003cli\u003eStroud L, Cavalcanti RB. Hybrid simulation for knee arthrocentesis: Improving fidelity in procedures training. J Gen Intern Med. 2013;28(5):723\u0026ndash;7.\u003c/li\u003e\n\u003cli\u003eEpstein RM. Medical education - Assessment in medical education. N Engl J Med. 2007;356(4):387\u0026ndash;96.\u003c/li\u003e\n\u003cli\u003eNaeem N. Validity, reliability, feasibility, acceptability and educational impact of direct observation of procedural skills (DOPS). J Coll Physicians Surg. 2013;23(1):77\u0026ndash;82.\u003c/li\u003e\n\u003cli\u003eDowning SM. Validity: On the meaningful interpretation of assessment data. Medical Education. 2003. p. 37;830-837.\u003c/li\u003e\n\u003cli\u003eDowning SM. the metric of medical education Reliability : on the reproducibility of assessment data. Med Educ. 2004;38:1006\u0026ndash;12.\u003c/li\u003e\n\u003cli\u003eKhan KZ, Ramachandran S, Gaunt K. The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part I: An historical and theoretical perspective. Med Teach. 2016;35(81):1437\u0026ndash;46.\u003c/li\u003e\n\u003cli\u003eLockyer J, Carraccio C, Chan M, Hart D, Smee S, Touchie C, et al. Core principles of assessment in competency- based medical education. 2017;39(6):609\u0026ndash;16.\u003c/li\u003e\n\u003cli\u003eSchuwirth LWT, Van der Vleuten CPM. Programmatic assessment: From assessment of learning to assessment for learning. Med Teach [Internet]. 2011;33(6):478\u0026ndash;85. Available from: http://www.tandfonline.com/doi/full/10.3109/0142159X.2011.565828\u003c/li\u003e\n\u003cli\u003eJohnston S, Coyer FM, Nash R. Kirkpatrick\u0026rsquo;s evaluation of simulation and debriefing in health care education: A systematic review. J Nurs Educ. 2018;57(7):393\u0026ndash;8.\u003c/li\u003e\n\u003cli\u003eKirkpatrick, Donald L. Evaluating Training Programs: the Four Levels. 3\u003csup\u003erd\u003c/sup\u003e edition. San Francisco: Emeryville, CA: Berrett-Koehler; Publishers Group West, 1994. p 52 \u0026ndash; 62\u003c/li\u003e\n\u003cli\u003eNorcini J, Burch V. 31 Workplace-based assessment as an educational tool: AMEE Guide. Med Teach. 2007;29(9\u0026ndash;10):855\u0026ndash;71.\u003c/li\u003e\n\u003cli\u003eHerrmann-Werner A, Nikendei C, Keifenheim K, Bosse HM, Lund F, Wagner R, et al. \u0026ldquo;Best Practice\u0026rdquo; Skills Lab Training vs. a \u0026ldquo;see one, do one\u0026rdquo; Approach in Undergraduate Medical Education: An RCT on Students\u0026rsquo; Long-Term Ability to Perform Procedural Clinical Skills. PLoS One. 2013;8(9):e76354.\u003c/li\u003e\n\u003cli\u003eFarquharson AL, Cresswell AC, Beard JD, Chan P. Randomized trial of the effect of video feedback on the acquisition of surgical skills. Br J Surg. 2013;100:1448\u0026ndash;53.\u003c/li\u003e\n\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"knee arthrocentesis, medical education, simulated training, procedure skills, nontechnical skills, hybrid simulation, DOPS scale","lastPublishedDoi":"10.21203/rs.3.rs-110369/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-110369/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003e\u003cstrong\u003eIntroduction \u003c/strong\u003eKnee arthrocentesis is frequently performed as a diagnostic or therapeutic procedure. Although considered a key competency for medical doctors, most students never execute the procedure during their training. We aimed to assess technical and nontechnical skills for knee arthrocentesis through high-fidelity hybrid simulation \u003c/p\u003e\u003cp\u003e\u003cstrong\u003eMethods \u003c/strong\u003eMedical students and general physicians were recruited for training; orthopedic surgeons were recruited as experts. Trainees received educational documentation prior to training. Trainees took a medical history and obtained informed consent from a patient-actor, then encountered a simulated knee to execute the procedure. We adapted a direct observation scale to assess technical and nontechnical skill performance. Personalized feedback was received after each session. Performance among trainees (learning curves) and between trainees and experts was compared using a mixed-effects model. \u003c/p\u003e\u003cp\u003e\u003cstrong\u003eResults\u003c/strong\u003e Trainees significantly improved from the first session to the second and third. The third session was the learning curve plateau. Performance obtained in the third and fourth sessions were similar to expert performance. The assessment tool evaluated technical and nontechnical skills with high internal consistency and showed high interobserver reliability. \u003c/p\u003e\u003cp\u003e\u003cstrong\u003eDiscussion \u003c/strong\u003eLearning curve analysis showed that high-fidelity simulation allowed trainees to become proficient in technical and nontechnical skills required to perform a safe knee arthrocentesis.\u003c/p\u003e\u003cp\u003e\u003cstrong\u003eLevel of Evidence: \u003c/strong\u003eLevel II (Prospective Cohort Study)\u003c/p\u003e","manuscriptTitle":"High-Fidelity Hybrid Simulation Not Only Optimizes Skills Acquisition But Improves Non-Technical Skills","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2020-12-02 17:43:54","doi":"10.21203/rs.3.rs-110369/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"b7e277f2-43c2-48a9-a21e-81a0aa2cfbd0","owner":[],"postedDate":"December 2nd, 2020","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[{"id":1305114,"name":"Orthopedic Surgery"}],"tags":[],"updatedAt":"2020-12-04T14:31:07+00:00","versionOfRecord":[],"versionCreatedAt":"2020-12-02 17:43:54","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-110369","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-110369","identity":"rs-110369","version":["v1"]},"buildId":"J0_U0BvcaRcwD8yVFaRlm","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}