Application of Large Language Models in Medical Interview Training: A Study with Medical Students

preprint OA: closed
Full text JSON View at publisher

Abstract

Abstract This paper explores the application of Large Language Models (LLMs) in medical interview training. While medical interviews remain fundamental in healthcare, training methods often require human interaction, limiting practice opportunities. We investigate if LLMs can effectively simulate patients for training purposes. We examined commercially available models and fine-tuned open-source LLMs using QLoRA techniques on a dataset of medical interviews. We developed a web application employing these models and conducted in-depth interviews with medical students to evaluate its effectiveness. Students found the application helpful, rating conversation quality as good and highlighting advantages over traditional training methods, particularly regarding availability and consistency in patient symptom presentation. While students emphasized that LLMs cannot replace real patient interactions, they recognized significant benefits for supplementary training. Our findings confirm that LLMs can be valuable tools in medical interview training, providing opportunities for skill development without dependency on peer availability or scheduled sessions.
Full text 18,308 characters · extracted from preprint-html · click to expand
Application of Large Language Models in Medical Interview Training: A Study with Medical Students | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Application of Large Language Models in Medical Interview Training: A Study with Medical Students Artur Michałek, Jarosław Hryszko, Adam Roman This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-6569758/v1 This work is licensed under a CC BY 4.0 License Status: Published Journal Publication published 03 Mar, 2026 Read the published version in BMC Medical Education → Version 1 posted 22 You are reading this latest preprint version Abstract This paper explores the application of Large Language Models (LLMs) in medical interview training. While medical interviews remain fundamental in healthcare, training methods often require human interaction, limiting practice opportunities. We investigate if LLMs can effectively simulate patients for training purposes. We examined commercially available models and fine-tuned open-source LLMs using QLoRA techniques on a dataset of medical interviews. We developed a web application employing these models and conducted in-depth interviews with medical students to evaluate its effectiveness. Students found the application helpful, rating conversation quality as good and highlighting advantages over traditional training methods, particularly regarding availability and consistency in patient symptom presentation. While students emphasized that LLMs cannot replace real patient interactions, they recognized significant benefits for supplementary training. Our findings confirm that LLMs can be valuable tools in medical interview training, providing opportunities for skill development without dependency on peer availability or scheduled sessions. Large Language Models Medical Education Virtual Patients Medical Interviews Healthcare Simulation Full Text Additional Declarations No competing interests reported. Cite Share Download PDF Status: Published Journal Publication published 03 Mar, 2026 Read the published version in BMC Medical Education → Version 1 posted Editorial decision: Revision requested 24 Nov, 2025 Reviews received at journal 22 Nov, 2025 Reviews received at journal 21 Nov, 2025 Reviews received at journal 20 Nov, 2025 Reviews received at journal 19 Nov, 2025 Reviews received at journal 18 Nov, 2025 Reviews received at journal 15 Nov, 2025 Reviewers agreed at journal 13 Nov, 2025 Reviewers agreed at journal 12 Nov, 2025 Reviewers agreed at journal 12 Nov, 2025 Reviewers agreed at journal 12 Nov, 2025 Reviewers agreed at journal 12 Nov, 2025 Reviewers agreed at journal 11 Nov, 2025 Reviewers agreed at journal 11 Nov, 2025 Reviewers agreed at journal 11 Nov, 2025 Reviews received at journal 11 Nov, 2025 Reviewers agreed at journal 11 Nov, 2025 Reviewers invited by journal 11 Nov, 2025 Editor invited by journal 10 Nov, 2025 Editor assigned by journal 07 Nov, 2025 Submission checks completed at journal 07 Nov, 2025 First submitted to journal 01 May, 2025 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-6569758","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":547747933,"identity":"87a9f0cb-414f-4fa7-8d94-eda0c8110d3a","order_by":0,"name":"Artur Michałek","email":"","orcid":"","institution":"Jagiellonian University","correspondingAuthor":false,"prefix":"","firstName":"Artur","middleName":"","lastName":"Michałek","suffix":""},{"id":547747934,"identity":"ea6fa4fd-79be-404e-9823-2f3103397e01","order_by":1,"name":"Jarosław Hryszko","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAABHElEQVRIie2RsWrDMBCGT6jYi4pXGZf0FVQECSXQZ5EIKIsLnYIhQwSFZEnJ6scoFDq7eMjSZk43e/GcUUMKlR0CHmLPheoD3f0SfByHAByOPwjSdX2yhzZ3AUFdwLPZ71NYSwn1WcF9s9oKy+reo+DVV1ka9iB19FKF5qgGfC8KOMxyGHUoaD3lnLCJ1DfbYURIzId7IVC6y+H+uWsX5UXA8KOmdaCJfLcKvl7mwPIOZVN5oWGLRrEhkW+pVX76lFR5lLC8USgRsXylVkG9SoXtLtvFkio8Jpni9LMQH+vdlHTtcrdRqDTJnAdUoW9znAyCVSwLMxsPRr6+rJyf7Udcnb4GiMjqyi4PgdtWxodT97OmdSkOh8Px7/gFApFWuOixdIUAAAAASUVORK5CYII=","orcid":"","institution":"Jagiellonian University","correspondingAuthor":true,"prefix":"","firstName":"Jarosław","middleName":"","lastName":"Hryszko","suffix":""},{"id":547747935,"identity":"440c733e-a93d-428c-80c5-32498012cfc8","order_by":2,"name":"Adam Roman","email":"","orcid":"","institution":"Jagiellonian University","correspondingAuthor":false,"prefix":"","firstName":"Adam","middleName":"","lastName":"Roman","suffix":""}],"badges":[],"createdAt":"2025-05-01 06:53:10","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-6569758/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-6569758/v1","draftVersion":[],"editorialEvents":[{"content":"https://doi.org/10.1186/s12909-026-08819-2","type":"published","date":"2026-03-03T15:56:59+00:00"}],"editorialNote":"","failedWorkflow":false,"files":[{"id":96372898,"identity":"c974adf4-91ed-4c04-88d2-fb7089951eef","added_by":"auto","created_at":"2025-11-20 10:37:01","extension":"json","order_by":0,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":4810,"visible":true,"origin":"","legend":"","description":"","filename":"18bd09e4feab4a4c8d25441480e4edec.json","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1/65267caff27b253570c96cc0.json"},{"id":96372902,"identity":"6c36c72a-9441-4692-a2b7-85c87bc68bbe","added_by":"auto","created_at":"2025-11-20 10:37:01","extension":"xml","order_by":1,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":91677,"visible":true,"origin":"","legend":"","description":"","filename":"18bd09e4feab4a4c8d25441480e4edec1enriched.xml","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1/814e995100a47be0291e60c8.xml"},{"id":96452943,"identity":"8f6f62b3-7487-4ce3-bd0e-f8d904f5096f","added_by":"auto","created_at":"2025-11-21 09:55:14","extension":"pdf","order_by":2,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":55639,"visible":true,"origin":"","legend":"","description":"","filename":"coverletter.pdf","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1/dfe2ee381e085c6e936c9f1b.pdf"},{"id":96372905,"identity":"a08b4347-c04c-41bc-9bc2-b39bf93cca5e","added_by":"auto","created_at":"2025-11-20 10:37:01","extension":"pdf","order_by":3,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":367540,"visible":true,"origin":"","legend":"","description":"","filename":"main.pdf","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1/6f62f2152afae97e7759909c.pdf"},{"id":96452913,"identity":"961ed2ad-2e87-4ed2-a9b9-b7b30165c9aa","added_by":"auto","created_at":"2025-11-21 09:53:43","extension":"pdf","order_by":4,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":41376,"visible":true,"origin":"","legend":"","description":"","filename":"response.pdf","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1/9988d0f1711932482036d44c.pdf"},{"id":96372900,"identity":"d3c456d1-2687-41b1-940b-7ff6a3801420","added_by":"auto","created_at":"2025-11-20 10:37:01","extension":"cls","order_by":5,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":55857,"visible":true,"origin":"","legend":"","description":"","filename":"snjnl.cls","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1/a5a5e2a0eb8d327407cc79c2.cls"},{"id":96372899,"identity":"0aeb5a54-c388-4f05-9adb-281afa865824","added_by":"auto","created_at":"2025-11-20 10:37:01","extension":"bst","order_by":6,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":39056,"visible":true,"origin":"","legend":"","description":"","filename":"snnature.bst","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1/f85cf4f5c057bad3aebbcafa.bst"},{"id":96372906,"identity":"375dc171-c41d-46b4-8704-5097f11f01ea","added_by":"auto","created_at":"2025-11-20 10:37:02","extension":"xml","order_by":7,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":96860,"visible":true,"origin":"","legend":"","description":"","filename":"18bd09e4feab4a4c8d25441480e4edec1structuring.xml","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1/b6cf2601286175f42f82de79.xml"},{"id":96372904,"identity":"35d2997b-e1a9-40cc-9038-785e3271df8d","added_by":"auto","created_at":"2025-11-20 10:37:01","extension":"html","order_by":8,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":102685,"visible":true,"origin":"","legend":"","description":"","filename":"earlyproof.html","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1/fe0cb9ea275357fe1322e207.html"},{"id":104251841,"identity":"ede25889-ca69-4462-8137-e9a48b18c40a","added_by":"auto","created_at":"2026-03-09 16:15:38","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":367136,"visible":true,"origin":"","legend":"","description":"","filename":"main.pdf","url":"https://assets-eu.researchsquare.com/files/rs-6569758/v1_covered_72e000cb-08b8-4a6c-8fdb-6a336eb25674.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Application of Large Language Models in Medical Interview Training: A Study with Medical Students","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":true,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"bmc-medical-education","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"meed","sideBox":"Learn more about [BMC Medical Education](http://bmcmededuc.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/meed/default.aspx","title":"BMC Medical Education","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true},"keywords":"Large Language Models, Medical Education, Virtual Patients, Medical Interviews, Healthcare Simulation","lastPublishedDoi":"10.21203/rs.3.rs-6569758/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-6569758/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eThis paper explores the application of Large Language Models (LLMs) in medical interview training. While medical interviews remain fundamental in healthcare, training methods often require human interaction, limiting practice opportunities. We investigate if LLMs can effectively simulate patients for training purposes. We examined commercially available models and fine-tuned open-source LLMs using QLoRA techniques on a dataset of medical interviews. We developed a web application employing these models and conducted in-depth interviews with medical students to evaluate its effectiveness. Students found the application helpful, rating conversation quality as good and highlighting advantages over traditional training methods, particularly regarding availability and consistency in patient symptom presentation. While students emphasized that LLMs cannot replace real patient interactions, they recognized significant benefits for supplementary training. Our findings confirm that LLMs can be valuable tools in medical interview training, providing opportunities for skill development without dependency on peer availability or scheduled sessions.\u003c/p\u003e","manuscriptTitle":"Application of Large Language Models in Medical Interview Training: A Study with Medical Students","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2025-11-20 10:36:56","doi":"10.21203/rs.3.rs-6569758/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"decision","content":"Revision requested","date":"2025-11-24T07:30:05+00:00","index":"","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-11-22T15:23:57+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-11-21T08:28:56+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-11-20T12:59:43+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-11-19T21:00:26+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-11-18T15:56:21+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-11-15T09:35:33+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"338201892049674380337527404773267311151","date":"2025-11-13T11:48:00+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"260361082477177282510533067952469890940","date":"2025-11-12T22:29:09+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"66563435196916263188396935791821374007","date":"2025-11-12T19:19:02+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"170415679863528919768832994875523172806","date":"2025-11-12T13:02:40+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"19013779517217181178947598803911152749","date":"2025-11-12T11:11:31+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"188149557163837627276722524559016218356","date":"2025-11-11T16:28:06+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"322878949447459358906741178157961807007","date":"2025-11-11T15:10:52+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"158339421588549652391792899907703348364","date":"2025-11-11T12:53:37+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-11-11T08:19:34+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"157234378958235386269487962239843685520","date":"2025-11-11T06:14:55+00:00","index":"hide","fulltext":""},{"type":"reviewersInvited","content":"","date":"2025-11-11T05:49:45+00:00","index":"","fulltext":""},{"type":"editorInvited","content":"","date":"2025-11-10T05:35:09+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2025-11-08T02:27:50+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2025-11-08T02:27:32+00:00","index":"","fulltext":""},{"type":"submitted","content":"BMC Medical Education","date":"2025-05-01T06:41:27+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"bmc-medical-education","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"meed","sideBox":"Learn more about [BMC Medical Education](http://bmcmededuc.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/meed/default.aspx","title":"BMC Medical Education","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"57e532f8-d925-4c7e-b762-1ff78aa1e7b6","owner":[],"postedDate":"November 20th, 2025","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"published-in-journal","subjectAreas":[],"tags":[],"updatedAt":"2026-03-09T16:11:53+00:00","versionOfRecord":{"articleIdentity":"rs-6569758","link":"https://doi.org/10.1186/s12909-026-08819-2","journal":{"identity":"bmc-medical-education","isVorOnly":false,"title":"BMC Medical Education"},"publishedOn":"2026-03-03 15:56:59","publishedOnDateReadable":"March 3rd, 2026"},"versionCreatedAt":"2025-11-20 10:36:56","video":"","vorDoi":"10.1186/s12909-026-08819-2","vorDoiUrl":"https://doi.org/10.1186/s12909-026-08819-2","workflowStages":[]},"version":"v1","identity":"rs-6569758","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-6569758","identity":"rs-6569758","version":["v1"]},"buildId":"8U1c8b4HqxoKbykW_rLl7","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: preprint-html

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2025) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00