Can Artificial Intelligence Evaluate Online Health Information? A Comparative Assessment of Scabies-Related YouTube Videos Using Human Experts and ChatGPT-5

preprint OA: closed
Full text JSON View at publisher
Full text 144,943 characters · extracted from preprint-html · click to expand
Can Artificial Intelligence Evaluate Online Health Information? A Comparative Assessment of Scabies-Related YouTube Videos Using Human Experts and ChatGPT-5 | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Article Can Artificial Intelligence Evaluate Online Health Information? A Comparative Assessment of Scabies-Related YouTube Videos Using Human Experts and ChatGPT-5 Bengisu MERAL KETENCI, ozge sevil KARSTARLI BAKAY This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-8924512/v1 This work is licensed under a CC BY 4.0 License Status: Under Review Version 1 posted 5 You are reading this latest preprint version Abstract Scabies is a highly contagious parasitic skin disease for which patients frequently seek information on YouTube, although the reliability of available content is uncertain. Artificial intelligence (AI), particularly large language models, has emerged as a potential tool for assessing online health information; however, its concordance with expert evaluation remains unclear. This cross-sectional study analyzed the first 50 English-language YouTube videos retrieved using the term “scabies disease.” Two dermatology specialists independently evaluated videos using the DISCERN instrument, JAMA benchmark criteria, and the Global Quality Scale (GQS). Video characteristics were recorded, and sources were classified as professional or non-professional. Corrected transcripts were analyzed with ChatGPT-5 to generate Accuracy and Completeness scores. Readability was assessed using Flesch Reading Ease and Flesch–Kincaid Grade Level. Professionally produced videos scored significantly higher than non-professional videos across all human-based quality measures (p < 0.01). AI-generated scores were also higher for professional content but showed only moderate correlation with expert assessments. ChatGPT Completeness demonstrated moderate discrimination in identifying higher-quality videos (AUC = 0.668). Overall, AI reflected general quality trends but did not replicate expert judgment, suggesting a complementary rather than substitutive role. Biological sciences/Computational biology and bioinformatics Health sciences/Health care Physical sciences/Mathematics and computing Health sciences/Medical research Scabies Social Media Artificial Intelligence Natural Language Processing Health Communication Figures Figure 1 Figure 2 Figure 3 Figure 4 1.Introduction Scabies is a contagious parasitic skin disease caused by Sarcoptes scabiei var. hominis , affecting hundreds of millions worldwide[ 1 ]. Despite being recognized for centuries, it remains a major public health concern, particularly in low-resource and densely populated settings[ 2 ]. The infestation typically presents with intense nocturnal pruritus and erythematous papules or burrows, often complicated by secondary bacterial infections that may lead to significant morbidity, especially in children and immunocompromised individuals[ 3 ]. Although scabies is treatable with topical or oral scabicides, difficulties such as persistent pruritus, fear of reinfestation, and treatment misuse are common. In pediatric cases, parental anxiety and misinformation further complicate management[ 4 ]. Consequently, patients and caregivers increasingly seek reliable online information to enhance disease understanding and treatment adherence. Digital platforms have transformed public access to health information, with YouTube emerging as a widely used source for dermatologic content, including scabies[ 5 ]. Its visual format and accessibility make it particularly appealing for non-professional audiences[ 6 ]. However, the absence of content regulation allows dissemination of inaccurate or incomplete medical information, potentially leading to inappropriate treatment practices or delayed medical consultation[ 7 ]. To our knowledge, scabies-related YouTube content has not previously been evaluated using an integrated methodology combining human expert assessment and large language model–based analysis. Given these concerns, the present study evaluates the reliability and educational quality of scabies-related YouTube videos using established human-based assessment tools—DISCERN, JAMA, and GQS—together with AI-assisted evaluation using the ChatGPT-5 model and readability analyses. Beyond content characterization, this approach specifically addresses whether artificial intelligence can meaningfully align with human expert judgment in evaluating online health information, or whether it functions primarily as a complementary screening tool rather than a human-level evaluator. By examining scabies-related videos—a common yet underexplored topic in the digital health literature—this study aims to contribute to the growing discussion on the role of large language models in assessing the quality of online medical information. 2. Materials and Methods In this descriptive study, a YouTube search ( https://www.youtube.com ) was conducted on September 10, 2025, using the term “scabies disease.” To minimize algorithmic bias, the search was performed in incognito mode on a cleared browser without a logged-in account, and the term was selected based on commonly used keywords from highly viewed scabies-related videos. Results were sorted by view count to reflect typical user behavior. Because most viewers primarily engage with the highest-ranked search outputs and videos beyond the 50th position receive minimal traffic, the first 50 videos meeting the inclusion criteria were selected, replicating real-world viewing patterns[ 8 ]. To ensure reproducibility, the search was repeated on a second computer and a different internet network on the same day. Video titles and descriptions were screened independently by two dermatology specialists. Inclusion criteria required videos to be in English, at least 60 seconds in duration, publicly accessible, and to provide audio-visual medical or educational information directly related to scabies. Exclusion criteria included poor or absent audio, irrelevant content (general health topics, unrelated dermatologic diseases, or personal stories), promotional material without educational value, duplicate uploads (retaining the earliest or most-viewed version), videos under 60 seconds, and clips consisting solely of on-screen text without narration. All videos were screened using the same criteria, and categorization by source and presenter type (physician, academic institution, patient-generated, health website, news media) was conducted only after the inclusion phase during subgroup analysis. These procedures were adapted from previously published methodologies[ 9 ]. As this study involved only publicly available online content and did not include human participants, identifiable personal data, or animal subjects, approval from an ethics committee was not required. 2.1 Evaluation of Video Content The included videos were independently evaluated by two dermatology specialists who are co-authors of this manuscript. To establish a standardized framework, prior YouTube-based medical content analyses were reviewed. Each video was classified into one of seven thematic domains: (1) definition and transmission; (2) clinical features; (3) diagnostic procedures; (4) treatment and management; (5) prevention and hygiene; (6) prognosis and follow-up; and (7) other related topics. The “other” category encompassed content on special populations, public health messages, complications, and common myths. The interobserver reliability between the two dermatologists was evaluated using the kappa statistic. In cases of disagreement, a final decision was made through joint re-evaluation and discussion to reach a consensus. 2.2 Video Characteristics For every video included in the analysis, the duration (in seconds), total number of views, and time elapsed since upload (in months) were recorded. The latter parameter was also converted into days on air to ensure greater temporal precision in descriptive statistics. Viewer interaction was quantified through an Engagement Index (EI), calculated using the following formula: EI = ((likes + comments) / views) × 100. This index provided a standardized indicator of audience engagement relative to the visibility of each video. Videos were classified into five distinct categories based on their source of upload: Physicians Content created and shared by dermatologists or other medical doctors explaining diagnostic or therapeutic aspects of scabies. Patients or Individual Users Personal experiences or self-reported accounts uploaded by individuals affected by scabies. Health-Related Websites or Online Platforms Non-academic and non-governmental sources delivering general health or dermatology-related information. Academic Institutions or Professional Organizations Universities, teaching hospitals, and dermatology societies producing scientifically grounded educational material. News Agencies Informative or public health–oriented content released by national or international media outlets. When duplicate or nearly identical videos were detected, only the version with the earliest publication date and highest view count was retained, while the others were excluded to avoid redundancy. The presenter’s gender was identified as female, male, or both, according to observable visual or auditory characteristics. If both male and female speakers appeared, the video was classified as “both genders.” When gender determination was uncertain, it was omitted from the dataset. Ultimately, the videos were grouped into two overarching categories according to their source of production, rather than their intended audience: (1) Professional videos, produced by physicians, universities, or professional organizations; and (2) Non-professional videos, created by patients, individual users, health-related websites, or news agencies. 2.3 Evaluation of Informational Quality and Educational Value of Videos 2.3.1 Human Reviewer Evaluation The informational quality of the videos was assessed by two independent dermatology specialists, each with more than five years of clinical experience in dermatological practice. Prior to data collection, both reviewers underwent standardized instruction on applying the DISCERN, JAMA, and Global Quality Scale (GQS) instruments to ensure interrater consistency. The modified DISCERN tool, derived from the original instrument developed by Charnock et al., was used to evaluate the reliability and quality of treatment-related health information[ 10 ]. It consists of five yes/no items scored as “yes” (1 point) or “no” (0 points), yielding a total score from 0 (lowest quality) to 5 (highest quality). The JAMA benchmark criteria, originally introduced by Silberg et al., were also applied to assess the authorship, attribution, disclosure, and currency of each video[ 11 ]. Each fulfilled criterion was assigned one point, producing a total JAMA score between 0 and 4. In addition, the 5-point Global Quality Scale (GQS) developed by Bernard et al., was used to rate the overall educational value and coherence of the videos (1–2 = low, 3 = moderate, 4–5 = high quality)[ 12 ]. Each video was reviewed independently by both raters, and discrepancies were resolved by consensus after discussion. Inter-rater reliability for DISCERN, JAMA, and GQS evaluations was measured using Cohen’s κ (κ = 0.87) and intraclass correlation coefficient (ICC(2,k) = 0.90), indicating excellent agreement. 2.3.2 AI-Based Evaluation To complement human assessment, the corrected transcripts of all included videos were analyzed using the ChatGPT-5 model (OpenAI, 2025 version). A standardized prompt was used to evaluate each video for medical accuracy and informational completeness on a 5-point Likert scale (1 = poor, 5 = excellent). The model outputs were automatically parsed and statistically compared with human reviewer scores to explore agreement levels. Transcripts were automatically generated using YouTube’s closed captions feature and manually proofread by the researchers to ensure accuracy. 2.3.3 Readability Analyse Readability metrics were calculated for each video transcript using the online tool Read-Able ( https://www.webfx.com/tools/read-able/ ). The Flesch Reading Ease Score (FRES) and Flesch–Kincaid Grade Level (FKGL) were computed to determine linguistic accessibility and complexity of the content[ 13 ]. Higher FRES values indicate easier readability, whereas higher FKGL values correspond to more complex, higher-grade-level language. 2.4 Statistical Analysis Analyses were performed using SPSS version 31 (IBM Corp.). Statistical significance was set at p < 0.05. The strength of the correlations was interpreted as strong (0.70–0.99), moderate (0.50–0.69), weak (0.01–0.49), or none (0), according to the correlation coefficient. 3.Results A total of 92 YouTube videos related to scabies were screened, and 50 met the inclusion criteria. The selection process is shown in Fig. 1 . Table 1 summarizes video characteristics, which showed wide variation in duration, time online, and engagement metrics. The mean DISCERN, GQS, and JAMA scores were 3.46 ± 1.1, 3.42 ± 1.0, and 2.23 ± 1.1. AI-based evaluations yielded mean ChatGPT Accuracy and Completeness scores of 4.62 ± 0.92 and 4.51 ± 0.85. Readability analysis showed mean FRES and FKGL values of 64.8 ± 6.3 and 9.2 ± 1.0. Treatment and management was the most frequently covered domain (86%), followed by diagnostics (46%), clinical features (42%), and definitions/transmission (38%). As shown in Fig. 2 , preventive hygiene (28%), prognosis/follow-up (18%), and other topics (12%) were the least represented categories. Table 1 Descriptive statistics of video characteristics, engagement metrics, and quality scores This table summarizes the descriptive statistics for all variables included in the study, including video characteristics (length, days on air, time since upload), viewer engagement metrics (total views, likes, comments, engagement index), human-rated quality scores (DISCERN, JAMA, GQS), and AI-based evaluation metrics (Accuracy and Completeness). Readability indices (FRES and FKGL) are also presented. For each variable, the mean, standard deviation (SD), median, minimum (Min), and maximum (Max) values are reported. These descriptive metrics provide an overview of the distribution and variability of the dataset used for subsequent correlation and multivariate regression analyses. Video length, sec Mean SD Median Min Max 347.44 229.04 302.0 63.0 896.0 Days on air 1539.1 1340.92 955.5 69.0 4594.0 Time since upload, months 51.3 44.7 31.85 2.3 153.13 Total views, n 251428.06 359526.13 93500.0 1500.0 1674457.0 Likes, n 2247.98 4631.84 529.5 0.0 24000.0 Comments, n 278.4 485.02 68.5 0.0 2405.0 Engagement index 1.11 1.07 0.79 0.01 6.61 DISCERN 3.32 1.17 3.0 1.0 5.0 JAMA 2.14 1.11 2.0 0.0 4.0 GQS 3.28 1.26 3.0 1.0 5.0 AI ,ACCURACY 4.54 1.03 5.0 1.0 5.0 AI ,COMPLETENESS 4.53 0.8 5.0 2.0 5.0 FRES 64.45 4.46 64.6 54.8 74.1 FKGL 8.41 0.85 8.5 5.24 9.8 Video source analysis Quality indicators differed significantly across the five video source categories (Table S1). For JAMA scores, one-way ANOVA demonstrated a significant group effect (F = 7.93, p < 0.001). Tukey’s HSD indicated that patient-generated videos scored significantly lower than those from physicians (p = 0.002) and academic institutions (p < 0.001). For DISCERN, group differences were more pronounced (F = 10.42, p < 0.001), with patient-generated videos scoring significantly lower than physicians (p < 0.001), health-related websites (p = 0.011), academic institutions (p < 0.001), and news agencies (p = 0.035). GQS also differed significantly by source (F = 10.09, p < 0.001); patient-generated videos consistently scored the lowest, performing significantly worse than physicians (p < 0.001), health websites (p = 0.006), academic institutions (p < 0.001), and news media (p = 0.043). Correlation analysis Engagement metrics demonstrated strong intercorrelations (Table 2 ), including views–likes (r = 0.85, p < 0.001), views–comments (r = 0.83, p < 0.001), and likes–comments (r = 0.86, p < 0.001). Readability indices showed a strong inverse correlation (FRES–FKGL: r = − 0.79, p < 0.001). Human-based quality scores were also strongly interrelated: DISCERN–GQS (r = 0.95, p < 0.001), DISCERN–JAMA (r = 0.83, p < 0.001), and JAMA–GQS (r = 0.82, p < 0.001). AI-based metrics showed moderate correlations with human ratings, such as DISCERN–AI Accuracy (r = 0.45, p = 0.001) and GQS–AI Accuracy (r = 0.46, p = 0.001). Table 2 Spearman correlation matrix of video characteristics, engagement metrics, quality scores, AI-based evaluation metrics, and readability indices. Spearman correlation coefficients (ρ) are shown. EI represents a composite index of views, likes, and comments. DISCERN, JAMA, and GQS are human-rated quality scores, while AI Accuracy and AI Completeness are AI-based metrics. FRES and FKGL denote readability indices. Statistical significance was defined as p < 0.05 (*p < 0.05, **p < 0.01, ***p < 0.001). Variable 1 2 3 4 5 6 7 8 9 10 11 12 13 14 1. Video length (sec) – 2. Days on air −0.174 – 3. Time since upload (months) −0.174 1.000*** – 4. Total views −0.188 0.738*** 0.738*** – 5. Likes 0.013 0.705*** 0.705*** 0.848*** – 6. Comments −0.026 0.655*** 0.655*** 0.829*** 0.856*** – 7. Engagement Index (EI) 0.471*** −0.209 −0.209 −0.306* 0.114 0.071 – 8. DISCERN 0.198 −0.059 −0.059 0.205 0.157 0.116 −0.137 – 9. JAMA 0.148 −0.118 −0.118 0.071 −0.008 −0.045 −0.260 0.830*** – 10. GQS 0.215 −0.038 −0.038 0.241 0.186 0.146 −0.126 0.946*** 0.818*** – 11. AI Accuracy −0.011 −0.386** −0.386** −0.277 −0.255 −0.255 −0.052 0.453*** 0.414** 0.457*** – 12. AI Completeness 0.325* −0.424** −0.424** −0.362* −0.250 −0.263 0.042 0.445*** 0.464*** 0.469*** 0.712*** – 13. FRES −0.428** 0.254 0.254 0.096 0.045 0.101 −0.042 −0.186 −0.230 −0.216 −0.272 −0.408** – 14. FKGL 0.458*** −0.359* −0.359* −0.166 −0.040 −0.066 0.252 0.172 0.156 0.200 0.255 0.462*** −0.794*** – Professional vs. non-professional comparison When sources were categorized as professional (physicians + academic institutions) or non-professional (patients, health websites, news agencies), significant differences emerged (Table 3 ). Professional videos scored higher in DISCERN (4.10 ± 0.9 vs. 2.80 ± 1.0, p = 0.0001), JAMA (2.80 ± 0.95 vs. 1.70 ± 0.99, p = 0.0007), GQS (4.05 ± 1.1 vs. 2.77 ± 1.1, p = 0.0006), AI Accuracy (4.99 ± 0.04 vs. 4.23 ± 1.24, p = 0.0045), and AI Completeness (4.84 ± 0.49 vs. 4.33 ± 0.91, p = 0.012). Readability scores did not differ significantly (p > 0.05). Table 3 Comparison of video characteristics, engagement metrics, quality scores, AI-based evaluations, and readability indices between professional and non-professional video sources Values are presented as mean (*) values for professional (n = 20) and non-professional (n = 30) video sources. Group comparisons were performed using the Mann–Whitney U test, and corresponding p-values are indicated by (**). P-values shown in bold indicate statistically significant differences between groups (p < 0.05). Video characteristics include video length, days on air, and time since upload. Engagement metrics include total views, likes, comments, and the Engagement Index (EI). Human-rated quality scores include DISCERN, JAMA, and the Global Quality Scale (GQS). Artificial intelligence–based evaluation metrics include AI Accuracy and AI Completeness. Readability indices include the Flesch Reading Ease Score (FRES) and the Flesch–Kincaid Grade Level (FKGL). Variable Professional (Mean) (n = 20) Non-Professional (Mean) (n = 30) p ** Video length, sec * 393.35 316.83 0.26317 Days on air* 1483.25 1576.33 0.80449 Time since upload, months* 49.44 52.54 0.80449 Total views, n* 241372.9 258131.5 0.74383 Likes, n* 2083.2 2357.83 0.85077 Comments,n* 297.2 265.87 0.3781 Engagement index * 1.28 1.0 1.0 DISCERN * 4.1 2.8 0.00011 JAMA * 2.8 1.7 0.00068 GQS * 4.05 2.77 0.00056 AI ACCURACY * 4.99 4.23 0.00453 AI COMPLETENESS* 4.84 4.33 0.01211 FRES * 64.3 64.55 0.92898 FKGL * 8.41 8.42 0.67706 Agreement Between Human and AI-Based Evaluations Agreement between human assessment scales and AI-based quality scores was evaluated using the weighted Cohen’s kappa method (Table 4 ). In the overall sample, no statistically significant agreement was observed between ChatGPT Accuracy scores and either the GQS or DISCERN scales (κ = 0.000 for both comparisons; p = 1.000). In contrast, ChatGPT Completeness scores demonstrated a low-to-moderate but statistically significant agreement with human assessment scales (GQS: κ = 0.281, p = 0.0036; DISCERN: κ = 0.257, p = 0.0064). In subgroup analyses stratified by source type (physician vs non-physician), the agreement between ChatGPT Completeness scores and human assessment scales did not reach statistical significance (all p > 0.05) (Fig. 3 A and 3 B) Table 4 Agreement Between Human and AI-Based Quality Assessments Comparison Overall Professional Non-profesional κ p κ p κ p ChatGPT Accuracy – GQS 0,000 1,000 0,000 1,000 0,000 1,000 ChatGPT Accuracy – DISCERN 0,000 1,000 0,000 1,000 0,000 1,000 ChatGPT Completeness – GQS 0,281 0,0036 0,115 0,249 0,239 0,094 ChatGPT Completeness – DISCERN 0,257 0,0064 0,034 0,583 0,203 0,144 Agreement between human evaluation scales (DISCERN and Global Quality Scale [GQS]) and AI-based quality scores (ChatGPT Accuracy and ChatGPT Completeness) assessed using the weighted Cohen’s kappa method. Results are presented for the overall sample and stratified by source type (physician vs non-physician). Abbreviations: κ, Cohen’s kappa ROC Analysis Receiver operating characteristic (ROC) analysis was performed to evaluate the discriminative performance of ChatGPT Completeness in identifying higher-quality videos (Table S2). ChatGPT Completeness demonstrated a statistically significant diagnostic performance with an area under the curve (AUC) of 0.668 (95% CI: 0.543–0.781; p = 0.004). Using a cut-off value of 5.0, the sensitivity and specificity were 84.2% and 48.4%, respectively (Fig. 4 ). 4.Discussion This study provides a comprehensive evaluation of the educational quality and medical accuracy of YouTube videos on scabies, integrating human expert assessments, AI-based large language model (LLM) analyses, and readability metrics. Of 92 screened videos, 50 met the inclusion criteria. Overall, DISCERN, GQS, and JAMA scores indicated moderate-to-high informational quality, and both human and AI-based measures were comparable to previous video-based evaluations[ 5 , 9 ]. Scores were significantly higher among professionally sourced videos, highlighting marked heterogeneity and the greater reliability of professional content. The internet is now a major medium for public health education, particularly for contagious and stigmatizing dermatoses[ 14 , 15 ]. Patients frequently seek diagnostic and therapeutic information online before consulting a physician, a pattern also reported for acne, psoriasis, atopic dermatitis, and skin care[ 16 , 17 ]. However, this behavior exposes users to inaccurate or incomplete information[ 18 ]. This pattern has been observed not only in dermatology-related videos but also across content analyses from other medical specialties, where user-generated materials have consistently been reported to demonstrate lower accuracy and completeness compared with professionally produced content[ 16 – 21 ]. No significant differences were observed between professional and non-professional sources in visibility or popularity metrics, contrasting with some earlier reports. This aligns with evidence that views, likes, and comments do not reliably reflect medical content quality and with cross-platform observations showing that highly viewed dermatology videos—particularly on TikTok—are frequently produced by non-professional users and do not correspond to higher reliability[ 10 , 22 , 23 ]. Thus, the superiority of professional videos appears independent of simple popularity measures, underscoring the limitations of relying on engagement counts as proxies for educational value. Professionally produced videos achieved significantly higher DISCERN, JAMA, and Global Quality Scale (GQS) scores, reflecting stronger adherence to evidence-based information and ethical transparency[ 21 ]. AI-based evaluations demonstrated a parallel trend, with professionally sourced videos showing significantly higher ChatGPT Accuracy and Completeness scores. Moderate and statistically significant positive correlations were observed between human assessment scales and AI-based quality measures, indicating that AI models are able to capture general trends in content quality. However, despite these correlations, analyses of inter-rater agreement using Cohen’s kappa revealed no significant agreement for ChatGPT Accuracy scores and only low-to-moderate agreement for ChatGPT Completeness scores. These findings suggest that, while AI-based metrics may rank content quality in a direction similar to that of human experts, discrepancies—particularly in accuracy assessments—may be related to the inability of AI systems to fully represent information derived from access-restricted scientific literature and expert experience. This distinction is further supported by the ROC analysis, in which ChatGPT Completeness demonstrated a statistically significant but moderate discriminative performance for identifying higher-quality videos, characterized by high sensitivity but limited specificity. This pattern suggests that the Completeness metric may be useful for preliminary screening and sensitivity-oriented evaluations, but should not be interpreted as a standalone decision-making tool with high discriminative precision. These findings are consistent with a recent systematic review and meta-analysis reporting substantial heterogeneity and only moderate overall accuracy of large language models in medical question-answering tasks, despite their frequent generation of guideline-aligned or partially accurate responses[ 24 ]. In this context, the “Humans in Charge” framework proposed for the integration of artificial intelligence in healthcare is further supported by our results[ 25 , 26 ]. Collectively, our findings suggest that AI-derived quality metrics are better positioned as complementary and scalable tools, particularly for large-scale content screening and preliminary assessment, rather than as replacements for expert human evaluation. Thematic analysis showed that videos predominantly addressed definitions, symptoms, and treatment, whereas preventive hygiene, contact management, and post-scabetic care were infrequently discussed. Similar underrepresentation of prevention and follow-up has been reported in online medical education and dermatology-related social media content[ 27 – 31 ]. In scabies, these omissions are clinically important, as guidelines stress simultaneous treatment of contacts, environmental decontamination, management of post-scabetic pruritus, and clear indications for re-evaluation[ 32 ]. Non-professional materials rarely included such structured recommendations, underscoring the need for expert-driven, guideline-aligned, and clinically comprehensive content[ 33 ]. This study has limitations. YouTube content evolves rapidly, and our cross-sectional design captures only one time point. The modest sample size (n = 50) and restriction to English-language videos limit generalizability to other settings and to populations with lower health literacy. Although DISCERN, JAMA, and GQS are frequently used in dermatology and general medical video evaluations, their dermatology-specific validity is incomplete, and they may miss domains such as cultural sensitivity or shared decision-making[ 19 , 20 , 32 ]. AI-based metrics were derived from a single LLM configuration and text transcripts only; non-verbal cues like demonstrations, production quality, and presenter credibility were not directly assessed. As LLM architectures and training data change, performance and alignment with experts may shift, necessitating ongoing recalibration across conditions, platforms, and languages[ 34 ]. Finally, we did not examine whether higher-quality videos translate into improved patient knowledge, behavior, or clinical outcomes. 5. Conclusions YouTube videos on scabies exhibit substantial variability in reliability, completeness, and educational quality. Professional sources consistently outperformed non-professional ones in both human and AI-based evaluations, yet readability and coverage of prevention, contact management, and post-treatment care remain suboptimal. The lack of association between popularity and quality highlights that online visibility is a poor proxy for educational accuracy. Within this context, our findings suggest that artificial intelligence can evaluate online health information at the level of general quality trends and content coverage, but does not replicate expert judgment in assessing medical accuracy or clinical nuance. Increasing the prominence of evidence-based dermatologic content, aligning video narratives with scabies guidelines, and integrating AI-assisted—but human-supervised—quality monitoring may therefore represent a pragmatic approach to promoting more reliable, scalable, and equitable digital health communication. Declarations Conflicting Interest : The authors declare no conflicts of interest. 7.Funding This study received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. 8.Acknowledgements The authors thank the independent reviewers for their methodological contributions during the evaluation process. 9.Author Contributions Bengisu Meral Ketenci conceived and designed the study, conducted data collection and statistical analyses, interpreted the results, and wrote the original manuscript draft. Özge Sevil Karstarlı Bakay contributed to data evaluation, provided methodological support, critically revised the manuscript for important intellectual content, and supervised the study. Both authors reviewed and approved the final version of the manuscript. 10.Data Availability Statement The datasets generated and analyzed during the current study are available from the corresponding author upon reasonable request. Publicly available video data were obtained from YouTube. Derived evaluation scores and analytical datasets are not publicly available due to analytical processing but may be shared upon request for academic purposes. 11.Additional Information The authors declare no competing interests. Author Contribution Bengisu Meral Ketenci conceived and designed the study, conducted data collection and statistical analyses, interpreted the results, and wrote the original manuscript draft. Özge Sevil Karstarlı Bakay contributed to data evaluation, provided methodological support, critically revised the manuscript for important intellectual content, and supervised the study. Both authors reviewed and approved the final version of the manuscript. Acknowledgement The authors thank the independent reviewers for their methodological contributions during the evaluation process. Data Availability The datasets generated and analyzed during the current study are available from the corresponding author upon reasonable request. Publicly available video data were obtained from YouTube. Derived evaluation scores and analytical datasets are not publicly available due to analytical processing but may be shared upon request for academic purposes. References Sunderkötter, C., Wohlrab, J. & Hamm, H. Scabies: epidemiology, diagnosis, and treatment. Dtsch. Arztebl Int. 118 , 695–704 (2021). Anderson, K. L. & Strowd, L. C. Epidemiology, diagnosis, and treatment of scabies in a dermatology office. J. Am. Board. Fam Med. 30 , 78–84 (2017). Hicks, M. I., Elston, D. M. & Scabies Dermatol. Ther. 22 , 279–292 (2009). Romani, L. et al. Prevalence of scabies and impetigo worldwide: a systematic review. Lancet Infect. Dis. 15 , 960–967 (2015). Ozdemir Kacer, E. & Kacer, I. Evaluating the quality and reliability of YouTube videos on scabies in children: a cross-sectional study. PLoS One . 19 , e0310508 (2024). Kang, E. et al. The quality of evidence of and engagement with video medical claims. JAMA Netw. Open. 9 , e2552106 (2026). Alice, U. et al. Assessing the reliability of YouTube content for plastic surgery patient information in Africa with the modified DISCERN and JAMA scores. Ann. Plast. Surg. 94 , 403–408 (2025). Advanced Web Ranking. Google organic CTR history. (2018). https://www.advancedwebranking.com/ctrstudy/ Gurok, N. G. et al. Scabies on YouTube: the quality, accuracy, and reliability of the videos. Turk. J. Dermatol. 19 , 80–86 (2025). Charnock, D., Shepperd, S., Needham, G. & Gann, R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J. Epidemiol. Community Health . 53 , 105–111 (1999). Serifler, S. & Gul, F. Evaluating tonsillectomy-related YouTube videos via a human expert review and ChatGPT-4: a multi-method quality analysis. BMC Med. Educ. 25 , 1157 (2025). Altun, A. et al. Evaluation of YouTube videos as sources of information about complex regional pain syndrome. Korean J. Pain . 35 , 319–326 (2022). Meyer, M. K. R. et al. Evaluation of rhinoplasty information from ChatGPT, Gemini, and Claude for readability and accuracy. Aesthetic Plast. Surg. 49 , 1868–1873 (2025). Schick, T. S. et al. Impact of digital media on the patient journey and patient–physician relationship among dermatologists and adult patients with skin diseases: qualitative interview study. J. Med. Internet Res. 25 , e44129 (2023). Wojtara, M. Use of social media for patient education in dermatology: narrative review. JMIR Dermatol. 6 , e42609 (2023). Reinhardt, L. et al. Quality, understandability and reliability of YouTube videos on skin cancer screening. J. Cancer Educ. 38 , 1667–1674 (2023). Guzman, A. K. et al. Evaluation of YouTube as an educational resource for treatment options of common dermatologic conditions. Int. J. Dermatol. 59 , e65–e67 (2020). Szeto, M. D. et al. Social media in dermatology and an overview of popular social media platforms. Curr. Dermatol. Rep. 10 , 97–104 (2021). Karadag, A. S. et al. Social media use in dermatology in Turkey: challenges and tips for patient health. JMIR Dermatol. 7 , e51267 (2024). Meral, H. B. et al. Evaluating the educational value and content quality of YouTube videos on myasthenia gravis. Muscle Nerve . 72 , 1067–1073 (2025). Oydanich, M. et al. An analysis of the quality, reliability, and popularity of YouTube videos on glaucoma. Ophthalmol. Glaucoma . 5 , 306–312 (2022). Tackett, S. et al. Medical education videos for the world: an analysis of viewing patterns for a YouTube channel. Acad. Med. 93 , 1150–1156 (2018). Zheng, D. X., Mulligan, K. M. & Scott, J. F. TikTok and dermatology: an opportunity for public health engagement. J. Am. Acad. Dermatol. 85 , e25–e26 (2021). Liu, M. et al. Performance of ChatGPT across different versions in medical licensing examinations worldwide: systematic review and meta-analysis. J. Med. Internet Res. 26 , e60807 (2024). Jaleel, A. et al. Evaluating the potential and accuracy of ChatGPT-3.5 and 4.0 in medical licensing and in-training examinations: systematic review and meta-analysis. JMIR Med. Educ. 11 , e68070 (2025). Herbert, A. S. et al. An evaluation of the readability and content-quality of pelvic organ prolapse YouTube transcripts. Urology 154 , 120–126 (2021). Nigro, A. R. et al. Quality and readability of online educational Mohs micrographic surgery resources. Dermatol. Surg. 50 , 904–907 (2024). White-Williams, C. et al. Addressing social determinants of health in the care of patients with heart failure: a scientific statement from the American Heart Association. Circulation 141 , e841–e863 (2020). Aghajani, M. et al. Evaluating the quality and readability of online information about hidradenitis suppurativa: a systematic review. Clin. Exp. Dermatol. 50 , 1937–1944 (2025). Unal, S. Demirel Ogut, N. Dermatologists' way of informative content about dermatology and cosmetology on social media. J. Cosmet. Dermatol. 24 , e70148 (2025). Barrutia, L. et al. Benefits, drawbacks, and challenges of social media use in dermatology: a systematic review. J. Dermatolog Treat. 33 , 2738–2757 (2022). Uzun, S. et al. Clinical practice guidelines for the diagnosis and treatment of scabies. Int. J. Dermatol. 63 , 1642–1656 (2024). Cooper, B. R. et al. Social media as a medium for dermatologic education. Curr. Dermatol. Rep. 11 , 103–109 (2022). Vrdoljak, J. et al. Evaluating large language and large reasoning models as decision support tools in emergency internal medicine. Comput. Biol. Med. 192 , 110351 (2025). Additional Declarations No competing interests reported. Cite Share Download PDF Status: Under Review Version 1 posted Reviewers invited by journal 11 Mar, 2026 Editor assigned by journal 02 Mar, 2026 Editor invited by journal 26 Feb, 2026 Submission checks completed at journal 24 Feb, 2026 First submitted to journal 24 Feb, 2026 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-8924512","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Article","associatedPublications":[],"authors":[{"id":604358730,"identity":"56f355fc-4ddc-41b0-9e8f-e93e84dea224","order_by":0,"name":"Bengisu MERAL KETENCI","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA9klEQVRIiWNgGAWjYLCChw1AghmIPwAxGzsxWhKhWhhngLQwE60FpIuHAWodPqDb3vvwQ+IOmzx5d/Zn0ja/tsnzMTMwfviYg1uL2ZnjxhKJZ9KKDQ/zmEnn9t02bGNmYJacuQ2PlhtpDBKJbYcTNzbzsEnn9txmBGphY+bFp+X+M+YfiW3/gVqADrPsuW1PWMsNNjagLQcS5zMzmEkz/LidSFjLmTQ2i8QzyYkbmHmMLXsbbie3MTM24/fL8WPMNz7usEuc33/84Y0ff27bzm9vPvjhIx4tcGBwAEgwtoGYjA1EqAcCebC6P8QpHgWjYBSMgpEFAI68USlwr4UHAAAAAElFTkSuQmCC","orcid":"","institution":"konya city hospital","correspondingAuthor":true,"prefix":"","firstName":"Bengisu","middleName":"MERAL","lastName":"KETENCI","suffix":""},{"id":604358731,"identity":"029d682d-39b3-4549-837b-b0581447fe3d","order_by":1,"name":"ozge sevil KARSTARLI BAKAY","email":"","orcid":"","institution":"Pamukkale University","correspondingAuthor":false,"prefix":"","firstName":"ozge","middleName":"sevil KARSTARLI","lastName":"BAKAY","suffix":""}],"badges":[],"createdAt":"2026-02-20 09:53:58","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-8924512/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-8924512/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":104689725,"identity":"efdc239c-0143-414f-971e-0080594172c2","added_by":"auto","created_at":"2026-03-16 06:02:10","extension":"jpg","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":146531,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003ePRISMA-based flow diagram of video selection.\u003c/strong\u003e\u003cbr\u003e\nFlow diagram illustrating the identification, screening, eligibility assessment, and inclusion process of scabies-related YouTube videos. A search using the term “scabies” yielded 92 records. After removal of duplicate entries, 87 videos were screened. Thirty-seven videos were excluded due to unrelated content (n = 12), absence of audio (n = 2), non-English language (n = 19), or low informational quality (n = 4). Fifty videos met the predefined inclusion criteria and were included in the final analysis.\u003c/p\u003e","description":"","filename":"Picture1.jpg","url":"https://assets-eu.researchsquare.com/files/rs-8924512/v1/80e62f4e9306800040ad5bd6.jpg"},{"id":104689726,"identity":"5126113e-3fca-476e-b008-dd6dc032b3da","added_by":"auto","created_at":"2026-03-16 06:02:10","extension":"jpg","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":60293,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eDistribution of scabies-related YouTube video content categories.\u003c/strong\u003e\u003cbr\u003e\nPie chart showing the proportional distribution of included videos across predefined content categories. Each segment represents one of seven numerically coded content categories (1–7), and percentage values indicate the relative frequency of videos within each category among the 50 included videos.\u003c/p\u003e","description":"","filename":"Picture2.jpg","url":"https://assets-eu.researchsquare.com/files/rs-8924512/v1/a29182196e6728cd08ac3e6f.jpg"},{"id":104783051,"identity":"8736a58c-f721-4bfb-a412-eece47c5b854","added_by":"auto","created_at":"2026-03-17 07:58:08","extension":"jpg","order_by":3,"title":"Figure 3","display":"","copyAsset":false,"role":"figure","size":62123,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eAssociation between ChatGPT Completeness and human-based quality scores by source type.\u003c/strong\u003e\u003cbr\u003e\n(A) Scatter plot showing the relationship between ChatGPT Completeness scores (Likert scale) and DISCERN scores, stratified by source type (physician vs non-physician). Solid lines represent linear regression models, and shaded areas indicate 95% confidence intervals.\u003cbr\u003e\n(B) Scatter plot showing the relationship between ChatGPT Completeness scores (Likert scale) and Global Quality Scale (GQS) scores, stratified by source type (physician vs non-physician). Solid lines represent linear regression models, and shaded areas indicate 95% confidence intervals.\u003c/p\u003e","description":"","filename":"Picture3.jpg","url":"https://assets-eu.researchsquare.com/files/rs-8924512/v1/8b570a4430286b20f0af9223.jpg"},{"id":104689723,"identity":"a2af4448-e05c-4e3a-8098-4fb4c06fd5f8","added_by":"auto","created_at":"2026-03-16 06:02:10","extension":"jpg","order_by":4,"title":"Figure 4","display":"","copyAsset":false,"role":"figure","size":122835,"visible":true,"origin":"","legend":"\u003cp\u003e\u003cstrong\u003eReceiver operating characteristic (ROC) curve of ChatGPT Completeness for identifying high-quality videos.\u003c/strong\u003e\u003cbr\u003e\nReceiver operating characteristic (ROC) curve evaluating the discriminatory performance of ChatGPT Completeness in identifying higher-quality scabies-related YouTube videos, defined as Global Quality Scale (GQS) ≥ 4. The area under the curve (AUC), optimal cut-off value, sensitivity, and specificity are shown.\u003c/p\u003e","description":"","filename":"Picture4.jpg","url":"https://assets-eu.researchsquare.com/files/rs-8924512/v1/c23819d7865d6d13a42974e4.jpg"},{"id":104785017,"identity":"8662ed49-1068-499f-ad6a-3f91a84e0957","added_by":"auto","created_at":"2026-03-17 08:09:16","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":1819478,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-8924512/v1/deafc796-7d2b-4354-97bc-2a9d82f5d532.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"\u003cp\u003eCan Artificial Intelligence Evaluate Online Health Information? A Comparative Assessment of Scabies-Related YouTube Videos Using Human Experts and ChatGPT-5 \u003c/p\u003e","fulltext":[{"header":"1.Introduction","content":"\u003cp\u003eScabies is a contagious parasitic skin disease caused by \u003cem\u003eSarcoptes scabiei\u003c/em\u003e var. \u003cem\u003ehominis\u003c/em\u003e, affecting hundreds of millions worldwide[\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e]. Despite being recognized for centuries, it remains a major public health concern, particularly in low-resource and densely populated settings[\u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e]. The infestation typically presents with intense nocturnal pruritus and erythematous papules or burrows, often complicated by secondary bacterial infections that may lead to significant morbidity, especially in children and immunocompromised individuals[\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eAlthough scabies is treatable with topical or oral scabicides, difficulties such as persistent pruritus, fear of reinfestation, and treatment misuse are common. In pediatric cases, parental anxiety and misinformation further complicate management[\u003cspan citationid=\"CR4\" class=\"CitationRef\"\u003e4\u003c/span\u003e]. Consequently, patients and caregivers increasingly seek reliable online information to enhance disease understanding and treatment adherence.\u003c/p\u003e \u003cp\u003eDigital platforms have transformed public access to health information, with YouTube emerging as a widely used source for dermatologic content, including scabies[\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e]. Its visual format and accessibility make it particularly appealing for non-professional audiences[\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e]. However, the absence of content regulation allows dissemination of inaccurate or incomplete medical information, potentially leading to inappropriate treatment practices or delayed medical consultation[\u003cspan citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e]. To our knowledge, scabies-related YouTube content has not previously been evaluated using an integrated methodology combining human expert assessment and large language model\u0026ndash;based analysis.\u003c/p\u003e \u003cp\u003eGiven these concerns, the present study evaluates the reliability and educational quality of scabies-related YouTube videos using established human-based assessment tools\u0026mdash;DISCERN, JAMA, and GQS\u0026mdash;together with AI-assisted evaluation using the ChatGPT-5 model and readability analyses. Beyond content characterization, this approach specifically addresses whether artificial intelligence can meaningfully align with human expert judgment in evaluating online health information, or whether it functions primarily as a complementary screening tool rather than a human-level evaluator. By examining scabies-related videos\u0026mdash;a common yet underexplored topic in the digital health literature\u0026mdash;this study aims to contribute to the growing discussion on the role of large language models in assessing the quality of online medical information.\u003c/p\u003e"},{"header":"2. Materials and Methods","content":"\u003cp\u003eIn this descriptive study, a YouTube search (\u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://www.youtube.com\u003c/span\u003e\u003cspan address=\"https://www.youtube.com\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e) was conducted on September 10, 2025, using the term \u0026ldquo;scabies disease.\u0026rdquo; To minimize algorithmic bias, the search was performed in incognito mode on a cleared browser without a logged-in account, and the term was selected based on commonly used keywords from highly viewed scabies-related videos. Results were sorted by view count to reflect typical user behavior. Because most viewers primarily engage with the highest-ranked search outputs and videos beyond the 50th position receive minimal traffic, the first 50 videos meeting the inclusion criteria were selected, replicating real-world viewing patterns[\u003cspan citationid=\"CR8\" class=\"CitationRef\"\u003e8\u003c/span\u003e]. To ensure reproducibility, the search was repeated on a second computer and a different internet network on the same day. Video titles and descriptions were screened independently by two dermatology specialists. Inclusion criteria required videos to be in English, at least 60 seconds in duration, publicly accessible, and to provide audio-visual medical or educational information directly related to scabies. Exclusion criteria included poor or absent audio, irrelevant content (general health topics, unrelated dermatologic diseases, or personal stories), promotional material without educational value, duplicate uploads (retaining the earliest or most-viewed version), videos under 60 seconds, and clips consisting solely of on-screen text without narration. All videos were screened using the same criteria, and categorization by source and presenter type (physician, academic institution, patient-generated, health website, news media) was conducted only after the inclusion phase during subgroup analysis. These procedures were adapted from previously published methodologies[\u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eAs this study involved only publicly available online content and did not include human participants, identifiable personal data, or animal subjects, approval from an ethics committee was not required.\u003c/p\u003e \u003cdiv id=\"Sec3\" class=\"Section2\"\u003e \u003ch2\u003e2.1 Evaluation of Video Content\u003c/h2\u003e \u003cp\u003eThe included videos were independently evaluated by two dermatology specialists who are co-authors of this manuscript. To establish a standardized framework, prior YouTube-based medical content analyses were reviewed. Each video was classified into one of seven thematic domains: (1) definition and transmission; (2) clinical features; (3) diagnostic procedures; (4) treatment and management; (5) prevention and hygiene; (6) prognosis and follow-up; and (7) other related topics. The \u0026ldquo;other\u0026rdquo; category encompassed content on special populations, public health messages, complications, and common myths.\u003c/p\u003e \u003cp\u003eThe interobserver reliability between the two dermatologists was evaluated using the kappa statistic. In cases of disagreement, a final decision was made through joint re-evaluation and discussion to reach a consensus.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec4\" class=\"Section2\"\u003e \u003ch2\u003e2.2 Video Characteristics\u003c/h2\u003e \u003cp\u003eFor every video included in the analysis, the duration (in seconds), total number of views, and time elapsed since upload (in months) were recorded. The latter parameter was also converted into days on air to ensure greater temporal precision in descriptive statistics. Viewer interaction was quantified through an Engagement Index (EI), calculated using the following formula:\u003c/p\u003e \u003cp\u003eEI = ((likes\u0026thinsp;+\u0026thinsp;comments) / views) \u0026times; 100.\u003c/p\u003e \u003cp\u003eThis index provided a standardized indicator of audience engagement relative to the visibility of each video.\u003c/p\u003e \u003cp\u003eVideos were classified into five distinct categories based on their source of upload:\u003c/p\u003e \u003cp\u003e \u003cb\u003ePhysicians\u003c/b\u003e \u003c/p\u003e \u003cp\u003eContent created and shared by dermatologists or other medical doctors explaining diagnostic or therapeutic aspects of scabies.\u003c/p\u003e \u003cp\u003e \u003cb\u003ePatients or Individual Users\u003c/b\u003e \u003c/p\u003e \u003cp\u003ePersonal experiences or self-reported accounts uploaded by individuals affected by scabies.\u003c/p\u003e \u003cp\u003e \u003cb\u003eHealth-Related Websites or Online Platforms\u003c/b\u003e \u003c/p\u003e \u003cp\u003eNon-academic and non-governmental sources delivering general health or dermatology-related information.\u003c/p\u003e \u003cp\u003e \u003cb\u003eAcademic Institutions or Professional Organizations\u003c/b\u003e \u003c/p\u003e \u003cp\u003eUniversities, teaching hospitals, and dermatology societies producing scientifically grounded educational material.\u003c/p\u003e \u003cp\u003e \u003cb\u003eNews Agencies\u003c/b\u003e \u003c/p\u003e \u003cp\u003eInformative or public health\u0026ndash;oriented content released by national or international media outlets.\u003c/p\u003e \u003cp\u003eWhen duplicate or nearly identical videos were detected, only the version with the earliest publication date and highest view count was retained, while the others were excluded to avoid redundancy.\u003c/p\u003e \u003cp\u003eThe presenter\u0026rsquo;s gender was identified as female, male, or both, according to observable visual or auditory characteristics. If both male and female speakers appeared, the video was classified as \u0026ldquo;both genders.\u0026rdquo; When gender determination was uncertain, it was omitted from the dataset.\u003c/p\u003e \u003cp\u003eUltimately, the videos were grouped into two overarching categories according to their source of production, rather than their intended audience:\u003c/p\u003e \u003cp\u003e(1) Professional videos, produced by physicians, universities, or professional organizations; and\u003c/p\u003e \u003cp\u003e(2) Non-professional videos, created by patients, individual users, health-related websites, or news agencies.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec5\" class=\"Section2\"\u003e \u003ch2\u003e2.3 Evaluation of Informational Quality and Educational Value of Videos\u003c/h2\u003e \u003cdiv id=\"Sec6\" class=\"Section3\"\u003e \u003ch2\u003e2.3.1 Human Reviewer Evaluation\u003c/h2\u003e \u003cp\u003eThe informational quality of the videos was assessed by two independent dermatology specialists, each with more than five years of clinical experience in dermatological practice. Prior to data collection, both reviewers underwent standardized instruction on applying the DISCERN, JAMA, and Global Quality Scale (GQS) instruments to ensure interrater consistency.\u003c/p\u003e \u003cp\u003eThe modified DISCERN tool, derived from the original instrument developed by Charnock et al., was used to evaluate the reliability and quality of treatment-related health information[\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e]. It consists of five yes/no items scored as \u0026ldquo;yes\u0026rdquo; (1 point) or \u0026ldquo;no\u0026rdquo; (0 points), yielding a total score from 0 (lowest quality) to 5 (highest quality).\u003c/p\u003e \u003cp\u003eThe JAMA benchmark criteria, originally introduced by Silberg et al., were also applied to assess the authorship, attribution, disclosure, and currency of each video[\u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e]. Each fulfilled criterion was assigned one point, producing a total JAMA score between 0 and 4.\u003c/p\u003e \u003cp\u003eIn addition, the 5-point Global Quality Scale (GQS) developed by Bernard et al., was used to rate the overall educational value and coherence of the videos (1\u0026ndash;2\u0026thinsp;=\u0026thinsp;low, 3\u0026thinsp;=\u0026thinsp;moderate, 4\u0026ndash;5\u0026thinsp;=\u0026thinsp;high quality)[\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e]. Each video was reviewed independently by both raters, and discrepancies were resolved by consensus after discussion. Inter-rater reliability for DISCERN, JAMA, and GQS evaluations was measured using Cohen\u0026rsquo;s κ (κ\u0026thinsp;=\u0026thinsp;0.87) and intraclass correlation coefficient (ICC(2,k)\u0026thinsp;=\u0026thinsp;0.90), indicating excellent agreement.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec7\" class=\"Section3\"\u003e \u003ch2\u003e2.3.2 AI-Based Evaluation\u003c/h2\u003e \u003cp\u003eTo complement human assessment, the corrected transcripts of all included videos were analyzed using the ChatGPT-5 model (OpenAI, 2025 version). A standardized prompt was used to evaluate each video for medical accuracy and informational completeness on a 5-point Likert scale (1\u0026thinsp;=\u0026thinsp;poor, 5\u0026thinsp;=\u0026thinsp;excellent). The model outputs were automatically parsed and statistically compared with human reviewer scores to explore agreement levels. Transcripts were automatically generated using YouTube\u0026rsquo;s closed captions feature and manually proofread by the researchers to ensure accuracy.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec8\" class=\"Section3\"\u003e \u003ch2\u003e2.3.3 Readability Analyse\u003c/h2\u003e \u003cp\u003eReadability metrics were calculated for each video transcript using the online tool Read-Able (\u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://www.webfx.com/tools/read-able/\u003c/span\u003e\u003cspan address=\"https://www.webfx.com/tools/read-able/\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e). The Flesch Reading Ease Score (FRES) and Flesch\u0026ndash;Kincaid Grade Level (FKGL) were computed to determine linguistic accessibility and complexity of the content[\u003cspan citationid=\"CR13\" class=\"CitationRef\"\u003e13\u003c/span\u003e]. Higher FRES values indicate easier readability, whereas higher FKGL values correspond to more complex, higher-grade-level language.\u003c/p\u003e \u003c/div\u003e \u003c/div\u003e \u003cdiv id=\"Sec9\" class=\"Section2\"\u003e \u003ch2\u003e2.4 Statistical Analysis\u003c/h2\u003e \u003cp\u003eAnalyses were performed using SPSS version 31 (IBM Corp.). Statistical significance was set at p\u0026thinsp;\u0026lt;\u0026thinsp;0.05. The strength of the correlations was interpreted as strong (0.70\u0026ndash;0.99), moderate (0.50\u0026ndash;0.69), weak (0.01\u0026ndash;0.49), or none (0), according to the correlation coefficient.\u003c/p\u003e \u003c/div\u003e"},{"header":"3.Results","content":"\u003cp\u003eA total of 92 YouTube videos related to scabies were screened, and 50 met the inclusion criteria. The selection process is shown in Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e. Table\u0026nbsp;\u003cspan refid=\"Tab1\" class=\"InternalRef\"\u003e1\u003c/span\u003e summarizes video characteristics, which showed wide variation in duration, time online, and engagement metrics. The mean DISCERN, GQS, and JAMA scores were 3.46\u0026thinsp;\u0026plusmn;\u0026thinsp;1.1, 3.42\u0026thinsp;\u0026plusmn;\u0026thinsp;1.0, and 2.23\u0026thinsp;\u0026plusmn;\u0026thinsp;1.1. AI-based evaluations yielded mean ChatGPT Accuracy and Completeness scores of 4.62\u0026thinsp;\u0026plusmn;\u0026thinsp;0.92 and 4.51\u0026thinsp;\u0026plusmn;\u0026thinsp;0.85. Readability analysis showed mean FRES and FKGL values of 64.8\u0026thinsp;\u0026plusmn;\u0026thinsp;6.3 and 9.2\u0026thinsp;\u0026plusmn;\u0026thinsp;1.0. Treatment and management was the most frequently covered domain (86%), followed by diagnostics (46%), clinical features (42%), and definitions/transmission (38%). As shown in Fig.\u0026nbsp;\u003cspan refid=\"Fig2\" class=\"InternalRef\"\u003e2\u003c/span\u003e, preventive hygiene (28%), prognosis/follow-up (18%), and other topics (12%) were the least represented categories.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab1\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003e\u003cb\u003eDescriptive statistics of video characteristics, engagement metrics, and quality scores\u003c/b\u003e This table summarizes the descriptive statistics for all variables included in the study, including video characteristics (length, days on air, time since upload), viewer engagement metrics (total views, likes, comments, engagement index), human-rated quality scores (DISCERN, JAMA, GQS), and AI-based evaluation metrics (Accuracy and Completeness). Readability indices (FRES and FKGL) are also presented. For each variable, the mean, standard deviation (SD), median, minimum (Min), and maximum (Max) values are reported. These descriptive metrics provide an overview of the distribution and variability of the dataset used for subsequent correlation and multivariate regression analyses.\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"6\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c6\" colnum=\"6\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\" morerows=\"1\" rowspan=\"2\"\u003e \u003cp\u003e\u003cb\u003eVideo length, sec\u003c/b\u003e\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eMean\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eSD\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003eMedian\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e \u003cp\u003eMin\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c6\"\u003e \u003cp\u003eMax\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003e347.44\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003e229.04\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003e302.0\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e \u003cp\u003e63.0\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c6\"\u003e \u003cp\u003e896.0\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eDays\u0026nbsp;on\u0026nbsp;air\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e1539.1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1340.92\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e955.5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e69.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e4594.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eTime\u0026nbsp;since\u0026nbsp;upload,\u0026nbsp;months\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e51.3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e44.7\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e31.85\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e2.3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e153.13\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eTotal views, n\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e251428.06\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e359526.13\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e93500.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e1500.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e1674457.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eLikes, n\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e2247.98\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e4631.84\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e529.5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e0.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e24000.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eComments, n\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e278.4\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e485.02\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e68.5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e0.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e2405.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eEngagement index\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e1.11\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1.07\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.79\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e0.01\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e6.61\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eDISCERN\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e3.32\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1.17\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e3.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e1.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e5.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eJAMA\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e2.14\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1.11\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e2.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e0.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e4.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eGQS\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e3.28\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1.26\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e3.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e1.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e5.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eAI\u0026nbsp;,ACCURACY\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e4.54\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1.03\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e5.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e1.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e5.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eAI ,COMPLETENESS\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e4.53\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e0.8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e5.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e2.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e5.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eFRES\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e64.45\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e4.46\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e64.6\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e54.8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e74.1\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eFKGL\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e8.41\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e0.85\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e8.5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e5.24\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e9.8\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003e \u003cb\u003eVideo source analysis\u003c/b\u003e \u003c/p\u003e \u003cp\u003eQuality indicators differed significantly across the five video source categories (Table S1). For JAMA scores, one-way ANOVA demonstrated a significant group effect (F\u0026thinsp;=\u0026thinsp;7.93, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001). Tukey\u0026rsquo;s HSD indicated that patient-generated videos scored significantly lower than those from physicians (p\u0026thinsp;=\u0026thinsp;0.002) and academic institutions (p\u0026thinsp;\u0026lt;\u0026thinsp;0.001). For DISCERN, group differences were more pronounced (F\u0026thinsp;=\u0026thinsp;10.42, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001), with patient-generated videos scoring significantly lower than physicians (p\u0026thinsp;\u0026lt;\u0026thinsp;0.001), health-related websites (p\u0026thinsp;=\u0026thinsp;0.011), academic institutions (p\u0026thinsp;\u0026lt;\u0026thinsp;0.001), and news agencies (p\u0026thinsp;=\u0026thinsp;0.035). GQS also differed significantly by source (F\u0026thinsp;=\u0026thinsp;10.09, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001); patient-generated videos consistently scored the lowest, performing significantly worse than physicians (p\u0026thinsp;\u0026lt;\u0026thinsp;0.001), health websites (p\u0026thinsp;=\u0026thinsp;0.006), academic institutions (p\u0026thinsp;\u0026lt;\u0026thinsp;0.001), and news media (p\u0026thinsp;=\u0026thinsp;0.043).\u003c/p\u003e \u003cp\u003e \u003cb\u003eCorrelation analysis\u003c/b\u003e \u003c/p\u003e \u003cp\u003eEngagement metrics demonstrated strong intercorrelations (Table\u0026nbsp;\u003cspan refid=\"Tab2\" class=\"InternalRef\"\u003e2\u003c/span\u003e), including views\u0026ndash;likes (r\u0026thinsp;=\u0026thinsp;0.85, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001), views\u0026ndash;comments (r\u0026thinsp;=\u0026thinsp;0.83, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001), and likes\u0026ndash;comments (r\u0026thinsp;=\u0026thinsp;0.86, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001). Readability indices showed a strong inverse correlation (FRES\u0026ndash;FKGL: r = \u0026minus;\u0026thinsp;0.79, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001). Human-based quality scores were also strongly interrelated: DISCERN\u0026ndash;GQS (r\u0026thinsp;=\u0026thinsp;0.95, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001), DISCERN\u0026ndash;JAMA (r\u0026thinsp;=\u0026thinsp;0.83, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001), and JAMA\u0026ndash;GQS (r\u0026thinsp;=\u0026thinsp;0.82, p\u0026thinsp;\u0026lt;\u0026thinsp;0.001). AI-based metrics showed moderate correlations with human ratings, such as DISCERN\u0026ndash;AI Accuracy (r\u0026thinsp;=\u0026thinsp;0.45, p\u0026thinsp;=\u0026thinsp;0.001) and GQS\u0026ndash;AI Accuracy (r\u0026thinsp;=\u0026thinsp;0.46, p\u0026thinsp;=\u0026thinsp;0.001).\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab2\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 2\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003e\u003cem\u003eSpearman correlation matrix of video characteristics, engagement metrics, quality scores, AI-based evaluation metrics, and readability indices.\u003c/em\u003e Spearman correlation coefficients (ρ) are shown. EI represents a composite index of views, likes, and comments. DISCERN, JAMA, and GQS are human-rated quality scores, while AI Accuracy and AI Completeness are AI-based metrics. FRES and FKGL denote readability indices. \u003cb\u003eStatistical significance was defined as p\u0026thinsp;\u0026lt;\u0026thinsp;0.05\u003c/b\u003e (*p\u0026thinsp;\u0026lt;\u0026thinsp;0.05, **p\u0026thinsp;\u0026lt;\u0026thinsp;0.01, ***p\u0026thinsp;\u0026lt;\u0026thinsp;0.001).\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"15\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c6\" colnum=\"6\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c7\" colnum=\"7\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c8\" colnum=\"8\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c9\" colnum=\"9\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c10\" colnum=\"10\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c11\" colnum=\"11\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c12\" colnum=\"12\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c13\" colnum=\"13\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c14\" colnum=\"14\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c15\" colnum=\"15\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eVariable\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003e1\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003e2\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003e3\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e \u003cp\u003e4\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c6\"\u003e \u003cp\u003e5\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c7\"\u003e \u003cp\u003e6\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c8\"\u003e \u003cp\u003e7\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c9\"\u003e \u003cp\u003e8\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c10\"\u003e \u003cp\u003e9\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c11\"\u003e \u003cp\u003e10\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c12\"\u003e \u003cp\u003e11\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c13\"\u003e \u003cp\u003e12\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c14\"\u003e \u003cp\u003e13\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c15\"\u003e \u003cp\u003e14\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e1. Video length (sec)\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e2. Days on air\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u0026minus;0.174\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e3. Time since upload (months)\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u0026minus;0.174\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e1.000***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e4. Total views\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u0026minus;0.188\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e0.738***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.738***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e5. Likes\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.013\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e0.705***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.705***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e0.848***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e6. Comments\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u0026minus;0.026\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e0.655***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.655***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e0.829***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e0.856***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e7. Engagement Index (EI)\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.471***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u0026minus;0.209\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u0026minus;0.209\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e\u0026minus;0.306*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e0.114\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e \u003cp\u003e0.071\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e8. DISCERN\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.198\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u0026minus;0.059\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u0026minus;0.059\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e0.205\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e0.157\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e \u003cp\u003e0.116\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e \u003cp\u003e\u0026minus;0.137\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e9. JAMA\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.148\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u0026minus;0.118\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u0026minus;0.118\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e0.071\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e\u0026minus;0.008\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e \u003cp\u003e\u0026minus;0.045\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e \u003cp\u003e\u0026minus;0.260\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e \u003cp\u003e0.830***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e10. GQS\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.215\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u0026minus;0.038\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u0026minus;0.038\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e0.241\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e0.186\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e \u003cp\u003e0.146\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e \u003cp\u003e\u0026minus;0.126\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e \u003cp\u003e0.946***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e \u003cp\u003e0.818***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e11. AI Accuracy\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u0026minus;0.011\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u0026minus;0.386**\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u0026minus;0.386**\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e\u0026minus;0.277\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e\u0026minus;0.255\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e \u003cp\u003e\u0026minus;0.255\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e \u003cp\u003e\u0026minus;0.052\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e \u003cp\u003e0.453***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e \u003cp\u003e0.414**\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e \u003cp\u003e0.457***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e12. AI Completeness\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.325*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u0026minus;0.424**\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u0026minus;0.424**\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e\u0026minus;0.362*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e\u0026minus;0.250\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e \u003cp\u003e\u0026minus;0.263\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e \u003cp\u003e0.042\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e \u003cp\u003e0.445***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e \u003cp\u003e0.464***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e \u003cp\u003e0.469***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e \u003cp\u003e0.712***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e13. FRES\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u0026minus;0.428**\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e0.254\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.254\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e0.096\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e0.045\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e \u003cp\u003e0.101\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e \u003cp\u003e\u0026minus;0.042\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e \u003cp\u003e\u0026minus;0.186\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e \u003cp\u003e\u0026minus;0.230\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e \u003cp\u003e\u0026minus;0.216\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e \u003cp\u003e\u0026minus;0.272\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e \u003cp\u003e\u0026minus;0.408**\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003e14. FKGL\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e0.458***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u0026minus;0.359*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u0026minus;0.359*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e \u003cp\u003e\u0026minus;0.166\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003e\u0026minus;0.040\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c7\"\u003e \u003cp\u003e\u0026minus;0.066\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c8\"\u003e \u003cp\u003e0.252\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c9\"\u003e \u003cp\u003e0.172\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c10\"\u003e \u003cp\u003e0.156\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c11\"\u003e \u003cp\u003e0.200\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c12\"\u003e \u003cp\u003e0.255\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c13\"\u003e \u003cp\u003e0.462***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c14\"\u003e \u003cp\u003e\u0026minus;0.794***\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c15\"\u003e \u003cp\u003e\u0026ndash;\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003e \u003cb\u003eProfessional vs. non-professional comparison\u003c/b\u003e \u003c/p\u003e \u003cp\u003eWhen sources were categorized as professional (physicians\u0026thinsp;+\u0026thinsp;academic institutions) or non-professional (patients, health websites, news agencies), significant differences emerged (Table\u0026nbsp;\u003cspan refid=\"Tab3\" class=\"InternalRef\"\u003e3\u003c/span\u003e). Professional videos scored higher in DISCERN (4.10\u0026thinsp;\u0026plusmn;\u0026thinsp;0.9 vs. 2.80\u0026thinsp;\u0026plusmn;\u0026thinsp;1.0, p\u0026thinsp;=\u0026thinsp;0.0001), JAMA (2.80\u0026thinsp;\u0026plusmn;\u0026thinsp;0.95 vs. 1.70\u0026thinsp;\u0026plusmn;\u0026thinsp;0.99, p\u0026thinsp;=\u0026thinsp;0.0007), GQS (4.05\u0026thinsp;\u0026plusmn;\u0026thinsp;1.1 vs. 2.77\u0026thinsp;\u0026plusmn;\u0026thinsp;1.1, p\u0026thinsp;=\u0026thinsp;0.0006), AI Accuracy (4.99\u0026thinsp;\u0026plusmn;\u0026thinsp;0.04 vs. 4.23\u0026thinsp;\u0026plusmn;\u0026thinsp;1.24, p\u0026thinsp;=\u0026thinsp;0.0045), and AI Completeness (4.84\u0026thinsp;\u0026plusmn;\u0026thinsp;0.49 vs. 4.33\u0026thinsp;\u0026plusmn;\u0026thinsp;0.91, p\u0026thinsp;=\u0026thinsp;0.012). Readability scores did not differ significantly (p\u0026thinsp;\u0026gt;\u0026thinsp;0.05).\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab3\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 3\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003e\u003cb\u003eComparison of video characteristics, engagement metrics, quality scores, AI-based evaluations, and readability indices between professional and non-professional video sources\u003c/b\u003e Values are presented as mean (*) values for professional (n\u0026thinsp;=\u0026thinsp;20) and non-professional (n\u0026thinsp;=\u0026thinsp;30) video sources. Group comparisons were performed using the Mann\u0026ndash;Whitney U test, and corresponding p-values are indicated by (**). P-values shown in bold indicate statistically significant differences between groups (p\u0026thinsp;\u0026lt;\u0026thinsp;0.05). Video characteristics include video length, days on air, and time since upload. Engagement metrics include total views, likes, comments, and the Engagement Index (EI). Human-rated quality scores include DISCERN, JAMA, and the Global Quality Scale (GQS). Artificial intelligence\u0026ndash;based evaluation metrics include AI Accuracy and AI Completeness. Readability indices include the Flesch Reading Ease Score (FRES) and the Flesch\u0026ndash;Kincaid Grade Level (FKGL).\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"4\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eVariable\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eProfessional (Mean) (n\u0026thinsp;=\u0026thinsp;20)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eNon-Professional\u003c/p\u003e \u003cp\u003e(Mean) (n\u0026thinsp;=\u0026thinsp;30)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003ep **\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eVideo length, sec *\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e393.35\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e316.83\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.26317\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eDays\u0026nbsp;on\u0026nbsp;air*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e1483.25\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1576.33\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.80449\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eTime\u0026nbsp;since\u0026nbsp;upload,\u0026nbsp;months*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e49.44\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e52.54\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.80449\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eTotal views, n*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e241372.9\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e258131.5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.74383\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eLikes, n*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e2083.2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e2357.83\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.85077\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eComments,n*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e297.2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e265.87\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.3781\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eEngagement index *\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e1.28\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e1.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eDISCERN *\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e4.1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e2.8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e0.00011\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eJAMA *\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e2.8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1.7\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e0.00068\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eGQS *\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e4.05\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e2.77\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e0.00056\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eAI ACCURACY *\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e4.99\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e4.23\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e0.00453\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eAI COMPLETENESS*\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e4.84\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e4.33\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e0.01211\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eFRES *\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e64.3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e64.55\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.92898\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eFKGL *\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e8.41\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e8.42\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0.67706\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003e \u003cb\u003eAgreement Between Human and AI-Based Evaluations\u003c/b\u003e \u003c/p\u003e \u003cp\u003eAgreement between human assessment scales and AI-based quality scores was evaluated using the weighted Cohen\u0026rsquo;s kappa method (Table\u0026nbsp;\u003cspan refid=\"Tab4\" class=\"InternalRef\"\u003e4\u003c/span\u003e). In the overall sample, no statistically significant agreement was observed between ChatGPT Accuracy scores and either the GQS or DISCERN scales (κ\u0026thinsp;=\u0026thinsp;0.000 for both comparisons; p\u0026thinsp;=\u0026thinsp;1.000). In contrast, ChatGPT Completeness scores demonstrated a low-to-moderate but statistically significant agreement with human assessment scales (GQS: κ\u0026thinsp;=\u0026thinsp;0.281, p\u0026thinsp;=\u0026thinsp;0.0036; DISCERN: κ\u0026thinsp;=\u0026thinsp;0.257, p\u0026thinsp;=\u0026thinsp;0.0064). In subgroup analyses stratified by source type (physician vs non-physician), the agreement between ChatGPT Completeness scores and human assessment scales did not reach statistical significance (all p\u0026thinsp;\u0026gt;\u0026thinsp;0.05) (Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003eA and \u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003eB)\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab4\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 4\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eAgreement Between Human and AI-Based Quality Assessments\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"7\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c6\" colnum=\"6\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c7\" colnum=\"7\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\" morerows=\"1\" rowspan=\"2\"\u003e \u003cp\u003eComparison\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colspan=\"2\" nameend=\"c3\" namest=\"c2\"\u003e \u003cp\u003eOverall\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colspan=\"2\" nameend=\"c5\" namest=\"c4\"\u003e \u003cp\u003eProfessional\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colspan=\"2\" nameend=\"c7\" namest=\"c6\"\u003e \u003cp\u003eNon-profesional\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eκ\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003ep\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003eκ\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e \u003cp\u003ep\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c6\"\u003e \u003cp\u003eκ\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c7\"\u003e \u003cp\u003ep\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eChatGPT Accuracy \u0026ndash; GQS\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e0,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e1,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e0,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c7\"\u003e \u003cp\u003e1,000\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eChatGPT Accuracy \u0026ndash; DISCERN\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e0,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e1,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e1,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e0,000\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c7\"\u003e \u003cp\u003e1,000\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eChatGPT Completeness \u0026ndash; GQS\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003e0,281\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e\u003cb\u003e0,0036\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0,115\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e0,249\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e0,239\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c7\"\u003e \u003cp\u003e0,094\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cb\u003eChatGPT Completeness \u0026ndash; DISCERN\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003e0,257\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e\u003cb\u003e0,0064\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e0,034\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e0,583\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c6\"\u003e \u003cp\u003e0,203\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c7\"\u003e \u003cp\u003e0,144\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003ctfoot\u003e \u003ctr\u003e\u003ctd colspan=\"7\"\u003e\u003cem\u003eAgreement between human evaluation scales (DISCERN and Global Quality Scale [GQS]) and AI-based quality scores (ChatGPT Accuracy and ChatGPT Completeness) assessed using the weighted Cohen\u0026rsquo;s kappa method. Results are presented for the overall sample and stratified by source type (physician vs non-physician).\u003c/em\u003e\u003c/td\u003e\u003c/tr\u003e \u003ctr\u003e\u003ctd colspan=\"7\"\u003eAbbreviations:\u003c/td\u003e\u003c/tr\u003e \u003ctr\u003e\u003ctd colspan=\"7\"\u003eκ, Cohen\u0026rsquo;s kappa\u003c/td\u003e\u003c/tr\u003e \u003c/tfoot\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eROC Analysis\u003c/p\u003e \u003cp\u003eReceiver operating characteristic (ROC) analysis was performed to evaluate the discriminative performance of ChatGPT Completeness in identifying higher-quality videos (Table S2). ChatGPT Completeness demonstrated a statistically significant diagnostic performance with an area under the curve (AUC) of 0.668 (95% CI: 0.543\u0026ndash;0.781; p\u0026thinsp;=\u0026thinsp;0.004). Using a cut-off value of 5.0, the sensitivity and specificity were 84.2% and 48.4%, respectively (Fig.\u0026nbsp;\u003cspan refid=\"Fig4\" class=\"InternalRef\"\u003e4\u003c/span\u003e).\u003c/p\u003e"},{"header":"4.Discussion","content":"\u003cp\u003eThis study provides a comprehensive evaluation of the educational quality and medical accuracy of YouTube videos on scabies, integrating human expert assessments, AI-based large language model (LLM) analyses, and readability metrics. Of 92 screened videos, 50 met the inclusion criteria. Overall, DISCERN, GQS, and JAMA scores indicated moderate-to-high informational quality, and both human and AI-based measures were comparable to previous video-based evaluations[\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e, \u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e]. Scores were significantly higher among professionally sourced videos, highlighting marked heterogeneity and the greater reliability of professional content.\u003c/p\u003e \u003cp\u003eThe internet is now a major medium for public health education, particularly for contagious and stigmatizing dermatoses[\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e, \u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e]. Patients frequently seek diagnostic and therapeutic information online before consulting a physician, a pattern also reported for acne, psoriasis, atopic dermatitis, and skin care[\u003cspan citationid=\"CR16\" class=\"CitationRef\"\u003e16\u003c/span\u003e, \u003cspan citationid=\"CR17\" class=\"CitationRef\"\u003e17\u003c/span\u003e]. However, this behavior exposes users to inaccurate or incomplete information[\u003cspan citationid=\"CR18\" class=\"CitationRef\"\u003e18\u003c/span\u003e]. This pattern has been observed not only in dermatology-related videos but also across content analyses from other medical specialties, where user-generated materials have consistently been reported to demonstrate lower accuracy and completeness compared with professionally produced content[\u003cspan additionalcitationids=\"CR17 CR18 CR19 CR20\" citationid=\"CR16\" class=\"CitationRef\"\u003e16\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eNo significant differences were observed between professional and non-professional sources in visibility or popularity metrics, contrasting with some earlier reports. This aligns with evidence that views, likes, and comments do not reliably reflect medical content quality and with cross-platform observations showing that highly viewed dermatology videos\u0026mdash;particularly on TikTok\u0026mdash;are frequently produced by non-professional users and do not correspond to higher reliability[\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e, \u003cspan citationid=\"CR22\" class=\"CitationRef\"\u003e22\u003c/span\u003e, \u003cspan citationid=\"CR23\" class=\"CitationRef\"\u003e23\u003c/span\u003e]. Thus, the superiority of professional videos appears independent of simple popularity measures, underscoring the limitations of relying on engagement counts as proxies for educational value.\u003c/p\u003e \u003cp\u003eProfessionally produced videos achieved significantly higher DISCERN, JAMA, and Global Quality Scale (GQS) scores, reflecting stronger adherence to evidence-based information and ethical transparency[\u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e]. AI-based evaluations demonstrated a parallel trend, with professionally sourced videos showing significantly higher ChatGPT Accuracy and Completeness scores. Moderate and statistically significant positive correlations were observed between human assessment scales and AI-based quality measures, indicating that AI models are able to capture general trends in content quality. However, despite these correlations, analyses of inter-rater agreement using Cohen\u0026rsquo;s kappa revealed no significant agreement for ChatGPT Accuracy scores and only low-to-moderate agreement for ChatGPT Completeness scores. These findings suggest that, while AI-based metrics may rank content quality in a direction similar to that of human experts, discrepancies\u0026mdash;particularly in accuracy assessments\u0026mdash;may be related to the inability of AI systems to fully represent information derived from access-restricted scientific literature and expert experience. This distinction is further supported by the ROC analysis, in which ChatGPT Completeness demonstrated a statistically significant but moderate discriminative performance for identifying higher-quality videos, characterized by high sensitivity but limited specificity. This pattern suggests that the Completeness metric may be useful for preliminary screening and sensitivity-oriented evaluations, but should not be interpreted as a standalone decision-making tool with high discriminative precision.\u003c/p\u003e \u003cp\u003eThese findings are consistent with a recent systematic review and meta-analysis reporting substantial heterogeneity and only moderate overall accuracy of large language models in medical question-answering tasks, despite their frequent generation of guideline-aligned or partially accurate responses[\u003cspan citationid=\"CR24\" class=\"CitationRef\"\u003e24\u003c/span\u003e]. In this context, the \u0026ldquo;Humans in Charge\u0026rdquo; framework proposed for the integration of artificial intelligence in healthcare is further supported by our results[\u003cspan citationid=\"CR25\" class=\"CitationRef\"\u003e25\u003c/span\u003e, \u003cspan citationid=\"CR26\" class=\"CitationRef\"\u003e26\u003c/span\u003e]. Collectively, our findings suggest that AI-derived quality metrics are better positioned as complementary and scalable tools, particularly for large-scale content screening and preliminary assessment, rather than as replacements for expert human evaluation.\u003c/p\u003e \u003cp\u003eThematic analysis showed that videos predominantly addressed definitions, symptoms, and treatment, whereas preventive hygiene, contact management, and post-scabetic care were infrequently discussed. Similar underrepresentation of prevention and follow-up has been reported in online medical education and dermatology-related social media content[\u003cspan additionalcitationids=\"CR28 CR29 CR30\" citationid=\"CR27\" class=\"CitationRef\"\u003e27\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR31\" class=\"CitationRef\"\u003e31\u003c/span\u003e]. In scabies, these omissions are clinically important, as guidelines stress simultaneous treatment of contacts, environmental decontamination, management of post-scabetic pruritus, and clear indications for re-evaluation[\u003cspan citationid=\"CR32\" class=\"CitationRef\"\u003e32\u003c/span\u003e]. Non-professional materials rarely included such structured recommendations, underscoring the need for expert-driven, guideline-aligned, and clinically comprehensive content[\u003cspan citationid=\"CR33\" class=\"CitationRef\"\u003e33\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eThis study has limitations. YouTube content evolves rapidly, and our cross-sectional design captures only one time point. The modest sample size (n\u0026thinsp;=\u0026thinsp;50) and restriction to English-language videos limit generalizability to other settings and to populations with lower health literacy. Although DISCERN, JAMA, and GQS are frequently used in dermatology and general medical video evaluations, their dermatology-specific validity is incomplete, and they may miss domains such as cultural sensitivity or shared decision-making[\u003cspan citationid=\"CR19\" class=\"CitationRef\"\u003e19\u003c/span\u003e, \u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e, \u003cspan citationid=\"CR32\" class=\"CitationRef\"\u003e32\u003c/span\u003e]. AI-based metrics were derived from a single LLM configuration and text transcripts only; non-verbal cues like demonstrations, production quality, and presenter credibility were not directly assessed. As LLM architectures and training data change, performance and alignment with experts may shift, necessitating ongoing recalibration across conditions, platforms, and languages[\u003cspan citationid=\"CR34\" class=\"CitationRef\"\u003e34\u003c/span\u003e]. Finally, we did not examine whether higher-quality videos translate into improved patient knowledge, behavior, or clinical outcomes.\u003c/p\u003e"},{"header":"5. Conclusions","content":"\u003cp\u003eYouTube videos on scabies exhibit substantial variability in reliability, completeness, and educational quality. Professional sources consistently outperformed non-professional ones in both human and AI-based evaluations, yet readability and coverage of prevention, contact management, and post-treatment care remain suboptimal. The lack of association between popularity and quality highlights that online visibility is a poor proxy for educational accuracy. Within this context, our findings suggest that artificial intelligence can evaluate online health information at the level of general quality trends and content coverage, but does not replicate expert judgment in assessing medical accuracy or clinical nuance. Increasing the prominence of evidence-based dermatologic content, aligning video narratives with scabies guidelines, and integrating AI-assisted\u0026mdash;but human-supervised\u0026mdash;quality monitoring may therefore represent a pragmatic approach to promoting more reliable, scalable, and equitable digital health communication.\u003c/p\u003e"},{"header":"Declarations","content":"\u003cp\u003eConflicting Interest :\u003c/p\u003e\n\u003cp\u003eThe authors declare no conflicts of interest.\u003c/p\u003e\n\u003cp\u003e7.Funding\u003c/p\u003e\n\u003cp\u003eThis study received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e8.Acknowledgements\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe authors thank the independent reviewers for their methodological contributions during the evaluation process.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e9.Author Contributions\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eBengisu Meral Ketenci conceived and designed the study, conducted data collection and statistical analyses, interpreted the results, and wrote the original manuscript draft. \u0026Ouml;zge Sevil Karstarlı Bakay contributed to data evaluation, provided methodological support, critically revised the manuscript for important intellectual content, and supervised the study. Both authors reviewed and approved the final version of the manuscript.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e10.Data Availability Statement\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe datasets generated and analyzed during the current study are available from the corresponding author upon reasonable request. Publicly available video data were obtained from YouTube. Derived evaluation scores and analytical datasets are not publicly available due to analytical processing but may be shared upon request for academic purposes.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003e11.Additional Information\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThe authors declare no competing interests.\u003c/p\u003e\n\u003cp\u003eAuthor Contribution\u003c/p\u003e\n\u003cp\u003eBengisu Meral Ketenci conceived and designed the study, conducted data collection and statistical analyses, interpreted the results, and wrote the original manuscript draft. \u0026Ouml;zge Sevil Karstarlı Bakay contributed to data evaluation, provided methodological support, critically revised the manuscript for important intellectual content, and supervised the study. Both authors reviewed and approved the final version of the manuscript.\u003c/p\u003e\n\u003cp\u003eAcknowledgement\u003c/p\u003e\n\u003cp\u003eThe authors thank the independent reviewers for their methodological contributions during the evaluation process.\u003c/p\u003e\n\u003cp\u003eData Availability\u003c/p\u003e\n\u003cp\u003eThe datasets generated and analyzed during the current study are available from the corresponding author upon reasonable request. Publicly available video data were obtained from YouTube. Derived evaluation scores and analytical datasets are not publicly available due to analytical processing but may be shared upon request for academic purposes.\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\u003cli\u003e\u003cspan\u003eSunderk\u0026ouml;tter, C., Wohlrab, J. \u0026amp; Hamm, H. Scabies: epidemiology, diagnosis, and treatment. \u003cem\u003eDtsch. Arztebl Int.\u003c/em\u003e \u003cb\u003e118\u003c/b\u003e, 695\u0026ndash;704 (2021).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAnderson, K. L. \u0026amp; Strowd, L. C. Epidemiology, diagnosis, and treatment of scabies in a dermatology office. \u003cem\u003eJ. Am. Board. Fam Med.\u003c/em\u003e \u003cb\u003e30\u003c/b\u003e, 78\u0026ndash;84 (2017).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHicks, M. I., Elston, D. M. \u0026amp; Scabies \u003cem\u003eDermatol. Ther.\u003c/em\u003e \u003cb\u003e22\u003c/b\u003e, 279\u0026ndash;292 (2009).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eRomani, L. et al. Prevalence of scabies and impetigo worldwide: a systematic review. \u003cem\u003eLancet Infect. Dis.\u003c/em\u003e \u003cb\u003e15\u003c/b\u003e, 960\u0026ndash;967 (2015).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eOzdemir Kacer, E. \u0026amp; Kacer, I. Evaluating the quality and reliability of YouTube videos on scabies in children: a cross-sectional study. \u003cem\u003ePLoS One\u003c/em\u003e. \u003cb\u003e19\u003c/b\u003e, e0310508 (2024).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eKang, E. et al. The quality of evidence of and engagement with video medical claims. \u003cem\u003eJAMA Netw. Open.\u003c/em\u003e \u003cb\u003e9\u003c/b\u003e, e2552106 (2026).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAlice, U. et al. Assessing the reliability of YouTube content for plastic surgery patient information in Africa with the modified DISCERN and JAMA scores. \u003cem\u003eAnn. Plast. Surg.\u003c/em\u003e \u003cb\u003e94\u003c/b\u003e, 403\u0026ndash;408 (2025).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAdvanced Web Ranking. Google organic CTR history. (2018). \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://www.advancedwebranking.com/ctrstudy/\u003c/span\u003e\u003cspan address=\"https://www.advancedwebranking.com/ctrstudy/\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eGurok, N. G. et al. Scabies on YouTube: the quality, accuracy, and reliability of the videos. \u003cem\u003eTurk. J. Dermatol.\u003c/em\u003e \u003cb\u003e19\u003c/b\u003e, 80\u0026ndash;86 (2025).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eCharnock, D., Shepperd, S., Needham, G. \u0026amp; Gann, R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. \u003cem\u003eJ. Epidemiol. Community Health\u003c/em\u003e. \u003cb\u003e53\u003c/b\u003e, 105\u0026ndash;111 (1999).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eSerifler, S. \u0026amp; Gul, F. Evaluating tonsillectomy-related YouTube videos via a human expert review and ChatGPT-4: a multi-method quality analysis. \u003cem\u003eBMC Med. Educ.\u003c/em\u003e \u003cb\u003e25\u003c/b\u003e, 1157 (2025).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAltun, A. et al. Evaluation of YouTube videos as sources of information about complex regional pain syndrome. \u003cem\u003eKorean J. Pain\u003c/em\u003e. \u003cb\u003e35\u003c/b\u003e, 319\u0026ndash;326 (2022).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eMeyer, M. K. R. et al. Evaluation of rhinoplasty information from ChatGPT, Gemini, and Claude for readability and accuracy. \u003cem\u003eAesthetic Plast. Surg.\u003c/em\u003e \u003cb\u003e49\u003c/b\u003e, 1868\u0026ndash;1873 (2025).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eSchick, T. S. et al. Impact of digital media on the patient journey and patient\u0026ndash;physician relationship among dermatologists and adult patients with skin diseases: qualitative interview study. \u003cem\u003eJ. Med. Internet Res.\u003c/em\u003e \u003cb\u003e25\u003c/b\u003e, e44129 (2023).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eWojtara, M. Use of social media for patient education in dermatology: narrative review. \u003cem\u003eJMIR Dermatol.\u003c/em\u003e \u003cb\u003e6\u003c/b\u003e, e42609 (2023).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eReinhardt, L. et al. Quality, understandability and reliability of YouTube videos on skin cancer screening. \u003cem\u003eJ. Cancer Educ.\u003c/em\u003e \u003cb\u003e38\u003c/b\u003e, 1667\u0026ndash;1674 (2023).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eGuzman, A. K. et al. Evaluation of YouTube as an educational resource for treatment options of common dermatologic conditions. \u003cem\u003eInt. J. Dermatol.\u003c/em\u003e \u003cb\u003e59\u003c/b\u003e, e65\u0026ndash;e67 (2020).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eSzeto, M. D. et al. Social media in dermatology and an overview of popular social media platforms. \u003cem\u003eCurr. Dermatol. Rep.\u003c/em\u003e \u003cb\u003e10\u003c/b\u003e, 97\u0026ndash;104 (2021).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eKaradag, A. S. et al. Social media use in dermatology in Turkey: challenges and tips for patient health. \u003cem\u003eJMIR Dermatol.\u003c/em\u003e \u003cb\u003e7\u003c/b\u003e, e51267 (2024).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eMeral, H. B. et al. Evaluating the educational value and content quality of YouTube videos on myasthenia gravis. \u003cem\u003eMuscle Nerve\u003c/em\u003e. \u003cb\u003e72\u003c/b\u003e, 1067\u0026ndash;1073 (2025).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eOydanich, M. et al. An analysis of the quality, reliability, and popularity of YouTube videos on glaucoma. \u003cem\u003eOphthalmol. Glaucoma\u003c/em\u003e. \u003cb\u003e5\u003c/b\u003e, 306\u0026ndash;312 (2022).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eTackett, S. et al. Medical education videos for the world: an analysis of viewing patterns for a YouTube channel. \u003cem\u003eAcad. Med.\u003c/em\u003e \u003cb\u003e93\u003c/b\u003e, 1150\u0026ndash;1156 (2018).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eZheng, D. X., Mulligan, K. M. \u0026amp; Scott, J. F. TikTok and dermatology: an opportunity for public health engagement. \u003cem\u003eJ. Am. Acad. Dermatol.\u003c/em\u003e \u003cb\u003e85\u003c/b\u003e, e25\u0026ndash;e26 (2021).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eLiu, M. et al. Performance of ChatGPT across different versions in medical licensing examinations worldwide: systematic review and meta-analysis. \u003cem\u003eJ. Med. Internet Res.\u003c/em\u003e \u003cb\u003e26\u003c/b\u003e, e60807 (2024).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eJaleel, A. et al. Evaluating the potential and accuracy of ChatGPT-3.5 and 4.0 in medical licensing and in-training examinations: systematic review and meta-analysis. \u003cem\u003eJMIR Med. Educ.\u003c/em\u003e \u003cb\u003e11\u003c/b\u003e, e68070 (2025).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHerbert, A. S. et al. An evaluation of the readability and content-quality of pelvic organ prolapse YouTube transcripts. \u003cem\u003eUrology\u003c/em\u003e \u003cb\u003e154\u003c/b\u003e, 120\u0026ndash;126 (2021).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eNigro, A. R. et al. Quality and readability of online educational Mohs micrographic surgery resources. \u003cem\u003eDermatol. Surg.\u003c/em\u003e \u003cb\u003e50\u003c/b\u003e, 904\u0026ndash;907 (2024).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eWhite-Williams, C. et al. Addressing social determinants of health in the care of patients with heart failure: a scientific statement from the American Heart Association. \u003cem\u003eCirculation\u003c/em\u003e \u003cb\u003e141\u003c/b\u003e, e841\u0026ndash;e863 (2020).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAghajani, M. et al. Evaluating the quality and readability of online information about hidradenitis suppurativa: a systematic review. \u003cem\u003eClin. Exp. Dermatol.\u003c/em\u003e \u003cb\u003e50\u003c/b\u003e, 1937\u0026ndash;1944 (2025).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eUnal, S. Demirel Ogut, N. Dermatologists' way of informative content about dermatology and cosmetology on social media. \u003cem\u003eJ. Cosmet. Dermatol.\u003c/em\u003e \u003cb\u003e24\u003c/b\u003e, e70148 (2025).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eBarrutia, L. et al. Benefits, drawbacks, and challenges of social media use in dermatology: a systematic review. \u003cem\u003eJ. Dermatolog Treat.\u003c/em\u003e \u003cb\u003e33\u003c/b\u003e, 2738\u0026ndash;2757 (2022).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eUzun, S. et al. Clinical practice guidelines for the diagnosis and treatment of scabies. \u003cem\u003eInt. J. Dermatol.\u003c/em\u003e \u003cb\u003e63\u003c/b\u003e, 1642\u0026ndash;1656 (2024).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eCooper, B. R. et al. Social media as a medium for dermatologic education. \u003cem\u003eCurr. Dermatol. Rep.\u003c/em\u003e \u003cb\u003e11\u003c/b\u003e, 103\u0026ndash;109 (2022).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eVrdoljak, J. et al. Evaluating large language and large reasoning models as decision support tools in emergency internal medicine. \u003cem\u003eComput. Biol. Med.\u003c/em\u003e \u003cb\u003e192\u003c/b\u003e, 110351 (2025).\u003c/span\u003e\u003c/li\u003e\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"scientific-reports","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"scirep","sideBox":"Learn more about [Scientific Reports](http://www.nature.com/srep/)","snPcode":"","submissionUrl":"","title":"Scientific Reports","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"stoa","reportingPortfolio":"Scientific Reports","inReviewEnabled":true,"inReviewRevisionsEnabled":true},"keywords":"Scabies, Social Media, Artificial Intelligence, Natural Language Processing, Health Communication ","lastPublishedDoi":"10.21203/rs.3.rs-8924512/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-8924512/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eScabies is a highly contagious parasitic skin disease for which patients frequently seek information on YouTube, although the reliability of available content is uncertain. Artificial intelligence (AI), particularly large language models, has emerged as a potential tool for assessing online health information; however, its concordance with expert evaluation remains unclear. This cross-sectional study analyzed the first 50 English-language YouTube videos retrieved using the term \u0026ldquo;scabies disease.\u0026rdquo; Two dermatology specialists independently evaluated videos using the DISCERN instrument, JAMA benchmark criteria, and the Global Quality Scale (GQS). Video characteristics were recorded, and sources were classified as professional or non-professional. Corrected transcripts were analyzed with ChatGPT-5 to generate Accuracy and Completeness scores. Readability was assessed using Flesch Reading Ease and Flesch\u0026ndash;Kincaid Grade Level. Professionally produced videos scored significantly higher than non-professional videos across all human-based quality measures (p\u0026thinsp;\u0026lt;\u0026thinsp;0.01). AI-generated scores were also higher for professional content but showed only moderate correlation with expert assessments. ChatGPT Completeness demonstrated moderate discrimination in identifying higher-quality videos (AUC\u0026thinsp;=\u0026thinsp;0.668). Overall, AI reflected general quality trends but did not replicate expert judgment, suggesting a complementary rather than substitutive role.\u003c/p\u003e","manuscriptTitle":"Can Artificial Intelligence Evaluate Online Health Information? A Comparative Assessment of Scabies-Related YouTube Videos Using Human Experts and ChatGPT-5","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2026-03-16 06:02:05","doi":"10.21203/rs.3.rs-8924512/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"reviewersInvited","content":"","date":"2026-03-11T10:24:08+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2026-03-02T08:28:36+00:00","index":"","fulltext":""},{"type":"editorInvited","content":"","date":"2026-02-26T13:50:47+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2026-02-24T15:49:06+00:00","index":"","fulltext":""},{"type":"submitted","content":"Scientific Reports","date":"2026-02-24T15:44:11+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"scientific-reports","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"scirep","sideBox":"Learn more about [Scientific Reports](http://www.nature.com/srep/)","snPcode":"","submissionUrl":"","title":"Scientific Reports","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"stoa","reportingPortfolio":"Scientific Reports","inReviewEnabled":true,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"b025d32c-acd3-4b19-8c7b-982058d32126","owner":[],"postedDate":"March 16th, 2026","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"under-review","subjectAreas":[{"id":64476905,"name":"Biological sciences/Computational biology and bioinformatics"},{"id":64476906,"name":"Health sciences/Health care"},{"id":64476907,"name":"Physical sciences/Mathematics and computing"},{"id":64476908,"name":"Health sciences/Medical research"}],"tags":[],"updatedAt":"2026-03-16T06:02:05+00:00","versionOfRecord":[],"versionCreatedAt":"2026-03-16 06:02:05","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-8924512","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-8924512","identity":"rs-8924512","version":["v1"]},"buildId":"XKTyCvWXoU3ODBz1xrDgd","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: preprint-html

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2026) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00