Academic Impact vs. Societal Attention: A Dual-Analysis of Top-Cited Artificial Intelligence Articles in Medicine

preprint OA: closed
Full text JSON View at publisher
Full text 120,251 characters · extracted from preprint-html · click to expand
Academic Impact vs. Societal Attention: A Dual-Analysis of Top-Cited Artificial Intelligence Articles in Medicine | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Academic Impact vs. Societal Attention: A Dual-Analysis of Top-Cited Artificial Intelligence Articles in Medicine Furkan Şakiroğlu, Cemil Çolak This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-8920991/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract Objective This study aims to examine the relationship between the academic citation success and social visibility of Artificial Intelligence (AI)-based medical research using bibliometric and altmetric methodologies. Methods The top 100 most-cited articles indexed in the Web of Science Core Collection from 1 January 2023 to 27 January 2026 were analyzed; citation counts and Altmetric Attention Scores (AAS) were retrieved on 27 January 2026 (See Methods for the full search query). Academic impact was measured by Web of Science citation counts, while social impact was evaluated using the Altmetric Attention Score (AAS). Data were assessed through Spearman’s correlation analysis and the Mann-Whitney U test. Results A statistically significant but weak positive correlation was identified between citation counts and AAS (r = 0.299, p = 0.0025). Open access status characterized 92% of the articles. The highest academic impact was achieved by the ChatGPT-USMLE study by Kung et al. (2023) with 2,193 citations, whereas the highest social impact was held by the "Physician vs. Chatbot" study by Ayers et al. (2023) (AAS: 6,388). A notable finding was that publications originating from China exhibited remarkably low altmetric scores (Median AAS: 12) despite high academic citation rates, suggesting a 'digital isolation' effect that may stem from Western-centric altmetric data coverage. Conclusion Academic success and societal popularity are governed by distinct dynamics, indicating the need for researchers to adopt science communication strategies and for funding agencies to use multidimensional impact metrics. While academia prioritizes conceptual depth—such as ethics and methodology—the general public shows greater interest in sensational competition (e.g., physician vs. AI). It is recommended that researchers enhance their science communication competencies and that funding agencies adopt multidimensional evaluation approaches. Artificial Intelligence Bibliometrics Altmetrics ChatGPT Medical Research Societal Impact Large Language Models Citation Analysis Figures Figure 1 Figure 2 Figure 3 Figure 4 Figure 5 Figure 6 Figure 7 1. Introduction Artificial Intelligence (AI), particularly with the introduction of ChatGPT (November 2022) and Large Language Models (LLMs), has triggered an unprecedented paradigm shift in medical research (1). AI-based applications are rapidly proliferating across nearly every domain of healthcare, ranging from diagnostic imaging to personalized treatment, and from medical education to clinical decision support systems. This technological revolution has fundamentally altered not only clinical practices but also the pace of scientific knowledge production and the dissemination of that knowledge (2). Traditional bibliometric analyses and citation counts have been recognized as the 'gold standard' for measuring scientific productivity and impact for many years. However, because citation-based metrics are inherently cumulative and often require years post-publication to yield meaningful data, they may prove inadequate for measuring the real-time impact in a field evolving at such a breakneck pace as Artificial Intelligence (3). Furthermore, citation counts solely reflect the interest of the 'academic community' while neglecting the reaction—and thus the societal impact—of patients, policymakers, the media, and the general public. To overcome this limitation, 'Altmetrics' have emerged as a complementary tool to traditional metrics, offering the opportunity to monitor the real-time reflections of scientific outputs across social media, news outlets, blogs, and policy documents (4). Since AI research in the field of medicine concerns not only scientists but also public health directly (e.g., physician vs. AI debates), these studies possess a high potential for going 'viral' on social media. Consequently, a linear relationship may not always exist between a paper's scientific quality and its societal popularity. There is a broad consensus in the literature that altmetrics measure societal curiosity and media visibility rather than scientific quality. In their meta-analysis examining the correlation between altmetric scores and citation counts in health sciences, Kolahi et al. (2021) identified a pooled correlation coefficient of 0.19, demonstrating that these two metrics reflect distinct dimensions of impact (5). However, the methodological limitations of altmetrics should not be overlooked. Thelwall (2021) emphasized that while altmetric indicators reflect attention, they fail to distinguish the nature of that attention (e.g., endorsement, criticism, or the dissemination of misinformation). Furthermore, it is well-known that social media mentions can be artificially inflated through bot activity or coordinated campaigns (6). Although numerous bibliometric studies exist on AI in medicine, they have predominantly focused on either academic citations or altmetric scores in isolation. To our knowledge, no study has yet jointly analyzed the top-cited articles from the post-ChatGPT era (2023–2026) using both metrics to uncover the divergence between scientific and societal attention. This study fills that gap by providing a comprehensive, dual-perspective analysis of the most influential AI research in medicine. Distinguishing which topics gain academic depth (e.g., machine learning ethics) versus those that generate societal excitement (e.g., chatbots) is critical for directing future research funding and health policies. The aim of this study is to analyze the most-cited articles in the fields of medicine and informatics within the Web of Science (WoS) database for the recent period (2023–2026) using bibliometric and altmetric methodologies. The study examines the correlation between academic citations and social media engagement, the performance of the most influential journals and countries, and the thematic differences (keyword analysis) between priorities of academia and society. The findings intend to provide a holistic perspective on the scientific and societal reflections of AI research. This study seeks to answer the following research questions: What is the relationship between Web of Science citation counts and the Altmetric Attention Score? How does open access status influence the academic and societal impact of articles? Which thematic areas receive more attention from the academic community versus the general public? How do academic-societal impact profiles differ across countries and journals? Based on previous meta-analyses (e.g., Kolahi et al., 2021), we hypothesized that there would be a weak positive correlation between citation counts and AAS. We also anticipated that open access status would be associated with higher AAS, and that certain thematic areas (e.g., chatbots) would garner more social attention than technical topics (e.g., machine learning). 2. Materials and Methods 2.1. Research Design and Data Sources This study is a cross-sectional, descriptive bibliometric and altmetric analysis evaluating the academic and societal impact of Artificial Intelligence (AI)-based medical research. Two primary data sources were utilized. The Web of Science Core Collection (Clarivate Analytics, Philadelphia, PA, USA) was employed to obtain scientific impact (citation counts) and bibliometric metadata (7). To measure the online visibility of the articles across social media, news outlets, and policy documents (Altmetric Attention Score-AAS), Altmetric.com (Digital Science, London, UK) was used (8). 2.2. Data Collection and Search Strategy Data retrieval was conducted between January 2023 and January 2026 to encompass the rise of generative AI and the most recent literature. WoS citation counts and Altmetric Attention Scores were retrieved on 27 January 2026 at UTC 12:00. The search strategy utilized the following term combinations within the Title (TI) and Topic (TS) fields: Keywords: ("Artificial Intelligence" OR "Machine Learning" OR "Deep Learning" OR "Large Language Models" OR "ChatGPT" OR "Generative AI") Context: ("Medicine" OR "Health*" OR "Clinical" OR "Diagnosis" OR "Prognosis") Exact query string and the date filter: TS=("Artificial Intelligence" OR "Machine Learning" OR "Deep Learning" OR "Large Language Models" OR "ChatGPT" OR "Generative AI") AND TS = ("Medicine" OR "Health*" OR "Clinical" OR "Diagnosis" OR "Prognosis") AND Document Types=(Article OR Review) AND Timespan = 2023–2026 (search conducted on January 27, 2026, covering publications from January 1, 2023, to January 27, 2026)) Inclusion Criteria : Studies published in the English language. Document types restricted to "Original Research Article" or "Review". Publications indexed under Web of Science categories related to clinical medical sciences, healthcare services, or medical informatics. Editorial materials, letters, meeting abstracts, and corrections were excluded from the analysis. The results were ranked in descending order based on their Web of Science Core Collection citation counts, and the top 100 most-cited articles constituted the study sample. We selected the Web of Science Core Collection due to its comprehensive coverage of high-impact medical journals and its reliable citation data; Scopus and PubMed were not included to maintain consistency with previous top-cited bibliometric studies. 2.3. Data Extraction and Altmetric Mapping The data extraction process was finalized on January 27, 2026. Bibliometric metadata (Title, Author, Journal, Publication Year, Author Keywords, Affiliations, Citation Count, and DOI) for the selected 100 articles were exported from the WoS database in .xlsx format. To obtain altmetric data, queries were performed via the Altmetric.com API using the Digital Object Identifier (DOI) of each article. The Altmetric Attention Score (AAS) and its source distribution were recorded. For each publication, the following metrics were documented: Total AAS, number of news mentions, Twitter/X posts, Facebook mentions, blog posts, Wikipedia citations, and Mendeley readership counts. 2.4. Analytical Framework In the analytical framework of the study: Scientific impact was assessed via total WoS citations. Societal impact was evaluated through the AAS. Conceptual and geographical structures were analyzed using author keywords and the institutional affiliations of the corresponding authors. Furthermore, articles were categorized by access type ("Open Access" vs. "Subscription-based") and content focus ("Methodological/Technical" vs. "Clinical Application"). The complete list of the 100 articles included in the study is provided in Supplementary File 1. 2.5. Statistical Analysis, Bibliometric Mapping, and Visualization Statistical analyses were performed using Python 3.12 with pandas (v2.0.0), scipy (v1.12.0), and numpy (v1.26.3) libraries. Given the non-normal distribution of bibliometric data (Shapiro-Wilk test, p < 0.05), non-parametric tests were employed. The relationship between scientific impact (citations) and social impact (Altmetric scores) was assessed using Spearman’s rank correlation coefficient. To ensure the robustness of the correlation estimate, the 95% Confidence Interval (CI) was calculated using the bootstrap method with 2,000 resamples (random seed = 42). Group comparisons (e.g., Open Access vs. Closed Access) were conducted using the Mann-Whitney U test; we report U statistic, p-value, and effect size (Cliff’s delta and r). Statistical significance was defined as a two-sided p-value < 0.05. No multiple comparison correction was applied as the analyses were exploratory and hypothesis-generating rather than confirmatory.(9–11). Scientific mapping techniques were employed to reveal the conceptual structure, research trends, and inter-topic relationships. For the construction and visualization of bibliometric networks, VOSviewer (Version 1.6.19, Leiden University, The Netherlands)(12) and Python-based network analysis libraries (NetworkX)(13) were used. The analysis process involved the following steps: Data Standardization : To ensure data consistency, synonymous or variably spelled terms in the "Author Keywords" column (e.g., "Artificial Intelligence" and "AI", "Large Language Models" and "LLM", "Chat-GPT" and "ChatGPT") were merged under a single standardized term. Co-occurrence Analysis : Keyword co-occurrence analysis was applied to determine the intellectual structure of the AI literature. To reduce noise in the network map and identify dominant trends, a minimum occurrence threshold was set, and only the most frequently used concepts were included. Visualization Parameters : In the generated network map, node size represents the frequency of the keyword, the lines between nodes indicate the frequency of co-occurrence in the same article, and the colors represent thematic clusters determined by the clustering algorithm. The normality of continuous variables (citation counts and AAS) was examined using the Shapiro-Wilk test, which indicated that the data were not normally distributed (p < 0.05). Consequently, the Spearman rank correlation coefficient was used to determine the direction and strength of the relationship between academic citations and altmetric scores. Differences in citation and altmetric scores based on open access status and article type (review vs. research) were analyzed using the Mann-Whitney U test. For all statistical tests, the significance level was set at p < 0.05. 2.6. Ethical Considerations As this study is a bibliometric analysis based on publicly available data obtained from the Web of Science and Altmetric databases and does not involve any human or animal subjects, it is exempt from ethics committee approval. We used ChatGPT (OpenAI; version GPT-4o; accessed Jan 2026) and QuillBot Premium (accessed Jan 2026) for English editing and language polishing only. The authors retain responsibility for the content and interpretation of the data. Use of these tools complied with journal guidelines 3. Results 3.1. General Characteristics of the Dataset The top 100 most-cited articles retrieved from the Web of Science Core Collection were included in the analysis. All included publications were released between 2023 and 2025, reflecting the early-stage impact of artificial intelligence and generative language models in medicine. The median citation count of the articles was 226 (IQR: 170–307.5), while the median Altmetric Attention Score (AAS) was determined to be 82 (IQR: 16–396.5). Regarding accessibility, 92% (n = 92) of the articles were published under Open Access status, with the remaining 8% appearing in subscription-based journals. In terms of document type, 65% (n = 65) were categorized as original research articles, and 35% (n = 35) were reviews. The distribution by year revealed a high concentration in 2023 (71%), followed by 2024 (27%) and 2025 (2%). The average number of authors per publication was calculated at 10.2. 3.2. Relationship Between Academic Impact and Societal Interest The relationship between WoS citation counts, representing academic impact, and altmetric scores, representing societal interest, was examined using Spearman’s rank correlation test. The analysis revealed a statistically significant, positive, yet weak correlation between the two variables (r = 0.299, p = 0.0025; 95% CI bootstrapped with 2,000 resamples [0.107, 0.457], n = 100). According to Cohen’s (1988) effect size criteria, this correlation coefficient indicates a small-to-medium relationship (14). This finding demonstrates that studies receiving high citations within the scientific community do not always garner a corresponding level of engagement on social media; conversely, studies that go "viral" on social platforms do not necessarily achieve the highest levels of academic citation success (Fig. 1 ). 3.3. Comparison of the Most Influential Articles An examination of the most successful articles in terms of scientific and societal impact reveals two distinct patterns (Table 1 and Table 2 ). The study titled 'Performance of ChatGPT on USMLE' by Kung et al. stands at the pinnacle of academic impact with 2,193 citations, while simultaneously achieving high visibility on social media with an Altmetric score of 1,766. Table 1 Top 5 Most Cited Articles in Academic Literature (Scientific Impact) Rank Article Title (Shortened) Category WoS Citations (Scientific Impact) Altmetric Score (Social Impact) 1 Performance of ChatGPT on USMLE: Potential for AI-assisted medical education...(15) Education / Exam 2193 1766 2 Large language models encode clinical knowledge(16) Basic Science / AI 1719 1248 3 ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review...(17) Review 1592 94 4 Comparing Physician and AI Chatbot Responses to Patient Questions...(18) Clinical Comparison 1385 6388 5 Segment anything in medical images (19) Technical / Imaging 1338 283 The study by Ayers et al. titled 'Comparing Physician and Artificial Intelligence Chatbot Responses' emerged as the most debated publication across social media and news outlets, reaching a peak Altmetric score of 6,388 (18). While its citation count (1,385) is also substantial, its societal impact is proportionally much more dominant than its academic influence. Similarly, the study titled 'Distinguishing features of long COVID' generated a massive public resonance with an Altmetric score of 4,181, yet remained further behind in academic citation rankings with 452 citations. Table 2 Top 5 Most Popular Articles on Social Media and News (Social Impact) Rank Article Title (Shortened) Focus Area Altmetric Score (Social Impact) WoS Citations (Scientific Impact) 1 Comparing Physician and AI Chatbot Responses to Patient Questions...(18) Doctor vs. AI 6388 1385 2 Distinguishing features of long COVID identified through immune profiling(20) Public Health / COVID 4181 452 3 A high-performance neuroprosthesis for speech decoding and avatar control(21) Futurism / BCI 3683 229 4 Persistent complement dysregulation ... in active Long Covid(22) Public Health / COVID 2945 259 5 Organ aging signatures in the plasma proteome track health and disease (23) Aging / Prevention 2036 291 3.4. Analysis of Societal Engagement Sources Table 3 compares the distribution of societal dissemination sources for the top three studies with the highest altmetric scores. The results indicate that societal interest is not monolithic; rather, three distinct "Engagement Profiles" emerge based on the study's subject matter: The "Hybrid/Viral" Profile (Physician vs. Chatbot): By addressing a popular and controversial question of universal concern—"Will AI replace doctors?"—this study garnered record-breaking attention across both news outlets (413 stories) and Twitter (5,158 posts). This profile represents rare instances where a scientific topic simultaneously penetrates the mainstream media agenda and triggers intensive public discourse. This tripartite classification—'Hybrid/Viral', 'Community-Driven', and 'Futuristic/Media-Centric'—demonstrates that societal engagement patterns vary systematically with research topic. The "Community-Driven" Profile (Long COVID): Despite receiving less than half the news coverage of the top-ranked article (191 stories), this study achieved the highest Twitter engagement with 6,108 tweets. This suggests that topics involving patient advocacy and diagnostic uncertainty, such as Long COVID, are primarily adopted and disseminated by social media communities rather than news organizations. This represents popularity amplified by the public rather than the media. The "Futuristic/Media-Centric" Profile (Neuroprosthesis / Avatar): This study, which enables a paralyzed patient to communicate via brain signals, remained relatively quiet on Twitter (only 668 tweets) but was featured in 409 news outlets, nearly matching the first-ranked article. This profile proves that futuristic technologies with high visual appeal (e.g., neural interfaces) are highly favored as "Technology News" by traditional media (TV, newspapers), even if they do not spark extensive daily discussion among the general public on social platforms. Table 3 Breakdown of Social Attention Sources for the Top 3 High-Scoring Papers Rank Paper Topic & Context (Descriptive Name) News Mentions Twitter (X) Posts Altmetric Score Dominant Source 1 Physician vs. Chatbot (Clinical Comparison)(18) 413 5,158 6,388 Mixed (Viral) 2 Long COVID (Immune Profiling)(20) 191 6,108 4,181 Social Media 3 Neuroprosthesis (Speech Decoding / Avatar)(21) 409 668 3,683 News Media 3.5. Journal and Country Performance Analysis of the distribution of publications by journal reveals that Nature (n = 11) and NPJ Digital Medicine (n = 11) emerged as the most productive outlets. Nature stood at the pinnacle of academic impact with a median citation count of 445, while also maintaining its leadership in societal impact (Median AAS: 908). A notable finding is that Science magazine, despite having the highest social media influence with a median Altmetric score of 913, trailed behind Nature in terms of academic citations (Median: 259). The clinically-oriented JAMA Network Open demonstrated a balanced and robust performance in both academic (Median Citations: 200.5) and social (Median AAS: 226.5) metrics. Conversely, the median Altmetric score for Scientific Reports was notably low at 8; this indicates that the high overall average for this journal was driven by a few viral articles rather than a widespread distribution of engagement across its publications. When country impact is evaluated based on median values, the United States (USA) maintains its dominance in the field with 58 articles, exhibiting a balanced and high profile in both academic impact (Median Citation: 247.5) and social influence (Median AAS: 227). In contrast, studies originating from China have been unable to translate their success in the academic world (Median Citation: 204) into social media visibility; the median altmetric score for Chinese publications was found to be only 12. This striking discrepancy suggests that while research from China possesses high scientific value, it does not achieve sufficient circulation within Western-centric social media networks and news outlets—a phenomenon that may be characterized as 'digital isolation.' Furthermore, Canada (Median Citation: 271, Median AAS: 369), despite a smaller number of publications (n = 7), emerged as one of the countries reaching the highest median values in both domains. 3.6. Thematic Analysis An impact analysis conducted via author keywords reveals that academia and the general public prioritize distinct subjects. Academic Focus: Studies featuring the keywords "Ethics" (Median Citations: 309.5) and "Machine Learning" (Median Citations: 307) stand at the forefront of scientific impact. This indicates that the academic community prioritizes not only the technical capabilities of AI but also its ethical boundaries and methodological foundations. Societal Focus: Contrary to mean values, an examination of median values shows that the standard social media impact of popular topics such as "Chatbot" (Median AAS: 30.5) and "Large Language Models" (Median AAS: 28.5) does not differ significantly from more technical subjects (e.g., Ethics: 34). This critical finding suggests that social media interest is not necessarily driven by a specific topic itself, but rather focuses on individual articles with sensational qualities within those topics. "ChatGPT" remains the most balanced and central term in the literature, characterized by both high academic citation rates (Median: 248) and consistent social visibility (Median AAS: 30). The impact analysis conducted according to Web of Science categories (Fig. 5 ) reveals a sharp divergence in character across different disciplines. The 'Medicine, General & Internal' category emerged as the most influential domain in the literature, with a median citation count of 255 and a median Altmetric score of 200. This trend indicates that AI discussions have evolved beyond being purely technical subjects and have shifted toward the axes of clinical practice and public health. In stark contrast, studies categorized under 'Computer Science' were found to have a median Altmetric score of 0 (zero). While publications in the computer science field continue to receive academic citations (Median: 163), they failed to achieve any significant visibility across social media platforms or news outlets. 3.7. The Impact of Open Access While the prevailing expectation in the literature is that open access articles achieve higher visibility, the data obtained in this study present a different picture (Fig. 6 ). A Mann-Whitney U test was conducted to determine if Open Access status influenced social impact. The analysis revealed no statistically significant difference in Altmetric scores between Open Access (n = 92, Mdn = 30.5) and Closed Access (n = 8, Mdn = 14.5) articles (U = 234.0, p = 0.090). The effect size was small to medium (Cliff’s δ = -0.364), indicating that accessibility alone was not the primary driver of social attention in this high-impact dataset. The difference approached but did not reach statistical significance (p = 0.090). 3.8. Conceptual Structure and Trend Analysis The keyword map generated using the VOSviewer algorithm (Fig. 7 ) demonstrates that the literature is concentrated along two primary axes: the technical infrastructure (blue cluster) and social/clinical applications (red cluster). 4. Discussion The present study stands as one of the first comprehensive bibliometric investigations to systematically compare the academic (citations) and societal (Altmetric) impact of the top-cited AI research in medicine from the generative AI era (2023–2026). Our findings reveal a statistically significant but weak correlation between academic impact and societal interest. This result corroborates the thesis that "scientific quality and popularity do not always coincide," indicating the existence of "two distinct audiences" (scholars and the general public) in AI research. Similarly, Karabay et al. (2024) found no significant correlation between citations and altmetric scores in their analysis of dental literature (24). This suggests that, independent of the discipline, scholarly accumulation (citations) and societal awareness (Altmetrics) constitute two separate universes governed by distinct dynamics. Khan et al. (2022) previously warned the literature that even publications lacking scientific validity could garner record-level attention on social media, emphasizing that Altmetric scores may not mirror scientific rigor (25). Our findings validate this divergence on a different scale: although all articles in our dataset were high-cited (high-quality) works, this academic success did not consistently translate into high social impact. As noted by Thelwall (2021), altmetric indicators measure "societal curiosity" and "media visibility" rather than intrinsic scientific merit (26). The distribution of publications revealed a high concentration in 2023 (71%), followed by 2024 (27%) and 2025 (2%). This trend indicates that academic interest in generative artificial intelligence technologies reached its pinnacle specifically in 2023. Furthermore, the average number of authors per article was calculated at 10.2, reflecting the field’s multidisciplinary nature (combining engineering and medicine) and its reliance on multi-center collaboration. In a comprehensive bibliometric analysis conducted by Wu et al. (2024), it was reported that approximately 41% of the ChatGPT-related literature consisted of 'Letters to the Editor' or opinion pieces. This finding serves as robust evidence that the field was initially in a phase of speculation and 'early hype' (27). In the present study, to eliminate the 'noise' identified by Wu et al. (2024) and to analyze the scientific backbone of the literature, the dataset was methodologically filtered to include only the top 100 most-cited works categorized as 'Original Articles' or 'Reviews.' Consequently, this research represents the 'evidence-based' facet of the AI literature with the potential to shape clinical practice, rather than its purely 'popular' aspect. Our results indicate that this 'elite' cluster resonates within society not only through academic citations but also through high social media engagement (Median AAS: 82) (27). Our analysis reveals a structural, rather than merely thematic, divergence between the priorities of academia and the general public (Fig. 4 ). When examining median citation values, concepts such as 'Ethics' (Median Citation: 309.5) and 'Machine Learning' (Median Citation: 307) were found to exert a significantly greater scientific impact than the popular 'Chatbot' studies (Median Citation: 239). Conversely, an intriguing paradox was observed on the social media front. Although the mean altmetric scores for 'Chatbot' and 'ChatGPT' terms were exceedingly high, their median scores (30.5 and 30, respectively) were nearly identical to technical subjects like 'Machine Learning' (Median AAS: 31). This critical finding proves that the public does not engage with every study on chatbots; rather, interest is reserved for studies with a specific narrative. The most concrete example of this selective interest is the study by Ayers et al. (2023). The reason this paper stood out from other chatbot research to garner record-breaking attention (AAS > 6,000) was not just its technical analysis, but its focus on the competitive inquiry: 'Who is better: the Physician or Artificial Intelligence?' (18). Consequently, our data confirm that while academia prioritizes 'conceptual depth,' society grants a premium to 'sensational competition.' Social media tends to respond with sensational fervor to competitive narratives such as 'Physician vs. Artificial Intelligence' (Ayers et al., 2023). In contrast, the fundamental vision of the academic literature is built upon the 'convergence' of human and artificial intelligence—a concept defined by Topol (2019) as 'High-Performance Medicine (28). The academic community's intense focus on ethical issues can be linked to the striking findings of Obermeyer et al. (2019), which exposed structural biases within healthcare algorithms. This underscores a fundamental scholarly stance: academia prioritizes the safety and reliability of technology over its mere speed of development (29). When examining the shifts within the literature, bibliometric studies covering the pre-generative AI era (Guo et al., 2020) show that the focus was predominantly concentrated on technical metrics such as 'algorithm performance,' 'disease diagnosis,' and 'image processing.' Guo et al. (2020) identified that while the AI literature in healthcare was growing rapidly, the majority of studies remained limited to theoretical modeling rather than clinical integration (30). In contrast, our current study, which covers the post-ChatGPT era, observes that the axis has shifted from technical performance toward 'social interaction' (e.g., Chatbot vs. Physician) and 'ethical discourse.' The steady growth identified in the analysis by Guo et al. (2020) has been superseded by an explosive popularity as of 2023. This phenomenon proves that artificial intelligence is no longer confined to the engineers' laboratories but has become central to daily public discourse (30). A striking finding in our study is that while publications originating from China (n = 16) achieved high academic citation counts, they exhibited statistically significant lower Altmetric Attention Scores (AAS) compared to studies from the USA and the UK. This discrepancy stems from the structural limitations of current altmetric data aggregators (e.g., Altmetric.com) rather than a lack of societal impact by Chinese research. The Altmetric.com algorithm comprehensively tracks Western-centric platforms such as Twitter (X), Facebook, and Reddit; however, it either fails to index or provides very limited coverage of platforms like WeChat and Weibo, which serve as the primary communication channels for the Chinese academic ecosystem (31). Consequently, the substantial social impact generated by Chinese researchers within their local digital ecosystems is rendered 'invisible' by Western-centric metrics. This situation creates a significant risk of 'Data Coverage Bias' in bibliometric analyses, leading to the systematic underestimation of the societal influence of publications originating from the Global South or East Asia. This 'digital isolation' is not a reflection of low societal interest in China, but rather a manifestation of data coverage bias inherent in current altmetric aggregators, which inadequately index major Chinese platforms like WeChat and Weibo. Furthermore, the limited social impact of articles in the Computer Science category, despite their academic citations, is directly related to our methodological choices. During the construction of the dataset, we prioritized Medicine and Health Sciences journals that directly influence clinical practice over pure engineering journals. Consequently, the studies labeled as 'Computer Science' in our analysis do not represent internal theoretical debates within the engineering community, but rather interdisciplinary works published in medical journals. It is expected that such technically dense articles are shared less by medical journal readers and the general public compared to articles with direct clinical implications, such as 'Chatbot vs. Physician.' This finding proves that while a 'technical infrastructure' is an academic necessity in the field of AI in healthcare, the primary factor determining 'social visibility' is the clinical and human narrative. The conceptual mapping analysis of our study (Fig. 7 ) demonstrates that the intellectual structure of the literature is distinctly clustered along two main axes. At one end of the map lies the technical infrastructure—represented by concepts such as 'Machine Learning' and 'Neural Networks'—while the other end hosts the social and clinical application areas represented by 'ChatGPT,' 'Ethics,' and 'Education.' The gradual displacement of technical terms by concepts focused on 'social impact' over the years provides the clearest visual evidence that AI literature has moved beyond the laboratory stage and onto a platform of societal debate. Contrary to expectations, the finding that Open Access (OA) articles had lower social impact scores than subscription-based articles demonstrates that 'access to content' alone is insufficient. The fact that subscription-based articles published in high-prestige journals like Nature, Science, or NEJM are more frequently reported by global news networks proves that 'Journal Branding' is a more potent visibility factor than mere accessibility. This finding aligns with studies showing that journal prestige can override accessibility in driving media attention. 4.1. Practical Implications and Conclusion The findings of this study offer significant implications for various stakeholders: Researchers: To enhance both the academic and societal impact of AI research, authors should focus on clinical and human narratives alongside technical content and improve their science communication competencies such as engaging with science journalists, using plain language summaries, and actively disseminating findings on multiple social media platforms. Funding Agencies: Multi-dimensional evaluation approaches should be adopted rather than relying on a single metric when assessing research impact. Journal Editors: It should be considered that the brand value of high-prestige journals is a stronger driver of visibility than accessibility. Policy Makers: Given that public debates regarding AI applications in health are often shaped by sensational competition, mechanisms should be established to support the flow of evidence-based information. 5. Limitations of the Study Despite its comprehensive scope, this study has certain limitations that should be acknowledged. First, the dataset is restricted to the Web of Science (WoS) database; consequently, preprint servers such as arXiv, which are extensively utilized in the field of artificial intelligence, were not included in the analysis. Second, Altmetric data are subject to external factors, including API policy changes by social media platforms (notably Twitter/X) and instantaneous fluctuations in online popularity. Altmetric scores are platform-dependent and subject to temporal fluctuations; they may not fully capture the nature (positive vs. negative) of online attention. Finally, the analysis was limited to English-language publications, which may have resulted in the omission of societal debates occurring in local languages. 6. Conclusion This study provides quantitative evidence of a distinct divergence between "academic significance" and "societal excitement" within the medical artificial intelligence literature. While the academic community focuses on how AI works (ethics, methodology), the general public and media concentrate on whom AI will replace (e.g., the "Physician vs. Chatbot" narrative). The findings underscore that researchers and funding agencies should avoid relying on a single metric—whether exclusively citations or social media scores—when evaluating the impact of a study. Especially for AI applications involving public health, it is of critical importance that researchers enhance their science communication competencies to ensure that scientifically rigorous studies are accurately disseminated to the public. Future research should utilize long-term data to monitor whether the current surge in popularity translates into lasting scientific impact. As AI continues to reshape medicine, bridging the gap between academic rigor and public engagement will be essential for translating innovation into real-world health benefits. The original dataset analyzed in this study was retrieved from the Web of Science Core Collection. The processed dataset used for the final analysis, including citation counts and Altmetric scores (retrieved in January 2026), is provided as Supplementary File 1. The Python code used for data preprocessing, statistical analysis, and VOSviewer file preparation is available as Supplementary File 2. All data and code are also openly available in the Zenodo repository at [ https://doi.org/10.5281/zenodo.18474927 ]. Declarations Author Contribution F.Ş. and C.Ç. contributed equally to all stages of this study. Both authors were involved in the study's conceptualization, methodology design, and data collection. F.Ş. and C.Ç. performed the bibliometric and altmetric data analysis, prepared the figures and tables, and wrote the main manuscript text. All authors reviewed and approved the final version of the manuscript. Data Availability The original dataset analyzed in this study was retrieved from the Web of Science Core Collection. The processed dataset used for the final analysis, including citation counts and Altmetric scores (retrieved in January 2026), is provided as Supplementary File 1. The Python code used for data preprocessing, statistical analysis, and VOSviewer file preparation is available as Supplementary File 2.All data and code are also openly available in the Zenodo repository at [https://doi.org/10.5281/zenodo.18474927]. References Achiam J, Adler S, Agarwal S, Ahmad L, Akkaya I, Aleman FL, et al. Gpt-4 technical report. arXiv preprint arXiv:230308774. 2023. Cai Y, Deng Q, Lv T, Zhang W, Zhou Y. Impact of GPT on the Academic Ecosystem. Science & Education. 2025;34(2):913 − 31. Priem J, Taraborelli D, Groth P, Neylon C. Altmetrics: A manifesto. 2011. Williams AE. Altmetrics: an overview and evaluation. Online information review. 2017;41(3):311-7. Kolahi J, Khazaei S, Iranmanesh P, Kim J, Bang H, Khademi A. Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences. BioMed research international. 2021;2021:6680764. Byram JN, Lazarus MD, Wilson AB, Brown KM. Could the altmetrics wave bring a flood of confusion for anatomists? Anatomical sciences education. 2023;16(4):600-9. Web of Science Core Collection: Clarivate; 2024 [cited 2026 01]. Available from: https://www.webofscience.com. Adie E, Roe W. Altmetric: enriching scholarly content with article-level discussion and metrics. Learned Publishing. 2013;26(1):11 − 7. McKinney W. Data structures for statistical computing in Python. scipy. 2010;445(1):51 − 6. Waskom ML. Seaborn: statistical data visualization. Journal of open source software. 2021;6(60):3021. Virtanen P, Gommers R, Oliphant TE, Haberland M, Reddy T, Cournapeau D, et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nature methods. 2020;17(3):261 − 72. Van Eck N, Waltman L. Software survey: VOSviewer, a computer program for bibliometric mapping. scientometrics. 2010;84(2):523 − 38. Hagberg A, Swart PJ, Schult DA. Exploring network structure, dynamics, and function using NetworkX. Los Alamos National Laboratory (LANL); 2007. Cohen J. Statistical power analysis for the behavioral sciences: routledge; 2013. Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepaño C, et al. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLoS digital health. 2023;2(2):e0000198. Singhal K, Azizi S, Tu T, Mahdavi SS, Wei J, Chung HW, et al. Large language models encode clinical knowledge. Nature. 2023;620(7972):172 − 80. Sallam M, editor ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare; 2023: MDPI. Ayers JW, Poliak A, Dredze M, Leas EC, Zhu Z, Kelley JB, et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA internal medicine. 2023;183(6):589 − 96. Khandakar S, Al Mamun M, Islam M, Hossain K, Melon M, Javed M. Unveiling early detection and prevention of cancer: Machine learning and deep learning approaches. Educational Administration: Theory and Practice. 2024;30(5):14614-28. Klein J, Wood J, Jaycox JR, Dhodapkar RM, Lu P, Gehlhausen JR, et al. Distinguishing features of long COVID identified through immune profiling. Nature. 2023;623(7985):139 − 48. Metzger SL, Littlejohn KT, Silva AB, Moses DA, Seaton MP, Wang R, et al. A high-performance neuroprosthesis for speech decoding and avatar control. Nature. 2023;620(7976):1037-46. Cervia-Hasler C, Brüningk SC, Hoch T, Fan B, Muzio G, Thompson RC, et al. Persistent complement dysregulation with signs of thromboinflammation in active Long Covid. Science. 2024;383(6680):eadg7942. Oh HS-H, Rutledge J, Nachun D, Pálovics R, Abiose O, Moran-Losada P, et al. Organ aging signatures in the plasma proteome track health and disease. Nature. 2023;624(7990):164 − 72. Karabay F, Demirci M, Tuncer S, Tekçe N, Berkman M. A bibliometric and Altmetric analysis of the 100 top most cited articles on dentin adhesives. Clinical oral investigations. 2024;28(1):92. Khan H, Gupta P, Zimba O, Gupta L. Bibliometric and altmetric analysis of retracted articles on COVID-19. Journal of Korean Medical Science. 2022;37(6). Thelwall M. Measuring societal impacts of research with altmetrics? Common problems and mistakes. Journal of economic surveys. 2021;35(5):1302-14. Wu J, Ma Y, Wang J, Xiao M. The application of ChatGPT in medicine: a scoping review and bibliometric analysis. Journal of Multidisciplinary Healthcare. 2024:1681-92. Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine. 2019;25(1):44–56. Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447 − 53. Guo Y, Hao Z, Zhao S, Gong J, Yang F. Artificial intelligence in health care: bibliometric analysis. Journal of medical Internet research. 2020;22(7):e18228. Griffiths J. The great firewall of China. 2021. Additional Declarations No competing interests reported. Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-8920991","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":604358337,"identity":"ace3297e-f4db-4592-9cf2-3bce21a515d9","order_by":0,"name":"Furkan Şakiroğlu","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA5klEQVRIie3RsWrDMBCA4QOBtBz1eoGQZzAYTKEhfhUFgyZ56lpCJo99lkChUweBSPIKWYPBQ6eCIXQqPQdntTUGoh+EhNAHZwwQi91hagsCNB+eQDjeaD5J0A1Eguw3wjACV4Lp9WKaJL5Jz1/LVU22+z69PSMov9+NEjKZ1q0pa6o+X+yBB0NjTmOkIMicdr6UTDIrmRDmowSTYzcQ22b2L4SA5cGcXzERTVWHELKvqXZGS2xzUb0Tyqlv4cE+Zr9uWSSqbDp72SwS5Q+j5NZ6y7+G+pMMed5X8BI/oa9jsVjssfoH6+xCqi2MwWUAAAAASUVORK5CYII=","orcid":"","institution":"Çat State Hospital","correspondingAuthor":true,"prefix":"","firstName":"Furkan","middleName":"","lastName":"Şakiroğlu","suffix":""},{"id":604358340,"identity":"3dec0e5c-95cb-4b76-b7fb-3a5586b3190a","order_by":1,"name":"Cemil Çolak","email":"","orcid":"","institution":"Inonu University","correspondingAuthor":false,"prefix":"","firstName":"Cemil","middleName":"","lastName":"Çolak","suffix":""}],"badges":[],"createdAt":"2026-02-19 21:53:19","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-8920991/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-8920991/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":104589508,"identity":"dc549185-a2de-45cf-9d10-05ea0ede193b","added_by":"auto","created_at":"2026-03-13 16:40:19","extension":"png","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":79734,"visible":true,"origin":"","legend":"\u003cp\u003eComparing Academic Citation and Social Media Impact (Scatter plot illustrating the relationship between citation counts and Altmetric Attention Scores. Each data point represents an individual article (n=100). The dashed line indicates the Spearman correlation trendline (r=0.299, p=0.0025). Points highlighted in red represent outliers characterized by 'high citation-low AAS' and 'low citation-high AAS' profiles. Notable outliers include Ayers et al. (high AAS, moderate citations) and Sallam et al. (high citations, low AAS))\u003c/p\u003e","description":"","filename":"floatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-8920991/v1/0b296c01124424f8ba43934c.png"},{"id":104589511,"identity":"8e41b605-5bb7-4243-a51c-f6c2f07929f9","added_by":"auto","created_at":"2026-03-13 16:40:19","extension":"png","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":107344,"visible":true,"origin":"","legend":"\u003cp\u003eScientific and Social Impact Distribution by Top Journal (The plots show median citation counts and median AAS for journals with at least 5 articles)\u003c/p\u003e","description":"","filename":"floatimage2.png","url":"https://assets-eu.researchsquare.com/files/rs-8920991/v1/6eb3ec8b2974ba727c4380e5.png"},{"id":104589514,"identity":"b81ad1b2-62c5-4847-8f95-c655919fcd1b","added_by":"auto","created_at":"2026-03-13 16:40:20","extension":"png","order_by":3,"title":"Figure 3","display":"","copyAsset":false,"role":"figure","size":120934,"visible":true,"origin":"","legend":"\u003cp\u003eSocial and Scientific Impact Distribution by Top Countries (The plots show median citation counts and median AAS for countries with at least 3 articles)\u003c/p\u003e","description":"","filename":"floatimage3.png","url":"https://assets-eu.researchsquare.com/files/rs-8920991/v1/ec43528ea8945b11c6993e42.png"},{"id":104589513,"identity":"94cecce3-2027-4423-a99a-fc879b7bb400","added_by":"auto","created_at":"2026-03-13 16:40:20","extension":"png","order_by":4,"title":"Figure 4","display":"","copyAsset":false,"role":"figure","size":77455,"visible":true,"origin":"","legend":"\u003cp\u003eComparing Keywords (Median citation counts and median AAS for selected keywords)\u003c/p\u003e","description":"","filename":"floatimage4.png","url":"https://assets-eu.researchsquare.com/files/rs-8920991/v1/03beddfc401c4d16bb8ab697.png"},{"id":104781903,"identity":"b039d4cd-b6c1-44c8-aaca-60a9e27b53f6","added_by":"auto","created_at":"2026-03-17 07:56:32","extension":"png","order_by":5,"title":"Figure 5","display":"","copyAsset":false,"role":"figure","size":117516,"visible":true,"origin":"","legend":"\u003cp\u003eShift in Priorities (Median citation counts and median AAS by Web of Science category)\u003c/p\u003e","description":"","filename":"floatimage5.png","url":"https://assets-eu.researchsquare.com/files/rs-8920991/v1/3970c2c9dcb247bafe6b3f5f.png"},{"id":104589512,"identity":"8426a0da-1718-4e43-9bc8-1cb3a4d7ca3e","added_by":"auto","created_at":"2026-03-13 16:40:19","extension":"png","order_by":6,"title":"Figure 6","display":"","copyAsset":false,"role":"figure","size":43644,"visible":true,"origin":"","legend":"\u003cp\u003eImpact Comparison based on Access Type\u003c/p\u003e","description":"","filename":"floatimage6.png","url":"https://assets-eu.researchsquare.com/files/rs-8920991/v1/a37836b72a81b33e2e37aba1.png"},{"id":104589509,"identity":"c1b961f0-13a7-429f-98bc-ca2e163e3933","added_by":"auto","created_at":"2026-03-13 16:40:19","extension":"png","order_by":7,"title":"Figure 7","display":"","copyAsset":false,"role":"figure","size":188081,"visible":true,"origin":"","legend":"\u003cp\u003eKeyword Co-occurrence Network illustrating the conceptual structure of the artificial intelligence literature. The size of the nodes represents the frequency of keywords within the dataset, while the thickness of the links between nodes indicates the strength of their co-occurrence. Colors signify the algorithmically determined clusters (Blue/Green Cluster: concepts focused on technical and engineering aspects; Red/Yellow Cluster: concepts focused on clinical application and societal impact).\u003c/p\u003e","description":"","filename":"floatimage7.png","url":"https://assets-eu.researchsquare.com/files/rs-8920991/v1/90ff3fc32719f46529c430cf.png"},{"id":104784766,"identity":"530480c0-a485-45a4-a24e-8630035a7d9d","added_by":"auto","created_at":"2026-03-17 08:08:55","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":1566015,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-8920991/v1/1e2ff229-fcd2-4093-b88f-7323b289b899.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Academic Impact vs. Societal Attention: A Dual-Analysis of Top-Cited Artificial Intelligence Articles in Medicine","fulltext":[{"header":"1. Introduction","content":"\u003cp\u003eArtificial Intelligence (AI), particularly with the introduction of ChatGPT (November 2022) and Large Language Models (LLMs), has triggered an unprecedented paradigm shift in medical research (1). AI-based applications are rapidly proliferating across nearly every domain of healthcare, ranging from diagnostic imaging to personalized treatment, and from medical education to clinical decision support systems. This technological revolution has fundamentally altered not only clinical practices but also the pace of scientific knowledge production and the dissemination of that knowledge (2).\u003c/p\u003e \u003cp\u003eTraditional bibliometric analyses and citation counts have been recognized as the 'gold standard' for measuring scientific productivity and impact for many years. However, because citation-based metrics are inherently cumulative and often require years post-publication to yield meaningful data, they may prove inadequate for measuring the real-time impact in a field evolving at such a breakneck pace as Artificial Intelligence (3). Furthermore, citation counts solely reflect the interest of the 'academic community' while neglecting the reaction\u0026mdash;and thus the societal impact\u0026mdash;of patients, policymakers, the media, and the general public. To overcome this limitation, 'Altmetrics' have emerged as a complementary tool to traditional metrics, offering the opportunity to monitor the real-time reflections of scientific outputs across social media, news outlets, blogs, and policy documents (4). Since AI research in the field of medicine concerns not only scientists but also public health directly (e.g., physician vs. AI debates), these studies possess a high potential for going 'viral' on social media. Consequently, a linear relationship may not always exist between a paper's scientific quality and its societal popularity. There is a broad consensus in the literature that altmetrics measure societal curiosity and media visibility rather than scientific quality. In their meta-analysis examining the correlation between altmetric scores and citation counts in health sciences, Kolahi et al. (2021) identified a pooled correlation coefficient of 0.19, demonstrating that these two metrics reflect distinct dimensions of impact (5). However, the methodological limitations of altmetrics should not be overlooked. Thelwall (2021) emphasized that while altmetric indicators reflect attention, they fail to distinguish the nature of that attention (e.g., endorsement, criticism, or the dissemination of misinformation). Furthermore, it is well-known that social media mentions can be artificially inflated through bot activity or coordinated campaigns (6).\u003c/p\u003e \u003cp\u003eAlthough numerous bibliometric studies exist on AI in medicine, they have predominantly focused on either academic citations or altmetric scores in isolation. To our knowledge, no study has yet jointly analyzed the top-cited articles from the post-ChatGPT era (2023\u0026ndash;2026) using both metrics to uncover the divergence between scientific and societal attention. This study fills that gap by providing a comprehensive, dual-perspective analysis of the most influential AI research in medicine. Distinguishing which topics gain academic depth (e.g., machine learning ethics) versus those that generate societal excitement (e.g., chatbots) is critical for directing future research funding and health policies.\u003c/p\u003e \u003cp\u003eThe aim of this study is to analyze the most-cited articles in the fields of medicine and informatics within the Web of Science (WoS) database for the recent period (2023\u0026ndash;2026) using bibliometric and altmetric methodologies. The study examines the correlation between academic citations and social media engagement, the performance of the most influential journals and countries, and the thematic differences (keyword analysis) between priorities of academia and society. The findings intend to provide a holistic perspective on the scientific and societal reflections of AI research.\u003c/p\u003e \u003cp\u003eThis study seeks to answer the following research questions:\u003c/p\u003e \u003cp\u003e \u003col\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eWhat is the relationship between Web of Science citation counts and the Altmetric Attention Score?\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eHow does open access status influence the academic and societal impact of articles?\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eWhich thematic areas receive more attention from the academic community versus the general public?\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eHow do academic-societal impact profiles differ across countries and journals?\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003c/ol\u003e \u003c/p\u003e \u003cp\u003eBased on previous meta-analyses (e.g., Kolahi et al., 2021), we hypothesized that there would be a weak positive correlation between citation counts and AAS. We also anticipated that open access status would be associated with higher AAS, and that certain thematic areas (e.g., chatbots) would garner more social attention than technical topics (e.g., machine learning).\u003c/p\u003e"},{"header":"2. Materials and Methods","content":"\u003cdiv id=\"Sec3\" class=\"Section2\"\u003e \u003ch2\u003e2.1. Research Design and Data Sources\u003c/h2\u003e \u003cp\u003eThis study is a cross-sectional, descriptive bibliometric and altmetric analysis evaluating the academic and societal impact of Artificial Intelligence (AI)-based medical research. Two primary data sources were utilized. The Web of Science Core Collection (Clarivate Analytics, Philadelphia, PA, USA) was employed to obtain scientific impact (citation counts) and bibliometric metadata (7). To measure the online visibility of the articles across social media, news outlets, and policy documents (Altmetric Attention Score-AAS), Altmetric.com (Digital Science, London, UK) was used (8).\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec4\" class=\"Section2\"\u003e \u003ch2\u003e\u003cb\u003e2.2. Data Collection and Search Strategy\u003c/b\u003e\u003c/h2\u003e \u003cp\u003eData retrieval was conducted between January 2023 and January 2026 to encompass the rise of generative AI and the most recent literature. WoS citation counts and Altmetric Attention Scores were retrieved on 27 January 2026 at UTC 12:00. The search strategy utilized the following term combinations within the Title (TI) and Topic (TS) fields:\u003c/p\u003e \u003cp\u003eKeywords: (\"Artificial Intelligence\" OR \"Machine Learning\" OR \"Deep Learning\" OR \"Large Language Models\" OR \"ChatGPT\" OR \"Generative AI\")\u003c/p\u003e \u003cp\u003eContext: (\"Medicine\" OR \"Health*\" OR \"Clinical\" OR \"Diagnosis\" OR \"Prognosis\")\u003c/p\u003e \u003cp\u003eExact query string and the date filter:\u003c/p\u003e \u003cp\u003eTS=(\"Artificial Intelligence\" OR \"Machine Learning\" OR \"Deep Learning\" OR \"Large Language Models\" OR \"ChatGPT\" OR \"Generative AI\") AND TS = (\"Medicine\" OR \"Health*\" OR \"Clinical\" OR \"Diagnosis\" OR \"Prognosis\") AND Document Types=(Article OR Review) AND Timespan\u0026thinsp;=\u0026thinsp;2023\u0026ndash;2026 (search conducted on January 27, 2026, covering publications from January 1, 2023, to January 27, 2026))\u003c/p\u003e \u003cp\u003e \u003cb\u003eInclusion Criteria\u003c/b\u003e:\u003c/p\u003e \u003cp\u003e \u003cul\u003e \u003cli\u003e \u003cp\u003eStudies published in the English language.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003eDocument types restricted to \"Original Research Article\" or \"Review\".\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003ePublications indexed under Web of Science categories related to clinical medical sciences, healthcare services, or medical informatics.\u003c/p\u003e \u003c/li\u003e \u003c/ul\u003e \u003c/p\u003e \u003cp\u003eEditorial materials, letters, meeting abstracts, and corrections were excluded from the analysis. The results were ranked in descending order based on their Web of Science Core Collection citation counts, and the top 100 most-cited articles constituted the study sample. We selected the Web of Science Core Collection due to its comprehensive coverage of high-impact medical journals and its reliable citation data; Scopus and PubMed were not included to maintain consistency with previous top-cited bibliometric studies.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec5\" class=\"Section2\"\u003e \u003ch2\u003e2.3. Data Extraction and Altmetric Mapping\u003c/h2\u003e \u003cp\u003eThe data extraction process was finalized on January 27, 2026. Bibliometric metadata (Title, Author, Journal, Publication Year, Author Keywords, Affiliations, Citation Count, and DOI) for the selected 100 articles were exported from the WoS database in .xlsx format.\u003c/p\u003e \u003cp\u003eTo obtain altmetric data, queries were performed via the Altmetric.com API using the Digital Object Identifier (DOI) of each article. The Altmetric Attention Score (AAS) and its source distribution were recorded. For each publication, the following metrics were documented: Total AAS, number of news mentions, Twitter/X posts, Facebook mentions, blog posts, Wikipedia citations, and Mendeley readership counts.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec6\" class=\"Section2\"\u003e \u003ch2\u003e2.4. Analytical Framework\u003c/h2\u003e \u003cp\u003eIn the analytical framework of the study:\u003c/p\u003e \u003cp\u003e \u003cul\u003e \u003cli\u003e \u003cp\u003eScientific impact was assessed via total WoS citations.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003eSocietal impact was evaluated through the AAS.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003eConceptual and geographical structures were analyzed using author keywords and the institutional affiliations of the corresponding authors.\u003c/p\u003e \u003c/li\u003e \u003c/ul\u003e \u003c/p\u003e \u003cp\u003eFurthermore, articles were categorized by access type (\"Open Access\" vs. \"Subscription-based\") and content focus (\"Methodological/Technical\" vs. \"Clinical Application\"). The complete list of the 100 articles included in the study is provided in Supplementary File 1.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec7\" class=\"Section2\"\u003e \u003ch2\u003e2.5. Statistical Analysis, Bibliometric Mapping, and Visualization\u003c/h2\u003e \u003cp\u003eStatistical analyses were performed using Python 3.12 with pandas (v2.0.0), scipy (v1.12.0), and numpy (v1.26.3) libraries. Given the non-normal distribution of bibliometric data (Shapiro-Wilk test, p\u0026thinsp;\u0026lt;\u0026thinsp;0.05), non-parametric tests were employed. The relationship between scientific impact (citations) and social impact (Altmetric scores) was assessed using Spearman\u0026rsquo;s rank correlation coefficient. To ensure the robustness of the correlation estimate, the 95% Confidence Interval (CI) was calculated using the bootstrap method with 2,000 resamples (random seed\u0026thinsp;=\u0026thinsp;42). Group comparisons (e.g., Open Access vs. Closed Access) were conducted using the Mann-Whitney U test; we report U statistic, p-value, and effect size (Cliff\u0026rsquo;s delta and r). Statistical significance was defined as a two-sided p-value\u0026thinsp;\u0026lt;\u0026thinsp;0.05. No multiple comparison correction was applied as the analyses were exploratory and hypothesis-generating rather than confirmatory.(9\u0026ndash;11).\u003c/p\u003e \u003cp\u003eScientific mapping techniques were employed to reveal the conceptual structure, research trends, and inter-topic relationships. For the construction and visualization of bibliometric networks, VOSviewer (Version 1.6.19, Leiden University, The Netherlands)(12) and Python-based network analysis libraries (NetworkX)(13) were used.\u003c/p\u003e \u003cp\u003eThe analysis process involved the following steps:\u003c/p\u003e \u003cp\u003e \u003cul\u003e \u003cli\u003e \u003cp\u003e \u003cb\u003eData Standardization\u003c/b\u003e: To ensure data consistency, synonymous or variably spelled terms in the \"Author Keywords\" column (e.g., \"Artificial Intelligence\" and \"AI\", \"Large Language Models\" and \"LLM\", \"Chat-GPT\" and \"ChatGPT\") were merged under a single standardized term.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003e \u003cb\u003eCo-occurrence Analysis\u003c/b\u003e: Keyword co-occurrence analysis was applied to determine the intellectual structure of the AI literature. To reduce noise in the network map and identify dominant trends, a minimum occurrence threshold was set, and only the most frequently used concepts were included.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003e \u003cb\u003eVisualization Parameters\u003c/b\u003e: In the generated network map, node size represents the frequency of the keyword, the lines between nodes indicate the frequency of co-occurrence in the same article, and the colors represent thematic clusters determined by the clustering algorithm.\u003c/p\u003e \u003c/li\u003e \u003c/ul\u003e \u003c/p\u003e \u003cp\u003eThe normality of continuous variables (citation counts and AAS) was examined using the Shapiro-Wilk test, which indicated that the data were not normally distributed (p\u0026thinsp;\u0026lt;\u0026thinsp;0.05). Consequently, the Spearman rank correlation coefficient was used to determine the direction and strength of the relationship between academic citations and altmetric scores. Differences in citation and altmetric scores based on open access status and article type (review vs. research) were analyzed using the Mann-Whitney U test.\u003c/p\u003e \u003cp\u003eFor all statistical tests, the significance level was set at p\u0026thinsp;\u0026lt;\u0026thinsp;0.05.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec8\" class=\"Section2\"\u003e \u003ch2\u003e2.6. Ethical Considerations\u003c/h2\u003e \u003cp\u003eAs this study is a bibliometric analysis based on publicly available data obtained from the Web of Science and Altmetric databases and does not involve any human or animal subjects, it is exempt from ethics committee approval.\u003c/p\u003e \u003cp\u003eWe used ChatGPT (OpenAI; version GPT-4o; accessed Jan 2026) and QuillBot Premium (accessed Jan 2026) for English editing and language polishing only. The authors retain responsibility for the content and interpretation of the data. Use of these tools complied with journal guidelines\u003c/p\u003e \u003c/div\u003e"},{"header":"3. Results","content":"\u003cdiv id=\"Sec10\" class=\"Section2\"\u003e \u003ch2\u003e3.1. General Characteristics of the Dataset\u003c/h2\u003e \u003cp\u003eThe top 100 most-cited articles retrieved from the Web of Science Core Collection were included in the analysis. All included publications were released between 2023 and 2025, reflecting the early-stage impact of artificial intelligence and generative language models in medicine.\u003c/p\u003e \u003cp\u003eThe median citation count of the articles was 226 (IQR: 170\u0026ndash;307.5), while the median Altmetric Attention Score (AAS) was determined to be 82 (IQR: 16\u0026ndash;396.5). Regarding accessibility, 92% (n\u0026thinsp;=\u0026thinsp;92) of the articles were published under Open Access status, with the remaining 8% appearing in subscription-based journals.\u003c/p\u003e \u003cp\u003eIn terms of document type, 65% (n\u0026thinsp;=\u0026thinsp;65) were categorized as original research articles, and 35% (n\u0026thinsp;=\u0026thinsp;35) were reviews. The distribution by year revealed a high concentration in 2023 (71%), followed by 2024 (27%) and 2025 (2%). The average number of authors per publication was calculated at 10.2.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec11\" class=\"Section2\"\u003e \u003ch2\u003e3.2. Relationship Between Academic Impact and Societal Interest\u003c/h2\u003e \u003cp\u003eThe relationship between WoS citation counts, representing academic impact, and altmetric scores, representing societal interest, was examined using Spearman\u0026rsquo;s rank correlation test. The analysis revealed a statistically significant, positive, yet weak correlation between the two variables (r\u0026thinsp;=\u0026thinsp;0.299, p\u0026thinsp;=\u0026thinsp;0.0025; 95% CI bootstrapped with 2,000 resamples [0.107, 0.457], n\u0026thinsp;=\u0026thinsp;100). According to Cohen\u0026rsquo;s (1988) effect size criteria, this correlation coefficient indicates a small-to-medium relationship (14).\u003c/p\u003e \u003cp\u003eThis finding demonstrates that studies receiving high citations within the scientific community do not always garner a corresponding level of engagement on social media; conversely, studies that go \"viral\" on social platforms do not necessarily achieve the highest levels of academic citation success (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e).\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec12\" class=\"Section2\"\u003e \u003ch2\u003e3.3. Comparison of the Most Influential Articles\u003c/h2\u003e \u003cp\u003eAn examination of the most successful articles in terms of scientific and societal impact reveals two distinct patterns (Table\u0026nbsp;\u003cspan refid=\"Tab1\" class=\"InternalRef\"\u003e1\u003c/span\u003e and Table\u0026nbsp;\u003cspan refid=\"Tab2\" class=\"InternalRef\"\u003e2\u003c/span\u003e). The study titled 'Performance of ChatGPT on USMLE' by Kung et al. stands at the pinnacle of academic impact with 2,193 citations, while simultaneously achieving high visibility on social media with an Altmetric score of 1,766.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab1\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eTop 5 Most Cited Articles in Academic Literature (Scientific Impact)\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"5\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eRank\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eArticle Title (Shortened)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eCategory\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003eWoS Citations (Scientific Impact)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e \u003cp\u003eAltmetric Score (Social Impact)\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003ePerformance of ChatGPT on USMLE: Potential for AI-assisted medical education...(15)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eEducation / Exam\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e2193\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e1766\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eLarge language models encode clinical knowledge(16)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eBasic Science / AI\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e1719\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e1248\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review...(17)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eReview\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e1592\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e94\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e4\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eComparing Physician and AI Chatbot Responses to Patient Questions...(18)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eClinical Comparison\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e1385\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e6388\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eSegment anything in medical images (19)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eTechnical / Imaging\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e1338\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e283\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eThe study by Ayers et al. titled 'Comparing Physician and Artificial Intelligence Chatbot Responses' emerged as the most debated publication across social media and news outlets, reaching a peak Altmetric score of 6,388 (18). While its citation count (1,385) is also substantial, its societal impact is proportionally much more dominant than its academic influence. Similarly, the study titled 'Distinguishing features of long COVID' generated a massive public resonance with an Altmetric score of 4,181, yet remained further behind in academic citation rankings with 452 citations.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab2\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 2\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eTop 5 Most Popular Articles on Social Media and News (Social Impact)\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"5\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eRank\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eArticle Title (Shortened)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eFocus Area\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003eAltmetric Score (Social Impact)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e \u003cp\u003eWoS Citations (Scientific Impact)\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eComparing Physician and AI Chatbot Responses to Patient Questions...(18)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eDoctor vs. AI\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e6388\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e1385\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eDistinguishing features of long COVID identified through immune profiling(20)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003ePublic Health / COVID\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e4181\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e452\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eA high-performance neuroprosthesis for speech decoding and avatar control(21)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eFuturism / BCI\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e3683\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e229\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e4\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003ePersistent complement dysregulation ... in active Long Covid(22)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003ePublic Health / COVID\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e2945\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e259\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eOrgan aging signatures in the plasma proteome track health and disease (23)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003eAging / Prevention\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e2036\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e291\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec13\" class=\"Section2\"\u003e \u003ch2\u003e3.4. Analysis of Societal Engagement Sources\u003c/h2\u003e \u003cp\u003eTable\u0026nbsp;\u003cspan refid=\"Tab3\" class=\"InternalRef\"\u003e3\u003c/span\u003e compares the distribution of societal dissemination sources for the top three studies with the highest altmetric scores. The results indicate that societal interest is not monolithic; rather, three distinct \"Engagement Profiles\" emerge based on the study's subject matter:\u003c/p\u003e \u003cp\u003e \u003cul\u003e \u003cli\u003e \u003cp\u003eThe \"Hybrid/Viral\" Profile (Physician vs. Chatbot): By addressing a popular and controversial question of universal concern\u0026mdash;\"Will AI replace doctors?\"\u0026mdash;this study garnered record-breaking attention across both news outlets (413 stories) and Twitter (5,158 posts). This profile represents rare instances where a scientific topic simultaneously penetrates the mainstream media agenda and triggers intensive public discourse. This tripartite classification\u0026mdash;'Hybrid/Viral', 'Community-Driven', and 'Futuristic/Media-Centric'\u0026mdash;demonstrates that societal engagement patterns vary systematically with research topic.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003eThe \"Community-Driven\" Profile (Long COVID): Despite receiving less than half the news coverage of the top-ranked article (191 stories), this study achieved the highest Twitter engagement with 6,108 tweets. This suggests that topics involving patient advocacy and diagnostic uncertainty, such as Long COVID, are primarily adopted and disseminated by social media communities rather than news organizations. This represents popularity amplified by the public rather than the media.\u003c/p\u003e \u003c/li\u003e \u003cli\u003e \u003cp\u003eThe \"Futuristic/Media-Centric\" Profile (Neuroprosthesis / Avatar): This study, which enables a paralyzed patient to communicate via brain signals, remained relatively quiet on Twitter (only 668 tweets) but was featured in 409 news outlets, nearly matching the first-ranked article. This profile proves that futuristic technologies with high visual appeal (e.g., neural interfaces) are highly favored as \"Technology News\" by traditional media (TV, newspapers), even if they do not spark extensive daily discussion among the general public on social platforms.\u003c/p\u003e \u003c/li\u003e \u003c/ul\u003e \u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab3\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 3\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eBreakdown of Social Attention Sources for the Top 3 High-Scoring Papers\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"6\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c6\" colnum=\"6\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eRank\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003ePaper Topic \u0026amp; Context (Descriptive Name)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eNews Mentions\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003eTwitter (X) Posts\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e \u003cp\u003eAltmetric Score\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c6\"\u003e \u003cp\u003eDominant Source\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003ePhysician vs. Chatbot (Clinical Comparison)(18)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e413\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e5,158\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e6,388\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003eMixed (Viral)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eLong COVID (Immune Profiling)(20)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e191\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e6,108\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e4,181\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003eSocial Media\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eNeuroprosthesis (Speech Decoding / Avatar)(21)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e409\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e668\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e3,683\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c6\"\u003e \u003cp\u003eNews Media\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec14\" class=\"Section2\"\u003e \u003ch2\u003e3.5. Journal and Country Performance\u003c/h2\u003e \u003cp\u003eAnalysis of the distribution of publications by journal reveals that Nature (n\u0026thinsp;=\u0026thinsp;11) and NPJ Digital Medicine (n\u0026thinsp;=\u0026thinsp;11) emerged as the most productive outlets. Nature stood at the pinnacle of academic impact with a median citation count of 445, while also maintaining its leadership in societal impact (Median AAS: 908).\u003c/p\u003e \u003cp\u003eA notable finding is that Science magazine, despite having the highest social media influence with a median Altmetric score of 913, trailed behind Nature in terms of academic citations (Median: 259). The clinically-oriented JAMA Network Open demonstrated a balanced and robust performance in both academic (Median Citations: 200.5) and social (Median AAS: 226.5) metrics. Conversely, the median Altmetric score for Scientific Reports was notably low at 8; this indicates that the high overall average for this journal was driven by a few viral articles rather than a widespread distribution of engagement across its publications.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eWhen country impact is evaluated based on median values, the United States (USA) maintains its dominance in the field with 58 articles, exhibiting a balanced and high profile in both academic impact (Median Citation: 247.5) and social influence (Median AAS: 227). In contrast, studies originating from China have been unable to translate their success in the academic world (Median Citation: 204) into social media visibility; the median altmetric score for Chinese publications was found to be only 12.\u003c/p\u003e \u003cp\u003eThis striking discrepancy suggests that while research from China possesses high scientific value, it does not achieve sufficient circulation within Western-centric social media networks and news outlets\u0026mdash;a phenomenon that may be characterized as 'digital isolation.' Furthermore, Canada (Median Citation: 271, Median AAS: 369), despite a smaller number of publications (n\u0026thinsp;=\u0026thinsp;7), emerged as one of the countries reaching the highest median values in both domains.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec15\" class=\"Section2\"\u003e \u003ch2\u003e3.6. Thematic Analysis\u003c/h2\u003e \u003cp\u003eAn impact analysis conducted via author keywords reveals that academia and the general public prioritize distinct subjects.\u003c/p\u003e \u003cp\u003eAcademic Focus: Studies featuring the keywords \"Ethics\" (Median Citations: 309.5) and \"Machine Learning\" (Median Citations: 307) stand at the forefront of scientific impact. This indicates that the academic community prioritizes not only the technical capabilities of AI but also its ethical boundaries and methodological foundations.\u003c/p\u003e \u003cp\u003eSocietal Focus: Contrary to mean values, an examination of median values shows that the standard social media impact of popular topics such as \"Chatbot\" (Median AAS: 30.5) and \"Large Language Models\" (Median AAS: 28.5) does not differ significantly from more technical subjects (e.g., Ethics: 34). This critical finding suggests that social media interest is not necessarily driven by a specific topic itself, but rather focuses on individual articles with sensational qualities within those topics.\u003c/p\u003e \u003cp\u003e\"ChatGPT\" remains the most balanced and central term in the literature, characterized by both high academic citation rates (Median: 248) and consistent social visibility (Median AAS: 30).\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eThe impact analysis conducted according to Web of Science categories (Fig.\u0026nbsp;\u003cspan refid=\"Fig5\" class=\"InternalRef\"\u003e5\u003c/span\u003e) reveals a sharp divergence in character across different disciplines.\u003c/p\u003e \u003cp\u003eThe 'Medicine, General \u0026amp; Internal' category emerged as the most influential domain in the literature, with a median citation count of 255 and a median Altmetric score of 200. This trend indicates that AI discussions have evolved beyond being purely technical subjects and have shifted toward the axes of clinical practice and public health.\u003c/p\u003e \u003cp\u003eIn stark contrast, studies categorized under 'Computer Science' were found to have a median Altmetric score of 0 (zero). While publications in the computer science field continue to receive academic citations (Median: 163), they failed to achieve any significant visibility across social media platforms or news outlets.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec16\" class=\"Section2\"\u003e \u003ch2\u003e3.7. The Impact of Open Access\u003c/h2\u003e \u003cp\u003eWhile the prevailing expectation in the literature is that open access articles achieve higher visibility, the data obtained in this study present a different picture (Fig.\u0026nbsp;\u003cspan refid=\"Fig6\" class=\"InternalRef\"\u003e6\u003c/span\u003e).\u003c/p\u003e \u003cp\u003eA Mann-Whitney U test was conducted to determine if Open Access status influenced social impact. The analysis revealed no statistically significant difference in Altmetric scores between Open Access (n\u0026thinsp;=\u0026thinsp;92, Mdn\u0026thinsp;=\u0026thinsp;30.5) and Closed Access (n\u0026thinsp;=\u0026thinsp;8, Mdn\u0026thinsp;=\u0026thinsp;14.5) articles (U\u0026thinsp;=\u0026thinsp;234.0, p\u0026thinsp;=\u0026thinsp;0.090). The effect size was small to medium (Cliff\u0026rsquo;s δ = -0.364), indicating that accessibility alone was not the primary driver of social attention in this high-impact dataset. The difference approached but did not reach statistical significance (p\u0026thinsp;=\u0026thinsp;0.090).\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec17\" class=\"Section2\"\u003e \u003ch2\u003e3.8. Conceptual Structure and Trend Analysis\u003c/h2\u003e \u003cp\u003eThe keyword map generated using the VOSviewer algorithm (Fig.\u0026nbsp;\u003cspan refid=\"Fig7\" class=\"InternalRef\"\u003e7\u003c/span\u003e) demonstrates that the literature is concentrated along two primary axes: the technical infrastructure (blue cluster) and social/clinical applications (red cluster).\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e"},{"header":"4. Discussion","content":"\u003cp\u003eThe present study stands as one of the first comprehensive bibliometric investigations to systematically compare the academic (citations) and societal (Altmetric) impact of the top-cited AI research in medicine from the generative AI era (2023\u0026ndash;2026). Our findings reveal a statistically significant but weak correlation between academic impact and societal interest. This result corroborates the thesis that \"scientific quality and popularity do not always coincide,\" indicating the existence of \"two distinct audiences\" (scholars and the general public) in AI research. Similarly, Karabay et al. (2024) found no significant correlation between citations and altmetric scores in their analysis of dental literature (24). This suggests that, independent of the discipline, scholarly accumulation (citations) and societal awareness (Altmetrics) constitute two separate universes governed by distinct dynamics. Khan et al. (2022) previously warned the literature that even publications lacking scientific validity could garner record-level attention on social media, emphasizing that Altmetric scores may not mirror scientific rigor (25). Our findings validate this divergence on a different scale: although all articles in our dataset were high-cited (high-quality) works, this academic success did not consistently translate into high social impact. As noted by Thelwall (2021), altmetric indicators measure \"societal curiosity\" and \"media visibility\" rather than intrinsic scientific merit (26).\u003c/p\u003e \u003cp\u003eThe distribution of publications revealed a high concentration in 2023 (71%), followed by 2024 (27%) and 2025 (2%). This trend indicates that academic interest in generative artificial intelligence technologies reached its pinnacle specifically in 2023. Furthermore, the average number of authors per article was calculated at 10.2, reflecting the field\u0026rsquo;s multidisciplinary nature (combining engineering and medicine) and its reliance on multi-center collaboration.\u003c/p\u003e \u003cp\u003eIn a comprehensive bibliometric analysis conducted by Wu et al. (2024), it was reported that approximately 41% of the ChatGPT-related literature consisted of 'Letters to the Editor' or opinion pieces. This finding serves as robust evidence that the field was initially in a phase of speculation and 'early hype' (27).\u003c/p\u003e \u003cp\u003eIn the present study, to eliminate the 'noise' identified by Wu et al. (2024) and to analyze the scientific backbone of the literature, the dataset was methodologically filtered to include only the top 100 most-cited works categorized as 'Original Articles' or 'Reviews.' Consequently, this research represents the 'evidence-based' facet of the AI literature with the potential to shape clinical practice, rather than its purely 'popular' aspect. Our results indicate that this 'elite' cluster resonates within society not only through academic citations but also through high social media engagement (Median AAS: 82) (27).\u003c/p\u003e \u003cp\u003eOur analysis reveals a structural, rather than merely thematic, divergence between the priorities of academia and the general public (Fig.\u0026nbsp;\u003cspan refid=\"Fig4\" class=\"InternalRef\"\u003e4\u003c/span\u003e). When examining median citation values, concepts such as 'Ethics' (Median Citation: 309.5) and 'Machine Learning' (Median Citation: 307) were found to exert a significantly greater scientific impact than the popular 'Chatbot' studies (Median Citation: 239). Conversely, an intriguing paradox was observed on the social media front. Although the mean altmetric scores for 'Chatbot' and 'ChatGPT' terms were exceedingly high, their median scores (30.5 and 30, respectively) were nearly identical to technical subjects like 'Machine Learning' (Median AAS: 31).\u003c/p\u003e \u003cp\u003eThis critical finding proves that the public does not engage with every study on chatbots; rather, interest is reserved for studies with a specific narrative. The most concrete example of this selective interest is the study by Ayers et al. (2023). The reason this paper stood out from other chatbot research to garner record-breaking attention (AAS\u0026thinsp;\u0026gt;\u0026thinsp;6,000) was not just its technical analysis, but its focus on the competitive inquiry: 'Who is better: the Physician or Artificial Intelligence?' (18). Consequently, our data confirm that while academia prioritizes 'conceptual depth,' society grants a premium to 'sensational competition.' Social media tends to respond with sensational fervor to competitive narratives such as 'Physician vs. Artificial Intelligence' (Ayers et al., 2023). In contrast, the fundamental vision of the academic literature is built upon the 'convergence' of human and artificial intelligence\u0026mdash;a concept defined by Topol (2019) as 'High-Performance Medicine (28).\u003c/p\u003e \u003cp\u003eThe academic community's intense focus on ethical issues can be linked to the striking findings of Obermeyer et al. (2019), which exposed structural biases within healthcare algorithms. This underscores a fundamental scholarly stance: academia prioritizes the safety and reliability of technology over its mere speed of development (29).\u003c/p\u003e \u003cp\u003eWhen examining the shifts within the literature, bibliometric studies covering the pre-generative AI era (Guo et al., 2020) show that the focus was predominantly concentrated on technical metrics such as 'algorithm performance,' 'disease diagnosis,' and 'image processing.' Guo et al. (2020) identified that while the AI literature in healthcare was growing rapidly, the majority of studies remained limited to theoretical modeling rather than clinical integration (30).\u003c/p\u003e \u003cp\u003eIn contrast, our current study, which covers the post-ChatGPT era, observes that the axis has shifted from technical performance toward 'social interaction' (e.g., Chatbot vs. Physician) and 'ethical discourse.' The steady growth identified in the analysis by Guo et al. (2020) has been superseded by an explosive popularity as of 2023. This phenomenon proves that artificial intelligence is no longer confined to the engineers' laboratories but has become central to daily public discourse (30).\u003c/p\u003e \u003cp\u003eA striking finding in our study is that while publications originating from China (n\u0026thinsp;=\u0026thinsp;16) achieved high academic citation counts, they exhibited statistically significant lower Altmetric Attention Scores (AAS) compared to studies from the USA and the UK. This discrepancy stems from the structural limitations of current altmetric data aggregators (e.g., Altmetric.com) rather than a lack of societal impact by Chinese research.\u003c/p\u003e \u003cp\u003eThe Altmetric.com algorithm comprehensively tracks Western-centric platforms such as Twitter (X), Facebook, and Reddit; however, it either fails to index or provides very limited coverage of platforms like WeChat and Weibo, which serve as the primary communication channels for the Chinese academic ecosystem (31). Consequently, the substantial social impact generated by Chinese researchers within their local digital ecosystems is rendered 'invisible' by Western-centric metrics. This situation creates a significant risk of 'Data Coverage Bias' in bibliometric analyses, leading to the systematic underestimation of the societal influence of publications originating from the Global South or East Asia. This 'digital isolation' is not a reflection of low societal interest in China, but rather a manifestation of data coverage bias inherent in current altmetric aggregators, which inadequately index major Chinese platforms like WeChat and Weibo.\u003c/p\u003e \u003cp\u003eFurthermore, the limited social impact of articles in the Computer Science category, despite their academic citations, is directly related to our methodological choices. During the construction of the dataset, we prioritized Medicine and Health Sciences journals that directly influence clinical practice over pure engineering journals.\u003c/p\u003e \u003cp\u003eConsequently, the studies labeled as 'Computer Science' in our analysis do not represent internal theoretical debates within the engineering community, but rather interdisciplinary works published in medical journals. It is expected that such technically dense articles are shared less by medical journal readers and the general public compared to articles with direct clinical implications, such as 'Chatbot vs. Physician.' This finding proves that while a 'technical infrastructure' is an academic necessity in the field of AI in healthcare, the primary factor determining 'social visibility' is the clinical and human narrative.\u003c/p\u003e \u003cp\u003eThe conceptual mapping analysis of our study (Fig.\u0026nbsp;\u003cspan refid=\"Fig7\" class=\"InternalRef\"\u003e7\u003c/span\u003e) demonstrates that the intellectual structure of the literature is distinctly clustered along two main axes. At one end of the map lies the technical infrastructure\u0026mdash;represented by concepts such as 'Machine Learning' and 'Neural Networks'\u0026mdash;while the other end hosts the social and clinical application areas represented by 'ChatGPT,' 'Ethics,' and 'Education.' The gradual displacement of technical terms by concepts focused on 'social impact' over the years provides the clearest visual evidence that AI literature has moved beyond the laboratory stage and onto a platform of societal debate.\u003c/p\u003e \u003cp\u003eContrary to expectations, the finding that Open Access (OA) articles had lower social impact scores than subscription-based articles demonstrates that 'access to content' alone is insufficient. The fact that subscription-based articles published in high-prestige journals like Nature, Science, or NEJM are more frequently reported by global news networks proves that 'Journal Branding' is a more potent visibility factor than mere accessibility. This finding aligns with studies showing that journal prestige can override accessibility in driving media attention.\u003c/p\u003e \u003cdiv id=\"Sec19\" class=\"Section2\"\u003e \u003ch2\u003e4.1. Practical Implications and Conclusion\u003c/h2\u003e \u003cp\u003eThe findings of this study offer significant implications for various stakeholders:\u003c/p\u003e \u003cp\u003eResearchers: To enhance both the academic and societal impact of AI research, authors should focus on clinical and human narratives alongside technical content and improve their science communication competencies such as engaging with science journalists, using plain language summaries, and actively disseminating findings on multiple social media platforms.\u003c/p\u003e \u003cp\u003eFunding Agencies: Multi-dimensional evaluation approaches should be adopted rather than relying on a single metric when assessing research impact.\u003c/p\u003e \u003cp\u003eJournal Editors: It should be considered that the brand value of high-prestige journals is a stronger driver of visibility than accessibility.\u003c/p\u003e \u003cp\u003ePolicy Makers: Given that public debates regarding AI applications in health are often shaped by sensational competition, mechanisms should be established to support the flow of evidence-based information.\u003c/p\u003e \u003c/div\u003e"},{"header":"5. Limitations of the Study","content":"\u003cp\u003eDespite its comprehensive scope, this study has certain limitations that should be acknowledged. First, the dataset is restricted to the Web of Science (WoS) database; consequently, preprint servers such as arXiv, which are extensively utilized in the field of artificial intelligence, were not included in the analysis. Second, Altmetric data are subject to external factors, including API policy changes by social media platforms (notably Twitter/X) and instantaneous fluctuations in online popularity. Altmetric scores are platform-dependent and subject to temporal fluctuations; they may not fully capture the nature (positive vs. negative) of online attention. Finally, the analysis was limited to English-language publications, which may have resulted in the omission of societal debates occurring in local languages.\u003c/p\u003e"},{"header":"6. Conclusion","content":"\u003cp\u003eThis study provides quantitative evidence of a distinct divergence between \"academic significance\" and \"societal excitement\" within the medical artificial intelligence literature. While the academic community focuses on how AI works (ethics, methodology), the general public and media concentrate on whom AI will replace (e.g., the \"Physician vs. Chatbot\" narrative).\u003c/p\u003e \u003cp\u003eThe findings underscore that researchers and funding agencies should avoid relying on a single metric\u0026mdash;whether exclusively citations or social media scores\u0026mdash;when evaluating the impact of a study. Especially for AI applications involving public health, it is of critical importance that researchers enhance their science communication competencies to ensure that scientifically rigorous studies are accurately disseminated to the public. Future research should utilize long-term data to monitor whether the current surge in popularity translates into lasting scientific impact. As AI continues to reshape medicine, bridging the gap between academic rigor and public engagement will be essential for translating innovation into real-world health benefits.\u003c/p\u003e \u003cp\u003eThe original dataset analyzed in this study was retrieved from the Web of Science Core Collection. The processed dataset used for the final analysis, including citation counts and Altmetric scores (retrieved in January 2026), is provided as Supplementary File 1. The Python code used for data preprocessing, statistical analysis, and VOSviewer file preparation is available as Supplementary File 2.\u003c/p\u003e \u003cp\u003eAll data and code are also openly available in the Zenodo repository at [\u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://doi.org/10.5281/zenodo.18474927\u003c/span\u003e\u003cspan address=\"10.5281/zenodo.18474927\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e].\u003c/p\u003e"},{"header":"Declarations","content":"\u003ch2\u003eAuthor Contribution\u003c/h2\u003e\u003cp\u003eF.Ş. and C.\u0026Ccedil;. contributed equally to all stages of this study. Both authors were involved in the study's conceptualization, methodology design, and data collection. F.Ş. and C.\u0026Ccedil;. performed the bibliometric and altmetric data analysis, prepared the figures and tables, and wrote the main manuscript text. All authors reviewed and approved the final version of the manuscript.\u003c/p\u003e\u003ch2\u003eData Availability\u003c/h2\u003e\u003cp\u003eThe original dataset analyzed in this study was retrieved from the Web of Science Core Collection. The processed dataset used for the final analysis, including citation counts and Altmetric scores (retrieved in January 2026), is provided as Supplementary File 1. The Python code used for data preprocessing, statistical analysis, and VOSviewer file preparation is available as Supplementary File 2.All data and code are also openly available in the Zenodo repository at [https://doi.org/10.5281/zenodo.18474927].\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\n\u003cli\u003eAchiam J, Adler S, Agarwal S, Ahmad L, Akkaya I, Aleman FL, et al. Gpt-4 technical report. arXiv preprint arXiv:230308774. 2023.\u003c/li\u003e\n\u003cli\u003eCai Y, Deng Q, Lv T, Zhang W, Zhou Y. Impact of GPT on the Academic Ecosystem. Science \u0026amp; Education. 2025;34(2):913\u0026thinsp;\u0026minus;\u0026thinsp;31.\u003c/li\u003e\n\u003cli\u003ePriem J, Taraborelli D, Groth P, Neylon C. Altmetrics: A manifesto. 2011.\u003c/li\u003e\n\u003cli\u003eWilliams AE. Altmetrics: an overview and evaluation. Online information review. 2017;41(3):311-7.\u003c/li\u003e\n\u003cli\u003eKolahi J, Khazaei S, Iranmanesh P, Kim J, Bang H, Khademi A. Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences. BioMed research international. 2021;2021:6680764.\u003c/li\u003e\n\u003cli\u003eByram JN, Lazarus MD, Wilson AB, Brown KM. Could the altmetrics wave bring a flood of confusion for anatomists? Anatomical sciences education. 2023;16(4):600-9.\u003c/li\u003e\n\u003cli\u003eWeb of Science Core Collection: Clarivate; 2024 [cited 2026 01]. Available from: https://www.webofscience.com.\u003c/li\u003e\n\u003cli\u003eAdie E, Roe W. Altmetric: enriching scholarly content with article-level discussion and metrics. Learned Publishing. 2013;26(1):11\u0026thinsp;\u0026minus;\u0026thinsp;7.\u003c/li\u003e\n\u003cli\u003eMcKinney W. Data structures for statistical computing in Python. scipy. 2010;445(1):51\u0026thinsp;\u0026minus;\u0026thinsp;6.\u003c/li\u003e\n\u003cli\u003eWaskom ML. Seaborn: statistical data visualization. Journal of open source software. 2021;6(60):3021.\u003c/li\u003e\n\u003cli\u003eVirtanen P, Gommers R, Oliphant TE, Haberland M, Reddy T, Cournapeau D, et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nature methods. 2020;17(3):261\u0026thinsp;\u0026minus;\u0026thinsp;72.\u003c/li\u003e\n\u003cli\u003eVan Eck N, Waltman L. Software survey: VOSviewer, a computer program for bibliometric mapping. scientometrics. 2010;84(2):523\u0026thinsp;\u0026minus;\u0026thinsp;38.\u003c/li\u003e\n\u003cli\u003eHagberg A, Swart PJ, Schult DA. Exploring network structure, dynamics, and function using NetworkX. Los Alamos National Laboratory (LANL); 2007.\u003c/li\u003e\n\u003cli\u003eCohen J. Statistical power analysis for the behavioral sciences: routledge; 2013.\u003c/li\u003e\n\u003cli\u003eKung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepa\u0026ntilde;o C, et al. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLoS digital health. 2023;2(2):e0000198.\u003c/li\u003e\n\u003cli\u003eSinghal K, Azizi S, Tu T, Mahdavi SS, Wei J, Chung HW, et al. Large language models encode clinical knowledge. Nature. 2023;620(7972):172\u0026thinsp;\u0026minus;\u0026thinsp;80.\u003c/li\u003e\n\u003cli\u003eSallam M, editor ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare; 2023: MDPI.\u003c/li\u003e\n\u003cli\u003eAyers JW, Poliak A, Dredze M, Leas EC, Zhu Z, Kelley JB, et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA internal medicine. 2023;183(6):589\u0026thinsp;\u0026minus;\u0026thinsp;96.\u003c/li\u003e\n\u003cli\u003eKhandakar S, Al Mamun M, Islam M, Hossain K, Melon M, Javed M. Unveiling early detection and prevention of cancer: Machine learning and deep learning approaches. Educational Administration: Theory and Practice. 2024;30(5):14614-28.\u003c/li\u003e\n\u003cli\u003eKlein J, Wood J, Jaycox JR, Dhodapkar RM, Lu P, Gehlhausen JR, et al. Distinguishing features of long COVID identified through immune profiling. Nature. 2023;623(7985):139\u0026thinsp;\u0026minus;\u0026thinsp;48.\u003c/li\u003e\n\u003cli\u003eMetzger SL, Littlejohn KT, Silva AB, Moses DA, Seaton MP, Wang R, et al. A high-performance neuroprosthesis for speech decoding and avatar control. Nature. 2023;620(7976):1037-46.\u003c/li\u003e\n\u003cli\u003eCervia-Hasler C, Br\u0026uuml;ningk SC, Hoch T, Fan B, Muzio G, Thompson RC, et al. Persistent complement dysregulation with signs of thromboinflammation in active Long Covid. Science. 2024;383(6680):eadg7942.\u003c/li\u003e\n\u003cli\u003eOh HS-H, Rutledge J, Nachun D, P\u0026aacute;lovics R, Abiose O, Moran-Losada P, et al. Organ aging signatures in the plasma proteome track health and disease. Nature. 2023;624(7990):164\u0026thinsp;\u0026minus;\u0026thinsp;72.\u003c/li\u003e\n\u003cli\u003eKarabay F, Demirci M, Tuncer S, Tek\u0026ccedil;e N, Berkman M. A bibliometric and Altmetric analysis of the 100 top most cited articles on dentin adhesives. Clinical oral investigations. 2024;28(1):92.\u003c/li\u003e\n\u003cli\u003eKhan H, Gupta P, Zimba O, Gupta L. Bibliometric and altmetric analysis of retracted articles on COVID-19. Journal of Korean Medical Science. 2022;37(6).\u003c/li\u003e\n\u003cli\u003eThelwall M. Measuring societal impacts of research with altmetrics? Common problems and mistakes. Journal of economic surveys. 2021;35(5):1302-14.\u003c/li\u003e\n\u003cli\u003eWu J, Ma Y, Wang J, Xiao M. The application of ChatGPT in medicine: a scoping review and bibliometric analysis. Journal of Multidisciplinary Healthcare. 2024:1681-92.\u003c/li\u003e\n\u003cli\u003eTopol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine. 2019;25(1):44\u0026ndash;56.\u003c/li\u003e\n\u003cli\u003eObermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447\u0026thinsp;\u0026minus;\u0026thinsp;53.\u003c/li\u003e\n\u003cli\u003eGuo Y, Hao Z, Zhao S, Gong J, Yang F. Artificial intelligence in health care: bibliometric analysis. Journal of medical Internet research. 2020;22(7):e18228.\u003c/li\u003e\n\u003cli\u003eGriffiths J. The great firewall of China. 2021.\u003c/li\u003e\n\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"Artificial Intelligence, Bibliometrics, Altmetrics, ChatGPT, Medical Research, Societal Impact, Large Language Models, Citation Analysis","lastPublishedDoi":"10.21203/rs.3.rs-8920991/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-8920991/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003ch2\u003eObjective\u003c/h2\u003e \u003cp\u003eThis study aims to examine the relationship between the academic citation success and social visibility of Artificial Intelligence (AI)-based medical research using bibliometric and altmetric methodologies.\u003c/p\u003e\u003ch2\u003eMethods\u003c/h2\u003e \u003cp\u003eThe top 100 most-cited articles indexed in the Web of Science Core Collection from 1 January 2023 to 27 January 2026 were analyzed; citation counts and Altmetric Attention Scores (AAS) were retrieved on 27 January 2026 (See Methods for the full search query). Academic impact was measured by Web of Science citation counts, while social impact was evaluated using the Altmetric Attention Score (AAS). Data were assessed through Spearman\u0026rsquo;s correlation analysis and the Mann-Whitney U test.\u003c/p\u003e\u003ch2\u003eResults\u003c/h2\u003e \u003cp\u003eA statistically significant but weak positive correlation was identified between citation counts and AAS (r\u0026thinsp;=\u0026thinsp;0.299, p\u0026thinsp;=\u0026thinsp;0.0025). Open access status characterized 92% of the articles. The highest academic impact was achieved by the ChatGPT-USMLE study by Kung et al. (2023) with 2,193 citations, whereas the highest social impact was held by the \"Physician vs. Chatbot\" study by Ayers et al. (2023) (AAS: 6,388). A notable finding was that publications originating from China exhibited remarkably low altmetric scores (Median AAS: 12) despite high academic citation rates, suggesting a 'digital isolation' effect that may stem from Western-centric altmetric data coverage.\u003c/p\u003e\u003ch2\u003eConclusion\u003c/h2\u003e \u003cp\u003eAcademic success and societal popularity are governed by distinct dynamics, indicating the need for researchers to adopt science communication strategies and for funding agencies to use multidimensional impact metrics. While academia prioritizes conceptual depth\u0026mdash;such as ethics and methodology\u0026mdash;the general public shows greater interest in sensational competition (e.g., physician vs. AI). It is recommended that researchers enhance their science communication competencies and that funding agencies adopt multidimensional evaluation approaches.\u003c/p\u003e","manuscriptTitle":"Academic Impact vs. Societal Attention: A Dual-Analysis of Top-Cited Artificial Intelligence Articles in Medicine","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2026-03-13 16:40:03","doi":"10.21203/rs.3.rs-8920991/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"a3aa1a48-e0e6-4bab-9d82-dc28a0a13996","owner":[],"postedDate":"March 13th, 2026","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[],"tags":[],"updatedAt":"2026-03-13T16:40:03+00:00","versionOfRecord":[],"versionCreatedAt":"2026-03-13 16:40:03","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-8920991","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-8920991","identity":"rs-8920991","version":["v1"]},"buildId":"XKTyCvWXoU3ODBz1xrDgd","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: preprint-html

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2026) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00