Spontaneous Sourcing Strategies and Heuristics in Adolescents’ Evaluation of Online Information | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Article Spontaneous Sourcing Strategies and Heuristics in Adolescents’ Evaluation of Online Information Margherita Ghiara, Mara Floris, Martina Calderisi, Yugin Cho, and 1 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-7760447/v1 This work is licensed under a CC BY 4.0 License Status: Under Review Version 1 posted 11 You are reading this latest preprint version Abstract In today’s information-rich environment, adolescents face significant challenges in evaluating the credibility of scientific content on social media. This study investigates how 130 high school students assessed the truthfulness of scientific and pseudoscientific Instagram-style posts in a classroom-based, ecologically valid setting. Participants provided written justifications for their judgments, which were thematically coded into 17 evaluative strategies grouped into three macro-categories: lateral reading, cues, and plausibility. Lateral reading was the most frequently used and correlated with higher judgment accuracy, though not significantly. Plausibility-based reasoning, by contrast, often led to incorrect classifications. Over 60% of students conducted external searches, but only half were judged effective. Notably, 40% of participants revised at least one judgment during the activity, and most of these revisions led to improved accuracy. The findings underscore the need for digital literacy interventions that promote reflective reasoning, effective search habits, and critical engagement with diverse epistemic resources. Social science/Education Humanities/Philosophy Biological sciences/Psychology Social science/Psychology Social science/Science technology and society digital literacy science disinformation information evaluation adolescents Figures Figure 1 Figure 2 Figure 3 Introduction In today’s digital environment, adolescents are constantly exposed to an abundance of information, much of which circulates in visually compelling but epistemically ambiguous formats such as social media posts and influencer-generated content [ 1 , 2 ]. Platforms like Instagram and TikTok play a central role in shaping young people’s understanding of the world, including science-related topics that carry both personal and collective implications, like alimentary habits or vaccination behavior. Yet, navigating this information-rich ecosystem requires more than just digital fluency: it demands critical evaluation skills, epistemic vigilance [ 3 ], and awareness of the social and technological infrastructures that mediate access to information. While adolescents are often described as “digital natives” [ 4 ], empirical research challenges the assumption that growing up with digital technologies equates to a high level of digital literacy or critical thinking [ 5 ]: studies show that young people’s ability to assess the credibility of online content is frequently limited by superficial evaluation strategies and cognitive constraints [ 6 , 7 ]. Rather than applying rigorous analytical frameworks, they tend to rely on visual appeal, personal preference, familiarity, or search engine rankings [ 1 ]. Even though such heuristics may be efficient, they are often epistemically unreliable [ 8 , 9 ]. Indeed, adolescents’ evaluative behaviors might be shaped by a combination of factors: bounded rationality, information overload, and satisficing strategies [ 6 , 7 , 10 ]. In practical terms, this means settling for the first seemingly plausible result rather than systematically seeking the most authoritative or corroborated source. This behavior often occurs even when students are aware of traditional credibility markers such as author expertise or institutional affiliation [ 9 , 11 ]. A consistent finding across observational and experimental studies is the discrepancy between what adolescents claim to do to assess credibility and what they actually do [ 11 , 12 ]. Adding complexity to the picture is the increasing role of social and contextual cues in shaping how young people evaluate online information. Recent ethnographic research has introduced the notion of information sensibility, i.e. a socially situated awareness of the value of information grounded not only in its epistemic features but also in its relevance to social positioning, identity, and emotional resonance [ 13 , 14 ]. Adolescents, for instance, may judge credibility based on peer reactions (crowdsourcing) or on the presence of personal, authentic experiences; surrogate trust in influencers or popular personalities; or just superficially explore a topic just to be able to win an argument on social media [ 14 ]. These practices challenge normative models of information literacy that assume the primacy of objectivity and evidence. Despite these challenges, it would equally be incorrect to say that young people are completely gullible because they lack formal training in discriminating between correct and incorrect science-related information. Harris shows that humans have a capacity for evaluating what and whom to believe, a skill observable even in early childhood [ 15 ]. One of the most fundamental expressions of this ability is the human tendency to ask questions, a trait that, despite various attempts to cultivate it in other species, remains uniquely human [ 15 , 16 ]. Questioning serves as a core strategy through which children actively seek out reliable knowledge, combining their own direct observations with information provided by others, in a mix of autonomous and deferential judgement. As Harris puts it, asking questions is what allows us to “ learn from others ” [ 15 ]. Yet this raises an important question: how do we move from the act of questioning to the actual discernment between well-founded and unfounded information? Harris addresses this issue by examining the nuanced balance of autonomy and deference observed in children. He identifies three core strategies that foster the development of epistemic vigilance, i.e., the cognitive faculty that underpins our ability to filter information. These strategies, along with many others, recur across historical periods and disciplinary boundaries [ 17 ]. Familiarity with the source is one of such strategies. Children, as well as adults, tend to trust more familiar informants rather than strangers [ 15 ], displaying a correlational tendency between epistemic trust and social-emotional closeness that might have evolutionary roots [ 18 ]. Such a strategy has also been found among adolescents in online environments [ 1 ] and represents one of the main criteria for information evaluation. However, trust is not given indiscriminately, but is rather moderated by the informants’ accuracy. As children grow, they shift from relying primarily on relational familiarity to tracking the epistemic track record of informants [ 19 ]. This second strategy allows children to overcome familiarity, by trusting those informants who have been accurate in the past. Such a strategy allows for a more sophisticated evaluation, where evidence is weighted more than familiarity. Finally, a third strategy involves group consensus and majority views . Several findings show that children are receptive to the presence of consensus among individuals and that such consensus is interpreted as a trustworthy source of information [ 15 ]. This strategy aligns with Hassoun’s and colleagues' results showing the impact of peer reactions on credibility assessment of adolescents’ [ 14 ]. In this study, we record and categorize the search-and-check behavior of high schoolers, partly in order to learn whether the strategies that Harris mentions, for rather simplified informational environments, are also those that we observe in the complex informational environment in which our subjects are checking for reliable information. While the three aforementioned strategies set solid foundations for accurate evaluations of information, they may not be sufficient in our digitalised information ecosystem [ 20 ]. As the sophistication of dis/misinformation increases, so does the inadequacy of superficial evaluation strategies. Recent research has highlighted the value of lateral reading , a method employed by expert fact-checkers that involves briefly scanning a site before leaving it to explore external sources for contextualization and verification [ 21 ]. Lateral reading has been shown to significantly improve credibility judgments and is increasingly recommended as a key component of digital literacy education [ 21 ]. Further insights into the effectiveness of evaluation strategies come from studies that compare novices to domain experts. Experts tend to prioritize source information, engage in deeper reliability assessments, and make more selective use of online content [ 22 ]. Moreover, intervention programs such as SEEK (Source, Evidence, Explanation, Knowledge) have demonstrated that explicit instruction in evaluative criteria can significantly enhance learners' ability to distinguish between reliable and unreliable sources [ 23 ]. Despite these advances, research on adolescents’ actual online behavior remains limited, especially in real-world contexts. Much of the existing literature relies on interview data or laboratory tasks, which may not capture the full complexity of an ecologically plausible environment. To address this gap, the present study adopts an ecological, classroom-based design to examine how adolescents aged 16–19 assess the validity of scientific information they find in Instagram-style posts (i.e. engage in sourcing [ 24 ]). Participants were asked to evaluate a series of scientifically valid and invalid posts and to provide written justifications for their judgments. Through an independent thematic analysis of the justifications, we explore the evaluative strategies employed by students and identify the patterns of reasoning underlying both accurate and inaccurate assessments. Our study contributes to the literature by (1) investigating adolescents' critical engagement with science disinformation in an ecological context; and (2) highlighting the interplay of epistemic, social, and affective cues in their reasoning processes. Results Through an iterative two-phase thematic analysis of students’ written justifications, we developed a comprehensive codebook for the annotation of evaluative strategies employed by adolescents in response to scientific and pseudoscientific online content. The development process followed established qualitative research protocols [ 25 , 26 ] and involved both inductive and deductive coding by multiple researchers (see Methods ). The resulting framework captures a broad spectrum of cognitive, epistemic, and metacognitive strategies and is detailed in the Supplementary Materials . The codebook includes 15 distinct categories, organized into three main macro-categories (i.e., lateral reading , cues , and plausibility) , and two additional meta-codes (i.e., external search and search effectiveness ). Among these, lateral reading emerges as particularly frequent and conceptually central across participants’ responses. This category stands out in two forms: source-oriented and content-oriented . In source-oriented lateral reading , students evaluate the credibility of a post by seeking external information about the source, such as the author, organization, or platform behind the content. This strategy aligns with findings by Wineburg and McGrew [ 21 ], who demonstrated its centrality in expert fact-checking behaviors. By contrast, content-oriented lateral reading involves verifying the specific factual claims in a post by consulting other sources. This reflects a distinct level of analytical engagement and correlates with cognitive reflectiveness and resistance to dis/misinformation [ 27 ]. Students’ justifications of their sourcing behavior were written in Italian and automatically anonymized by the Padlet tool [ 28 ] with different pseudonyms. All quotations in this study have been translated by the team and are followed by the initials of the relative pseudonym assigned by Padlet. Among the lateral reading macro-category, a common sub-strategy is consensus search , whereby students assess the convergence of information across multiple sources (e.g., “ After examining various sources regarding this news, searching the web, and carefully observing various official newspaper websites, we can confirm that this news is, in my opinion, true. In conclusion, the facts reported in this article are true ”, A.F.). This triangulation method is supported by work in social epistemology and civic online reasoning [ 29 , 30 ]. Closely related is the use of scientific article verification , which involves citing or referencing peer-reviewed sources or scientific summaries, a behavior previously found to correlate with epistemic trust in science and higher-level digital literacy [ 31 ]. Below is an example of the latter: “ The study conducted by the University of California, San Diego, published in Archives of Internal Medicine ( https://www.ncbi.nlm.nih.gov/pubmed/20421555 ), does not confirm the thesis reported in any way. In fact, the research analyzes a possible link between certain factors and mood, but does not provide any scientific evidence to support the correlation stated in the news ”, D.M.. Moreover, a smaller but significant number of students referenced fact-checking or science communication websites like Facta , Focus or Geopop , which are relatively well-known in Italy, demonstrating awareness of debunking infrastructures [ 32 ]. Others used ChatGPT or similar AI tools for verification, sometimes explicitly and sometimes inferred through stylistic clues [ 33 ]. Given the growing use of generative AI in youth information behavior, this strategy warrants particular attention: “ I don't have any specific sources from which I drew my ideas, but following a discussion with ChatGpt and based on my knowledge from the world of fitness, I came to the conclusion that dark chocolate is a source of fat and therefore makes you gain weight ”, H.O.. Some participants relied on Wikipedia , a tool often treated with skepticism in academic settings but shown to offer relatively reliable information for general topics [ 34 ]. Similarly, YouTube and other video-based sources were mentioned, indicating a shift toward audiovisual verification strategies, especially common among adolescents [ 35 ]. Some students, moreover, combined the search tools used, like B.D., who provided a thorough explanation of why he believed the post to be true, citing both Wikipedia and Youtube as sources. Cues strategies encompass heuristic-based approaches such as source reliability judgments (e.g., “ According to me, Geopop is always right ”, E.F.), language as a cue (e.g., “ I decided to read the article carefully, and after reading it, I realized that it was written in a manner consistent with the language of a scientist [...] ”, C.C.), and image-based validation (e.g., “ In my opinion, it's true because there are also photos ”, A.B.), all of which echo well-documented cognitive shortcuts in digital contexts [ 36 , 37 ]. Other strategies, categorized within the plausibility macro-category, center on the content’s internal coherence ( e.g., “ Reading the entire article, it is clear that the news is true ”, B.C.), or on plausibility assessments based on either general reasoning (e.g., “ In my opinion, it is not possible because you cannot revive a dead animal ”, M.P.) or specific prior knowledge (e.g., “ As a competitive athlete at the national level, I am fairly knowledgeable about the benefits of various foods, and dark chocolate, which has a high cocoa content, also has a high protein content that promotes muscle growth and fat loss ”, H.P.). These plausibility-based judgments highlight the tension between intuitive thinking and formal verification [ 38 , 39 ]. Finally, we included two meta-codes: external search (whether a search was performed and declared) and search effectiveness , indicating whether the search led to an accurate judgment supported by evidence [ 9 , 40 ]. Performing external searches, indeed, does not necessarily lead to proper assessments of information pieces. An example of that was the case of C.H.: When reading a news item stating that a Bachelor’s student contracted HIV in a laboratory while carrying on an internship, C.H. didn’t verify the truthfulness of the assertion, but only referenced the webpage of the Italian Health Ministry with information related to the means of transmission of the virus. The 174 student responses were coded using the finalized codebook by two independent annotators, with high inter-rater agreements (Cohen’s κ = 0.84 for lateral reading, κ = 0.78 for cues, κ = 0.64 for plausibility, κ = 0.82 for external search and κ = 0.74 for search effectiveness ), demonstrating reliable identification of these evaluative strategies [ 41 ]. Across all responses, approximately two out of three evaluations (i.e., 64.25%) are correct, confirming a moderate level of discriminatory ability. Incidentally, this rate of accuracy is consistent with previous work by Martini et al. on high-school student ability to discriminate between science-based information and science disinformation [ 42 ]. Specifically, 69.4% of students who used a computer and 61.8% of those using a smartphone made correct judgments, though this difference was not statistically significant (χ² = 0.78, df = 1, p = 0.378). A frequency analysis revealed notable differences in the adoption of evaluative strategies among students. Lateral reading strategies (including sub-strategies: consensus search, fact-checking websites, generative AI tools, Wikipedia, YouTube, and scientific article verification) are the most prevalent, representing approximately 61% of annotations for Rater 1 and 57% for Rater 2. Among the lateral reading strategies, however, some are under-represented (Fig. 1 ). In particular, very few students applied lateral reading strategies to compare the content with available scientific literature (2.68% for Rater 1 and 6.25% for Rater 2) or to gain more information about the source of the news item (5.36% for Rater 1 and 7.81% for Rater 2). Plausibility assessments ( general plausibility , specific plausibility , internal coherence , and other intuitive evaluations) account for around 29% of annotations for Rater 1 and 33% for Rater 2. Finally, cues strategies ( misleading titles , source reliability judgments , visual cues , and language cues ) are employed less frequently, accounting for approximately 10% of annotations for Rater 1 and 9% for Rater 2. These frequencies indicate clear patterns in adolescents' verification behaviors and preferences, as well as an overall level of critical engagement with the information they were given. More specifically, Table 1 summarizes the mean frequency of each strategy between the two raters, disaggregated by the six posts presented in the activity. The posts included three scientifically valid and three pseudoscientific items, each designed to mimic the stylistic features of real social media content (See Methods ). Table 1 The table displays the relative frequency (%) of each evaluative strategy (i.e., cues, lateral reading, and plausibility) disaggregated by news item. Lateral reading was the most common strategy across all posts, followed by plausibility-reasoning and cue-based strategies. News item Cues (%) Lateral reading (%) Plausibility (%) Flamingos (Valid) 10.2 57.8 32.0 HIV (Valid) 5.4 57.7 36.9 Spiders (Valid) 16.7 55.9 27.5 Chocolate (Invalid) 10.9 47.5 41.6 Pyramid (Invalid) 7.8 70.7 21.6 Spain flood (Invalid) 6.1 76.8 17.1 Regarding frequencies of external search behavior, 33.7% of times no external search was performed when evaluating the credibility of the posts, whereas in 34.0% and 25.6% of cases multiple sources or a single source were respectively consulted. Finally, in 6.7% cases, students declared to have conducted an external search without specifying the sources consulted. Importantly, in 52.1% cases, the external search was rated as effective (i.e., a search that contributes to an accurate judgment based on meaningful evidence), a result showing that almost half of the external searches were not effective. Accuracy rates vary substantially depending on the strategy employed. Lateral reading is associated with higher accuracy: cases where students used it led to correct evaluations in 71–72% of cases, compared to 58% of accurate evaluations when the strategy was not used. However, such a difference did not result to be significant ( p rater1 = 0.057, p rater2 = 0.086). Cues -based reasoning shows accuracy levels between 64–76%, without significant differences between usage or non-usage ( p rater1 = 0.332, p rater2 = 0.155), while plausibility -based strategies led to decreased accuracy, especially among Rater 2, where it significantly dropped to 55% when used, compared to 73% when not used ( p rater1 = 0.494, p rater2 = 0.0198). Finally, analysis of post-activity responses revealed meaningful revisions in students’ thinking. In cases when students initially judged a post as true, 18.4% later reported having changed their mind to 'false' after searching, and 70.3% of these revised answers were correct. Conversely, among the cases where students initially judged a post as false, 16.5% changed their mind to 'true', with a correctness rate of 52.4%. Those who maintained their initial judgment had slightly lower but still meaningful accuracy levels (63.4% and 81.1%, respectively, for true and false initial responses). Discussion This study investigated how adolescents evaluate the credibility of scientific and pseudoscientific content encountered in Instagram-style posts in a real-world setting. By combining a digital simulation of social media environments with a qualitative and quantitative analysis of students’ justifications for their sourcing strategies, we identified a wide range of epistemic strategies employed by young people to assess the validity of information online. Our findings highlight several notable trends. Firstly, a significant proportion of participants effectively employed advanced evaluative strategies, such as lateral reading (primarily consensus search and debunking search) and specific cues, such as trustworthy external sources . Indeed, lateral reading emerged as the most frequently employed strategy, positively correlating with higher accuracy in judgements, although this correlation was not significant. This is a promising result, as lateral reading strategies have been proven to be an effective evaluation approach [ 30 ]. However, it is important to note that students primarily verified information related to the content. Only a small number of cases involved the application of experts' evaluation strategies, such as source-oriented lateral reading or scientific article verification [ 22 ]. Importantly, the widespread reliance on content-oriented lateral reading that was observed in this study may (at least partly) be due to the instructions provided on Padlet boards by the experimenters. Such instructions (which included the explicit invitation to navigate the web, collect some pieces of information and upload them on Padlet) could have affected students’ evaluative strategy selection. Hence, we submit, this potential priming effect on adolescents’ choice of verification methods should be carefully addressed and measured in future studies. At the same time, a substantial subset of students continued to rely on plausibility -based heuristics, intuition, and cues derived from familiarity, language, or visual presentation. These results align with previous literature highlighting adolescents' tendency toward intuitive reasoning and heuristic shortcuts in online contexts [ 6 , 9 , 39 ], as well as with findings from the field of developmental psychology [ 15 ], supporting the idea that some of these strategies are embedded in human cognition as some of the work in Harris shows [ 15 ]. The study identified hybrid evaluative behaviors as well, reflecting students' pragmatic engagement with available digital tools and resources. A notable portion of students integrated contemporary digital tools, such as generative AI (i.e., ChatGPT), video platforms (i.e., YouTube), and online encyclopedia (i.e., Wikipedia), into their verification processes. The increasing integration of generative AI and polished digital content underscores the risk of reinforcing the perceived validity of pseudoscientific claims, an issue highlighted in recent discussions about algorithmic trust and cognitive biases [ 33 , 37 ]. Given the widespread usage of generative AI as a tool to evaluate information, it is pivotal to understand adolescents’ awareness of the reliability of information provided by such tools and how they engage with them in order to develop tailored digital interventions. Moreover, in only half of the cases where an external search was performed, such a search led to an accurate judgment based on meaningful evidence. Taken together, these results highlight the need for digital literacy interventions that go beyond an uncritical application of external search, but rather aim at providing more nuanced tools for distinguishing between a case of information based on science from a case of information based on the mere appearance of science (i.e. pseudoscience). In real-world contexts, valid information and invalid information traits can be found simultaneously, making it difficult to evaluate content reliability and accuracy. This was the case for some of the information pieces used in the present study, where, for example, a misleading title stating that dead spiders have been revived was attached to a scientifically valid news or where fragments of accurate information were merged to argue in favour of a pseudoscientific claim according to which dark chocolate has been shown to cause weight loss. Educational interventions that integrate multiple strategies together should thus be developed. Such interventions would enable not only to overcome this issue, but also to avoid an uncritical application of effective techniques, such as the application of content-oriented lateral reading to exclusively confirm pre-existing beliefs. Furthermore, the ecological and classroom-based approach of our study provided insights into students' evaluation strategies within authentic, socially embedded contexts. The use of collaborative yet individually moderated platforms such as Notion and Padlet mirrored realistic digital interactions. This design allowed us to observe the complex interplay between individual critical thinking, social influences, and environmental factors influencing students' evaluative behaviors, providing valuable insights that go beyond those typically obtained in controlled laboratory settings. However, it should be pointed out that the classroom environment in which our study was carried out differed from real-world scenarios in some important respects. Indeed, students’ level of engagement and attention might be expected to be higher at school when they are involved in educational initiatives under the supervision of their teachers than while doing everyday activities out of school. Moreover, students were given a significant amount of time (up to one hour) to complete the requested task, namely assessing the accuracy of at least one piece of news. In real life, adolescents rarely devote a comparable amount of time to the verification of online contents, with the plausible exception of the cases in which these are related to issues they particularly care about. The effect of the amount of time spent reading and evaluating online news on the accuracy of information assessment should be further investigated in future research, being properly disentangled from the evaluation strategy used. This could be useful to identify the strategies that ensure an acceptable degree of accuracy while also being compatible with time constraints typical of real-life contexts. The effect of adolescents’ motivation on the accuracy of their credibility judgments should be examined in future work, too. By “motivation”, we mean one’s interest in the topic covered by a certain piece of information (to be controlled for by directly asking participants to rate it before assessing the veracity of some news). We think that motivation (in the sense of the word just specified, not to be confused with motivated reasoning which applies to ethically non-neutral information) is positively correlated with evaluation accuracy. The existence of this correlation should be tested in further studies. The results of our study suggests that the kind of device (computer vs. smartphone) used to search for relevant information on the internet could have some impact on the accuracy of assessments made by young people. In particular, 69.4% of students who used a computer provided accurate judgments, compared to 61.8% of those using a smartphone, though this gap in accuracy turned out to be not statistically significant. The effect of the specific tool through which information evaluation is carried out should be more systematically addressed in the future, given the increasing centrality of smartphones in teenagers’ (as well as adults’) lives. From an educational perspective, our findings emphasize the need for comprehensive digital literacy interventions that go further than checklist-based approaches. Effective educational curriculum should prioritize teaching lateral reading, nuanced source analysis, and epistemic humility; skills that significantly enhance evaluative accuracy yet are rarely intuitive without explicit training [ 21 , 30 ]. Moreover, given the evolving digital landscape, characterized by generative AI, influencer culture, and interactive media, digital literacy curricula should incorporate critical reflection on the broader infrastructure underpinning knowledge creation and dissemination, as well as providing useful guidelines for AI usage when applying fact-checking strategies. Lastly, the annotated dataset and comprehensive codebook generated from this study constitute valuable resources for future educational research. We believe that they offer empirical foundations for developing pedagogical tools specifically tailored to adolescent learners. Yet, the lower inter-rater agreement result for the category plausibility with respect to the other categories presented and discussed here represents an additional limit of the present study, that should be overcome by future research through a clearer category definition and/or through appropriate rater training. Methods Participants Data collection was conducted between May and June 2025 in two upper secondary schools located in the metropolitan area of a large city in northern Italy. The schools were recruited through a public engagement initiative led by a local university: invitations were sent to publicly available institutional email addresses starting on 01/09/2024, and the first two schools to respond were selected, with participant recruitment ending on 31/10/2024. A total of 130 students from multiple fourth-grade classes (aged 16–19) participated in the study. All students in the selected classes were invited to participate, with nobody choosing to opt out. No exclusion criteria were applied aside from age and school year, and no demographic information was collected. The activity took place during regular school hours and was supervised by members of the research team in collaboration with classroom teachers. Participation was entirely voluntary, and students could withdraw at any time without penalty. Written informed consent was obtained from all participants prior to data collection through paper-based consent forms signed by each student. In compliance with the General Data Protection Regulation (Regulation EU 2016/679), no personally identifiable information was collected. Ethical approval for the study was provided by the Lombardy Regional Ethics Committee 1 (approval number CET 175–2025). Additionally, all research was performed in accordance with relevant guidelines and regulations, as well as in accordance with the Declaration of Helsinki. The Padlet tool used in the study does not store IP addresses or user metadata, and all student responses were anonymized at the point of data collection. Study Procedure Participants took part in a classroom-based session of approximately two hours, facilitated by a member of the research team. The session began with a 30-minute presentation introducing the research team, the overall study, and key concepts such as misinformation, disinformation, and their implications in scientific contexts. Following the introduction, students were directed to a custom digital environment built on the Notion platform [ 43 ], which featured six Instagram-styled posts (see Supplementary material s). All posts were based on news pieces the experimenters found on the web, and were selected and independently evaluated by pairs of researchers from the research team. Half of the posts were based on pseudoscientific claims and contained information that was shown to be unequivocally false or misleading by professional fact-checking organisations. The remaining half of the posts contained scientifically accurate claims supported by published scientific evidence. All the themes were selected based on scientific topics with neutral political resonance in order to avoid interference in evaluations with political motivated reasoning. Scientifically valid posts included statements about (i) the reasons behind the colour pink of flamingos, (ii) an HIV infection happened in a laboratory, and (iii) the results of a research where dead spiders were turned into ready-to-use actuators. Instead, invalid and pseudoscientific posts included statements about (i) weight-loss properties of dark chocolate, (ii) new archaeological results discussing the actual oldest pyramid known until now, and (iii) a cause-effect relationship between geoengineering and recent floods in Spain. Each post was linked to its original online source and accompanied by two emoji-buttons (i.e., ✅ and ❌) that redirected students to specific Padlet boards. Given the high interactivity design of Padlet, this free online tool has been widely used for educational purposes. Research has previously highlighted how the tool motivates students to participate, exchange information and express opinions comfortably, while fostering effective dialogues by allowing students to learn from peers’ responses [ 44 , 45 ]. In particular, the Padlet tool allows the creation of digital boards, where students are able to anonymously share various media formats, including text, image, audio, video and external URLs. The creators of Padlet boards can control the content, design, privacy settings and access to the board. Two Padlet boards were therefore created for each news piece, one for the students who evaluated the post as true and one for those who evaluated it to be false (Fig. 3 ). This design allowed us to manage in the best possible way the debriefing phase, as facilitators could easily pick a few news items to focus on, usually the ones mostly analyzed by students in the classroom, and walk through the different boards to discuss the rationales underlying the responses given, on the one side, by participants who believed the post to be true and, on the other side, by those who believed the post to be false. Once landed to the relative Padlet digital board, students were asked to: Judge whether the content of each post was true or false. Provide a brief written justification explaining their reasoning. This could include written statements, comments, links, and audio-visual material. Answer an anonymous poll asking whether they still believed the post to be true or false, or whether the activity led them to revise their evaluations. Participants were encouraged to evaluate at least one of the six posts, although some students chose to assess multiple items. As a result, the dataset comprises 174 individual responses. Each student was allowed to use either their personal smartphone or a school-provided device (i.e., laptop or desktop) to complete the activity. They had between 45 and 60 minutes to formulate their responses, during which they were permitted to consult the internet. To minimize peer influence, students’ sourcing strategies and justifications were not made immediately visible: all content had to be approved by the facilitator before appearing on the shared Padlet board. During a short 15-minute break, the facilitator reviewed and approved submissions. The session concluded with a debriefing phase, during which the nature of the posts and students’ rationales were discussed collectively by walking through students’ comments while fostering dialogue: facilitators provided key take-aways on digital critical thinking and effective ways to evaluate news pieces, and students were free to discuss with the facilitators and the rest of the class. The Padlet tool enabled the collection of both categorical (true/false) and open-ended responses in a fully anonymous format. Thematic Analysis and Coding Scheme The qualitative analysis of student justifications followed a two-phase thematic approach, combining both inductive and deductive elements [ 25 , 26 ]. The aim was to identify and classify the evaluative strategies adolescents used to assess the validity of scientific and pseudoscientific Instagram-style posts. In the first phase, three members of the research team (C.M., M.G., and M.F.) independently reviewed the full set of 174 open-ended responses. Each researcher generated initial codes based on recurring patterns in the data, focusing on the epistemic, cognitive, and social cues employed by students. This initial round of open coding produced a diverse set of labels, which were then compared and refined through an iterative process of discussion and negotiated consensus. Through successive rounds of synthesis, overlapping codes were merged, hierarchical relationships were established (e.g., main categories and subcategories), and ambiguous cases were clarified. The result was the development of a structured codebook, comprising 17 coding labels that represent distinct credibility assessment strategies. The full codebook, including definitions, examples, and theoretical references, is available in the Supplementary Information . In the second phase, the finalized codebook was applied to the entire dataset by two independent annotators (M.C. and Y.C.), who had not participated in the initial code development. Prior to annotation, both coders received a brief training session on the use of the codebook. Each student response could receive multiple labels if more than one strategy was present. To assess the reliability of the coding scheme, inter-rater agreement was calculated using Cohen’s Kappa, a widely adopted measure of categorical consistency. The analysis yielded moderate to high levels of agreement (κ = 0.84 for lateral reading , κ = 0.78 for cues , κ = 0.64 for plausibility , κ = 0.82 for external search and κ = 0.74 for search effectiveness ), indicating that the codebook was both conceptually clear and reproducible across raters. The annotated dataset allowed for a quantitative analysis of the frequency and distribution of credibility strategies across responses and post types. In addition to supporting the present study, this structured dataset can serve as a resource for future research on adolescent reasoning and for the development of educational and computational tools. Data Analysis Data were analyzed through a mixed-method approach [ 46 ] in three complementary stages: frequency-based exploration of evaluative strategies, assessment of judgment accuracy, and examination of search behavior and revision patterns. All analyses were performed using R Statistical Software [ 47 ]. In the first stage, we computed the frequency of each strategy identified in the thematic coding, disaggregated by rater and post type. Each of the 174 student responses could include multiple strategies, and all coded strategies were included in the analysis. For comparative purposes, strategies were grouped into three macro-categories: lateral reading, cues , and plausibility . Sub-strategies (e.g., use of generative AI tool, Wikipedia, or scientific article validation ) were nested within the relevant macro-category. In the second stage, we assessed the accuracy of students’ true/false judgments, defined as alignment between the student’s judgment (true/false) and the actual validity of the information. Accuracy was calculated both globally and in relation to strategy use. For each strategy, we compared the accuracy of responses where the strategy was used to those where it was not. This enabled us to identify associations between evaluative behavior and outcome quality and their significance through t-test statistics. Lateral reading, in particular, was associated with higher accuracy levels, although the difference was not significant (t rater1 = 1.92, df rater1 = 133.64; p rater1 = 0.057; t rater2 = 1.73, df rater2 = 114.8, p rater2 = 0.086). Cues-based reasoning resulted in accuracy levels between 64–76%, without significant differences between usage or non-usage (t rater1 = 0.98, df rater1 = 52.04; p rater1 = 0.332; t rater2 = 1.44, df rater2 = 53.89, p rater2 = 0.155), whereas reliance on plausibility reasoning often coincided with lower performance (t rater1 = -0.69, df rater1 = 88.29; p rater1 = 0.494; t rater2 = -2.36, df rater2 = 120.53, p rater2 = 0.02). The third stage focused on students’ search behavior and its effectiveness. Each justification was coded for whether a search was performed and, if so, whether it contributed meaningfully to the accuracy of the final judgment. Frequencies of search use were categorized as no search, single-source search, multi-source search, or unspecified search. Search effectiveness was rated qualitatively based on whether the participant’s search led to an accurate conclusion inferred from relevant pieces of information. Inter-rater agreement was high for both dimensions (κ = 0.82 for external search; κ = 0.74 for search effectiveness). Among those cases when searches were conducted, just over half (i.e., 52.1%) were judged to be effective. Finally, we analyzed revisions in students’ judgments across the activity. Some students initially evaluated a post, then modified their judgment after engaging with further information. By comparing initial and final responses (where available), we documented shifts in opinion and calculated the proportion of judgment changes that resulted in a correct response. Approximately 40% of students changed at least one answer after reflection or search, and these changes led to improved accuracy in the majority of cases. This finding highlights the potential of encouraging reflective digital practices, particularly when combined with explicit training in evaluative strategies. Declarations Data availability The raw dataset, labelled datasets, and materials related to this work have been deposited in the Open Science Framework (OSF) repositories for this project and are available at the following link https://osf.io/gn3br/?view_only=888f8aa5f9734231ba24c478279346f6. Additional Information The authors declare no competing interests. Funding Declaration The study was supported by the European Union – Next Generation EU, Mission 4, Component 1 (CUP D46F23000120004). References Freeman, J. L., Caldwell, P. H. Y. & Scott, K. M. How Adolescents Trust Health Information on Social Media: A Systematic Review. Acad. Pediatr. 23, 703–719 (2023). Boczkowski, P. J. Abundance: On the Experience of Living in a World of Information Plenty . (Oxford University Press, 2021). Brown, P. & Gummerum, M. Trust issues: Adolescents’ epistemic vigilance towards online sources. Br. J. Dev. Psychol. (2025). doi:10.1111/bjdp.12559 Prensky, M. Digital Natives, Digital Immigrants Part 1. Horiz. 9, 1–6 (2001). Helsper, E. J. & Eynon, R. Digital natives: Where is the evidence? Br. Educ. Res. J. 36, 503–520 (2010). Agosto, D. E. A model of young people’s decision-making in using the Web. Libr. Inf. Sci. Res. 24, 311–341 (2002). Gasser, U., Cortesi, S., Malik, M. M. & Lee, A. Youth and Digital Media: From Credibility to Information Quality. SSRN Scholarly Paper at https://doi.org/10.2139/ssrn.2005272 (2012) Pan, B. et al. In Google We Trust: Users’ Decisions on Rank, Position, and Relevance. J. Comput.-Mediat. Commun. 12, 801–823 (2007). Hargittai, E., Fullerton, L., Menchen-Trevino, E. & Thomas, K. Y. Trust Online: Young Adults’ Evaluation of Web Content. Int. J. Commun. 4, 27 (2010). McGrew, S. & Kohnen, A. M. Tackling misinformation through online information literacy: Structural and contextual considerations. J. Res. Technol. Educ. 56, 1–6 (2024). Iding, M. K., Crosby, M. E., Auernheimer, B. & Klemm, E. B. Web site credibility: Why do people believe what they believe? Instr. Sci. 37, 43–63 (2009). Flanagin, A. J. & Metzger, M. J. The role of site features, user attributes, and information verification behaviors on the perceived credibility of web-based information. New Media Soc. 9, 319–342 (2007). Hassoun, A. et al. Practicing Information Sensibility: How Gen Z Engages with Online Information. in Proc. 2023 CHI Conf. Hum. Factors Comput. Syst. 1–17 (ACM, 2023). doi:10.1145/3544548.3581328 Hassoun, A. et al. Beyond Digital Literacy: Building Youth Digital Resilience Through Existing “Information Sensibility” Practices. Soc. Sci. 14, 230 (2025). Harris, P. L. Trusting what you’re told: How children learn from others . 253 (The Belknap Press of Harvard University Press, 2012). Greenfield, P. M. & Savage-Rumbaugh, E. S. Comparing communicative competence in child and chimp: the pragmatics of repetition. J. Child Lang. 20, 1–26 (1993). Martini, C. in Routledge Handb. Soc. Epistemol. (Routledge, 2019). Mercier, H. Not Born Yesterday: The Science of Who We Trust and What We Believe . (Princeton University Press, 2020). doi:10.1515/9780691198842 Corriveau, K. & Harris, P. L. Choosing your informant: weighing familiarity and recent accuracy. Dev. Sci. 12, 426–437 (2009). Wineburg, S. & McGrew, S. Why Students Can’t Google Their Way to the Truth. Educ. Week (2016). at Wineburg, S. & McGrew, S. Lateral Reading: Reading Less and Learning More When Evaluating Digital Information. SSRN Electron. J. (2017). doi:10.2139/ssrn.3048994 Brand‐Gruwel, S., Kammerer, Y., Van Meeuwen, L. & Van Gog, T. Source evaluation of domain experts and novices during Web search. J. Comput. Assist. Learn. 33, 234–251 (2017). Wiley, J. et al. Source Evaluation, Comprehension, and Learning in Internet Science Inquiry Tasks. Am. Educ. Res. J. 46, 1060–1106 (2009). Brante, E. W. & Strømsø, H. I. Sourcing in text comprehension: A review of interventions targeting sourcing skills. Educ. Psychol. Rev. 30, 773–799 (2018). Braun, V. & Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 3, 77–101 (2006). Braun, V. & Clarke, V. Reflecting on reflexive thematic analysis. Qual. Res. Sport Exerc. Health 11, 589–597 (2019). Bronstein, M. V., Pennycook, G., Bear, A., Rand, D. G. & Cannon, T. D. Belief in Fake News is Associated with Delusionality, Dogmatism, Religious Fundamentalism, and Reduced Analytic Thinking. J. Appl. Res. Mem. Cogn. 8, 108–117 (2019). Padlet - Visual Collaboration for Creative Work and Education. Padlet at Goldman, A. I. Experts: Which Ones Should You Trust? Philos. Phenomenol. Res. 63, 85–110 (2001). McGrew, S., Breakstone, J., Ortega, T., Smith, M. & Wineburg, S. Can Students Evaluate Online Sources? Learning From Assessments of Civic Online Reasoning. Theory Res. Soc. Educ. 46, 165–193 (2018). Barzilai, S. & Zohar, A. Epistemic Thinking in Action: Evaluating and Integrating Online Sources. Cogn. Instr. 30, 39–85 (2012). Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G. & Rand, D. G. Fighting COVID-19 Misinformation on Social Media: Experimental Evidence for a Scalable Accuracy-Nudge Intervention. Psychol. Sci. 31, 770–780 (2020). Bender, E. M., Gebru, T., McMillan-Major, A. & Shmitchell, S. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜. in Proc. 2021 ACM Conf. Fairness Account. Transpar. 610–623 (Association for Computing Machinery, 2021). doi:10.1145/3442188.3445922 Jemielniak, D. Wikipedia, a professor’s best friend. Chron. High. Educ. (2014). Swart, J. & Broersma, M. The Trust Gap: Young People’s Tactics for Assessing the Reliability of Political News. Int. J. Press. 27, 396–416 (2022). Lewandowsky, S., Ecker, U. K. H. & Cook, J. Beyond Misinformation: Understanding and Coping with the “Post-Truth” Era. J. Appl. Res. Mem. Cogn. 6, 353–369 (2017). Newman, E. J., Garry, M., Bernstein, D. M., Kantner, J. & Lindsay, D. S. Nonprobative photographs (or words) inflate truthiness. Psychon. Bull. Rev. 19, 969–974 (2012). Nickerson, R. S. Confirmation bias: A ubiquitous phenomenon in many guises. Rev. Gen. Psychol. 2, 175–220 (1998). Kahneman, D. Thinking, fast and slow . (2011). Pirolli, P. & Card, S. Information foraging. Psychol. Rev. 106, 643–675 (1999). Landis, J. R. & Koch, G. G. The measurement of observer agreement for categorical data. Biometrics 33, 159–174 (1977). Martini, C., Floris, M. & Ghiara, M. Disinformazione a Scuola: il progetto UniSR per sviluppare le capacità critiche digitali . (2024). at Notion Labs Inc. at Arouri, Y. M., Hamaidi, D. A., Al-Kaabi, A. F., Al Attiyah, A. A. & ElKhouly, M. M. Undergraduate Students’ Perceptions on the Use of Padlet as an Educational Tool for an Academic Engagement: Qualitative Study. | EBSCOhost. 18, 86 (2023). Deni, A. R. M. & Zainal, Z. I. Padlet as an educational tool: pedagogical considerations and lessons learnt. in Proc. 10th Int. Conf. Educ. Technol. Comput. 156–162 (Association for Computing Machinery, 2018). doi:10.1145/3290511.3290512 Creswell, J. W. in Handb. Educ. Policy (ed. Cizek, G. J.) 455–472 (Academic Press, 1999). doi:10.1016/B978-012174698-8/50045-X R Core Team. R: A Language and Environment for Statistical Computing. (2025). at Additional Declarations No competing interests reported. Supplementary Files supplementaryinformation.pdf Cite Share Download PDF Status: Under Review Version 1 posted Reviews received at journal 21 Mar, 2026 Reviews received at journal 20 Mar, 2026 Reviewers agreed at journal 18 Mar, 2026 Reviews received at journal 18 Mar, 2026 Reviewers agreed at journal 18 Mar, 2026 Reviewers agreed at journal 18 Mar, 2026 Reviewers invited by journal 18 Mar, 2026 Editor assigned by journal 03 Feb, 2026 Editor invited by journal 15 Oct, 2025 Submission checks completed at journal 09 Oct, 2025 First submitted to journal 09 Oct, 2025 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-7760447","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Article","associatedPublications":[],"authors":[{"id":608547297,"identity":"4c46250f-fa38-4d39-9e87-5b7b7b127b39","order_by":0,"name":"Margherita Ghiara","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAABB0lEQVRIiWNgGAWjYHACNoYEIMkPYvKAuUCQAGPg0yLZwAzWIoHQglsPRMbgAFQLugQG0G1gv/bgQc09eePz549JvKm4U8fHwGP24MGfewx88g1YtZgd4Ck3SDhWbLjtRjKb5Jwzz4AO4zE3SGwrxukwoJY0iQS2BMZtN5jZpHnbDoO0mEkkNiQQ0PIvwX5z/2Ggln9QLQl/8GlhPyaR2JaQuIEhGailAaaFDY+WwzxsEol9CckzbiQbW845dliyjZmtDGQIDxtQG1Ytx9ufSf74lmDb33/w4Y03NYf55dubt0n++JMgJ998ALs1zDwG6CIQige7ehBgf4BbbhSMglEwCkYBCAAA+DZQXQhxpM0AAAAASUVORK5CYII=","orcid":"","institution":"Università Vita-Salute San Raffaele","correspondingAuthor":true,"prefix":"","firstName":"Margherita","middleName":"","lastName":"Ghiara","suffix":""},{"id":608547299,"identity":"34a26b65-9db8-4b52-98b9-1d1584d0a845","order_by":1,"name":"Mara Floris","email":"","orcid":"","institution":"Università Vita-Salute San Raffaele","correspondingAuthor":false,"prefix":"","firstName":"Mara","middleName":"","lastName":"Floris","suffix":""},{"id":608547302,"identity":"2c553f01-1abd-4f9a-b6bf-fd3cf9f17169","order_by":2,"name":"Martina Calderisi","email":"","orcid":"","institution":"Università degli Studi di Torino","correspondingAuthor":false,"prefix":"","firstName":"Martina","middleName":"","lastName":"Calderisi","suffix":""},{"id":608547306,"identity":"27ea194c-a7bc-44d0-9b64-2c33a962fa0b","order_by":3,"name":"Yugin Cho","email":"","orcid":"","institution":"Scuola Universitaria Superiore IUSS Pavia","correspondingAuthor":false,"prefix":"","firstName":"Yugin","middleName":"","lastName":"Cho","suffix":""},{"id":608547309,"identity":"4416447a-b6c7-41c3-995f-29d6cfe8f3aa","order_by":4,"name":"Carlo Martini","email":"","orcid":"","institution":"Università Vita-Salute San Raffaele","correspondingAuthor":false,"prefix":"","firstName":"Carlo","middleName":"","lastName":"Martini","suffix":""}],"badges":[],"createdAt":"2025-10-01 14:46:53","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-7760447/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-7760447/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":105150406,"identity":"3f2b0636-827a-44a5-b8f2-e68a8bd74b83","added_by":"auto","created_at":"2026-03-22 15:02:17","extension":"png","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":84998,"visible":true,"origin":"","legend":"\u003cp\u003eLateral reading sub-strategies by rater. The plot shows the percentage use of lateral reading sub-strategies coded by two raters. Content-oriented lateral reading was dominant (94.64% for Rater 1 and 92.19% for Rater 2), followed by consensus search (51.79% for Rater 1 and 32.81% for Rater 2) and fact-checking websites (22.32% for Rater 1 and 14.06% for Rater 2). Less frequent was Source-oriented lateral reading (5.36% for Rater 1 and 7.81% for Rater 2), as well as Wikipedia (7.14% for Rater 1 and 6.25% for Rater 2), YouTube (10.71% for Rater 1 and 9.38% for Rater 2), generative AI tools (4.46% for Rater 1 and 7.03% for Rater 2), and scientific article verification (2.68% for Rater 1 and 6.25% for Rater 2). The pattern suggests students favored verifying claims over assessing source credibility.\u003c/p\u003e","description":"","filename":"floatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-7760447/v1/58145b29c358480b499a5b79.png"},{"id":105563791,"identity":"70b83b09-6ced-403a-93c5-77c70544e975","added_by":"auto","created_at":"2026-03-27 12:47:49","extension":"png","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":53761,"visible":true,"origin":"","legend":"\u003cp\u003eMean accuracy by evaluative strategy. The figure compares the mean accuracy of student judgments based on whether each evaluation strategy (cues, lateral reading, plausibility) was used. Lateral reading is associated with higher accuracy for both raters, while plausibility-based reasoning corresponds to lower accuracy, especially for Rater 2. Cue-based reasoning shows moderate accuracy and less variation. These trends suggest that lateral reading is the most reliable strategy, whereas plausibility heuristics may lead to more frequent misjudgments.\u003c/p\u003e","description":"","filename":"floatimage2.png","url":"https://assets-eu.researchsquare.com/files/rs-7760447/v1/054d9580370caa49d7ea1bad.png"},{"id":105150409,"identity":"8bcf3779-77c8-408a-83a6-f7329ea16ee1","added_by":"auto","created_at":"2026-03-22 15:02:17","extension":"png","order_by":3,"title":"Figure 3","display":"","copyAsset":false,"role":"figure","size":517946,"visible":true,"origin":"","legend":"\u003cp\u003eA snapshot of the Padlet board. An example of a Padlet board filled with a few comments shared by students.\u003c/p\u003e","description":"","filename":"floatimage3.png","url":"https://assets-eu.researchsquare.com/files/rs-7760447/v1/3072219bc3b72aaef53d1452.png"},{"id":105569231,"identity":"d598822b-84d7-4000-9712-f65789131039","added_by":"auto","created_at":"2026-03-27 13:11:48","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":1196126,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-7760447/v1/ecec7584-c025-48f5-8183-55f332fbd66d.pdf"},{"id":105150410,"identity":"d4e4ab66-2b14-45d9-a4ee-35a6f0791de5","added_by":"auto","created_at":"2026-03-22 15:02:17","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"supplement","size":5588481,"visible":true,"origin":"","legend":"","description":"","filename":"supplementaryinformation.pdf","url":"https://assets-eu.researchsquare.com/files/rs-7760447/v1/bedeaa02218b31b2c383ba90.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Spontaneous Sourcing Strategies and Heuristics in Adolescents’ Evaluation of Online Information","fulltext":[{"header":"Introduction","content":"\u003cp\u003eIn today\u0026rsquo;s digital environment, adolescents are constantly exposed to an abundance of information, much of which circulates in visually compelling but epistemically ambiguous formats such as social media posts and influencer-generated content [\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e, \u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e]. Platforms like Instagram and TikTok play a central role in shaping young people\u0026rsquo;s understanding of the world, including science-related topics that carry both personal and collective implications, like alimentary habits or vaccination behavior. Yet, navigating this information-rich ecosystem requires more than just digital fluency: it demands critical evaluation skills, epistemic vigilance [\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e], and awareness of the social and technological infrastructures that mediate access to information.\u003c/p\u003e \u003cp\u003eWhile adolescents are often described as \u0026ldquo;digital natives\u0026rdquo; [\u003cspan citationid=\"CR4\" class=\"CitationRef\"\u003e4\u003c/span\u003e], empirical research challenges the assumption that growing up with digital technologies equates to a high level of digital literacy or critical thinking [\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e]: studies show that young people\u0026rsquo;s ability to assess the credibility of online content is frequently limited by superficial evaluation strategies and cognitive constraints [\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e, \u003cspan citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e]. Rather than applying rigorous analytical frameworks, they tend to rely on visual appeal, personal preference, familiarity, or search engine rankings [\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e]. Even though such heuristics may be efficient, they are often epistemically unreliable [\u003cspan citationid=\"CR8\" class=\"CitationRef\"\u003e8\u003c/span\u003e, \u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eIndeed, adolescents\u0026rsquo; evaluative behaviors might be shaped by a combination of factors: bounded rationality, information overload, and satisficing strategies [\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e, \u003cspan citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e, \u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e]. In practical terms, this means settling for the first seemingly plausible result rather than systematically seeking the most authoritative or corroborated source. This behavior often occurs even when students are aware of traditional credibility markers such as author expertise or institutional affiliation [\u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e, \u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e]. A consistent finding across observational and experimental studies is the discrepancy between what adolescents claim to do to assess credibility and what they actually do [\u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e, \u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eAdding complexity to the picture is the increasing role of social and contextual cues in shaping how young people evaluate online information. Recent ethnographic research has introduced the notion of information sensibility, i.e. a socially situated awareness of the value of information grounded not only in its epistemic features but also in its relevance to social positioning, identity, and emotional resonance [\u003cspan citationid=\"CR13\" class=\"CitationRef\"\u003e13\u003c/span\u003e, \u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e]. Adolescents, for instance, may judge credibility based on peer reactions (crowdsourcing) or on the presence of personal, authentic experiences; surrogate trust in influencers or popular personalities; or just superficially explore a topic just to be able to win an argument on social media [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e]. These practices challenge normative models of information literacy that assume the primacy of objectivity and evidence.\u003c/p\u003e \u003cp\u003eDespite these challenges, it would equally be incorrect to say that young people are completely gullible because they lack formal training in discriminating between correct and incorrect science-related information. Harris shows that humans have a capacity for evaluating what and whom to believe, a skill observable even in early childhood [\u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e]. One of the most fundamental expressions of this ability is the human tendency to ask questions, a trait that, despite various attempts to cultivate it in other species, remains uniquely human [\u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e, \u003cspan citationid=\"CR16\" class=\"CitationRef\"\u003e16\u003c/span\u003e]. Questioning serves as a core strategy through which children actively seek out reliable knowledge, combining their own direct observations with information provided by others, in a mix of autonomous and deferential judgement.\u003c/p\u003e \u003cp\u003eAs Harris puts it, asking questions is what allows us to \u0026ldquo;\u003cem\u003elearn from others\u003c/em\u003e\u0026rdquo; [\u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e]. Yet this raises an important question: how do we move from the act of questioning to the actual discernment between well-founded and unfounded information? Harris addresses this issue by examining the nuanced balance of autonomy and deference observed in children. He identifies three core strategies that foster the development of epistemic vigilance, i.e., the cognitive faculty that underpins our ability to filter information. These strategies, along with many others, recur across historical periods and disciplinary boundaries [\u003cspan citationid=\"CR17\" class=\"CitationRef\"\u003e17\u003c/span\u003e].\u003c/p\u003e \u003cp\u003e \u003cem\u003eFamiliarity with the source\u003c/em\u003e is one of such strategies. Children, as well as adults, tend to trust more familiar informants rather than strangers [\u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e], displaying a correlational tendency between epistemic trust and social-emotional closeness that might have evolutionary roots [\u003cspan citationid=\"CR18\" class=\"CitationRef\"\u003e18\u003c/span\u003e]. Such a strategy has also been found among adolescents in online environments [\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e] and represents one of the main criteria for information evaluation.\u003c/p\u003e \u003cp\u003eHowever, trust is not given indiscriminately, but is rather moderated by the informants\u0026rsquo; accuracy. As children grow, they shift from relying primarily on relational familiarity to \u003cem\u003etracking the epistemic track record\u003c/em\u003e of informants [\u003cspan citationid=\"CR19\" class=\"CitationRef\"\u003e19\u003c/span\u003e]. This second strategy allows children to overcome familiarity, by trusting those informants who have been accurate in the past. Such a strategy allows for a more sophisticated evaluation, where evidence is weighted more than familiarity.\u003c/p\u003e \u003cp\u003eFinally, a third strategy involves \u003cem\u003egroup consensus\u003c/em\u003e and \u003cem\u003emajority views\u003c/em\u003e. Several findings show that children are receptive to the presence of consensus among individuals and that such consensus is interpreted as a trustworthy source of information [\u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e]. This strategy aligns with Hassoun\u0026rsquo;s and colleagues' results showing the impact of peer reactions on credibility assessment of adolescents\u0026rsquo; [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eIn this study, we record and categorize the search-and-check behavior of high schoolers, partly in order to learn whether the strategies that Harris mentions, for rather simplified informational environments, are also those that we observe in the complex informational environment in which our subjects are checking for reliable information. While the three aforementioned strategies set solid foundations for accurate evaluations of information, they may not be sufficient in our digitalised information ecosystem [\u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e]. As the sophistication of dis/misinformation increases, so does the inadequacy of superficial evaluation strategies. Recent research has highlighted the value of \u003cem\u003elateral reading\u003c/em\u003e, a method employed by expert fact-checkers that involves briefly scanning a site before leaving it to explore external sources for contextualization and verification [\u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e]. Lateral reading has been shown to significantly improve credibility judgments and is increasingly recommended as a key component of digital literacy education [\u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eFurther insights into the effectiveness of evaluation strategies come from studies that compare novices to domain experts. Experts tend to prioritize source information, engage in deeper reliability assessments, and make more selective use of online content [\u003cspan citationid=\"CR22\" class=\"CitationRef\"\u003e22\u003c/span\u003e]. Moreover, intervention programs such as SEEK (Source, Evidence, Explanation, Knowledge) have demonstrated that explicit instruction in evaluative criteria can significantly enhance learners' ability to distinguish between reliable and unreliable sources [\u003cspan citationid=\"CR23\" class=\"CitationRef\"\u003e23\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eDespite these advances, research on adolescents\u0026rsquo; actual online behavior remains limited, especially in real-world contexts. Much of the existing literature relies on interview data or laboratory tasks, which may not capture the full complexity of an ecologically plausible environment.\u003c/p\u003e \u003cp\u003eTo address this gap, the present study adopts an ecological, classroom-based design to examine how adolescents aged 16\u0026ndash;19 assess the validity of scientific information they find in Instagram-style posts (i.e. engage in sourcing [\u003cspan citationid=\"CR24\" class=\"CitationRef\"\u003e24\u003c/span\u003e]). Participants were asked to evaluate a series of scientifically valid and invalid posts and to provide written justifications for their judgments. Through an independent thematic analysis of the justifications, we explore the evaluative strategies employed by students and identify the patterns of reasoning underlying both accurate and inaccurate assessments. Our study contributes to the literature by (1) investigating adolescents' critical engagement with science disinformation in an ecological context; and (2) highlighting the interplay of epistemic, social, and affective cues in their reasoning processes.\u003c/p\u003e"},{"header":"Results","content":"\u003cp\u003eThrough an iterative two-phase thematic analysis of students\u0026rsquo; written justifications, we developed a comprehensive codebook for the annotation of evaluative strategies employed by adolescents in response to scientific and pseudoscientific online content. The development process followed established qualitative research protocols [\u003cspan citationid=\"CR25\" class=\"CitationRef\"\u003e25\u003c/span\u003e, \u003cspan citationid=\"CR26\" class=\"CitationRef\"\u003e26\u003c/span\u003e] and involved both inductive and deductive coding by multiple researchers (see \u003cem\u003eMethods\u003c/em\u003e). The resulting framework captures a broad spectrum of cognitive, epistemic, and metacognitive strategies and is detailed in the \u003cem\u003eSupplementary Materials\u003c/em\u003e.\u003c/p\u003e \u003cp\u003eThe codebook includes 15 distinct categories, organized into three main macro-categories (i.e., \u003cem\u003elateral reading\u003c/em\u003e, \u003cem\u003ecues\u003c/em\u003e, and \u003cem\u003eplausibility)\u003c/em\u003e, and two additional meta-codes (i.e., \u003cem\u003eexternal search\u003c/em\u003e and \u003cem\u003esearch effectiveness\u003c/em\u003e). Among these, \u003cem\u003elateral reading\u003c/em\u003e emerges as particularly frequent and conceptually central across participants\u0026rsquo; responses. This category stands out in two forms: \u003cem\u003esource-oriented\u003c/em\u003e and \u003cem\u003econtent-oriented\u003c/em\u003e. In \u003cem\u003esource-oriented lateral reading\u003c/em\u003e, students evaluate the credibility of a post by seeking external information about the source, such as the author, organization, or platform behind the content. This strategy aligns with findings by Wineburg and McGrew [\u003cspan citationid=\"CR21\" class=\"CitationRef\"\u003e21\u003c/span\u003e], who demonstrated its centrality in expert fact-checking behaviors. By contrast, \u003cem\u003econtent-oriented lateral reading\u003c/em\u003e involves verifying the specific factual claims in a post by consulting other sources. This reflects a distinct level of analytical engagement and correlates with cognitive reflectiveness and resistance to dis/misinformation [\u003cspan citationid=\"CR27\" class=\"CitationRef\"\u003e27\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eStudents\u0026rsquo; justifications of their sourcing behavior were written in Italian and automatically anonymized by the Padlet tool [\u003cspan citationid=\"CR28\" class=\"CitationRef\"\u003e28\u003c/span\u003e] with different pseudonyms. All quotations in this study have been translated by the team and are followed by the initials of the relative pseudonym assigned by Padlet. Among the \u003cem\u003elateral reading\u003c/em\u003e macro-category, a common sub-strategy is \u003cem\u003econsensus search\u003c/em\u003e, whereby students assess the convergence of information across multiple sources (e.g., \u0026ldquo;\u003cem\u003eAfter examining various sources regarding this news, searching the web, and carefully observing various official newspaper websites, we can confirm that this news is, in my opinion, true. In conclusion, the facts reported in this article are true\u003c/em\u003e\u0026rdquo;, A.F.). This triangulation method is supported by work in social epistemology and civic online reasoning [\u003cspan citationid=\"CR29\" class=\"CitationRef\"\u003e29\u003c/span\u003e, \u003cspan citationid=\"CR30\" class=\"CitationRef\"\u003e30\u003c/span\u003e]. Closely related is the use of \u003cem\u003escientific article verification\u003c/em\u003e, which involves citing or referencing peer-reviewed sources or scientific summaries, a behavior previously found to correlate with epistemic trust in science and higher-level digital literacy [\u003cspan citationid=\"CR31\" class=\"CitationRef\"\u003e31\u003c/span\u003e]. Below is an example of the latter:\u003cdiv class=\"BlockQuote\"\u003e\u003cp\u003e\u0026ldquo;\u003cem\u003eThe study conducted by the University of California, San Diego, published in Archives of Internal Medicine (\u003c/em\u003e\u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://www.ncbi.nlm.nih.gov/pubmed/20421555\u003c/span\u003e\u003cspan address=\"https://www.ncbi.nlm.nih.gov/pubmed/20421555\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e\u003cem\u003e), does not confirm the thesis reported in any way. In fact, the research analyzes a possible link between certain factors and mood, but does not provide any scientific evidence to support the correlation stated in the news\u003c/em\u003e\u0026rdquo;, D.M..\u003c/p\u003e\u003c/div\u003e\u003c/p\u003e \u003cp\u003eMoreover, a smaller but significant number of students referenced fact-checking or science communication websites like \u003cem\u003eFacta\u003c/em\u003e, \u003cem\u003eFocus\u003c/em\u003e or \u003cem\u003eGeopop\u003c/em\u003e, which are relatively well-known in Italy, demonstrating awareness of debunking infrastructures [\u003cspan citationid=\"CR32\" class=\"CitationRef\"\u003e32\u003c/span\u003e]. Others used \u003cem\u003eChatGPT\u003c/em\u003e or similar AI tools for verification, sometimes explicitly and sometimes inferred through stylistic clues [\u003cspan citationid=\"CR33\" class=\"CitationRef\"\u003e33\u003c/span\u003e]. Given the growing use of generative AI in youth information behavior, this strategy warrants particular attention:\u003cdiv class=\"BlockQuote\"\u003e\u003cp\u003e\u0026ldquo;\u003cem\u003eI don't have any specific sources from which I drew my ideas, but following a discussion with ChatGpt and based on my knowledge from the world of fitness, I came to the conclusion that dark chocolate is a source of fat and therefore makes you gain weight\u003c/em\u003e\u0026rdquo;, H.O..\u003c/p\u003e\u003c/div\u003e\u003c/p\u003e \u003cp\u003eSome participants relied on \u003cem\u003eWikipedia\u003c/em\u003e, a tool often treated with skepticism in academic settings but shown to offer relatively reliable information for general topics [\u003cspan citationid=\"CR34\" class=\"CitationRef\"\u003e34\u003c/span\u003e]. Similarly, \u003cem\u003eYouTube\u003c/em\u003e and other video-based sources were mentioned, indicating a shift toward audiovisual verification strategies, especially common among adolescents [\u003cspan citationid=\"CR35\" class=\"CitationRef\"\u003e35\u003c/span\u003e]. Some students, moreover, combined the search tools used, like B.D., who provided a thorough explanation of why he believed the post to be true, citing both Wikipedia and Youtube as sources.\u003c/p\u003e \u003cp\u003e \u003cem\u003eCues\u003c/em\u003e strategies encompass heuristic-based approaches such as \u003cem\u003esource reliability judgments\u003c/em\u003e (e.g., \u0026ldquo;\u003cem\u003eAccording to me, Geopop is always right\u003c/em\u003e\u0026rdquo;, E.F.), \u003cem\u003elanguage as a cue\u003c/em\u003e (e.g., \u0026ldquo;\u003cem\u003eI decided to read the article carefully, and after reading it, I realized that it was written in a manner consistent with the language of a scientist [...]\u003c/em\u003e\u0026rdquo;, C.C.), and \u003cem\u003eimage-based validation\u003c/em\u003e (e.g., \u0026ldquo;\u003cem\u003eIn my opinion, it's true because there are also photos\u003c/em\u003e\u0026rdquo;, A.B.), all of which echo well-documented cognitive shortcuts in digital contexts [\u003cspan citationid=\"CR36\" class=\"CitationRef\"\u003e36\u003c/span\u003e, \u003cspan citationid=\"CR37\" class=\"CitationRef\"\u003e37\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eOther strategies, categorized within the \u003cem\u003eplausibility\u003c/em\u003e macro-category, center on the \u003cem\u003econtent\u0026rsquo;s internal coherence (\u003c/em\u003ee.g., \u0026ldquo;\u003cem\u003eReading the entire article, it is clear that the news is true\u003c/em\u003e\u0026rdquo;, B.C.), or on plausibility assessments based on either \u003cem\u003egeneral reasoning\u003c/em\u003e (e.g., \u0026ldquo;\u003cem\u003eIn my opinion, it is not possible because you cannot revive a dead animal\u003c/em\u003e\u0026rdquo;, M.P.) or \u003cem\u003especific prior knowledge\u003c/em\u003e (e.g., \u0026ldquo;\u003cem\u003eAs a competitive athlete at the national level, I am fairly knowledgeable about the benefits of various foods, and dark chocolate, which has a high cocoa content, also has a high protein content that promotes muscle growth and fat loss\u003c/em\u003e\u0026rdquo;, H.P.). These plausibility-based judgments highlight the tension between intuitive thinking and formal verification [\u003cspan citationid=\"CR38\" class=\"CitationRef\"\u003e38\u003c/span\u003e, \u003cspan citationid=\"CR39\" class=\"CitationRef\"\u003e39\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eFinally, we included two meta-codes: \u003cem\u003eexternal search\u003c/em\u003e (whether a search was performed and declared) and \u003cem\u003esearch effectiveness\u003c/em\u003e, indicating whether the search led to an accurate judgment supported by evidence [\u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e, \u003cspan citationid=\"CR40\" class=\"CitationRef\"\u003e40\u003c/span\u003e]. Performing external searches, indeed, does not necessarily lead to proper assessments of information pieces. An example of that was the case of C.H.: When reading a news item stating that a Bachelor\u0026rsquo;s student contracted HIV in a laboratory while carrying on an internship, C.H. didn\u0026rsquo;t verify the truthfulness of the assertion, but only referenced the webpage of the Italian Health Ministry with information related to the means of transmission of the virus.\u003c/p\u003e \u003cp\u003eThe 174 student responses were coded using the finalized codebook by two independent annotators, with high inter-rater agreements (Cohen\u0026rsquo;s κ\u0026thinsp;=\u0026thinsp;0.84 for lateral reading, κ\u0026thinsp;=\u0026thinsp;0.78 for cues, κ\u0026thinsp;=\u0026thinsp;0.64 for plausibility, κ\u0026thinsp;=\u0026thinsp;0.82 for \u003cem\u003eexternal search\u003c/em\u003e and κ\u0026thinsp;=\u0026thinsp;0.74 for \u003cem\u003esearch effectiveness\u003c/em\u003e), demonstrating reliable identification of these evaluative strategies [\u003cspan citationid=\"CR41\" class=\"CitationRef\"\u003e41\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eAcross all responses, approximately two out of three evaluations (i.e., 64.25%) are correct, confirming a moderate level of discriminatory ability. Incidentally, this rate of accuracy is consistent with previous work by Martini et al. on high-school student ability to discriminate between science-based information and science disinformation [\u003cspan citationid=\"CR42\" class=\"CitationRef\"\u003e42\u003c/span\u003e]. Specifically, 69.4% of students who used a computer and 61.8% of those using a smartphone made correct judgments, though this difference was not statistically significant (χ\u0026sup2; = 0.78, df\u0026thinsp;=\u0026thinsp;1, \u003cem\u003ep\u003c/em\u003e\u0026thinsp;=\u0026thinsp;0.378).\u003c/p\u003e \u003cp\u003eA frequency analysis revealed notable differences in the adoption of evaluative strategies among students. Lateral reading strategies (including sub-strategies: consensus search, fact-checking websites, generative AI tools, Wikipedia, YouTube, and scientific article verification) are the most prevalent, representing approximately 61% of annotations for Rater 1 and 57% for Rater 2. Among the lateral reading strategies, however, some are under-represented (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e). In particular, very few students applied lateral reading strategies to compare the content with available scientific literature (2.68% for Rater 1 and 6.25% for Rater 2) or to gain more information about the source of the news item (5.36% for Rater 1 and 7.81% for Rater 2).\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003e \u003cem\u003ePlausibility\u003c/em\u003e assessments (\u003cem\u003egeneral plausibility\u003c/em\u003e, \u003cem\u003especific plausibility\u003c/em\u003e, \u003cem\u003einternal coherence\u003c/em\u003e, and other intuitive evaluations) account for around 29% of annotations for Rater 1 and 33% for Rater 2. Finally, \u003cem\u003ecues\u003c/em\u003e strategies (\u003cem\u003emisleading titles\u003c/em\u003e, \u003cem\u003esource reliability judgments\u003c/em\u003e, \u003cem\u003evisual cues\u003c/em\u003e, and \u003cem\u003elanguage cues\u003c/em\u003e) are employed less frequently, accounting for approximately 10% of annotations for Rater 1 and 9% for Rater 2. These frequencies indicate clear patterns in adolescents' verification behaviors and preferences, as well as an overall level of critical engagement with the information they were given.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eMore specifically, Table\u0026nbsp;\u003cspan refid=\"Tab1\" class=\"InternalRef\"\u003e1\u003c/span\u003e summarizes the mean frequency of each strategy between the two raters, disaggregated by the six posts presented in the activity. The posts included three scientifically valid and three pseudoscientific items, each designed to mimic the stylistic features of real social media content (See \u003cem\u003eMethods\u003c/em\u003e).\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab1\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eThe table displays the relative frequency (%) of each evaluative strategy (i.e., cues, lateral reading, and plausibility) disaggregated by news item. Lateral reading was the most common strategy across all posts, followed by plausibility-reasoning and cue-based strategies.\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"5\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eNews item\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eCues (%)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eLateral reading (%)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003ePlausibility (%)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eFlamingos (Valid)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e10.2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e57.8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e32.0\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eHIV (Valid)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e5.4\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e57.7\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e36.9\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eSpiders (Valid)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e16.7\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e55.9\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e27.5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eChocolate (Invalid)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e10.9\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e47.5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e41.6\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ePyramid (Invalid)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e7.8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e70.7\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e21.6\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eSpain flood (Invalid)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e6.1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e76.8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e17.1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c5\"\u003e\u0026nbsp;\u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eRegarding frequencies of \u003cem\u003eexternal search\u003c/em\u003e behavior, 33.7% of times no external search was performed when evaluating the credibility of the posts, whereas in 34.0% and 25.6% of cases multiple sources or a single source were respectively consulted. Finally, in 6.7% cases, students declared to have conducted an external search without specifying the sources consulted. Importantly, in 52.1% cases, the external search was rated as effective (i.e., a search that contributes to an accurate judgment based on meaningful evidence), a result showing that almost half of the external searches were not effective.\u003c/p\u003e \u003cp\u003eAccuracy rates vary substantially depending on the strategy employed. \u003cem\u003eLateral reading\u003c/em\u003e is associated with higher accuracy: cases where students used it led to correct evaluations in 71\u0026ndash;72% of cases, compared to 58% of accurate evaluations when the strategy was not used. However, such a difference did not result to be significant (\u003cem\u003ep\u003c/em\u003e\u003csub\u003e\u003cem\u003erater1\u003c/em\u003e\u003c/sub\u003e = 0.057, \u003cem\u003ep\u003c/em\u003e\u003csub\u003e\u003cem\u003erater2\u003c/em\u003e\u003c/sub\u003e = 0.086). \u003cem\u003eCues\u003c/em\u003e-based reasoning shows accuracy levels between 64\u0026ndash;76%, without significant differences between usage or non-usage (\u003cem\u003ep\u003c/em\u003e\u003csub\u003e\u003cem\u003erater1\u003c/em\u003e\u003c/sub\u003e = 0.332, \u003cem\u003ep\u003c/em\u003e\u003csub\u003e\u003cem\u003erater2\u003c/em\u003e\u003c/sub\u003e = 0.155), while \u003cem\u003eplausibility\u003c/em\u003e-based strategies led to decreased accuracy, especially among Rater 2, where it significantly dropped to 55% when used, compared to 73% when not used (\u003cem\u003ep\u003c/em\u003e\u003csub\u003e\u003cem\u003erater1\u003c/em\u003e\u003c/sub\u003e = 0.494, \u003cem\u003ep\u003c/em\u003e\u003csub\u003e\u003cem\u003erater2\u003c/em\u003e\u003c/sub\u003e = 0.0198).\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eFinally, analysis of post-activity responses revealed meaningful revisions in students\u0026rsquo; thinking. In cases when students initially judged a post as true, 18.4% later reported having changed their mind to 'false' after searching, and 70.3% of these revised answers were correct. Conversely, among the cases where students initially judged a post as false, 16.5% changed their mind to 'true', with a correctness rate of 52.4%. Those who maintained their initial judgment had slightly lower but still meaningful accuracy levels (63.4% and 81.1%, respectively, for true and false initial responses).\u003c/p\u003e"},{"header":"Discussion","content":"\u003cp\u003eThis study investigated how adolescents evaluate the credibility of scientific and pseudoscientific content encountered in Instagram-style posts in a real-world setting. By combining a digital simulation of social media environments with a qualitative and quantitative analysis of students’ justifications for their sourcing strategies, we identified a wide range of epistemic strategies employed by young people to assess the validity of information online.\u003c/p\u003e \u003cp\u003eOur findings highlight several notable trends. Firstly, a significant proportion of participants effectively employed advanced evaluative strategies, such as \u003cem\u003elateral reading\u003c/em\u003e (primarily \u003cem\u003econsensus search\u003c/em\u003e and \u003cem\u003edebunking search)\u003c/em\u003e and specific cues, such as \u003cem\u003etrustworthy external sources\u003c/em\u003e. Indeed, \u003cem\u003elateral reading\u003c/em\u003e emerged as the most frequently employed strategy, positively correlating with higher accuracy in judgements, although this correlation was not significant. This is a promising result, as lateral reading strategies have been proven to be an effective evaluation approach [\u003cspan class=\"CitationRef\"\u003e30\u003c/span\u003e]. However, it is important to note that students primarily verified information related to the content. Only a small number of cases involved the application of experts' evaluation strategies, such as \u003cem\u003esource-oriented lateral reading\u003c/em\u003e or \u003cem\u003escientific article verification\u003c/em\u003e [\u003cspan class=\"CitationRef\"\u003e22\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eImportantly, the widespread reliance on \u003cem\u003econtent-oriented lateral reading\u003c/em\u003e that was observed in this study may (at least partly) be due to the instructions provided on Padlet boards by the experimenters. Such instructions (which included the explicit invitation to navigate the web, collect some pieces of information and upload them on Padlet) could have affected students’ evaluative strategy selection. Hence, we submit, this potential priming effect on adolescents’ choice of verification methods should be carefully addressed and measured in future studies.\u003c/p\u003e \u003cp\u003eAt the same time, a substantial subset of students continued to rely on \u003cem\u003eplausibility\u003c/em\u003e-based heuristics, intuition, and \u003cem\u003ecues\u003c/em\u003e derived from familiarity, language, or visual presentation. These results align with previous literature highlighting adolescents' tendency toward intuitive reasoning and heuristic shortcuts in online contexts [\u003cspan class=\"CitationRef\"\u003e6\u003c/span\u003e, \u003cspan class=\"CitationRef\"\u003e9\u003c/span\u003e, \u003cspan class=\"CitationRef\"\u003e39\u003c/span\u003e], as well as with findings from the field of developmental psychology [\u003cspan class=\"CitationRef\"\u003e15\u003c/span\u003e], supporting the idea that some of these strategies are embedded in human cognition as some of the work in Harris shows [\u003cspan class=\"CitationRef\"\u003e15\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eThe study identified hybrid evaluative behaviors as well, reflecting students' pragmatic engagement with available digital tools and resources. A notable portion of students integrated contemporary digital tools, such as generative AI (i.e., ChatGPT), video platforms (i.e., YouTube), and online encyclopedia (i.e., Wikipedia), into their verification processes.\u003c/p\u003e \u003cp\u003eThe increasing integration of generative AI and polished digital content underscores the risk of reinforcing the perceived validity of pseudoscientific claims, an issue highlighted in recent discussions about algorithmic trust and cognitive biases [\u003cspan class=\"CitationRef\"\u003e33\u003c/span\u003e, \u003cspan class=\"CitationRef\"\u003e37\u003c/span\u003e]. Given the widespread usage of generative AI as a tool to evaluate information, it is pivotal to understand adolescents’ awareness of the reliability of information provided by such tools and how they engage with them in order to develop tailored digital interventions.\u003c/p\u003e \u003cp\u003eMoreover, in only half of the cases where an external search was performed, such a search led to an accurate judgment based on meaningful evidence. Taken together, these results highlight the need for digital literacy interventions that go beyond an uncritical application of external search, but rather aim at providing more nuanced tools for distinguishing between a case of information based on science from a case of information based on the mere appearance of science (i.e. pseudoscience).\u003c/p\u003e \u003cp\u003eIn real-world contexts, valid information and invalid information traits can be found simultaneously, making it difficult to evaluate content reliability and accuracy. This was the case for some of the information pieces used in the present study, where, for example, a misleading title stating that dead spiders have been revived was attached to a scientifically valid news or where fragments of accurate information were merged to argue in favour of a pseudoscientific claim according to which dark chocolate has been shown to cause weight loss. Educational interventions that integrate multiple strategies together should thus be developed. Such interventions would enable not only to overcome this issue, but also to avoid an uncritical application of effective techniques, such as the application of content-oriented lateral reading to exclusively confirm pre-existing beliefs.\u003c/p\u003e \u003cp\u003eFurthermore, the ecological and classroom-based approach of our study provided insights into students' evaluation strategies within authentic, socially embedded contexts. The use of collaborative yet individually moderated platforms such as Notion and Padlet mirrored realistic digital interactions. This design allowed us to observe the complex interplay between individual critical thinking, social influences, and environmental factors influencing students' evaluative behaviors, providing valuable insights that go beyond those typically obtained in controlled laboratory settings.\u003c/p\u003e \u003cp\u003eHowever, it should be pointed out that the classroom environment in which our study was carried out differed from real-world scenarios in some important respects. Indeed, students’ level of engagement and attention might be expected to be higher at school when they are involved in educational initiatives under the supervision of their teachers than while doing everyday activities out of school. Moreover, students were given a significant amount of time (up to one hour) to complete the requested task, namely assessing the accuracy of at least one piece of news. In real life, adolescents rarely devote a comparable amount of time to the verification of online contents, with the plausible exception of the cases in which these are related to issues they particularly care about.\u003c/p\u003e \u003cp\u003eThe effect of the amount of time spent reading and evaluating online news on the accuracy of information assessment should be further investigated in future research, being properly disentangled from the evaluation strategy used. This could be useful to identify the strategies that ensure an acceptable degree of accuracy while also being compatible with time constraints typical of real-life contexts.\u003c/p\u003e \u003cp\u003eThe effect of adolescents’ motivation on the accuracy of their credibility judgments should be examined in future work, too. By “motivation”, we mean one’s interest in the topic covered by a certain piece of information (to be controlled for by directly asking participants to rate it before assessing the veracity of some news). We think that motivation (in the sense of the word just specified, not to be confused with motivated reasoning which applies to ethically non-neutral information) is positively correlated with evaluation accuracy. The existence of this correlation should be tested in further studies.\u003c/p\u003e \u003cp\u003eThe results of our study suggests that the kind of device (computer vs. smartphone) used to search for relevant information on the internet could have some impact on the accuracy of assessments made by young people. In particular, 69.4% of students who used a computer provided accurate judgments, compared to 61.8% of those using a smartphone, though this gap in accuracy turned out to be not statistically significant. The effect of the specific tool through which information evaluation is carried out should be more systematically addressed in the future, given the increasing centrality of smartphones in teenagers’ (as well as adults’) lives.\u003c/p\u003e \u003cp\u003eFrom an educational perspective, our findings emphasize the need for comprehensive digital literacy interventions that go further than checklist-based approaches. Effective educational curriculum should prioritize teaching lateral reading, nuanced source analysis, and epistemic humility; skills that significantly enhance evaluative accuracy yet are rarely intuitive without explicit training [\u003cspan class=\"CitationRef\"\u003e21\u003c/span\u003e, \u003cspan class=\"CitationRef\"\u003e30\u003c/span\u003e]. Moreover, given the evolving digital landscape, characterized by generative AI, influencer culture, and interactive media, digital literacy curricula should incorporate critical reflection on the broader infrastructure underpinning knowledge creation and dissemination, as well as providing useful guidelines for AI usage when applying fact-checking strategies.\u003c/p\u003e \u003cp\u003eLastly, the annotated dataset and comprehensive codebook generated from this study constitute valuable resources for future educational research. We believe that they offer empirical foundations for developing pedagogical tools specifically tailored to adolescent learners. Yet, the lower inter-rater agreement result for the category \u003cem\u003eplausibility\u003c/em\u003e with respect to the other categories presented and discussed here represents an additional limit of the present study, that should be overcome by future research through a clearer category definition and/or through appropriate rater training.\u003c/p\u003e "},{"header":"Methods","content":"\u003cp\u003eParticipants\u003c/p\u003e\u003cp\u003eData collection was conducted between May and June 2025 in two upper secondary schools located in the metropolitan area of a large city in northern Italy. The schools were recruited through a public engagement initiative led by a local university: invitations were sent to publicly available institutional email addresses starting on 01/09/2024, and the first two schools to respond were selected, with participant recruitment ending on 31/10/2024. A total of 130 students from multiple fourth-grade classes (aged 16–19) participated in the study. All students in the selected classes were invited to participate, with nobody choosing to opt out. No exclusion criteria were applied aside from age and school year, and no demographic information was collected.\u003c/p\u003e\u003cp\u003eThe activity took place during regular school hours and was supervised by members of the research team in collaboration with classroom teachers. Participation was entirely voluntary, and students could withdraw at any time without penalty. Written informed consent was obtained from all participants prior to data collection through paper-based consent forms signed by each student. In compliance with the General Data Protection Regulation (Regulation EU 2016/679), no personally identifiable information was collected. Ethical approval for the study was provided by the Lombardy Regional Ethics Committee 1 (approval number CET 175–2025). Additionally, all research was performed in accordance with relevant guidelines and regulations, as well as in accordance with the Declaration of Helsinki. The Padlet tool used in the study does not store IP addresses or user metadata, and all student responses were anonymized at the point of data collection.\u003c/p\u003e\u003cp\u003eStudy Procedure\u003c/p\u003e\u003cp\u003eParticipants took part in a classroom-based session of approximately two hours, facilitated by a member of the research team. The session began with a 30-minute presentation introducing the research team, the overall study, and key concepts such as misinformation, disinformation, and their implications in scientific contexts.\u003c/p\u003e\u003cp\u003eFollowing the introduction, students were directed to a custom digital environment built on the Notion platform [\u003cspan class=\"CitationRef\"\u003e43\u003c/span\u003e], which featured six Instagram-styled posts (see \u003cem\u003eSupplementary material\u003c/em\u003es). All posts were based on news pieces the experimenters found on the web, and were selected and independently evaluated by pairs of researchers from the research team. Half of the posts were based on pseudoscientific claims and contained information that was shown to be unequivocally false or misleading by professional fact-checking organisations. The remaining half of the posts contained scientifically accurate claims supported by published scientific evidence. All the themes were selected based on scientific topics with neutral political resonance in order to avoid interference in evaluations with political motivated reasoning.\u003c/p\u003e\u003cp\u003eScientifically valid posts included statements about (i) the reasons behind the colour pink of flamingos, (ii) an HIV infection happened in a laboratory, and (iii) the results of a research where dead spiders were turned into ready-to-use actuators. Instead, invalid and pseudoscientific posts included statements about (i) weight-loss properties of dark chocolate, (ii) new archaeological results discussing the actual oldest pyramid known until now, and (iii) a cause-effect relationship between geoengineering and recent floods in Spain. Each post was linked to its original online source and accompanied by two emoji-buttons (i.e., ✅ and ❌) that redirected students to specific Padlet boards.\u003c/p\u003e\u003cp\u003eGiven the high interactivity design of Padlet, this free online tool has been widely used for educational purposes. Research has previously highlighted how the tool motivates students to participate, exchange information and express opinions comfortably, while fostering effective dialogues by allowing students to learn from peers’ responses [\u003cspan class=\"CitationRef\"\u003e44\u003c/span\u003e, \u003cspan class=\"CitationRef\"\u003e45\u003c/span\u003e]. In particular, the Padlet tool allows the creation of digital boards, where students are able to anonymously share various media formats, including text, image, audio, video and external URLs. The creators of Padlet boards can control the content, design, privacy settings and access to the board.\u003c/p\u003e\u003cp\u003eTwo Padlet boards were therefore created for each news piece, one for the students who evaluated the post as true and one for those who evaluated it to be false (Fig.\u0026nbsp;\u003cspan class=\"InternalRef\"\u003e3\u003c/span\u003e). This design allowed us to manage in the best possible way the debriefing phase, as facilitators could easily pick a few news items to focus on, usually the ones mostly analyzed by students in the classroom, and walk through the different boards to discuss the rationales underlying the responses given, on the one side, by participants who believed the post to be true and, on the other side, by those who believed the post to be false.\u003c/p\u003e\u003cp\u003eOnce landed to the relative Padlet digital board, students were asked to:\u003c/p\u003e\u003col\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eJudge whether the content of each post was true or false.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eProvide a brief written justification explaining their reasoning. This could include written statements, comments, links, and audio-visual material.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eAnswer an anonymous poll asking whether they still believed the post to be true or false, or whether the activity led them to revise their evaluations.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003c/ol\u003e\u003cp\u003eParticipants were encouraged to evaluate at least one of the six posts, although some students chose to assess multiple items. As a result, the dataset comprises 174 individual responses. Each student was allowed to use either their personal smartphone or a school-provided device (i.e., laptop or desktop) to complete the activity. They had between 45 and 60 minutes to formulate their responses, during which they were permitted to consult the internet.\u003c/p\u003e\u003cp\u003eTo minimize peer influence, students’ sourcing strategies and justifications were not made immediately visible: all content had to be approved by the facilitator before appearing on the shared Padlet board. During a short 15-minute break, the facilitator reviewed and approved submissions. The session concluded with a debriefing phase, during which the nature of the posts and students’ rationales were discussed collectively by walking through students’ comments while fostering dialogue: facilitators provided key take-aways on digital critical thinking and effective ways to evaluate news pieces, and students were free to discuss with the facilitators and the rest of the class. The Padlet tool enabled the collection of both categorical (true/false) and open-ended responses in a fully anonymous format.\u003c/p\u003e\u003cp\u003eThematic Analysis and Coding Scheme\u003c/p\u003e\u003cp\u003eThe qualitative analysis of student justifications followed a two-phase thematic approach, combining both inductive and deductive elements [\u003cspan class=\"CitationRef\"\u003e25\u003c/span\u003e, \u003cspan class=\"CitationRef\"\u003e26\u003c/span\u003e]. The aim was to identify and classify the evaluative strategies adolescents used to assess the validity of scientific and pseudoscientific Instagram-style posts.\u003c/p\u003e\u003cp\u003eIn the first phase, three members of the research team (C.M., M.G., and M.F.) independently reviewed the full set of 174 open-ended responses. Each researcher generated initial codes based on recurring patterns in the data, focusing on the epistemic, cognitive, and social cues employed by students. This initial round of open coding produced a diverse set of labels, which were then compared and refined through an iterative process of discussion and negotiated consensus. Through successive rounds of synthesis, overlapping codes were merged, hierarchical relationships were established (e.g., main categories and subcategories), and ambiguous cases were clarified. The result was the development of a structured codebook, comprising 17 coding labels that represent distinct credibility assessment strategies. The full codebook, including definitions, examples, and theoretical references, is available in the \u003cem\u003eSupplementary Information\u003c/em\u003e.\u003c/p\u003e\u003cp\u003eIn the second phase, the finalized codebook was applied to the entire dataset by two independent annotators (M.C. and Y.C.), who had not participated in the initial code development. Prior to annotation, both coders received a brief training session on the use of the codebook. Each student response could receive multiple labels if more than one strategy was present. To assess the reliability of the coding scheme, inter-rater agreement was calculated using Cohen’s Kappa, a widely adopted measure of categorical consistency. The analysis yielded moderate to high levels of agreement (κ = 0.84 for \u003cem\u003elateral reading\u003c/em\u003e, κ = 0.78 for \u003cem\u003ecues\u003c/em\u003e, κ = 0.64 for \u003cem\u003eplausibility\u003c/em\u003e, κ = 0.82 for \u003cem\u003eexternal search\u003c/em\u003e and κ = 0.74 for \u003cem\u003esearch effectiveness\u003c/em\u003e), indicating that the codebook was both conceptually clear and reproducible across raters.\u003c/p\u003e\u003cp\u003eThe annotated dataset allowed for a quantitative analysis of the frequency and distribution of credibility strategies across responses and post types. In addition to supporting the present study, this structured dataset can serve as a resource for future research on adolescent reasoning and for the development of educational and computational tools.\u003c/p\u003e\u003ch2\u003eData Analysis\u003c/h2\u003e\u003cp\u003eData were analyzed through a mixed-method approach [\u003cspan class=\"CitationRef\"\u003e46\u003c/span\u003e] in three complementary stages: frequency-based exploration of evaluative strategies, assessment of judgment accuracy, and examination of search behavior and revision patterns. All analyses were performed using R Statistical Software [\u003cspan class=\"CitationRef\"\u003e47\u003c/span\u003e].\u003c/p\u003e\u003cp\u003eIn the first stage, we computed the frequency of each strategy identified in the thematic coding, disaggregated by rater and post type. Each of the 174 student responses could include multiple strategies, and all coded strategies were included in the analysis. For comparative purposes, strategies were grouped into three macro-categories: \u003cem\u003elateral reading, cues\u003c/em\u003e, and \u003cem\u003eplausibility\u003c/em\u003e. Sub-strategies (e.g., \u003cem\u003euse of generative AI tool, Wikipedia, or scientific article validation\u003c/em\u003e) were nested within the relevant macro-category.\u003c/p\u003e\u003cp\u003eIn the second stage, we assessed the accuracy of students’ true/false judgments, defined as alignment between the student’s judgment (true/false) and the actual validity of the information. Accuracy was calculated both globally and in relation to strategy use. For each strategy, we compared the accuracy of responses where the strategy was used to those where it was not. This enabled us to identify associations between evaluative behavior and outcome quality and their significance through t-test statistics. Lateral reading, in particular, was associated with higher accuracy levels, although the difference was not significant (t\u003csub\u003erater1\u003c/sub\u003e = 1.92, df\u003csub\u003erater1\u003c/sub\u003e = 133.64; p\u003csub\u003erater1\u003c/sub\u003e = 0.057; t\u003csub\u003erater2\u003c/sub\u003e = 1.73, df\u003csub\u003erater2\u003c/sub\u003e = 114.8, p\u003csub\u003erater2\u003c/sub\u003e = 0.086). Cues-based reasoning resulted in accuracy levels between 64–76%, without significant differences between usage or non-usage (t\u003csub\u003erater1\u003c/sub\u003e = 0.98, df\u003csub\u003erater1\u003c/sub\u003e = 52.04; p\u003csub\u003erater1\u003c/sub\u003e = 0.332; t\u003csub\u003erater2\u003c/sub\u003e = 1.44, df\u003csub\u003erater2\u003c/sub\u003e = 53.89, p\u003csub\u003erater2\u003c/sub\u003e = 0.155), whereas reliance on plausibility reasoning often coincided with lower performance (t\u003csub\u003erater1\u003c/sub\u003e = -0.69, df\u003csub\u003erater1\u003c/sub\u003e = 88.29; p\u003csub\u003erater1\u003c/sub\u003e = 0.494; t\u003csub\u003erater2\u003c/sub\u003e = -2.36, df\u003csub\u003erater2\u003c/sub\u003e = 120.53, p\u003csub\u003erater2\u003c/sub\u003e = 0.02).\u003c/p\u003e\u003cp\u003eThe third stage focused on students’ search behavior and its effectiveness. Each justification was coded for whether a search was performed and, if so, whether it contributed meaningfully to the accuracy of the final judgment. Frequencies of search use were categorized as no search, single-source search, multi-source search, or unspecified search. Search effectiveness was rated qualitatively based on whether the participant’s search led to an accurate conclusion inferred from relevant pieces of information. Inter-rater agreement was high for both dimensions (κ = 0.82 for external search; κ = 0.74 for search effectiveness). Among those cases when searches were conducted, just over half (i.e., 52.1%) were judged to be effective.\u003c/p\u003e\u003cp\u003eFinally, we analyzed revisions in students’ judgments across the activity. Some students initially evaluated a post, then modified their judgment after engaging with further information. By comparing initial and final responses (where available), we documented shifts in opinion and calculated the proportion of judgment changes that resulted in a correct response. Approximately 40% of students changed at least one answer after reflection or search, and these changes led to improved accuracy in the majority of cases. This finding highlights the potential of encouraging reflective digital practices, particularly when combined with explicit training in evaluative strategies.\u003c/p\u003e"},{"header":"Declarations","content":"\u003ch3\u003eData availability\u003c/h3\u003e\n\u003cp\u003eThe raw dataset, labelled datasets, and materials related to this work have been deposited in the Open Science Framework (OSF) repositories for this project and are available at the following link https://osf.io/gn3br/?view_only=888f8aa5f9734231ba24c478279346f6. \u003c/p\u003e\u003cp\u003eAdditional Information\u003c/p\u003e\n\u003cp\u003eThe authors declare no competing interests.\u003c/p\u003e\n\u003cp\u003eFunding Declaration\u003c/p\u003e\n\u003cp\u003eThe study was supported by the European Union \u0026ndash; Next Generation EU, Mission 4, Component 1 (CUP D46F23000120004).\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\n\u003cli\u003eFreeman, J. L., Caldwell, P. H. Y. \u0026amp; Scott, K. M. How Adolescents Trust Health Information on Social Media: A Systematic Review. \u003cem\u003eAcad. Pediatr. \u003c/em\u003e\u003cstrong\u003e23,\u003c/strong\u003e 703\u0026ndash;719 (2023).\u003c/li\u003e\n\u003cli\u003eBoczkowski, P. J. \u003cem\u003eAbundance: On the Experience of Living in a World of Information Plenty\u003c/em\u003e. (Oxford University Press, 2021).\u003c/li\u003e\n\u003cli\u003eBrown, P. \u0026amp; Gummerum, M. Trust issues: Adolescents\u0026rsquo; epistemic vigilance towards online sources. \u003cem\u003eBr. J. Dev. Psychol.\u003c/em\u003e (2025). doi:10.1111/bjdp.12559\u003c/li\u003e\n\u003cli\u003ePrensky, M. Digital Natives, Digital Immigrants Part 1. \u003cem\u003eHoriz. \u003c/em\u003e\u003cstrong\u003e9,\u003c/strong\u003e 1\u0026ndash;6 (2001).\u003c/li\u003e\n\u003cli\u003eHelsper, E. J. \u0026amp; Eynon, R. Digital natives: Where is the evidence? \u003cem\u003eBr. Educ. Res. J. \u003c/em\u003e\u003cstrong\u003e36,\u003c/strong\u003e 503\u0026ndash;520 (2010).\u003c/li\u003e\n\u003cli\u003eAgosto, D. E. A model of young people\u0026rsquo;s decision-making in using the Web. \u003cem\u003eLibr. Inf. Sci. Res. \u003c/em\u003e\u003cstrong\u003e24,\u003c/strong\u003e 311\u0026ndash;341 (2002).\u003c/li\u003e\n\u003cli\u003eGasser, U., Cortesi, S., Malik, M. M. \u0026amp; Lee, A. Youth and Digital Media: From Credibility to Information Quality. SSRN Scholarly Paper at https://doi.org/10.2139/ssrn.2005272 (2012)\u003c/li\u003e\n\u003cli\u003ePan, B. \u003cem\u003eet al.\u003c/em\u003e In Google We Trust: Users\u0026rsquo; Decisions on Rank, Position, and Relevance. \u003cem\u003eJ. Comput.-Mediat. Commun. \u003c/em\u003e\u003cstrong\u003e12,\u003c/strong\u003e 801\u0026ndash;823 (2007).\u003c/li\u003e\n\u003cli\u003eHargittai, E., Fullerton, L., Menchen-Trevino, E. \u0026amp; Thomas, K. Y. Trust Online: Young Adults\u0026rsquo; Evaluation of Web Content. \u003cem\u003eInt. J. Commun. \u003c/em\u003e\u003cstrong\u003e4,\u003c/strong\u003e 27 (2010).\u003c/li\u003e\n\u003cli\u003eMcGrew, S. \u0026amp; Kohnen, A. M. Tackling misinformation through online information literacy: Structural and contextual considerations. \u003cem\u003eJ. Res. Technol. Educ. \u003c/em\u003e\u003cstrong\u003e56,\u003c/strong\u003e 1\u0026ndash;6 (2024).\u003c/li\u003e\n\u003cli\u003eIding, M. K., Crosby, M. E., Auernheimer, B. \u0026amp; Klemm, E. B. Web site credibility: Why do people believe what they believe? \u003cem\u003eInstr. Sci. \u003c/em\u003e\u003cstrong\u003e37,\u003c/strong\u003e 43\u0026ndash;63 (2009).\u003c/li\u003e\n\u003cli\u003eFlanagin, A. J. \u0026amp; Metzger, M. J. The role of site features, user attributes, and information verification behaviors on the perceived credibility of web-based information. \u003cem\u003eNew Media Soc. \u003c/em\u003e\u003cstrong\u003e9,\u003c/strong\u003e 319\u0026ndash;342 (2007).\u003c/li\u003e\n\u003cli\u003eHassoun, A. \u003cem\u003eet al.\u003c/em\u003e Practicing Information Sensibility: How Gen Z Engages with Online Information. in \u003cem\u003eProc. 2023 CHI Conf. Hum. Factors Comput. Syst.\u003c/em\u003e 1\u0026ndash;17 (ACM, 2023). doi:10.1145/3544548.3581328\u003c/li\u003e\n\u003cli\u003eHassoun, A. \u003cem\u003eet al.\u003c/em\u003e Beyond Digital Literacy: Building Youth Digital Resilience Through Existing \u0026ldquo;Information Sensibility\u0026rdquo; Practices. \u003cem\u003eSoc. Sci. \u003c/em\u003e\u003cstrong\u003e14,\u003c/strong\u003e 230 (2025).\u003c/li\u003e\n\u003cli\u003eHarris, P. L. \u003cem\u003eTrusting what you\u0026rsquo;re told: How children learn from others\u003c/em\u003e. 253 (The Belknap Press of Harvard University Press, 2012).\u003c/li\u003e\n\u003cli\u003eGreenfield, P. M. \u0026amp; Savage-Rumbaugh, E. S. Comparing communicative competence in child and chimp: the pragmatics of repetition. \u003cem\u003eJ. Child Lang. \u003c/em\u003e\u003cstrong\u003e20,\u003c/strong\u003e 1\u0026ndash;26 (1993).\u003c/li\u003e\n\u003cli\u003eMartini, C. in \u003cem\u003eRoutledge Handb. Soc. Epistemol.\u003c/em\u003e (Routledge, 2019).\u003c/li\u003e\n\u003cli\u003eMercier, H. \u003cem\u003eNot Born Yesterday: The Science of Who We Trust and What We Believe\u003c/em\u003e. (Princeton University Press, 2020). doi:10.1515/9780691198842\u003c/li\u003e\n\u003cli\u003eCorriveau, K. \u0026amp; Harris, P. L. Choosing your informant: weighing familiarity and recent accuracy. \u003cem\u003eDev. Sci. \u003c/em\u003e\u003cstrong\u003e12,\u003c/strong\u003e 426\u0026ndash;437 (2009).\u003c/li\u003e\n\u003cli\u003eWineburg, S. \u0026amp; McGrew, S. Why Students Can\u0026rsquo;t Google Their Way to the Truth. \u003cem\u003eEduc. Week\u003c/em\u003e (2016). at \u0026lt;https://www.edweek.org/teaching-learning/opinion-why-students-cant-google-their-way-to-the-truth/2016/11\u0026gt;\u003c/li\u003e\n\u003cli\u003eWineburg, S. \u0026amp; McGrew, S. Lateral Reading: Reading Less and Learning More When Evaluating Digital Information. \u003cem\u003eSSRN Electron. J.\u003c/em\u003e (2017). doi:10.2139/ssrn.3048994\u003c/li\u003e\n\u003cli\u003eBrand‐Gruwel, S., Kammerer, Y., Van Meeuwen, L. \u0026amp; Van Gog, T. Source evaluation of domain experts and novices during Web search. \u003cem\u003eJ. Comput. Assist. Learn. \u003c/em\u003e\u003cstrong\u003e33,\u003c/strong\u003e 234\u0026ndash;251 (2017).\u003c/li\u003e\n\u003cli\u003eWiley, J. \u003cem\u003eet al.\u003c/em\u003e Source Evaluation, Comprehension, and Learning in Internet Science Inquiry Tasks. \u003cem\u003eAm. Educ. Res. J. \u003c/em\u003e\u003cstrong\u003e46,\u003c/strong\u003e 1060\u0026ndash;1106 (2009).\u003c/li\u003e\n\u003cli\u003eBrante, E. W. \u0026amp; Str\u0026oslash;ms\u0026oslash;, H. I. Sourcing in text comprehension: A review of interventions targeting sourcing skills. \u003cem\u003eEduc. Psychol. Rev. \u003c/em\u003e\u003cstrong\u003e30,\u003c/strong\u003e 773\u0026ndash;799 (2018).\u003c/li\u003e\n\u003cli\u003eBraun, V. \u0026amp; Clarke, V. Using thematic analysis in psychology. \u003cem\u003eQual. Res. Psychol. \u003c/em\u003e\u003cstrong\u003e3,\u003c/strong\u003e 77\u0026ndash;101 (2006).\u003c/li\u003e\n\u003cli\u003eBraun, V. \u0026amp; Clarke, V. Reflecting on reflexive thematic analysis. \u003cem\u003eQual. Res. Sport Exerc. Health \u003c/em\u003e\u003cstrong\u003e11,\u003c/strong\u003e 589\u0026ndash;597 (2019).\u003c/li\u003e\n\u003cli\u003eBronstein, M. V., Pennycook, G., Bear, A., Rand, D. G. \u0026amp; Cannon, T. D. Belief in Fake News is Associated with Delusionality, Dogmatism, Religious Fundamentalism, and Reduced Analytic Thinking. \u003cem\u003eJ. Appl. Res. Mem. Cogn. \u003c/em\u003e\u003cstrong\u003e8,\u003c/strong\u003e 108\u0026ndash;117 (2019).\u003c/li\u003e\n\u003cli\u003ePadlet - Visual Collaboration for Creative Work and Education. \u003cem\u003ePadlet\u003c/em\u003e at \u0026lt;https://padlet.com/\u0026gt;\u003c/li\u003e\n\u003cli\u003eGoldman, A. I. Experts: Which Ones Should You Trust? \u003cem\u003ePhilos. Phenomenol. Res. \u003c/em\u003e\u003cstrong\u003e63,\u003c/strong\u003e 85\u0026ndash;110 (2001).\u003c/li\u003e\n\u003cli\u003eMcGrew, S., Breakstone, J., Ortega, T., Smith, M. \u0026amp; Wineburg, S. Can Students Evaluate Online Sources? Learning From Assessments of Civic Online Reasoning. \u003cem\u003eTheory Res. Soc. Educ. \u003c/em\u003e\u003cstrong\u003e46,\u003c/strong\u003e 165\u0026ndash;193 (2018).\u003c/li\u003e\n\u003cli\u003eBarzilai, S. \u0026amp; Zohar, A. Epistemic Thinking in Action: Evaluating and Integrating Online Sources. \u003cem\u003eCogn. Instr. \u003c/em\u003e\u003cstrong\u003e30,\u003c/strong\u003e 39\u0026ndash;85 (2012).\u003c/li\u003e\n\u003cli\u003ePennycook, G., McPhetres, J., Zhang, Y., Lu, J. G. \u0026amp; Rand, D. G. Fighting COVID-19 Misinformation on Social Media: Experimental Evidence for a Scalable Accuracy-Nudge Intervention. \u003cem\u003ePsychol. Sci. \u003c/em\u003e\u003cstrong\u003e31,\u003c/strong\u003e 770\u0026ndash;780 (2020).\u003c/li\u003e\n\u003cli\u003eBender, E. M., Gebru, T., McMillan-Major, A. \u0026amp; Shmitchell, S. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜. in \u003cem\u003eProc. 2021 ACM Conf. Fairness Account. Transpar.\u003c/em\u003e 610\u0026ndash;623 (Association for Computing Machinery, 2021). doi:10.1145/3442188.3445922\u003c/li\u003e\n\u003cli\u003eJemielniak, D. Wikipedia, a professor\u0026rsquo;s best friend. \u003cem\u003eChron. High. Educ.\u003c/em\u003e (2014).\u003c/li\u003e\n\u003cli\u003eSwart, J. \u0026amp; Broersma, M. The Trust Gap: Young People\u0026rsquo;s Tactics for Assessing the Reliability of Political News. \u003cem\u003eInt. J. Press. \u003c/em\u003e\u003cstrong\u003e27,\u003c/strong\u003e 396\u0026ndash;416 (2022).\u003c/li\u003e\n\u003cli\u003eLewandowsky, S., Ecker, U. K. H. \u0026amp; Cook, J. Beyond Misinformation: Understanding and Coping with the \u0026ldquo;Post-Truth\u0026rdquo; Era. \u003cem\u003eJ. Appl. Res. Mem. Cogn. \u003c/em\u003e\u003cstrong\u003e6,\u003c/strong\u003e 353\u0026ndash;369 (2017).\u003c/li\u003e\n\u003cli\u003eNewman, E. J., Garry, M., Bernstein, D. M., Kantner, J. \u0026amp; Lindsay, D. S. Nonprobative photographs (or words) inflate truthiness. \u003cem\u003ePsychon. Bull. Rev. \u003c/em\u003e\u003cstrong\u003e19,\u003c/strong\u003e 969\u0026ndash;974 (2012).\u003c/li\u003e\n\u003cli\u003eNickerson, R. S. Confirmation bias: A ubiquitous phenomenon in many guises. \u003cem\u003eRev. Gen. Psychol. \u003c/em\u003e\u003cstrong\u003e2,\u003c/strong\u003e 175\u0026ndash;220 (1998).\u003c/li\u003e\n\u003cli\u003eKahneman, D. \u003cem\u003eThinking, fast and slow\u003c/em\u003e. (2011).\u003c/li\u003e\n\u003cli\u003ePirolli, P. \u0026amp; Card, S. Information foraging. \u003cem\u003ePsychol. Rev. \u003c/em\u003e\u003cstrong\u003e106,\u003c/strong\u003e 643\u0026ndash;675 (1999).\u003c/li\u003e\n\u003cli\u003eLandis, J. R. \u0026amp; Koch, G. G. The measurement of observer agreement for categorical data. \u003cem\u003eBiometrics \u003c/em\u003e\u003cstrong\u003e33,\u003c/strong\u003e 159\u0026ndash;174 (1977).\u003c/li\u003e\n\u003cli\u003eMartini, C., Floris, M. \u0026amp; Ghiara, M. \u003cem\u003eDisinformazione a Scuola: il progetto UniSR per sviluppare le capacit\u0026agrave; critiche digitali\u003c/em\u003e. (2024). at \u0026lt;https://www.unisr.it/news/2024/10/disinformazione-scuole-ricerca-carlo-martini\u0026gt;\u003c/li\u003e\n\u003cli\u003eNotion Labs Inc. at \u0026lt;https://www.notion.so/\u0026gt;\u003c/li\u003e\n\u003cli\u003eArouri, Y. M., Hamaidi, D. A., Al-Kaabi, A. F., Al Attiyah, A. A. \u0026amp; ElKhouly, M. M. Undergraduate Students\u0026rsquo; Perceptions on the Use of Padlet as an Educational Tool for an Academic Engagement: Qualitative Study. | EBSCOhost. \u003cstrong\u003e18,\u003c/strong\u003e 86 (2023).\u003c/li\u003e\n\u003cli\u003eDeni, A. R. M. \u0026amp; Zainal, Z. I. Padlet as an educational tool: pedagogical considerations and lessons learnt. in \u003cem\u003eProc. 10th Int. Conf. Educ. Technol. Comput.\u003c/em\u003e 156\u0026ndash;162 (Association for Computing Machinery, 2018). doi:10.1145/3290511.3290512\u003c/li\u003e\n\u003cli\u003eCreswell, J. W. in \u003cem\u003eHandb. Educ. Policy\u003c/em\u003e (ed. Cizek, G. J.) 455\u0026ndash;472 (Academic Press, 1999). doi:10.1016/B978-012174698-8/50045-X\u003c/li\u003e\n\u003cli\u003eR Core Team. R: A Language and Environment for Statistical Computing. (2025). at \u0026lt;https://www.R-project.org/\u0026gt;\u003c/li\u003e\n\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"
[email protected]","identity":"scientific-reports","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"scirep","sideBox":"Learn more about [Scientific Reports](http://www.nature.com/srep/)","snPcode":"","submissionUrl":"","title":"Scientific Reports","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"stoa","reportingPortfolio":"Scientific Reports","inReviewEnabled":true,"inReviewRevisionsEnabled":true},"keywords":"digital literacy, science disinformation, information evaluation, adolescents","lastPublishedDoi":"10.21203/rs.3.rs-7760447/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-7760447/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eIn today\u0026rsquo;s information-rich environment, adolescents face significant challenges in evaluating the credibility of scientific content on social media. This study investigates how 130 high school students assessed the truthfulness of scientific and pseudoscientific Instagram-style posts in a classroom-based, ecologically valid setting. Participants provided written justifications for their judgments, which were thematically coded into 17 evaluative strategies grouped into three macro-categories: lateral reading, cues, and plausibility. Lateral reading was the most frequently used and correlated with higher judgment accuracy, though not significantly. Plausibility-based reasoning, by contrast, often led to incorrect classifications. Over 60% of students conducted external searches, but only half were judged effective. Notably, 40% of participants revised at least one judgment during the activity, and most of these revisions led to improved accuracy. The findings underscore the need for digital literacy interventions that promote reflective reasoning, effective search habits, and critical engagement with diverse epistemic resources.\u003c/p\u003e","manuscriptTitle":"Spontaneous Sourcing Strategies and Heuristics in Adolescents’ Evaluation of Online Information","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2026-03-22 15:02:12","doi":"10.21203/rs.3.rs-7760447/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"editorInvitedReview","content":"","date":"2026-03-21T09:28:41+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2026-03-21T01:54:00+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"178993683000244589517856079323519781091","date":"2026-03-18T22:25:29+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2026-03-18T16:12:07+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"123067087088574623055963691359813961692","date":"2026-03-18T15:40:32+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"22105891335090037740600242102060526058","date":"2026-03-18T13:06:12+00:00","index":"hide","fulltext":""},{"type":"reviewersInvited","content":"","date":"2026-03-18T11:43:45+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2026-02-03T16:03:41+00:00","index":"","fulltext":""},{"type":"editorInvited","content":"","date":"2025-10-15T08:40:09+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2025-10-09T13:32:47+00:00","index":"","fulltext":""},{"type":"submitted","content":"Scientific Reports","date":"2025-10-09T10:52:47+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"
[email protected]","identity":"scientific-reports","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"scirep","sideBox":"Learn more about [Scientific Reports](http://www.nature.com/srep/)","snPcode":"","submissionUrl":"","title":"Scientific Reports","twitterHandle":"","acdcEnabled":true,"dfaEnabled":true,"editorialSystem":"stoa","reportingPortfolio":"Scientific Reports","inReviewEnabled":true,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"ce5acc6a-1001-419f-b27e-5608dafee177","owner":[],"postedDate":"March 22nd, 2026","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"under-review","subjectAreas":[{"id":64755563,"name":"Social science/Education"},{"id":64755564,"name":"Humanities/Philosophy"},{"id":64755565,"name":"Biological sciences/Psychology"},{"id":64755566,"name":"Social science/Psychology"},{"id":64755567,"name":"Social science/Science technology and society"}],"tags":[],"updatedAt":"2026-03-22T15:02:13+00:00","versionOfRecord":[],"versionCreatedAt":"2026-03-22 15:02:12","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-7760447","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-7760447","identity":"rs-7760447","version":["v1"]},"buildId":"XKTyCvWXoU3ODBz1xrDgd","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}
Text is read by the "Ask this paper" AI Q&A widget below.
Extraction quality varies by source — PMC NXML preserves structure
cleanly, OA-HTML may include some navigation residue, and OA-PDF can
have broken hyphenation. The publisher copy
(via DOI)
is the canonical version.