An Innovative Teaching & Learning Paradigm to Enhance College Students’ Long-Term Memory & Learning Gains

An Innovative Teaching & Learning Paradigm to Enhance College Students’ Long-Term Memory & Learning Gains | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article An Innovative Teaching & Learning Paradigm to Enhance College Students’ Long-Term Memory & Learning Gains Raquel Warley This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-4476383/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract This article elaborates on the active ingredients and theory of change used to explain an innovative model of teaching and learning called MISSAL. MISSAL is an abbreviation for Meaningful Instruction, Social, Self-Regulated, and Active Learning. This learning intervention is in the third year of research and development. Drawing upon prior scholarly investigations on brain-based learning and various instructional strategies, the active ingredients of this framework are summarized. Using a sample of 12 undergraduate social work students, I examined to what extent the MISSAL approach facilitates short- and long-term knowledge retention and recall of acquired learning, successful exam performance, and learning gains among students enrolled in a content-intensive course. Findings of this preliminary investigation are hopeful. Implications for the higher education sector and future research are discussed. Cognitive Neuroscience active learning scholarship of teaching and learning brain-based learning student learning outcomes Introduction The United States Department of Education is mandating greater accountability from the higher education sector. Colleges and universities are encouraged to develop a new paradigm for providing students with rigorous learning experiences and collecting evidence of their learning. This author has used a program development and intervention research model to develop and evaluate a complex paradigm of teaching and learning based on brain-based theory and neuroscience knowledge of how adult students learn since 2020. MISSAL (Meaningful Instruction, Self-Regulated, Social, and Active Learning) is the name of this learning intervention. MISSAL is in the third year of research and development. Based on preliminary findings this methodology has the potential to address student success and escalating problems with persistence, retention, engagement, and motivation to learn. This paradigm is driven by the desire to enhance higher education so that all students can and will learn through full participation, support, and rigorous learning experiences. MISSAL: Operational Framework MISSAL is a multifaceted educational intervention that encompasses a theoretical framework, instructional materials, educational activities, procedures, and processes that are hypothesized to have an impact on student learning outcomes. The absence of thoughtful contemplation or a detailed description of the active ingredients impedes complete understanding of what makes this intervention effective or ineffective in relation to student achievement. This also prevents other researchers and educators from replicating the practice and study of MISSAL or expanding upon it. The foundation of this paradigm is constructed upon existing academic literature related to the Scholarship of Teaching and Learning (SoTL), as well as the knowledge gained from neuroscience on the cognitive processes and brain development associated with learning. SoTL has the potential to strengthen the higher education system and fulfill the national "completion agenda" (Obama, 2009 ; Denning et al.) in a variety of ways. Most importantly, when instructional practices are founded on theory and research, it can enhance learning by employing more effective instructional methods (Tiernery, 2020; Owens, et al., 2021 ; Bailey et al., 2022 ; Maurer, 2022 ). Given that education is intended to be an evidence-based practice, it should be based on theory and/or research informed practice. The active ingredients of this framework, which comprise three instructional focus areas and 11 subcategories (see Table 1 ), can be summarized as follows: Table 1 Active Ingredients of the MISSAL Approach Focus Area Subcategories Implementation in MISSAL Focus on outcomes • Student learning outcomes • Constructive alignment Learning target Lesson structure Emphasis on mastery-learning • Cognitive load • Formative assessment • Feeback • Retrieval practice Input Diagnostic testing & practice Formative assessment & metacognitive reflection Throughout curriculum Promotion of learner-centeredness • Active learning • Mindset • Metacognition • Self-regulated learning • Scaffolding Preponderance of the lesson Casual-style explanation & facilitation Metacognitive reflection Input/initial & intervening phases of learning Throughout the curriculum Emphasis on Outcomes Outcome-based education is an andragogical approach that focuses on the achievement of certain learning objectives. Advocates of outcome-based professional education argue that methods of instruction should prioritize the acquisition of skills that are considered vital by the community to foster the development of competent professionals among students (Gruppen et al., 2012 ; Gervais, 2016 ). Student Learning Outcomes A clearly articulated understanding of what students are expected to know and be able to do when they complete an academic program or by the end of a unit of study is crucial to students’ academic growth and success. The phrase "outcome-based education" was introduced by Benjamin Bloom to describe an instructional method that he initially formulated during the 1960s. Bloom's "Mastery Learning" approach involves the segmentation of curriculum content into discrete and manageable parts, with students' advancement and readiness for graduation assessed based on their mastery of individual units of learning. According to Bloom, the most effective way to facilitate the development of mastery and higher-order skills is to include high-order tasks as learning objectives, provide practice in class and additional practice on assignments, and then assess students' ability to transfer knowledge to a variety of new contexts. According to Bloom's mastery learning paradigm, it is necessary for students to attain a degree of mastery, such as scoring 90% on a knowledge test, in prerequisite/introductory content prior to progressing towards acquiring advanced knowledge. The assessment process begins with the formulation of appropriate student learning outcomes. Bloom's Taxonomy of Learning can be used to categorize educational learning objectives in accordance with the specificity and complexity of the target student learning outcome(s). Target learning outcomes should be succinct, easy to measure and analyze, and clearly communicated to students. In the MISSAL approach, student learning outcomes play a pivotal role in the development or revision of lesson plans, the selection of educational resources, the implementation of instructional approaches, and the evaluation of student learning. Every module in the MISSAL methodology consists of two phases of learning. Each module's initial phase of learning begins with students being apprised of the module's particular goals for learning. Outcomes are written in student-friendly language and describe what students will be able to do by the end of the course, in addition to the criteria for success. Typically, outcomes and assessment tasks pertain to authentic professional responsibilities. Bloom's Taxonomy of Learning is used to categorize educational learning objectives according to the specificity and complexity of the intended student learning outcome(s). Students are apprised of the learning objective via the course outline, the LMS system, and the instructor of record throughout the duration of the lesson. Constructive Alignment Alignment of the curriculum is essential for attaining student learning outcomes. There are two perspectives in curricular alignment. One is within the interaction between program structure and course structures, and the other is within the interaction between a specific lesson plan and student learning. To ensure that learning objectives become actual learning outcomes and thereby maximize students' learning, it is essential that the content, instructional strategies, learning activities, and assessment task(s) that are used contribute to their realization. To create a lesson that maximizes student learning, the MISSAL framework ensures that the content, learning activities, and formative assessments are all aligned with the desired student learning outcomes. For each unit of study, a curriculum blueprint agreed upon by the faculty is established. The blueprint is essential in the MISSAL approach, which places a premium on consistency and equity across faculty and students. The blueprint contains a topic overview, talking points, student learning outcomes, inputs, and itinerary. Formative Assessment Assessment, which can be addressed in a variety of ways, enables instructors and students to track progress toward achieving learning outcomes. Whenever possible, evaluations should be founded on authentic work duties and should reflect the relevance and complexity of performance in the discipline. Assessment methods and instruments should be valid and reliable. Qualitative and quantitative data, and multiple measurement techniques are essential. Both formative and summative decisions can be made using the same assessment data. Success criteria outline the necessary steps that learners must take to achieve the objectives of the given task or activity. In the MISSAL approach, evaluation data is collected frequently. Formative assessment and feedback are a combined strategy in which faculty monitor/observe student performance, provide corrective feedback, and adjust teaching and/or learning strategies to improve students’ performance, as needed. Merely exposing students to information does not guarantee their retention. To ensure that students are retaining, comprehending, and generalizing new concepts, individual and collective student development is frequently assessed in a variety of ways and at various times. Formative assessment evaluates students' progress throughout the course and each module to identify areas for improvement. This is assessment for learning in addition to assessment of learning. By systematically utilizing formative assessment, faculty will gain a better understanding of students' learning needs and be able to hone their instruction. In both the initial and intervening learning phases, the MISSAL approach includes formative assessments, including diagnostic testing. Students take a diagnostic test at least until midterm to measure their conceptual understanding of introductory knowledge and to activate the testing effect, which research reveals has a substantial influence on brain development and long-term memory. Throughout the lesson, individual students and structured groups are assessed informally. Feedback It is crucial to assess students' comprehension and provide them with consistent, clear feedback. Students can receive feedback from educators, peers, computer-assisted technology, and themselves. The purposes of feedback are to motivate students, inform them of their performance in learning, and demonstrate how they can further develop. To accomplish these objectives, feedback must be timely, explicit, centered on strategy rather than ability or effort, and proportional to the complexity of the task at hand (Haughney et al., 2020 ). In addition, timely feedback prevents students from wasting time practicing errors or operating under incorrect knowledge. Throughout and upon completion of learning in the MISSAL model, learners receive feedback on their accomplishments. After completing diagnostic testing, for instance, students receive computer-mediated corrective feedback. Immediately thereafter, the instructor examines each assessment question with students to enhance their critical thinking skills, dispel misconceptions, assist them in making connections to prior learning, and, if necessary, provide additional information. Students also receive feedback via participation in metacognitive activities. Mastery Learning & Focus on Abilities According to the principles of mastery learning, it is essential for students to attain a certain level of proficiency in foundational information before progressing to acquire further knowledge on subject matter (Akpan, 2020 ). Undoubtedly, education requires the delivery of an abundance of academic input; students should be engaged, inspired, and informed by it. Educational content should be both practical and practicable. Managing Cognitive Load The nature of learning necessitates that students can retain, recall, apply, and then transfer newly acquired knowledge in a variety of contexts. Cognitive load theory and research on the topic have implications for teaching and learning in higher education. Sweller ( 1994 ) defines cognitive load as the thought processes required for working memory to engage in learning activity. According to cognitive load theory, learning processes are a function of working memory activities with finite capacity and duration (Kalyuga, 2011 ). Memory becomes overloaded and limits learning when activities surpass working memory capacity. More specifically, cognitive load theory contends that instructional design must account for the constraints of the human cognitive architecture to prevent needlessly overloading a learner's working memory (Schnotz & Kurschnere, 2007). Intrinsic cognitive load refers to thinking processes focused on acquiring the knowledge and/or abilities at hand. Existing literature and instructor feedback indicate that students are less likely to achieve deep understanding of course information when they are overwhelmed with excessive reading and lecture notes. Furthermore, content-heavy, lecture-based instruction tends to turn students into passive learners. In both phases of learning, students are exposed to content (i.e. input). Initially, students undertake required reading, review videos, listen to podcasts, and etcetera on their own. Following that, they engage in instructor-led information dissemination and facilitation. The most important and distinct (memorable) components of content are included in the curriculum at each stage, as highly distinct material is remembered more readily and precisely. For instructor-led input, the content to be learned is chunked to enhance long-term retention and recall by managing the quantity and organization of content dissemination. There are numerous methods for recoding information into easily remembered chunks (see https://theelearningcoach.com/elearning_design/how-to-organize-content/ ). Extraneous cognitive load, on the other hand, relates to the cognitive work invested in navigating the instructional design. Attending is a critical component of learning; students cannot recall what they do not notice. Therefore, ensuring that students are paying attention to the instruction is essential. Moreover, attending to critical components of a lecture or an assignment is necessary to preventing information overload. This requires faculty's ability to draw learners' attention to important ideas while ignoring extraneous material that may surround them. Furthermore, extraneous cognitive load encompasses the mental effort used by students to navigate and comprehend the various components of a lesson. Consequently, it is imperative for educators to meticulously structure each lesson, ensuring that instructions, activities, content delivery, and evaluation are presented in a manner that is readily comprehensible and executable for students. Lesson structure is an essential component of the MISSAL approach. Each lesson plan in this paradigm consists of two learning phases and five components (see Table 2 ). The activity instructions and scaffolding are explicit, succinct, direct, and written in language that is student friendly. Likewise, for content posted on the learning management system. Lesson structure enables the instructor to guide students through the material to be covered so that they are not overburdened and receive the necessary support for growth and success. Retrieval Practice Memory, comprehension, procedural knowledge, and deep learning all require practice. The frequency with which something is attended to often determines how long and effectively it is remembered in one’s long-term memory. It is essential to incorporate regular retrieval practice and rehearsal into the curriculum. Retrieval practice is useful for both teaching and learning. Restudying the same material is not as effective for long-term retention and persistent learning as actively recalling previously taught material. This empirical occurrence is referred to as retrieval practice or the "testing effect." Over the past century, studies have consistently found that retrieval practice has a large and positive effect on memory and learning. (For more details, see Yang et al. 2019 ; Pastötter and Bäuml 2014 ; Roediger III and Butler 2011; Roediger III and Karpicke 2006b). Recovery of knowledge helps memory and learning in two different ways. According to preliminary research, testing helps students remember material they have already learned. In other words, when compared to restudying, taking a test (i.e. retrieval practice) improves recall of studied material. The reverse testing effect is the term used to describe this. Further studies have discovered that retrieval practice has the potential to enhance the recall, comprehension, transferability, and integration of new, unlearned material as well. In other words, testing (retrieval practice) on previously learned material makes it easier to learn new material later on (i.e. forward testing effect). An important aspect of retrieval practice is the way it encourages active learning participation in memory retrieval and encoding. Rereading, reviewing, taking notes, underlining, studying beforehand, and lecturing, to mention a few, are traditional and often used learning techniques that are characterized by passive encoding and no active memory retrieval (Putnam et al., 2016 ; Morano, 2019 ). In the MISSAL approach retrieval practice is a potent catalyst for improving students’ long-term memory and developing their conceptual understanding. Therefore, in this model, students practice retrieval skills on a regular basis. This occurs both during the first phase of learning with diagnostic testing and throughout the intervening phase. Promotion of Learner-Centeredness As a learner-centered method, retrieval-based learning is a significant part of the MISSAL paradigm because it engages students and helps them retain their knowledge, which is required for comprehension, application, and higher-order thinking. The term "learner-centeredness" pertains to instructional approaches that facilitate active participation of learners in educational activities. Students are encouraged and expected to participate actively in their learning by asking questions, finding connections, participating in introspective and metacognitive reflection, and reporting on their progress in a learner-centered approach. Putting the learner at the center of the learning process, emphasizing active learning, and promoting a collaborative and supportive learning environment are among the key concepts of this strategy. Rather than just imparting information, the educator's responsibility in a learner-centered “classroom” is to function as a facilitator, guide, and coach. Active learning The concept of active learning holds major significance within the MISSAL method. Active learning places a greater emphasis on the cognitive, affective, and behavioral development of students rather than solely focusing on the acquisition of factual knowledge and the transmission of information. Students who receive an education dominated by lectures and other didactic teaching methods are likely to be primarily passive learners. The traditional learning environment in higher education, which underscores a constant lecture-style, limits student participation in their learning as well as how they learn. In active learning, students engage in discussions, simulations, research, critical thinking, and cooperative group exercises to develop higher-order thinking skills like analysis, evaluation, and synthesis. A few examples of instructional techniques that adhere to this learner-centered concept are inquiry-based learning, problem-based learning, experiential learning, cooperative learning, and service learning. The benefits of active learning (see Hacisalihoglu et al., 2018 ; McGreevy & Church, 2020 ; Joseph Lobo, 2017 ; Minhas et al., 2012 ; Steel, 2011 ) can be summed up as: promoting the development of higher-order thinking skills and adaptive performance, supporting self-directed learning, fostering students' interaction with each other and faculty, allowing students to think about and process information, encouraging students to connect academic content to practical use, and fostering a more positive attitude towards learning. The extant literature (Hacisalihoglu et al., 2018 ; McGreevy & Church, 2020 ; Joesph Lobo, 2017; Minhas et al., 2012: Richey, 2013 ; Sewagegn & Diale, 2019 ) suggests when learners are empowered using an appropriate teaching methodology, they experience learning gains in addition to a sense of confidence, capability, competence, and self-esteem, enabling them to face their learning as well as life's challenges with greater effectiveness. MISSAL is an active learning technique in which students actively participate throughout each course. Activities range from a brief participatory moment during an instructor-led/facilitated session to activities that are totally student-centered. Students are encouraged and expected to participate actively in their learning by, among other things, asking questions, making connections, engaging in introspective and metacognitive reflection, and reporting on their progress. Metacognition, Mindset, & Self-Regulated Learning From the perspective of MISSAL, active learning has a critical function in fostering academic and professional competence in students because it enables them to assume ownership of their learning process through engagement in both practical application and critical reflection. We learn about learning as we acquire factual, conceptual, and procedural knowledge. Metacognition is the understanding of our own cognitive processes; it consists of being aware of our thinking (cognitive monitoring) and controlling our thinking in relation to learning in addition to the learning methods used (cognitive regulation). Metacognition skills enable students to direct, monitor, assess, and alter their ongoing learning. Metacognition is linked to self-regulation or self-regulated learning. Self-regulation refers to the learning that results from a student's belief that he or she is capable of learning in ways that promote self-generated thoughts and behaviors that are systematically geared toward achieving their learning objectives. The goal of self-regulated learning is to assist students in defining their own learning goals, monitoring their own study habits, and making decisions and choices that contribute to the achievement of those goals. It requires self-awareness, the motivation to exert effort and to persist in the face of difficulty, the ability to limit anxiety about task difficulty, the operationalization of short- and long-term objectives and the setting of priorities among them, and the ability to deal with unexpected barriers and find solutions. Research and theory support the relationship between self-regulation and student achievement (Steel, 2011 ; Jensen et al., 2019; Xu et al., 2022 ). Certain forms of instructional practices have been found to be the most effective for promoting self-regulated learning, according to classroom-based research (Marulis & Palincsar, 2014 ). These practices include explicit teaching and modeling of self-regulation strategies, including explicit feedback that links increased performance with specific strategies employed (i.e., enhanced metacognitive awareness), and gradually decreasing the support provided by the teacher so that students begin to internalize or self-regulate their learning (i.e., gradual release of responsibility). MISSAL incorporates learning to learn into the curriculum to encourage students to pursue and persist in learning, to organize their own learning, to assess their progress and further learning requirements, and to refine their academic habits. Students receive examples and explanations of effective study strategies and the science of learning in a casual manner. At the conclusion of each lesson, they are encouraged to engage in self-reflection regarding their learning. MISSAL upholds rigorous educational standards and expectations for exceptional student performance to combat fixed mindset, enhance students' academic self-efficacy, and preclude potential stereotype threat and/or imposter syndrome. Scaffolding Scaffolding, also known as cognitive bootstrapping, is a crucial component of deep learning in general and self-regulated learning in particular. Scaffolding derives from the cognitive apprenticeship theory, which emphasizes the social context of learning and the interaction between experts and learners and has origins in Vygotsky's concept of the zone of proximal development (Margolis, 2020 ). As an instructional strategy, scaffolding focuses on providing learners with short-term assistance for difficult task components. The support may take the form of offering suggestions, providing direct assistance, adjusting the level of difficulty of tasks, highlighting crucial elements, providing prompts or cues, sustaining learners' interest, providing feedback, modeling, coaching, providing explanations, and utilizing structured groups/partnerships. It should be provided when students need support, which can make encoding of the new information easier. The precise nature of the scaffolds is determined by the target learning objective(s) in addition to the needs of students and should be removed once mastery is demonstrated. The structure of each lesson in MISSAL (see Table 2 ), which constitutes instructional scaffolding, provides students with learning support. They are provided with resources that contain information about a specific topic or facilitate the processing of to-be-acquired knowledge and skills. Table 2 Lesson Structure & Course Curriculum in MISSAL Phases of Learning Components for Learning Implementation in MISSAL Initial phase of learning • Learning target • Initial input • Diagnostic testing Students informed about the target learning outcome & success criteria. Students engage in independent learning of introductory knowledge. In the beginning of the class meeting, students participate in diagnostic testing (at least until midterm). Intervening phase of learning • Mental set • Intervening input • Scheduled practice • Formative assessment • Metacognitive reflection Students are presented with a brief activity or prompt that focuses the students' attention before the instructor-led/facilitated input begins. Micro instruction provided by the instructor to ensure students have the conceptual understanding necessary to engage in scheduled practice & formative assessment. Based on the input, students complete at least one practice exercise. An assessment of and for learning is administered. Students are encouraged to reflect on their learning. Materials & Methods The objective of this study was to assess the efficacy of the MISSAL approach in enhancing the retention and recall of acquired knowledge among students who are enrolled in a course that involves a substantial amount of content. Specifically, this study addresses the following question: To what extent can the MISSAL approach facilitate short- and long-term knowledge retention and recall of acquired learning, successful exam performance, and learning gains among students enrolled in a content-intensive course? Drawing upon the extant scholarly literature pertaining to the Scholarship of Teaching and Learning (SoTL) as well as the insights derived from neuroscience about the cognitive processes and brain development involved in learning, it is expected that the following outcomes would be observed: • Hypothesis 1 It is expected that students will achieve marginally higher scores on pre-test quizzes (i.e. diagnostic testing) compared to their performance on the midterm examination. • Hypothesis 2 There will be considerable improvement in students' performance on the final exam compared to their performance on the midterm assessment. • Hypothesis 3 It is expected that students will demonstrate moderate to high levels of learning gains by the conclusion of the course. Participants The sample for this research comprised undergraduate social work students who were enrolled in the lone section of a course called "Human Behavior and the Social Environment" at a four-year university in New York City. This university serves a diverse student population, including a significant number of first-generation college students as well as those from Black and Latinx backgrounds. The study was conducted during the spring semester of 2023. The present study obtained exempt clearance from the Institutional Review Board (IRB) of the university and followed all ethical rules pertaining to the handling of human participants. Research Design To address the research inquiries of this study, a repeated measures design was employed. A total of 14 students enrolled in the course, but two cases were excluded from the study due to incomplete data. The final sample size consisted of 12 students. Outcomes Assessments In this study, the instructor-of-record administered a brief, informal test of knowledge with immediate feedback one week after the initial learning phase. The effect of the MISSAL approach on short-term memory was examined by quizzing students on actual educational material seven days after independent study for each unit of learning. In the following class session, a 10-item multiple choice quiz representing the most essential content from the respective lessons was administered to students. Quizzes were developed by the instructor of record using the test bank for the required textbook for the course. Each correct response was worth 10 points; the maximum score for each quiz was 100%. Quizzes were administered to students in-class via a learning management system. Following the completion of the assessment, students were given computer-mediated feedback that included the original question as well as the correct response. Immediately thereafter, the instructor reviewed each assessment question with students to refine their critical thinking skills, dispel misconceptions, assist them in making connections to prior learning, and if necessary, provide additional information. Five data points were collected to measure short-term memory, and their sum was used as the pretest score in the analysis of learning gains. The following schedule of testing and data collection was used for this investigation: Week/Unit Intervention Testing & Data Collection Week #1 Week #1 Instructional Input (i.e. lecture, reading, activities, etc.) No retrieval-based testing Week #2 Week #2 Instructional Input (i.e. lecture, reading, activities, etc.) Quiz on week #1 content Week #3 Week #3 Instructional Input (i.e. lecture, reading, activities, etc.) Quiz on week #2 content Week #4 Week #4 Instructional Input (i.e. lecture, reading, activities, etc.) Quiz on week #3 content Week #5 Week #5 Instructional Input (i.e. lecture, reading, activities, etc.) Quiz on week #4 content Week #6 Week #6 Instructional Input (i.e. lecture, reading, activities, etc.) Quiz on week #5 content In addition, the efficacy of the MISSAL method on students’ long-term knowledge retention and recall of acquired learning at seven weeks and performance on high-stakes assessments (i.e. durable learning) was evaluated using a midterm exam. The midterm exam was administered to students in the classroom via a learning management system during week seven of the semester. The test consisted of 50 multiple choice items representing the most important information from the beginning of the course up until the date of the midterm examination. Each correct response was worth two points; the maximum score was 100%. Following the completion of the midterm exam, students were provided with computer-mediated feedback that included the original question as well as the correct response. In addition, the instructor had students complete a post-exam wrapper and encouraged independent post-exam review. A semi-cumulative final exam was also used to assess the effect of the MISSAL strategy on students’ long-term knowledge retention and recall of acquired learning at seven weeks and performance on high-stakes assessments in this study. The final consisted of 50 multiple choice items representing the most important information from the midterm to the end of the course. The final exam was administered in-class via the learning management system during week fifteen of the semester. Each correct response was worth two points; the maximum score for this assessment was 100%. Following the completion of the exam, students were given computer-mediated feedback that included the original question as well as the correct response. In addition, the instructor engaged students in a post-exam wrapper and encouraged them to conduct their own post-exam review. Statistical Methods Students’ raw quiz and exam scores were calculated by hand as well as by use of IBM Statistical Package for Social Science for Windows 26.0 for analysis, while the instructor of record determined the weighting of scores for the series of quizzes and high-stakes exams on final grading. However, educational scholars (Janes et al., 2020; Putnam et al., 2014), postulate that in the absence of a grade incentive, students may be disinclined to fully engage in testing; as a result, the instructor made quizzes and cumulative assessments worth at least 50% of the course grade. This arrangement is fair and acceptable because testing for assessment is an objective and direct measure of student learning as well as an essential component of higher education. There are several methods for measuring learning gains/retention and recall. According to scholars and statisticians, each has limitations. To overcome that problem, the four most popular calculations were used to analyze the proportion of knowledge that students remembered over the first half of the course; namely, normalized change (i.e., gain of averages and average of gains), normalized changed, and percent change. In this study, knowledge retention and recall of acquired learning was defined as the average increase or decrease in students’ mean pre-test quiz scores and mean midterm scores over the first seven weeks of the course. Normalized gain scores (Hake, 1998 ) were calculated for the cohort (i.e. gain of averages). Additionally, gain scores for each student was computed and then averaged for the entire cohort to measure their average learning gain (i.e. average of gains) from the beginning of the course of study and through the series of weekly unit quizzes to the midpoint in the semester, seven weeks later (i.e. academic growth). Hake ( 1998 ) defines normalized gain, denoted as , as the ratio of the pretest to posttest average gain. The formula below was used to calculate student academic growth, also known as learning gains/losses or academic progress. The following criteria were used to interpret : High gains > 0.7 Moderate gains 0.3–0.7 Low gains < 0.3 Marx and Cummings ( 2007 ) developed a metric known as normalized change scores, which serves as a student-level alternative to Hake's normalized gain measure. The symbol c is used to represent normalized change scores. The following equation was employed to compute normalized change scores for the given sample. The following criteria were used to interpret : High gains > 0.6 Moderate gains 0.3–0.6 Low gains < 0.3 The percent change formula, which measures the change from pre- to post-test and expresses the change as an increase or decrease, can also be used to assess learning gains. The following formula was used to calculate the variance in mean scores between pre- and post-tests. These metrics are concise, quick, and simple for faculty to use for classroom-based research as well as monitoring students' development and the effectiveness of a lesson plan. A minimal improvement threshold of 5% change is established to reflect the value set for students' performance. Finally, paired sample t-tests were performed to compare the mean quiz, midterm, and final exam scores. Learning gain scores and t-test analyses were utilized to investigate potential impacts of the MISSAL approach on students’ knowledge retention and recall of acquired learning in an information-dense course. Results A total of 12 learners successfully completed all the assessments. See Table 3 for a list of student-level mean quiz scores across each unit of learning. The average value of pre-test scores of cognitive knowledge for the pretest quizzes was 74.83. The average of the midterm exam scores for this sample was 77.67 (See Table 4 ). Table 3 Mean Quiz Scores across Each Unit of Learning N Range M SD Unit Quit #1 12 50 74.17 15.64 Unit Quiz #2 12 60 66.67 18.75 Unit Quiz #3 12 50 77.50 17.65 Unit Quiz #4 12 60 78.33 20.38 Unit Quiz #5 12 40 77.50 12.15 The observed value for the gain of averages, denoted as , was determined to be 0.12. Similarly, the average of gains, denoted as was found to be 0.05 (see Table 5 ). The normalized change, representing the relative change in value, denoted as c was calculated to be 0.14. The average final exam results were 90.67. Table 4 Mean Scores for Quizzing on Each Learning Unit & the Midterm Mean Quiz Score Mean Midterm Score 74.83 ( 9.85 ) 77.67 ( 6.76 ) A paired-samples t-test was used to examine the relationship between pretest quiz scores and midterm exam scores among students. Once more, the average value of the pre-test quiz scores was found to be 74.83, with a standard deviation of 9.85. Similarly, the average score on the midterm examination was determined to be 77.67, with a standard deviation of 6.76. There was no statistically significant difference in memory and test performance between the pretest quizzing and midterm assessments ( t (11) = -1.252, p > .05). See Table 4 ; there was slight improvement in test performance of 3 points, representing a percentage gain of 4%, when comparing diagnostic testing to the results of the midterm exam. Table 5 Changes in Learning Between Unit Quizzing and Midterm Student Midterm Exam Score (Posttest) Quiz Average Score (Pretest) Student Gain Score 1 70 74 -0.15 2 82 84 -0.13 3 74 78 -0.18 4 86 78 0.36 5 76 86 -0.71 6 80 80 -0.00 7 76 70 0.20 8 86 80 0.30 9 64 50 0.28 10 76 80 -0.20 11 86 74 0.46 12 76 64 0.33 Total Average Gain Score 0.05 A paired-samples t-test was conducted to compare the average score obtained in the midterm examination with the average score achieved in the final exam. The average score on the midterm assessment was 77.67 with a standard deviation of 6.76, while the average score on the final exam was 90.67 with a standard deviation of 7.15. The analysis revealed a substantial rise in performance from the midterm to the final exam in the course (t (11) = -8.100, p < .001). Students evidenced notable improvement of 13 points, representing a gain of 16.67%, when comparing the midterm results to those of the final exam (see Table 6 ). Table 6 Mean Scores for High-Stakes Testing with and without Quizzing on Each Learning Unit Midterm ( w/unit quizzing ) Final ( w/o unit quizzing ) 77.67 ( 6.76 ) 90.67 ( 7.15 ) Discussion Initial findings provide evidence for the prospective effectiveness of MISSAL in attaining exceptional academic results for students. It was anticipated that students would attain somewhat elevated scores on diagnostic testing in comparison to their performance on the midterm examination. Based on the evaluation of normalized gain, normalized change, and percent change scores, as well as the t-test statistic, it can be concluded that there was no statistically significant distinction in memory and test performance when comparing the pretest quizzing and midterm assessments. A marginal increase of 3 points was observed in test performance, indicating a relative improvement of 4% when comparing the diagnostic testing outcomes with those of the midterm examination. Moreover, a substantial enhancement in students' performance on the final examination relative to their performance on the midterm assessment was postulated. This hypothesis was confirmed. In conclusion, students were anticipated to have achieved substantial to moderate learning gains by the end of the course. The prediction was confirmed. The students' performance on the final examination was noticeably superior to that of the midterm. They demonstrated an increase of 13 points, which corresponds to a gain of 16.67%, when comparing their midterm scores to their final assessment scores. According to Bjork and Bjork's (2020) theory of metamemory and desirable difficulties, conditions of learning that cause performance to improve rapidly frequently fail to support long-term retention and transfer, whereas conditions that create challenges (i.e., difficulties) and slow the rate of apparent learning frequently optimize long-term retention and transfer. Based on the evaluation of quiz and high-stakes exam scores, it is evident that MISSAL holds promise in improving student retention and recall of acquired knowledge, as well as enhancing test performance and learning gains. The observed results in this study can be attributed to the active ingredients and theoretical framework underlying the intervention, which contribute to its effectiveness in improving student learning outcomes. Limitations and Future Research The outcomes of this initial investigation are particularly noteworthy considering the small sample size, which could preclude significant findings from being extrapolated. Nevertheless, the small sample size, non-experimental methodology, and cross-sectional design of this investigation hinder the applicability of the conclusions. MISSAL has potential to accomplish the national “completion agenda”. Additionally, it is expected to maintain high quality education and training and to achieve outstanding student learning outcomes. If instructors across an academic program adopt this method in every course from start to finish, our graduates may be able to function at a level that is currently unthinkable intellectually and professionally. The use of this paradigm is recommended. However, questions remain about the efficacy, efficiency, and amenability of this framework. It is imperative to conduct experimental investigations into the advantages of this approach in various authentic classroom settings. This research is necessary to determine the limitations of this strategy and to ascertain the specific circumstances in which students would derive the most benefits from the MISSAL approach. References Akpan, B. (2020). “Mastery Learning—Benjamin Bloom”. Science Education in Theory and Practice: An Introductory Guide to Learning Theory , 149-162. Bailey, E., Le Vin, A., Miller, L., Price, K., Sneddon, S., Stapleton, G., & Wolfe, L. (2022). “Bridging the transition to a new expertise in the scholarship of teaching and learning through a faculty learning community”. International Journal for Academic Development , 27 (3), 265-278. Bjork, R. A., & Bjork, E. L. (2020). “Desirable difficulties in theory and practice.” Journal of Applied research in Memory and Cognition , 9 (4), 475. Gervais, J. (2016). “The operational definition of competency‐based education”. The Journal of Competency‐Based Education , 1 (2), 98-106. Gruppen, L. D., Mangrulkar, R. S., & Kolars, J. C. (2012). “The promise of competency-based education in the health professions for improving global health”. Human Resources for Health , 10 (1), 1-7. Hacisalihoglu, G., Stephens, D., Johnson, L., & Edington, M. (2018). “The use of an active learning approach in a SCALE-UP learning space improves academic performance in undergraduate General Biology”. PloS one , 13 (5), e0197916. Hake, R. R. (1998). “Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses”. American Journal of Physics , 66 (1), 64-74. Haughney, K., Wakeman, S., & Hart, L. (2020). “Quality of feedback in higher education: A review of literature”. Education Sciences , 10 (3), 60. Jansen, R. S., Van Leeuwen, A., Janssen, J., Jak, S., & Kester, L. (2019). “Self-regulated learning partially mediates the effect of self-regulated learning interventions on achievement in higher education: A meta-analysis”. Educational Research Review , 28 , 100292. Joseph Lobo, G. (2017). “Active learning interventions and student perceptions”. Journal of Applied Research in Higher Education , 9 (3), 465-473. Kalyuga, S. (2011). “Informing: A cognitive load perspective”. Informing Science , 14 , 33. Margolis, A. A. (2020). “Zone of Proximal Development, Scaffolding and Teaching Practice”. Cultural-Historical Psychology , 16 (3). Marulis, L. M., & Palincsar, A. S. (2014). “Self-regulated learning”. In W. G. Scarlett (Ed). Classroom Management : An A-to-Z Guide . Thousand Oaks, CA: Sage Publications. Marx, J. D., & Cummings, K. (2007). “Normalized change”. American Journal of Physics , 75 (1), 87-91. McGreevy, K. M., & Church, F. C. (2020). “Active learning: Subtypes, intra-exam comparison, and student survey in an undergraduate biology course”. Education Sciences , 10 (7), 185. Minhas, P. S., Ghosh, A., & Swanzy, L. (2012). “The effects of passive and active learning on student preference and performance in an undergraduate basic science course”. Anatomical sciences education , 5 (4), 200-207. Morano, S. (2019). “Retrieval practice for retention and transfer”. TEACHING Exceptional Children , 51 (6), 436-444. Maurer, T. W. (2022). “Leveraging SoTL to improve teaching and learning during the COVID-19 pandemic”. International Journal for the Scholarship of Teaching and Learning , 16 (1), 3. Obama, B. (2009). Remarks of President Barack Obama — address to joint session of Congress . White House: President Barack Obama Press Office. October 28, 2023. Retrieved from https://www.whitehouse.gov/the-press-office/remarks-president-barack-obama-address-jointsession-congress. Owens, A., Daddow, A., Clarkson, G., & Nulty, D. (2021). “What Price Excellence in Learning and Teaching? Exploring the Costs and Benefits for Diverse Academic Staff Studying for a GCHE Supporting the SoTL”. Teaching and Learning Inquiry , 9 (1), 161-179. Pastötter, B., & Bäuml, K. H. T. (2014). “Retrieval practice enhances new learning: the forward effect of testing”. Frontiers in psychology , 286. Putnam, A. L., Nestojko, J. F., & Roediger, H. L. (2016). “Improving student learning: Two strategies to make it stick”. In From the Laboratory to the Classroom (pp. 94-116). Routledge. Richey, R. C. (Ed.). (2013). Encyclopedia of terminology for educational communications and technology . New York: Springer. Roediger, H. L., & Butler, A. C. (2011). “The critical role of retrieval practice in long-term retention”. Trends in cognitive sciences , 15 (1), 20-27. Roediger III, H. L., & Karpicke, J. D. (2006a). “Test-enhanced learning: Taking memory tests improves long-term retention”. Psychological science , 17 (3), 249-255. Sewagegn, A. A., & Diale, B. M. (2019). “Empowering learners using active learning in higher education institutions”. Active Learning-Beyond the Future , 118-414. Schnotz, W., & Kürschner, C. (2007). “A reconsideration of cognitive load Theory”. Educational psychology review , 19 , 469-508. Steel, N. M. (Ed.). (2011). Encyclopedia of the Sciences of Learning . Springer Science & Business Media. Sweller, J. (1994). “Cognitive load theory, learning difficulty, and instructional Design”. Learning and instruction , 4 (4), 295-312. Tierney, A. M., Aidulis, D., Park, J., & Clark, K. (2020). “Supporting SoTL Development through Communities of Practice”. Teaching & Learning Inquiry , 8 (2), 32-52. Xu, L., Duan, P., Padua, S. A., & Li, C. (2022). “The impact of self-regulated learning strategies on academic performance for online learning during COVID-19”. Frontiers in Psychology , 13 . Yang, B. W., Razo, J., & Persky, A. M. (2019). “Using testing as a learning tool. American Journal of pharmaceutical education , 83 (9). Additional Declarations The authors declare no competing interests. Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-4476383","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":306649469,"identity":"e5a54436-c57c-4e0c-8eb2-48dd7f46f988","order_by":0,"name":"Raquel Warley","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA+UlEQVRIiWNgGAWjYNCCAiBmB+IPQMzGTpQWAyBmZmBgnAHSwkyKFmYeBggDLzBvP7xN4oPBYXnzZuZj0ja/tsnzMTMwfviYg1uLzJm0MskZBocN5xxmS5PO7btt2MbMwCw5cxtuLRIMOWbSPAa3GWcw85hJ5/bcZgRqYWPmxaeF/42Z9B+D2/YzmPm/SVv23LYnrEUCaAuDwe1EoC1s0gw/bicSoeVZsWWPwf/kGcxsxpa9DbeT25gZm/H7hT95440fFWm2M9ibH9748ee27fz25oMfPuLRwgCJFDBgkWBsA9GMDXjVI2th/sDwh5DiUTAKRsEoGIkAAKVMR+ItHOjRAAAAAElFTkSuQmCC","orcid":"https://orcid.org/0009-0005-4127-1960","institution":"California State University, Dominguez Hills","correspondingAuthor":true,"prefix":"","firstName":"Raquel","middleName":"","lastName":"Warley","suffix":""}],"badges":[],"createdAt":"2024-05-25 10:27:32","currentVersionCode":1,"declarations":{"humanSubjects":true,"vertebrateSubjects":false,"conflictsOfInterestStatement":false,"humanSubjectEthicalGuidelines":true,"humanSubjectConsent":true,"humanSubjectClinicalTrial":false,"humanSubjectCaseReport":false,"vertebrateSubjectEthicalGuidelines":false},"doi":"10.21203/rs.3.rs-4476383/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-4476383/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":57400924,"identity":"474c3aba-3991-4856-8bf9-e12f9307ce54","added_by":"auto","created_at":"2024-05-30 08:12:28","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":678333,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-4476383/v1/ca2a1027-aa58-468b-9b27-520b9648a8d9.pdf"}],"financialInterests":"The authors declare no competing interests.","formattedTitle":"\u003cp\u003e\u003cstrong\u003eAn Innovative Teaching \u0026amp; Learning Paradigm to Enhance College Students’ Long-Term Memory \u0026amp; Learning Gains\u003c/strong\u003e\u003c/p\u003e","fulltext":[{"header":"Introduction","content":"\u003cp\u003eThe United States Department of Education is mandating greater accountability from the higher education sector. Colleges and universities are encouraged to develop a new paradigm for providing students with rigorous learning experiences and collecting evidence of their learning. This author has used a program development and intervention research model to develop and evaluate a complex paradigm of teaching and learning based on brain-based theory and neuroscience knowledge of how adult students learn since 2020. MISSAL (Meaningful Instruction, Self-Regulated, Social, and Active Learning) is the name of this learning intervention. MISSAL is in the third year of research and development. Based on preliminary findings this methodology has the potential to address student success and escalating problems with persistence, retention, engagement, and motivation to learn. This paradigm is driven by the desire to enhance higher education so that all students can and will learn through full participation, support, and rigorous learning experiences.\u003c/p\u003e\n\u003ch3\u003eMISSAL: Operational Framework\u003c/h3\u003e\n\u003cp\u003eMISSAL is a multifaceted educational intervention that encompasses a theoretical framework, instructional materials, educational activities, procedures, and processes that are hypothesized to have an impact on student learning outcomes. The absence of thoughtful contemplation or a detailed description of the active ingredients impedes complete understanding of what makes this intervention effective or ineffective in relation to student achievement. This also prevents other researchers and educators from replicating the practice and study of MISSAL or expanding upon it.\u003c/p\u003e\n\u003cp\u003eThe foundation of this paradigm is constructed upon existing academic literature related to the Scholarship of Teaching and Learning (SoTL), as well as the knowledge gained from neuroscience on the cognitive processes and brain development associated with learning. SoTL has the potential to strengthen the higher education system and fulfill the national \u0026quot;completion agenda\u0026quot; (Obama, \u003cspan class=\"CitationRef\"\u003e2009\u003c/span\u003e; Denning et al.) in a variety of ways. Most importantly, when instructional practices are founded on theory and research, it can enhance learning by employing more effective instructional methods (Tiernery, 2020; Owens, et al., \u003cspan class=\"CitationRef\"\u003e2021\u003c/span\u003e; Bailey et al., \u003cspan class=\"CitationRef\"\u003e2022\u003c/span\u003e; Maurer, \u003cspan class=\"CitationRef\"\u003e2022\u003c/span\u003e). Given that education is intended to be an evidence-based practice, it should be based on theory and/or research informed practice. The active ingredients of this framework, which comprise three instructional focus areas and 11 subcategories (see Table \u003cspan class=\"InternalRef\"\u003e1\u003c/span\u003e), can be summarized as follows:\u003c/p\u003e\n\u003cdiv class=\"gridtable\"\u003e\u0026nbsp;\u003ctable id=\"Tab1\" border=\"1\"\u003e\n \u003ccaption language=\"En\"\u003e\n \u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e\n \u003cdiv class=\"CaptionContent\"\u003e\n \u003cp\u003eActive Ingredients of the MISSAL Approach\u003c/p\u003e\n \u003c/div\u003e\n \u003c/caption\u003e\n \u003ccolgroup cols=\"3\"\u003e\u003c/colgroup\u003e\n \u003cthead\u003e\n \u003ctr\u003e\n \u003cth align=\"left\"\u003e\n \u003cp\u003eFocus Area\u003c/p\u003e\n \u003c/th\u003e\n \u003cth align=\"left\"\u003e\n \u003cp\u003eSubcategories\u003c/p\u003e\n \u003c/th\u003e\n \u003cth align=\"left\"\u003e\n \u003cp\u003eImplementation in MISSAL\u003c/p\u003e\n \u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003e\u003cstrong\u003eFocus on outcomes\u003c/strong\u003e\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003e\u0026bull; Student learning outcomes\u003c/p\u003e\n \u003cp\u003e\u0026bull; Constructive alignment\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eLearning target\u003c/p\u003e\n \u003cp\u003eLesson structure\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003e\u003cstrong\u003eEmphasis on mastery-learning\u003c/strong\u003e\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003e\u0026bull; Cognitive load\u003c/p\u003e\n \u003cp\u003e\u0026bull; Formative assessment\u003c/p\u003e\n \u003cp\u003e\u0026bull; Feeback\u003c/p\u003e\n \u003cp\u003e\u0026bull; Retrieval practice\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eInput\u003c/p\u003e\n \u003cp\u003eDiagnostic testing \u0026amp; practice\u003c/p\u003e\n \u003cp\u003eFormative assessment \u0026amp; metacognitive reflection\u003c/p\u003e\n \u003cp\u003eThroughout curriculum\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003e\u003cstrong\u003ePromotion of learner-centeredness\u003c/strong\u003e\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003e\u0026bull; Active learning\u003c/p\u003e\n \u003cp\u003e\u0026bull; Mindset\u003c/p\u003e\n \u003cp\u003e\u0026bull; Metacognition\u003c/p\u003e\n \u003cp\u003e\u0026bull; Self-regulated learning\u003c/p\u003e\n \u003cp\u003e\u0026bull; Scaffolding\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003ePreponderance of the lesson\u003c/p\u003e\n \u003cp\u003eCasual-style explanation \u0026amp; facilitation\u003c/p\u003e\n \u003cp\u003eMetacognitive reflection\u003c/p\u003e\n \u003cp\u003eInput/initial \u0026amp; intervening phases of learning\u003c/p\u003e\n \u003cp\u003eThroughout the curriculum\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n \u003c/table\u003e\n\u003c/div\u003e\n\u003ch3\u003eEmphasis on Outcomes\u003c/h3\u003e\n\u003cp\u003eOutcome-based education is an andragogical approach that focuses on the achievement of certain learning objectives. Advocates of outcome-based professional education argue that methods of instruction should prioritize the acquisition of skills that are considered vital by the community to foster the development of competent professionals among students (Gruppen et al., \u003cspan class=\"CitationRef\"\u003e2012\u003c/span\u003e; Gervais, \u003cspan class=\"CitationRef\"\u003e2016\u003c/span\u003e).\u003c/p\u003e\n\u003ch3\u003eStudent Learning Outcomes\u003c/h3\u003e\n\u003cp\u003eA clearly articulated understanding of what students are expected to know and be able to do when they complete an academic program or by the end of a unit of study is crucial to students\u0026rsquo; academic growth and success. The phrase \u0026quot;outcome-based education\u0026quot; was introduced by Benjamin Bloom to describe an instructional method that he initially formulated during the 1960s. Bloom\u0026apos;s \u0026quot;Mastery Learning\u0026quot; approach involves the segmentation of curriculum content into discrete and manageable parts, with students\u0026apos; advancement and readiness for graduation assessed based on their mastery of individual units of learning. According to Bloom, the most effective way to facilitate the development of mastery and higher-order skills is to include high-order tasks as learning objectives, provide practice in class and additional practice on assignments, and then assess students\u0026apos; ability to transfer knowledge to a variety of new contexts. According to Bloom\u0026apos;s mastery learning paradigm, it is necessary for students to attain a degree of mastery, such as scoring 90% on a knowledge test, in prerequisite/introductory content prior to progressing towards acquiring advanced knowledge.\u003c/p\u003e\n\u003cp\u003eThe assessment process begins with the formulation of appropriate student learning outcomes. Bloom\u0026apos;s \u003cem\u003eTaxonomy of Learning\u003c/em\u003e can be used to categorize educational learning objectives in accordance with the specificity and complexity of the target student learning outcome(s). Target learning outcomes should be succinct, easy to measure and analyze, and clearly communicated to students. In the MISSAL approach, student learning outcomes play a pivotal role in the development or revision of lesson plans, the selection of educational resources, the implementation of instructional approaches, and the evaluation of student learning.\u003c/p\u003e\n\u003cp\u003eEvery module in the MISSAL methodology consists of two phases of learning. Each module\u0026apos;s initial phase of learning begins with students being apprised of the module\u0026apos;s particular goals for learning. Outcomes are written in student-friendly language and describe what students will be able to do by the end of the course, in addition to the criteria for success. Typically, outcomes and assessment tasks pertain to authentic professional responsibilities. Bloom\u0026apos;s \u003cem\u003eTaxonomy of Learning\u003c/em\u003e is used to categorize educational learning objectives according to the specificity and complexity of the intended student learning outcome(s). Students are apprised of the learning objective via the course outline, the LMS system, and the instructor of record throughout the duration of the lesson.\u003c/p\u003e\n\u003cdiv id=\"Sec5\" class=\"Section2\"\u003e\n \u003ch2\u003eConstructive Alignment\u003c/h2\u003e\n \u003cp\u003eAlignment of the curriculum is essential for attaining student learning outcomes. There are two perspectives in curricular alignment. One is within the interaction between program structure and course structures, and the other is within the interaction between a specific lesson plan and student learning. To ensure that learning objectives become actual learning outcomes and thereby maximize students\u0026apos; learning, it is essential that the content, instructional strategies, learning activities, and assessment task(s) that are used contribute to their realization.\u003c/p\u003e\n \u003cp\u003eTo create a lesson that maximizes student learning, the MISSAL framework ensures that the content, learning activities, and formative assessments are all aligned with the desired student learning outcomes. For each unit of study, a curriculum blueprint agreed upon by the faculty is established. The blueprint is essential in the MISSAL approach, which places a premium on consistency and equity across faculty and students. The blueprint contains a topic overview, talking points, student learning outcomes, inputs, and itinerary.\u003c/p\u003e\n\u003c/div\u003e\n\u003cdiv id=\"Sec6\" class=\"Section2\"\u003e\n \u003ch2\u003eFormative Assessment\u003c/h2\u003e\n \u003cp\u003eAssessment, which can be addressed in a variety of ways, enables instructors and students to track progress toward achieving learning outcomes. Whenever possible, evaluations should be founded on authentic work duties and should reflect the relevance and complexity of performance in the discipline. Assessment methods and instruments should be valid and reliable. Qualitative and quantitative data, and multiple measurement techniques are essential. Both formative and summative decisions can be made using the same assessment data. Success criteria outline the necessary steps that learners must take to achieve the objectives of the given task or activity.\u003c/p\u003e\n \u003cp\u003eIn the MISSAL approach, evaluation data is collected frequently. Formative assessment and feedback are a combined strategy in which faculty monitor/observe student performance, provide corrective feedback, and adjust teaching and/or learning strategies to improve students\u0026rsquo; performance, as needed. Merely exposing students to information does not guarantee their retention. To ensure that students are retaining, comprehending, and generalizing new concepts, individual and collective student development is frequently assessed in a variety of ways and at various times. Formative assessment evaluates students\u0026apos; progress throughout the course and each module to identify areas for improvement. This is assessment for learning in addition to assessment of learning. By systematically utilizing formative assessment, faculty will gain a better understanding of students\u0026apos; learning needs and be able to hone their instruction.\u003c/p\u003e\n \u003cp\u003eIn both the initial and intervening learning phases, the MISSAL approach includes formative assessments, including diagnostic testing. Students take a diagnostic test at least until midterm to measure their conceptual understanding of introductory knowledge and to activate the testing effect, which research reveals has a substantial influence on brain development and long-term memory. Throughout the lesson, individual students and structured groups are assessed informally.\u003c/p\u003e\n\u003c/div\u003e\n\u003ch3\u003eFeedback\u003c/h3\u003e\n\u003cp\u003eIt is crucial to assess students\u0026apos; comprehension and provide them with consistent, clear feedback. Students can receive feedback from educators, peers, computer-assisted technology, and themselves. The purposes of feedback are to motivate students, inform them of their performance in learning, and demonstrate how they can further develop. To accomplish these objectives, feedback must be timely, explicit, centered on strategy rather than ability or effort, and proportional to the complexity of the task at hand (Haughney et al., \u003cspan class=\"CitationRef\"\u003e2020\u003c/span\u003e). In addition, timely feedback prevents students from wasting time practicing errors or operating under incorrect knowledge.\u003c/p\u003e\n\u003cp\u003eThroughout and upon completion of learning in the MISSAL model, learners receive feedback on their accomplishments. After completing diagnostic testing, for instance, students receive computer-mediated corrective feedback. Immediately thereafter, the instructor examines each assessment question with students to enhance their critical thinking skills, dispel misconceptions, assist them in making connections to prior learning, and, if necessary, provide additional information. Students also receive feedback via participation in metacognitive activities.\u003c/p\u003e\n\u003cdiv id=\"Sec8\" class=\"Section2\"\u003e\n \u003ch2\u003eMastery Learning \u0026amp; Focus on Abilities\u003c/h2\u003e\n \u003cp\u003eAccording to the principles of mastery learning, it is essential for students to attain a certain level of proficiency in foundational information before progressing to acquire further knowledge on subject matter (Akpan, \u003cspan class=\"CitationRef\"\u003e2020\u003c/span\u003e). Undoubtedly, education requires the delivery of an abundance of academic input; students should be engaged, inspired, and informed by it. Educational content should be both practical and practicable.\u003c/p\u003e\n\u003c/div\u003e\n\u003cdiv id=\"Sec9\" class=\"Section2\"\u003e\n \u003ch2\u003eManaging Cognitive Load\u003c/h2\u003e\n \u003cp\u003eThe nature of learning necessitates that students can retain, recall, apply, and then transfer newly acquired knowledge in a variety of contexts. Cognitive load theory and research on the topic have implications for teaching and learning in higher education. Sweller (\u003cspan class=\"CitationRef\"\u003e1994\u003c/span\u003e) defines cognitive load as the thought processes required for working memory to engage in learning activity. According to cognitive load theory, learning processes are a function of working memory activities with finite capacity and duration (Kalyuga, \u003cspan class=\"CitationRef\"\u003e2011\u003c/span\u003e). Memory becomes overloaded and limits learning when activities surpass working memory capacity. More specifically, cognitive load theory contends that instructional design must account for the constraints of the human cognitive architecture to prevent needlessly overloading a learner\u0026apos;s working memory (Schnotz \u0026amp; Kurschnere, 2007).\u003c/p\u003e\n \u003cp\u003eIntrinsic cognitive load refers to thinking processes focused on acquiring the knowledge and/or abilities at hand. Existing literature and instructor feedback indicate that students are less likely to achieve deep understanding of course information when they are overwhelmed with excessive reading and lecture notes. Furthermore, content-heavy, lecture-based instruction tends to turn students into passive learners. In both phases of learning, students are exposed to content (i.e. input). Initially, students undertake required reading, review videos, listen to podcasts, and etcetera on their own. Following that, they engage in instructor-led information dissemination and facilitation. The most important and distinct (memorable) components of content are included in the curriculum at each stage, as highly distinct material is remembered more readily and precisely. For instructor-led input, the content to be learned is chunked to enhance long-term retention and recall by managing the quantity and organization of content dissemination. There are numerous methods for recoding information into easily remembered chunks (see \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://theelearningcoach.com/elearning_design/how-to-organize-content/\u003c/span\u003e\u003c/span\u003e).\u003c/p\u003e\n \u003cp\u003eExtraneous cognitive load, on the other hand, relates to the cognitive work invested in navigating the instructional design. Attending is a critical component of learning; students cannot recall what they do not notice. Therefore, ensuring that students are paying attention to the instruction is essential. Moreover, attending to critical components of a lecture or an assignment is necessary to preventing information overload. This requires faculty\u0026apos;s ability to draw learners\u0026apos; attention to important ideas while ignoring extraneous material that may surround them. Furthermore, extraneous cognitive load encompasses the mental effort used by students to navigate and comprehend the various components of a lesson. Consequently, it is imperative for educators to meticulously structure each lesson, ensuring that instructions, activities, content delivery, and evaluation are presented in a manner that is readily comprehensible and executable for students.\u003c/p\u003e\n \u003cp\u003eLesson structure is an essential component of the MISSAL approach. Each lesson plan in this paradigm consists of two learning phases and five components (see Table\u0026nbsp;\u003cspan class=\"InternalRef\"\u003e2\u003c/span\u003e). The activity instructions and scaffolding are explicit, succinct, direct, and written in language that is student friendly. Likewise, for content posted on the learning management system. Lesson structure enables the instructor to guide students through the material to be covered so that they are not overburdened and receive the necessary support for growth and success.\u003c/p\u003e\n \u003cdiv id=\"Sec10\" class=\"Section3\"\u003e\n \u003ch2\u003eRetrieval Practice\u003c/h2\u003e\n \u003cp\u003eMemory, comprehension, procedural knowledge, and deep learning all require practice. The frequency with which something is attended to often determines how long and effectively it is remembered in one\u0026rsquo;s long-term memory. It is essential to incorporate regular retrieval practice and rehearsal into the curriculum. Retrieval practice is useful for both teaching and learning. Restudying the same material is not as effective for long-term retention and persistent learning as actively recalling previously taught material. This empirical occurrence is referred to as retrieval practice or the \u0026quot;testing effect.\u0026quot; Over the past century, studies have consistently found that retrieval practice has a large and positive effect on memory and learning. (For more details, see Yang et al. \u003cspan class=\"CitationRef\"\u003e2019\u003c/span\u003e; Past\u0026ouml;tter and B\u0026auml;uml \u003cspan class=\"CitationRef\"\u003e2014\u003c/span\u003e; Roediger III and Butler 2011; Roediger III and Karpicke 2006b).\u003c/p\u003e\n \u003cp\u003eRecovery of knowledge helps memory and learning in two different ways. According to preliminary research, testing helps students remember material they have already learned. In other words, when compared to restudying, taking a test (i.e. retrieval practice) improves recall of studied material. The reverse testing effect is the term used to describe this. Further studies have discovered that retrieval practice has the potential to enhance the recall, comprehension, transferability, and integration of new, unlearned material as well. In other words, testing (retrieval practice) on previously learned material makes it easier to learn new material later on (i.e. forward testing effect).\u003c/p\u003e\n \u003cp\u003eAn important aspect of retrieval practice is the way it encourages active learning participation in memory retrieval and encoding. Rereading, reviewing, taking notes, underlining, studying beforehand, and lecturing, to mention a few, are traditional and often used learning techniques that are characterized by passive encoding and no active memory retrieval (Putnam et al., \u003cspan class=\"CitationRef\"\u003e2016\u003c/span\u003e; Morano, \u003cspan class=\"CitationRef\"\u003e2019\u003c/span\u003e). In the MISSAL approach retrieval practice is a potent catalyst for improving students\u0026rsquo; long-term memory and developing their conceptual understanding. Therefore, in this model, students practice retrieval skills on a regular basis. This occurs both during the first phase of learning with diagnostic testing and throughout the intervening phase.\u003c/p\u003e\n \u003c/div\u003e\n\u003c/div\u003e\n\u003cdiv id=\"Sec11\" class=\"Section2\"\u003e\n \u003ch2\u003ePromotion of Learner-Centeredness\u003c/h2\u003e\n \u003cp\u003eAs a learner-centered method, retrieval-based learning is a significant part of the MISSAL paradigm because it engages students and helps them retain their knowledge, which is required for comprehension, application, and higher-order thinking. The term \u0026quot;learner-centeredness\u0026quot; pertains to instructional approaches that facilitate active participation of learners in educational activities. Students are encouraged and expected to participate actively in their learning by asking questions, finding connections, participating in introspective and metacognitive reflection, and reporting on their progress in a learner-centered approach. Putting the learner at the center of the learning process, emphasizing active learning, and promoting a collaborative and supportive learning environment are among the key concepts of this strategy. Rather than just imparting information, the educator\u0026apos;s responsibility in a learner-centered \u0026ldquo;classroom\u0026rdquo; is to function as a facilitator, guide, and coach.\u003c/p\u003e\n\u003c/div\u003e\n\u003cdiv id=\"Sec12\" class=\"Section2\"\u003e\n \u003ch2\u003eActive learning\u003c/h2\u003e\n \u003cp\u003eThe concept of active learning holds major significance within the MISSAL method. Active learning places a greater emphasis on the cognitive, affective, and behavioral development of students rather than solely focusing on the acquisition of factual knowledge and the transmission of information. Students who receive an education dominated by lectures and other didactic teaching methods are likely to be primarily passive learners. The traditional learning environment in higher education, which underscores a constant lecture-style, limits student participation in their learning as well as how they learn. In active learning, students engage in discussions, simulations, research, critical thinking, and cooperative group exercises to develop higher-order thinking skills like analysis, evaluation, and synthesis. A few examples of instructional techniques that adhere to this learner-centered concept are inquiry-based learning, problem-based learning, experiential learning, cooperative learning, and service learning.\u003c/p\u003e\n \u003cp\u003eThe benefits of active learning (see Hacisalihoglu et al., \u003cspan class=\"CitationRef\"\u003e2018\u003c/span\u003e; McGreevy \u0026amp; Church, \u003cspan class=\"CitationRef\"\u003e2020\u003c/span\u003e; Joseph Lobo, \u003cspan class=\"CitationRef\"\u003e2017\u003c/span\u003e; Minhas et al., \u003cspan class=\"CitationRef\"\u003e2012\u003c/span\u003e; Steel, \u003cspan class=\"CitationRef\"\u003e2011\u003c/span\u003e) can be summed up as: promoting the development of higher-order thinking skills and adaptive performance, supporting self-directed learning, fostering students\u0026apos; interaction with each other and faculty, allowing students to think about and process information, encouraging students to connect academic content to practical use, and fostering a more positive attitude towards learning. The extant literature (Hacisalihoglu et al., \u003cspan class=\"CitationRef\"\u003e2018\u003c/span\u003e; McGreevy \u0026amp; Church, \u003cspan class=\"CitationRef\"\u003e2020\u003c/span\u003e; Joesph Lobo, 2017; Minhas et al., 2012: Richey, \u003cspan class=\"CitationRef\"\u003e2013\u003c/span\u003e; Sewagegn \u0026amp; Diale, \u003cspan class=\"CitationRef\"\u003e2019\u003c/span\u003e) suggests when learners are empowered using an appropriate teaching methodology, they experience learning gains in addition to a sense of confidence, capability, competence, and self-esteem, enabling them to face their learning as well as life\u0026apos;s challenges with greater effectiveness.\u003c/p\u003e\n \u003cp\u003eMISSAL is an active learning technique in which students actively participate throughout each course. Activities range from a brief participatory moment during an instructor-led/facilitated session to activities that are totally student-centered. Students are encouraged and expected to participate actively in their learning by, among other things, asking questions, making connections, engaging in introspective and metacognitive reflection, and reporting on their progress.\u003c/p\u003e\n\u003c/div\u003e\n\u003cdiv id=\"Sec13\" class=\"Section2\"\u003e\n \u003ch2\u003eMetacognition, Mindset, \u0026amp; Self-Regulated Learning\u003c/h2\u003e\n \u003cp\u003eFrom the perspective of MISSAL, active learning has a critical function in fostering academic and professional competence in students because it enables them to assume ownership of their learning process through engagement in both practical application and critical reflection. We learn about learning as we acquire factual, conceptual, and procedural knowledge. Metacognition is the understanding of our own cognitive processes; it consists of being aware of our thinking (cognitive monitoring) and controlling our thinking in relation to learning in addition to the learning methods used (cognitive regulation). Metacognition skills enable students to direct, monitor, assess, and alter their ongoing learning. Metacognition is linked to self-regulation or self-regulated learning. Self-regulation refers to the learning that results from a student\u0026apos;s belief that he or she is capable of learning in ways that promote self-generated thoughts and behaviors that are systematically geared toward achieving their learning objectives. The goal of self-regulated learning is to assist students in defining their own learning goals, monitoring their own study habits, and making decisions and choices that contribute to the achievement of those goals. It requires self-awareness, the motivation to exert effort and to persist in the face of difficulty, the ability to limit anxiety about task difficulty, the operationalization of short- and long-term objectives and the setting of priorities among them, and the ability to deal with unexpected barriers and find solutions.\u003c/p\u003e\n \u003cp\u003eResearch and theory support the relationship between self-regulation and student achievement (Steel, \u003cspan class=\"CitationRef\"\u003e2011\u003c/span\u003e; Jensen et al., 2019; Xu et al., \u003cspan class=\"CitationRef\"\u003e2022\u003c/span\u003e). Certain forms of instructional practices have been found to be the most effective for promoting self-regulated learning, according to classroom-based research (Marulis \u0026amp; Palincsar, \u003cspan class=\"CitationRef\"\u003e2014\u003c/span\u003e). These practices include explicit teaching and modeling of self-regulation strategies, including explicit feedback that links increased performance with specific strategies employed (i.e., enhanced metacognitive awareness), and gradually decreasing the support provided by the teacher so that students begin to internalize or self-regulate their learning (i.e., gradual release of responsibility).\u003c/p\u003e\n \u003cp\u003eMISSAL incorporates learning to learn into the curriculum to encourage students to pursue and persist in learning, to organize their own learning, to assess their progress and further learning requirements, and to refine their academic habits. Students receive examples and explanations of effective study strategies and the science of learning in a casual manner. At the conclusion of each lesson, they are encouraged to engage in self-reflection regarding their learning. MISSAL upholds rigorous educational standards and expectations for exceptional student performance to combat fixed mindset, enhance students\u0026apos; academic self-efficacy, and preclude potential stereotype threat and/or imposter syndrome.\u003c/p\u003e\n\u003c/div\u003e\n\u003cdiv id=\"Sec14\" class=\"Section2\"\u003e\n \u003ch2\u003eScaffolding\u003c/h2\u003e\n \u003cp\u003eScaffolding, also known as cognitive bootstrapping, is a crucial component of deep learning in general and self-regulated learning in particular. Scaffolding derives from the cognitive apprenticeship theory, which emphasizes the social context of learning and the interaction between experts and learners and has origins in Vygotsky\u0026apos;s concept of the zone of proximal development (Margolis, \u003cspan class=\"CitationRef\"\u003e2020\u003c/span\u003e). As an instructional strategy, scaffolding focuses on providing learners with short-term assistance for difficult task components. The support may take the form of offering suggestions, providing direct assistance, adjusting the level of difficulty of tasks, highlighting crucial elements, providing prompts or cues, sustaining learners\u0026apos; interest, providing feedback, modeling, coaching, providing explanations, and utilizing structured groups/partnerships. It should be provided when students need support, which can make encoding of the new information easier. The precise nature of the scaffolds is determined by the target learning objective(s) in addition to the needs of students and should be removed once mastery is demonstrated.\u003c/p\u003e\n \u003cp\u003eThe structure of each lesson in MISSAL (see Table \u003cspan class=\"InternalRef\"\u003e2\u003c/span\u003e), which constitutes instructional scaffolding, provides students with learning support. They are provided with resources that contain information about a specific topic or facilitate the processing of to-be-acquired knowledge and skills.\u003c/p\u003e\n \u003cdiv class=\"gridtable\"\u003e\u0026nbsp;\u003ctable id=\"Tab2\" border=\"1\"\u003e\n \u003ccaption language=\"En\"\u003e\n \u003cdiv class=\"CaptionNumber\"\u003eTable 2\u003c/div\u003e\n \u003cdiv class=\"CaptionContent\"\u003e\n \u003cp\u003eLesson Structure \u0026amp; Course Curriculum in MISSAL\u003c/p\u003e\n \u003c/div\u003e\n \u003c/caption\u003e\n \u003ccolgroup cols=\"3\"\u003e\u003c/colgroup\u003e\n \u003cthead\u003e\n \u003ctr\u003e\n \u003cth align=\"left\"\u003e\n \u003cp\u003ePhases of Learning\u003c/p\u003e\n \u003c/th\u003e\n \u003cth align=\"left\"\u003e\n \u003cp\u003eComponents for Learning\u003c/p\u003e\n \u003c/th\u003e\n \u003cth align=\"left\"\u003e\n \u003cp\u003eImplementation in MISSAL\u003c/p\u003e\n \u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eInitial phase of learning\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003e\u0026bull; Learning target\u003c/p\u003e\n \u003cp\u003e\u0026bull; Initial input\u003c/p\u003e\n \u003cp\u003e\u0026bull; Diagnostic testing\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eStudents informed about the target learning outcome \u0026amp; success criteria.\u003c/p\u003e\n \u003cp\u003eStudents engage in independent learning of introductory knowledge.\u003c/p\u003e\n \u003cp\u003eIn the beginning of the class meeting, students participate in diagnostic testing (at least until midterm).\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eIntervening phase of learning\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003e\u0026bull; Mental set\u003c/p\u003e\n \u003cp\u003e\u0026bull; Intervening input\u003c/p\u003e\n \u003cp\u003e\u0026bull; Scheduled practice\u003c/p\u003e\n \u003cp\u003e\u0026bull; Formative assessment\u003c/p\u003e\n \u003cp\u003e\u0026bull; Metacognitive reflection\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eStudents are presented with a brief activity or prompt that focuses the students\u0026apos; attention before the instructor-led/facilitated input begins.\u003c/p\u003e\n \u003cp\u003eMicro instruction provided by the instructor to ensure students have the conceptual understanding necessary to engage in scheduled practice \u0026amp; formative assessment.\u003c/p\u003e\n \u003cp\u003eBased on the input, students complete at least one practice exercise.\u003c/p\u003e\n \u003cp\u003eAn assessment of and for learning is administered.\u003c/p\u003e\n \u003cp\u003eStudents are encouraged to reflect on their learning.\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n \u003c/table\u003e\n \u003c/div\u003e\n\u003c/div\u003e"},{"header":"Materials \u0026 Methods","content":"\u003cdiv class=\"Section2\"\u003e\n \u003cp\u003eThe objective of this study was to assess the efficacy of the MISSAL approach in enhancing the retention and recall of acquired knowledge among students who are enrolled in a course that involves a substantial amount of content. Specifically, this study addresses the following question: \u003cem\u003eTo what extent can the MISSAL approach facilitate short- and long-term knowledge retention and recall of acquired learning, successful exam performance, and learning gains among students enrolled in a content-intensive course?\u003c/em\u003e\u003c/p\u003e\n \u003cp\u003eDrawing upon the extant scholarly literature pertaining to the Scholarship of Teaching and Learning (SoTL) as well as the insights derived from neuroscience about the cognitive processes and brain development involved in learning, it is expected that the following outcomes would be observed:\u003c/p\u003e\n \u003cp\u003e\u003cstrong\u003e• Hypothesis 1\u003c/strong\u003e\u003c/p\u003e\n \u003cp\u003eIt is expected that students will achieve marginally higher scores on pre-test quizzes (i.e. diagnostic testing) compared to their performance on the midterm examination.\u003c/p\u003e\n \u003cp\u003e\u003cstrong\u003e• Hypothesis 2\u003c/strong\u003e\u003c/p\u003e\n \u003cp\u003eThere will be considerable improvement in students' performance on the final exam compared to their performance on the midterm assessment.\u003c/p\u003e\n \u003cp\u003e\u003cstrong\u003e• Hypothesis 3\u003c/strong\u003e\u003c/p\u003e\n \u003cp\u003eIt is expected that students will demonstrate moderate to high levels of learning gains by the conclusion of the course.\u003c/p\u003e\n\u003c/div\u003e\n\u003cdiv class=\"Section2\"\u003e\n \u003ch2\u003eParticipants\u003c/h2\u003e\n \u003cp\u003eThe sample for this research comprised undergraduate social work students who were enrolled in the lone section of a course called \"Human Behavior and the Social Environment\" at a four-year university in New York City. This university serves a diverse student population, including a significant number of first-generation college students as well as those from Black and Latinx backgrounds. The study was conducted during the spring semester of 2023. The present study obtained exempt clearance from the Institutional Review Board (IRB) of the university and followed all ethical rules pertaining to the handling of human participants.\u003c/p\u003e\n\u003c/div\u003e\n\u003cdiv class=\"Section2\"\u003e\n \u003ch2\u003eResearch Design\u003c/h2\u003e\n \u003cp\u003eTo address the research inquiries of this study, a repeated measures design was employed. A total of 14 students enrolled in the course, but two cases were excluded from the study due to incomplete data. The final sample size consisted of 12 students.\u003c/p\u003e\n\u003c/div\u003e\n\u003cdiv class=\"Section2\"\u003e\n \u003ch2\u003eOutcomes Assessments\u003c/h2\u003e\n \u003cp\u003eIn this study, the instructor-of-record administered a brief, informal test of knowledge with immediate feedback one week after the initial learning phase. The effect of the MISSAL approach on short-term memory was examined by quizzing students on actual educational material seven days after independent study for each unit of learning. In the following class session, a 10-item multiple choice quiz representing the most essential content from the respective lessons was administered to students.\u003c/p\u003e\n \u003cp\u003eQuizzes were developed by the instructor of record using the test bank for the required textbook for the course. Each correct response was worth 10 points; the maximum score for each quiz was 100%. Quizzes were administered to students in-class via a learning management system. Following the completion of the assessment, students were given computer-mediated feedback that included the original question as well as the correct response. Immediately thereafter, the instructor reviewed each assessment question with students to refine their critical thinking skills, dispel misconceptions, assist them in making connections to prior learning, and if necessary, provide additional information. Five data points were collected to measure short-term memory, and their sum was used as the pretest score in the analysis of learning gains. The following schedule of testing and data collection was used for this investigation:\u003c/p\u003e\n \u003cdiv class=\"gridtable\"\u003e\n \u003ctable border=\"1\"\u003e\n \u003cthead\u003e\n \u003ctr\u003e\n \u003cth align=\"left\"\u003e\n \u003cp\u003eWeek/Unit\u003c/p\u003e\n \u003c/th\u003e\n \u003cth align=\"left\"\u003e\n \u003cp\u003eIntervention\u003c/p\u003e\n \u003c/th\u003e\n \u003cth align=\"left\"\u003e\n \u003cp\u003eTesting \u0026amp; Data Collection\u003c/p\u003e\n \u003c/th\u003e\n \u003c/tr\u003e\n \u003c/thead\u003e\n \u003ctbody\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #1\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #1 Instructional Input (i.e. lecture,\u003c/p\u003e\n \u003cp\u003ereading, activities, etc.)\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eNo retrieval-based testing\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #2\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #2 Instructional Input (i.e. lecture,\u003c/p\u003e\n \u003cp\u003ereading, activities, etc.)\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eQuiz on week #1 content\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #3\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #3 Instructional Input (i.e. lecture,\u003c/p\u003e\n \u003cp\u003ereading, activities, etc.)\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eQuiz on week #2 content\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #4\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #4 Instructional Input (i.e. lecture,\u003c/p\u003e\n \u003cp\u003ereading, activities, etc.)\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eQuiz on week #3 content\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #5\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #5 Instructional Input (i.e. lecture,\u003c/p\u003e\n \u003cp\u003ereading, activities, etc.)\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eQuiz on week #4 content\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003ctr\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #6\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eWeek #6 Instructional Input (i.e. lecture,\u003c/p\u003e\n \u003cp\u003ereading, activities, etc.)\u003c/p\u003e\n \u003c/td\u003e\n \u003ctd align=\"left\"\u003e\n \u003cp\u003eQuiz on week #5 content\u003c/p\u003e\n \u003c/td\u003e\n \u003c/tr\u003e\n \u003c/tbody\u003e\n \u003c/table\u003e\n \u003c/div\u003e\n \u003cp\u003eIn addition, the efficacy of the MISSAL method on students’ long-term knowledge retention and recall of acquired learning at seven weeks and performance on high-stakes assessments (i.e. durable learning) was evaluated using a midterm exam. The midterm exam was administered to students in the classroom via a learning management system during week seven of the semester. The test consisted of 50 multiple choice items representing the most important information from the beginning of the course up until the date of the midterm examination. Each correct response was worth two points; the maximum score was 100%. Following the completion of the midterm exam, students were provided with computer-mediated feedback that included the original question as well as the correct response. In addition, the instructor had students complete a post-exam wrapper and encouraged independent post-exam review.\u003c/p\u003e\n \u003cp\u003eA semi-cumulative final exam was also used to assess the effect of the MISSAL strategy on students’ long-term knowledge retention and recall of acquired learning at seven weeks and performance on high-stakes assessments in this study. The final consisted of 50 multiple choice items representing the most important information from the midterm to the end of the course. The final exam was administered in-class via the learning management system during week fifteen of the semester. Each correct response was worth two points; the maximum score for this assessment was 100%. Following the completion of the exam, students were given computer-mediated feedback that included the original question as well as the correct response. In addition, the instructor engaged students in a post-exam wrapper and encouraged them to conduct their own post-exam review.\u003c/p\u003e\n\u003c/div\u003e\n\u003cdiv class=\"Section2\"\u003e\n \u003ch2\u003eStatistical Methods\u003c/h2\u003e\n \u003cp\u003eStudents’ raw quiz and exam scores were calculated by hand as well as by use of IBM \u003cem\u003eStatistical Package for Social Science\u003c/em\u003e for Windows 26.0 for analysis, while the instructor of record determined the weighting of scores for the series of quizzes and high-stakes exams on final grading. However, educational scholars (Janes et al., 2020; Putnam et al., 2014), postulate that in the absence of a grade incentive, students may be disinclined to fully engage in testing; as a result, the instructor made quizzes and cumulative assessments worth at least 50% of the course grade. This arrangement is fair and acceptable because testing for assessment is an objective and direct measure of student learning as well as an essential component of higher education.\u003c/p\u003e\n \u003cp\u003eThere are several methods for measuring learning gains/retention and recall. According to scholars and statisticians, each has limitations. To overcome that problem, the four most popular calculations were used to analyze the proportion of knowledge that students remembered over the first half of the course; namely, normalized change (i.e., gain of averages and average of gains), normalized changed, and percent change.\u003c/p\u003e\n \u003cp\u003eIn this study, knowledge retention and recall of acquired learning was defined as the average increase or decrease in students’ mean pre-test quiz scores and mean midterm scores over the first seven weeks of the course. Normalized gain scores (Hake, \u003cspan class=\"CitationRef\"\u003e1998\u003c/span\u003e) were calculated for the cohort (i.e. gain of averages). Additionally, gain scores for each student was computed and then averaged for the entire cohort to measure their average learning gain (i.e. average of gains) from the beginning of the course of study and through the series of weekly unit quizzes to the midpoint in the semester, seven weeks later (i.e. academic growth). Hake (\u003cspan class=\"CitationRef\"\u003e1998\u003c/span\u003e) defines normalized gain, denoted as \u0026lt; \u003cem\u003eg\u003c/em\u003e\u0026gt;, as the ratio of the pretest to posttest average gain. The formula below was used to calculate student academic growth, also known as learning gains/losses or academic progress.\u003c/p\u003e\n \u003cp\u003e\u003cimg src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAXkAAABMCAYAAACIw8eXAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAAJcEhZcwAADsMAAA7DAcdvqGQAAB1ASURBVHhe7d0HWFRX3sfx78DADL0XBQWpKvauUWNiojFF00w1ZpM3ZTdlN8nuZlN2042btkk0pmwSW4yx9y4oYkGMCCqKSJXOgPQy/b53YFAwJG/2XZEwns/zjMB/6p0Zf+fcc8+9VyHJEARBEGySnfWnIAiCYINEyAuCINgwEfKCIAg2TIS8IAiCDRMhLwiCYMNEyAuCINgwEfKCIAg2TIS8IAiCDRMhLwiCYMNEyAuCINgwEfKCIAg2TIS8IAiCDRMhLwiCYMNEyAuCINgwEfKCIAg2TIS8IAiCDRMhLwiCYMNEyAuCINgwEfKCIAg2TIS8IAiCDRMhLwiCYMNEyAuCINgwEfKCIAg2TIS8IAiCDRMhLwiCYMNEyAuCINgwEfK/BZIZo8mMJEnWwpUkYZKf22y+ws8tL3PnP6+EWX4Oy/MIwtVKhHxXkwxQ/SPrNh8jq6DWWryCpDxiNx3iSHK+HIlXivxM9Sls3XGU42cqrLXOUEji3sPs3ZuJyVoRhKuNCPkuZtI2krHmFbbmVlBmdLRWryCFK8W7lnE4No5Temutk0lmBXkbXmNHeiY5eidrtTO4U564laObV3Os0VoShKuMCPkuJaFrzGHx+kLCwgMI9O/MwLPSVVCryeFUibwG0cyPIQNNFFecY0t8jbXWmSQUpjyWbsjH28+bPqGu1npn8KBflB1GqZCV2ztzjUEQfrtEyHclQzGazO3saLyJyQN6E9aZeWdVknKAfVt2cbrRwVqBobdPxkldT0rsTnTWWqcx1VKduZZtNRMZFh3FYE9rvZNET76GQPmNTd6yji4YDBOELidCvgvVF2dzYsdWvK5/kFAv9+YPw2TU0VBdQXlxAZqqSopzssnOyCCvSENNY5uRZXMjFYUF5GVmkp2TQ3ZuGXUXhlsk9A3VVBTncy4/X75NFmU1OvS1J4nbtIHvl+8kvyhfrulp3u7ZcxrRvjqcStYTq2l5hM6iqynj2PpVuI69g9CeQdjLNbPJQGNtJRVF1mXOyyVHXuacghIqG4yWW6DX1lNVWkrF+XI0mlLys3LIKatrGWs31snv1zky0s+QmZ1HYUWjfA8r3wmEB/kQqPmBnfnyTa/w9mVB6GoKqWumdAg0kR6/hvl/+5rR327nzn4uuMmJV1N6msPb1hMXm4R22CSM2zaTJgeYw9Dp3DX7GR6fFoGDZKYmeysL3l7Dj9m51DuradL35bE5L3LXyGDcHOtI3bacDeviOGtyQXsylV6/X8Do0q/4MfEg28454xcQxNRnP+e5m0JwU9tRsuddvt8RT2LkF6x9PNz6Gi83HaUZe3nngdcYOG8Dd47qiZ+8QtFQmUtK3Ca2rdtFw7DrMO3bS0ZWOtqoCdwy+y88c1dvSn48wNYlG9D4BmJuqiV3Twq5173ItrenocxZz/z58vLGn8bOtzchE5/mvRenEebhiEJ+1sqU5Wxc8S9+6LmItb+PwU0l+jbC1UN827tK9VGy046RIt3BdVFOuFq6tDK1pKOuTsO2k6XsW6bhhtff5+W/TqdPbSxrvv+c5Sm1GEq28Pjz/6R+7Aze2pjAis9e57lJOXz16mzWnyilQbOf+P015PM4y7/+gC8+vJOSIgPRtz3NmIk30j9sII+9v5QXpvVuDniLHiNuIDxsGMXrF5Mnd487ZdJhfSaFqbtJ1N/OuAgPfK0jRg6SEUODhp2ZZexaVMCIJ17hpbd/xyjHFDYv/SeL9ldSXpJFenEWW1akU5hvz3WPTqKvSg1Fq3nurSxcRr3MwfR4lrxxG+fjPubV1SfJrWrZ7uAdPYyY0begWbuQ3Ea9mGkjXFVEyHeRLLkneiK+iL6P30oPR7vmHqeFqkcwwRF9CFU5cOufH2bMiOFMe/hpbho7Ac/CQo6cyaU4eRUFNePoFz6EgT7gEzWYcbfPJKyqnB2JBRSU1GM2neB00W52pksETHqcP0zpQ78ofxxVzrg7qHDz88NFZW1ZLNwHEBkcxXDNEX44XEGD4ZIVPMmAsSaT1NRjJKekcPz48Z9eThzlWEo6uflVHTYSxamnSVx5isjHbiXIQ31hmR19/Og1oB/B8p1ufuYBrhk/lskzH+GWaTPoWVJEcl4D0eNG4ufoQP9rhjLtmed54MGn+cejQzh/bCMVBeuI37eITxf8m+9Wx1FYXsjBvWc4X9PU8gTOfQgKG8UkuWFde7iEMmtZEK4GIuS7RDWZ50rJPA8jJ0bKPVlruZkTTq6uODsqCRsWjqeT/BEpI4kOCyPCw0hVdS1nDp/A7ByKj7ub9T6uePYawTBPJdWVtTR6jGDcMH/C2MwHcz9g7idH8O3tjbOTCoPJhEGy7ABlvesFzvTo6cfwiDISjpeh1V8S03Jv21ybweov5vPFJ5/y+Rdf8Pnnn1+8WP7+4H0+/noD21PKOvhi1VNYWsKxPD0jr43GyaFNA4MKZw931HYK+gwNw9vdcu9ehIX3o5+nmQatHZ5yo6RUKvEPCaTPoF64ewQQGeZI9t5cFOFDiRkzjsGRQxhx3Uxeef113p49ilCf1tlKKjx9gpgQU87hUyVU17XOLBIE2ydCvkuocQ1Q4RJooCKvFqm1S9vMiNFopEkOfoNBS+vOmi6OCrzcJZpMdui0EgpdOTpzm4ntZjV+zhKSZELv2FtuPGbw4G3j8atLYdlHX7JqbQqahiaMSjv5GRQXetFtNZoaKFNDT28nlHLgtqOwx07tS4CfP/5y4Pr6+uIn/7xwkf/29Zav8/eRA7ijqaCOOHmq8Qg1UZ5XI69ptG3ZTBgNeiwdbL1Bd6EBUtnb4SuHvFaSX7Neh04yy42U3NhYF9ukb6Jao6VJPYox197HTVOmc9e9D/LI7If43VgXuSExyfdpua3eKDcyKjMB8rKpHMTXXrh6iG97l1AzamQUo2KMbFq1i7p2QyMtAWz5YIxmOxTWT6hW28R5vR0ePl5EDYvGseYs+WXltM5sl8x1FOrM2KnUGDVZNLkPZfjsz/j47w8zY2gDP7y/kiMnCjCoHFEoFM2zaiRLoMq9+uZnl7JJzzzD1pwoZl0Xhot1rP4ChSNKvzH88Z33ePfDD5jzzju8c8llzqef8dEbTzBrUoj8eNb7XeBI337RTJuoZsuqHZxvaLvnlWWZFc0zbYxyoLd+K5t0jZTrFLi4qbCXe/H28m3sFHIDZ71eoXAmcIAL+sxUMpJPom2ummiqKmTDd5s5XViFfHdZCUV5yfyQFs7dEyII9Gy7FiEItu2S/8ndmaUXa7lY//wVWm7/H9zhMlJFTiJi6ATsM+bxY/nFHqeFg9yLVhlNFGaVobUkl/44Cbl5nFD48tjkvvQaMQM37ywSfjxJcral21tNdWkK6+rVXD82jDDlSXbG7WTlUT2Bo+/grX/eQa9QMzq9Xl5LsJN70XqqqjQUZZyWe/eG5g2R2vT95KVn4RD1JOMD5EjuqKv/n+jg/g5Bg4gaPxOnzE9JLq2j3lq3sKw4OMufRXF2GQ0NcsGcSUpuOnFaHx6ZGCqvWdihlFsme/nFyis6zRT2aoZMnEqw02HWbVrGV5tPUJJ/nIMrX+Htgx5yw+eMu3w73bkT5PyYgDn8Ka4JUuPy3y6bIHQj9m/IrL93b9rT7D+UR0E5hARZ/mv/X/I5sPsM+aUGevf26iiTOpkbKm0t6lPr2aK6jYlhnrg2J6uOqsIMEtbt4WjyNs4WpbNg3iKKpEhmPfUyN0e74eAVzfBAHQnbVrN9XxyHDhxk+3dxjH32Ux69vi891IVsW7OcVWvWobFsjP1iCeqpT3HnLcNxzzlG8sbVbDl4mP26gUwZ1QcftT2Ja9aQdLSK0X/+I2MDO6un6yQHtT1uxxezVXkTg3sH4OdsWWYDjZW5JKyWl/nodjIK0ljy7XKSzym5/4U5zIiuY+f811l7MJ3Ek3mUndfhGzGAUC8VTqExuNankZUivwdbNrF+SyIJmgm88+49jAz3wEF++PT9sexcfZyhf/sbE0IsQ1Etr0YQrgY2M09es+lR5p8dRMDIh3nmWi9r9ZdUsurV98iXenLjG39icBccNobaLE7t+pIHF0aydOEDDAq0bEitJnXvKt58cSGDnn6VqTG+6LUGXHx6ExURiof1dUqNGs6czUJTb0Bhp0Il2RM8cBhB7nJAm6o4J/f8CzW1OLm4YKhpxCtyKKGBrhg1OWSfzaaoyQnPPv0ZEu6D2nSIf/1tK8lFwby38g8EtzxF59CWUxT/IXfMD2LOP+/lxoHyaoNlo2z6Tp6b9S4Rj/6VKcNDcDQbsXP2p2/faLxVjZRmZ1BUpaNBb4eblx+9Qnrj69LSGDWUZ5OTV0jJ+SYkpStufuEMG9wDteVKYyqr5m9h8QY75u19hbCLo0GCcHWwhHz3ZpYvldKCx8dJf35/gbSzuKX6axz/5nnpH8/+SXp9a5W1cqU1SlW5cdLsQdOkZYk5UoW1dvLAQumecddKy881F/5jlnfkArPB+svPK1j3kvTys69If/k6y1rpTHrJUHVEenLkrdKXG5OkouaaTirN2SrdM3yE9M3JJvkduHw0ez6RPnrhKenh99OsFUG4unT/To1kwlS4lq1lMXLvbiiTeljrv8KgWybg3dOepK1bm2d2XHlOuPj2Y9akRuISsskq1IGhgHMZZzlfV8/h2ERS8+swtJuJ8n9rN/SkUFp/+Tn1xG/Lx8HVmyl3dtaerm05YO8Rw6zJBlJTczl2Rn7npTJy0tKo1mo5sieBY1k16C7L8Qf0JMXnU1mtYvpDMdaaIFxdun3ImwwNpK5dAn0nERIZw3806hJ4PREBzngWLye2lJbjuFxhDk6eXPuH+6kvqW0+Zk1p5hnOpmWh6BXEma1rSEorpLKxU/Y/tSpG4zyOiIjRXOttLXUyhdy4jX/iPkxaiZqSEmqKc0lLTMWuTx+yYjdxOPksJXU/mcj//1BMpSoGvz7XMS3QWhKEq0w3H5M30lRzktemPkbgi19x+7QRhHcwRbvdIirazxHXJH7FmrWL2RaxhLWPRaJStusHt/Nr3yrLFMX/L7O55WxJrQ9hlOyx7Dd06bR1W2J5Xy1nb2pdZpO8gmkvL7C9GDwXhP9a9w55XQkFiZ9x11Mw5/tnmDy0xyWrJnoy4r9i+a4iSqr1BPvbY/Yezfjx4xgXE4CzZbf+uuPs3biCFxbBys3vEOFs3/HqjSaWtz5czpb9Gbg6q6zFtswY9Wo8/Ybzj4VvMcRTDmfrNYIgCF2lW0+hrDl3kp3vLaHouse5e3IEvi4Xx58lk47zSW8x5185eA2azP1398Wl+jjfbTqA94DrGRDijZNlfp3KA6mujsLV6ykcOIX+Pd1x7mgY21hPTZMdXv69GRDTn+io6EsukURGRRHdfwgjR0biLq8RiI6oIAhdrRv35LXkHd3CnFlzCf5qO38Y449/mw62oamcnX+dwr8qfsdzr/2J6f2zSPz6bX73cQ1z1n7DtGhfXKwpXJN5kG2vPM7S8d+xYPZgwrw6SHmzAZ3e2Dxub2fXUXybLec8QlKocPqFPYkWLlyIRqPBwUH087ua3iCv3QUH89Csh6wVQbA93TjkDRSm7eBff3sDu9mr+fPNfejhdjFcDY0atv/lARa73sf9t49ngC6RDev2kGa8mY8W3Etgm6CuyNjND+89S9KENbx7Zz96e3SwM5C2kPTMYkoqmlDadxzilnfSwdGZviOG4ymvJXTUFLz00kucyz+HStXRkI9wJWm1WqKjo3nzjTetFUGwPd16TN5YmUHK6t/zyN4HWDRnJiPD25xLzqSlLukv3P9yAZFDgvHwcKewNoQnX32Mkb5yT/1CThdxdMcK/vh6LK+sWMf1oU4074R5qcLlvPr+Gjbtz8fNuaM5PBJGvQIv/wje/n4hQz2VYkxeEIQu181n19RTl7edG+75J09+uJQ7J8bQGvMmXT2p/76Zvy7tyzX33cUjj46ht5cHlw7E6HI3sWnFcj48/iC7lt6Mh2MHvXgLXSUlZdVUN+ix63Cqi+VAX0qUKndCQ/xQ/hczbARBEC6Xbh7yYGgoYfXTE4gd8Rm/u30qE4Mt4WrEfP4Ij01/kvpgHyob7Kir8mTwmJt57s3H6Ot6cQeBlDUfs+a7ONxeXMFfxrr+/HFN5LfJLJmbh2R+nvzccrhbpv8JgiD8FvxcpHUbSrU302bPpHDfKbJO5zXXKnNTWPLaF8Q8+zHPv/oBc//+J2aN86EpbReL40swtu5Bakrh5NlaTjeN5+5xrr88L1sObzs7e+ztf+nSMr+7K+h11kMz/gyDvu2hfTuZ1EBTZSZ7ErJp0l+OnZo6YsCszSc+9gzlrWeAEgThJ7p9yCvsHfCacD8Da45SkXWaUrlWV5FL/K5kIm+4gbGDRjJyzAxuG9uXYG0pDW32iS2Pj6WovBrfKbcRYemEW+u/HUbqSs6yd+1SNu86QEbrweMvqOTYgY38+6uP2Ry7no/mLyOltEmOv1YGGspS+feCD9myey3zvlzMhoQ0+V6dy1SeQcaez1lzuv4yHZ6gY2ZzHUmL/s3R9CKqrTVBENrr9iHfvAgOg7hngony4lxiT1Tj7utH+IhIcvclkJiawdmcU5zSKAkcOJ4ZI3ysvW09ibtzaNSrmfbgb/C4JpYzPFXnkXFiP9/M+5RFa2PJqLVe18xIftIOVqxax6bDZzh/Pp+kbUv5bk0c6aWNzbdoLEtn99rv+HbLEQorNGQkbWP9qtVsP1zQqSezLsxOY/eW3Sh7BWKn/JltHP81B3k1zgt/3X72HMkkvdhaFgShHRsI+RajH7kdpcqJrGPlePUZy6Mv3E/J5h9YvmQpn36ylGSdP0Oe/ztTAqFlBmQBRQzEv/cEpv0HBzW7UiST3IsvzKZMb6Te1Q1HNzUubafrGI/zxbxl5Bn78fT7X/HE7D+yZO5NpCz6lB0HTlJHDScPbWXeN8nc984Snnz4Tyz48BH6k8HyT74grdNOc5rFqdwCdhZfw+9vCGg+bWFnsVf6c8cfx3Py+ClSj2Vbq4IgtGUzIU/Qfcx59RFemx0h/6EmaMQ9vPvtZ3z60dvM/2Quf3/2XiaGObfctlkYT777e57+6zQ6OiNpV1MoVfjETOGW26YyvpcfXgZju9535eFN5FeqCAqNZJifpaLAqd9kBnk3cSq9lP0JCRSnn0DrOYxJ/Z1aPmif4YT1CUJVnc/2xJ+M/VwWDcd3kpN9GsW4/6GfSg5ia70zKOzs8LxmNr2qdlGUc4iWLTKCILRlOyGvsGveE7V1eqPC8re9vbXWcmk/q9GyIfXi7X+Tml+wGYMkYdlsevGVmsk9tY9qnQ8eHuH4NtfkOFX5MywYyio1HE4+TFFBPvaeI+kpt2ItYetFHz8XfB1rSDpbzOUfLTeSlJBHQaaSe+8eYX29Jspyj7Hty7l8OvcfvPfNl7w45UZuvukmnv94M6kl9ZgNpaTsWsvnL7/EN5tXMed/HuLu2a/z3o785scsO/Ilj95+M9dNmMAdT73P0viC5kdu/vraD+XB0Xoqys+y8YjOWhcEoZXthLzNMssxaZmD37Yx0lGWpafJ6IzK2cka4JbrnfH1VGAuLqE0tYLyMiVKDw+52tpAOODq6oiLsY6a08Xyo1xmdbEcSdehMY9l2oDWr5Y99vXFpKansGTlIeK3aYi5705G+FdyfMcClm/Zw4EzZRRlHWFHfAJLPzlEo1KL0tkRbXEuxRlxvPFZLVOfeJ53XptNuHSG1T8sY2naxTPEXnPzDByqqknbs6dTtzUIQnckQv43r224tzLSWOWAySwHqLJtf1wp/y3/q9eirzLT2OCAnaPUbsjEzjLNU45CRYO+fSCaGmioLiEvv4CioqKOL8UFFBZW0tjhdE2JzHU7KWpwwX/idQRZqxY+vQJROalwdPAg5pqp3PrwIzz53JMMoJy0wyc4Xa0kKCwAQ1MT3n2GMumBJ3j28ZncENrImfjFxB5Opd5eQumoxFiVxbEjh9iwN9f66HLTNXAGAx3lV3DiAHHl1qIgCM1EyHdLDrj7O+LgIPfa2+Wt3OOXk9ukUqH2U+PqqcSst1QvslwvKeyRXBzbNx+mSgrT9/HDwkWsWrXqp5eVP7By2VK+35pK4fmO5qVrSNiaidHFk6E3RVtrLRSeIQS4ezAgOohJs0fjY68maNhsJoaH4dqkQ6/yIHJgf7yUSiY9eivDJ97INcOjGBxoIjspGZ++RjKOHSR231kUvlFMGj+agZ5tv7phjA5R4WvMY8vR89aaIAgWIuS7AUsYK9pFtZqIUYG4uUjoG7TWmoWOujo5+O1c6dnPn5C+bhhr6pvH81vptCa0RkdUHur2h3iQe8q1ZQUkbd9OfHw88fv2tfxs/X3PXuK37ib2ZDHnmy7tyVtem5bzbnZy4yE3QC3FNnRoTSbqTUb0LbM7ZUoCvM14ethhMirQa5tokKtmnR6D9QVXFFVRku+P19TXeOOlN3n1tbl8/Nk3fD//77w5K4q2U/Cde0qoeuhoqr+CO30JQjcgQr4bUMsXyy5cbWPe3bU3an0+NfV5VDRX5C66oZSkfDk4w0PoH9MfN7nHbqpNxnLq2JahmfNkl9VSZPZmyJio9qdKtO/F8OkvsHr/PtasWcOa1atbfrb+vn4Da3fvYtsn9zM6zMt6p1aWZiiEe2+V6w1ZbN+e2VK+wLrOYNmQ3GYaqEJeIK18aZKXrHWtQmqzK5ejpwNO3jVUJJyhtvFiw1KVm8nRTevJklcoWpYrh60pFZytD+L+63+D82EFoQuJkP/Ns5N7uBJNjs6oXa0lme+YqXh51FNUkENWnaUix2TBMY6fN9E30p8J10/Av6/c2606RkqOuSVEdVnkFRXR6OrDTaOa51220XLYBgdHyzCQQ8cXy3VK+589FWHIDbPxd62jIPV7iqy1Vir5PlKTmcoLoyknWXFWA94+TB0ajJ3KGTe5qnZyR2VtCHwCQ4gZHEp91tfMWRxPVqXcU89Zx4qVi5mb4EGIc8usIcPJlWRpPHHtOZ1JPi33FQShRbc+M5Qtk0wGqnMOsX7pAjbG/UhuWRMGgys+AUH08HRE4RhAkFs9maeTid+fir7xHJ8v+A7X0Q9xz62T6Ofvi5urCmd9NstW75AzvJb1S5aRXufLpJn/w4whPX5yRM7/mioUKTOessJsikJnMjawtTWoI/vIUZL2JpFVcJrK6nxWfPkN5b4TuOvu2xjgkMOOpV+yMTGHnJI6VF7BBAf64O7jiZO8DJVnthOfdJrUw3Fs2ZNHpTqGGfdNZXAPyzqOkbjPPiHLri/D7pjJ8OC2e4wJgiBC/rdKMqOv15BXWI1/6AD6RUUTEuBHUGgIPTwsAy1KAkODcJZDrqm2GrWHJ3V6L+6Y9QijIryxnNnQycOX8F7eaM4VyIHpTlWjEwPHTmH6tLF4X/aEt1AQoNRQXFjBttN+3Ht9L+uqYi3HDxzidJaGwEH95eXwpLpRzZTpD3Lj6CjUDaVoNI149xtBbznYwyIjCfb3wsVRhYtvEMFeTjg5ueFk+TtwBBNvuJGZY/3lxzWD/kfmvXcC7yHjuePegVw6kCQIV7tuf6hhQSYZqKnV4uFhGfBoYflYFW32/qqrqUHt5oFDpw/Q5bFr6UbmfV3I3N0f0F/ubNtTysJ33mLfWSWz581jsqcczr9ipNDyzWy/A1t7klmPZucrPPFtL257aDqPzehjvUYQhFZiTN4WKBzaBbxF24C3cPO4EgFvEUrf0B5M9f+R9QfP09S8HVWPwmjCpNVTWg5G0y8kdxu/FPAWZkMdu76Jp9/UfsSMEwEvCB0RIS9cdr0HRjP2vnGsXXyQBkMFKRuWcCD5GAfTTvDta2+xPllzGQ5BrMPUcJa4vHFM6N+HIZduRxYEoZkYrhEuP7MObUM1uRUqIkNcaawspaKylnq9AqWjC94BPfB3d/jZWTq/jhnJ2ER+Ti0+vXxwdWo3IVQQBCsR8oIgCDZMDNcIgiDYMBHygiAINkyEvCAIgg0TIS8IgmCz4H8BJ/QbxDyxyWsAAAAASUVORK5CYII=\"\u003e\u003c/p\u003e\n \u003cp\u003eThe following criteria were used to interpret \u003cem\u003e\u0026lt; g\u003c/em\u003e\u0026gt;:\u003c/p\u003e\n \u003cp\u003eHigh gains \u0026gt; 0.7\u003c/p\u003e\n \u003cp\u003eModerate gains 0.3–0.7\u003c/p\u003e\n \u003cp\u003eLow gains \u0026lt; 0.3\u003c/p\u003e\n \u003cp\u003eMarx and Cummings (\u003cspan class=\"CitationRef\"\u003e2007\u003c/span\u003e) developed a metric known as normalized change scores, which serves as a student-level alternative to Hake's normalized gain measure. The symbol \u003cem\u003ec\u003c/em\u003e is used to represent normalized change scores. The following equation was employed to compute normalized change scores for the given sample.\u003c/p\u003e\n \u003cp\u003e\u003cimg src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZ4AAACHCAYAAAAm0j/oAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAAJcEhZcwAADsMAAA7DAcdvqGQAAEvtSURBVHhe7d0HYBRV4sfx77bspvdeSCeU0HsTQRALooICoqJ/ez/L6enp3al36tm7otgQpDfpvfeEAAkEEhJSIL237bv/t8milIBYKB7v480BM7uzszOz7/fezJsZhV1AkiRJki4QpfNPSZIkSbogZPBIkiRJF5QMHkmSJOmCksEjSZIkXVAyeCRJkqQLSgaPJEmSdEHJ4JEkSZIuKBk8kiRJ0gUlg0eSJEm6oGTwSJIkSReUDB5JkiTpgpLBI0mSJF1QMngkSZKkC0oGjyRJknRByeCRJEmSLigZPGfheFSR7bw/rciEUV/PsTKD89+SJEn/2+SD4E5htxpprGukoqIcq6s//v7++LgqnFNPZrdZMBn0GK0KFDYzZguota54eOhQ2q3oG/XYxVvNYrpG44Krqxq7xYjeJN5sNaN288RFn8W+3XuZuTuKFx7ojod4zXGnz1/MR+eKq06F1ajHZFdiMxhQubqhUqmwm40iKO0oXNxxc1GhaH2xJUmSLioZPCeyNVCavoTXH32PzeVudL39Ee658zr6ROmcLzhZQ+l+Ns38hrlZ7ng17WT3fiXth93JMy/cSqQhncnvz8biqyDjoIZ2va/ijts6wKFFfLFZjWv+DmJH/x9+xv2kfvsOP5RdycNPPsro/uF46FoaovUl6WL+34r5e+Cj30lKhoquoyZy59gOVKz4hkVlvlQtW0jCxLsICY/BsGM9tbYqzJ2f4Kkb2uLn8XOISZIkXSpU/xKcf7+8GQvYveZLHn11Fo19HuHlFx9g/IiuRPq5olG13nTQ0IS1IZPPtkXw1DOPM6ZLEdlVNSzfV0fi0Q/ZEvM0t1x3Lf01q9lVVMLCLAUJed+yPvAe7h8Vg5dvJJ5qPZ6BnhzwGMnTN8bh4/5zWGi1RszVB5i0PYqnn3uMm5ML2V9aza4Kf0ZEFPD+bD8ee/kBEm0pHMwtpSGiG939Cpj06WQShlxNZKC3WEZJkqRLizzH41SwYws/frSeY7b+PHj3NfTvnoC/jzuumjMfr1KoVCI8dPgmticiJpr2A7sTonJh35RUdiwoIig8kuBAN+L7dsSj3kLRtmr8Bw6nctq/eOnjTAqrXIiL8ETn5Y3W3Q9/Txfq0+bw3j8f486/vMfnM/fjEeLZPP+o6Gg6DOpGgMmFo+vzcAn1xqdLF7r27YTiqB2PRg3d+/eiU9+x/OuFv9E13A+tczklSZIuJTJ4mhWSsW8363PNJPYfydAEn3NcMTYU4oU+QQFoHG/QueLu54errwsuukqOVeqx2MR4Xz90Pl5YtT54hgxkzNXJ+FWvYeX2VLYerkdltaJUuzTPUSMCKDgsipioEAJ9tCiw4x0cgLp5/m64+fmi83bH3d0D39hw3LVaVMYqTFYjCp9wojsM5Ma+8TQZod5xLkmSJOkSI4PHoaqQ4toSigN9iGofhsJ6jqe9FCpsIljqsnZwJPcI+TuOYXbzYdjD/el6fQyHN6wl82AhBSmFWAN8RagFUZWWTrvbH+Pu/nVUVeaSdtSKytJE+eGt7MmqQJU4hNse+CsvPzWe0dcngdFK/SHH/PPIE/NXBHjT5Zo21OQdozI9g4ISKxGd/RHtKZbOWcn2zRtYtSmFfBF6ZkfoSeeHXaxcQyXlIt2NFuc4SZLOiQweB0MTZoMeV9Gs8HRXiTbGOVI5zqCoqU2dzbatS5iyXI/OFsZjowcTe8WrdM9ZSMqWH/ludT3+bvE8NtSLqqOr+GH+Vg7qe3F93x5c3Sseu92Cefdkflh+kPLaE5opJsfmUVKTMoutzfM34qNtw7i+XhzIKER9aCOZ+RUEXnEH7SP9yfrmWZ59+U1mlXage4QPAa33iZD+ADZDNce2zGV1Zi1VZ+oJb9VTV1NDZVVjS8tXkqRmslebULntMz79bBKr6pJ59N3vGR0jMuVcuiLrj1KePpentwzg5dviiQn2xGpXOt9rbw6UurpGXHSuaLXa5pS326wi5+qxKD3QadVoVKIQs1qxmk2otToUJ/aBbiqgdN98/rptAP++PYGoQA9sYv5K8RLHZnNsOYX4R8s7zJjNZgwGJR4e2pPnI/3BTJRnb+C1Cc8T8voCbh8QQXhrJ9RKF/LKa2tJrYjjpTfuokekl3OCJF3eZK82wVi8j9TUPWTp/el+1Sg6+rcU7r/EWJtH6vKv+XqKkc79komO8OTnvggiEBSq5sDRqNXOcBBjFUo0LlpcROKonO1NhVKElVpzWlgYanKb5//N92a6DEimTbgHaudLHK9tHlr+KYj5iRaYVoSZDB2wmGrITlnNws8+ZE1uLqtmzOC7l//FF8s3clSZRHKiPzrHRjYdJWXed7z40MvMWTubDz7aSL13NG1ig/BQ22mqPsii9//JpEVrmfL2e2zLM1BSXkDWlGeZd1RJxvq55BnCCImIIdRL1CJO5OaOqu4AWSlz+fKHZSzcUU1YnKigBLo6X3B2drue/IxNLJ38KSvS0lizdh0zX3iBD+b9SJYhlraJfqgb89gyfx4LZ8wlra6UBc/+jTc31uAamUT74Br2Lnqf++97kc+//ZYl+8E3LIq4IDfnJ0jSxSGDRzAW7SUlZTfZej96DLvxnIPHJtowCl04XTonERsfgreHrrkFc6LWQ+DEwDgzmwgThauYf5ckYuJCW+YvD46eE5u5kYoDG/hi/mrWbdATntiZvgOCMeasY/2ewyij+pAUUM2KWZOYuSmXbuOe4LrBPYgwbGftptWUKQJIjPOkZt8y/jPJnfseu5GhiXVkVnpQq4lmeGcdazfn0HXMQ4waPoBOkd5oj9cKjlO4ExAWT4fkZGIDVNQcWMjKNRtYtLsMq1sg8VG+nPVKK7uV+uwtfL9oJYtXlaP1SGDIqA6oCtazPvUApsBEXIwVZG9fztxlaaRnKOjQrpGj5rZ0ixat7cMZTJ5n5s6/TWRUnwB2r13DrjI7btHtSPSV13hJF48MHsFwLI1dKSkiePzp+QvB4zjEdTxMVBp3/ETBktgukkDf00Pn91K5OOaf0DJ/n98eOicu8+VCNCJRKSpZPG8j2qjBjJp4GzeN7EyIVs+ueaspihpGsnItq5fuJdvSh+f/djNJUTF0TrSxbf5i0qv88GkTSkDZet5bWMmQm69j0LAOeLqHEOgfQHJbd9bMXEuX+/7BNT3C8BFNXccx65PXsmjduvoQGB5Px7YxRIqWjkphoaQgk9ys/WTlVVJlUOPj593qnSYc1ROdtoZVSzfR6JLEVeMnMn5sH+KDlKTNX0GeexfadwzFoz6XbTuPEjX4Tu68cyDdknvTxraD7SvnsGBHI12vjENTU8jGlSvYXKjDL7IjV7X3dX6KJF148hyPULPzaz79fBJLKxN46M1vGZeoPus5noyMDAoKCtBoTjw81nLO5fTC57c5Pp/fM3+T2URiQiIJCQnOMZcTq1hZ+3l4yP0E3f0G48YOJkkL+sr9fHTjBLaM/JA7XT9n0zZ3GhMe4cuXuzjf18isR+5mZmUS3e+awP3B63n4ubcxxExg5FVD6SNan3Ft1DQUbOSJca/S/Y3ZTBgQQ+g5d+Ro4vDaT3nz4+ksTDOS0Gck9z38AGP7RKE7rWbh2Np5/Ou2R6hLuolbn7qPPh6O8RV8ft1IlrR9mL88fRVB++fw2uvLuPrLpdwZ39JjqHDJa0yeMp11mn6M6B2Huq6BsopKaty7c8WQ4dwxJMIxI0m6KGTwCL82eF577TXmzZ+Hp6enc8ylqba2lgcffJD777vfOeZyYsauT+Ouax4n5LZ/cvu4a0j2EsV+aSYLH72Vuf0/46ry90nZJ1oavZ/gyxf7Od8H654Zx7TyGGLueYG/96lh05eP897iIvame3P1nffyxLPD8a7cwANjX2XgG3O4fWC0aEk533wWNnMTdTV6Go5uYtIPi1myYT8R0bF0vOFpXhjTCQ/dqYe/HD/Ngzw7/inq4q7ntr88wqAAMR9LNUvuu5opoU9y770D8D8wk1ffXsuoj39kQjs1WtHyTv3wWb5elU/jhHf4dtwpIWMzYVa4nHA+UpIuMEfwXO6qd3xl/8/dvez9b5hgn3rQbLfYnBOkPzGT3da0wz7xit72ZyevsO+rbxnbUJxh/+7mZPvV7263/zjlCfsLt1xvH//QVHtpy2TBaF/25K32cRNesD//Y6HdXl9kL9Nb7OUZC+z/vu1qe9eI0fbHX5hhzy5aah/Vvbv9rVUF9iK9861nYTJU2Q9tnWJ/anB/e6+2CfYbH3zR/v3GPHu1xfmCVjl2xEz7s+NG2B/4x6f2DVUtY62mCvu8O3rar39hun1xbqE9ZdHb9lFXjLBPTtfbDc75Zc55wf7E9Vfar3lkhd3QMqpZ7pZ19q0rV9hzTM4RknQRyFPVDgrH0XRn9U/WAv+nuCsV1JYZ0Ddfa2OkqTyNz3LMjOgeQd9B1+ERqiCrYBNL9x5v+B/ix+JyzKFBDI4zcyx9EZM2NeKZNIq/v3sv110TRFVFIQ0GJY7rjI0KK41F+dRVllNrdc7iRPpjbJ/2Lg9dMZy7n/6IukF38/LUpXz2xvPc0icSn3M4L+gm9smmaiN1tS3/Vtak8FlWI53aRdAzJhSlSoOH2IddtD+fZ2yT1JnEOBV5aZ/x0rfbKG3QU7b9Ld6duZFZ+/2JlTfxky4i2blAaCpIZdeuXWQb/Ol61SiS/VXn1KvtdHbx38891kyNZlQuzpLAUa45J5w8Xkw49ayy9AewgaWEzXPXszttO3nHskjZsZZpc9YTf8Oz3D28M+EhMQR7Kmk4msbseT9yrKaEZe9/QmPkMG669TauTbBy7OAqXn3zGwwqG/sXzSbPFEzH629mYJiJvT/8wNa0HawvdMEnIpYu4adcp1O9ga8+e5/Jyw/T5srxTLjrDq4bNpAubcPx1WlQn9PFYpWkLd1CyvZtZOft41B2KpM+n07A4Ee59+aeKLIWMXvK9yxPLyU3vwKP8Hgig7xwDwlHpzZQlbmKFetT2b5uMTPXm4nsNYzxY/oQ5nkOiSdJ54kMHuHYzuVs3biFbHsUvh1GMDjaBdU5JI/VWM/RAzuYOWsHuqgIfDx1zd1jG8oL2DZ/EQXGStZvPIqrjxcBPq40luc395j6abyvGO99btd0SL9WS/AsmLYCTUwHuvTqQpvgYAIiOjL65tG0DXRU+VX4B4URGRyAp4crQaFiG3qEMvjam+jfORJXrQqF2gtPnZaIyFC0LoG06zWI/v27EeauJSAwEN+gSGI6dKdruzaEeLXcb+8nhjJK6zT4xPXjhltuZGByLIFerr/y3EoFq+etok4XQPLAfiRFhODuF89NN99Cl0hv7E2NqNxDSeo5gOTYCNq2TSDE29HyccUnIJQ24eGEhkQQLr5bXKehjBzRi+5R8joe6eKSnQuEgzNe4cuvJrNOPYirHv+M/wz3PKeu0VZDJQfWz+GZR1Zw38z3ubpHFJ76w+zZtJrJC6q4fkJXdolCw3vArVzVPwj7vpV8Ns85fu4qvPrfyNDhg+h4afdR+JOyiuzJ4J4hDxDz4LvceWs/ok7rNHZKa9Nx4z1HP2ynExqpYpoRu9Jx09azOOkN4i0Wo+PJgM29zH67XF4Y/wjGTmOZ+MxddDrHQ2RnbUjLVrZ0kclzPEJgm1B8w4JxExXW5Fj3E8ues1LpvGjTuRf9gj3xVCuaV2Zd+gYOpK6m6Ya/MKL/Nfz9VhMH83L46uOZ5Gas/2n8C2NN7D90gIWbyltmdgaO2+401VRQVlZBafFRCvMLOFZcjdFqbR5fUVVJkRhXVlZOjd5ATYUYV1ZMRZ0RU2vnHC4XdgO1ZWXYrRaKC46Re8zSnCsnObXwPWXDnzT1l0LH4dTZ/e7QMWNuKMdqMlFZWk7OERPmc7yB7VlzRYaOdJHJ4BFUasftZlpWhdJxiOacaXBxDyE4XBQGzppoWWE91Yct9I11c9S5UUb1Ql1pJn9jDpV5dvqJ8Y5PUEX1hBIb+iPFze87E4uhnN2z3+QfL7/HKy88wSMT7+aRv37O9vxiUma9yesffMpTd97Nm/99g6kbtvLVe5/y6etP8up3Gzl4rNE5l8uNjabaPJZ/8TV5CiVrZ09n1pQFpB7Vt0z+U7Bjs5ax+qtvOFTfyLaNa5n52ddsyK53TpekPy8ZPE7nVo9sjeWnNzvqkSaTgsZGx9+cAaZUYK/QYygxUW84dbwBW1WT+IeVmppqqqtPHKqoa9SLOq8X7Tv5k90QyaCJ7/LNR3dxTecc3piTT0I7N/btdmfoo29xx3VtYdcsCqL7ceWgBFKnP8/a1K3UtHzaZUaJq1ci1z3+MTPnLmb94i945ZFr6RDyZ7pdt2hBq0IYdPdrTJ72IxuXTeGjl26nT4w8Liv9+cngcfjtqSOIVSjyxDELx6BSKdBqbKiOH7YRNW6FpxKlhx0Xlf2nlpXjWT5Kbxfx72Nk757FS399hbfffpt33hHDu2/z75de5/0PZrC70vH8NyWBSQkEhkXh3z6JmIBIypZmg7sWv57JtO2RgLZOizlPxYABHYlOvpnX33ifm/p3E7F1eVIoNXj4+BMYGERwcAABPm64ufzZDjGpcPfyI6D5OwQS6OeBh/bP9h0k6XQyeH4nx5NDlUY17hqVKCbAN1CDT6SSnDJHsSFU5GEJcCe4exgBoXZySp0rveIItmAX1NGxhIYkceVVV9C/f3/69WsZBl05kD69kgl3d8SZDXdvb7SOQkclCiM/T3SRAXi4ueEVGoy7myeu9lqstnKqVcFExndlYJKvaH1ZONbg+DBJkqRLh+xOLbTcJDT1nG4SehJbIyWHtjL9h5W4d+tFRGwYwR5G6vW17NjVSHwbBdsXraU2qAcDr0wgyq2eLdsbfhpfF9iZHgMGkdwmjHYdk5rvqXZ8SGrfljgxP1+dBUvlXmYsL8RftJzcyvM4WNCAZ98+tK9fz8yVeiLaxJAYVEFJaQaLdjfhUp9H5qEC9K4hosbvi5e8WFCSpEuIbPH8DpbGOsqP7KUi2oOiokpqK/QoAgfQrscoepSsZnf6NlYf6cCAtgnc1H8I0Z1H0r3UOT63A1ckd+LauF/YBDaFaFW5Y8rbTnb6elalNlLbFM8DQwM4WmrBpzKTqpIilAmD6TZwOC67pvD5p5+wqDiciBAxyEs2JEm6xMjreIRfe5PQ4xxrzjE0n85xdHN1vOenppKZqtIGPIJ9OfmywjONPwNLI8b9X/Lk+m6MHZbMFb94O3srRqMCrVbWKSRJujTJ0ul3cFwO8dOlH46kOun4nAbfIJ9WwuVM41tntRjI3LeZtKmL2LO7mF/uTOt46qncrJIkXbpkCXUenenha7/moWwKjRvBvZ7mnTfHMrRXIHbDZd9AlSTpT04GzyVOqdISENeHfld2JSnWD1e1DB5Jkv7cZPA4iBbIpftYBCWa5mf5q1CrVeLvcpNJkvTnJksxwdG/4ngfC9nVQpIk6fySwSOYmwxYDEasInXqDRYZPpIkSeeRDB6hvKCI6uJSmowK9h42YJPJI0mSdN7I4BECI0PwDQ1Ep4GkKDeU8rbxkiRJ540MHkHr4YaLmysasTYCvFTycSWSJEnnkQwewXFgzeb4PxE4CsX5PMzm6MTg/KsknS/2X36mlLV5h794rJbL+SmFkgwehxN/g3/079HWSFlBNmlbtrFn9wHqf81z5iTpBDaL46mqhRxKT+FIpRHjSWW3qNSYKsnYs5W0vTvZmpLGvsNFNJ60P+s5lref1JRNpKWnsSU1k3K97fgToi4AK/raY6Tt2si+A7vZtHMPh4trMDqnSpcPeXdq4TffnfpcWHJY9PG/ee3lT9mUb6Pv6CEEOFpWzslSK2xmzDZF8x0e5GHP44zUl2Sybs53vPLCW9R0GEX7SG88nXcetxuryds1g7ueepdqcyWrFy9l9ZZsvDv2J9Ff07y/GfLX8MZbHzJt2Toamor5/J3vsMT1IS7MDw/N+V/RtrocNi35mgdf+hytt5FvPvyGgzUuBLdNJtJD1oEvJ3Jrn2+adox7YAI33NLPcXzj+BOypTMx6zEcWsbyfRWU1MvjkseZyo6Qn5XO/loDla46XLWi1vjTr7eBY9lr+etfp9D/L1/w2DMfMuPN+7iuTSkf/vWfZJodr8nktRc/4piuNw+/vYhXn3yaqf/owbx//p1VaVliDudbOeuXzOajr9MYKz7/Lw/9hyUfj8M1axmT3/+So85XSZcHGTwXQnAIPj5e2Gy25prneatbXirl9C+cyDrb5KbabD7620ccaVSi9mhZUzJ+RP3FL44O/Ydxw/AexNrszQ8ZPL5e7DV55KWsJc8QzeAekYS4i5ERXYhNiENblsnireWUbFvIoSIlETHx9IwV61UXQGTPoUTZCtmWWkB2ecu8/iinbmPr0Z1kp++n3iWB4b0DcRMtLF3HK4gLcqU65yBr95ucr5QuB/JQm/DHH2ozYyraxvsvv8vqLTvYuGEtG7YX4OIVx9Ab+mPM3cf2RcvIrChm79aNLP1hKWvr/OjTLgi1KZflk39g5rQZLN+yhZXrjuGb1IEwTyWNFbns27CKHdu2sLe0hE2ffMasZSvYX6XDOyCUQE+18/PPH6uliaLsNHYsXsCekmJS1q1n+Vdf8ePOfVSpY4iL9ETjWHn2WvK2r2LSfyezLnUdc+ZloPcIIyzCG1dR3THri9g1/2vmb9zF8plzOVCkp7axjOxZrzBlyzGys/dSZXM88jmMAPeT60eOMu33hbeJUse5juWLSM3OYve+vaz5fBJzNm6jyBJOVKQ3GlMZB7ZsZdu6DeQYa9n02ZfM3FODMrANsf4mjqXM4Y3XJjF/yVJ2FCrF+g8h1OfUe47bxX8/3YzpHLX+7RRKFQqVC7bGfJbN3UTk8LF0EsvpITZ5nSjUdy77gS2VI7jnrj6E6tRiDjr0JYfI3Z3Kbp+eJB77lDWZcXQaeBVDk4NFjVN8htrO0RWz2aZMIj4xjvZBohl1KnslmWuWMvndr8V2XM+cBQewB8YQEeaOxlBO1u4UNi9dSa6lnq3fTWH2piOU6wJJjjj5oeule2awZl0GJW7Xc8+tyTgeE6XAldqM9WTk1VAW1ofr23u3vFj6nyeDR/hjg8dCef5Ovvv2Gw7U+BIaFoKpPJPcrAp0QR25ckQyFTuXMXvaHNaklFKaf5iy8qPsbYjn1n5KFv3wJdv316L0DcVTXcfRPZvZU1xFeGIimpps1i+exXfztnAgT0mgh5HCA6vYlVlAnUsQUfEx+J3r8xZ+I7ulgWN7VvPVlJksFzVpvR5cLIUc3LOGXQVG/GKTiQmwcmDzPOYsWkeVIpLgUC2VGVvZl5uLxTOEhChX6rLX8c47+4ns2AbPhj2kl6goMfuQpNjPqsw6fMKjSUruQbuYMHzdTg4ehaGQlG2bWbhsPekiNNLS0k4ZdrN79z727DmKd0wUHqIgbn4M+XF2MxWZG5g+fQbz1+RQVqnA26Wa7D3L2ZFTi3tENC7GUvatns+M2WvZnWPCXryFjSWBxMX4EKDPZdoPaaiDffDXVrNt234KTK4Ex8cT6nbijiNCx1TO4fTtzFq4mn1nWta0PaTsPIJLUDA+3m6cufpgpLoki0ULttDmhOCpyklhy+LVHFDfwJ2j2+OjdXxbJYbiA+SkbGNHYzuSyhaTWt2drv370jvJ8UwnhWiVmChaP531JVG0b59Et5iTwwJ7FVuXz2Dx6l3UayIJClRTvncTe/MKcQkMEPunnoy1C/lh+hJ2HDJiOraD1GI16oC2XNU5yDmTFvlb57NxSwkNYddzx7Uxzu+ooS5zNXv2F1Pq3o3xA8Obx0r/++Shtj+aMYuMrQv4eEE1t7zwGk8/+Qgv3DOKAe0DMJiM4ueuwt1bRXVTLcXH1IQnD+b2J+5gTJdADIfn8O7kHbj2up6n//kUz774DE/dHsa+6e8xe0se9WpXlKJQOVZhx1XXkXGvvsoLz02krfkAW1atZNVBg3Mhzh+lUoN/oDuljUaqKjzoMHgsj739Mg/d3AP99hnM21pI/sHVLP9xCWvy/bj33b/y2GPP8eaLQ3DJWcSCuUvZcriMhoI9rMsNpOcVt3D/K09y7dAeREbE02/CgziKnyvv/ju339hLtC5UPx1S+oleBPWOlXz3/VRmzJzRyjCd6TNmMn3WOgrqjZzWcVchvkOAOzUmiwh9LRHthnPfW//mmXuuRpu5mEVrM8iusaF1s1JSWU99bSjDHribe8dcSTvFATYsmcmMjRZG/N+d/N+EEYSb9rFoyUrmbit2fsAJzOUc2b+RKVOntbKcLcNMMUydtpyDxTWiLfbLTq0TmfUKGirdUOhEI+aEiUqVSvzbjELMt6bYFYtC/PvEk4x2NRqtHZX4jraGVvqWFa0Qy7ec3Q1teOitZ3j8ied5/bm+GHZPFy2f9eytUuLmaae0upaqcj/6jRsv1scwBkSf/rBCfY0GfYMOlc5+UrCqNErURrHfltXTfCpKuizI4PmD1eekkpe2F7/IexgQ0tJRVR0VTUCbMKzmRtRuHrQfdAUhLlquGD+U6x/5P4YMvIGHxsVRsmsJuI+kfUgcHo43KnyJGXo3V/p4kZJWQqNvOPGR4fRMCOOWf40l1t2TxCFPcHWnngQ01FNYUd38eeeTQoRfSLduxCrVjLz3GgaP7Eigdzv6T3iGIR5uVFfWcmjXcuqrvYiIupG2zve5dr6NwYmdsBbXsi2rSYSvJ6E+03jv2xlsPBBAt249GNvPiwaDvvkheSajniZnjp7W+HRvy4gxD/LJRx/w7jvvtjK8w3vvvsGbbz9B91APTj+ApMIzsQvRrm5cdX1vrrt3AMG6UHpNeIHhwcE0lTWgDY+hQ+eORPl5MebVh7hi2F0ieHoQ71pByf5VqFy3Mkl8xivvzqXE6oa/2K7q2jrn/E+gjaDblbfz0fvvtbKcx4f/8t7HzzOkY3jLdv+VVGolLq5iLVkdh/Z+1nzzW8dBNW8dWg9V84/dftL1O3ZsjlR216LQnt7OKtqzkobGKNpEXE108xg73r0nMiQ6gaoj9eQbfejWvzehLi7c9JLYj0fdzYSbruK6gWHNrz6RRisCRmxY+6nLKJbHrlGj8BDL4Bwn/e+TwfMHKy+tISenBqWnGePxCyRsNqxiaC5CHb86q54GUSg0X8RnaX4FxqZGsvZVYlaK0lZz/KepEu/wJ87HLsoG8V6LGYPFQqOYl8Vga7noVRSrIX4KgsRgt1+IPnPiQ00GGsSfBrNoTTirqQqrjrgIC66uUHi4lvKKOpTuJ14h4keYu4YgnWj1eUQS3PUWnhnuRuG697nnpqf4cMo2jH5+OK7fbRSvPr4GWuXiR3h0O7p360rHjh1bGTqTnNyZrh2j8FQ71mFrjGI92tGLdWpxNjPsNh0xYVY83NXYzDaMJhNNYrzSauX49Y7F+yspqu5E0j2f8OnrH/D2B5OZOU+04ma+zD8ntGt50YnUXviHJdC9e7dWltMxJIuhK907xeDvCADn234Nn1BfEnr6iVaL+C4nBIvNYhebShTqbp60GxTYvA+Z9Se2/6yYm5TYRMGvdNy24xR5B6uoqW04YTs6ls6fSE8VAY6TNCK1zKIV3yhGKxz7uHNfbk24aPFHJHhgqTOd1AK1iIaWxSqW0VV9lkOM0v8aGTx/MI3Khit6RInWfBihZaRS/N1xKx7FT+eOWnr9/PwTVKl1RMb7oa0upK6p/ucp4g2Op2rXNtkwiYLEwS7GKU94vLVOvMCCjVpRm7xQHMuvcHwnZ2mhEC0gVxVUm1R4h/vhr9VjKjvKiW0AR/dfg/gOVTVi/Sh8GPDYbD7810OMiK9mzaSpfPLmKhrcWsJTgQblSSdmTlC5kslvP0D/QUMYcc2IVoarGT58BNdcM571BVWOrdGq5kdhiNaC4nheKzXiOyhotNpoEuvSsala6ueiRHWuWo2vTQRUNTX7qlErlGhEy1Wnc8WQd5Ds7Rs4cuqxsvpdrPz+aQYOHtrKcv48XHnFDczekfmLjzZ33EfQ0Spy7kbNXFw88Xbzwl67m1KzCMnmsU2UVtdwsNadjr3bEuLfBpemHGqaip1dp63YLeXsKoTAtrGER/g3jz1RaLQ/3opa9BXFzQHcQuyPYjs2mWw0iJqVqO44V81ZUkdwcw8UlQArptoMSsS/W6KsiuySJqo0gbTvGtM8Rro8yOBxaL5QseWn/HsvWPQLiSZKBEhN0Y/M3VHZMrK6nPqyQhEcjZRVi5JJ5YmHUomr1hXxv2aO4IntMUQUcPvYmpFDtrO0VJuPMK+kgYTEQNGycUMpapZKk52amuZMEo6yKq+EKhcPBrcPbH7PheA4stNUZ8PsLG/sDYeYlttEt8Qgeg+4Ek+xKDn5W1if3zLdsZwbysqp9fKiW7iZqqx1LD4aRYfBd/H6a+Po01nNwfQM6sxKUWsXxZgINXNVJab6aupPrCI7aKNI7jqUW8aM5sZRN7Y63HTTTYwafRMx3q7Nh+5aoxN7v6lRtHqc61phOMgM0VqLiAykU3wIao0WDxEuWnc3jh+JCotLIDrSTv7Ob/hkxcHmZTPkzuWLmcuZsl0U1qd+mDqY6LYDGTP65laX88ZRo5r/HD32VtqFBaBzvq11LmhFJaZW/E3j4YPWeQzRJTCSsORuonayk4xCi/NcSQmlx46QZ3XnmgFxxPYZjpvqKPlHCylsLvVFXJSkk1Jmo3NyFImRzh3xBJHJA/D0a+Rg7k62/HT6qoCVJZXYfD3p3DYUtc6tOQh1olWlO0vHFve4LgRFB9NYnkqGSJ7mgseczaFjZVh8/BnSI7j5ddLlQfZqExrzd7Br106y9IF0HDyKLoGq39yrzcXDU4SXniP7VrL1QCVFoia8efVyNmzPpdbiS0CIH7aCNSxZtp3cGlGvdw8lMiwIL1c1Ou8QTDWHSMs4zJGj1aLgzWTzjz+S4z+AiWNG0C1EQV5aCtvX7eGYKJCV9moxfSrbK73pfuUN3Dow5hcKrj+CKLWspWyeu5bMPFETNjaKkE1j8aJlFAUO5t7Rw0ShHS0KlRqO5e9nS1oBalUD+xd/z65aP7oPv4kxPbyoObSEVyZvxkMUYOaCnRypUeHTqR9XtHNl1w9zyKmtIafMgtYniOhQ75MPw6h9CYlIoEvXrnTp0uUsQzIB7i5nqF1VsmfZJvZl5FKlb8Bcf4Rls2dwUNuN28YMJ9qazboFs1m1q4A60ToLDA4lWAS/h5+3aClUcnjvStbvOUZJ7l7WrN1DiSaBroMG0j3KcQzqBGoPfILi6Nzq8v08dO3ehTBfj+bWbWusTZUUpK9iwbw5rEnNx+IiWiNegQT7eokWlwc6d1esVftZm5Ir5mEic+NS1qcdI6zfGO68thPePsGixXOEA1k55ObXoGjIZdYPs2iIGsa4G6+iY7D7aetJ6RWMwlhJ/pFMduw7JrZBDXsXTCHVFM2QkSPoG1THrkUzWLLhIJU2T3wCQkXLygNta19C44erxkR9yUHWpRSIFpqBdTOnkl7jQ4/hIpR7ixaZ86XS/z4ZPELjkfUieLaTZYggaeAN9Az97cHjOKbvHRROkKqaowVHyTtSQIVBi09Ie9o5rscJcsN89AANInCwq0SB4Ed4bBwhHmoUukC6xgZQffQwR8uKKK/WU1Vo4MZHX2J4ko9Ypnqydqeyc1s6Vk8FLi42dqYV0uvqOxhz3RUEX5BfbkvwrJq1hpL6OjRiOSqra8krVXDHYy8xKNYDpdKVqIhIglya2J+eRqNKQ05qLj2uvYubrulDqKcVfUMN6Tt3ovLQkZ+Rj2dMD668eRTtxTRraRHFpSVUeiSS2K4d7YNPKcxFK0SpVqPRaM4yiOkndvE6TSXblm4gp6AIlZcCo8nA3sxqxtz/PNd2D6Mxexf7Dx3F5B+NxqAnNLEjkYFeuLr64hsURKCqjsqKWsqKiylX9WPULdcxrt/JXYibOZZV9UvLKgbHIb+zLK6toZSsjFRSMwoJjOmAh9WMb1gbwkP98dKp0HkE0a2tN9vXrseqNLA/pxJtSBcm3j+ReMcFpbjStn0YdYU5HMk+SKPdzr7DBsY//jwD2/rhOIV4GtEyj28TjqetmoOZ6dQrVBxJzWPgrY9y87AuuJVnsCclA31ALCqxjoKiE4gKDcTTpdWZ4R8SSnQAbF2zXuSxhu17i0VFbwy33HglQfKWHpcVhf34M58vY5Vb3uKzSV+ypLoPE1/9hns7qRyH/v8AFix29UldXM+dFbPZLgqlE+v6Zcz+5F3mrCxkwmfTuCHYKH7PrVz0d15ZxP/SuXfEo4SOf5E7xl1DYvPJ5xNXmGOX+vlLmwwGXHQ/t8VOnGoz1WPWeJ5W8DlO5quPn+M5eXZ/kGxenPgUtVHDueOZx+jl7ThA9culX/O5rROX5bws2+9ho66qGrReeLmf4fuIFl5FkwVff5+Tr2/6BUaDEa3uj9jfzFSW1+DmHYirbOZclv6Q4vXPTqXxFzVoX1RKG56u9t99nudnvzV0HFSnhI6DCq1SiWjo0CDKSfsFDx0H8YVEDd5d/GExK2hyFLyn7UYnf+kTQ8fhxKlKl9NDx+Gn0HFoZfrvp8ZNtEbsIkcbm88hnVuV+7R947ws2++hxMtPtILOFDoOrh4E/MrQcfhjQsfBcS2YDJ3LmQweB1Ga/HRjk0uuIDlOz/6VU1m9Zg2bDx1k0nOvMGtbUXPvogvHjrExl4XvvsPuykpmfTmJLz5eQGrhmfqNXYrsotVSyvqvPmB7Tg5LFi3k89e+Yt2hVq7BkSTpvLikDrVZKg6wcf0ONu8rI8CnkoPakTw8rgdJ/if0uBFVVHvxBl79fBk5hVVoXU5tFTjYMBnciGrbm/97bgJtRNXubHlSs2syn33+GYvL2vLAa1O4rYNoqVxykWylsjCL/KMllDcp0Lh4E5nQluhAVzRnOiN9HljN9RQezKCgyiBCT41vcCTRMZEEe/7a+vPFZODYoQzyy+qpM6jw8AmmTXwskb7yRIMkXQiXTPDU7p/KrCWHOaKPoENbF7SlK3h8aiCfff0s1yWH/dyrSQSPrWgdr325iryiWnTa1goLCwaDO5GJfbjnmVsIF+Xy2YrmIz++wUcffkOq6xU8++kXjIjgjL2LJEmSpN/n4geP3Ya1IZcfXpnAwqK+DLrjBR4fEQSlq3nqP7sZ/did9EwIOaGrpR27qZ7y6ibHHUJQKVtrmljFNNFqcfHA39f17McTm7KZ+uqLTF9VSMDwh3jllTuIEiknc0eSJOn8uOjBY7cYKN/wIuP/lcdVDz/Fo+P74emc1joRPOYGKmv0mC1Wjl/4eSrHPaA0Wi3efn6c9nBFEXZmg5hHfSOHfnyNrxalUh19M3fe/wS3dJCHWyRJks6nix48NnMTWdNu4eEF/bnzwQncNaJNywSxWPbmk/6nsBkxZX3Onc8vYF92Fa661s7x2DE02mnXczCvfPMeSaqTe1HYmirIXDeFe16dTnV1Ddf83wvcfcftdA6ToSNJknS+XQLB08jB72/ioc/7ct9L93H7yAhsDRWkLp5DQ9876BHuzknPNxOtFeoLSMsqoa7JjKrVKz3tWO0avHyD6dAx5rQrom2NZRxY/RUP/n0KR+v1XP/wqzx8zx20D3C+QJIkSTpvLv6hNquJut0fcfdTKyh3a0Nyoh8hWgX+PW7i5uu6EyxS57RzNDZr8114z7rojivGxaBqpZeA3WqmqbqI7LwSDq78hCV7ylEnj2XC7RO5Kqb1Q3eSJEnSH+OS6Fxgb8hn9eqN7C90PIBFSVigP9F9rqNXzPm/QNJatp1PX3mFBalm2t78JC8/fS0BIulk/EiSJJ0fFz94LgGHZr/CRx98z36/Yfz9y0+5Mujidae222yisXbWfniSJEl/arKEE4KigglL8MBkr6GozNJ8P64Ly47VWEt+TgZZhzNJP5RDQVntOT0GWZIk6c9GBo9gNtian4RoUyjQ/8IDrc4LYwW5279n9Li7+XbOFzz31BM8//pktpc6p0uXJvvxp8BKkvRryOARKgpLqCkuQ29WcCDfcPZOC3+4eg6lLeefL89l8HPf8PAjbzHzv+PpYNvLR/94kzzxClm2XYLMekw5q1iRUUlZg9xCkvRryOARbBYLdqsVmw30RtuFLeirDpKTuoXcxjCGD0wixNsFz479iY8KoOnwHlbs0V+EQ3+XiV9YsWeb3FSdzRf/+IQjTRrUjlt1C3+azST3J+kikw+CE8wle0nPPMARexh9R9xM/yjNBetcUH14LVtWLmNP0wgeuKc3fuKDFbjRkL+HQ+mHyA4awI2dfMXyyH52v4bV0kTpkf3sWbuSzMpy9m3ZwvpZs1mTnkWdJoo2oW7OdVpHwa6NTJ80k60Z21i6IguLVxjBwR5oRbXMpC9h34pZrNi5j/U/LiOn0kpDYxFZ89/iK/Ha/JI8mlQhhAQG4uN6cj3OUb7/nq1mt5uoOJpF+oY1ZBTmk5GRweZpP7Bs1x7Kxb4aEeaB0lBOdkoqaTt3UWCsY+fU6Sw+2IhLYATh3gaK9i7l009/YOW6DewrUeMTEEiAp7xQWrq4ZPA4VGeyZ38GOXp/ho66hU7+it/+BNJfqXT/Ojav3Eme+01MHJ2Ie/MHq9Dn7yIzLZ0MVQ8mXNkGzYVaoP8RNlMd+akr+GryFFaklFNZWkP90TR27VrHnhIloQntifKzkbVjEQsXreJQEah1erK3beZgSQUav3DiwjVUZ2/gw7e24BLijenIBtJKXKgwuBBas5lVOSa0bm5EJHQlMTocf/eTg0dhLCZjbxobtqaQnZ3FwUMHTxsyM7PIyi7HMzwUdxfVyYcg7EZKMtbxw3ffs2D9YQqLmrCUZ5KyYxkpBRb8osV+0VRIytK5zJi1it15emr2LWFpvh/x8QEEGnKZPWMzxfomrA1H2Lg9h0qVNxHx0QRcjEc5SZKTPNQmOJ5o4zhJ7KgAK5XiXxewjDfWq2iockPpZj/pUWQqjQqN1YiisBqTPDbyq6mUany9NeTVGSjIVtP+ytt55pPXeOjaeMrWT2bG5mMczV7D3JmzWZ7nwSNfvc5LL73BJ//oiyH1G2bMWcKOI8XU5KSy4nAiN4x5gL+9/wxD+3ckMLwDg//vKSLFDnPN429z/9h+JASqT99KDdmsXTKVf7/2Bu+8804rw1u8/fZ7vPv+LLJrDTiegXoihUKDn49GBIeR3Bw7IXHDefSzd3n2jr6YUqcxZ1U6hypMIjEbySuqofiIF8MfvoM7ru9PnCWNFQvmMW2zJ/e/+k9eee5OYs2pzFm4nDk7ZK8V6eKSweNwYolxgct4pUohQkYknci7kxbDcWcGlQqFl05ezPobKFzciezdkwSlitGP3cSQkZ0JC+rO4Il/Y4hOR2l5FYd2LqK+NpDIyJtp53yfd9+7GBLfgab8KrYebMTNQ42327e89d0C9pYkMmRgX8b1c6fRaMDxXFWzyYDIhWanbSePJEaOe5hPP/6Q9959r9Xh/fff4L9vPUG3YDdOa4QoRHh27EGsVse1t1zByPsHE+4ZzaD7/sXV/gHUFNfjFp1AcudkYoN8Gf/WXxh6zcM8ObEf8S4llB5YhMW6hNdfeo6n//ktufV2lCY7xtIq5wdI0sUhg+ciC4j2JaazF9Y6S3PL6zibxfFoaRV2repXP6JYcnDcxdxEo92O2SrajM6Vq1a4kxBhQeeiIC+zkorKBlSeJ0ZGEFGeLgRoDdg9Y4jsPoYnB9vIWPQaE65/hsnz9oJ/kJi9nUbx6hO32Wm0QcQkdqF/v7706NGjlaEXPXv2pk/3OLzUopLhfNvJTOjFZxnFDnH8O9htnsSHW3F3VWMz2zFZzDSJ1pdaDMc7RBSlV1Bc14UO93/CJ/9+h9ff/YKZ85aybda/+Pu44zErSReHDJ6LzNXVV9SodVhr91FmdTxJyKGRY5X1FBi9SOoWh7b5JLj0q4lSuHl9akSh7kxvpUqDh8ZOtVmJV4g33soGTJXFNLVMFpSOl2My26iqMYAujKue+J7/Pj2O7t75LPp4Gl9/sYkmN01zC9VxOEw0qlpXuZpvPniS6264iVvH3trqMGbMrYy/7SG2FdfhbDidwt5yrZBa6WgAtRCf6aERe4nVhl4Mjr1DxKz4U9RWnMGj8rRgMdXTlGvBTeeGl7cPfn7+uJTniVDaQeGpx/Uk6QKSwXOR6UJjCUlIwFy1g4wi50iOUlh0lFKlN8P7x8gebb+DTqy6pgYRQM7WguOhg/PyDXSOC6Rbv0F4+pnIydvB1p9OexSxubySRi8v2gfoqT68jQ0NnRg48n5ef3UUSWGNpO3cS51VhUUU8lbRUrHUVGNuqhNB4JzFceoAItu0Fy2b7nTr2q2VoSvdunenqxgCXTVnaNkqRMVDBGGTHYPzVhZKYw7zjtQTERFAYpsg1BoX3BRKXNy0uDhnEhYfR0SwgZytU5m2JU+0msBYsJQvZ65ixnYDfrJjm3QRyV5tguFYGrtSUsnW+9Nz2I109Hfc2do58XzTeKHRQnXhXnYdrsfH3cah9QvZdKCSkO7Xcsf1yTguE5HR82uJpLGUsHHWanLKGrGr7Jgr9rFy5QrSVZ24f/z1dI2PQl9fQm7eIfbmNOKtayJ33UzWFrnQechIxvTwpCpzEf+ZdoCQ0EBca9PJrVHimdSFfm1d2Tl9PsViy5RUGtF5+RESJLal89ObafyJiO1An9696d2rtaEXvfv0oVfvHoR4uJyhFlhJyuL1ZOaUYRCfpTEUsGHJHLY1xTL+lmtIcClky9If2bCrALN3G8JCAgnw1uLp7S7Cqoj9aWvEvlRNU3k2m9du4pAxioQe/ekT6+GcvyRdeDJ4hIsaPKKe6+UXQqcYDYtmzsGs1LNmWzYeMQO464GJxLnK0PltWoJnzey15JcWYqSOrCOFZOQYuPuZNxga74FS7UFCVATe1lK2bF5HmclC6ooUeox6mFtGDiDC20xdRRGbVizHrFOTsTENXXQvht46mmR3Aw3ZB8k6fJAcdQKJ7dvRMdjN+dlOShUqtQYXF5ezDGK6+mwHHirZtmgDhw5n02SvESFXwYbtBYx97N/c2DuUqj1r2JlygAptIIaKSgITOtEm0AudeyD+QX54m45xJLeQ7MxMDhl6c8uEG7nzilDnvCXp4pB3pxZqdn7Np59PYmllAg+9+S3jEtUX5+7UVgMVFTWo3fzw8jxTDVg6N2bshj3cNeIxoie+zG2jr6atpxmr4kyHtKw0NRpEge3e6no3NdVgFq1TV42olDjHOU6oGAwKdI7ubeeF46d5iGfHP4mh7Q3c/vhD9PIxYFHqaO25u2dit5ix2DVo5OE16RIhy7ZLiUonaqnBeMvQ+QMoUWh1eDp6eomC2up4DO0ZQ8dBhdsZQsfBxc0b95NCx+F8ho6Do/ajw0N8B5VSg8XxHX5l6DgoRKtLho50KZHlm4P4YSucJ/CP/3mxOD5fHlr7vURLpD6HxR9+QFplJbMmTeKrL1eQXtx6v7Fzc6G3ih2brYSN333Ezrw8Fs2fzxdvzWBbboNzuiT9eclDbULV9sl89tkXLK1J4IH/fsNtbV1Qy9L/T8yO2VjF4d07ySrT02hwIbhNIkntYgn3/rXthYvF8Wj3RnJ37+BQUS3VTWp8g9uQ1LEdsQGOpo8k/XnJ4BHyfnyTL76czEpbT254dhLPD/RAI9uCkiRJ54UsXgVjkx6zQY/FqqCq1iYqm5d9FkuSJJ03MniEkJhw/CNCcHOBznEeF/08jyRJ0v8yGTyCXaFsHhzX7riobY6+BpIkSdJ5IoPHQQSNPLgmSZJ0YcjgcZCpI0mSdMHI4JEkSZIuKBk8kiRJ0gUlg+disVswGM3Nz32RJEm6nMjguVgaUpm3eCertpc5R0iSJF0e5J0LhF93d2orBTt+ZN3Wg+wv1aOuTmdXXgJPvPYU13YP4MiudaxdtQWzrycHDvlz3zNj6eSTx+49h9m0u5IASymxdzwBCx7h86U1KNvdwsP3jqJXrKtz/q1pYv+S71mVUUdZxVHqSo5x1Nydf7z/IIpds0kpMXBg5wG0CjsdHvoLii2bqK7MoCl6JFcMHESf2NOe5i9JknTRyBbPr6YiwNtEWV0jh+pjGXX73dzc6QAzt2azYv7HZOftobb9aK7s35d+7ouYtCmbZYvmczgrk4aoXlw1PBlTg42o+Db4de5HZLv2JIU6gsGKyWTEaHQOBsefBkxmE2abjhB/PRkFBvR+A7lt/AgGRKTw3uI8VOoK9qZU0ujeg0HDumLcPJntTT4Ehbqwa/FHLFw6h5qWBZckSbokyOD5Ddx8dXhHhOOXNIDeA29g4i2JFO48wqpPV3L0SCORvZNp16kn118VwL4lGZQ2eaO013Fo3VpW5QYQ7qUjIj4K35iORETF4OVqpr5gO99Pnsq0qT8wY8YMZsycztQpPzD12wXsKbHhFeCGe2QsUV2G0e/a6xl1ZRi75mWjclWhCYsj6coR9O/VDcuubKK7daJTv+sYOfQKuieEyo0sSdIlRZZJv4XVKsLHHb9QP/EPC26BMXhYlBgrjTTUGDAbWl7mFZOMpqoJt/D+tE1sh9+xzcybs4w9RQ001jdhN5mdt4WzYm6s5ljhMYqLiykpcQwlFB8rpuhoGY0mi/hIC74h/nh4txyS8wqIxrXJhlKhxq9dFIFR/igb9DRVWQgKCSQo9gom3nkPI/r1wGKQFypJknTpkMHj8GtvkaNUYW1qpKmsCLO+jpL8KkKGdWLQA1G4BlWya6cY31RHaUEF/te2o7GmhojYgTz/8XM83G4Fby3NobQWVNYGamvKRfi4ifC4nn+8/g/+/uILPPfc35qHF//1d158+VEGR+vQaVQYaipprCxBvImKqkbix3XCw02NqbiCugojag8NkYmVrNmeQ0lFFccyNpO6dx+HauQ9gP54IswtBgxmG1aZ65L0q8jg+S1c/TAU7GX//Ff4Zu5C3pgM43qHcfP9r5PokQgzn+PTeQt5b5qRe4cl08d/N0sWfsnH8/No0g3g/qtiCYlqQ33aFBZOfptJi484Z3wWrv407FnI9nn/5aNpG/l+gTvP3xpOUc5hMhdMZ++GjRR6tqP36Dsp/uIRJlw7gInf5lHu0o6+Ic55SH8Yu7GBhgNLWJZeSXnD70seq8koZijTS7p8yF5tQvmmD/l80pcsqe3MHa9+xQOdtKjPFsllK5izoYhtdZ35z/ho6hqUePl5oVMrMDbWiQZJLQaR6ToXd7x8fVBb6mlobKTRpESr1uLq7Y272khFaRkGq0a8NxAv0XI5q7zv+c8KHb4RHbl3SAi1jSp8/T1Fy6uK2joLSp0H3t5uKC0NlJeXUVtvw9UnkAA/b9xcZIundY5d/8zrxvHLONMNY+uO7eTDe57D8x/zmNDHlwCxv5x9bqczl25iwaz5fLGwM5Nnj6WN73l9jrYkXTJk8Ajlm/7bEjw1/bj95a95sKv6rMFTm/YBH3y9n1TDjUz+5FoCW3kgpN1mR+G43fVJ7OK/3/Zo6+LVf+GZSVrCeo3h5b/2xM05Xmqd1VzP0UN72bdxG3UR0TTk5nNs916qQmLpfc29jLkiAlfH9rFXkrVuNdOmrMcUqqGkPIwRd97G1f2j8FGBsSGf7XN/YHulmsqsI4R2H07bOHeaVr7GB0srUbdpy+BbHmfs1X1JCj63p5vW5qxl9sIVLF+3D73Ri6QRT/Ligz3wPaXyYbcbKc5JJ2PjFio8fGlqNFK6fjOF3v50GX4ftw6Pw91USsaWVA7nFqHpEEfR3MVkBg3g5ltHMjTBRO7mObz35WbqRYIGdRnNrTdeQY9oT+cnSNLFofqX4Pz7ZctYlEZq2j4OG0LoffVNdA5seUTCmTQ21mMyuRESGkmbhHC8dcrTasatP9Pnt4WOo/NBbU2d+NOPNjFRhLUJwkPTMkVqnc3cwLE9q/ly6lxWba1BofIQBXslR9LXsiO3Hp/YLsT6G0hdNZ05y3diD+5CXKwfhuwtpBw8iMk9hIQ2OqoOrOHtDwrpMrADodYD7CvTUWn1JdmjgDX7qglt341u3XvTTmwTL7EfnJme4oObmTV7FrOmzyctX49ndE+uuvoaRo/pTZiX9vTWld1M5YENTJ05l4VrC6hrdCMsyMzRjFVsy6rANTwWF30R6WsWMmvBJvZkmXDV72VHeTjtRThqK7KYOiub8M5x4rvq2bopjSMGVwLi4gl3l0fZpYtHBo9gLMkkNTWdw3of+l5zIx39zx48bn5xJHXtTo/uUbhrlajO+29YiVdoR7r26ULHdkG4iorx2ZZPckS8FVtjPrMWbaXW0pGREydyx939CbMUsn7hSkoiRtBZt40FM5axozqRlz54iiFdezEwoZKV06ezr8aP4NgQXPNW8cZcdx56+k6uviFehEEgrr5tGDowirUz1zDwrx8xfkgcQSJ0Tj/UZsNsqKak4BApWzaw5selzN+SRYMikMHXjeO+B+/iql7xBLhpWj2k56imqM2F/LhyG/nlwfS//jYeeOp62rpVsGXBUvI9uhAd6YWiPIN1WwvRhg1l4oN9SYjrTZLLXravXsK0TTrue2EM3ULsbF08l5U5Ctwjkrky0cv5KZJ04cngEQzHdrMrJYVsvT89hp09eEpKS6murqahoYH6+noaG+qoq7sAg/gsx+c5hobWpp9hqKmpEa0zE+7u7s5vcHlQKFV4hijZOmUJXe5+gGtGdifKI5Cg6CiK5y4hN3oI0TWzycryxCVyPBOHhDa/Tx0cR82W7WRUeKFqk0gvn6Os3jKN/VUe+Pgn0S4uhs4xKvS1eayas5GgwTeRFOaLp6gMnL7L1FOYtoLvP/6A1z/4kT0VCdz73DM8//w9DO4cj+8v3VBCpJHWT8veBSsI7TeMkfePJNHdk7COyZTNXcQhETyDrulGG8pJTz3KtW+9ww3dOtKlbTDKIyvZvHo+2RYzVcVHSNl6gAqDHbV3WzomtKV/e3/nh0jShSfP8Qi/5pY5Y8eOJT0jHVfXs93i5tLhCMihQ4by6aefOsdcLszY9Wncfc3jBI//J7ePv4ZkUclvLDnAvEfGsWjQpwwpfY9dGS6o+vyFL17o7XyfnTVPj2d6RQzx973A37qVsvjtO3h7ZROFRbHc+shDPP7UIJQ5y3lg3L/p/8Zsbh8QQ2hr/QLMh5j/9qdM/mYphUFtcOv7IF8/ez1Jgbpz7E7q+Gke4rnxT1Ibdx23PfEogwIdhxErWXjvNUyPeIr77h2A7/6Z/PvtNYz8eBG3t1OhVUHqR3/j29VHqB//Ot+Oi8Vms+H4qSuVjsPCZ9i5JekCkcEj/JrgqaiowGw2/2l+vI7Nq9Vp8fN1XOx6OWkJnrtE8ITe+Qq3jx1OR9Hoayo7xKJHxjC51xfc7/0tKSuKKY6YyMcfjKbl4JONtc/cxlfFMUSMe4z/DnOhymClbM9iPn9zKpuzIrj2gbHcPUHJkzf8gwFvLOCOQREEt9LBxHGOxthkpKq0kMyUlcz67hsO1LkRM2git427lWHJvr8QQC3B8+y4J6lPuoHb/vIQA33EElprWX7vMD4O/gsP3jeQ8MxZvPL2am74eL4IHl1z8GRMf47Pp6ZS2PFVFv63b8vshMqMFErqGnDrOZgYeZ5QukjkGcZfKSAggNDQUEJCQv4Ug2NZL7/Q+ZmrqB801FgxWxz/smOuPcB3OQb6dQih14CrcA+0kJW3hbV5zS8X8llZUk6Tny89w42UZ65hbk4gbQfcwX/fnEC/ri7kHDpInUmFReSCRaPEVFGKoa6aeqtzFscpNGjdPQiNbUf/EeN55tUPeO6RsYSULOGL58dy77OvM3VrvojIs3MVv1JDvQ19U8u/lU37+S67joTYYDrHhaDWaPFQKNG5tYSOQ2RCEjERVnJ2fsX7Sw5QZ7HRkDmFj2asZXqqC5EydKSLSJ7jEQzH0tiVktp8jqfnL5zjkf4sbCIVStg0ey0HcvOpbaymKGcbCxetoil+JPfdNJik6Gg01jqK8/ezfttBrPYaUmd9w35bDIOuG82NnVwoPbCUVyetxtXbjZoDG8itdye89xUMiFWS+sMsDpaVcKDEjntAKHEhXjjL/dOotY5bLEWT2DaRMD8vPF1VovWVy/6tO0jZ70PX7qG4urT27kpSF29kX3oWZXWV1FUcYsH0mRQHDWHiLUMIrNvNijmzWL37KJUmV/xDwwnxc8MjwF80+io5sm8Va1OOUJC5k2Vrs2jy78KAof3o0OqxQUm6MGTwCIaiPaQ0B4/feQ0es6GW0pyDZBWWU3wknfSMQurMajw8FFTlHSS3rIqclF3UiIao4/5sFbnZFJUUUmnzw9dNg1K2T3+FluBZPmO1WJ92vILcaHIc9tJ7cvuDz9An0hWFUkdkRCSBOjOF+TmYta6UZFfQ74a7uO7Kzvi72zE2NZF/KBNXH09Kc8sJbN+PwdcPJ8HdhqKuhpr6BgyBHejQPpF4/3MozFWuBEW3p0vfK+gQJLZzYR5ZR0MYcnU87trWrgOqYOOP6ymsqsMj2EvsGVaOFFu59Z6nGdoxgMbcdPKL6lCHJeAt9o+IxA5E+nug1frgGxREkPhu+iYzDXX16L0GMfqW4Yzsevm2gKVLgzzHI1TvmMxnn3/BsqpEHn7rO25NUJ3leTy/XWNpOhunf85nKd60887lQHo1IQNGc/Ponqi3TuarzAC0B7YQP2oYrgHR6NPTsFoLKAgczz/uG0q0v7xs9NxZwLSXu4Y/Quy9b3D7mMHEnpYLjl3/5w1tMZlQu/x8subEqXZzI2aNO6eeynH8en463Xfy7M6ZTVQylJrWusU5ZpjNc+OfwNThZu588j66isA7lyPkJy2XJF1iZB1asNnMWMXguG5CZTvTwZLfz93Lm6QuERylM/e8PIO5nwwj3DOfKWtKSOoYxKGsSB79aibXhddjOrIXel3L0H6xZMz9J2nFZTQ65yOdC3vzzTsdUa3XW6gztYw92ckl84mh43DiVEUroeNwUuH+Gwt6pUurfbF/4ug/aTFaqWm+6/m5/WRl6EiXMhk8gn90IkFt4qmtb2Tv4SIRRI6a5nkgqqEanZLIzonoRFnjEtMOP4Mfxq35WP08iBrWjchwVyoPKvE0+TKgTzJte/4fM2cvZkRSJJfXlTi/hx19bTbz33mHPbW1zPr8E778bCG7C53Pq/hTsGOzFrPq0/fZWVjIogXzmPT6V6zPqndOl6Q/Lxk8DlpX1FodBlFFbtTbfmvF9RzYm2uiLlp3tI7qs8KMNsoTty5t8NO64eLmhYvKDX+PY9RYyyiw+BIUFUu4PoPU/BpKnL2apF+iEOsyir5jnuXDL79jyscv8eDNvWjj11qb5VIl2t9KfzqNeJj/fPA10754nefuvoqkkD/H9WOSdDayc4GDq4LSjAOkrz6Mwbs7twxvc8beSb+LrZHaY/v4fvo2Av0hd/NBqlUhdOoThjltAVMXVtO+WzKxIbVkZx9iwYIt5GfuYneFN3EJcUT66dDIqsI5Uapc8PIPISwsnKjIUIL9RcD/ye7SrVCo8fANIrT5O4QRGuSDh1buANKfn9yLm0XQsVNPBie6cmjTfFbsr3L0ifrjKVSoVVo0GDDpq6lVxtI+rj0jOoVg90hiRAfR8sKMX5eR9O9/BR10FRwtrcYW0pl2IV64nb/TT5IkSReM7NV2nKmIPetn8uIHS1AlTuSJW7vSPjEKL88/sKbccIT8HVP565ZhvPFAZ2KD5WETSZIuP7LFc5xLGF2uepDv33ic+LTPeO7/7uEfny9hX0mr3aF+E72hnqz9e8hftJqM3Fr0MvIlSboMyRbPKexWxwV3eqoqy7BrffHx9cNT98e0eCymBqrLytCb1Kg8/fH3cUUnT9pIknSZkcFzNmLVND8x9A860uZY1Y61rVTasVrFylcqUMoLLiRJuszI4JEkSZIuKHmcR5IkSbqgZPBIkiRJF5QMHkmSJOkCgv8HIfxXEAS2U20AAAAASUVORK5CYII=\"\u003e\u003c/p\u003e\n \u003cp\u003eThe following criteria were used to interpret \u003cem\u003e\u0026lt; c\u003c/em\u003e\u0026gt;:\u003c/p\u003e\n \u003cp\u003eHigh gains \u0026gt; 0.6\u003c/p\u003e\n \u003cp\u003eModerate gains 0.3–0.6\u003c/p\u003e\n \u003cp\u003eLow gains \u0026lt; 0.3\u003c/p\u003e\n \u003cp\u003eThe percent change formula, which measures the change from pre- to post-test and expresses the change as an increase or decrease, can also be used to assess learning gains. The following formula was used to calculate the variance in mean scores between pre- and post-tests.\u003c/p\u003e\n \u003cp\u003e\u003cimg src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAARwAAABICAYAAAAknEq1AAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAAJcEhZcwAADsMAAA7DAcdvqGQAABOtSURBVHhe7Z0HlNRUFIYfYO8dK/beC7pYsSGIHizoUSwo2AsqKlYULIhdxN57VxBRsaKIqDSlWGgWFFREce0K+nzfNXcIYWYns7jZWbjfOXMmeZNkkuy8P7e9t/V8wBmGYWRA/ejdMAyjxjHBMQwjM0xwDMPIDBMcwzAywwTHMIzMMMExDCMzTHAMw8gMExzDMDLDBMcwjMwwwTEMIzNMcAzDyAwTHMMwMsMExzCMzDDBMQwjM0xwDMPIDBMcwzAywwTHMIzMMMExDCMzTHAMw8gMExyjJHbccUd3//33y/LXX3/ttt12W7f44ou7Rx991D3yyCPut99+k89KpWPHju6KK66I1tIzbdo0d8cdd8h7VXB+I0aMiNZm8vvvv7s777zTffXVV1FLfnbddVc3aNAgWT7ggAPcpZdeKstGaZjgGKl57bXX3IILLuhatWol6w888IC8n3feee6nn35yN998c7UFp7pMnTrV9ezZ0/34449RS34QyeHDh8vy/vvvnxMfBOemm25yEydOlPWq0P83cMIJJ7h+/foV/U5jdkxwjNQgOFtvvbVbaqmlZP3TTz91xx57rFgnhx56qLvxxhvdEkssIZ9lxaqrruruuecet+KKK0Yt+bnqqqtc8+bNZRmRUpZcckl31113uY022ihqKQ5WHeLz4YcfRi1GWkxwjFT8+uuvbsiQIW7vvfeW9cmTJ7vRo0e7SZMmuQEDBsjr77//dvPPP7/75ptv5LMZM2a4119/3f3www+yD3AcXBPaf/7556h1zuB7+F6sLKyY6dOnuzfeeEPOQ/nnn39kG0Tyu+++E/Hk9csvv4h4NGjQQLb79ttvpf3dd9+V9XwgUohO//79oxYjLSY4RioQjcrKSrfBBhvIOk933JInn3xSYi9du3Z19913n3z28ccfuxtuuMGdeuqp7rjjjnPnn3++uC5w/fXXu/bt28tnvNPB5wTO6bbbbnN//fWXCMw111zjOnToIN/LO58DMZxx48aJICE6nCsuIMJ59913i9XDMU4++WR5cW5cE2KWpF69emLpIapGaZjgGKkgqLrsssu6pZdeWtZXW201cWcqKiokJrLNNtuI0GAtYLn06tVL4iJ77bWXe/7553OdE0tjjz32cK1btxbBevHFF6W9uvz5559u1KhRYl2x/Mwzz4iw8L1YOcOGDZPtxowZI+K2zjrriPu1++67i7W2yCKLuJEjR0rsiXMjAM718DkiNX78eNk/yfrrry8xnKxjVnUdExwjFZ999pmIDEFjwNLZZJNNJHaDJUEgdaGFFhLBwQJAnC644AKxIuicGu/A8iDIi/Wwzz77VOm6pIHv0nNimRhSp06d5DvILKngLLDAAiJKW2yxhYgO53HMMce45ZZbLudOsc3VV18tFhvxKMR17Nix8lmSNdZYQ6yfeDzIKI4JjpGKKVOmiIjEIVaiT3hiIQqWRuPGjd32228v64iTxmsWXXRR98orr0iG68svv5RjVMWECRPcCy+8IK98ae04CMDmm2/umjVrJutbbbWVxGsUBAkQHmJJuqzUr1/f/fHHH653796SKme50PlxLzgecSMjPSY4RirofFgAaYnHPgjW0rGxfh588EF32GGHSSqd4CydvCoef/xx17JlS3mRaaoKjs/3cK6A5RIXlKrgPBDPiy66yLVr185ddtll4prNN9980RazwrG5LuI+RnpMcIxU8DQv1PmSsK1aE0BnpoNi5eBinX766WK5FBMQaNKkiaTdzzzzTLfvvvtGrYWJfy/L+QQNYYqj1zZw4EARQUTxiy++kAK/qgSlmFgas2N3zEgFHTLuNpUKgkMQmRjLueeeK/GeNNYHcZhrr71Wsk+HHHJI1DpnEBxOZp8QDwLbBJuxpoDtCoFoYUmlFWHjP0xwjFRQ7Kep7WLQGeNWhC7TqVlWofn+++9TuzxpiX9vIQgyE2cCrBvdB/GICxHnVwjuBddDlstIT1kLDk8QgneMlYn/MEm/xou60oA5f9BBB7nPP/88aql7cO6Y+klwAS688ELJJMWh3oRM0UMPPRS1VJ+11lpLvrtYkBfoxEnXhr8fWS7+DrhS1M7UxHik+PcWAsF56qmn3Ntvvy2pbYQDa2bjjTcWl4q40RlnnCHB7UJxK+4137XCCitELUYaylpwKM5iDAwZDWoigKfRddddV/I4Fn5Q1JKk6TDlCgVqdIg4t99+u4gNBXht27bNZU14P+qoo9zTTz8thXd08DmBmhsyPpptAjI9ej+xDNTlok2zQEAwltdiiy0mon/JJZe4W265RWpd9EGCxaDB3lLg78o5qeWklcOAFaNWWfxcSeVzL4klUdDINmxLVo0hDkcffbT76KOPJIWu58Rx4w89xBzrhmsySiD8ccqW1q1b+3vvvdf36NHDh84jbeGHIO3hByDraQkC5XfYYQc/bty4qKXuUFlZ6YNV4MPT1Pfs2TNq9T50Bt+8eXPftWtXP2DAAL/ddtv58OSWz4IA+SZNmvi33nrLd+nSxbdo0cKHTi+fVQe9f8OGDYtavB80aJCfPHmyLE+dOtUPHDjQBwHwQdj9e++9J+0wcuTI3H1ne84xWA/ytxw+fLi0jxgxwo8ZM0aWSyEIie/fv78PYuKnTZsm1xuEQT4bO3asHzVqlCxzPpMmTZJltuvdu7fv16+fXBf3Lgi0fMa5BgvHDxkyRPbhWoBtuEalW7duvmPHjtGakZayFpzwBPTjx4/377//vm/VqpW0BavHhye6LBeDH0hwQ2Q5PAWlw0ycONEH39xPmTJF2hV+hHSK8MSLWrwPT73cjzS4E/LjjhOe6j486eR4dCTWFdr47P+Aa2jWrJkProC/9dZbo1bvP/nkE9+4cWM5NzjttNP8WWedJcvBJfAdOnSQZToN21WnQyt04vbt2/vu3btHLfMuiFvLli1FtIzSKGuXSv1x6h00DhDEx4UnubRXxdChQ6UCljE7VI8ypgZ/nFL6E088UT7TKlLK19mOtlNOOcUNHjxY2nEhqFil6pR9qI5VlwVTm1gE7ex7+eWX54rgPvjgA0nlBgGQ/ZMZkVIhs0NlbBDMWY5F1mfhhRd2q6yyiqzjDjCYkvtEjGvDDTeU9pVXXlniFmmmYCgEcQ5GW7/88stF556Z22EoBQHlNL9DY1bKWnDwzxEafG9+8HRo4jBbbrmlCEihrAntiAx+NiLD+BodJBhcNPmxMNL3iSeekDY6J9syCjhYDSISfDd+P7EP4kd0dPx+BA8Y8UxAm+MzTofJpzhP6jbYn/PEv2cbPk8SzHURv5deein3YgS1DjaMQ4n9gQceKEMEOC+FOBbpZS3Nb9iwoezPeRNzYB24h2yXFArK8uOVuAgVxW6F2GWXXeS7ENR5GeJo1Afp/TXSU9aCQ0fD2mC8DaXkiAJPe4SHYCnZmXgQUyGLxVQKZLfIRmCFYCURGCTbQhsWSPD3ZXvaOBbCgjWDGGDBkCZFRA4++GARLX5kfAZkMuiAffr0kSA22QpEEWsJ0Xr44YdFhAg8IiRJOH/qUTp37iwvArtkbfJloRTOJQ73ge9UGDaA2CI2nD8io3D9SYFmuAIDHFXECJSqoOZj+eWXl0B0XPTmRfhdHnHEETkL3EhPWQsOWQwmR0IIKAB78803ZYwOnZ1Ub48ePWQeliQIFNttuummsn7kkUe6Ro0ayQ+EDAk1Jbgn2oFxORglzNQFTFfAUxxLBauGsTkIFp2Z88FlAcb1cFxgIB/WEcdnsCDpX6wJBiyuvfbaeSdqYnwRc6owypoX54vlVkpdB+en1g3oEAKui/d4ShdhSrp2a665prhZjGniekkDI5BV0aZNG7kP8zJMXcHfyiidshYcnqa77babTCPAdAYIAn/od955R0RIayWS0IEQgaqgc6p1wJOe2A1VpsyFwly9WkHKNipMxEG0M4PWYNCReeqzLW4KVs+ee+4px2NemHypU0Y0426RHuaF64alxEjmtHCOPkoBA6JBG9eGEMUtIs5Rr0kh/oN4MF0mMS+e3Outt1706Uy4No5lr/wvIz31iBxHy2UNsQWsE4KziAIuC8KDe0THjcO4G8ShW7duUct/EzVRsk5tD50alws3BsFiO9opoWeuFI5PTIX4Bk8zRipjAeEGETBk+gICqOyz7rrriqtH2T2+Pcfg2OyHC0dnJXjLyOU4xHVwfeJmOSKBRVSotoPpPLHaCG7DY489JueAYACjnHEjsf4OP/xwd/zxx+fmH2YOGgLPuIdx+PPjRhKXQRyx1JIQ48LViltTxkx0dLpRnDojOAR4+dHT2ejMxFSoFKUoUP+LgEIhHPEKOr+ST3CowiXrwoRLvOikWDsM2uvbt69YK8yZguAgAio4jOvBxSMAjWsUFxwCxlhYDFJUEJWkv4/lRgxJ4yxYTbh6CCgFaPlICg5Cg1iqW8ncvgglLifng8hw/rDTTjvJfcHqSkL86tVXX53tPipc1znnnCMWkTE7Ggs0ilNnBIcg78477ywuAJ2JpzsWDkJEnCcO6wjSc889l3sqIx6ICiKRFBwmgqJj7rfffpLNwoWjA2LhJAWH2eGY5Z+UKC4Q/zaFIQeIFAFYOjwuEu8aQ8HSweKKw3EQQXXr+DPg8pDaLjQRORYKgkMaHogjnXTSSWLZENDFYsNqwmLBSkPAsAjJyjHSGrdts802k30VBBbRZlvcUEQqCeefLzhfF0DoucdYmjX1U2cSLyMlCE65Q4VsEAMppAuWgA+dQipUgzXhO3XqFG01k9GjR/uGDRv6Pn36SOFe586d/dChQ33Tpk1zFa+DBw+W40BwPXybNm2kKJDlIC5SeUqhXLAMpGgQQof1oYPLMtu3bdtWtmnXrp0PrphUrXKMRo0a+WDhSPFfECl5JeE68r3yQfuMGTPk+6g4Vqg0DtaQDwLoJ0yY4CsqKnwQD/ksWC1Sacw94z6xzPZJgjvqg3D7ILRSPcs1zG0kizyN2qOsg8YKlgyuB+N5eFrhcjBJEu4Rrk0S4iqM2aHwrkWLFpLdwsLgKa0p3dCJc+N9iHNQl4MvTmyFpz2fs218H4KyWtzHeBy1jnD1eMqxDxkvgt3du3eXc8PCyAfXke+VDwYK8j2Mi8JNxNLh3LkmJrO68sor5XPW1WUiaM067ZwL2yWtLAofuSYyUwTAGbzINdU0pN+5r1heF198cdFpOpl4nd8AMPZJ/x64zZQS4NIWglolyg9IBAAlC/N64WJt0qBLIFouW6juJZhK4RsgPHQU3BniMsmOhBvFtrg0uAmID52KlDPBW94xtcnK0E6gGJHhnY7JjPxkw8j24N6wzjERBFLeHBthYR/WicfQeREh0ud8zjuFYQgA7ky+YGxacGkI3JI653wRVFLpuGCrr766iDHnweBNdZlwAalA5ho4P9LZnFMcanW4jpVWWknWccsQTe5vTUItEwLNdSHIuLLcy0IgmJQ1kMZHYLgPxJMQHBIJuNpabZ2E3w5FoGQ5+Q7quvhbVPV9Rg0SWTplTfhhzjJOCcKPraALorAP2ynxfXiPuxjhqZnblnbW2Sa+//Tp0+VckgQLx4dOPctYK/aPr88JnAeDVTke77iYHF9hmbZ8JLeNk6+da6xpGLyJ64mrykDJysrK6JP89O3bV8bU4aKGB4GMe4Pw0JFjBetF1vOBO4WrqWPqevXqJe6nUTvUCZcKSyWZkuWpXsgFUdgnXm0b34f3uGWExaPb0q7Bxvj+WBQaCCZgS3aHtDppeVLf8W3Z//+anInzwDrheLzzdOf4CsuFMkjJbePka0/W6tQEfG/47cm5YbXwTvCae4oLRPYtXnGNdUOlOe4QrhiuJUH5IJiyv5YRYGXyL2nIGqnrm4TvLnQ/jJqnTghOOcKP/+yzz5aMETEiTPZiAmjMhHuFeBDD4Z1qbFL8ZBip7CbTpqJBDIfCRKq4yQjiItGGu8Rk54xbC5aotDHHDSl8SgOM8sN6SDUhjkAqnHgNcYSmTZtGnxhpwMoIrqKUIWCpsMyYMwo6sVqoJKd0AAgqIz5UQRNnIhBO7A5rk/2pokZ8qH8i3kbcDfEiwGwPgfLC/hrVhAGf1Ns8++yzIjxG9VBXGRcLoaBWCOEhaI+LBboNg2cRI/7FDJYl1d8IF4JFgB6rhvosXC6C4QyFycJFNNJjgmOUBZqe1zlmsGYoYoyDJYO4kN0CRCr+zue4XUz7QdkAWTijvDDBMcoS3CUEJI4KSxLcJmI4DE3BtWXoB2PvzLopP0xwjLIkX+ylUHaJrCKZLWI4vFOIifCoJWSUDyY4Rp0Clypu+agI8Z88ccd0Jj7KBwpZREbtYYJj1AkQD6qmcbXUckFsaOedl1aDI0oMvC1kERm1hwmOUavErZDksq7zjohQ+EiRINlBRshTv6Ofk71img7G1zG5GfP7aJFm/LhG7WKCY9QqZKdUUOKz5+E2UZsDtLOOBcPYNGp1qO5mXz7jHXdqmWWWkTl/mFeacXLqeul3GLVPnRi8acxdMMk9gy2pu8E9Iu6CK0TcRWdGJKXNwFsG7VL0xzxADK6ljX0YSsLgXcSEYj+OR+wGYWE0PYNYmRyNNo5VUVEh1hGzAdCGIBnZU2cm4DLmHpgcjdHujJHKGgo1ESNcMCN7zKUyDCMzTHAMw8gMExwjc8ge1dagSr5bx2YZ2WMxHMMwMsMsHMMwMsMExzCMzDDBMQwjM0xwDMPIDBMcwzAywwTHMIzMMMExDCMjnPsXB7IqmwTMmzYAAAAASUVORK5CYII=\"\u003e\u003cbr\u003e\u003c/p\u003e\n \u003cp\u003eThese metrics are concise, quick, and simple for faculty to use for classroom-based research as well as monitoring students' development and the effectiveness of a lesson plan. A minimal improvement threshold of 5% change is established to reflect the value set for students' performance.\u003c/p\u003e\n \u003cp\u003eFinally, paired sample t-tests were performed to compare the mean quiz, midterm, and final exam scores. Learning gain scores and t-test analyses were utilized to investigate potential impacts of the MISSAL approach on students’ knowledge retention and recall of acquired learning in an information-dense course.\u003c/p\u003e\n\u003c/div\u003e"},{"header":"Results","content":"\u003cp\u003eA total of 12 learners successfully completed all the assessments. See Table\u0026nbsp;\u003cspan refid=\"Tab3\" class=\"InternalRef\"\u003e3\u003c/span\u003e for a list of student-level mean quiz scores across each unit of learning. The average value of pre-test scores of cognitive knowledge for the pretest quizzes was 74.83. The average of the midterm exam scores for this sample was 77.67 (See Table\u0026nbsp;\u003cspan refid=\"Tab4\" class=\"InternalRef\"\u003e4\u003c/span\u003e).\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab3\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 3\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eMean Quiz Scores across Each Unit of Learning\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"5\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c5\" colnum=\"5\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e\u0026nbsp;\u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eN\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003e\u003cem\u003eRange\u003c/em\u003e\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cem\u003eM\u003c/em\u003e\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c5\"\u003e \u003cp\u003e\u003cem\u003eSD\u003c/em\u003e\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eUnit Quit #1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e12\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e50\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e74.17\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e15.64\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eUnit Quiz #2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e12\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e60\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e66.67\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e18.75\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eUnit Quiz #3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e12\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e50\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e77.50\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e17.65\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eUnit Quiz #4\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e12\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e60\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e78.33\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e20.38\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eUnit Quiz #5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e12\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c3\"\u003e \u003cp\u003e40\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c4\"\u003e \u003cp\u003e77.50\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c5\"\u003e \u003cp\u003e12.15\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eThe observed value for the gain of averages, denoted as \u0026lt;\u0026thinsp;\u003cem\u003eg\u003c/em\u003e\u0026gt;, was determined to be 0.12. Similarly, the average of gains, denoted as \u0026lt;\u0026thinsp;\u003cem\u003eg\u003c/em\u003e\u003csup\u003e\u003cem\u003eave\u003c/em\u003e\u003c/sup\u003e\u003cem\u003e\u0026gt;\u003c/em\u003e was found to be 0.05 (see Table\u0026nbsp;\u003cspan refid=\"Tab5\" class=\"InternalRef\"\u003e5\u003c/span\u003e). The normalized change, representing the relative change in value, denoted as \u003cem\u003ec\u003c/em\u003e was calculated to be 0.14. The average final exam results were 90.67.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab4\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 4\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eMean Scores for Quizzing on Each Learning Unit \u0026amp; the Midterm\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"2\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003eMean Quiz Score\u003c/span\u003e\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003eMean Midterm Score\u003c/span\u003e\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e74.83 (\u003cem\u003e9.85\u003c/em\u003e)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e77.67 (\u003cem\u003e6.76\u003c/em\u003e)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eA paired-samples t-test was used to examine the relationship between pretest quiz scores and midterm exam scores among students. Once more, the average value of the pre-test quiz scores was found to be 74.83, with a standard deviation of 9.85. Similarly, the average score on the midterm examination was determined to be 77.67, with a standard deviation of 6.76. There was no statistically significant difference in memory and test performance between the pretest quizzing and midterm assessments (\u003cem\u003et\u003c/em\u003e (11) = -1.252, p\u0026thinsp;\u0026gt;\u0026thinsp;.05). See Table\u0026nbsp;\u003cspan refid=\"Tab4\" class=\"InternalRef\"\u003e4\u003c/span\u003e; there was slight improvement in test performance of 3 points, representing a percentage gain of 4%, when comparing diagnostic testing to the results of the midterm exam.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab5\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 5\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eChanges in Learning Between Unit Quizzing and Midterm\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"4\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c4\" colnum=\"4\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eStudent\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eMidterm Exam Score\u003c/p\u003e \u003cp\u003e(Posttest)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eQuiz Average Score\u003c/p\u003e \u003cp\u003e(Pretest)\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c4\"\u003e \u003cp\u003eStudent Gain Score\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e70\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e74\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e-0.15\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e82\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e84\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e-0.13\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e74\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e78\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e-0.18\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e4\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e86\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e78\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.36\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e76\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e86\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e-0.71\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e6\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e80\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e80\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e-0.00\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e7\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e76\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e70\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.20\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e8\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e86\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e80\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.30\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e9\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e64\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e50\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.28\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e10\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e76\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e80\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e-0.20\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e11\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e86\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e74\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.46\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e12\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e76\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003e64\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e0.33\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e\u0026nbsp;\u003c/td\u003e \u003ctd align=\"left\" colspan=\"2\" nameend=\"c3\" namest=\"c2\"\u003e \u003cp\u003eTotal Average Gain Score\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c4\"\u003e \u003cp\u003e\u003cb\u003e0.05\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eA paired-samples t-test was conducted to compare the average score obtained in the midterm examination with the average score achieved in the final exam. The average score on the midterm assessment was 77.67 with a standard deviation of 6.76, while the average score on the final exam was 90.67 with a standard deviation of 7.15. The analysis revealed a substantial rise in performance from the midterm to the final exam in the course (t (11) = -8.100, p\u0026thinsp;\u0026lt;\u0026thinsp;.001). Students evidenced notable improvement of 13 points, representing a gain of 16.67%, when comparing the midterm results to those of the final exam (see Table\u0026nbsp;\u003cspan refid=\"Tab6\" class=\"InternalRef\"\u003e6\u003c/span\u003e).\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab6\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 6\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eMean Scores for High-Stakes Testing with and without Quizzing on Each Learning Unit\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"2\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003e\u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003eMidterm\u003c/span\u003e\u003c/p\u003e \u003cp\u003e\u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003e(\u003c/span\u003ew/unit quizzing\u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003e)\u003c/span\u003e\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003eFinal\u003c/span\u003e\u003c/p\u003e \u003cp\u003e\u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003e(\u003c/span\u003ew/o unit quizzing\u003cspan type=\"Underline\" class=\"Underline\" name=\"Emphasis\"\u003e)\u003c/span\u003e\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e77.67 (\u003cem\u003e6.76\u003c/em\u003e)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e90.67 (\u003cem\u003e7.15\u003c/em\u003e)\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e"},{"header":"Discussion","content":"\u003cp\u003eInitial findings provide evidence for the prospective effectiveness of MISSAL in attaining exceptional academic results for students. It was anticipated that students would attain somewhat elevated scores on diagnostic testing in comparison to their performance on the midterm examination. Based on the evaluation of normalized gain, normalized change, and percent change scores, as well as the t-test statistic, it can be concluded that there was no statistically significant distinction in memory and test performance when comparing the pretest quizzing and midterm assessments. A marginal increase of 3 points was observed in test performance, indicating a relative improvement of 4% when comparing the diagnostic testing outcomes with those of the midterm examination. Moreover, a substantial enhancement in students' performance on the final examination relative to their performance on the midterm assessment was postulated. This hypothesis was confirmed.\u003c/p\u003e \u003cp\u003eIn conclusion, students were anticipated to have achieved substantial to moderate learning gains by the end of the course. The prediction was confirmed. The students' performance on the final examination was noticeably superior to that of the midterm. They demonstrated an increase of 13 points, which corresponds to a gain of 16.67%, when comparing their midterm scores to their final assessment scores. According to Bjork and Bjork's (2020) theory of metamemory and desirable difficulties, conditions of learning that cause performance to improve rapidly frequently fail to support long-term retention and transfer, whereas conditions that create challenges (i.e., difficulties) and slow the rate of apparent learning frequently optimize long-term retention and transfer.\u003c/p\u003e \u003cp\u003eBased on the evaluation of quiz and high-stakes exam scores, it is evident that MISSAL holds promise in improving student retention and recall of acquired knowledge, as well as enhancing test performance and learning gains. The observed results in this study can be attributed to the active ingredients and theoretical framework underlying the intervention, which contribute to its effectiveness in improving student learning outcomes.\u003c/p\u003e \u003cdiv id=\"Sec22\" class=\"Section2\"\u003e \u003ch2\u003eLimitations and Future Research\u003c/h2\u003e \u003cp\u003eThe outcomes of this initial investigation are particularly noteworthy considering the small sample size, which could preclude significant findings from being extrapolated. Nevertheless, the small sample size, non-experimental methodology, and cross-sectional design of this investigation hinder the applicability of the conclusions.\u003c/p\u003e \u003cp\u003eMISSAL has potential to accomplish the national \u0026ldquo;completion agenda\u0026rdquo;. Additionally, it is expected to maintain high quality education and training and to achieve outstanding student learning outcomes. If instructors across an academic program adopt this method in every course from start to finish, our graduates may be able to function at a level that is currently unthinkable intellectually and professionally. The use of this paradigm is recommended. However, questions remain about the efficacy, efficiency, and amenability of this framework. It is imperative to conduct experimental investigations into the advantages of this approach in various authentic classroom settings. This research is necessary to determine the limitations of this strategy and to ascertain the specific circumstances in which students would derive the most benefits from the MISSAL approach.\u003c/p\u003e \u003c/div\u003e"},{"header":"References","content":"\u003col\u003e\n \u003cli\u003eAkpan, B. (2020). \u0026ldquo;Mastery Learning\u0026mdash;Benjamin Bloom\u0026rdquo;. \u003cem\u003eScience Education in Theory\u0026nbsp;\u003c/em\u003e\u003cem\u003eand Practice: An Introductory Guide to Learning Theory\u003c/em\u003e, 149-162.\u003c/li\u003e\n \u003cli\u003eBailey, E., Le Vin, A., Miller, L., Price, K., Sneddon, S., Stapleton, G., \u0026amp; Wolfe, L. (2022). \u0026ldquo;Bridging the transition to a new expertise in the scholarship of teaching and learning through a faculty learning community\u0026rdquo;. \u003cem\u003eInternational Journal for Academic Development\u003c/em\u003e, \u003cem\u003e27\u003c/em\u003e(3), 265-278.\u003c/li\u003e\n \u003cli\u003eBjork, R. A., \u0026amp; Bjork, E. L. (2020). \u0026ldquo;Desirable difficulties in theory and practice.\u0026rdquo; \u003cem\u003eJournal of Applied research in Memory and Cognition\u003c/em\u003e, \u003cem\u003e9\u003c/em\u003e(4), 475.\u003c/li\u003e\n \u003cli\u003eGervais, J. (2016). \u0026ldquo;The operational definition of competency‐based education\u0026rdquo;. \u003cem\u003eThe\u0026nbsp;\u003c/em\u003e\u003cem\u003eJournal of Competency‐Based Education\u003c/em\u003e, \u003cem\u003e1\u003c/em\u003e(2), 98-106.\u003c/li\u003e\n \u003cli\u003eGruppen, L. D., Mangrulkar, R. S., \u0026amp; Kolars, J. C. (2012). \u0026ldquo;The promise of competency-based education in the health professions for improving global health\u0026rdquo;. \u003cem\u003eHuman Resources for Health\u003c/em\u003e, \u003cem\u003e10\u003c/em\u003e(1), 1-7.\u003c/li\u003e\n \u003cli\u003eHacisalihoglu, G., Stephens, D., Johnson, L., \u0026amp; Edington, M. (2018). \u0026ldquo;The use of an active learning approach in a SCALE-UP learning space improves academic performance in undergraduate General Biology\u0026rdquo;. \u003cem\u003ePloS one\u003c/em\u003e, \u003cem\u003e13\u003c/em\u003e(5), e0197916.\u003c/li\u003e\n \u003cli\u003eHake, R. R. (1998). \u0026ldquo;Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses\u0026rdquo;. \u003cem\u003eAmerican\u0026nbsp;\u003c/em\u003e\u003cem\u003eJournal of Physics\u003c/em\u003e, \u003cem\u003e66\u003c/em\u003e(1), 64-74.\u003c/li\u003e\n \u003cli\u003eHaughney, K., Wakeman, S., \u0026amp; Hart, L. (2020). \u0026ldquo;Quality of feedback in higher education: A review of literature\u0026rdquo;. \u003cem\u003eEducation Sciences\u003c/em\u003e, \u003cem\u003e10\u003c/em\u003e(3), 60.\u003c/li\u003e\n \u003cli\u003eJansen, R. S., Van Leeuwen, A., Janssen, J., Jak, S., \u0026amp; Kester, L. (2019). \u0026ldquo;Self-regulated learning partially mediates the effect of self-regulated learning interventions on achievement in higher education: A meta-analysis\u0026rdquo;. \u003cem\u003eEducational Research Review\u003c/em\u003e, \u003cem\u003e28\u003c/em\u003e, 100292.\u003c/li\u003e\n \u003cli\u003eJoseph Lobo, G. (2017). \u0026ldquo;Active learning interventions and student perceptions\u0026rdquo;. \u003cem\u003eJournal\u0026nbsp;\u003c/em\u003e\u003cem\u003eof Applied Research in Higher Education\u003c/em\u003e, \u003cem\u003e9\u003c/em\u003e(3), 465-473.\u003c/li\u003e\n \u003cli\u003eKalyuga, S. (2011). \u0026ldquo;Informing: A cognitive load perspective\u0026rdquo;. \u003cem\u003eInforming Science\u003c/em\u003e, \u003cem\u003e14\u003c/em\u003e, 33.\u003c/li\u003e\n \u003cli\u003eMargolis, A. A. (2020). \u0026ldquo;Zone of Proximal Development, Scaffolding and Teaching Practice\u0026rdquo;. \u003cem\u003eCultural-Historical Psychology\u003c/em\u003e, \u003cem\u003e16\u003c/em\u003e(3).\u003c/li\u003e\n \u003cli\u003eMarulis, L. M., \u0026amp; Palincsar, A. S. (2014). \u0026ldquo;Self-regulated learning\u0026rdquo;. In W. G. Scarlett (Ed). \u003cem\u003eClassroom Management\u003c/em\u003e: \u003cem\u003eAn A-to-Z Guide\u003c/em\u003e. Thousand Oaks, CA: Sage Publications.\u003c/li\u003e\n \u003cli\u003eMarx, J. D., \u0026amp; Cummings, K. (2007). \u0026ldquo;Normalized change\u0026rdquo;. \u003cem\u003eAmerican Journal of\u0026nbsp;\u003c/em\u003e\u003cem\u003ePhysics\u003c/em\u003e, \u003cem\u003e75\u003c/em\u003e(1), 87-91.\u003c/li\u003e\n \u003cli\u003eMcGreevy, K. M., \u0026amp; Church, F. C. (2020). \u0026ldquo;Active learning: Subtypes, intra-exam comparison, and student survey in an undergraduate biology course\u0026rdquo;. \u003cem\u003eEducation Sciences\u003c/em\u003e, \u003cem\u003e10\u003c/em\u003e(7), 185.\u003c/li\u003e\n \u003cli\u003eMinhas, P. S., Ghosh, A., \u0026amp; Swanzy, L. (2012). \u0026ldquo;The effects of passive and active learning on student preference and performance in an undergraduate basic science course\u0026rdquo;. \u003cem\u003eAnatomical sciences education\u003c/em\u003e, \u003cem\u003e5\u003c/em\u003e(4), 200-207.\u003c/li\u003e\n \u003cli\u003eMorano, S. (2019). \u0026ldquo;Retrieval practice for retention and transfer\u0026rdquo;. \u003cem\u003eTEACHING\u0026nbsp;\u003c/em\u003e\u003cem\u003eExceptional Children\u003c/em\u003e, \u003cem\u003e51\u003c/em\u003e(6), 436-444.\u003c/li\u003e\n \u003cli\u003eMaurer, T. W. (2022). \u0026ldquo;Leveraging SoTL to improve teaching and learning during the COVID-19 pandemic\u0026rdquo;. \u003cem\u003eInternational Journal for the Scholarship of Teaching and Learning\u003c/em\u003e, \u003cem\u003e16\u003c/em\u003e(1), 3.\u003c/li\u003e\n \u003cli\u003eObama, B. (2009). \u003cem\u003eRemarks of President Barack Obama \u0026mdash; address to joint session of\u0026nbsp;\u003c/em\u003e\u003cem\u003eCongress\u003c/em\u003e. White House: President Barack Obama Press Office. \u0026nbsp;October 28, 2023. Retrieved from https://www.whitehouse.gov/the-press-office/remarks-president-barack-obama-address-jointsession-congress.\u003c/li\u003e\n \u003cli\u003eOwens, A., Daddow, A., Clarkson, G., \u0026amp; Nulty, D. (2021). \u0026ldquo;What Price Excellence in Learning and Teaching? Exploring the Costs and Benefits for Diverse Academic Staff Studying for a GCHE Supporting the SoTL\u0026rdquo;. \u003cem\u003eTeaching and Learning Inquiry\u003c/em\u003e, \u003cem\u003e9\u003c/em\u003e(1), 161-179.\u003c/li\u003e\n \u003cli\u003ePast\u0026ouml;tter, B., \u0026amp; B\u0026auml;uml, K. H. T. (2014). \u0026ldquo;Retrieval practice enhances new learning: the forward effect of testing\u0026rdquo;. \u003cem\u003eFrontiers in psychology\u003c/em\u003e, 286.\u003c/li\u003e\n \u003cli\u003ePutnam, A. L., Nestojko, J. F., \u0026amp; Roediger, H. L. (2016). \u0026ldquo;Improving student learning: Two strategies to make it stick\u0026rdquo;. In \u003cem\u003eFrom the Laboratory to the Classroom\u003c/em\u003e (pp. 94-116). Routledge.\u003c/li\u003e\n \u003cli\u003eRichey, R. C. (Ed.). (2013). \u003cem\u003eEncyclopedia of terminology for educational\u0026nbsp;\u003c/em\u003e\u003cem\u003ecommunications and technology\u003c/em\u003e. New York: Springer.\u003c/li\u003e\n \u003cli\u003eRoediger, H. L., \u0026amp; Butler, A. C. (2011). \u0026ldquo;The critical role of retrieval practice in long-term retention\u0026rdquo;. \u003cem\u003eTrends in cognitive sciences\u003c/em\u003e, \u003cem\u003e15\u003c/em\u003e(1), 20-27.\u003c/li\u003e\n \u003cli\u003eRoediger III, H. L., \u0026amp; Karpicke, J. D. (2006a). \u0026ldquo;Test-enhanced learning: Taking memory tests improves long-term retention\u0026rdquo;. \u003cem\u003ePsychological science\u003c/em\u003e, \u003cem\u003e17\u003c/em\u003e(3), 249-255.\u003c/li\u003e\n \u003cli\u003eSewagegn, A. A., \u0026amp; Diale, B. M. (2019). \u0026ldquo;Empowering learners using active learning in higher education institutions\u0026rdquo;. \u003cem\u003eActive Learning-Beyond the Future\u003c/em\u003e, 118-414.\u003c/li\u003e\n \u003cli\u003eSchnotz, W., \u0026amp; K\u0026uuml;rschner, C. (2007). \u0026ldquo;A reconsideration of cognitive load Theory\u0026rdquo;. \u003cem\u003eEducational psychology review\u003c/em\u003e, \u003cem\u003e19\u003c/em\u003e, 469-508.\u003c/li\u003e\n \u003cli\u003eSteel, N. M. (Ed.). (2011). \u003cem\u003eEncyclopedia of the Sciences of Learning\u003c/em\u003e. Springer Science \u0026amp; Business Media.\u003c/li\u003e\n \u003cli\u003eSweller, J. (1994). \u0026ldquo;Cognitive load theory, learning difficulty, and instructional Design\u0026rdquo;. \u003cem\u003eLearning and instruction\u003c/em\u003e, \u003cem\u003e4\u003c/em\u003e(4), 295-312.\u003c/li\u003e\n \u003cli\u003eTierney, A. M., Aidulis, D., Park, J., \u0026amp; Clark, K. (2020). \u0026ldquo;Supporting SoTL Development through Communities of Practice\u0026rdquo;. \u003cem\u003eTeaching \u0026amp; Learning Inquiry\u003c/em\u003e, \u003cem\u003e8\u003c/em\u003e(2), 32-52.\u003c/li\u003e\n \u003cli\u003eXu, L., Duan, P., Padua, S. A., \u0026amp; Li, C. (2022). \u0026ldquo;The impact of self-regulated learning strategies on academic performance for online learning during COVID-19\u0026rdquo;. \u003cem\u003eFrontiers in Psychology\u003c/em\u003e, \u003cem\u003e13\u003c/em\u003e.\u003c/li\u003e\n \u003cli\u003eYang, B. W., Razo, J., \u0026amp; Persky, A. M. (2019). \u0026ldquo;Using testing as a learning tool. \u003cem\u003eAmerican Journal of pharmaceutical education\u003c/em\u003e, \u003cem\u003e83\u003c/em\u003e(9).\u003c/li\u003e\n\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":true,"hideJournal":true,"highlight":"","institution":"Mercy College","isAcceptedByJournal":false,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"active learning, scholarship of teaching and learning, brain-based learning, student learning outcomes","lastPublishedDoi":"10.21203/rs.3.rs-4476383/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-4476383/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eThis article elaborates on the active ingredients and theory of change used to explain an innovative model of teaching and learning called MISSAL. MISSAL is an abbreviation for Meaningful Instruction, Social, Self-Regulated, and Active Learning. This learning intervention is in the third year of research and development. Drawing upon prior scholarly investigations on brain-based learning and various instructional strategies, the active ingredients of this framework are summarized. Using a sample of 12 undergraduate social work students, I examined to what extent the MISSAL approach facilitates short- and long-term knowledge retention and recall of acquired learning, successful exam performance, and learning gains among students enrolled in a content-intensive course. Findings of this preliminary investigation are hopeful. Implications for the higher education sector and future research are discussed.\u003c/p\u003e","manuscriptTitle":"An Innovative Teaching \u0026amp; Learning Paradigm to Enhance College Students’ Long-Term Memory \u0026amp; Learning Gains","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-05-30 08:04:21","doi":"10.21203/rs.3.rs-4476383/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"77c60d37-0dbe-4e6e-af9a-7f29c1170843","owner":[],"postedDate":"May 30th, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[{"id":32392659,"name":"Cognitive Neuroscience"}],"tags":[],"updatedAt":"2024-05-30T08:04:21+00:00","versionOfRecord":[],"versionCreatedAt":"2024-05-30 08:04:21","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-4476383","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-4476383","identity":"rs-4476383","version":["v1"]},"buildId":"8U1c8b4HqxoKbykW_rLl7","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}