Using Personalized Computer Adaptive Testing to Evaluate Competency-Based Mathematics in Secondary Schools

Using Personalized Computer Adaptive Testing to Evaluate Competency-Based Mathematics in Secondary Schools | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Using Personalized Computer Adaptive Testing to Evaluate Competency-Based Mathematics in Secondary Schools Andrew Karia Wanjiru, Waweru Mwangi, Henry Mwangi This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-6110322/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract Although computerized adaptive testing (CAT) provides a promising route to personalized assessments, it has been falling short in providing the detailed personal feedback that is necessary for a competency-based curriculum beyond the typical pass/fail scores. Personalizing competency-based assessments to deliver accurate feedback per learner has been hindered by examiner biases and exorbitant implementation costs. Evidence suggests that the knowledge space theory (KST) is valuable in illustrating the knowledge characteristics of individual learners based on their responses to a set of academic problems. This study sought to explore the application of CAT integrated with KST to evaluate mathematical competencies in a competency-based curriculum. Forty-two learners were selected using cluster sampling to participate in quasi-experimental research comparing learner outcomes in a mathematics-based CAT and traditional paper-pencil competency tests. The study found that KST-integrated CAT demonstrated consistent and reliable results across the three trials, unlike the conventional test, which showed glaring inconsistencies. By integrating CAT with KST to create a Competency-Based Computerized Adaptive test (CBCAT), the study underscores CAT’s potential to revolutionize assessments within competency-based education frameworks. By addressing gaps in current assessment systems, CAT can improve student outcomes, particularly in mathematics, and foster a supportive learning environment that aligns with modern educational goals. Knowledge Space Theory Computerized Adaptive test Item Response Theory Competence-based Curriculum Mathematics Evaluation Full Text Additional Declarations No competing interests reported. Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-6110322","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":434405062,"identity":"19db85d0-5aa2-4091-93b5-23ce2da75f10","order_by":0,"name":"Andrew Karia Wanjiru","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAABXUlEQVRIie2RP2vCQBTA3xGoy5OsAcF8BUPAdhDzVU4OMtmhBMRS0JRCupy4Kg79ChXB+SRgl9SuAR1aCp0VF6G09K4qxv5xLjS/6e7e+/HevQeQkvI3KWwPVACUdi+EbwN4UHFVXL7QjSIOK4pwp3xm/qDovavhfBFApd3zn8Lz4MFxDNZ/Pls1QOORtZxD2QQMRUIxZmOv25VKZybo6D6YVrjhenaHhkBa3DYEMMvPBjRZJq7aWnYIp35M6egymFI0qsUcyn+RNhakolHQMdm8qZQ3qdyslYkjleNXpA2l2CsBTano8+TflUKkcrtWBOGyioZUU40VZZWQQpYn+7Ji1yOtd6PZV4o/YRUevXg5dEMkfFw7iQp3VoDjZGP5mA1gFZXsfFxlC79WdjLXrL/EUiNvcTaI6/ULU0f2+HUzcnBq+ntjAbT8zdaOvudvyIj9u/lrZkpKSso/4wNgK31/7Lj8nQAAAABJRU5ErkJggg==","orcid":"","institution":"Jomo Kenyatta University of Agriculture and Technology","correspondingAuthor":true,"prefix":"","firstName":"Andrew","middleName":"Karia","lastName":"Wanjiru","suffix":""},{"id":434405063,"identity":"5898729e-dd5c-45e0-8755-d53c16a0dadb","order_by":1,"name":"Waweru Mwangi","email":"","orcid":"","institution":"Jomo Kenyatta University of Agriculture and Technology","correspondingAuthor":false,"prefix":"","firstName":"Waweru","middleName":"","lastName":"Mwangi","suffix":""},{"id":434405064,"identity":"a05efb7a-1bed-4f55-b3d0-13ce5b55b130","order_by":2,"name":"Henry Mwangi","email":"","orcid":"","institution":"Jomo Kenyatta University of Agriculture and Technology","correspondingAuthor":false,"prefix":"","firstName":"Henry","middleName":"","lastName":"Mwangi","suffix":""}],"badges":[],"createdAt":"2025-02-26 06:38:23","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-6110322/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-6110322/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":83043339,"identity":"833a3f3b-8e05-422d-8b19-4a39ea99f60e","added_by":"auto","created_at":"2025-05-19 11:08:41","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":645759,"visible":true,"origin":"","legend":"","description":"","filename":"ArticleRevised14thMarch.pdf","url":"https://assets-eu.researchsquare.com/files/rs-6110322/v1_covered_7c3d5e19-0f11-4c6a-9d2c-7a6102b91bfe.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Using Personalized Computer Adaptive Testing to Evaluate Competency-Based Mathematics in Secondary Schools","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"Knowledge Space Theory, Computerized Adaptive test, Item Response Theory, Competence-based Curriculum, Mathematics Evaluation","lastPublishedDoi":"10.21203/rs.3.rs-6110322/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-6110322/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eAlthough computerized adaptive testing (CAT) provides a promising route to personalized assessments, it has been falling short in providing the detailed personal feedback that is necessary for a competency-based curriculum beyond the typical pass/fail scores. Personalizing competency-based assessments to deliver accurate feedback per learner has been hindered by examiner biases and exorbitant implementation costs. Evidence suggests that the knowledge space theory (KST) is valuable in illustrating the knowledge characteristics of individual learners based on their responses to a set of academic problems. This study sought to explore the application of CAT integrated with KST to evaluate mathematical competencies in a competency-based curriculum. Forty-two learners were selected using cluster sampling to participate in quasi-experimental research comparing learner outcomes in a mathematics-based CAT and traditional paper-pencil competency tests. The study found that KST-integrated CAT demonstrated consistent and reliable results across the three trials, unlike the conventional test, which showed glaring inconsistencies. By integrating CAT with KST to create a Competency-Based Computerized Adaptive test (CBCAT), the study underscores CAT\u0026rsquo;s potential to revolutionize assessments within competency-based education frameworks. By addressing gaps in current assessment systems, CAT can improve student outcomes, particularly in mathematics, and foster a supportive learning environment that aligns with modern educational goals.\u003c/p\u003e","manuscriptTitle":"Using Personalized Computer Adaptive Testing to Evaluate Competency-Based Mathematics in Secondary Schools","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2025-04-01 17:56:02","doi":"10.21203/rs.3.rs-6110322/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"aecf123b-4895-4255-81e0-77e6655a9584","owner":[],"postedDate":"April 1st, 2025","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[],"tags":[],"updatedAt":"2025-05-19T11:08:16+00:00","versionOfRecord":[],"versionCreatedAt":"2025-04-01 17:56:02","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-6110322","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-6110322","identity":"rs-6110322","version":["v1"]},"buildId":"8U1c8b4HqxoKbykW_rLl7","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}