An Efficient IoT-based Crop Damage Prediction Framework in Smart Agricultural Systems

An Efficient IoT-based Crop Damage Prediction Framework in Smart Agricultural Systems | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article An Efficient IoT-based Crop Damage Prediction Framework in Smart Agricultural Systems Nermeen Gamal Rezk, Abdel-Fattah Attia, Mohamed A. El-Rashidy, and 2 more This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-4697940/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract This study proposes an intelligent IoT-based framework for forecasting crop damage in smart agricultural systems. Integrating smart farming with machine learning (ML) to comprehend the complex relationships in agriculture requires access to comprehensive and coherent datasets. However, such datasets are often incomplete due to missing data across various input features, posing a challenge for developing robust predictive models using ML. Addressing the issue of missing data is critical throughout the development, evaluation, and implementation phases of predictive models in smart farming. While ML methods are commonly believed to handle missing data well, their applicability in agriculture research remains unclear. This study aims to assess how ML-based prediction model studies address missing data and to what extent. To systematically explore the performance and applicability of both single ML algorithms and ensemble learning (EL) algorithms, this study adopts appropriate criteria for assessing missing data treatment in decision-making processes. The performance of various missing data processing techniques varies across different scenarios of missing data. Overall, ensemble learning demonstrates superior imputation performance compared to traditional ML methods, particularly in scenarios with high correlations among missing features. Among the ensemble learning algorithms evaluated, XGBoost, CatBoost, and LGBM classifiers with hyperparameter optimization exhibit notable performance, surpassing that of linear regression. Specifically, the XGBoost classifier achieves average sensitivity, accuracy, precision, and F-score values of 88.1, 89.56, 83.4, and 84.8, respectively. Similarly, the CatBoost classifier attains values of 88.1, 90.50, 83.3, and 84.6 for the same metrics. In comparison, the LGBM classifier achieves values of 86.3, 90.23, 81.1, and 83.1 for sensitivity, accuracy, precision, and F-score, respectively. Moreover, the accuracy of predicting missing values is assessed using Mean Squared Error (MSE) and R-squared (R2), with the XGBoost model demonstrating notably low MSE (0.0213) and high R2 (0.99), indicative of its strong performance in this aspect. Crop Damage Missing data Imputation technique Machine learning Ensemble learning prediction Smart farming Full Text Additional Declarations No competing interests reported. Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-4697940","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":335082945,"identity":"963f0f60-29be-4996-a2e3-7c20308f29d3","order_by":0,"name":"Nermeen Gamal Rezk","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAABH0lEQVRIie3QsWqDQBzH8b8c3C0nrje05BUsgYaQkryKIpjFQkeHQA8EXVK65jH6CIEDXW7oaDDQlFCnDjd2acgZQulwBMdC7zvoz+HDcQLYbH88BKp7UWd3+uhFnNWJIL8/QbQPGZGnjxeVbmFUFPvhXbqdciqQgnQSclK8msh4Wd1uVrKFK7mOokS2EXczzEDOQ07lg4n4dYwbNxfAWCDEfS4i8LwSnFyEnCWBkby1uPk+aDJ4z8T40BGElHPQZPBpJjXGjcO7UxCK9JiCmwHTQ59C1kYiY7xZlprQGN3oEWAqMAvK+TCnifGP+VWJ66+FJqTaMz1mHo2QUovJ9TOpdkZz7pGfR5h3z+4SGKh/ifw0+7XJxVNsNpvt33QEObJhGy9xW3gAAAAASUVORK5CYII=","orcid":"","institution":"Kafrelsheikh University","correspondingAuthor":true,"prefix":"","firstName":"Nermeen","middleName":"Gamal","lastName":"Rezk","suffix":""},{"id":335082946,"identity":"cd1b6926-141d-4a8c-9b22-b7b544fe4b53","order_by":1,"name":"Abdel-Fattah Attia","email":"","orcid":"","institution":"Kafrelsheikh University","correspondingAuthor":false,"prefix":"","firstName":"Abdel-Fattah","middleName":"","lastName":"Attia","suffix":""},{"id":335082947,"identity":"81a8eabe-fa69-422b-beaa-746628271419","order_by":2,"name":"Mohamed A. El-Rashidy","email":"","orcid":"","institution":"Menoufia University Menoufia","correspondingAuthor":false,"prefix":"","firstName":"Mohamed","middleName":"A.","lastName":"El-Rashidy","suffix":""},{"id":335082948,"identity":"98cf45b3-6c47-49d3-afde-1b3f48467c51","order_by":3,"name":"Ayman El-Sayed","email":"","orcid":"","institution":"Menoufia University Menoufia","correspondingAuthor":false,"prefix":"","firstName":"Ayman","middleName":"","lastName":"El-Sayed","suffix":""},{"id":335082950,"identity":"a5f516e6-597a-4767-970d-f12a754c1dcf","order_by":4,"name":"Ezz El-Din Hemdan","email":"","orcid":"","institution":"Menoufia University Menoufia","correspondingAuthor":false,"prefix":"","firstName":"Ezz","middleName":"El-Din","lastName":"Hemdan","suffix":""}],"badges":[],"createdAt":"2024-07-06 18:31:38","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-4697940/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-4697940/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":62494284,"identity":"8e6568c8-ab16-43d3-842d-550f96de01da","added_by":"auto","created_at":"2024-08-14 21:52:20","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":584798,"visible":true,"origin":"","legend":"","description":"","filename":"FinalPaper1572024.pdf","url":"https://assets-eu.researchsquare.com/files/rs-4697940/v1_covered_2a29a9f2-3529-4cbd-a044-71fc97788fcb.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"An Efficient IoT-based Crop Damage Prediction Framework in Smart Agricultural Systems","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"Crop Damage, Missing data, Imputation technique, Machine learning, Ensemble learning, prediction, Smart farming","lastPublishedDoi":"10.21203/rs.3.rs-4697940/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-4697940/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eThis study proposes an intelligent IoT-based framework for forecasting crop damage in smart agricultural systems. Integrating smart farming with machine learning (ML) to comprehend the complex relationships in agriculture requires access to comprehensive and coherent datasets. However, such datasets are often incomplete due to missing data across various input features, posing a challenge for developing robust predictive models using ML. Addressing the issue of missing data is critical throughout the development, evaluation, and implementation phases of predictive models in smart farming. While ML methods are commonly believed to handle missing data well, their applicability in agriculture research remains unclear. This study aims to assess how ML-based prediction model studies address missing data and to what extent. To systematically explore the performance and applicability of both single ML algorithms and ensemble learning (EL) algorithms, this study adopts appropriate criteria for assessing missing data treatment in decision-making processes. The performance of various missing data processing techniques varies across different scenarios of missing data. Overall, ensemble learning demonstrates superior imputation performance compared to traditional ML methods, particularly in scenarios with high correlations among missing features. Among the ensemble learning algorithms evaluated, XGBoost, CatBoost, and LGBM classifiers with hyperparameter optimization exhibit notable performance, surpassing that of linear regression. Specifically, the XGBoost classifier achieves average sensitivity, accuracy, precision, and F-score values of 88.1, 89.56, 83.4, and 84.8, respectively. Similarly, the CatBoost classifier attains values of 88.1, 90.50, 83.3, and 84.6 for the same metrics. In comparison, the LGBM classifier achieves values of 86.3, 90.23, 81.1, and 83.1 for sensitivity, accuracy, precision, and F-score, respectively. Moreover, the accuracy of predicting missing values is assessed using Mean Squared Error (MSE) and R-squared (R2), with the XGBoost model demonstrating notably low MSE (0.0213) and high R2 (0.99), indicative of its strong performance in this aspect.\u003c/p\u003e","manuscriptTitle":"An Efficient IoT-based Crop Damage Prediction Framework in Smart Agricultural Systems","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-08-09 11:16:33","doi":"10.21203/rs.3.rs-4697940/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"8c49a7bf-f79f-43a4-80ea-3d8bf6ccf00a","owner":[],"postedDate":"August 9th, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[],"tags":[],"updatedAt":"2024-08-14T21:44:12+00:00","versionOfRecord":[],"versionCreatedAt":"2024-08-09 11:16:33","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-4697940","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-4697940","identity":"rs-4697940","version":["v1"]},"buildId":"qtupq5eGEP_6zYnWcrvyt","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}