{"paper_id":"d742dcfd-4cc6-4593-8583-3bc506422af9","body_text":"Ovarian Cysts Classification Using Novel Deep Q-Learning With Harris Hawks Optimization Method | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Ovarian Cysts Classification Using Novel Deep Q-Learning With Harris Hawks Optimization Method Narmatha C, Manimegalai P, Krishnadass J, Prajoona Valsalan, Manimurugan S This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-920250/v1 This work is licensed under a CC BY 4.0 License Status: Under Review Version 1 posted 3 You are reading this latest preprint version Abstract This research presents an essential solution for classifying ultrasound diagnostic images describing seven types of ovarian cysts: Follicular cyst, Hemorrhagic cyst, Corpus luteum cyst, Polycystic-appearing ovary, endometriosis cysts, Dermoid cyst, and Teratoma. This work proposed a novel technique using images of ovarian ultrasound cysts from an ongoing database with this motivation. Initially, the work is followed by removing noise in preprocessing, feature extraction, and finally classifying using new Deep Q-Network with Harris Hawks Optimization (HHO) classifier. Automatic feature extraction is implemented using the recent popular convolutional neural network (CNN) technique that extracts image features as conditions in the reinforcement learning algorithm. With this, through the procedure of a new deep Q-learning algorithm, Deep Q-Network (DQN) is generated to train a Q-network. The swarm-based method of HHO utilized the optimization method to produce optimal hyperparameters in the DQN model known as HHO-DQN, a novel technique for classifying ovarian cysts. Extensive experimental evaluations on datasets show that the proposed HHO- DQN approach outperforms existing active learning approaches for ovarian cyst classification. Compared with the ANN, CNN, and AlexNet models, the performance of the proposed model is better in terms of precision, f-measure, recall, accuracy, and IoU. The proposed model has achieved 96% precision, 96.5% f-measure, 96% recall, 97% accuracy, and 0.65 IoU. Computer Architecture and Engineering Electrical Engineering Active learning Deep Q-learning deep learning image classification Ultrasound Medical Image Ovarian Cyst Classification Full Text Cite Share Download PDF Status: Under Review Version 1 posted Reviews received at journal 25 Sep, 2021 Reviewers invited by journal 24 Sep, 2021 First submitted to journal 18 Sep, 2021 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {\"props\":{\"pageProps\":{\"initialData\":{\"identity\":\"rs-920250\",\"acceptedTermsAndConditions\":true,\"allowDirectSubmit\":false,\"archivedVersions\":[],\"articleType\":\"Research Article\",\"associatedPublications\":[],\"authors\":[{\"id\":54270536,\"identity\":\"ab3dd875-f0ee-4d49-8fb1-8a32ff5d0943\",\"order_by\":0,\"name\":\"Narmatha C\",\"email\":\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA0ElEQVRIiWNgGAWjYPCCAwz8YJqNaB0JBxgkG5hJ1WJwgFgt5uxnn274+eOOvPGN/AMMH8oOM8i3H8CvxbIn3exmT8Izw203khkYZ5w7zGBwJgG/FoMDaWw3eBIOM4K0MPO2AbUwENJy/hnbzT8Jh+03zwBq+QvUIt//gICWG2lst4G2JG6QAGphBGphuEHIlhvP2G7LpB1OnnHmscHBnnPpPAY3CNlyPo3t5hubw7b97YkPH/wos5aT7ydgCwo4AMQ8JKgfBaNgFIyCUYALAABkCEnYqwMMSQAAAABJRU5ErkJggg==\",\"orcid\":\"https://orcid.org/0000-0003-4411-4045\",\"institution\":\"University of Tabuk\",\"correspondingAuthor\":true,\"submittingAuthor\":false,\"prefix\":\"\",\"firstName\":\"Narmatha\",\"middleName\":\"\",\"lastName\":\"C\",\"suffix\":\"\"},{\"id\":54270537,\"identity\":\"62312f1c-d961-4815-9b02-5653be4fc039\",\"order_by\":1,\"name\":\"Manimegalai P\",\"email\":\"\",\"orcid\":\"\",\"institution\":\"Karunya Institute of Technology and Sciences\",\"correspondingAuthor\":false,\"submittingAuthor\":false,\"prefix\":\"\",\"firstName\":\"Manimegalai\",\"middleName\":\"\",\"lastName\":\"P\",\"suffix\":\"\"},{\"id\":54270538,\"identity\":\"056f769b-9910-4ba0-850c-e8bee8405b37\",\"order_by\":2,\"name\":\"Krishnadass J\",\"email\":\"\",\"orcid\":\"\",\"institution\":\"Sahrdaya College of Engineering and Technology\",\"correspondingAuthor\":false,\"submittingAuthor\":false,\"prefix\":\"\",\"firstName\":\"Krishnadass\",\"middleName\":\"\",\"lastName\":\"J\",\"suffix\":\"\"},{\"id\":54270539,\"identity\":\"963d43f4-11bd-48fa-babd-50f0bcd69bc7\",\"order_by\":3,\"name\":\"Prajoona Valsalan\",\"email\":\"\",\"orcid\":\"\",\"institution\":\"Dhofar University\",\"correspondingAuthor\":false,\"submittingAuthor\":false,\"prefix\":\"\",\"firstName\":\"Prajoona\",\"middleName\":\"\",\"lastName\":\"Valsalan\",\"suffix\":\"\"},{\"id\":54270540,\"identity\":\"6740cf99-0956-42eb-b373-06aaa36f9f78\",\"order_by\":4,\"name\":\"Manimurugan S\",\"email\":\"\",\"orcid\":\"\",\"institution\":\"University of Tabuk\",\"correspondingAuthor\":false,\"submittingAuthor\":false,\"prefix\":\"\",\"firstName\":\"Manimurugan\",\"middleName\":\"\",\"lastName\":\"S\",\"suffix\":\"\"}],\"badges\":[],\"createdAt\":\"2021-09-19 16:47:51\",\"currentVersionCode\":1,\"declarations\":\"\",\"doi\":\"10.21203/rs.3.rs-920250/v1\",\"doiUrl\":\"https://doi.org/10.21203/rs.3.rs-920250/v1\",\"draftVersion\":[],\"editorialEvents\":[],\"editorialNote\":\"\",\"failedWorkflow\":false,\"files\":[{\"id\":14038817,\"identity\":\"d90e364e-3bea-4111-9fe4-138a89bdd3f8\",\"added_by\":\"auto\",\"created_at\":\"2021-09-27 20:54:45\",\"extension\":\"pdf\",\"order_by\":2,\"title\":\"\",\"display\":\"\",\"copyAsset\":false,\"role\":\"manuscript-pdf\",\"size\":514212,\"visible\":true,\"origin\":\"\",\"legend\":\"\",\"description\":\"\",\"filename\":\"NarmathaV2.pdf\",\"url\":\"https://assets-eu.researchsquare.com/files/rs-920250/v1_covered.pdf\"}],\"financialInterests\":\"\",\"formattedTitle\":\"\\u003cp\\u003eOvarian Cysts Classification Using Novel Deep Q-Learning With Harris Hawks Optimization Method\\u003c/p\\u003e\",\"fulltext\":[{\"header\":\"Full Text\",\"content\":\"This preprint is available for \\u003ca href='/article/rs-920250/latest.pdf' target='_blank'\\u003edownload as a PDF\\u003c/a\\u003e.\"}],\"fulltextSource\":\"\",\"fullText\":\"\",\"funders\":[],\"hasAdminPriorityOnWorkflow\":false,\"hasManuscriptDocX\":false,\"hasOptedInToPreprint\":true,\"hasPassedJournalQc\":\"\",\"hasAnyPriority\":false,\"hideJournal\":false,\"highlight\":\"\",\"institution\":\"\",\"isAcceptedByJournal\":true,\"isAuthorSuppliedPdf\":true,\"isDeskRejected\":\"\",\"isHiddenFromSearch\":false,\"isInQc\":false,\"isInWorkflow\":true,\"isPdf\":false,\"isPdfUpToDate\":true,\"isWithdrawnOrRetracted\":false,\"journal\":{\"display\":true,\"email\":\"info@researchsquare.com\",\"identity\":\"soft-computing\",\"isNatureJournal\":false,\"hasQc\":true,\"allowDirectSubmit\":false,\"externalIdentity\":\"soco\",\"sideBox\":\"Learn more about [Soft Computing](https://www.springer.com/journal/500)\",\"snPcode\":\"500\",\"submissionUrl\":\"https://submission.nature.com/new-submission/500/3\",\"title\":\"Soft Computing\",\"twitterHandle\":\"\",\"acdcEnabled\":true,\"dfaEnabled\":true,\"editorialSystem\":\"em\",\"reportingPortfolio\":\"Springer Hybrid\",\"inReviewEnabled\":true,\"inReviewRevisionsEnabled\":false},\"keywords\":\"Active learning, Deep Q-learning, deep learning, image classification, Ultrasound Medical Image, Ovarian Cyst Classification\",\"lastPublishedDoi\":\"10.21203/rs.3.rs-920250/v1\",\"lastPublishedDoiUrl\":\"https://doi.org/10.21203/rs.3.rs-920250/v1\",\"license\":{\"name\":\"CC BY 4.0\",\"url\":\"https://creativecommons.org/licenses/by/4.0/\"},\"manuscriptAbstract\":\"\\u003cp\\u003eThis research presents an essential solution for classifying ultrasound diagnostic images describing seven types of ovarian cysts: Follicular cyst, Hemorrhagic cyst, Corpus luteum cyst, Polycystic-appearing ovary, endometriosis cysts, Dermoid cyst, and Teratoma. This work proposed a novel technique using images of ovarian ultrasound cysts from an ongoing database with this motivation. Initially, the work is followed by removing noise in preprocessing, feature extraction, and finally classifying using new\\u0026nbsp;Deep Q-Network with Harris Hawks Optimization (HHO) classifier. Automatic feature extraction is implemented using the recent popular convolutional neural network (CNN) technique that extracts image features as conditions in the reinforcement learning algorithm. With this, through the procedure of a new\\u0026nbsp;deep Q-learning algorithm, Deep Q-Network (DQN) is generated to train a Q-network. The swarm-based method of HHO utilized the optimization method to produce optimal hyperparameters in the DQN model known as HHO-DQN, a novel technique for classifying ovarian cysts. Extensive experimental evaluations on datasets show that the proposed HHO- DQN approach outperforms existing active learning approaches for ovarian cyst classification. Compared with the ANN, CNN, and AlexNet models, the performance of the proposed model is better in terms of precision, f-measure, recall, accuracy, and IoU. The proposed model has achieved 96% precision, 96.5% f-measure, 96% recall, 97% accuracy, and 0.65 IoU.\\u003c/p\\u003e\",\"manuscriptTitle\":\"Ovarian Cysts Classification Using Novel Deep Q-Learning With Harris Hawks Optimization Method\",\"msid\":\"\",\"msnumber\":\"\",\"nonDraftVersions\":[{\"code\":1,\"date\":\"2021-09-27 20:54:39\",\"doi\":\"10.21203/rs.3.rs-920250/v1\",\"editorialEvents\":[{\"type\":\"communityComments\",\"content\":0},{\"type\":\"editorInvitedReview\",\"content\":\"\",\"date\":\"2021-09-25T13:56:58+00:00\",\"index\":0,\"fulltext\":\"\"},{\"type\":\"reviewersInvited\",\"content\":\"\",\"date\":\"2021-09-24T17:45:03+00:00\",\"index\":\"\",\"fulltext\":\"\"},{\"type\":\"submitted\",\"content\":\"Soft Computing\",\"date\":\"2021-09-18T13:25:52+00:00\",\"index\":\"\",\"fulltext\":\"\"}],\"status\":\"published\",\"journal\":{\"display\":true,\"email\":\"info@researchsquare.com\",\"identity\":\"soft-computing\",\"isNatureJournal\":false,\"hasQc\":true,\"allowDirectSubmit\":false,\"externalIdentity\":\"soco\",\"sideBox\":\"Learn more about [Soft Computing](https://www.springer.com/journal/500)\",\"snPcode\":\"500\",\"submissionUrl\":\"https://submission.nature.com/new-submission/500/3\",\"title\":\"Soft Computing\",\"twitterHandle\":\"\",\"acdcEnabled\":true,\"dfaEnabled\":true,\"editorialSystem\":\"em\",\"reportingPortfolio\":\"Springer Hybrid\",\"inReviewEnabled\":true,\"inReviewRevisionsEnabled\":false}}],\"origin\":\"\",\"ownerIdentity\":\"eea35c06-8840-4c25-a419-455b387bdba7\",\"owner\":[],\"postedDate\":\"September 27th, 2021\",\"published\":true,\"recentEditorialEvents\":[],\"rejectedJournal\":[],\"revision\":\"\",\"amendment\":\"\",\"status\":\"under-review\",\"subjectAreas\":[{\"id\":7484078,\"name\":\"Computer Architecture and Engineering\"},{\"id\":7484079,\"name\":\"Electrical Engineering\"}],\"tags\":[],\"updatedAt\":\"2021-11-17T06:33:29+00:00\",\"versionOfRecord\":[],\"versionCreatedAt\":\"2021-09-27 20:54:39\",\"video\":\"\",\"vorDoi\":\"\",\"vorDoiUrl\":\"\",\"workflowStages\":[]},\"version\":\"v1\",\"identity\":\"rs-920250\",\"journalConfig\":\"researchsquare\"},\"__N_SSP\":true},\"page\":\"/article/[identity]/[[...version]]\",\"query\":{\"redirect\":\"/article/rs-920250\",\"identity\":\"rs-920250\",\"version\":[\"v1\"]},\"buildId\":\"uwybb5PU2iWlRI8EIam5Y\",\"isFallback\":false,\"isExperimentalCompile\":false,\"dynamicIds\":[84888],\"gssp\":true,\"scriptLoader\":[]}","source_license":"CC-BY-4.0","license_restricted":false}