Drowsiness Detection for Drivers Using Convolutional Neural Networks (CNNs)

preprint OA: closed
Full text JSON View at publisher

Abstract

Abstract Drowsy driving is a huge risk to road safety, resulting in serious accidents. Drowsiness detection in drivers can assist prevent accidents by providing timely alarms and actions. In this research, we look at how deep learning Convolutional Neural Networks (CNNs) can be used to identify tiredness. We discuss our technique, experimental results, and conclusions about the efficacy of deep learning CNNs in solving this essential road safety issue. In this work, we employed two convolutional neural networks, one is built from scratch and another one that is a pre-trained model (ResNet). Our findings show that the pre-trained outperformed the one built from scratch achieving an accuracy of 95.6%
Full text 51,869 characters · extracted from preprint-html · click to expand
Drowsiness Detection for Drivers Using Convolutional Neural Networks (CNNs) | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Drowsiness Detection for Drivers Using Convolutional Neural Networks (CNNs) Ali This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-4808639/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract Drowsy driving is a huge risk to road safety, resulting in serious accidents. Drowsiness detection in drivers can assist prevent accidents by providing timely alarms and actions. In this research, we look at how deep learning Convolutional Neural Networks (CNNs) can be used to identify tiredness. We discuss our technique, experimental results, and conclusions about the efficacy of deep learning CNNs in solving this essential road safety issue. In this work, we employed two convolutional neural networks, one is built from scratch and another one that is a pre-trained model (ResNet). Our findings show that the pre-trained outperformed the one built from scratch achieving an accuracy of 95.6% Artificial Intelligence and Machine Learning Drowsiness drowsy driving CNN pre-trained model ResNet50 Figures Figure 1 Figure 2 Figure 3 Figure 4 Figure 5 1. Introduction Drowsy driving is a severe threat to road safety, resulting in innumerable accidents and fatalities around the world. Detecting and treating sleepiness in drivers is critical for avoiding potential accidents on the road [ 1 ]. Significant research efforts have been devoted in recent years to building sleepiness detection systems utilizing diverse approaches. Deep learning Convolutional Neural Networks (CNNs) have emerged as a useful tool for processing visual data and extracting relevant features among various approaches. Nonetheless, despite progress in this field, there are still some limits that must be addressed [ 2 ]. Existing sleepiness detection research has mostly focused on machine learning and computer vision techniques. Some methods have relied on specific traits such as eye closure duration, head position, and blink rate to assess a driver's drowsiness. However, because they rely primarily on explicit feature engineering, these techniques frequently suffer from low resilience and generalization and may fail to catch small variations in sleepiness patterns [ 3 ]. Deep learning CNNs have demonstrated amazing performance in a variety of computer vision tasks in recent years, including object detection, image categorization, and facial expression analysis [ 4 ]. Several research have looked into the use of CNNs for sleepiness detection, taking use of their capacity to train and extract relevant features straight from raw visual input. These approaches have produced promising results in accurately recognizing sleepy states based on facial signals and expressions by training CNN models on large-scale datasets [ 5 ]. Deep learning CNNs have the ability to automatically learn hierarchical representations, collecting both low-level and high-level data. This allows the models to detect complicated patterns and minor variations that indicate tiredness. CNNs can also manage complicated and diverse datasets, allowing them to adapt and generalize effectively to different individuals, lighting circumstances, and camera angles [ 6 – 10 ]. Despite progress, existing research on drowsiness detection using deep learning CNNs have limitations and problems. One significant problem is the lack of labeled datasets created specifically for sleepiness detection. It is still difficult to collect large-scale, diversified, and well annotated datasets that include many sleepy states and circumstances. Inadequate and unbalanced data can stymie the training process and have an impact on the model's effectiveness and generalizability [ 7 ]. Another disadvantage of deep learning CNN models is their interpretability. While CNNs excel at learning complex representations, their internal workings are "black boxes." Understanding the decision-making process and interpreting the learned characteristics becomes difficult. This lack of interpretability may jeopardize the credibility and acceptability of these models in real-world situations where transparency and explainability are critical [ 8 ]. Furthermore, previous research frequently focuses primarily on facial cues for tiredness identification, ignoring other potential sources of information such as physiological signals (e.g., heart rate, electroencephalogram) or driving behavior (e.g., steering wheel movements, lane departure). Integrating multimodal data and developing fusion algorithms to combine several modalities may improve the robustness and accuracy of sleepiness detection systems [ 9 ]. We want to solve some of these limitations and further investigate the potential of deep learning CNNs in sleepiness detection in this study. We want to improve the accuracy, generalization, and interpretability of drowsiness detection systems by leveraging advances in deep learning techniques, thereby contributing to the improvement of road safety and lowering the hazards associated with drowsy driving (Fig. 1 ). 2. Methods 2.1 Convolutional Neural Networks Convolutional Neural Networks (CNNs) are a subset of deep learning neural networks that excel at analyzing and extracting characteristics from visual data such as photos and videos (Fig. 2 ). CNNs have transformed computer vision tasks by using their ability to learn and recognize patterns, objects, and structures inside images automatically [ 10 – 20 ]. They've been used extensively in a variety of fields, including picture categorization, object identification, and facial recognition. Convolutional layers are the essential building blocks of a CNN, and they play a critical role in capturing local patterns and spatial dependencies inside an image. These layers are made up of several filters or kernels, each of which is responsible for recognizing specific features in the incoming data. These filters are taught to extract relevant features by convolving them with the input image during training [ 11 ]. The filters are slid spatially across the image and element-wise multiplications and summations are computed, resulting in a feature map that highlights the existence of the identified features. One of CNNs' primary advantages is their ability to leverage picture local structure. Parameter sharing is used by convolutional layers, which means that the same set of filters is applied to different parts of the input image. When compared to fully connected networks, this trait dramatically reduces the number of parameters to learn, making CNNs more efficient and scalable for large-scale datasets. CNNs frequently include pooling layers, typically max pooling, which downsample feature maps by selecting the maximum value within a set neighborhood. Pooling layers aids in reducing the spatial dimensions of feature maps while preserving the most important information. This downsampling method helps to achieve translation invariance, allowing CNNs to recognize features regardless of where they are in the input image [ 12 ]. CNN architectures are often made up of numerous stacked convolutional and pooling layers, which are then followed by one or more fully connected layers. The fully connected layers act as the classifier, transferring the high-level characteristics gathered by the preceding layers to particular output classifications. These layers are in charge of understanding the complicated linkages and decision boundaries required for accurate classification [ 10 – 20 ]. A labeled dataset is required to train a CNN. The network learns the ideal values of its parameters (weights and biases) during training by minimizing a loss function that quantifies the difference between predicted and true labels. Backpropagation is used to optimize the network's parameters by computing gradients and employing gradient descent-based optimization methods such as stochastic gradient descent (SGD). Modern CNN architectures frequently use additional techniques to enhance performance and handle common issues [ 14 ]. Among these methods are: Activation functions: Non-linear activation functions, such as ReLU (Rectified Linear Unit), are used to add non-linearity into the network, allowing it to reflect complicated interactions and decision limits. Regularization: Techniques such as dropout and batch normalization are used to reduce the network's reliance on individual neurons or features during training, thereby preventing overfitting and improving generalization. Transfer learning and pre-trained models: CNNs can benefit from pre-training on large-scale datasets such as ImageNet, where they learn generic features. These pre-trained models can then be fine-tuned on smaller, task-specific datasets, which saves training time while enhancing performance. Data augmentation: Image rotation, scaling, and mirroring techniques are used to artificially expand the amount and diversity of the training dataset, allowing the network to generalize better to new data. CNNs have outperformed traditional techniques in accuracy and performance in a variety of computer vision tasks. Because of their ability to automatically learn and extract significant features from visual data, as well as their hierarchical architecture, they have become a cornerstone of modern computer vision systems. CNNs are still being actively researched and developed, pushing the limits of what is achievable in visual identification and comprehension tasks. 3. Results 3.1 Model Training Our drowsiness detection system consists of two main stages: face detection and drowsiness classification. In the face detection stage, we employ a pre-trained CNN model to detect and extract facial regions from the input video frames. This helps isolate the relevant area for subsequent drowsiness classification. For drowsiness classification, we train a CNN model on a large dataset of labeled images containing both drowsy and alert states. The CNN model learns to discriminate between these two states and predicts the likelihood of drowsiness based on extracted facial features (Fig. 3 ). To train the CNN model, we augment the dataset [ 14 ] with various transformations, such as image rotation and scaling, to improve generalization and robustness. We utilize a training-validation split to fine-tune the model parameters and optimize its performance. We also employ techniques like data balancing to address potential class imbalance issues and ensure accurate representation of both drowsy and alert instances. 3.2 Results Evaluation As mentioned before the model was trained and tested using the xxx dataset []. 70% of the data were used for training while the rest were used for testing the model. Table 1 below shows the testing results of the network. We trained two models on the drowsiness detection dataset. The first model was a CNN built from scratch while the second was a pre-trained model (ResNet50). It was noticed that the pre-trained model achieved better accuracy than the one built from scratch. This is due to the learned weights that the pre-trained have from its original training on the huge ImageNet dataset, which grants powerful ability in extracting useful features from the face. Table 1 Results evaluation of CNN and the ResNet50 Accuracy CNN 91% Pre-trained model (ResNet50) 95.6% Figure 4 and 5 show the accuracy variations the CNN and ResNet50, respectively. 4. Discussion Previously, machine learning algorithms were employed for manual feature extraction, however deep learning architectures now eliminate manual feature extraction. It learns automatically. Deep learning architectures now extract their features automatically. So, we save a lot of time here because we would otherwise have to spend time calculating the feature needs to better the categorization result. The drowsy observation model's dataset was extensively evaluated under a variety of light circumstances, including exposure and occlusion. In most circumstances, our model works perfectly. It has a higher than 90% accuracy rate. We tested the model on people of various ages and skin tones and found it to be effective. The success rate when driving in real-world scenarios was deemed perfect. We also discovered that its efficiency is lacking in several circumstances. In low-light settings or when the flashlight is focused at the camera lens in the backdrop, the trained model's performance was not totally satisfied. However, because the dataset did not contain any low-light photographs, it was acceptable. That is why we just expect it to perform properly in this situation. 5. Conclusion Our experiments demonstrate the effectiveness of the deep learning CNN approach for drowsiness detection. The trained CNN model achieved an accuracy of 91% of a CNN built from scratch set, accurately classifying instances of drowsiness and alertness. The precision and recall values for drowsiness detection indicated a balanced performance. On the other hand, our pre-trained model showed higher performance (95.6%) in terms of accuracy compared to the CNN. The system also showed promising results in real-time video processing, exhibiting a low latency and providing timely drowsiness alerts. In this study, we successfully applied deep learning CNNs for the detection of drowsiness. The results indicate that CNN models can effectively learn and extract discriminative features from facial images, enabling accurate identification of drowsy states. Our system demonstrates high accuracy, precision, and recall values, highlighting its potential for real-world implementation in drowsiness detection systems. The application of deep learning CNNs in this context holds great promise for enhancing road safety by alerting drivers and preventing accidents caused by drowsy driving. References Amodio A, Ermidoro M, Maggi DFS, Savaresi SM (2018) Automatic detection of driver impairment based on pupillary light reflex.IEEE Transactions on Intelligent Transportation Systems, pp. 1–11 Yang JH, Mao ZH, Tijerina L, Pilutti T, Coughlin JF, Feron E (2009) Detection of driver fatigue caused by sleep deprivation. IEEE Trans Syst Man Cybernetics-Part A: Syst Hum 39(4):694–705 Hu S, Zheng G (2009) Driver drowsiness detection with eyelid related parameters by support vector machine. Expert Syst Appl 36(4):7651–7658 Fujiwara K, Abe E, Kamata K, Nakayama C, Suzuki Y, Yamakawa T, Hiraoka T, Kano M, Sumi Y, Masuda F, Matsuo M, Kadotani H (2019) „„Heart rate variability-based driver drowsiness detection and its validation with EEG,‟‟ IEEE Trans. Biomed. Eng., vol. 66, no. 6, pp. 1769–1778, Jun George CFP (2007) Nov. Sleep apnea, alertness, and motor vehicle crashes,‟‟ Amer. J. Respiratory Crit. Care Med., vol. 176, no. 10, pp. 954–956 Owens JA, Dearth-Wesley T, Herman AN, Whitaker RC (2019) „„Drowsy driving, sleep duration, and chronotype in adolescents,‟‟ J. Pediatrics, vol. 205, pp. 224–229, Feb Abiyev RH, Ma’aitaH MKS (2018) Deep convolutional neural networks for chest diseases detection. Journal of healthcare engineering, 2018(1), 4168538 Abiyev RH, Altabel MZ, Darwish M, Helwan A (2024) A Multimodal Transformer Model for Recognition of Images from Complex Laparoscopic Surgical Videos. Diagnostics 14(7):681 Helwan A, Ma’aitah MKS, Uzelaltinbulat S, Altobel MZ, Darwish M (2021), April Gaze prediction based on convolutional neural network. In International conference on emerging technologies and intelligent systems (pp. 215–224). Cham: Springer International Publishing Helwan A, Azar D, Ma’aitah MKS (2024) Conventional and deep learning methods in heart rate estimation from RGB face videos. Physiol Meas 45(2):02TR01 Helwan A, Ma’aitah MKS, Hamdan H, Ozsahin DU, Tuncyurek O (2021) Radiologists versus Deep Convolutional Neural Networks: A Comparative Study for Diagnosing COVID-19. Computational and Mathematical Methods in Medicine, 2021(1), 5527271 Helwan A, Ma’aitah S, Abiyev MK, Uzelaltinbulat RH, S., Sonyel B (2021) Deep learning based on residual networks for automatic sorting of bananas. Journal of Food Quality, 2021(1), 5516368 & Haque, M. A. (2021). An online survey and review about the awareness, coping style,and exercise behavior during the COVID-19 pandemic situation by implementing the cloud-based medical treatment technology system in China among the public. Science Progress, 104(2), 00368504211000889 Helwan A, Ma’aitah MKS (2022), September Medical Application of Deep Learning-Based Detection on Malignant Melanoma. In International Conference on Emerging Technologies and Intelligent Systems (pp. 627–637). Cham: Springer International Publishing Helwan A, Ma’aitah MKS, Uzelaltinbulat S, Sonyel B, Altobel MZZ, Darwish M (2021), April Stacked autoencoders deep learning approach for left ventricular localization in magnetic resonance slices. In International Conference on Emerging Technologies and Intelligent Systems (pp. 225–234). Cham: Springer International Publishing Helwan A, Azar D, Ma’aitah MKS (2024) Conventional and deep learning methods in heart rate estimation from RGB face videos. Physiol Meas 45(2):02TR01 Helwan A, Menekay M, Ma’aitah MKS (2020), August Machine learning for better understanding of autistics. In International conference on theory and applications of fuzzy systems and soft computing (pp. 817–825). Cham: Springer International Publishing Helwan A, Ma’aitah MKS (2020), August Machine learning in automated chest radiographs classification. In International conference on theory and applications of fuzzy systems and soft computing (pp. 810–816). Cham: Springer International Publishing Menekay M, Maaitah MKS (2017), December Applying expert system for bank credit authorization using fuzzy tools. In Proceedings of the 9th International Conference on Education Technology and Computers (pp. 258–261) Helwan A, Ma’aitah MKS (2022), September Medical Application of Deep Learning-Based Detection on Malignant Melanoma. In International Conference on Emerging Technologies and Intelligent Systems (pp. 627–637). Cham: Springer International Publishing Kaggle dataset https://www.kaggle.com/datasets/prasadvpatil/mrl-dataset Additional Declarations The authors declare no competing interests. Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-4808639","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":332232622,"identity":"0fc45645-60ae-47e2-b46f-85e6267d3611","order_by":0,"name":"Ali","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAAw0lEQVRIiWNgGAWjYHACA2YgIQdiHXhAihZjsJYEUrQkNoCYRGnhb2De+Lmgpi59ftjhh0Bb7OR0GwhokTjAViw949jh3I230wyAWpKNzQ4QsuYAj4E0D9uB3I2zE0BaDiRuI6RF/gCP8W+ef3XphrPTPxCnxeAAj5k0bxtzgrx0DpG2GB5mK7Oe2XfYcIN0TsGBBAMi/CJ3vHnz7YJvdfLys9M3f/hQYSdH2PvMcBeCSULKkYF8AymqR8EoGAWjYEQBAE3VQ5rYig4YAAAAAElFTkSuQmCC","orcid":"","institution":"girne american university","correspondingAuthor":true,"prefix":"","firstName":"","middleName":"","lastName":"Ali","suffix":""}],"badges":[],"createdAt":"2024-07-26 14:09:56","currentVersionCode":1,"declarations":{"humanSubjects":false,"vertebrateSubjects":true,"conflictsOfInterestStatement":false,"humanSubjectEthicalGuidelines":false,"humanSubjectConsent":false,"humanSubjectClinicalTrial":false,"humanSubjectCaseReport":false,"vertebrateSubjectEthicalGuidelines":true},"doi":"10.21203/rs.3.rs-4808639/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-4808639/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":61371099,"identity":"dfa08635-6ebe-48e7-b0da-102190960756","added_by":"auto","created_at":"2024-07-30 03:02:52","extension":"png","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":403753,"visible":true,"origin":"","legend":"\u003cp\u003eAn example of dowsiness detection model\u003c/p\u003e","description":"","filename":"image1.png","url":"https://assets-eu.researchsquare.com/files/rs-4808639/v1/29f98caa9b5fb5a45a113710.png"},{"id":61371097,"identity":"736d4e53-c2b2-48fd-97b6-e32f5341a093","added_by":"auto","created_at":"2024-07-30 03:02:52","extension":"png","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":10900,"visible":true,"origin":"","legend":"\u003cp\u003eBasic CNN architecture [14]\u003c/p\u003e","description":"","filename":"image2.png","url":"https://assets-eu.researchsquare.com/files/rs-4808639/v1/817bb7afc29425ec9e831beb.png"},{"id":61371100,"identity":"892fda37-6650-4c54-886b-e6dabdf9cd6d","added_by":"auto","created_at":"2024-07-30 03:02:52","extension":"png","order_by":3,"title":"Figure 3","display":"","copyAsset":false,"role":"figure","size":329988,"visible":true,"origin":"","legend":"\u003cp\u003eOur model stages: Face detection and then drowsiness detection\u003c/p\u003e","description":"","filename":"image3.png","url":"https://assets-eu.researchsquare.com/files/rs-4808639/v1/fe7c3dd130ab6bd14b45b203.png"},{"id":61371626,"identity":"f20b7788-86ff-47df-99b9-cddf8ac23886","added_by":"auto","created_at":"2024-07-30 03:10:52","extension":"png","order_by":4,"title":"Figure 4","display":"","copyAsset":false,"role":"figure","size":16824,"visible":true,"origin":"","legend":"\u003cp\u003eAccuracy change over number of epochs of the CNN model\u003c/p\u003e","description":"","filename":"image4.png","url":"https://assets-eu.researchsquare.com/files/rs-4808639/v1/27e13ec080aa489eba1e68c9.png"},{"id":61371095,"identity":"7b19052e-b0f6-4b30-bace-b2b406436cbe","added_by":"auto","created_at":"2024-07-30 03:02:52","extension":"png","order_by":5,"title":"Figure 5","display":"","copyAsset":false,"role":"figure","size":14493,"visible":true,"origin":"","legend":"\u003cp\u003eAccuracy change over number of epochs of the ResNet50 model\u003c/p\u003e","description":"","filename":"image5.png","url":"https://assets-eu.researchsquare.com/files/rs-4808639/v1/d3bd08502b8f0ae81e7d7f5f.png"},{"id":61371964,"identity":"b69bd11e-d7e5-41e2-b3f7-20ed4ddbfaff","added_by":"auto","created_at":"2024-07-30 03:18:53","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":1222436,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-4808639/v1/5ce5f8e5-7a41-4529-9f40-7829059c7247.pdf"}],"financialInterests":"The authors declare no competing interests.","formattedTitle":"\u003cp\u003e\u003cstrong\u003eDrowsiness Detection for Drivers Using Convolutional Neural Networks (CNNs)\u003c/strong\u003e\u003c/p\u003e","fulltext":[{"header":"1. Introduction","content":"\u003cp\u003eDrowsy driving is a severe threat to road safety, resulting in innumerable accidents and fatalities around the world. Detecting and treating sleepiness in drivers is critical for avoiding potential accidents on the road [\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e]. Significant research efforts have been devoted in recent years to building sleepiness detection systems utilizing diverse approaches. Deep learning Convolutional Neural Networks (CNNs) have emerged as a useful tool for processing visual data and extracting relevant features among various approaches. Nonetheless, despite progress in this field, there are still some limits that must be addressed [\u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eExisting sleepiness detection research has mostly focused on machine learning and computer vision techniques. Some methods have relied on specific traits such as eye closure duration, head position, and blink rate to assess a driver's drowsiness. However, because they rely primarily on explicit feature engineering, these techniques frequently suffer from low resilience and generalization and may fail to catch small variations in sleepiness patterns [\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eDeep learning CNNs have demonstrated amazing performance in a variety of computer vision tasks in recent years, including object detection, image categorization, and facial expression analysis [\u003cspan citationid=\"CR4\" class=\"CitationRef\"\u003e4\u003c/span\u003e]. Several research have looked into the use of CNNs for sleepiness detection, taking use of their capacity to train and extract relevant features straight from raw visual input. These approaches have produced promising results in accurately recognizing sleepy states based on facial signals and expressions by training CNN models on large-scale datasets [\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eDeep learning CNNs have the ability to automatically learn hierarchical representations, collecting both low-level and high-level data. This allows the models to detect complicated patterns and minor variations that indicate tiredness. CNNs can also manage complicated and diverse datasets, allowing them to adapt and generalize effectively to different individuals, lighting circumstances, and camera angles [\u003cspan additionalcitationids=\"CR7 CR8 CR9\" citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eDespite progress, existing research on drowsiness detection using deep learning CNNs have limitations and problems. One significant problem is the lack of labeled datasets created specifically for sleepiness detection. It is still difficult to collect large-scale, diversified, and well annotated datasets that include many sleepy states and circumstances. Inadequate and unbalanced data can stymie the training process and have an impact on the model's effectiveness and generalizability [\u003cspan citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eAnother disadvantage of deep learning CNN models is their interpretability. While CNNs excel at learning complex representations, their internal workings are \"black boxes.\" Understanding the decision-making process and interpreting the learned characteristics becomes difficult. This lack of interpretability may jeopardize the credibility and acceptability of these models in real-world situations where transparency and explainability are critical [\u003cspan citationid=\"CR8\" class=\"CitationRef\"\u003e8\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eFurthermore, previous research frequently focuses primarily on facial cues for tiredness identification, ignoring other potential sources of information such as physiological signals (e.g., heart rate, electroencephalogram) or driving behavior (e.g., steering wheel movements, lane departure). Integrating multimodal data and developing fusion algorithms to combine several modalities may improve the robustness and accuracy of sleepiness detection systems [\u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eWe want to solve some of these limitations and further investigate the potential of deep learning CNNs in sleepiness detection in this study. We want to improve the accuracy, generalization, and interpretability of drowsiness detection systems by leveraging advances in deep learning techniques, thereby contributing to the improvement of road safety and lowering the hazards associated with drowsy driving (Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e).\u003c/p\u003e \u003cp\u003e \u003c/p\u003e"},{"header":"2. Methods","content":"\u003cdiv id=\"Sec3\" class=\"Section2\"\u003e \u003ch2\u003e2.1 Convolutional Neural Networks\u003c/h2\u003e \u003cp\u003eConvolutional Neural Networks (CNNs) are a subset of deep learning neural networks that excel at analyzing and extracting characteristics from visual data such as photos and videos (Fig.\u0026nbsp;\u003cspan refid=\"Fig2\" class=\"InternalRef\"\u003e2\u003c/span\u003e). CNNs have transformed computer vision tasks by using their ability to learn and recognize patterns, objects, and structures inside images automatically [\u003cspan additionalcitationids=\"CR11 CR12 CR13 CR14 CR15 CR16 CR17 CR18 CR19\" citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e]. They've been used extensively in a variety of fields, including picture categorization, object identification, and facial recognition.\u003c/p\u003e \u003cp\u003eConvolutional layers are the essential building blocks of a CNN, and they play a critical role in capturing local patterns and spatial dependencies inside an image. These layers are made up of several filters or kernels, each of which is responsible for recognizing specific features in the incoming data. These filters are taught to extract relevant features by convolving them with the input image during training [\u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e]. The filters are slid spatially across the image and element-wise multiplications and summations are computed, resulting in a feature map that highlights the existence of the identified features.\u003c/p\u003e \u003cp\u003eOne of CNNs' primary advantages is their ability to leverage picture local structure. Parameter sharing is used by convolutional layers, which means that the same set of filters is applied to different parts of the input image. When compared to fully connected networks, this trait dramatically reduces the number of parameters to learn, making CNNs more efficient and scalable for large-scale datasets.\u003c/p\u003e \u003cp\u003eCNNs frequently include pooling layers, typically max pooling, which downsample feature maps by selecting the maximum value within a set neighborhood. Pooling layers aids in reducing the spatial dimensions of feature maps while preserving the most important information. This downsampling method helps to achieve translation invariance, allowing CNNs to recognize features regardless of where they are in the input image [\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eCNN architectures are often made up of numerous stacked convolutional and pooling layers, which are then followed by one or more fully connected layers. The fully connected layers act as the classifier, transferring the high-level characteristics gathered by the preceding layers to particular output classifications. These layers are in charge of understanding the complicated linkages and decision boundaries required for accurate classification [\u003cspan additionalcitationids=\"CR11 CR12 CR13 CR14 CR15 CR16 CR17 CR18 CR19\" citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e\u0026ndash;\u003cspan citationid=\"CR20\" class=\"CitationRef\"\u003e20\u003c/span\u003e].\u003c/p\u003e \u003cp\u003eA labeled dataset is required to train a CNN. The network learns the ideal values of its parameters (weights and biases) during training by minimizing a loss function that quantifies the difference between predicted and true labels. Backpropagation is used to optimize the network's parameters by computing gradients and employing gradient descent-based optimization methods such as stochastic gradient descent (SGD). Modern CNN architectures frequently use additional techniques to enhance performance and handle common issues [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e]. Among these methods are:\u003c/p\u003e \u003cp\u003e \u003col\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eActivation functions: Non-linear activation functions, such as ReLU (Rectified Linear Unit), are used to add non-linearity into the network, allowing it to reflect complicated interactions and decision limits.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eRegularization: Techniques such as dropout and batch normalization are used to reduce the network's reliance on individual neurons or features during training, thereby preventing overfitting and improving generalization.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eTransfer learning and pre-trained models: CNNs can benefit from pre-training on large-scale datasets such as ImageNet, where they learn generic features. These pre-trained models can then be fine-tuned on smaller, task-specific datasets, which saves training time while enhancing performance.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eData augmentation: Image rotation, scaling, and mirroring techniques are used to artificially expand the amount and diversity of the training dataset, allowing the network to generalize better to new data.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003c/ol\u003e \u003c/p\u003e \u003cp\u003eCNNs have outperformed traditional techniques in accuracy and performance in a variety of computer vision tasks. Because of their ability to automatically learn and extract significant features from visual data, as well as their hierarchical architecture, they have become a cornerstone of modern computer vision systems. CNNs are still being actively researched and developed, pushing the limits of what is achievable in visual identification and comprehension tasks.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e"},{"header":"3. Results","content":"\u003cdiv id=\"Sec5\" class=\"Section2\"\u003e \u003ch2\u003e3.1 Model Training\u003c/h2\u003e \u003cp\u003eOur drowsiness detection system consists of two main stages: face detection and drowsiness classification. In the face detection stage, we employ a pre-trained CNN model to detect and extract facial regions from the input video frames. This helps isolate the relevant area for subsequent drowsiness classification. For drowsiness classification, we train a CNN model on a large dataset of labeled images containing both drowsy and alert states. The CNN model learns to discriminate between these two states and predicts the likelihood of drowsiness based on extracted facial features (Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003e).\u003c/p\u003e \u003cp\u003eTo train the CNN model, we augment the dataset [\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e] with various transformations, such as image rotation and scaling, to improve generalization and robustness. We utilize a training-validation split to fine-tune the model parameters and optimize its performance. We also employ techniques like data balancing to address potential class imbalance issues and ensure accurate representation of both drowsy and alert instances.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec6\" class=\"Section2\"\u003e \u003ch2\u003e3.2 Results Evaluation\u003c/h2\u003e \u003cp\u003eAs mentioned before the model was trained and tested using the xxx dataset []. 70% of the data were used for training while the rest were used for testing the model. Table\u0026nbsp;\u003cspan refid=\"Tab1\" class=\"InternalRef\"\u003e1\u003c/span\u003e below shows the testing results of the network. We trained two models on the drowsiness detection dataset. The first model was a CNN built from scratch while the second was a pre-trained model (ResNet50). It was noticed that the pre-trained model achieved better accuracy than the one built from scratch. This is due to the learned weights that the pre-trained have from its original training on the huge ImageNet dataset, which grants powerful ability in extracting useful features from the face.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab1\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eResults evaluation of CNN and the ResNet50\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"2\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e\u0026nbsp;\u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eAccuracy\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eCNN\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e91%\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ePre-trained model (ResNet50)\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e95.6%\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cp\u003eFigure \u003cspan refid=\"Fig5\" class=\"InternalRef\"\u003e4\u003c/span\u003e and 5 show the accuracy variations the CNN and ResNet50, respectively.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e"},{"header":"4. Discussion","content":"\u003cp\u003ePreviously, machine learning algorithms were employed for manual feature extraction, however deep learning architectures now eliminate manual feature extraction. It learns automatically. Deep learning architectures now extract their features automatically. So, we save a lot of time here because we would otherwise have to spend time calculating the feature needs to better the categorization result.\u003c/p\u003e \u003cp\u003eThe drowsy observation model's dataset was extensively evaluated under a variety of light circumstances, including exposure and occlusion. In most circumstances, our model works perfectly. It has a higher than 90% accuracy rate. We tested the model on people of various ages and skin tones and found it to be effective. The success rate when driving in real-world scenarios was deemed perfect.\u003c/p\u003e \u003cp\u003eWe also discovered that its efficiency is lacking in several circumstances. In low-light settings or when the flashlight is focused at the camera lens in the backdrop, the trained model's performance was not totally satisfied. However, because the dataset did not contain any low-light photographs, it was acceptable. That is why we just expect it to perform properly in this situation.\u003c/p\u003e"},{"header":"5. Conclusion","content":"\u003cp\u003eOur experiments demonstrate the effectiveness of the deep learning CNN approach for drowsiness detection. The trained CNN model achieved an accuracy of 91% of a CNN built from scratch set, accurately classifying instances of drowsiness and alertness. The precision and recall values for drowsiness detection indicated a balanced performance. On the other hand, our pre-trained model showed higher performance (95.6%) in terms of accuracy compared to the CNN. The system also showed promising results in real-time video processing, exhibiting a low latency and providing timely drowsiness alerts.\u003c/p\u003e \u003cp\u003eIn this study, we successfully applied deep learning CNNs for the detection of drowsiness. The results indicate that CNN models can effectively learn and extract discriminative features from facial images, enabling accurate identification of drowsy states. Our system demonstrates high accuracy, precision, and recall values, highlighting its potential for real-world implementation in drowsiness detection systems. The application of deep learning CNNs in this context holds great promise for enhancing road safety by alerting drivers and preventing accidents caused by drowsy driving.\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\u003cli\u003e\u003cspan\u003eAmodio A, Ermidoro M, Maggi DFS, Savaresi SM (2018) Automatic detection of driver impairment based on pupillary light reflex.IEEE Transactions on Intelligent Transportation Systems, pp. 1\u0026ndash;11\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eYang JH, Mao ZH, Tijerina L, Pilutti T, Coughlin JF, Feron E (2009) Detection of driver fatigue caused by sleep deprivation. IEEE Trans Syst Man Cybernetics-Part A: Syst Hum 39(4):694\u0026ndash;705\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHu S, Zheng G (2009) Driver drowsiness detection with eyelid related parameters by support vector machine. Expert Syst Appl 36(4):7651\u0026ndash;7658\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eFujiwara K, Abe E, Kamata K, Nakayama C, Suzuki Y, Yamakawa T, Hiraoka T, Kano M, Sumi Y, Masuda F, Matsuo M, Kadotani H (2019) \u0026bdquo;\u0026bdquo;Heart rate variability-based driver drowsiness detection and its validation with EEG,‟‟ IEEE Trans. Biomed. Eng., vol. 66, no. 6, pp. 1769\u0026ndash;1778, Jun\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eGeorge CFP (2007) Nov. Sleep apnea, alertness, and motor vehicle crashes,‟‟ Amer. J. Respiratory Crit. Care Med., vol. 176, no. 10, pp. 954\u0026ndash;956\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eOwens JA, Dearth-Wesley T, Herman AN, Whitaker RC (2019) \u0026bdquo;\u0026bdquo;Drowsy driving, sleep duration, and chronotype in adolescents,‟‟ J. Pediatrics, vol. 205, pp. 224\u0026ndash;229, Feb\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAbiyev RH, Ma\u0026rsquo;aitaH MKS (2018) Deep convolutional neural networks for chest diseases detection. Journal of healthcare engineering, 2018(1), 4168538\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAbiyev RH, Altabel MZ, Darwish M, Helwan A (2024) A Multimodal Transformer Model for Recognition of Images from Complex Laparoscopic Surgical Videos. Diagnostics 14(7):681\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Ma\u0026rsquo;aitah MKS, Uzelaltinbulat S, Altobel MZ, Darwish M (2021), April Gaze prediction based on convolutional neural network. In International conference on emerging technologies and intelligent systems (pp. 215\u0026ndash;224). Cham: Springer International Publishing\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Azar D, Ma\u0026rsquo;aitah MKS (2024) Conventional and deep learning methods in heart rate estimation from RGB face videos. Physiol Meas 45(2):02TR01\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Ma\u0026rsquo;aitah MKS, Hamdan H, Ozsahin DU, Tuncyurek O (2021) Radiologists versus Deep Convolutional Neural Networks: A Comparative Study for Diagnosing COVID-19. Computational and Mathematical Methods in Medicine, 2021(1), 5527271\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Ma\u0026rsquo;aitah S, Abiyev MK, Uzelaltinbulat RH, S., Sonyel B (2021) Deep learning based on residual networks for automatic sorting of bananas. Journal of Food Quality, 2021(1), 5516368\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003e\u0026amp; Haque, M. A. (2021). An online survey and review about the awareness, coping style,and exercise behavior during the COVID-19 pandemic situation by implementing the cloud-based medical treatment technology system in China among the public. Science Progress, 104(2), 00368504211000889\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Ma\u0026rsquo;aitah MKS (2022), September Medical Application of Deep Learning-Based Detection on Malignant Melanoma. In \u003cem\u003eInternational Conference on Emerging Technologies and Intelligent Systems\u003c/em\u003e (pp. 627\u0026ndash;637). Cham: Springer International Publishing\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Ma\u0026rsquo;aitah MKS, Uzelaltinbulat S, Sonyel B, Altobel MZZ, Darwish M (2021), April Stacked autoencoders deep learning approach for left ventricular localization in magnetic resonance slices. In International Conference on Emerging Technologies and Intelligent Systems (pp. 225\u0026ndash;234). Cham: Springer International Publishing\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Azar D, Ma\u0026rsquo;aitah MKS (2024) Conventional and deep learning methods in heart rate estimation from RGB face videos. Physiol Meas 45(2):02TR01\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Menekay M, Ma\u0026rsquo;aitah MKS (2020), August Machine learning for better understanding of autistics. In International conference on theory and applications of fuzzy systems and soft computing (pp. 817\u0026ndash;825). Cham: Springer International Publishing\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Ma\u0026rsquo;aitah MKS (2020), August Machine learning in automated chest radiographs classification. In International conference on theory and applications of fuzzy systems and soft computing (pp. 810\u0026ndash;816). Cham: Springer International Publishing\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eMenekay M, Maaitah MKS (2017), December Applying expert system for bank credit authorization using fuzzy tools. In Proceedings of the 9th International Conference on Education Technology and Computers (pp. 258\u0026ndash;261)\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHelwan A, Ma\u0026rsquo;aitah MKS (2022), September Medical Application of Deep Learning-Based Detection on Malignant Melanoma. In International Conference on Emerging Technologies and Intelligent Systems (pp. 627\u0026ndash;637). Cham: Springer International Publishing\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eKaggle dataset \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003ehttps://www.kaggle.com/datasets/prasadvpatil/mrl-dataset\u003c/span\u003e\u003cspan address=\"https://www.kaggle.com/datasets/prasadvpatil/mrl-dataset\" targettype=\"URL\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\u003c/li\u003e\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":true,"hideJournal":true,"highlight":"","institution":"Girne American University","isAcceptedByJournal":false,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"Drowsiness, drowsy driving, CNN, pre-trained model, ResNet50","lastPublishedDoi":"10.21203/rs.3.rs-4808639/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-4808639/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eDrowsy driving is a huge risk to road safety, resulting in serious accidents. Drowsiness detection in drivers can assist prevent accidents by providing timely alarms and actions. In this research, we look at how deep learning Convolutional Neural Networks (CNNs) can be used to identify tiredness. We discuss our technique, experimental results, and conclusions about the efficacy of deep learning CNNs in solving this essential road safety issue. In this work, we employed two convolutional neural networks, one is built from scratch and another one that is a pre-trained model (ResNet). Our findings show that the pre-trained outperformed the one built from scratch achieving an accuracy of 95.6%\u003c/p\u003e","manuscriptTitle":"Drowsiness Detection for Drivers Using Convolutional Neural Networks (CNNs)","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-07-30 03:02:48","doi":"10.21203/rs.3.rs-4808639/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"bb45bcbc-266f-487f-821d-c39df032fb62","owner":[],"postedDate":"July 30th, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[{"id":35179076,"name":"Artificial Intelligence and Machine Learning"}],"tags":[],"updatedAt":"2024-07-30T03:02:48+00:00","versionOfRecord":[],"versionCreatedAt":"2024-07-30 03:02:48","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-4808639","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-4808639","identity":"rs-4808639","version":["v1"]},"buildId":"qtupq5eGEP_6zYnWcrvyt","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: preprint-html

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2024) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00