Research on Student Performance Prediction Based on Deep Learning

Research on Student Performance Prediction Based on Deep Learning | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Article Research on Student Performance Prediction Based on Deep Learning Wenjin Xu, Chang Gao, Hongning Yang This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-4967448/v1 This work is licensed under a CC BY 4.0 License Status: Posted Version 1 posted You are reading this latest preprint version Abstract Student performance serves as a crucial indicator for assessing learning outcomes across various educational institutions. Conducting reasonable predictions and analyses can provide insights into students' future academic achievements. Predicting student performance is a significant research direction in the current exploration of educational data analysis patterns. Accurate predictions can assist educational administrators and teachers in promptly identifying academic risks, optimizing the allocation of scarce educational resources, and consequently improving education quality and learning outcomes. This paper establishes a Convolutional Neural Network (CNN) prediction model, constructing training and testing datasets using PyTorch tensors based on existing student information data. By extracting target information columns, the model identifies patterns within the data and ultimately predicts a student's score in a specific subject for their next exam. Upon completing the predictions, the results are displayed in a chart alongside existing scores for analysis, providing a reference for developing subsequent training programs. Physical sciences/Mathematics and computing/Computational science Physical sciences/Mathematics and computing/Computer science Physical sciences/Mathematics and computing/Information technology Deep learning Grade prediction Convolutional neural network Feature extraction Figures Figure 1 Figure 2 Figure 3 Figure 4 Figure 5 Introduction In recent years, China's education sector has been undergoing extensive reform and development, with a significant increase in the number of newly enrolled students. For relevant functional departments, the advantages of large data storage capacity and diverse collection channels make it possible to use data mining techniques to more quickly and easily discover relationships within the data. This, in turn, provides scientific and rational references for decision-making, while also enhancing the credibility of national education policies 1 . In today's information era, the continuous development of relevant information technology provides solutions for various educational institutions 2 . Traditional statistical methods are insufficient to fully explore the latent patterns within the multidimensional data, including existing student information, academic performance, classroom behavior, and psychological states. Instead, leveraging multiple technologies such as machine learning, deep learning, and image processing can facilitate the feature extraction and analysis of complex high-dimensional data. By using a Convolutional Neural Network (CNN) model to analyze and predict student performance, educators can utilize the interpretability inherent in these learning methods to clearly understand the learning progress differences among students in a particular class. This enables the formulation of differentiated teaching plans, optimizing the allocation of educational resources, and improving education quality. Conducting in-depth analysis and evaluation of campus data related to student performance, and identifying valuable attribute features for performance analysis and prediction, has become a current research focus. As one of the earliest research directions in educational data mining, student performance prediction has been extensively studied by numerous scholars who have made significant contributions. The methods used in these studies can be categorized into two main types: traditional machine learning-based approaches and deep learning-based approaches. Grade Prediction Based on Traditional Machine Learning Methods.Wang et al. 3 combined students' gender, educational background data, subject background, and online learning behavior data, inputting these into a decision tree to predict academic performance. Xiaoli Wang et al. 4 proposed a weighted naive Bayes classification method based on mutual information and Bayesian classification algorithms to predict students' computer proficiency test scores. Ashenafi et al. 5 extracted features from students' classroom discussion questions and answer ratings that capture student activity information, using a multiple linear regression model to predict course grades. Jintao Hu 6 utilized decision trees to analyze all course grades, identifying the impact of basic course grades on specific professional course grades, and used the generated rules to establish a predictive model for professional course grades. As an ensemble learning meta-algorithm, Bagging was used by Hillebrand et al. 7 to reduce generalization error and improve prediction accuracy by combining different models. Ahmed 8 proposed using the GBDT algorithm to predict college students' performance in final exams. Grade Prediction Based on Deep Learning Methods.Okubo 9 proposed a method for predicting students' final grades by inputting log data stored in educational systems, such as attendance, video watching, and reports, into a recurrent neural network. Kalyani 10 applied convolutional neural networks (CNN) to predict student performance, considering that CNNs can mimic the human brain's behavior in analyzing and processing information, which helps solve problems beyond human capabilities. Hongjiang Cao 11 addressed the sequential nature of students' historical grades and the forgetting characteristics during the learning process by introducing an LSTM network to model students' knowledge structure states. By integrating emotional and behavioral features, the method significantly improved the accuracy of the grade prediction model according to experimental results. Qu et al. 12 constructed a grade prediction framework with an attention mechanism, using the attention mechanism to adjust the weights of partial time behaviors and behavior patterns. Experiments demonstrated that this model has higher accuracy compared to other methods. Aljaloud 13 tackled the issue of complex features and high processing difficulty in online learning systems by using CNN to extract learning features from time-series data, which were then fed into an LSTM neural network for grade prediction, proving the feasibility of this method. Tao Fang 14 proposed an Att-LSTM model, capable of filtering out key information from a large number of input features, with a focus on features that significantly impact student performance, to predict grades. Related technologies Principles of Data Processing Perform the following operations on the existing data:First, anonymize student information by replacing real names with specific non-numeric strings. Use letter codes as identifiers to determine whether the student meets certain special attributes and assign values accordingly. Second, after importing the dataset, create a new mapping dictionary to numerically replace all non-numeric strings that appear in the dataset. After replacement, define a data cleaning function to check for missing and abnormal values in the converted numerical data, provide timely warnings based on the check results, and make corrections to ensure data quality. Finally, perform one-hot encoding on the verified data. The purpose is to convert relevant feature columns into numerical values that can be processed by deep learning algorithms, maintain the independence of feature columns, and enhance the model's understanding ability.The principle of single hot encoding is shown in Fig. 1 . Convolutional Neural Network This study employs the Convolutional Neural Network (CNN) algorithm for deep learning analysis. Due to their efficiency in extracting implicit features and strong capability to hierarchically capture spatial structure information, some researchers use CNNs to extract latent features in students' learning activities 15 . This research uses the CNN feedforward algorithm as the foundational structure for student performance prediction analysis. The model structure is specifically divided into an input layer, convolution layer, pooling layer, fully connected layer, and output layer, as shown in Fig. 2 . Methods Ethics declarations This study confirms that all methods were conducted in accordance with relevant guidelines and regulations.This study confirms that all experimental protocols have been approved by Qingdao New Oriental School and Qingdao University of Science and Technology.This study confirms that informed consent has been obtained from all participants. Data Sources The dataset used in this study comes from Qingdao New Oriental School, containing historical exam scores and other relevant information about campus students, such as gender, age, and school attended. This dataset includes information on a total of 2,225 students from numerous schools, with the chosen subject for performance prediction being junior high school mathematics. To avoid involving personal privacy information, this study anonymized the relevant columns in the dataset before processing the information, ensuring the dataset's authenticity and validity. This, in turn, aims to achieve the most accurate results possible in subsequent prediction processes. Detailed student information is shown in Table 1 . Table 1 student information data Attribute Number Attribute Name Attribute Type 1 Name varchar 2 Gender varchar 3 Age char 4 School varchar 5 Keyclass char 6 Grade float Data Processing In this study, the processing of both the training and testing datasets by the CNN model requires converting them into PyTorch tensors. By using One-Hot Encoding, each category of data is transformed into a fixed-length binary vector, ensuring that the desired input data has consistent shapes and dimensions. One-Hot Encoding is a method of mapping discrete feature data into a high-dimensional space. The principle involves using an N-bit state register to encode N states, with only one bit outputting a valid value of 1 at any given time. This method converts discrete variables into independent binary vectors, avoiding data misrepresentation during training. Let X be a categorical variable with k possible values, denoted as { x 1 , x 2 , x 3 ,..., x k }.The One-Hot Encoding for X can be represented as: $$OneHot(X)=[{v_1},{v_2},{v_3}, \cdots ,{v_k}]$$ 1 Among them, vk is defined as: $${v_k}=\left\{ \begin{gathered} 1,x={x_k} \hfill \\ 0,x \ne {x_k} \hfill \\ \end{gathered} \right.$$ 2 The vectors generated by One-Hot Encoding are used in a sparse representation. This method can significantly reduce computational complexity and memory consumption while enhancing the model's ability to distinguish between different categories and capture subtle differences between features. To mitigate the significant data level differences caused by varying scales, it is necessary to normalize the dataset by scaling the data into a similar range, thereby enhancing the accuracy of classification. Min-Max scaling 16 is one of the most well-known methods for standardizing information, where each element's base estimate is transformed to 0, the maximum value to 1, and other values to decimals between 0 and 1. In this study, the Min-Max normalization method is employed to normalize student information, scaling all numerical features encoded previously within a specified range. The processed data feature values are represented as Eq. ( 3 ). 3 In this study, after the dataset underwent one-hot encoding, the categorical features of the original data were transformed into numerical features. These categorical features refer specifically to the column names of the dataset, preserving not only their independence but also ensuring compatibility with convolutional neural network models. Subsequently, after normalization, all data in the dataset can be converted into PyTorch two-dimensional tensors using the `torch.size()` function, preparing them for model training. The normalized feature data and the label data stored in the original dataset are separately stored in two tensors, X and Y . Based on the dimensions of the divided training and testing sets, the dimensions of tensors X and Y are updated as follows: the dimensions of the training set features ` train_X ` are torch.Size([1780,7]), the dimensions of the training set labels ` train_Y ` are torch.Size([1780,1]), the dimensions of the testing set features ` test_X ` are torch.Size([445,7]), and the dimensions of the testing set labels ` test_Y ` are torch.Size([445,1]). Experimental environment and parameters In this study, the PyTorch deep learning framework and the CNN (Convolutional Neural Network) algorithm were employed. PyTorch tensors, used instead of NumPy's ndarray data structure, offer automatic differentiation capabilities. This feature enables automatic computation of tensor gradients, which plays a crucial role in training neural networks. The environment parameters configuration is detailed in Table 2 . Table 2 Parameter configuration of python Parameter Configuration Pandas 1.1.5 Numpy 1.19.5 Torch 1.10.2 Matplotlib 3.3.4 Scikit-learn 0.24.2 Keras 2.10.0 Training parameters The parameters for training the CNN network model in this article are shown in Table 3 . Table 3 CNN network dataset parameter configuration Parameter Configuration data_frame [2225,13] features_columns [2225,8] train_X.shape torch.Size([1780,7]) train_y.shape torch.Size([1780,1]) test_X.shape torch.Size([445,7]) test_y.shape torch.Size([445,1]) batch_size 32 num_epochs 100 Training Process Before constructing the CNN neural network model, it is essential to set up a crucial component: the data loader. The data loader divides input data into multiple small batches, loading only one batch at a time during each training iteration. This approach ensures faster gradient descent and parameter updates when using batched data. Data loaders are used to manage and store data for both the training and testing sets, ensuring efficient handling and utilization of data throughout the model training process. During the training process of the CNN network model, an outer loop first iterates over the number of training epochs, setting the model to training mode to enable specific layers such as dropout and batch normalization. Throughout training, backpropagation is repeatedly used to compute gradients for each parameter. However, performing backpropagation multiple times can lead to gradient explosion, causing the model to fail to train properly and resulting in overflow errors in numerical computations. Therefore, gradient clipping is introduced to prevent such distortions.After training is completed, the iterated data is fed into the test model to compute the output. The loss function is then used to measure the loss between the predicted values and the true labels. The model's performance is ultimately validated using the Mean Squared Error (MSE). A lower MSE value, approaching zero, indicates better model performance. The formula for calculating MSE is shown in Eq. ( 4 ),where n is the number of samples, y i is the true value of the i-th sample, and \({\hat {y}_i}\) is the predicted value of the i-th sample. $$MSE=\frac{1}{n}\sum\limits_{{i=1}}^{n} {{{({y_i} - {{\hat {y}}_i})}^2}}$$ 4 In this study, the constructed CNN model incorporates an adaptive pooling layer, which automatically calculates the size of each pooling window based on the input feature map size and the target output size. This simplifies the feature extraction process. After passing through the adaptive pooling layer, the lengths of the two sets of tensor sequences are adjusted to 10. These tensors are then flattened according to the channel number and sequence length and sequentially fed into two fully connected layers. Each set of feature values is combined with the initial weights of the input and output nodes and mapped to the predicted values. Consequently, the shapes of the tensors for the training and testing sets are adjusted accordingly. Model innovation Compared to Recurrent Neural Networks (RNNs), this study opts to use Convolutional Neural Networks (CNNs) for data training and prediction for several reasons: High Spatial Structure Utilization: The convolutional layers in CNN models can effectively capture spatial local features in the input data. For two-dimensional tensors, the convolution operation achieves weight sharing spatially. As the convolution kernel slides systematically over the input data, the model can extract features from various parts in a directional sequence. Parameter Sharing in Convolutions: During convolution operations, the same convolutional kernel is applied across the entire input image, with the weights on the convolution kernel remaining identical. This significantly reduces the number of parameters the model needs to process, thereby enhancing computational efficiency and the model's generalization ability. Additionally, parameter sharing confers translational invariance to the convolutional layers, allowing the convolutional kernel to correctly identify features regardless of where they appear in the data. Multi-Scale Feature Extraction: Through multiple layers of convolution and pooling operations, CNN models can progressively extract multi-scale features from the data. Low-level convolutions can capture edge features in the input data, while high-level convolutions can extract object features contained within the input data. Results When processing time series data, RNN recurrent neural networks are commonly used for analysis. In order to more intuitively demonstrate which model is more advantageous between CNN and RNN in processing student data and making predictions, this study used the LSTM algorithm for comparison 17 . The xLSTM algorithm extends upon LSTM to enhance model performance and the capability to handle complex sequential data. It introduces an exponential gating mechanism to provide the model with more dynamic information filtering capabilities. Additionally, it incorporates additional normalization and stabilization techniques to mitigate numerical stability issues arising from the exponential gating. The design objective of xLSTM is to address limitations of traditional LSTM in handling large-scale data and long sequences, such as poor parallelism and limited storage capacity. By introducing new gating mechanisms and memory structures, xLSTM aims to be more competitive in deep learning applications. The prediction results of xLSTM are depicted in Fig. 3 . Based on the parameters described above, the CNN convolutional neural network model is constructed and the data training is initiated. To ensure the training results are as accurate as possible, the training is set for 100 epochs. Using Python, implement the CNN convolutional neural network algorithm by storing the target student's data information in the form of a numpy array, performing feature extraction, Min-Max normalization, regularization, and tensor conversion. Finally, input the transformed data tensors into the CNN model to compute the prediction values and output them, updating the original dataset. The prediction results of CNN convolutional neural network model are shown in Fig. 4 . The comparison of mean square error (MSE) and root mean square error (RMSE) between CNN convolutional neural network model and xLSTM algorithm is shown in Fig. 5 . In comparison to the predictions of the xLSTM algorithm, the CNN model performs better in both numerical prediction and model performance validation. Despite xLSTM's strong performance in handling time series data, in this study, the CNN model excels in predicting and analyzing student grade data over an entire academic year. The fixed two-dimensional tensor dimensions are advantageous for convolutional operations in the CNN model. Conversely, models built on xLSTM require the decomposition of two-dimensional tensors into one-dimensional tensors for training and analysis, potentially leading to feature loss during intermediate processes, thereby affecting prediction outcomes. Discussion This paper analyzes student performance over a school year's large-scale exams, incorporating personal information such as age, gender, and school to conduct multidimensional performance analysis. Leveraging CNN convolutional neural networks within the PyTorch programming environment, compared to RNN recurrent neural networks and Transformer technology, CNNs are more suitable for handling spatially structured and large-scale data. Their inherent features of parameter sharing, automatic feature extraction, and strong transfer learning capabilities distinguish CNNs among various technologies, making them widely applicable across different domains. Therefore, this study chooses CNN models for performance prediction analysis, ensuring stability and accuracy of the predictions to a certain extent. After multiple training iterations with input data fed into the model, the predicted results undergo validation through mean squared error checks, establishing the reliability of using this network model for predictive analysis with a degree of confidence in the data. The model still has its limitations. For instance, the performance data only considers scores from large-scale exams within the current school year, which spans a significant period. The study interval of one month between exams may lead to substantial fluctuations in students' day-to-day learning states, thereby questioning the reliability of the chosen exam scores. Additionally, the collected personal information about students, including age, school, and enrollment in specialized classes, are factors that could significantly influence performance but are immutable. The study did not explore potentially influential mutable factors such as classroom behavior and psychological activities of the students. Considering these variables could potentially alter the predictive outcomes. These are aspects that warrant further investigation. Declarations Author Contribution W.X. proposed research directions and innovative points, and analyzed the experimental results. C.G. provided the dataset and wrote code to complete the experimental part of the paper. H.Y. is responsible for writing, polishing, formatting, and formatting the paper. All authors have read and agreed to the published version of the manuscript. Data Availability The dataset generated and analyzed in this study cannot be made public as it contains information that may compromise the privacy of research participants. However, it can be obtained from the corresponding authors upon reasonable request. References Wang Zang. Research on Learning Status and Grade Prediction Method Based on Deep Learning [D]. Guizhou University. DOI: (2023). 10.27047/d.cnki.ggudu.2023.000655 Sayed, A. R., Khafagy, M. H. & Ali, M. Marwa Hussien Mohamed,Predict student learning styles and suitable assessment methods using click stream. Wang, G. H., Zhang, J. & Fu, G. S. Predicting student behaviors and performance in online learning using decision tree. 2018 Seventh International Conference of Educational Innovation through Technology (Eitt 2018) [J]. 214–219. (2018). Wang & Xiaoli Yuan Junhong. Grade Prediction Model Based on Weighted Naive Bayes Classification Method. Electronics Technology and Software Engineering [J]. (19): 225–226. (2013). Ashenafi, M. M., Riccardi, G. & Ronchetti, M. Predicting students' final exam scores from their course activities. Frontiers in Education Conference (Fie), 372–380. (2015) [J].2015. Hu Jintao. Research and Implementation of Student Performance Prediction Teaching System Based on C4.5 Decision Tree (Southwest Jiaotong University [D], 2017). Hillebrand, E., Lukas, M. & Wei, W. Bagging weak predictors. Int. J. Forecast. [J] . 37 (1), 237–254 (2021). Ahmed, D. M., Abdulazeez, A. M. & Zeebaree, D. Q. Ahmed Fyh. Predicting university's students performance based on machine learning techniques[C]//2021 IEEE International Conference on Automatic Control & Intelligent Systems (I2CACIS).2021. Okubo, F., Yamashita, T., Shimada, A. & Ogata, H. A neural network approach for students' performance prediction. Seventh International Learning Analytics & Knowledge Conference (Lak'17) [J]. 598–599. (2017). Kalyani, B. S., Harisha, D., Ramyakrishna, V. & Manne, S. Evaluation of students performance using neural networks. Intelligent Computing, Information and Control Systems, Iciccs 2019 [J]. 1039: 499–505. (2020). Hongjiang, C. & Xie Jin.. Research on Learning Performance Prediction Based on LSTM and Its Influencing Factors. Journal of Beijing University of Posts and Telecommunications (Social Sciences Edition) [J]. 22 (06): 90–100. (2020). Qu, S. J., Li, K., Wu, B., Zhang, S. H. & Wang, Y. C. Predicting student achievement based on temporal learning behavior in MOOCs. Appl. Sciences-Basel [J] 9 (24). (2019). Aljaloud, A. S. et al. A deep learning model to predict student learning outcomes in LMS using CNN and LSTM. IEEE Access. [J] . 10 , 85255–85265 (2022). Fang Tao. Research on Student Performance Prediction Model Based on Ensemble Learning Algorithms (Guilin University of Electronic Technology [D], 2022). Wang, C. & Research on Performance Prediction Method Based on Student Online Learning Behavior [D].. Guilin University of Electronic Technology, DOI: (2022). 10.27049/d.cnki.ggldc.2022.000414 Deng, J. & Huang, X. Xiaopeng Ren,A multidimensional analysis of self-esteem and individualism: A deep learning-based model for predicting elementary school students' academic performance. Sun Ruiqi. Research on Prediction Model of US Stock Index Price Trends Based on LSTM Neural Network [D] (Capital University of Economics and Business, 2016). Additional Declarations No competing interests reported. Cite Share Download PDF Status: Posted Version 1 posted You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-4967448","acceptedTermsAndConditions":true,"allowDirectSubmit":true,"archivedVersions":[],"articleType":"Article","associatedPublications":[],"authors":[{"id":362933269,"identity":"bc29d9f8-a413-4573-a950-564b27bbf6f8","order_by":0,"name":"Wenjin Xu","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAA7UlEQVRIie3QMUvEMBTA8VcCmcJ1faXH3VeIS1Q46ldJiXQTbtIKNxSU62Dd/RidxLE1Epe4dxAuLs53m8Mhuitt3Rzym98f3nsAnvcP0bl+3mK+SE4K3TqZr4aTCdIMjmymeGAUd9YMJzNkAi7Xj0FNrIjersmIxeJKuI425JBakacFhbC8kf3J1Fwc3LHXyXFlzrv0YQpoX+r+BFQdI74T6PR9l1oKHM+GEsnjPddBsXFima7JiARPBaLUQd08CRiXsO/fYpOpqDAKpTVs8JZ5edW66HORhKDb3Ue+moXlbX/yA/vbuOd5nverLxcFT7GPQ4KlAAAAAElFTkSuQmCC","orcid":"","institution":"Qingdao University of Science and Technology","correspondingAuthor":true,"prefix":"","firstName":"Wenjin","middleName":"","lastName":"Xu","suffix":""},{"id":362933270,"identity":"3d957ab9-a9b3-430c-862b-9e78882b6948","order_by":1,"name":"Chang Gao","email":"","orcid":"","institution":"Qingdao University of Science and Technology","correspondingAuthor":false,"prefix":"","firstName":"Chang","middleName":"","lastName":"Gao","suffix":""},{"id":362933271,"identity":"9a7b75e4-ad7e-42ba-856e-3fe8bdce073a","order_by":2,"name":"Hongning Yang","email":"","orcid":"","institution":"Qingdao University of Science and Technology","correspondingAuthor":false,"prefix":"","firstName":"Hongning","middleName":"","lastName":"Yang","suffix":""}],"badges":[],"createdAt":"2024-08-24 06:02:18","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-4967448/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-4967448/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":66316944,"identity":"4035890c-8cc8-4bc6-af38-7eb330f0ef13","added_by":"auto","created_at":"2024-10-10 10:33:38","extension":"jpeg","order_by":1,"title":"Figure 1","display":"","copyAsset":false,"role":"figure","size":18623,"visible":true,"origin":"","legend":"\u003cp\u003eOne-hot encoding principle\u003c/p\u003e","description":"","filename":"floatimage1.jpeg","url":"https://assets-eu.researchsquare.com/files/rs-4967448/v1/43292d9df4fee3adb89097ac.jpeg"},{"id":66316941,"identity":"ebb7d7ff-12aa-4419-9c98-3253c6c28c56","added_by":"auto","created_at":"2024-10-10 10:33:38","extension":"png","order_by":2,"title":"Figure 2","display":"","copyAsset":false,"role":"figure","size":70183,"visible":true,"origin":"","legend":"\u003cp\u003eCNN model structure\u003c/p\u003e","description":"","filename":"floatimage2.png","url":"https://assets-eu.researchsquare.com/files/rs-4967448/v1/d35789fe5bd3799428f04d63.png"},{"id":66316946,"identity":"d4acf3a5-91d6-4077-9826-5e17419d489e","added_by":"auto","created_at":"2024-10-10 10:33:40","extension":"png","order_by":3,"title":"Figure 3","display":"","copyAsset":false,"role":"figure","size":31009,"visible":true,"origin":"","legend":"\u003cp\u003exLSTM prediction results\u003c/p\u003e","description":"","filename":"floatimage3.png","url":"https://assets-eu.researchsquare.com/files/rs-4967448/v1/ad0ef0f3f777f514edcda7fa.png"},{"id":66317786,"identity":"bff1ce56-77f4-41b2-90c7-5bc4570f6aa3","added_by":"auto","created_at":"2024-10-10 10:49:41","extension":"png","order_by":4,"title":"Figure 4","display":"","copyAsset":false,"role":"figure","size":112299,"visible":true,"origin":"","legend":"\u003cp\u003eCNN prediction result\u003c/p\u003e","description":"","filename":"floatimage4.png","url":"https://assets-eu.researchsquare.com/files/rs-4967448/v1/cba1c45442fcbd001c5942d7.png"},{"id":66317693,"identity":"d0c20540-53e4-4ff9-b27e-bb5536928b32","added_by":"auto","created_at":"2024-10-10 10:41:38","extension":"png","order_by":5,"title":"Figure 5","display":"","copyAsset":false,"role":"figure","size":15745,"visible":true,"origin":"","legend":"\u003cp\u003eComparison of Algorithm Metrics\u003c/p\u003e","description":"","filename":"floatimage5.png","url":"https://assets-eu.researchsquare.com/files/rs-4967448/v1/4a5e5cbd82fa10d58824f31a.png"},{"id":73472926,"identity":"559d8105-4e84-4e86-995b-1c6c2e140bfa","added_by":"auto","created_at":"2025-01-10 09:54:04","extension":"pdf","order_by":0,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":730604,"visible":true,"origin":"","legend":"","description":"","filename":"manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-4967448/v1/8b4765cb-dfda-4681-9a48-22177e8082da.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Research on Student Performance Prediction Based on Deep Learning","fulltext":[{"header":"Introduction","content":"\u003cp\u003eIn recent years, China's education sector has been undergoing extensive reform and development, with a significant increase in the number of newly enrolled students. For relevant functional departments, the advantages of large data storage capacity and diverse collection channels make it possible to use data mining techniques to more quickly and easily discover relationships within the data. This, in turn, provides scientific and rational references for decision-making, while also enhancing the credibility of national education policies\u003csup\u003e\u003cspan citationid=\"CR1\" class=\"CitationRef\"\u003e1\u003c/span\u003e\u003c/sup\u003e.\u003c/p\u003e \u003cp\u003eIn today's information era, the continuous development of relevant information technology provides solutions for various educational institutions\u003csup\u003e\u003cspan citationid=\"CR2\" class=\"CitationRef\"\u003e2\u003c/span\u003e\u003c/sup\u003e. Traditional statistical methods are insufficient to fully explore the latent patterns within the multidimensional data, including existing student information, academic performance, classroom behavior, and psychological states. Instead, leveraging multiple technologies such as machine learning, deep learning, and image processing can facilitate the feature extraction and analysis of complex high-dimensional data. By using a Convolutional Neural Network (CNN) model to analyze and predict student performance, educators can utilize the interpretability inherent in these learning methods to clearly understand the learning progress differences among students in a particular class. This enables the formulation of differentiated teaching plans, optimizing the allocation of educational resources, and improving education quality. Conducting in-depth analysis and evaluation of campus data related to student performance, and identifying valuable attribute features for performance analysis and prediction, has become a current research focus.\u003c/p\u003e \u003cp\u003eAs one of the earliest research directions in educational data mining, student performance prediction has been extensively studied by numerous scholars who have made significant contributions. The methods used in these studies can be categorized into two main types: traditional machine learning-based approaches and deep learning-based approaches.\u003c/p\u003e \u003cp\u003eGrade Prediction Based on Traditional Machine Learning Methods.Wang et al.\u003csup\u003e\u003cspan citationid=\"CR3\" class=\"CitationRef\"\u003e3\u003c/span\u003e\u003c/sup\u003e combined students' gender, educational background data, subject background, and online learning behavior data, inputting these into a decision tree to predict academic performance. Xiaoli Wang et al. \u003csup\u003e\u003cspan citationid=\"CR4\" class=\"CitationRef\"\u003e4\u003c/span\u003e\u003c/sup\u003e proposed a weighted naive Bayes classification method based on mutual information and Bayesian classification algorithms to predict students' computer proficiency test scores. Ashenafi et al. \u003csup\u003e\u003cspan citationid=\"CR5\" class=\"CitationRef\"\u003e5\u003c/span\u003e\u003c/sup\u003e extracted features from students' classroom discussion questions and answer ratings that capture student activity information, using a multiple linear regression model to predict course grades. Jintao Hu \u003csup\u003e\u003cspan citationid=\"CR6\" class=\"CitationRef\"\u003e6\u003c/span\u003e\u003c/sup\u003e utilized decision trees to analyze all course grades, identifying the impact of basic course grades on specific professional course grades, and used the generated rules to establish a predictive model for professional course grades. As an ensemble learning meta-algorithm, Bagging was used by Hillebrand et al. \u003csup\u003e\u003cspan citationid=\"CR7\" class=\"CitationRef\"\u003e7\u003c/span\u003e\u003c/sup\u003e to reduce generalization error and improve prediction accuracy by combining different models. Ahmed\u003csup\u003e\u003cspan citationid=\"CR8\" class=\"CitationRef\"\u003e8\u003c/span\u003e\u003c/sup\u003e proposed using the GBDT algorithm to predict college students' performance in final exams.\u003c/p\u003e \u003cp\u003eGrade Prediction Based on Deep Learning Methods.Okubo\u003csup\u003e\u003cspan citationid=\"CR9\" class=\"CitationRef\"\u003e9\u003c/span\u003e\u003c/sup\u003e proposed a method for predicting students' final grades by inputting log data stored in educational systems, such as attendance, video watching, and reports, into a recurrent neural network. Kalyani\u003csup\u003e\u003cspan citationid=\"CR10\" class=\"CitationRef\"\u003e10\u003c/span\u003e\u003c/sup\u003e applied convolutional neural networks (CNN) to predict student performance, considering that CNNs can mimic the human brain's behavior in analyzing and processing information, which helps solve problems beyond human capabilities. Hongjiang Cao\u003csup\u003e\u003cspan citationid=\"CR11\" class=\"CitationRef\"\u003e11\u003c/span\u003e\u003c/sup\u003e addressed the sequential nature of students' historical grades and the forgetting characteristics during the learning process by introducing an LSTM network to model students' knowledge structure states. By integrating emotional and behavioral features, the method significantly improved the accuracy of the grade prediction model according to experimental results. Qu et al. \u003csup\u003e\u003cspan citationid=\"CR12\" class=\"CitationRef\"\u003e12\u003c/span\u003e\u003c/sup\u003e constructed a grade prediction framework with an attention mechanism, using the attention mechanism to adjust the weights of partial time behaviors and behavior patterns. Experiments demonstrated that this model has higher accuracy compared to other methods. Aljaloud\u003csup\u003e\u003cspan citationid=\"CR13\" class=\"CitationRef\"\u003e13\u003c/span\u003e\u003c/sup\u003e tackled the issue of complex features and high processing difficulty in online learning systems by using CNN to extract learning features from time-series data, which were then fed into an LSTM neural network for grade prediction, proving the feasibility of this method. Tao Fang\u003csup\u003e\u003cspan citationid=\"CR14\" class=\"CitationRef\"\u003e14\u003c/span\u003e\u003c/sup\u003e proposed an Att-LSTM model, capable of filtering out key information from a large number of input features, with a focus on features that significantly impact student performance, to predict grades.\u003c/p\u003e\n\u003ch3\u003eRelated technologies\u003c/h3\u003e\n\u003cdiv id=\"Sec3\" class=\"Section2\"\u003e \u003ch2\u003ePrinciples of Data Processing\u003c/h2\u003e \u003cp\u003ePerform the following operations on the existing data:First, anonymize student information by replacing real names with specific non-numeric strings. Use letter codes as identifiers to determine whether the student meets certain special attributes and assign values accordingly. Second, after importing the dataset, create a new mapping dictionary to numerically replace all non-numeric strings that appear in the dataset. After replacement, define a data cleaning function to check for missing and abnormal values in the converted numerical data, provide timely warnings based on the check results, and make corrections to ensure data quality. Finally, perform one-hot encoding on the verified data. The purpose is to convert relevant feature columns into numerical values that can be processed by deep learning algorithms, maintain the independence of feature columns, and enhance the model's understanding ability.The principle of single hot encoding is shown in Fig.\u0026nbsp;\u003cspan refid=\"Fig1\" class=\"InternalRef\"\u003e1\u003c/span\u003e.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec4\" class=\"Section2\"\u003e \u003ch2\u003eConvolutional Neural Network\u003c/h2\u003e \u003cp\u003eThis study employs the Convolutional Neural Network (CNN) algorithm for deep learning analysis. Due to their efficiency in extracting implicit features and strong capability to hierarchically capture spatial structure information, some researchers use CNNs to extract latent features in students' learning activities\u003csup\u003e\u003cspan citationid=\"CR15\" class=\"CitationRef\"\u003e15\u003c/span\u003e\u003c/sup\u003e. This research uses the CNN feedforward algorithm as the foundational structure for student performance prediction analysis. The model structure is specifically divided into an input layer, convolution layer, pooling layer, fully connected layer, and output layer, as shown in Fig.\u0026nbsp;\u003cspan refid=\"Fig2\" class=\"InternalRef\"\u003e2\u003c/span\u003e.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003c/div\u003e"},{"header":"Methods","content":"\u003cdiv id=\"Sec6\" class=\"Section2\"\u003e \u003ch2\u003eEthics declarations\u003c/h2\u003e \u003cp\u003eThis study confirms that all methods were conducted in accordance with relevant guidelines and regulations.This study confirms that all experimental protocols have been approved by Qingdao New Oriental School and Qingdao University of Science and Technology.This study confirms that informed consent has been obtained from all participants.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec7\" class=\"Section2\"\u003e \u003ch2\u003eData Sources\u003c/h2\u003e \u003cp\u003eThe dataset used in this study comes from Qingdao New Oriental School, containing historical exam scores and other relevant information about campus students, such as gender, age, and school attended. This dataset includes information on a total of 2,225 students from numerous schools, with the chosen subject for performance prediction being junior high school mathematics. To avoid involving personal privacy information, this study anonymized the relevant columns in the dataset before processing the information, ensuring the dataset's authenticity and validity. This, in turn, aims to achieve the most accurate results possible in subsequent prediction processes. Detailed student information is shown in Table\u0026nbsp;\u003cspan refid=\"Tab1\" class=\"InternalRef\"\u003e1\u003c/span\u003e.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab1\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 1\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003estudent information data\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"3\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c3\" colnum=\"3\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eAttribute Number\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eAttribute Name\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c3\"\u003e \u003cp\u003eAttribute Type\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e1\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eName\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003evarchar\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e2\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eGender\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003evarchar\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e3\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eAge\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003echar\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e4\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eSchool\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003evarchar\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e5\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eKeyclass\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003echar\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003e6\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003eGrade\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c3\"\u003e \u003cp\u003efloat\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec8\" class=\"Section2\"\u003e \u003ch2\u003eData Processing\u003c/h2\u003e \u003cp\u003eIn this study, the processing of both the training and testing datasets by the CNN model requires converting them into PyTorch tensors. By using One-Hot Encoding, each category of data is transformed into a fixed-length binary vector, ensuring that the desired input data has consistent shapes and dimensions. One-Hot Encoding is a method of mapping discrete feature data into a high-dimensional space. The principle involves using an N-bit state register to encode N states, with only one bit outputting a valid value of 1 at any given time. This method converts discrete variables into independent binary vectors, avoiding data misrepresentation during training. Let \u003cem\u003eX\u003c/em\u003e be a categorical variable with \u003cem\u003ek\u003c/em\u003e possible values, denoted as {\u003cem\u003ex\u003c/em\u003e\u003csub\u003e1\u003c/sub\u003e,\u003cem\u003ex\u003c/em\u003e\u003csub\u003e2\u003c/sub\u003e,\u003cem\u003ex\u003c/em\u003e\u003csub\u003e3\u003c/sub\u003e,...,\u003cem\u003ex\u003c/em\u003e\u003csub\u003ek\u003c/sub\u003e}.The One-Hot Encoding for \u003cem\u003eX\u003c/em\u003e can be represented as:\u003cdiv id=\"Equ1\" class=\"Equation\"\u003e\u003cdiv format=\"TEX\" class=\"mathdisplay\" id=\"FileID_Equ1\" name=\"EquationSource\"\u003e\n$$OneHot(X)=[{v_1},{v_2},{v_3}, \\cdots ,{v_k}]$$\u003c/div\u003e\u003cdiv class=\"EquationNumber\"\u003e1\u003c/div\u003e\u003c/div\u003e\u003c/p\u003e \u003cp\u003eAmong them, vk is defined as:\u003cdiv id=\"Equ2\" class=\"Equation\"\u003e\u003cdiv format=\"TEX\" class=\"mathdisplay\" id=\"FileID_Equ2\" name=\"EquationSource\"\u003e\n$${v_k}=\\left\\{ \\begin{gathered} 1,x={x_k} \\hfill \\\\ 0,x \\ne {x_k} \\hfill \\\\ \\end{gathered} \\right.$$\u003c/div\u003e\u003cdiv class=\"EquationNumber\"\u003e2\u003c/div\u003e\u003c/div\u003e\u003c/p\u003e \u003cp\u003eThe vectors generated by One-Hot Encoding are used in a sparse representation. This method can significantly reduce computational complexity and memory consumption while enhancing the model's ability to distinguish between different categories and capture subtle differences between features.\u003c/p\u003e \u003cp\u003eTo mitigate the significant data level differences caused by varying scales, it is necessary to normalize the dataset by scaling the data into a similar range, thereby enhancing the accuracy of classification. Min-Max scaling\u003csup\u003e\u003cspan citationid=\"CR16\" class=\"CitationRef\"\u003e16\u003c/span\u003e\u003c/sup\u003e is one of the most well-known methods for standardizing information, where each element's base estimate is transformed to 0, the maximum value to 1, and other values to decimals between 0 and 1. In this study, the Min-Max normalization method is employed to normalize student information, scaling all numerical features encoded previously within a specified range. The processed data feature values are represented as Eq.\u0026nbsp;(\u003cspan refid=\"Equ3\" class=\"InternalRef\"\u003e3\u003c/span\u003e).\u003c/div\u003e\u003cp\u003e\u003cimg src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAIMAAAA4CAYAAADekEvQAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAAJcEhZcwAADsMAAA7DAcdvqGQAAARmSURBVHhe7Zu9S+xMFMbP3lqxsBI7RWy1sBErP0ALQQQbi7VSQVBQRLDU1o9eLMUPsFQrQfAPUKwVtFJr0T43z7wz82Zzc2+S2WQnk5wfhE0mszuZmSdzzpnZqXk+xDA+v+Qnw7AYmP9hMTAaFgOjYTEwGhYDo2ExMJrKiOH6+ppqtZo+ent76fPzU9xbWFhouIe8WWKz7FRg0qkqPD8/ez09Pd7Y2Jj3/f0tUz3v4+PDGxoa8g4PDxvSs8Rm2UmplBjA/v6+6BR0AkAHbG5uis7KG5tlJ6FyYnh8fPQ6Ozu9q6urlneGzbKTULm1CdjqkZERGhgYIP8tpaWlJerr65N388Vm2UmoXDTR1dUlOuTp6Ynm5+db2hk2y05C5cTw8/ND7+/v9PX1JVNah82yk1ApMaAzdnZ2aGNjQ1zf3d2JzzjC4V/UcXBwIHNHY1p2SxGeQ07Ae4azVASCDhvOEeKFw7y8sFl2GnIdGTo6Oqi7u1te2ePl5UW8lcpha2tro6mpKXp7eyO/Q2SufMiybDigExMTesIqc6QocuH4+FiEUzY5Pz/3JicndWyvwIiF6mP0ygubZZuQSgyqEuoITqDU6/WGe7bNg4rp1fMEh2V0QvBZkS9L0ZqWjc/FxUWRH/fwMqGNVTvjGB8fF59o39nZWZE32A/NkHpkgN1D4WGbh4cpyrSqi6DN0KZKHBCN6mSco/NVGvognDeLly+1zwC7t7Ky0mDz4Cn7IqDT01NaX18XdpFJB9psb29PRC6Dg4PU398v2hlzE4rl5WXyRfBH3qwwciBHR0dFrPzw8KBDpqLNpjEGyBEiFRi6MFzBZhVtft1llN8Fx1P5AjADyiwjHfdhFpAXZuLm5kbfb9Y8G0cTeBj1sCaEHc6oA5VmWofRQhVMw8zMjJhjv729zdRuMfZI7TM4Ma3KmCHGh4TAJmU1rWpqJqLy8WF2hEksBggg7CyquDeLCQ/GPonMxMXFBa2trQnTEAwfEQu/vr7S2dmZTGGcRooiEkQKJtOqjJvwlnxGk+sSNuMWpRCDM5tU/kEh6iCMRQlAlBM1LevSaqrtOpRGDCAc6qLhXFs7sVmHUolBRT9Y23dRCMBmHUoVTRR9k0oSbNahVNFE0TepJMFmHUolBiyiFXmTShJs1qE0YrC9mlqKjTbCc3CcoKOF82ZWU21RhDo4PzLY3CCTFYXZaCNF4SSubVKJokh1cFIMzaym4vxvG1Xw51L1uyrOV/l2d3d1/J8FedUB90w32pRq0ikO1bmqcYOzfTgfHh4WDYhzHMHvQAz39/cizSZJ6oBr+B7hfHFCLlVoGUfcRpXt7W26vLwk35ET1wDfOTk5Ib8hqb29XabaI64Oq6urxhttKiWGOKanp2lubo78t0im/OeQ1et1Ojo6oq2tLTPHzBXkCFEZ1B9xozaqIB1HeKjFd5AHQy6ulW23RZI6wCwgH5456UYb/qcTo2EzwWhYDIyGxcBoWAyMhsXAaFgMjIToN0BrnG7XqCpcAAAAAElFTkSuQmCC\"\u003e\u003c/p\u003e\u003cdiv class=\"EquationNumber\"\u003e3\u003c/div\u003e\u003c/div\u003e\u003c/p\u003e \u003cp\u003eIn this study, after the dataset underwent one-hot encoding, the categorical features of the original data were transformed into numerical features. These categorical features refer specifically to the column names of the dataset, preserving not only their independence but also ensuring compatibility with convolutional neural network models. Subsequently, after normalization, all data in the dataset can be converted into PyTorch two-dimensional tensors using the `torch.size()` function, preparing them for model training. The normalized feature data and the label data stored in the original dataset are separately stored in two tensors, \u003cem\u003eX\u003c/em\u003e and \u003cem\u003eY\u003c/em\u003e. Based on the dimensions of the divided training and testing sets, the dimensions of tensors \u003cem\u003eX\u003c/em\u003e and \u003cem\u003eY\u003c/em\u003e are updated as follows: the dimensions of the training set features `\u003cem\u003etrain_X\u003c/em\u003e` are torch.Size([1780,7]), the dimensions of the training set labels `\u003cem\u003etrain_Y\u003c/em\u003e` are torch.Size([1780,1]), the dimensions of the testing set features `\u003cem\u003etest_X\u003c/em\u003e` are torch.Size([445,7]), and the dimensions of the testing set labels `\u003cem\u003etest_Y\u003c/em\u003e` are torch.Size([445,1]).\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec9\" class=\"Section2\"\u003e \u003ch2\u003eExperimental environment and parameters\u003c/h2\u003e \u003cp\u003eIn this study, the PyTorch deep learning framework and the CNN (Convolutional Neural Network) algorithm were employed. PyTorch tensors, used instead of NumPy's ndarray data structure, offer automatic differentiation capabilities. This feature enables automatic computation of tensor gradients, which plays a crucial role in training neural networks. The environment parameters configuration is detailed in Table\u0026nbsp;\u003cspan refid=\"Tab2\" class=\"InternalRef\"\u003e2\u003c/span\u003e.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab2\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 2\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eParameter configuration of python\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"2\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"char\" char=\".\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eParameter\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eConfiguration\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ePandas\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e1.1.5\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eNumpy\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e1.19.5\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eTorch\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e1.10.2\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eMatplotlib\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e3.3.4\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eScikit-learn\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e0.24.2\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003eKeras\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"char\" char=\".\" colname=\"c2\"\u003e \u003cp\u003e2.10.0\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003cdiv id=\"Sec10\" class=\"Section3\"\u003e \u003ch2\u003eTraining parameters\u003c/h2\u003e \u003cp\u003eThe parameters for training the CNN network model in this article are shown in Table\u0026nbsp;\u003cspan refid=\"Tab3\" class=\"InternalRef\"\u003e3\u003c/span\u003e.\u003c/p\u003e \u003cp\u003e \u003cdiv class=\"gridtable\"\u003e\u003ctable float=\"Yes\" id=\"Tab3\" border=\"1\"\u003e \u003ccaption language=\"En\"\u003e \u003cdiv class=\"CaptionNumber\"\u003eTable 3\u003c/div\u003e \u003cdiv class=\"CaptionContent\"\u003e \u003cp\u003eCNN network dataset parameter configuration\u003c/p\u003e \u003c/div\u003e \u003c/caption\u003e \u003ccolgroup cols=\"2\"\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c1\" colnum=\"1\"\u003e\u003c/div\u003e \u003cdiv align=\"left\" class=\"colspec\" colname=\"c2\" colnum=\"2\"\u003e\u003c/div\u003e \u003cthead\u003e \u003ctr\u003e \u003cth align=\"left\" colname=\"c1\"\u003e \u003cp\u003eParameter\u003c/p\u003e \u003c/th\u003e \u003cth align=\"left\" colname=\"c2\"\u003e \u003cp\u003eConfiguration\u003c/p\u003e \u003c/th\u003e \u003c/tr\u003e \u003c/thead\u003e \u003ctbody\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003edata_frame\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003e[2225,13]\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003efeatures_columns\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003e[2225,8]\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003etrain_X.shape\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003etorch.Size([1780,7])\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003etrain_y.shape\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003etorch.Size([1780,1])\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003etest_X.shape\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003etorch.Size([445,7])\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003etest_y.shape\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003etorch.Size([445,1])\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003ebatch_size\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003e32\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003ctr\u003e \u003ctd align=\"left\" colname=\"c1\"\u003e \u003cp\u003enum_epochs\u003c/p\u003e \u003c/td\u003e \u003ctd align=\"left\" colname=\"c2\"\u003e \u003cp\u003e\u003cb\u003e100\u003c/b\u003e\u003c/p\u003e \u003c/td\u003e \u003c/tr\u003e \u003c/tbody\u003e \u003c/colgroup\u003e \u003c/table\u003e\u003c/div\u003e \u003c/p\u003e \u003c/div\u003e \u003c/div\u003e \u003cdiv id=\"Sec11\" class=\"Section2\"\u003e \u003ch2\u003eTraining Process\u003c/h2\u003e \u003cp\u003eBefore constructing the CNN neural network model, it is essential to set up a crucial component: the data loader. The data loader divides input data into multiple small batches, loading only one batch at a time during each training iteration. This approach ensures faster gradient descent and parameter updates when using batched data. Data loaders are used to manage and store data for both the training and testing sets, ensuring efficient handling and utilization of data throughout the model training process.\u003c/p\u003e \u003cp\u003eDuring the training process of the CNN network model, an outer loop first iterates over the number of training epochs, setting the model to training mode to enable specific layers such as dropout and batch normalization. Throughout training, backpropagation is repeatedly used to compute gradients for each parameter. However, performing backpropagation multiple times can lead to gradient explosion, causing the model to fail to train properly and resulting in overflow errors in numerical computations. Therefore, gradient clipping is introduced to prevent such distortions.After training is completed, the iterated data is fed into the test model to compute the output. The loss function is then used to measure the loss between the predicted values and the true labels. The model's performance is ultimately validated using the Mean Squared Error (MSE). A lower MSE value, approaching zero, indicates better model performance. The formula for calculating MSE is shown in Eq.\u0026nbsp;(\u003cspan refid=\"Equ4\" class=\"InternalRef\"\u003e4\u003c/span\u003e),where n is the number of samples,\u003cem\u003ey\u003c/em\u003e\u003csub\u003e\u003cem\u003ei\u003c/em\u003e\u003c/sub\u003e is the true value of the i-th sample, and\u003cspan class=\"InlineEquation\"\u003e\u003cspan class=\"mathinline\"\u003e\\({\\hat {y}_i}\\)\u003c/span\u003e\u003c/span\u003eis the predicted value of the i-th sample.\u003cdiv id=\"Equ4\" class=\"Equation\"\u003e\u003cdiv format=\"TEX\" class=\"mathdisplay\" id=\"FileID_Equ4\" name=\"EquationSource\"\u003e\n$$MSE=\\frac{1}{n}\\sum\\limits_{{i=1}}^{n} {{{({y_i} - {{\\hat {y}}_i})}^2}}$$\u003c/div\u003e\u003cdiv class=\"EquationNumber\"\u003e4\u003c/div\u003e\u003c/div\u003e\u003c/p\u003e \u003cp\u003eIn this study, the constructed CNN model incorporates an adaptive pooling layer, which automatically calculates the size of each pooling window based on the input feature map size and the target output size. This simplifies the feature extraction process. After passing through the adaptive pooling layer, the lengths of the two sets of tensor sequences are adjusted to 10. These tensors are then flattened according to the channel number and sequence length and sequentially fed into two fully connected layers. Each set of feature values is combined with the initial weights of the input and output nodes and mapped to the predicted values. Consequently, the shapes of the tensors for the training and testing sets are adjusted accordingly.\u003c/p\u003e \u003c/div\u003e \u003cdiv id=\"Sec12\" class=\"Section2\"\u003e \u003ch2\u003eModel innovation\u003c/h2\u003e \u003cp\u003eCompared to Recurrent Neural Networks (RNNs), this study opts to use Convolutional Neural Networks (CNNs) for data training and prediction for several reasons:\u003c/p\u003e \u003cp\u003e \u003col\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eHigh Spatial Structure Utilization: The convolutional layers in CNN models can effectively capture spatial local features in the input data. For two-dimensional tensors, the convolution operation achieves weight sharing spatially. As the convolution kernel slides systematically over the input data, the model can extract features from various parts in a directional sequence.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eParameter Sharing in Convolutions: During convolution operations, the same convolutional kernel is applied across the entire input image, with the weights on the convolution kernel remaining identical. This significantly reduces the number of parameters the model needs to process, thereby enhancing computational efficiency and the model's generalization ability. Additionally, parameter sharing confers translational invariance to the convolutional layers, allowing the convolutional kernel to correctly identify features regardless of where they appear in the data.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003cspan\u003e \u003cli\u003e \u003cp\u003eMulti-Scale Feature Extraction: Through multiple layers of convolution and pooling operations, CNN models can progressively extract multi-scale features from the data. Low-level convolutions can capture edge features in the input data, while high-level convolutions can extract object features contained within the input data.\u003c/p\u003e \u003c/li\u003e \u003c/span\u003e \u003c/ol\u003e \u003c/p\u003e \u003c/div\u003e"},{"header":"Results","content":"\u003cp\u003eWhen processing time series data, RNN recurrent neural networks are commonly used for analysis. In order to more intuitively demonstrate which model is more advantageous between CNN and RNN in processing student data and making predictions, this study used the LSTM algorithm for comparison \u003csup\u003e\u003cspan citationid=\"CR17\" class=\"CitationRef\"\u003e17\u003c/span\u003e\u003c/sup\u003e.\u003c/p\u003e \u003cp\u003eThe xLSTM algorithm extends upon LSTM to enhance model performance and the capability to handle complex sequential data. It introduces an exponential gating mechanism to provide the model with more dynamic information filtering capabilities. Additionally, it incorporates additional normalization and stabilization techniques to mitigate numerical stability issues arising from the exponential gating. The design objective of xLSTM is to address limitations of traditional LSTM in handling large-scale data and long sequences, such as poor parallelism and limited storage capacity. By introducing new gating mechanisms and memory structures, xLSTM aims to be more competitive in deep learning applications. The prediction results of xLSTM are depicted in Fig.\u0026nbsp;\u003cspan refid=\"Fig3\" class=\"InternalRef\"\u003e3\u003c/span\u003e.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eBased on the parameters described above, the CNN convolutional neural network model is constructed and the data training is initiated. To ensure the training results are as accurate as possible, the training is set for 100 epochs. Using Python, implement the CNN convolutional neural network algorithm by storing the target student's data information in the form of a numpy array, performing feature extraction, Min-Max normalization, regularization, and tensor conversion. Finally, input the transformed data tensors into the CNN model to compute the prediction values and output them, updating the original dataset. The prediction results of CNN convolutional neural network model are shown in Fig.\u0026nbsp;\u003cspan refid=\"Fig4\" class=\"InternalRef\"\u003e4\u003c/span\u003e.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eThe comparison of mean square error (MSE) and root mean square error (RMSE) between CNN convolutional neural network model and xLSTM algorithm is shown in Fig.\u0026nbsp;\u003cspan refid=\"Fig5\" class=\"InternalRef\"\u003e5\u003c/span\u003e.\u003c/p\u003e \u003cp\u003e \u003c/p\u003e \u003cp\u003eIn comparison to the predictions of the xLSTM algorithm, the CNN model performs better in both numerical prediction and model performance validation. Despite xLSTM's strong performance in handling time series data, in this study, the CNN model excels in predicting and analyzing student grade data over an entire academic year. The fixed two-dimensional tensor dimensions are advantageous for convolutional operations in the CNN model. Conversely, models built on xLSTM require the decomposition of two-dimensional tensors into one-dimensional tensors for training and analysis, potentially leading to feature loss during intermediate processes, thereby affecting prediction outcomes.\u003c/p\u003e"},{"header":"Discussion","content":"\u003cp\u003eThis paper analyzes student performance over a school year's large-scale exams, incorporating personal information such as age, gender, and school to conduct multidimensional performance analysis. Leveraging CNN convolutional neural networks within the PyTorch programming environment, compared to RNN recurrent neural networks and Transformer technology, CNNs are more suitable for handling spatially structured and large-scale data. Their inherent features of parameter sharing, automatic feature extraction, and strong transfer learning capabilities distinguish CNNs among various technologies, making them widely applicable across different domains. Therefore, this study chooses CNN models for performance prediction analysis, ensuring stability and accuracy of the predictions to a certain extent. After multiple training iterations with input data fed into the model, the predicted results undergo validation through mean squared error checks, establishing the reliability of using this network model for predictive analysis with a degree of confidence in the data.\u003c/p\u003e \u003cp\u003eThe model still has its limitations. For instance, the performance data only considers scores from large-scale exams within the current school year, which spans a significant period. The study interval of one month between exams may lead to substantial fluctuations in students' day-to-day learning states, thereby questioning the reliability of the chosen exam scores. Additionally, the collected personal information about students, including age, school, and enrollment in specialized classes, are factors that could significantly influence performance but are immutable. The study did not explore potentially influential mutable factors such as classroom behavior and psychological activities of the students. Considering these variables could potentially alter the predictive outcomes. These are aspects that warrant further investigation.\u003c/p\u003e "},{"header":"Declarations","content":"\u003ch2\u003eAuthor Contribution\u003c/h2\u003e\u003cp\u003eW.X. proposed research directions and innovative points, and analyzed the experimental results. C.G. provided the dataset and wrote code to complete the experimental part of the paper. H.Y. is responsible for writing, polishing, formatting, and formatting the paper. All authors have read and agreed to the published version of the manuscript.\u003c/p\u003e\u003ch2\u003eData Availability\u003c/h2\u003e\u003cp\u003eThe dataset generated and analyzed in this study cannot be made public as it contains information that may compromise the privacy of research participants. However, it can be obtained from the corresponding authors upon reasonable request.\u003c/p\u003e"},{"header":"References","content":"\u003col\u003e\u003cli\u003e\u003cspan\u003eWang Zang. Research on Learning Status and Grade Prediction Method Based on Deep Learning [D]. Guizhou University. DOI: (2023). \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.27047/d.cnki.ggudu.2023.000655\u003c/span\u003e\u003cspan address=\"10.27047/d.cnki.ggudu.2023.000655\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eSayed, A. R., Khafagy, M. H. \u0026amp; Ali, M. Marwa Hussien Mohamed,Predict student learning styles and suitable assessment methods using click stream.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eWang, G. H., Zhang, J. \u0026amp; Fu, G. S. Predicting student behaviors and performance in online learning using decision tree. 2018 Seventh International Conference of Educational Innovation through Technology (Eitt 2018) [J]. 214\u0026ndash;219. (2018).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eWang \u0026amp; Xiaoli Yuan Junhong. Grade Prediction Model Based on Weighted Naive Bayes Classification Method. Electronics Technology and Software Engineering [J]. (19): 225\u0026ndash;226. (2013).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAshenafi, M. M., Riccardi, G. \u0026amp; Ronchetti, M. Predicting students' final exam scores from their course activities. Frontiers in Education Conference (Fie), 372\u0026ndash;380. (2015) [J].2015.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHu Jintao. \u003cem\u003eResearch and Implementation of Student Performance Prediction Teaching System Based on C4.5 Decision Tree\u003c/em\u003e (Southwest Jiaotong University [D], 2017).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHillebrand, E., Lukas, M. \u0026amp; Wei, W. Bagging weak predictors. \u003cem\u003eInt. J. Forecast. [J]\u003c/em\u003e. \u003cb\u003e37\u003c/b\u003e (1), 237\u0026ndash;254 (2021).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAhmed, D. M., Abdulazeez, A. M. \u0026amp; Zeebaree, D. Q. Ahmed Fyh. Predicting university's students performance based on machine learning techniques[C]//2021 IEEE International Conference on Automatic Control \u0026amp; Intelligent Systems (I2CACIS).2021.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eOkubo, F., Yamashita, T., Shimada, A. \u0026amp; Ogata, H. A neural network approach for students' performance prediction. Seventh International Learning Analytics \u0026amp; Knowledge Conference (Lak'17) [J]. 598\u0026ndash;599. (2017).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eKalyani, B. S., Harisha, D., Ramyakrishna, V. \u0026amp; Manne, S. Evaluation of students performance using neural networks. Intelligent Computing, Information and Control Systems, Iciccs 2019 [J]. 1039: 499\u0026ndash;505. (2020).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eHongjiang, C. \u0026amp; Xie Jin.. Research on Learning Performance Prediction Based on LSTM and Its Influencing Factors. Journal of Beijing University of Posts and Telecommunications (Social Sciences Edition) [J]. 22 (06): 90\u0026ndash;100. (2020).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eQu, S. J., Li, K., Wu, B., Zhang, S. H. \u0026amp; Wang, Y. C. Predicting student achievement based on temporal learning behavior in MOOCs. \u003cem\u003eAppl. Sciences-Basel [J]\u003c/em\u003e \u003cb\u003e9\u003c/b\u003e(24). (2019).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eAljaloud, A. S. et al. A deep learning model to predict student learning outcomes in LMS using CNN and LSTM. \u003cem\u003eIEEE Access. [J]\u003c/em\u003e. \u003cb\u003e10\u003c/b\u003e, 85255\u0026ndash;85265 (2022).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eFang Tao. \u003cem\u003eResearch on Student Performance Prediction Model Based on Ensemble Learning Algorithms\u003c/em\u003e (Guilin University of Electronic Technology [D], 2022).\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eWang, C. \u0026amp; Research on Performance Prediction Method Based on Student Online Learning Behavior [D].. Guilin University of Electronic Technology, DOI: (2022). \u003cspan class=\"ExternalRef\"\u003e\u003cspan class=\"RefSource\"\u003e10.27049/d.cnki.ggldc.2022.000414\u003c/span\u003e\u003cspan address=\"10.27049/d.cnki.ggldc.2022.000414\" targettype=\"DOI\" class=\"RefTarget\"\u003e\u003c/span\u003e\u003c/span\u003e\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eDeng, J. \u0026amp; Huang, X. Xiaopeng Ren,A multidimensional analysis of self-esteem and individualism: A deep learning-based model for predicting elementary school students' academic performance.\u003c/span\u003e\u003c/li\u003e \u003cli\u003e\u003cspan\u003eSun Ruiqi. \u003cem\u003eResearch on Prediction Model of US Stock Index Price Trends Based on LSTM Neural Network [D]\u003c/em\u003e (Capital University of Economics and Business, 2016).\u003c/span\u003e\u003c/li\u003e\u003c/ol\u003e"}],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":true,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":true,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":false,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":false,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true},"keywords":"Deep learning, Grade prediction, Convolutional neural network, Feature extraction","lastPublishedDoi":"10.21203/rs.3.rs-4967448/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-4967448/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003cp\u003eStudent performance serves as a crucial indicator for assessing learning outcomes across various educational institutions. Conducting reasonable predictions and analyses can provide insights into students' future academic achievements. Predicting student performance is a significant research direction in the current exploration of educational data analysis patterns. Accurate predictions can assist educational administrators and teachers in promptly identifying academic risks, optimizing the allocation of scarce educational resources, and consequently improving education quality and learning outcomes. This paper establishes a Convolutional Neural Network (CNN) prediction model, constructing training and testing datasets using PyTorch tensors based on existing student information data. By extracting target information columns, the model identifies patterns within the data and ultimately predicts a student's score in a specific subject for their next exam. Upon completing the predictions, the results are displayed in a chart alongside existing scores for analysis, providing a reference for developing subsequent training programs.\u003c/p\u003e","manuscriptTitle":"Research on Student Performance Prediction Based on Deep Learning","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2024-10-10 10:33:33","doi":"10.21203/rs.3.rs-4967448/v1","editorialEvents":[{"type":"communityComments","content":0}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"researchsquare","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":true,"externalIdentity":"","sideBox":"","snPcode":"","submissionUrl":"/submission","title":"Research Square","twitterHandle":"researchsquare","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"","reportingPortfolio":"","inReviewEnabled":false,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"de4c2459-c176-43b3-8ec9-cb886634e9a9","owner":[],"postedDate":"October 10th, 2024","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"posted","subjectAreas":[{"id":38603485,"name":"Physical sciences/Mathematics and computing/Computational science"},{"id":38603486,"name":"Physical sciences/Mathematics and computing/Computer science"},{"id":38603487,"name":"Physical sciences/Mathematics and computing/Information technology"}],"tags":[],"updatedAt":"2025-01-10T09:53:13+00:00","versionOfRecord":[],"versionCreatedAt":"2024-10-10 10:33:33","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-4967448","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-4967448","identity":"rs-4967448","version":["v1"]},"buildId":"qtupq5eGEP_6zYnWcrvyt","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}